System

Abstract

A system is provided.SOLUTION: A system comprising: means for providing a plurality of design parts based on a design theme individually selected by a user; means for generating a design preview based on the design parts selected by the user; means for confirming intellectual property rights of each of the design parts used in the generated design preview and calculating a license fee; means for presenting the license fee to the user and processing payment; and means for generating and providing a final design file to the user after the payment is completed.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] While modern design generation tools allow users to freely personalize their designs, intellectual property issues pose a major barrier. In particular, there is a risk that AI-generated designs may infringe on others' intellectual property, potentially exposing companies and individuals to legal issues. While AI-generated designs allow users to intuitively customize designs, there is also the issue of limited freedom of customization. This invention aims to resolve these issues and provide a platform that allows users to safely and freely generate and customize designs. [Means for solving the problem]

[0005] The present invention solves the above-mentioned problems by providing a system including the following means: means for providing a plurality of design parts based on a design theme individually selected by a user, means for generating a design preview based on the design parts selected by the user, means for verifying the intellectual property rights of each design part used in the generated design preview and calculating a license fee, means for presenting the license fee to the user and processing payment, and means for generating a final design file and providing it to the user after payment is complete.

[0006] The system also includes a means for generating a design preview using AI based on the selected design theme and design parts, and a means for verifying and authenticating the user's credentials, thereby ensuring user safety.

[0007] Therefore, the present invention provides an environment in which users can freely create designs by achieving both personalization of designs and protection of intellectual property rights.

[0008] "User" means any individual or entity that utilizes the Design Platform to select and customize a Design.

[0009] A "design theme" refers to a category of designs with a particular style or visual characteristics, and is used by users to set their desired design direction.

[0010] "Design parts" refers to the individual elements that make up a design, specifically the background, font, color, buttons, etc.

[0011] "Design Preview" refers to an initial visual representation of a design generated based on the theme and parts selected by a user.

[0012] "Intellectual Property Rights" means any legal rights, including copyright, trademark, patent, etc., in and to the Design Parts and Generated Designs.

[0013] "License Fee" means the amount payable to the Intellectual Property Rights Owner for the Design Elements used by the User.

[0014] "AI" refers to artificial intelligence technology, particularly technology used to generate optimal design previews based on design themes and parts.

[0015] "Authentication Information" means information such as email address and password required by a User to access and use the Platform.

[0016] "Payment Information" means your financial information, such as credit card information, used to pay license fees for use of a Design. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9]1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram illustrating a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] The following describes an embodiment of the present invention. The present invention is a system that allows users to freely personalize designs while protecting intellectual property rights. In this system, the user selects a design theme and design parts, generates a design preview based on the selected design, and finally confirms the intellectual property rights, calculates the license fee, and provides the final design file once payment is completed.

[0039] Overall system overview

[0040] The system consists of three main components: the user, the terminal, and the server. The user selects a design theme and sends a request to the server through the terminal. The server loads the related design parts and generates a design preview. The server then verifies the intellectual property rights, calculates the license fee, and presents it to the user. Once the user pays the license fee, the server generates the final design file and provides it to the user.

[0041] Program processing and natural language explanation

[0042] 1. User Authentication

[0043] User: Accesses the platform and enters their email address and password on the login screen.

[0044] Terminal: Sends the entered email address and password to the server.

[0045] Server: Checks the credentials in the database and returns the authentication result to the device.

[0046] Terminal: Displays the authentication result, and if authentication is successful, proceeds to the next step.

[0047] 2. Select a design theme

[0048] User: Select the desired theme (e.g. "Modern") from the list of design themes.

[0049] Device: Sends the selected theme ID to the server.

[0050] Server: Loads design elements related to the theme (background, font, color, etc.) from the database and sends them to the terminal.

[0051] Terminal: Displays the loaded design parts to the user.

[0052] 3. Selecting a design configuration

[0053] User: Select each part from the displayed design parts (e.g., main background "blue", button "circle", etc.).

[0054] Terminal: Sends information about the selected design parts to the server.

[0055] Server: Generates an initial design preview using the selected parts and sends it to the device.

[0056] Terminal: The generated preview image is displayed and the user is asked to confirm it.

[0057] 4. Generate and preview your design

[0058] User: Check the preview image and reselect parts and color schemes as necessary.

[0059] Terminal: Sends part information to the server again based on the new selection (if a reselection occurs).

[0060] Server: [Using AI] generates the final design based on the selected theme and components and sends it to the device as a preview image.

[0061] Terminal: Shows the final preview image to the user.

[0062] 5. Intellectual Property Verification and License Fee Calculation

[0063] Server: Check the intellectual property rights status of all design parts used in the final preview.

[0064] Server: Based on the confirmed intellectual property rights, calculates the required license fees and sends the detailed information to the terminal.

[0065] Terminal: Shows the user the license fee and its breakdown.

[0066] 6. Payment of license fee and finalization of design

[0067] User: Enter your credit card information according to the license fee payment information displayed.

[0068] Terminal: Sends payment information to the server and initiates the payment process.

[0069] Server: Performs payment processing and sends the processing results to the terminal.

[0070] Terminal: Notifies the user that the payment has been completed.

[0071] 7. Download your design

[0072] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[0073] Terminal: Display and provide the download link to the user.

[0074] User: Click the download link to save the final design file to your device.

[0075] Specific examples

[0076] For example, suppose a user selects the "Modern" design theme, "Blue" as the main background, and "Circular" as the button style. After the user selects these, the server uses AI to instantly generate a preview image that reflects the selected background and button style.

[0077] Next, the user confirms the license fee calculation and enters their credit card information to make the payment. The server processes the payment, generates the final design files, and provides a download link. Finally, the user can click the link to download and use the design files.

[0078] In this way, users can easily create their own preferred designs while ensuring both customization of the design and protection of intellectual property rights.

[0079] The processing flow will be explained below.

[0080] Step 1:

[0081] User: Accesses the platform and enters their email address and password on the login screen.

[0082] Terminal: Sends the entered email address and password to the server.

[0083] Server: Checks the credentials in the database and returns the authentication result to the device.

[0084] Terminal: Displays the authentication result. If authentication is successful, the user can proceed to the next step.

[0085] Step 2:

[0086] User: On the home screen, select the desired theme (e.g., "Modern") from the list of design themes.

[0087] Device: Sends the selected theme ID to the server.

[0088] Server: Loads design elements related to the theme (background, fonts, colors, etc.) from the database and sends them to the device.

[0089] Terminal: Displays the loaded design parts to the user.

[0090] Step 3:

[0091] User: Select each part from the displayed design parts (e.g., main background "blue", button "circle", etc.).

[0092] Terminal: Sends information about the selected design parts to the server.

[0093] Server: Using the selected parts, generate an initial design preview using AI, and send the generated preview image to the device.

[0094] Terminal: The generated preview image is displayed to the user.

[0095] Step 4:

[0096] User: Check the preview image and reselect design elements and color schemes as needed.

[0097] Terminal: Sends design part information to the server again based on the new selection (if reselection occurs).

[0098] Server: Generates an updated design preview using the reselected parts and sends it to the device.

[0099] Terminal: Show updated preview image to user.

[0100] Step 5:

[0101] Server: Based on the final selected design parts, it checks the intellectual property rights, calculates the license fee for each part, and sends the detailed information to the terminal.

[0102] Terminal: Displays intellectual property information and license fee details to the user.

[0103] Step 6:

[0104] User: Confirm license fee payment information and enter payment information, including credit card information.

[0105] Terminal: Sends the entered payment information to the server.

[0106] Server: Performs payment processing and sends the processing results to the terminal.

[0107] Terminal: Notifies the user that the payment has been completed.

[0108] Step 7:

[0109] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[0110] On the device: Display the download link to the user.

[0111] User: Click the download link and save the final design file to your device.

[0112] By following these steps, users can complete the process of selecting a design theme and parts, generating and confirming a design based on those themes, and finally paying the license fee and downloading the design.

[0113] Example 1

[0114] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0115] With conventional design generation systems, it is difficult for users to easily personalize designs according to their preferences, and the process of verifying intellectual property rights and calculating license fees is cumbersome. Therefore, there is a need for a system that allows users to quickly and easily generate designs and use them while protecting appropriate intellectual property rights.

[0116] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0117] In this invention, the server includes means for providing a plurality of design components based on a design theme individually selected by the user, means for generating a design preview based on the design components selected by the user, means for checking the intellectual property rights of each design component used in the generated design preview and calculating a license fee, means for presenting the license fee to the user and processing payment, and means for generating a final design file and providing it to the user after payment is completed, thereby enabling users to easily personalize designs and use them while appropriately protecting their intellectual property rights.

[0118] A "design theme" is a category that can be selected by the user to determine the basic style, color scheme, and components of the overall system design.

[0119] "Design components" are specific design parts such as background, font, color, button shape, etc. that are selected based on the design theme.

[0120] A "design preview" is a display image that the system generates based on the selected design components, allowing you to preview how the final design will look.

[0121] "Intellectual Property Rights" means copyright, patent, trademark, or other legal rights protected in and to the Design Elements and combinations thereof.

[0122] "License Fee" means the fee payable for the use of a Design Component used in a Generated Design.

[0123] "Payment processing means" refers to the system and process that processes payment information, such as credit card information, used by users to pay license fees.

[0124] A "final design file" is a file containing the final generated design based on the design theme and design components selected by the user.

[0125] An embodiment of the present invention will be described. The present invention is a system that allows users to freely personalize designs while protecting intellectual property rights. This system consists of three main components: a user, a terminal, and a server. A user selects a design theme and sends a request to the server through their terminal. The server loads related design components and generates a design preview. The server then verifies the intellectual property rights, calculates a license fee, and presents it to the user. Once the user pays the license fee, the server generates the final design file and provides it to the user. This process also uses a generative model to streamline the generation of the design preview.

[0126] Hardware and software used

[0127] The system of the present invention uses the following hardware and software:

[0128] Servers: Database servers, servers for running AI generative models (e.g., TensorFlow or PyTorch-based models), and license management systems.

[0129] Device: A device operated by a user, such as a computer, smartphone, or tablet.

[0130] Software: web browser, payment system (e.g. Stripe, PayPal, etc.), design preview display system.

[0131] Program processing

[0132] 1. User Authentication

[0133] User: Accesses the platform and enters their email address and password on the login screen.

[0134] Terminal: Sends the entered email address and password to the server.

[0135] Server: Checks the credentials in the database and returns the authentication result to the device.

[0136] Terminal: Displays the authentication result, and if authentication is successful, proceeds to the next step.

[0137] 2. Select a design theme

[0138] User: Select the desired theme (e.g. "Modern") from the list of design themes.

[0139] Device: Sends the selected theme ID to the server.

[0140] Server: Loads the design elements related to the theme (background, fonts, colors, etc.) from a database and sends them to the device.

[0141] Terminal: Displays the loaded design components to the user.

[0142] 3. Selecting a design configuration

[0143] User: Select each part from the displayed design components (e.g., main background "blue", button "circle", etc.).

[0144] Terminal: Sends information about the selected design components to the server.

[0145] Server: Generates an initial design preview using the selected parts and sends it to the device.

[0146] Terminal: The generated preview image is displayed and the user is asked to confirm it.

[0147] 4. Generate and preview your design

[0148] User: Check the preview image and reselect parts and color schemes as necessary.

[0149] Terminal: Sends part information to the server again based on the new selection (if a reselection occurs).

[0150] Server: Uses the generative model to generate the final design based on the selected theme and components, and sends it to the device as a preview image.

[0151] Terminal: Shows the final preview image to the user.

[0152] 5. Intellectual Property Verification and License Fee Calculation

[0153] Server: Check the intellectual property rights status of all design elements used in the final preview.

[0154] Server: Based on the confirmed intellectual property rights, calculates the required license fees and sends the details to the terminal.

[0155] Terminal: Shows the user the license fee and its breakdown.

[0156] 6. Payment of license fee and finalization of design

[0157] User: Enter your credit card information according to the license fee payment information displayed.

[0158] Terminal: Sends payment information to the server and initiates the payment process.

[0159] Server: Performs payment processing and sends the processing results to the terminal.

[0160] Terminal: Notifies the user that the payment has been completed.

[0161] 7. Download your design

[0162] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[0163] Terminal: Display and provide the download link to the user.

[0164] User: Click the download link to save the final design file to your device.

[0165] Specific examples

[0166] For example, suppose a user selects the "Modern" design theme, chooses "Blue" as the main background, and selects "Circular" as the button style. The user makes these selections, and the server uses the generative model to instantly generate a preview image that reflects the selected background and button style.

[0167] Next, the user confirms the license fee calculation and enters their credit card information to make the payment. The server processes the payment, generates the final design files, and provides a download link. Finally, the user can click the link to download and use the design files.

[0168] Prompt Sentence Examples

[0169] "If a user selects 'Modern' as the design theme, 'Blue' as the main background, and 'Circular' as the button, explain how the system generates the design, verifies intellectual property rights, and provides the final design file."

[0170] In this way, this system allows users to freely personalize their designs while properly protecting their intellectual property rights and providing a concrete means for easily generating and obtaining design files.

[0171] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0172] Step 1:

[0173] User authentication

[0174] User: Access the platform, enter your email address and password on the login screen, and click the "Login" button.

[0175] Input: Email address, password

[0176] Terminal: Sends the entered email address and password to the server.

[0177] Output: Authentication request

[0178] Server: Matches the received email address and password with the credentials in its database and generates an authentication status.

[0179] Input: Authentication Request

[0180] Output: Authentication result (success or failure)

[0181] Terminal: Displays the authentication result, and if authentication is successful, proceeds to the next step. If authentication fails, displays an error message.

[0182] Output: Display of authentication result

[0183] Step 2:

[0184] Select a design theme

[0185] User: After logging in, select the desired theme (e.g. "Modern") from the list of design themes displayed.

[0186] Input: Selected Design Theme

[0187] Device: Sends the selected theme ID to the server.

[0188] Output: Send theme ID

[0189] Server: Based on the theme ID, retrieves related design elements (background, font, color, etc.) from the database and sends them to the device.

[0190] Input: Theme ID

[0191] Output: Associated design components

[0192] Terminal: Displays the design components received from the server to the user.

[0193] Output: Display of design components

[0194] Step 3:

[0195] Selecting a design configuration

[0196] User: Select each part (e.g., main background "blue," button "circle," etc.) from the displayed design components.

[0197] Input: Selected design component

[0198] Terminal: Collects information about the selected design components and sends their IDs to the server.

[0199] Output: Send ID of design component

[0200] Server: Based on the IDs of the received design components, it generates an initial design preview and sends it to the device.

[0201] Input: ID of the design component

[0202] Output: Initial design preview image

[0203] Terminal: The generated preview image is displayed to the user.

[0204] Output: Show preview image

[0205] Step 4:

[0206] Generate and preview your design

[0207] User: Check the preview image and reselect parts and color schemes if necessary. If there is no need to reselect, proceed to the next step.

[0208] Input: Reselected design components

[0209] Terminal: Sends part information to the server again based on the new selection (if a reselection occurs).

[0210] Output: Sending reselected part information

[0211] Server: Uses the generative model to generate the final design based on the selected theme and components, and sends it to the device as a preview image.

[0212] Input: Reselected part information

[0213] Output: Final preview image

[0214] Terminal: Shows the final preview image to the user.

[0215] Output: Display final preview image

[0216] Step 5:

[0217] Intellectual property verification and license fee calculation

[0218] Server: All design elements used in the final preview are checked against a database to verify their intellectual property rights.

[0219] Inputs: Design components used in the final preview

[0220] Output: Intellectual property rights verification results

[0221] Server: Based on the confirmed intellectual property rights, calculates the required license fees and sends the details to the terminal.

[0222] Input: Intellectual property rights confirmation result

[0223] Output: License fee details

[0224] Terminal: Shows the user the license fee and its breakdown.

[0225] Output: Display license fee

[0226] Step 6:

[0227] Pay the license fee and finalize the design

[0228] User: Enter your credit card information according to the license fee payment information displayed.

[0229] Input: Credit card information

[0230] Terminal: Sends payment information to the server and initiates the payment process.

[0231] Output: Send payment information

[0232] Server: Performs payment processing and sends the processing results to the terminal.

[0233] Input: Payment information

[0234] Output: Payment processing result

[0235] Terminal: Notifies the user that the payment has been completed.

[0236] Output: Notification of successful payment

[0237] Step 7:

[0238] Download the design

[0239] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[0240] Input: Payment confirmation

[0241] Output: Final design files, download link

[0242] On the device: Show the download link to the user.

[0243] Output: Download link displayed

[0244] User: Click the download link to save the final design file to your device.

[0245] Input: Download link

[0246] Output: Save the final design file

[0247] (Application example 1)

[0248] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0249] In the modern design industry, there is a growing need for users to create their own customized designs. However, when users freely create designs, it is difficult to protect the intellectual property rights of the designs and calculate appropriate license fees. It is also challenging to quickly provide users with generated design previews and safely store and download the final design files. Furthermore, a system that can perform these processes seamlessly is required.

[0250] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0251] In this invention, the server includes: means for providing multiple design elements based on a design theme individually selected by the user; means for generating a design preview based on the design elements selected by the user; means for verifying intellectual property rights of each design element used in the generated design preview and calculating a license fee; means for presenting the license fee to the user and processing payment; means for generating a final design file and providing it to the user after payment is completed; means for sending a notification to the user's device; and means for saving the final design file in cloud storage and generating a download link. This allows users to freely customize designs, protect intellectual property rights, and ensure appropriate license fee payment. It also enables users to quickly and securely obtain the final design file.

[0252] "User" means an individual or organization that utilizes the system to customize a design and obtain a final design file.

[0253] A "design theme" is a setting selected by the user that indicates the overall design direction or style.

[0254] "Design elements" are the individual elements that make up a design, including background, font, color, etc.

[0255] A "design preview" is a preliminary visual representation of a design that is generated based on user-selected design elements.

[0256] "Intellectual property rights" refers to rights protected by law, such as copyrights, patents, and trademarks, relating to design parts.

[0257] "License Fee" means the amount paid as consideration for the use of Design Parts.

[0258] "Final Design File" means the final and completed design data generated based on the user's customized design.

[0259] A "terminal" is an electronic device such as a computer, smartphone, or tablet that a user uses to operate the system.

[0260] "Cloud storage" refers to a remote storage device where data can be stored and accessed over the Internet.

[0261] "Download Link" means the URL or hyperlink where a User can obtain the Final Design File via the Internet.

[0262] "Notification" refers to messages such as update information and processing results sent from the system to the user.

[0263] A "generative AI model" is a program that uses artificial intelligence to automatically generate designs based on user selections.

[0264] A "server" is a computer system used to process user requests and provide data.

[0265] The following describes the mode for carrying out the present invention. The system of the present invention allows users to freely customize designs and provides functions to protect intellectual property rights. This system consists of three main components: a user, a terminal, and a server.

[0266] Program processing and natural language explanation

[0267] 1. User Authentication

[0268] User: Accesses the system and enters their email address and password on the login screen.

[0269] Terminal: Sends the entered credentials to the server.

[0270] Server: Checks the user's credentials in a database (e.g., MySQL) and returns the authentication result to the device (e.g., "Authentication successful").

[0271] Terminal: Displays the authentication result, and if successful, allows you to proceed to the next step.

[0272] 2. Design theme and product selection

[0273] User: In the system, select the product to customize (e.g., a phone case) and the design theme (e.g., "Modern").

[0274] Terminal: Sends the selected product ID and design theme ID to the server.

[0275] Server: Loads relevant design elements (background, fonts, colors, etc.) from the database and sends them to the device.

[0276] 3. Selecting a design configuration

[0277] User: Selects the background color "blue" and the button "circle" from the design elements displayed on the terminal.

[0278] Terminal: Sends the selected design element information to the server.

[0279] Server: Based on the user's selections, generates an initial design preview and sends it to the device.

[0280] 4. Generate and preview your design

[0281] User: Review the design preview and reselect design elements as needed.

[0282] Terminal: If the user makes a new selection, it sends that information back to the server.

[0283] Server: Uses a generative AI model (e.g., Stable Diffusion) to generate the final design and send it to the device as a preview.

[0284] Terminal: Shows the final preview image to the user.

[0285] 5. Identifying Intellectual Property Rights and Calculating License Fees

[0286] Server: Check the intellectual property rights status of all design elements used in the final design (e.g., using Google Cloud Vision AI).

[0287] Server: Calculates the license fee based on the confirmed intellectual property rights and sends the details to the terminal.

[0288] Terminal: Shows the user the license fee and its breakdown.

[0289] 6. Payment of License Fees

[0290] User: Enter your credit card information according to the license fee payment information.

[0291] Terminal: Sends payment information to the server and initiates the payment process (e.g., using Stripe).

[0292] Server: Performs payment processing and sends the result to the terminal.

[0293] Terminal: Displays a payment completion notification to the user.

[0294] 7. Final design provided

[0295] Server: After payment is confirmed, generate the final design files and store them in cloud storage (e.g. AWS S3).

[0296] Server: Generates the download link and sends it to the device.

[0297] On your device: You can display a download link to the user, allowing them to obtain the design file.

[0298] Examples and prompts

[0299] As a concrete example, we will show what a user would do to customize a smartphone case with a "modern" design theme.

[0300] Example prompt sentence:

[0301] Choose "Modern" as the design theme for your customized phone case, then select "Blue" as the background color and "Circle" as the button shape.

[0302] The system allows users to customize designs in real time, streamlines intellectual property rights verification and licensing payments, and securely stores final design files for immediate download.

[0303] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0304] Step 1:

[0305] User authentication

[0306] Input: The user enters their email address and password into the terminal and sends a request to the server.

[0307] Data processing / calculation: The server performs authentication by checking the received email address and password information against a database (e.g., using a MySQL database).

[0308] Specific behavior: The server performs a database query to check the credentials and generates an authentication result.

[0309] Output: The server returns the authentication result to the terminal, which displays it to the user. If the authentication is successful, proceed to the next step.

[0310] Step 2:

[0311] Design theme and product selection

[0312] Input: The user selects a product and design theme on the system and sends it to the terminal.

[0313] Data processing / calculation: The terminal sends the selected product ID and design theme ID to the server, which retrieves the corresponding design elements from the database.

[0314] Specific operation: Based on the product ID and theme ID, the server executes a database query and loads the corresponding design elements.

[0315] Output: The server sends the acquired design element data to the terminal, and the terminal displays a list of design elements to the user.

[0316] Step 3:

[0317] Selecting a design configuration

[0318] Input: The user selects a design element (e.g., background "blue," button "circle") and presses the confirm button on the terminal.

[0319] Data processing / calculation: The device sends the design element selection information to the server, which then generates an initial design preview based on this information. For example, a generative AI model (Stable Diffusion) is used.

[0320] Specific operation: The server receives the selection information and invokes the generative AI model to generate an initial design preview.

[0321] Output: The server sends the generated preview image data to the terminal, which displays it to the user.

[0322] Step 4:

[0323] Generate and preview your design

[0324] Input: The user checks the preview image and reselects the design elements if necessary. If there is reselection, the information is entered into the terminal.

[0325] Data processing / calculation: The terminal sends the reselected design element information to the server, and the server generates a new design preview. If there is no reselection, the final design is reflected in the preview.

[0326] Specific operation: The server receives the reselection information and calls the generative AI model again to update the design preview.

[0327] Output: The server sends the updated preview image data to the terminal, which displays it to the user.

[0328] Step 5:

[0329] Identifying intellectual property rights and calculating license fees

[0330] Input: The server retrieves information about all design elements used in the final design preview.

[0331] Data processing / calculation: The server uses the acquired design element information to check the intellectual property rights status (using Google Cloud Vision AI, etc.), and calculates the license fee based on the results of the check.

[0332] Specific operation: The server obtains intellectual property information, calculates and sums up the license fees for each design element.

[0333] Output: The server sends the license fee details to the terminal, which displays them to the user.

[0334] Step 6:

[0335] License fee payment

[0336] Input: The user enters the license fee payment information into the terminal and begins the payment process.

[0337] Data processing / calculation: The terminal sends payment information (such as credit card information) to the server, which processes the payment using a payment system (such as Stripe).

[0338] Specific operation: The server passes the received payment information to the payment system and executes the payment process.

[0339] Output: The server sends the result of the payment process to the terminal, which notifies the user.

[0340] Step 7:

[0341] Final design provided

[0342] Input: The server will generate the final design files after confirming payment.

[0343] Data processing / calculation: The server saves the final design data in cloud storage (e.g., AWS S3) and generates a download link.

[0344] Specific operation: The server uploads the final design data and obtains a download link from the cloud storage service.

[0345] Output: The server sends a download link to the device, which displays it to the user, who then uses the download link to get the final design file.

[0346] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0347] The following describes an embodiment of the present invention. The present invention is a system that aims to promote the creative creation and personalization of designs while ensuring the protection of intellectual property rights. This system incorporates an emotion engine, which adds functionality to recognize a user's emotions and suggest and adjust design themes and parts based on those emotions.

[0348] Overall system overview

[0349] The system consists of three main components: the user, the device, and the server, and is equipped with an emotion engine. The user selects a design theme and sends a request to the server via their device. The server loads the relevant design parts and generates a design preview. During the generation process, the emotion engine recognizes the user's emotions and provides appropriate advice and adjustments. The server also verifies intellectual property rights, calculates the license fee, and presents it to the user. Once the user pays the license fee, the server generates the final design file and provides it to the user.

[0350] Program processing and natural language explanation

[0351] 1. User Authentication

[0352] User: Accesses the platform and enters their email address and password on the login screen.

[0353] Terminal: Sends the entered email address and password to the server.

[0354] Server: Checks the credentials in the database and returns the authentication result to the device.

[0355] Terminal: Displays the authentication result. If authentication is successful, the user can proceed to the next step.

[0356] 2. Select a design theme

[0357] User: On the home screen, select the desired theme (e.g., "Modern") from the list of design themes.

[0358] Device: Sends the selected theme ID to the server.

[0359] Server: Loads design elements related to the theme (background, font, color, etc.) from the database and sends them to the terminal.

[0360] Terminal: Displays the loaded design parts to the user.

[0361] 3. Emotion Recognition by Emotion Engine

[0362] Device: The emotion engine is activated and analyzes the user's facial expressions and voice using the device's camera, microphone, etc.

[0363] Server: Detects the user's emotional state based on the emotional data sent from the emotion engine.

[0364] Server: Based on the detected emotions, suggests appropriate design themes and parts to the user.

[0365] 4. Selecting a design configuration

[0366] User: Select each part from the displayed design parts (e.g., main background "blue", button "circle", etc.).

[0367] Terminal: Sends information about the selected design parts to the server.

[0368] Server: Using the selected parts, generate an initial design preview using AI, and send the generated preview image to the device.

[0369] Terminal: The generated preview image is displayed to the user.

[0370] Emotion engine: Re-analyzes user responses and suggests corrections if necessary.

[0371] 5. Intellectual Property Verification and License Fee Calculation

[0372] Server: Based on the final selected design parts, it checks the intellectual property rights, calculates the license fee for each part, and sends the detailed information to the terminal.

[0373] Terminal: Displays intellectual property information and license fee details to the user.

[0374] 6. Payment of license fee and finalization of design

[0375] User: Confirm license fee payment information and enter payment information, including credit card information.

[0376] Terminal: Sends the entered payment information to the server.

[0377] Server: Performs payment processing and sends the processing results to the terminal.

[0378] Terminal: Notifies the user that the payment has been completed.

[0379] 7. Download your design

[0380] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[0381] On the device: Display the download link to the user.

[0382] User: Click the download link and save the final design file to your device.

[0383] Specific examples

[0384] For example, suppose a user selects the "Modern" design theme, "Blue" as the main background, and "Circular" as the button style. After the user selects these, the server uses AI to instantly generate a preview image that reflects the selected background and button style.

[0385] The emotion engine analyzes the user's facial expressions and voice to determine whether they are satisfied, for example. If they are not satisfied, the emotion engine will suggest alternatives, and the user can make a new selection based on those suggestions.

[0386] Next, the user confirms the license fee calculation and enters their credit card information to make the payment. The server processes the payment, generates the final design files, and provides a download link. Finally, the user can click the link to download and use the design files.

[0387] In this way, users can easily generate designs that match their emotions using the emotion engine while ensuring both design customization and protection of intellectual property rights.

[0388] The processing flow will be explained below.

[0389] Step 1:

[0390] User: Accesses the platform and enters their email address and password on the login screen.

[0391] Terminal: Sends the entered email address and password to the server.

[0392] Server: Checks the credentials in the database and returns the authentication result to the device.

[0393] Terminal: Displays the authentication result. If authentication is successful, the user can proceed to the next step.

[0394] Step 2:

[0395] User: On the home screen, select the desired theme (e.g., "Modern") from the list of design themes.

[0396] Device: Sends the selected theme ID to the server.

[0397] Server: Loads design elements related to the theme (background, font, color, etc.) from the database and sends them to the terminal.

[0398] Terminal: Displays the loaded design parts to the user.

[0399] Step 3:

[0400] Device: The emotion engine is activated and analyzes the user's facial expressions and voice using the device's camera, microphone, etc.

[0401] Server: Detects the user's emotional state based on the emotional data sent from the emotion engine.

[0402] Server: Based on the detected emotions, suggests appropriate design themes and parts to the user.

[0403] On the device: Display suggestions to the user based on the detected emotions.

[0404] Step 4:

[0405] User: Select each part from the displayed design parts (e.g., main background "blue", button "circle", etc.).

[0406] Terminal: Sends information about the selected design parts to the server.

[0407] Server: Using the selected parts, generate an initial design preview using AI, and send the generated preview image to the device.

[0408] Terminal: The generated preview image is displayed to the user.

[0409] Step 5:

[0410] User: Check the preview image and reselect design elements and color schemes as needed.

[0411] Terminal: Sends design part information to the server again based on the new selection (if reselection occurs).

[0412] Server: Generates an updated design preview using the reselected parts and sends it to the device.

[0413] Terminal: Show updated preview image to user.

[0414] Emotion engine: Re-analyzes user responses and suggests corrections if necessary.

[0415] Step 6:

[0416] Server: Based on the final selected design parts, it checks the intellectual property rights, calculates the license fee for each part, and sends the detailed information to the terminal.

[0417] Terminal: Displays intellectual property information and license fee details to the user.

[0418] Step 7:

[0419] User: Confirm license fee payment information and enter payment information, including credit card information.

[0420] Terminal: Sends the entered payment information to the server.

[0421] Server: Performs payment processing and sends the processing results to the terminal.

[0422] Terminal: Notifies the user that the payment has been completed.

[0423] Step 8:

[0424] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[0425] On the device: Display the download link to the user.

[0426] User: Click the download link and save the final design file to your device.

[0427] Through these steps, users can select a design theme and elements, generate a design based on them, review it, and finally download it after paying the license fee. The addition of an emotion engine enables more appropriate suggestions and modifications based on the user's emotions, improving the user experience.

[0428] Example 2

[0429] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0430] When customizing and personalizing designs, it is difficult to automatically suggest appropriate design elements that match the user's emotions, while simultaneously generating the final design quickly and effectively while protecting intellectual property rights. There is also a need to automate the selection of design elements and the generation of previews that meet diverse user needs. This allows users to carry out the design process easily and intuitively, but conventional systems have had difficulty meeting this requirement.

[0431] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0432] In this invention, the server includes: means for providing multiple design elements based on a design theme individually selected by the user; means for generating a design preview based on the design elements selected by the user; means for verifying intellectual property rights of each design element used in the generated design preview and calculating a license fee; means for presenting the license fee to the user and processing payment; means for generating a final design file and providing it to the user after payment is completed; means for recognizing the user's emotions; and means for suggesting appropriate design elements based on the recognized emotions. This enables automatic suggestion of design elements that match the user's emotions. Furthermore, a system can be provided that protects intellectual property rights, streamlines the design generation process, and simplifies design customization and personalization.

[0433] "User" means any person or entity that uses the System to enjoy the convenience of customizing and personalizing designs.

[0434] A "design theme" is a collective term for multiple visual styles or concepts that a user can select, and which determine the basic direction and atmosphere of a design.

[0435] "Design elements" are individual parts related to a design theme and include specific design components such as background, font, color, and shape.

[0436] A "design preview" is a preliminary visual representation of a design that is generated by combining design elements selected by the user.

[0437] "Intellectual Property Rights" means legal rights in and to design elements and other creative works, including copyright, trademark, and patent rights.

[0438] A "license fee" is a fee paid to the owner of the intellectual property rights, and is a fee required when a user uses a design element.

[0439] "Emotion recognition" is the process of analyzing data such as a user's facial expressions and voice to determine their emotional state (e.g., joy, sadness, surprise, etc.).

[0440] "Generative model" is a general term for algorithms and techniques for generating design previews using artificial intelligence.

[0441] "Authentication Information" refers to the credentials, such as email address and password, that a user uses to access a system.

[0442] "Authentication processing" is a process of verifying the authentication information of a user attempting to access a system and determining whether the user has the right to access the system.

[0443] The present invention is a system that aims to promote the creative creation and personalization of designs while ensuring the protection of intellectual property rights. The system incorporates an emotion engine that recognizes the user's emotions and suggests and adjusts design themes and parts based on those emotions.

[0444] System configuration

[0445] This system consists of three main components: the user, the terminal, and the server, and is equipped with an emotion engine.

[0446] 1. User: The user accesses the system through an interface and selects design themes and parts. The user also has the ability to adjust the design based on suggestions from the emotion engine.

[0447] 2. Device: A computer or mobile device used by a user. The device sends input from the user to the server and displays the data received from the server. The device also runs an emotion engine and captures the user's emotions using a camera or microphone.

[0448] 3. Server: The server processes data received from users, manages design parts and theme data, generates design previews using generative AI models, and is also responsible for intellectual property rights verification and license fee calculation.

[0449] System Operation

[0450] The general operation flow of this system is as follows:

[0451] 1. User Authentication

[0452] The user logs in to the system using their email address and password. The device sends this information to the server, which then performs the authentication process. If the authentication is successful, the user proceeds to the next step.

[0453] 2. Select a design theme

[0454] The user selects a desired theme from a list of design themes, and the device sends the theme ID to the server, which then loads the associated design parts from the database and sends them to the device.

[0455] 3. Emotion Recognition by Emotion Engine

[0456] The device activates the emotion engine and captures the user's facial expressions and voice in real time using a camera and microphone. The server analyzes the emotion data and suggests appropriate design parts based on the user's emotional state.

[0457] 4. Selecting a design configuration

[0458] The user selects each design part from the displayed list, and the device sends the selection information to the server, which then uses the generative AI model to generate a design preview and sends it to the device.

[0459] 5. Intellectual Property Verification and License Fee Calculation

[0460] The server checks the intellectual property rights of the design parts used in the design preview and calculates the license fee, and the calculation result is presented to the user via the terminal.

[0461] 6. Payment of license fee and finalization of design

[0462] The user confirms the license fee and enters payment information. The server processes the payment and, upon completion, generates the final design files and provides a download link.

[0463] 7. Download your design

[0464] The user clicks on the download link to get the final design file.

[0465] Specific examples

[0466] For example, if a user selects the "Modern" design theme, "Blue" for the main background, and "Circular" for the button shape, the server instantly generates a preview image using the generative AI model. The emotion engine analyzes the user's emotions from their facial expressions and voice to confirm whether they are satisfied. If it determines that they are not satisfied, the emotion engine will suggest alternatives and the user can make another selection.

[0467] Prompt Sentence Examples

[0468] Please explain in detail the processing steps of a system where a user selects a design theme, analyzes their emotions using an emotion engine, and suggests appropriate design parts.

[0469] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0470] Step 1: User authentication

[0471] Input: The user enters their email address and password.

[0472] Processing: The device encodes the entered email address and password and sends them to the server using the HTTPS protocol. The server checks the received credentials against its database to determine if a matching user exists.

[0473] Output: The server returns the authentication result (success or failure) to the terminal. The terminal displays the authentication result to the user and proceeds to the next step if the authentication is successful.

[0474] Step 2: Choose a design theme

[0475] Input: The user selects the desired theme from a list of design themes provided on the home screen.

[0476] Processing: The device sends the ID of the selected theme to the server, which loads the design elements associated with the theme (background, font, color, etc.) from a database and sends this information to the device.

[0477] Output: The terminal visually displays the loaded design elements to the user.

[0478] Step 3: Emotion recognition by the emotion engine

[0479] Input: As the user views the design elements, the device uses the camera and microphone to capture the user's emotional data (facial expressions and voice).

[0480] Processing: The device processes the emotion data and sends it to the server in real time. The server then uses an emotion engine to analyze the emotion data and determine the user's emotional state.

[0481] Output: The server generates data suggesting appropriate design elements and themes based on the user's emotional state and sends it to the device. The device then presents the suggested data to the user.

[0482] Step 4: Select a design configuration

[0483] Input: The user selects each part from the proposed design elements (e.g., main background "blue," button "circular," etc.).

[0484] Processing: The device sends information about the selected design elements to the server, which uses the generative AI model to create a design preview and sends this preview image to the device.

[0485] Output: The device displays the generated design preview to the user and then activates the emotion engine to analyze the user's reaction and, if necessary, suggest further revisions.

[0486] Step 5: Identifying intellectual property and calculating license fees

[0487] Input: When the user performs an action to finalize the design preview, the server receives information about the design elements used.

[0488] Processing: The server checks the intellectual property rights of the selected design elements, calculates the license fee for each element, and then sums up the calculated license fees to calculate the total license fee.

[0489] Output: The server sends the license fee details to the terminal, which displays them to the user.

[0490] Step 6: Pay the license fee and finalize the design

[0491] Input: The user confirms the proposed license fee and enters payment information (such as credit card information).

[0492] Processing: The terminal sends the payment information to the server using the HTTPS protocol. The server processes the payment and returns the processing result to the terminal. If the payment is successful, the server generates the final design file.

[0493] Output: The terminal will notify the user of the payment result. After notifying that the payment was successful, a download link will be displayed.

[0494] Step 7: Download your design

[0495] Input: User clicks on download link.

[0496] Processing: The server generates the final design file and sends a secure download link to the device, which displays this link to the user.

[0497] Output: Users can click a link to save the final design file to their device.

[0498] (Application example 2)

[0499] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0500] Conventional design generation systems offer limited design parts and themes to users, and do not adequately personalize the design based on individual emotions and preferences. Furthermore, it is difficult to visualize designs in real space, making it difficult to maximize user satisfaction. Furthermore, the verification of intellectual property rights and the calculation of license fees are complex, making the system cumbersome for users. These issues need to be resolved.

[0501] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0502] In this invention, the server includes: means for providing multiple design components based on a design theme individually selected by the user; means for generating a design forecast based on the design components selected by the user; means for verifying intellectual property rights for each design component used in the generated design forecast and calculating royalties; means for presenting royalties to the user and processing payment; means for generating a final design file and providing it to the user after payment is completed; means for recognizing the user's emotions and suggesting and adjusting design themes and components based on the emotions; and means for applying and visualizing the design forecast in real space through the user's scaled display device. This allows the user to receive design suggestions based on their own emotions and make a satisfying design selection through visualization in real space. Furthermore, intellectual property rights verification and license fee calculation are automated, simplifying use.

[0503] 1. "Design Theme" means the overall style or concept of a design that a user can choose from.

[0504] 2. "Design Components" refers to the individual parts or elements that make up a design theme, such as background, font, color, shape, etc.

[0505] 3. "Design Preview" is a preview of the design generated based on the design components selected by the user.

[0506] 4. "Intellectual Property Rights" means legally protected rights in design parts and themes.

[0507] 5. "Royalty" means the fee payable for the use of any Intellectual Property Rights-containing item.

[0508] 6. "Means for recognizing emotions" refers to technology or devices that analyze a user's facial expressions and voice to recognize their emotional state.

[0509] 7. "Means for suggesting and adjusting" refers to the function of recommending appropriate design themes and components to users based on the recognized user emotions.

[0510] 8. "Scaled display device" refers to a device that uses augmented reality (AR) technology to apply designs to real-world space and allow users to visualize them.

[0511] The following describes an embodiment of the present invention: This invention is a system that provides multiple design components based on a design theme individually selected by a user, proposes designs based on the user's emotions, and visualizes the final design in the user's real space.

[0512] Overall system configuration

[0513] The system consists of three main components: the user, the device, and the server. The device includes a scaled display device (e.g., smart glasses), and the server includes an emotion engine (e.g., Emotion API) that recognizes emotions and makes suggestions, and a generative AI model (e.g., Generative Adversarial Networks, hereafter referred to as "GAN") that generates design predictions. It also has the ability to visualize the design predictions in real space using 3D modeling software (e.g., Blender).

[0514] System Procedures

[0515] 1. User Authentication

[0516] The user enters login information through the terminal and sends it to the server. The server performs authentication processing and returns the results to the terminal.

[0517] 2. Select a design theme

[0518] The user selects a design theme using the terminal interface, and the selection is sent to the server, which loads and sends the associated design parts to the terminal.

[0519] 3. Emotion Recognition by Emotion Engine

[0520] The device's built-in camera and microphone capture the user's facial expressions and voice in real time and send the data to a server, which then uses an emotion engine to analyze the user's emotions.

[0521] 4. Design prediction and proposal

[0522] The server makes design suggestions based on emotions and generates design predictions using a generative AI model (GAN) based on the design components selected by the user. The generated design predictions are sent to the device and displayed to the user.

[0523] 5. AR Preview

[0524] The generated design predictions are applied and visualized in real space using the user's scaled display device (smart glasses), and previewed in real time using 3D modeling software (Blender).

[0525] 6. Intellectual property rights verification and license management

[0526] The server checks the intellectual property rights of each design component used in the design forecast and calculates the royalty. The calculation results are sent to the terminal and presented to the user.

[0527] 7. Payment Processing and Download of Final Design

[0528] Once the user pays the license fee, the server generates the final design file and sends a download link to the device, which the user clicks to download the design file.

[0529] Specific examples

[0530] For example, if a user selects a "minimalist" design theme, sets the wall color to "white," and the furniture style to "modern," the smart glasses will reflect those settings in the AR preview of the room in real time. The emotion engine analyzes the user's satisfaction level from their facial expressions and may suggest changing the color to "light gray" if the user is not satisfied.

[0531] Example prompts to input to the generative AI model

[0532] "Generate a living room design preview with a minimalist theme, white wall color, and modern furniture style."

[0533] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0534] Step 1:

[0535] User Authentication

[0536] The user enters login information (email address and password) through the device interface. The device sends this authentication information to the server. The server checks the authentication information in the database and returns the authentication result to the device. The device displays the authentication result to the user, and if authentication is successful, the user can proceed to the next step.

[0537] Input: User login information

[0538] Output: Authentication result (success or failure)

[0539] Specific operations: Sending authentication information, checking database, displaying authentication results

[0540] Step 2:

[0541] Select a design theme

[0542] The user selects the desired theme from a list of design themes presented on the device's home screen. The device then sends the selected theme's ID to the server. The server then loads design elements (background, font, color, etc.) associated with the theme from the database and sends them to the device. The device then displays the loaded design elements to the user.

[0543] Input: Design theme selection information

[0544] Output: Display of related design parts

[0545] Specific operations: Select design theme, send theme ID, load design parts, display selection candidates

[0546] Step 3:

[0547] emotion recognition

[0548] The device's built-in camera and microphone capture the user's facial expressions and voice in real time and send the data to a server, which then uses an emotion engine (e.g., Emotion API) to analyze the emotion data and detect the user's emotional state.

[0549] Input: User's facial expression data, voice data

[0550] Output: Emotional state detection result

[0551] Specific operations: data capture, data transmission, emotion analysis, emotional state detection

[0552] Step 4:

[0553] Design prediction and proposal

[0554] The server proposes appropriate design components based on the user's emotional state. Based on the design components selected by the user, a design forecast is generated using a generative AI model (e.g., GAN). The generated design forecast is sent to the device and displayed to the user.

[0555] Input: User's emotional state, selected design part

[0556] Output: Generated design predictions

[0557] Specific actions: Proposals based on emotional state, prediction generation by generative AI model

[0558] Step 5:

[0559] AR Preview

[0560] The server generates design predictions that are then visualized in real space through a scaled display device (e.g., smart glasses) on the device. A real-time preview is performed using 3D modeling software (e.g., Blender). The user can review the preview and accept suggested revisions if necessary.

[0561] Input: Generated design forecast

[0562] Output: Visualized design preview in real space

[0563] Specific operation: Applying design predictions, displaying real-time samples

[0564] Step 6:

[0565] Intellectual property rights verification and license management

[0566] The server checks the intellectual property rights of each design part used in the design forecast and calculates the usage fee. The calculated usage fee is sent to the terminal and displayed to the user. The user then approves the payment.

[0567] Input: Information on the design components used in the design prediction

[0568] Output: Calculation result of usage fee, presented to the user

[0569] Specific operations: Checking intellectual property rights, calculating royalties, displaying royalties

[0570] Step 7:

[0571] Payment processing and download of final design

[0572] The user approves the license fee and enters payment information. The entered payment information is sent to the server, which processes the payment. Once payment is complete, the server generates the final design file and sends a download link to the device. The user downloads the design file from the link.

[0573] Input: Payment information

[0574] Output: Payment completion notification, download link for the final design file

[0575] Specific actions: Sending payment information, processing payments, sending links, downloading files

[0576] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0577] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0578] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0579] [Second embodiment]

[0580] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0581] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0582] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0583] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0584] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0585] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0586] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0587] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0588] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0589] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0590] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0591] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0592] The following describes an embodiment of the present invention. The present invention is a system that allows users to freely personalize designs while protecting intellectual property rights. In this system, the user selects a design theme and design parts, generates a design preview based on the selected design, and finally confirms the intellectual property rights, calculates the license fee, and provides the final design file once payment is completed.

[0593] Overall system overview

[0594] The system consists of three main components: the user, the terminal, and the server. The user selects a design theme and sends a request to the server through the terminal. The server loads the related design parts and generates a design preview. The server then verifies the intellectual property rights, calculates the license fee, and presents it to the user. Once the user pays the license fee, the server generates the final design file and provides it to the user.

[0595] Program processing and natural language explanation

[0596] 1. User Authentication

[0597] User: Accesses the platform and enters their email address and password on the login screen.

[0598] Terminal: Sends the entered email address and password to the server.

[0599] Server: Checks the credentials in the database and returns the authentication result to the device.

[0600] Terminal: Displays the authentication result, and if authentication is successful, proceeds to the next step.

[0601] 2. Select a design theme

[0602] User: Select the desired theme (e.g. "Modern") from the list of design themes.

[0603] Device: Sends the selected theme ID to the server.

[0604] Server: Loads design elements related to the theme (background, font, color, etc.) from the database and sends them to the terminal.

[0605] Terminal: Displays the loaded design parts to the user.

[0606] 3. Selecting a design configuration

[0607] User: Select each part from the displayed design parts (e.g., main background "blue", button "circle", etc.).

[0608] Terminal: Sends information about the selected design parts to the server.

[0609] Server: Generates an initial design preview using the selected parts and sends it to the device.

[0610] Terminal: The generated preview image is displayed and the user is asked to confirm it.

[0611] 4. Generate and preview your design

[0612] User: Check the preview image and reselect parts and color schemes as necessary.

[0613] Terminal: Sends part information to the server again based on the new selection (if a reselection occurs).

[0614] Server: [Using AI] generates the final design based on the selected theme and components and sends it to the device as a preview image.

[0615] Terminal: Shows the final preview image to the user.

[0616] 5. Intellectual Property Verification and License Fee Calculation

[0617] Server: Check the intellectual property rights status of all design parts used in the final preview.

[0618] Server: Based on the confirmed intellectual property rights, calculates the required license fees and sends the detailed information to the terminal.

[0619] Terminal: Shows the user the license fee and its breakdown.

[0620] 6. Payment of license fee and finalization of design

[0621] User: Enter your credit card information according to the license fee payment information displayed.

[0622] Terminal: Sends payment information to the server and initiates the payment process.

[0623] Server: Performs payment processing and sends the processing results to the terminal.

[0624] Terminal: Notifies the user that the payment has been completed.

[0625] 7. Download your design

[0626] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[0627] Terminal: Display and provide the download link to the user.

[0628] User: Click the download link to save the final design file to your device.

[0629] Specific examples

[0630] For example, suppose a user selects the "Modern" design theme, "Blue" as the main background, and "Circular" as the button style. After the user selects these, the server uses AI to instantly generate a preview image that reflects the selected background and button style.

[0631] Next, the user confirms the license fee calculation and enters their credit card information to make the payment. The server processes the payment, generates the final design files, and provides a download link. Finally, the user can click the link to download and use the design files.

[0632] In this way, users can easily create their own preferred designs while ensuring both customization of the design and protection of intellectual property rights.

[0633] The processing flow will be explained below.

[0634] Step 1:

[0635] User: Accesses the platform and enters their email address and password on the login screen.

[0636] Terminal: Sends the entered email address and password to the server.

[0637] Server: Checks the credentials in the database and returns the authentication result to the device.

[0638] Terminal: Displays the authentication result. If authentication is successful, the user can proceed to the next step.

[0639] Step 2:

[0640] User: On the home screen, select the desired theme (e.g., "Modern") from the list of design themes.

[0641] Device: Sends the selected theme ID to the server.

[0642] Server: Loads design elements related to the theme (background, fonts, colors, etc.) from the database and sends them to the device.

[0643] Terminal: Displays the loaded design parts to the user.

[0644] Step 3:

[0645] User: Select each part from the displayed design parts (e.g., main background "blue", button "circle", etc.).

[0646] Terminal: Sends information about the selected design parts to the server.

[0647] Server: Using the selected parts, generate an initial design preview using AI, and send the generated preview image to the device.

[0648] Terminal: The generated preview image is displayed to the user.

[0649] Step 4:

[0650] User: Check the preview image and reselect design elements and color schemes as needed.

[0651] Terminal: Sends design part information to the server again based on the new selection (if reselection occurs).

[0652] Server: Generates an updated design preview using the reselected parts and sends it to the device.

[0653] Terminal: Show updated preview image to user.

[0654] Step 5:

[0655] Server: Based on the final selected design parts, it checks the intellectual property rights, calculates the license fee for each part, and sends the detailed information to the terminal.

[0656] Terminal: Displays intellectual property information and license fee details to the user.

[0657] Step 6:

[0658] User: Confirm license fee payment information and enter payment information, including credit card information.

[0659] Terminal: Sends the entered payment information to the server.

[0660] Server: Performs payment processing and sends the processing results to the terminal.

[0661] Terminal: Notifies the user that the payment has been completed.

[0662] Step 7:

[0663] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[0664] On the device: Display the download link to the user.

[0665] User: Click the download link and save the final design file to your device.

[0666] By following these steps, users can complete the process of selecting a design theme and parts, generating and confirming a design based on those themes, and finally paying the license fee and downloading the design.

[0667] Example 1

[0668] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0669] With conventional design generation systems, it is difficult for users to easily personalize designs according to their preferences, and the process of verifying intellectual property rights and calculating license fees is cumbersome. Therefore, there is a need for a system that allows users to quickly and easily generate designs and use them while protecting appropriate intellectual property rights.

[0670] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0671] In this invention, the server includes means for providing a plurality of design components based on a design theme individually selected by the user, means for generating a design preview based on the design components selected by the user, means for checking the intellectual property rights of each design component used in the generated design preview and calculating a license fee, means for presenting the license fee to the user and processing payment, and means for generating a final design file and providing it to the user after payment is completed, thereby enabling users to easily personalize designs and use them while appropriately protecting their intellectual property rights.

[0672] A "design theme" is a category that can be selected by the user to determine the basic style, color scheme, and components of the overall system design.

[0673] "Design components" are specific design parts such as background, font, color, button shape, etc. that are selected based on the design theme.

[0674] A "design preview" is a display image that the system generates based on the selected design components, allowing you to preview how the final design will look.

[0675] "Intellectual Property Rights" means copyright, patent, trademark, or other legal rights protected in and to the Design Elements and combinations thereof.

[0676] "License Fee" means the fee payable for the use of a Design Component used in a Generated Design.

[0677] "Payment processing means" refers to the system and process that processes payment information, such as credit card information, used by users to pay license fees.

[0678] A "final design file" is a file containing the final generated design based on the design theme and design components selected by the user.

[0679] An embodiment of the present invention will be described. The present invention is a system that allows users to freely personalize designs while protecting intellectual property rights. This system consists of three main components: a user, a terminal, and a server. A user selects a design theme and sends a request to the server through their terminal. The server loads related design components and generates a design preview. The server then verifies the intellectual property rights, calculates a license fee, and presents it to the user. Once the user pays the license fee, the server generates the final design file and provides it to the user. This process also uses a generative model to streamline the generation of the design preview.

[0680] Hardware and software used

[0681] The system of the present invention uses the following hardware and software:

[0682] Servers: Database servers, servers for running AI generative models (e.g., TensorFlow or PyTorch-based models), and license management systems.

[0683] Device: A device operated by a user, such as a computer, smartphone, or tablet.

[0684] Software: web browser, payment system (e.g. Stripe, PayPal, etc.), design preview display system.

[0685] Program processing

[0686] 1. User Authentication

[0687] User: Accesses the platform and enters their email address and password on the login screen.

[0688] Terminal: Sends the entered email address and password to the server.

[0689] Server: Checks the credentials in the database and returns the authentication result to the device.

[0690] Terminal: Displays the authentication result, and if authentication is successful, proceeds to the next step.

[0691] 2. Select a design theme

[0692] User: Select the desired theme (e.g. "Modern") from the list of design themes.

[0693] Device: Sends the selected theme ID to the server.

[0694] Server: Loads the design elements related to the theme (background, fonts, colors, etc.) from a database and sends them to the device.

[0695] Terminal: Displays the loaded design components to the user.

[0696] 3. Selecting a design configuration

[0697] User: Select each part from the displayed design components (e.g., main background "blue", button "circle", etc.).

[0698] Terminal: Sends information about the selected design components to the server.

[0699] Server: Generates an initial design preview using the selected parts and sends it to the device.

[0700] Terminal: The generated preview image is displayed and the user is asked to confirm it.

[0701] 4. Generate and preview your design

[0702] User: Check the preview image and reselect parts and color schemes as necessary.

[0703] Terminal: Sends part information to the server again based on the new selection (if a reselection occurs).

[0704] Server: Uses the generative model to generate the final design based on the selected theme and components, and sends it to the device as a preview image.

[0705] Terminal: Shows the final preview image to the user.

[0706] 5. Intellectual Property Verification and License Fee Calculation

[0707] Server: Check the intellectual property rights status of all design elements used in the final preview.

[0708] Server: Based on the confirmed intellectual property rights, calculates the required license fees and sends the details to the terminal.

[0709] Terminal: Shows the user the license fee and its breakdown.

[0710] 6. Payment of license fee and finalization of design

[0711] User: Enter your credit card information according to the license fee payment information displayed.

[0712] Terminal: Sends payment information to the server and initiates the payment process.

[0713] Server: Performs payment processing and sends the processing results to the terminal.

[0714] Terminal: Notifies the user that the payment has been completed.

[0715] 7. Download your design

[0716] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[0717] Terminal: Display and provide the download link to the user.

[0718] User: Click the download link to save the final design file to your device.

[0719] Specific examples

[0720] For example, suppose a user selects the "Modern" design theme, chooses "Blue" as the main background, and selects "Circular" as the button style. The user makes these selections, and the server uses the generative model to instantly generate a preview image that reflects the selected background and button style.

[0721] Next, the user confirms the license fee calculation and enters their credit card information to make the payment. The server processes the payment, generates the final design files, and provides a download link. Finally, the user can click the link to download and use the design files.

[0722] Prompt Sentence Examples

[0723] "If a user selects 'Modern' as the design theme, 'Blue' as the main background, and 'Circular' as the button, explain how the system generates the design, verifies intellectual property rights, and provides the final design file."

[0724] In this way, this system allows users to freely personalize their designs while properly protecting their intellectual property rights and providing a concrete means for easily generating and obtaining design files.

[0725] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0726] Step 1:

[0727] User authentication

[0728] User: Access the platform, enter your email address and password on the login screen, and click the "Login" button.

[0729] Input: Email address, password

[0730] Terminal: Sends the entered email address and password to the server.

[0731] Output: Authentication request

[0732] Server: Matches the received email address and password with the credentials in its database and generates an authentication status.

[0733] Input: Authentication Request

[0734] Output: Authentication result (success or failure)

[0735] Terminal: Displays the authentication result, and if authentication is successful, proceeds to the next step. If authentication fails, displays an error message.

[0736] Output: Display of authentication result

[0737] Step 2:

[0738] Select a design theme

[0739] User: After logging in, select the desired theme (e.g. "Modern") from the list of design themes displayed.

[0740] Input: Selected Design Theme

[0741] Device: Sends the selected theme ID to the server.

[0742] Output: Send theme ID

[0743] Server: Based on the theme ID, retrieves related design elements (background, font, color, etc.) from the database and sends them to the device.

[0744] Input: Theme ID

[0745] Output: Associated design components

[0746] Terminal: Displays the design components received from the server to the user.

[0747] Output: Display of design components

[0748] Step 3:

[0749] Selecting a design configuration

[0750] User: Select each part (e.g., main background "blue," button "circle," etc.) from the displayed design components.

[0751] Input: Selected design component

[0752] Terminal: Collects information about the selected design components and sends their IDs to the server.

[0753] Output: Send ID of design component

[0754] Server: Based on the IDs of the received design components, it generates an initial design preview and sends it to the device.

[0755] Input: ID of the design component

[0756] Output: Initial design preview image

[0757] Terminal: The generated preview image is displayed to the user.

[0758] Output: Show preview image

[0759] Step 4:

[0760] Generate and preview your design

[0761] User: Check the preview image and reselect parts and color schemes if necessary. If there is no need to reselect, proceed to the next step.

[0762] Input: Reselected design components

[0763] Terminal: Sends part information to the server again based on the new selection (if a reselection occurs).

[0764] Output: Sending reselected part information

[0765] Server: Uses the generative model to generate the final design based on the selected theme and components, and sends it to the device as a preview image.

[0766] Input: Reselected part information

[0767] Output: Final preview image

[0768] Terminal: Shows the final preview image to the user.

[0769] Output: Display final preview image

[0770] Step 5:

[0771] Intellectual property verification and license fee calculation

[0772] Server: All design elements used in the final preview are checked against a database to verify their intellectual property rights.

[0773] Inputs: Design components used in the final preview

[0774] Output: Intellectual property rights verification results

[0775] Server: Based on the confirmed intellectual property rights, calculates the required license fees and sends the details to the terminal.

[0776] Input: Intellectual property rights confirmation result

[0777] Output: License fee details

[0778] Terminal: Shows the user the license fee and its breakdown.

[0779] Output: Display license fee

[0780] Step 6:

[0781] Pay the license fee and finalize the design

[0782] User: Enter your credit card information according to the license fee payment information displayed.

[0783] Input: Credit card information

[0784] Terminal: Sends payment information to the server and initiates the payment process.

[0785] Output: Send payment information

[0786] Server: Performs payment processing and sends the processing results to the terminal.

[0787] Input: Payment information

[0788] Output: Payment processing result

[0789] Terminal: Notifies the user that the payment has been completed.

[0790] Output: Notification of successful payment

[0791] Step 7:

[0792] Download the design

[0793] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[0794] Input: Payment confirmation

[0795] Output: Final design files, download link

[0796] On the device: Show the download link to the user.

[0797] Output: Download link displayed

[0798] User: Click the download link to save the final design file to your device.

[0799] Input: Download link

[0800] Output: Save the final design file

[0801] (Application example 1)

[0802] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0803] In the modern design industry, there is a growing need for users to create their own customized designs. However, when users freely create designs, it is difficult to protect the intellectual property rights of the designs and calculate appropriate license fees. It is also challenging to quickly provide users with generated design previews and safely store and download the final design files. Furthermore, a system that can perform these processes seamlessly is required.

[0804] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0805] In this invention, the server includes: means for providing multiple design elements based on a design theme individually selected by the user; means for generating a design preview based on the design elements selected by the user; means for verifying intellectual property rights of each design element used in the generated design preview and calculating a license fee; means for presenting the license fee to the user and processing payment; means for generating a final design file and providing it to the user after payment is completed; means for sending a notification to the user's device; and means for saving the final design file in cloud storage and generating a download link. This allows users to freely customize designs, protect intellectual property rights, and ensure appropriate license fee payment. It also enables users to quickly and securely obtain the final design file.

[0806] "User" means an individual or organization that utilizes the system to customize a design and obtain a final design file.

[0807] A "design theme" is a setting selected by the user that indicates the overall design direction or style.

[0808] "Design elements" are the individual elements that make up a design, including background, font, color, etc.

[0809] A "design preview" is a preliminary visual representation of a design that is generated based on user-selected design elements.

[0810] "Intellectual property rights" refers to rights protected by law, such as copyrights, patents, and trademarks, relating to design parts.

[0811] "License Fee" means the amount paid as consideration for the use of Design Parts.

[0812] "Final Design File" means the final and completed design data generated based on the user's customized design.

[0813] A "terminal" is an electronic device such as a computer, smartphone, or tablet that a user uses to operate the system.

[0814] "Cloud storage" refers to a remote storage device where data can be stored and accessed over the Internet.

[0815] "Download Link" means the URL or hyperlink where a User can obtain the Final Design File via the Internet.

[0816] "Notification" refers to messages such as update information and processing results sent from the system to the user.

[0817] A "generative AI model" is a program that uses artificial intelligence to automatically generate designs based on user selections.

[0818] A "server" is a computer system used to process user requests and provide data.

[0819] The following describes the mode for carrying out the present invention. The system of the present invention allows users to freely customize designs and provides functions to protect intellectual property rights. This system consists of three main components: a user, a terminal, and a server.

[0820] Program processing and natural language explanation

[0821] 1. User Authentication

[0822] User: Accesses the system and enters their email address and password on the login screen.

[0823] Terminal: Sends the entered credentials to the server.

[0824] Server: Checks the user's credentials in a database (e.g., MySQL) and returns the authentication result to the device (e.g., "Authentication successful").

[0825] Terminal: Displays the authentication result, and if successful, allows you to proceed to the next step.

[0826] 2. Design theme and product selection

[0827] User: In the system, select the product to customize (e.g., a phone case) and the design theme (e.g., "Modern").

[0828] Terminal: Sends the selected product ID and design theme ID to the server.

[0829] Server: Loads relevant design elements (background, fonts, colors, etc.) from the database and sends them to the device.

[0830] 3. Selecting a design configuration

[0831] User: Selects the background color "blue" and the button "circle" from the design elements displayed on the terminal.

[0832] Terminal: Sends the selected design element information to the server.

[0833] Server: Based on the user's selections, generates an initial design preview and sends it to the device.

[0834] 4. Generate and preview your design

[0835] User: Review the design preview and reselect design elements as needed.

[0836] Terminal: If the user makes a new selection, it sends that information back to the server.

[0837] Server: Uses a generative AI model (e.g., Stable Diffusion) to generate the final design and send it to the device as a preview.

[0838] Terminal: Shows the final preview image to the user.

[0839] 5. Identifying Intellectual Property Rights and Calculating License Fees

[0840] Server: Check the intellectual property rights status of all design elements used in the final design (e.g., using Google Cloud Vision AI).

[0841] Server: Calculates the license fee based on the confirmed intellectual property rights and sends the details to the terminal.

[0842] Terminal: Shows the user the license fee and its breakdown.

[0843] 6. Payment of License Fees

[0844] User: Enter your credit card information according to the license fee payment information.

[0845] Terminal: Sends payment information to the server and initiates the payment process (e.g., using Stripe).

[0846] Server: Performs payment processing and sends the result to the terminal.

[0847] Terminal: Displays a payment completion notification to the user.

[0848] 7. Final design provided

[0849] Server: After payment is confirmed, generate the final design files and store them in cloud storage (e.g. AWS S3).

[0850] Server: Generates the download link and sends it to the device.

[0851] On your device: You can display a download link to the user, allowing them to obtain the design file.

[0852] Examples and prompts

[0853] As a concrete example, we will show what a user would do to customize a smartphone case with a "modern" design theme.

[0854] Example prompt sentence:

[0855] Choose "Modern" as the design theme for your customized phone case, then select "Blue" as the background color and "Circle" as the button shape.

[0856] The system allows users to customize designs in real time, streamlines intellectual property rights verification and licensing payments, and securely stores final design files for immediate download.

[0857] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0858] Step 1:

[0859] User authentication

[0860] Input: The user enters their email address and password into the terminal and sends a request to the server.

[0861] Data processing / calculation: The server performs authentication by checking the received email address and password information against a database (e.g., using a MySQL database).

[0862] Specific behavior: The server performs a database query to check the credentials and generates an authentication result.

[0863] Output: The server returns the authentication result to the terminal, which displays it to the user. If the authentication is successful, proceed to the next step.

[0864] Step 2:

[0865] Design theme and product selection

[0866] Input: The user selects a product and design theme on the system and sends it to the terminal.

[0867] Data processing / calculation: The terminal sends the selected product ID and design theme ID to the server, which retrieves the corresponding design elements from the database.

[0868] Specific operation: Based on the product ID and theme ID, the server executes a database query and loads the corresponding design elements.

[0869] Output: The server sends the acquired design element data to the terminal, and the terminal displays a list of design elements to the user.

[0870] Step 3:

[0871] Selecting a design configuration

[0872] Input: The user selects a design element (e.g., background "blue," button "circle") and presses the confirm button on the terminal.

[0873] Data processing / calculation: The device sends the design element selection information to the server, which then generates an initial design preview based on this information. For example, a generative AI model (Stable Diffusion) is used.

[0874] Specific operation: The server receives the selection information and invokes the generative AI model to generate an initial design preview.

[0875] Output: The server sends the generated preview image data to the terminal, which displays it to the user.

[0876] Step 4:

[0877] Generate and preview your design

[0878] Input: The user checks the preview image and reselects the design elements if necessary. If there is reselection, the information is entered into the terminal.

[0879] Data processing / calculation: The terminal sends the reselected design element information to the server, and the server generates a new design preview. If there is no reselection, the final design is reflected in the preview.

[0880] Specific operation: The server receives the reselection information and calls the generative AI model again to update the design preview.

[0881] Output: The server sends the updated preview image data to the terminal, which displays it to the user.

[0882] Step 5:

[0883] Identifying intellectual property rights and calculating license fees

[0884] Input: The server retrieves information about all design elements used in the final design preview.

[0885] Data processing / calculation: The server uses the acquired design element information to check the intellectual property rights status (using Google Cloud Vision AI, etc.), and calculates the license fee based on the results of the check.

[0886] Specific operation: The server obtains intellectual property information, calculates and sums up the license fees for each design element.

[0887] Output: The server sends the license fee details to the terminal, which displays them to the user.

[0888] Step 6:

[0889] License fee payment

[0890] Input: The user enters the license fee payment information into the terminal and begins the payment process.

[0891] Data processing / calculation: The terminal sends payment information (such as credit card information) to the server, which processes the payment using a payment system (such as Stripe).

[0892] Specific operation: The server passes the received payment information to the payment system and executes the payment process.

[0893] Output: The server sends the result of the payment process to the terminal, which notifies the user.

[0894] Step 7:

[0895] Final design provided

[0896] Input: The server will generate the final design files after confirming payment.

[0897] Data processing / calculation: The server saves the final design data in cloud storage (e.g., AWS S3) and generates a download link.

[0898] Specific operation: The server uploads the final design data and obtains a download link from the cloud storage service.

[0899] Output: The server sends a download link to the device, which displays it to the user, who then uses the download link to get the final design file.

[0900] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0901] The following describes an embodiment of the present invention. The present invention is a system that aims to promote the creative creation and personalization of designs while ensuring the protection of intellectual property rights. This system incorporates an emotion engine, which adds functionality to recognize a user's emotions and suggest and adjust design themes and parts based on those emotions.

[0902] Overall system overview

[0903] The system consists of three main components: the user, the device, and the server, and is equipped with an emotion engine. The user selects a design theme and sends a request to the server via their device. The server loads the relevant design parts and generates a design preview. During the generation process, the emotion engine recognizes the user's emotions and provides appropriate advice and adjustments. The server also verifies intellectual property rights, calculates the license fee, and presents it to the user. Once the user pays the license fee, the server generates the final design file and provides it to the user.

[0904] Program processing and natural language explanation

[0905] 1. User Authentication

[0906] User: Accesses the platform and enters their email address and password on the login screen.

[0907] Terminal: Sends the entered email address and password to the server.

[0908] Server: Checks the credentials in the database and returns the authentication result to the device.

[0909] Terminal: Displays the authentication result. If authentication is successful, the user can proceed to the next step.

[0910] 2. Select a design theme

[0911] User: On the home screen, select the desired theme (e.g., "Modern") from the list of design themes.

[0912] Device: Sends the selected theme ID to the server.

[0913] Server: Loads design elements related to the theme (background, font, color, etc.) from the database and sends them to the terminal.

[0914] Terminal: Displays the loaded design parts to the user.

[0915] 3. Emotion Recognition by Emotion Engine

[0916] Device: The emotion engine is activated and analyzes the user's facial expressions and voice using the device's camera, microphone, etc.

[0917] Server: Detects the user's emotional state based on the emotional data sent from the emotion engine.

[0918] Server: Based on the detected emotions, suggests appropriate design themes and parts to the user.

[0919] 4. Selecting a design configuration

[0920] User: Select each part from the displayed design parts (e.g., main background "blue", button "circle", etc.).

[0921] Terminal: Sends information about the selected design parts to the server.

[0922] Server: Using the selected parts, generate an initial design preview using AI, and send the generated preview image to the device.

[0923] Terminal: The generated preview image is displayed to the user.

[0924] Emotion engine: Re-analyzes user responses and suggests corrections if necessary.

[0925] 5. Intellectual Property Verification and License Fee Calculation

[0926] Server: Based on the final selected design parts, it checks the intellectual property rights, calculates the license fee for each part, and sends the detailed information to the terminal.

[0927] Terminal: Displays intellectual property information and license fee details to the user.

[0928] 6. Payment of license fee and finalization of design

[0929] User: Confirm license fee payment information and enter payment information, including credit card information.

[0930] Terminal: Sends the entered payment information to the server.

[0931] Server: Performs payment processing and sends the processing results to the terminal.

[0932] Terminal: Notifies the user that the payment has been completed.

[0933] 7. Download your design

[0934] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[0935] On the device: Display the download link to the user.

[0936] User: Click the download link and save the final design file to your device.

[0937] Specific examples

[0938] For example, suppose a user selects the "Modern" design theme, "Blue" as the main background, and "Circular" as the button style. After the user selects these, the server uses AI to instantly generate a preview image that reflects the selected background and button style.

[0939] The emotion engine analyzes the user's facial expressions and voice to determine whether they are satisfied, for example. If they are not satisfied, the emotion engine will suggest alternatives, and the user can make a new selection based on those suggestions.

[0940] Next, the user confirms the license fee calculation and enters their credit card information to make the payment. The server processes the payment, generates the final design files, and provides a download link. Finally, the user can click the link to download and use the design files.

[0941] In this way, users can easily generate designs that match their emotions using the emotion engine while ensuring both design customization and protection of intellectual property rights.

[0942] The processing flow will be explained below.

[0943] Step 1:

[0944] User: Accesses the platform and enters their email address and password on the login screen.

[0945] Terminal: Sends the entered email address and password to the server.

[0946] Server: Checks the credentials in the database and returns the authentication result to the device.

[0947] Terminal: Displays the authentication result. If authentication is successful, the user can proceed to the next step.

[0948] Step 2:

[0949] User: On the home screen, select the desired theme (e.g., "Modern") from the list of design themes.

[0950] Device: Sends the selected theme ID to the server.

[0951] Server: Loads design elements related to the theme (background, font, color, etc.) from the database and sends them to the terminal.

[0952] Terminal: Displays the loaded design parts to the user.

[0953] Step 3:

[0954] Device: The emotion engine is activated and analyzes the user's facial expressions and voice using the device's camera, microphone, etc.

[0955] Server: Detects the user's emotional state based on the emotional data sent from the emotion engine.

[0956] Server: Based on the detected emotions, suggests appropriate design themes and parts to the user.

[0957] On the device: Display suggestions to the user based on the detected emotions.

[0958] Step 4:

[0959] User: Select each part from the displayed design parts (e.g., main background "blue", button "circle", etc.).

[0960] Terminal: Sends information about the selected design parts to the server.

[0961] Server: Using the selected parts, generate an initial design preview using AI, and send the generated preview image to the device.

[0962] Terminal: The generated preview image is displayed to the user.

[0963] Step 5:

[0964] User: Check the preview image and reselect design elements and color schemes as needed.

[0965] Terminal: Sends design part information to the server again based on the new selection (if reselection occurs).

[0966] Server: Generates an updated design preview using the reselected parts and sends it to the device.

[0967] Terminal: Show updated preview image to user.

[0968] Emotion engine: Re-analyzes user responses and suggests corrections if necessary.

[0969] Step 6:

[0970] Server: Based on the final selected design parts, it checks the intellectual property rights, calculates the license fee for each part, and sends the detailed information to the terminal.

[0971] Terminal: Displays intellectual property information and license fee details to the user.

[0972] Step 7:

[0973] User: Confirm license fee payment information and enter payment information, including credit card information.

[0974] Terminal: Sends the entered payment information to the server.

[0975] Server: Performs payment processing and sends the processing results to the terminal.

[0976] Terminal: Notifies the user that the payment has been completed.

[0977] Step 8:

[0978] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[0979] On the device: Display the download link to the user.

[0980] User: Click the download link and save the final design file to your device.

[0981] Through these steps, users can select a design theme and elements, generate a design based on them, review it, and finally download it after paying the license fee. The addition of an emotion engine enables more appropriate suggestions and modifications based on the user's emotions, improving the user experience.

[0982] Example 2

[0983] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0984] When customizing and personalizing designs, it is difficult to automatically suggest appropriate design elements that match the user's emotions, while simultaneously generating the final design quickly and effectively while protecting intellectual property rights. There is also a need to automate the selection of design elements and the generation of previews that meet diverse user needs. This allows users to carry out the design process easily and intuitively, but conventional systems have had difficulty meeting this requirement.

[0985] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0986] In this invention, the server includes: means for providing multiple design elements based on a design theme individually selected by the user; means for generating a design preview based on the design elements selected by the user; means for verifying intellectual property rights of each design element used in the generated design preview and calculating a license fee; means for presenting the license fee to the user and processing payment; means for generating a final design file and providing it to the user after payment is completed; means for recognizing the user's emotions; and means for suggesting appropriate design elements based on the recognized emotions. This enables automatic suggestion of design elements that match the user's emotions. Furthermore, a system can be provided that protects intellectual property rights, streamlines the design generation process, and simplifies design customization and personalization.

[0987] "User" means any person or entity that uses the System to enjoy the convenience of customizing and personalizing designs.

[0988] A "design theme" is a collective term for multiple visual styles or concepts that a user can select, and which determine the basic direction and atmosphere of a design.

[0989] "Design elements" are individual parts related to a design theme and include specific design components such as background, font, color, and shape.

[0990] A "design preview" is a preliminary visual representation of a design that is generated by combining design elements selected by the user.

[0991] "Intellectual Property Rights" means legal rights in and to design elements and other creative works, including copyright, trademark, and patent rights.

[0992] A "license fee" is a fee paid to the owner of the intellectual property rights, and is a fee required when a user uses a design element.

[0993] "Emotion recognition" is the process of analyzing data such as a user's facial expressions and voice to determine their emotional state (e.g., joy, sadness, surprise, etc.).

[0994] "Generative model" is a general term for algorithms and techniques for generating design previews using artificial intelligence.

[0995] "Authentication Information" refers to the credentials, such as email address and password, that a user uses to access a system.

[0996] "Authentication processing" is a process of verifying the authentication information of a user attempting to access a system and determining whether the user has the right to access the system.

[0997] The present invention is a system that aims to promote the creative creation and personalization of designs while ensuring the protection of intellectual property rights. The system incorporates an emotion engine that recognizes the user's emotions and suggests and adjusts design themes and parts based on those emotions.

[0998] System configuration

[0999] This system consists of three main components: the user, the terminal, and the server, and is equipped with an emotion engine.

[1000] 1. User: The user accesses the system through an interface and selects design themes and parts. The user also has the ability to adjust the design based on suggestions from the emotion engine.

[1001] 2. Device: A computer or mobile device used by a user. The device sends input from the user to the server and displays the data received from the server. The device also runs an emotion engine and captures the user's emotions using a camera or microphone.

[1002] 3. Server: The server processes data received from users, manages design parts and theme data, generates design previews using generative AI models, and is also responsible for intellectual property rights verification and license fee calculation.

[1003] System Operation

[1004] The general operation flow of this system is as follows:

[1005] 1. User Authentication

[1006] The user logs in to the system using their email address and password. The device sends this information to the server, which then performs the authentication process. If the authentication is successful, the user proceeds to the next step.

[1007] 2. Select a design theme

[1008] The user selects a desired theme from a list of design themes, and the device sends the theme ID to the server, which then loads the associated design parts from the database and sends them to the device.

[1009] 3. Emotion Recognition by Emotion Engine

[1010] The device activates the emotion engine and captures the user's facial expressions and voice in real time using a camera and microphone. The server analyzes the emotion data and suggests appropriate design parts based on the user's emotional state.

[1011] 4. Selecting a design configuration

[1012] The user selects each design part from the displayed list, and the device sends the selection information to the server, which then uses the generative AI model to generate a design preview and sends it to the device.

[1013] 5. Intellectual Property Verification and License Fee Calculation

[1014] The server checks the intellectual property rights of the design parts used in the design preview and calculates the license fee, and the calculation result is presented to the user via the terminal.

[1015] 6. Payment of license fee and finalization of design

[1016] The user confirms the license fee and enters payment information. The server processes the payment and, upon completion, generates the final design files and provides a download link.

[1017] 7. Download your design

[1018] The user clicks on the download link to get the final design file.

[1019] Specific examples

[1020] For example, if a user selects the "Modern" design theme, "Blue" for the main background, and "Circular" for the button shape, the server instantly generates a preview image using the generative AI model. The emotion engine analyzes the user's emotions from their facial expressions and voice to confirm whether they are satisfied. If it determines that they are not satisfied, the emotion engine will suggest alternatives and the user can make another selection.

[1021] Prompt Sentence Examples

[1022] Please explain in detail the processing steps of a system where a user selects a design theme, analyzes their emotions using an emotion engine, and suggests appropriate design parts.

[1023] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1024] Step 1: User authentication

[1025] Input: The user enters their email address and password.

[1026] Processing: The device encodes the entered email address and password and sends them to the server using the HTTPS protocol. The server checks the received credentials against its database to determine if a matching user exists.

[1027] Output: The server returns the authentication result (success or failure) to the terminal. The terminal displays the authentication result to the user and proceeds to the next step if the authentication is successful.

[1028] Step 2: Choose a design theme

[1029] Input: The user selects the desired theme from a list of design themes provided on the home screen.

[1030] Processing: The device sends the ID of the selected theme to the server, which loads the design elements associated with the theme (background, font, color, etc.) from a database and sends this information to the device.

[1031] Output: The terminal visually displays the loaded design elements to the user.

[1032] Step 3: Emotion recognition by the emotion engine

[1033] Input: As the user views the design elements, the device uses the camera and microphone to capture the user's emotional data (facial expressions and voice).

[1034] Processing: The device processes the emotion data and sends it to the server in real time. The server then uses an emotion engine to analyze the emotion data and determine the user's emotional state.

[1035] Output: The server generates data suggesting appropriate design elements and themes based on the user's emotional state and sends it to the device. The device then presents the suggested data to the user.

[1036] Step 4: Select a design configuration

[1037] Input: The user selects each part from the proposed design elements (e.g., main background "blue," button "circular," etc.).

[1038] Processing: The device sends information about the selected design elements to the server, which uses the generative AI model to create a design preview and sends this preview image to the device.

[1039] Output: The device displays the generated design preview to the user and then activates the emotion engine to analyze the user's reaction and, if necessary, suggest further revisions.

[1040] Step 5: Identifying intellectual property and calculating license fees

[1041] Input: When the user performs an action to finalize the design preview, the server receives information about the design elements used.

[1042] Processing: The server checks the intellectual property rights of the selected design elements, calculates the license fee for each element, and then sums up the calculated license fees to calculate the total license fee.

[1043] Output: The server sends the license fee details to the terminal, which displays them to the user.

[1044] Step 6: Pay the license fee and finalize the design

[1045] Input: The user confirms the proposed license fee and enters payment information (such as credit card information).

[1046] Processing: The terminal sends the payment information to the server using the HTTPS protocol. The server processes the payment and returns the processing result to the terminal. If the payment is successful, the server generates the final design file.

[1047] Output: The terminal will notify the user of the payment result. After notifying that the payment was successful, a download link will be displayed.

[1048] Step 7: Download your design

[1049] Input: User clicks on download link.

[1050] Processing: The server generates the final design file and sends a secure download link to the device, which displays this link to the user.

[1051] Output: Users can click a link to save the final design file to their device.

[1052] (Application example 2)

[1053] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1054] Conventional design generation systems offer limited design parts and themes to users, and do not adequately personalize the design based on individual emotions and preferences. Furthermore, it is difficult to visualize designs in real space, making it difficult to maximize user satisfaction. Furthermore, the verification of intellectual property rights and the calculation of license fees are complex, making the system cumbersome for users. These issues need to be resolved.

[1055] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1056] In this invention, the server includes: means for providing multiple design components based on a design theme individually selected by the user; means for generating a design forecast based on the design components selected by the user; means for verifying intellectual property rights for each design component used in the generated design forecast and calculating royalties; means for presenting royalties to the user and processing payment; means for generating a final design file and providing it to the user after payment is completed; means for recognizing the user's emotions and suggesting and adjusting design themes and components based on the emotions; and means for applying and visualizing the design forecast in real space through the user's scaled display device. This allows the user to receive design suggestions based on their own emotions and make a satisfying design selection through visualization in real space. Furthermore, intellectual property rights verification and license fee calculation are automated, simplifying use.

[1057] 1. "Design Theme" means the overall style or concept of a design that a user can choose from.

[1058] 2. "Design Components" refers to the individual parts or elements that make up a design theme, such as background, font, color, shape, etc.

[1059] 3. "Design Preview" is a preview of the design generated based on the design components selected by the user.

[1060] 4. "Intellectual Property Rights" means legally protected rights in design parts and themes.

[1061] 5. "Royalty" means the fee payable for the use of any Intellectual Property Rights-containing item.

[1062] 6. "Means for recognizing emotions" refers to technology or devices that analyze a user's facial expressions and voice to recognize their emotional state.

[1063] 7. "Means for suggesting and adjusting" refers to the function of recommending appropriate design themes and components to users based on the recognized user emotions.

[1064] 8. "Scaled display device" refers to a device that uses augmented reality (AR) technology to apply designs to real-world space and allow users to visualize them.

[1065] The following describes an embodiment of the present invention: This invention is a system that provides multiple design components based on a design theme individually selected by a user, proposes designs based on the user's emotions, and visualizes the final design in the user's real space.

[1066] Overall system configuration

[1067] The system consists of three main components: the user, the device, and the server. The device includes a scaled display device (e.g., smart glasses), and the server includes an emotion engine (e.g., Emotion API) that recognizes emotions and makes suggestions, and a generative AI model (e.g., Generative Adversarial Networks, hereafter referred to as "GAN") that generates design predictions. It also has the ability to visualize the design predictions in real space using 3D modeling software (e.g., Blender).

[1068] System Procedures

[1069] 1. User Authentication

[1070] The user enters login information through the terminal and sends it to the server. The server performs authentication processing and returns the results to the terminal.

[1071] 2. Select a design theme

[1072] The user selects a design theme using the terminal interface, and the selection is sent to the server, which loads and sends the associated design parts to the terminal.

[1073] 3. Emotion Recognition by Emotion Engine

[1074] The device's built-in camera and microphone capture the user's facial expressions and voice in real time and send the data to a server, which then uses an emotion engine to analyze the user's emotions.

[1075] 4. Design prediction and proposal

[1076] The server makes design suggestions based on emotions and generates design predictions using a generative AI model (GAN) based on the design components selected by the user. The generated design predictions are sent to the device and displayed to the user.

[1077] 5. AR Preview

[1078] The generated design predictions are applied and visualized in real space using the user's scaled display device (smart glasses), and previewed in real time using 3D modeling software (Blender).

[1079] 6. Intellectual property rights verification and license management

[1080] The server checks the intellectual property rights of each design component used in the design forecast and calculates the royalty. The calculation results are sent to the terminal and presented to the user.

[1081] 7. Payment Processing and Download of Final Design

[1082] Once the user pays the license fee, the server generates the final design file and sends a download link to the device, which the user clicks to download the design file.

[1083] Specific examples

[1084] For example, if a user selects a "minimalist" design theme, sets the wall color to "white," and the furniture style to "modern," the smart glasses will reflect those settings in the AR preview of the room in real time. The emotion engine analyzes the user's satisfaction level from their facial expressions and may suggest changing the color to "light gray" if the user is not satisfied.

[1085] Example prompts to input to the generative AI model

[1086] "Generate a living room design preview with a minimalist theme, white wall color, and modern furniture style."

[1087] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1088] Step 1:

[1089] User Authentication

[1090] The user enters login information (email address and password) through the device interface. The device sends this authentication information to the server. The server checks the authentication information in the database and returns the authentication result to the device. The device displays the authentication result to the user, and if authentication is successful, the user can proceed to the next step.

[1091] Input: User login information

[1092] Output: Authentication result (success or failure)

[1093] Specific operations: Sending authentication information, checking database, displaying authentication results

[1094] Step 2:

[1095] Select a design theme

[1096] The user selects the desired theme from a list of design themes presented on the device's home screen. The device then sends the selected theme's ID to the server. The server then loads design elements (background, font, color, etc.) associated with the theme from the database and sends them to the device. The device then displays the loaded design elements to the user.

[1097] Input: Design theme selection information

[1098] Output: Display of related design parts

[1099] Specific operations: Select design theme, send theme ID, load design parts, display selection candidates

[1100] Step 3:

[1101] emotion recognition

[1102] The device's built-in camera and microphone capture the user's facial expressions and voice in real time and send the data to a server, which then uses an emotion engine (e.g., Emotion API) to analyze the emotion data and detect the user's emotional state.

[1103] Input: User's facial expression data, voice data

[1104] Output: Emotional state detection result

[1105] Specific operations: data capture, data transmission, emotion analysis, emotional state detection

[1106] Step 4:

[1107] Design prediction and proposal

[1108] The server proposes appropriate design components based on the user's emotional state. Based on the design components selected by the user, a design forecast is generated using a generative AI model (e.g., GAN). The generated design forecast is sent to the device and displayed to the user.

[1109] Input: User's emotional state, selected design part

[1110] Output: Generated design predictions

[1111] Specific actions: Proposals based on emotional state, prediction generation by generative AI model

[1112] Step 5:

[1113] AR Preview

[1114] The server generates design predictions that are then visualized in real space through a scaled display device (e.g., smart glasses) on the device. A real-time preview is performed using 3D modeling software (e.g., Blender). The user can review the preview and accept suggested revisions if necessary.

[1115] Input: Generated design forecast

[1116] Output: Visualized design preview in real space

[1117] Specific operation: Applying design predictions, displaying real-time samples

[1118] Step 6:

[1119] Intellectual property rights verification and license management

[1120] The server checks the intellectual property rights of each design part used in the design forecast and calculates the usage fee. The calculated usage fee is sent to the terminal and displayed to the user. The user then approves the payment.

[1121] Input: Information on the design components used in the design prediction

[1122] Output: Calculation result of usage fee, presented to the user

[1123] Specific operations: Checking intellectual property rights, calculating royalties, displaying royalties

[1124] Step 7:

[1125] Payment processing and download of final design

[1126] The user approves the license fee and enters payment information. The entered payment information is sent to the server, which processes the payment. Once payment is complete, the server generates the final design file and sends a download link to the device. The user downloads the design file from the link.

[1127] Input: Payment information

[1128] Output: Payment completion notification, download link for the final design file

[1129] Specific actions: Sending payment information, processing payments, sending links, downloading files

[1130] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1131] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1132] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1133] [Third embodiment]

[1134] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1135] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1136] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1137] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1138] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1139] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1140] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1141] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1142] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1143] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1144] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1145] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1146] The following describes an embodiment of the present invention. The present invention is a system that allows users to freely personalize designs while protecting intellectual property rights. In this system, the user selects a design theme and design parts, generates a design preview based on the selected design, and finally confirms the intellectual property rights, calculates the license fee, and provides the final design file once payment is completed.

[1147] Overall system overview

[1148] The system consists of three main components: the user, the terminal, and the server. The user selects a design theme and sends a request to the server through the terminal. The server loads the related design parts and generates a design preview. The server then verifies the intellectual property rights, calculates the license fee, and presents it to the user. Once the user pays the license fee, the server generates the final design file and provides it to the user.

[1149] Program processing and natural language explanation

[1150] 1. User Authentication

[1151] User: Accesses the platform and enters their email address and password on the login screen.

[1152] Terminal: Sends the entered email address and password to the server.

[1153] Server: Checks the credentials in the database and returns the authentication result to the device.

[1154] Terminal: Displays the authentication result, and if authentication is successful, proceeds to the next step.

[1155] 2. Select a design theme

[1156] User: Select the desired theme (e.g. "Modern") from the list of design themes.

[1157] Device: Sends the selected theme ID to the server.

[1158] Server: Loads design elements related to the theme (background, font, color, etc.) from the database and sends them to the terminal.

[1159] Terminal: Displays the loaded design parts to the user.

[1160] 3. Selecting a design configuration

[1161] User: Select each part from the displayed design parts (e.g., main background "blue", button "circle", etc.).

[1162] Terminal: Sends information about the selected design parts to the server.

[1163] Server: Generates an initial design preview using the selected parts and sends it to the device.

[1164] Terminal: The generated preview image is displayed and the user is asked to confirm it.

[1165] 4. Generate and preview your design

[1166] User: Check the preview image and reselect parts and color schemes as necessary.

[1167] Terminal: Sends part information to the server again based on the new selection (if a reselection occurs).

[1168] Server: [Using AI] generates the final design based on the selected theme and components and sends it to the device as a preview image.

[1169] Terminal: Shows the final preview image to the user.

[1170] 5. Intellectual Property Verification and License Fee Calculation

[1171] Server: Check the intellectual property rights status of all design parts used in the final preview.

[1172] Server: Based on the confirmed intellectual property rights, calculates the required license fees and sends the detailed information to the terminal.

[1173] Terminal: Shows the user the license fee and its breakdown.

[1174] 6. Payment of license fee and finalization of design

[1175] User: Enter your credit card information according to the license fee payment information displayed.

[1176] Terminal: Sends payment information to the server and initiates the payment process.

[1177] Server: Performs payment processing and sends the processing results to the terminal.

[1178] Terminal: Notifies the user that the payment has been completed.

[1179] 7. Download your design

[1180] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[1181] Terminal: Display and provide the download link to the user.

[1182] User: Click the download link to save the final design file to your device.

[1183] Specific examples

[1184] For example, suppose a user selects the "Modern" design theme, "Blue" as the main background, and "Circular" as the button style. After the user selects these, the server uses AI to instantly generate a preview image that reflects the selected background and button style.

[1185] Next, the user confirms the license fee calculation and enters their credit card information to make the payment. The server processes the payment, generates the final design files, and provides a download link. Finally, the user can click the link to download and use the design files.

[1186] In this way, users can easily create their own preferred designs while ensuring both customization of the design and protection of intellectual property rights.

[1187] The processing flow will be explained below.

[1188] Step 1:

[1189] User: Accesses the platform and enters their email address and password on the login screen.

[1190] Terminal: Sends the entered email address and password to the server.

[1191] Server: Checks the credentials in the database and returns the authentication result to the device.

[1192] Terminal: Displays the authentication result. If authentication is successful, the user can proceed to the next step.

[1193] Step 2:

[1194] User: On the home screen, select the desired theme (e.g., "Modern") from the list of design themes.

[1195] Device: Sends the selected theme ID to the server.

[1196] Server: Loads design elements related to the theme (background, fonts, colors, etc.) from the database and sends them to the device.

[1197] Terminal: Displays the loaded design parts to the user.

[1198] Step 3:

[1199] User: Select each part from the displayed design parts (e.g., main background "blue", button "circle", etc.).

[1200] Terminal: Sends information about the selected design parts to the server.

[1201] Server: Using the selected parts, generate an initial design preview using AI, and send the generated preview image to the device.

[1202] Terminal: The generated preview image is displayed to the user.

[1203] Step 4:

[1204] User: Check the preview image and reselect design elements and color schemes as needed.

[1205] Terminal: Sends design part information to the server again based on the new selection (if reselection occurs).

[1206] Server: Generates an updated design preview using the reselected parts and sends it to the device.

[1207] Terminal: Show updated preview image to user.

[1208] Step 5:

[1209] Server: Based on the final selected design parts, it checks the intellectual property rights, calculates the license fee for each part, and sends the detailed information to the terminal.

[1210] Terminal: Displays intellectual property information and license fee details to the user.

[1211] Step 6:

[1212] User: Confirm license fee payment information and enter payment information, including credit card information.

[1213] Terminal: Sends the entered payment information to the server.

[1214] Server: Performs payment processing and sends the processing results to the terminal.

[1215] Terminal: Notifies the user that the payment has been completed.

[1216] Step 7:

[1217] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[1218] On the device: Display the download link to the user.

[1219] User: Click the download link and save the final design file to your device.

[1220] By following these steps, users can complete the process of selecting a design theme and parts, generating and confirming a design based on those themes, and finally paying the license fee and downloading the design.

[1221] Example 1

[1222] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1223] With conventional design generation systems, it is difficult for users to easily personalize designs according to their preferences, and the process of verifying intellectual property rights and calculating license fees is cumbersome. Therefore, there is a need for a system that allows users to quickly and easily generate designs and use them while protecting appropriate intellectual property rights.

[1224] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1225] In this invention, the server includes means for providing a plurality of design components based on a design theme individually selected by the user, means for generating a design preview based on the design components selected by the user, means for checking the intellectual property rights of each design component used in the generated design preview and calculating a license fee, means for presenting the license fee to the user and processing payment, and means for generating a final design file and providing it to the user after payment is completed, thereby enabling users to easily personalize designs and use them while appropriately protecting their intellectual property rights.

[1226] A "design theme" is a category that can be selected by the user to determine the basic style, color scheme, and components of the overall system design.

[1227] "Design components" are specific design parts such as background, font, color, button shape, etc. that are selected based on the design theme.

[1228] A "design preview" is a display image that the system generates based on the selected design components, allowing you to preview how the final design will look.

[1229] "Intellectual Property Rights" means copyright, patent, trademark, or other legal rights protected in and to the Design Elements and combinations thereof.

[1230] "License Fee" means the fee payable for the use of a Design Component used in a Generated Design.

[1231] "Payment processing means" refers to the system and process that processes payment information, such as credit card information, used by users to pay license fees.

[1232] A "final design file" is a file containing the final generated design based on the design theme and design components selected by the user.

[1233] An embodiment of the present invention will be described. The present invention is a system that allows users to freely personalize designs while protecting intellectual property rights. This system consists of three main components: a user, a terminal, and a server. A user selects a design theme and sends a request to the server through their terminal. The server loads related design components and generates a design preview. The server then verifies the intellectual property rights, calculates a license fee, and presents it to the user. Once the user pays the license fee, the server generates the final design file and provides it to the user. This process also uses a generative model to streamline the generation of the design preview.

[1234] Hardware and software used

[1235] The system of the present invention uses the following hardware and software:

[1236] Servers: Database servers, servers for running AI generative models (e.g., TensorFlow or PyTorch-based models), and license management systems.

[1237] Device: A device operated by a user, such as a computer, smartphone, or tablet.

[1238] Software: web browser, payment system (e.g. Stripe, PayPal, etc.), design preview display system.

[1239] Program processing

[1240] 1. User Authentication

[1241] User: Accesses the platform and enters their email address and password on the login screen.

[1242] Terminal: Sends the entered email address and password to the server.

[1243] Server: Checks the credentials in the database and returns the authentication result to the device.

[1244] Terminal: Displays the authentication result, and if authentication is successful, proceeds to the next step.

[1245] 2. Select a design theme

[1246] User: Select the desired theme (e.g. "Modern") from the list of design themes.

[1247] Device: Sends the selected theme ID to the server.

[1248] Server: Loads the design elements related to the theme (background, fonts, colors, etc.) from a database and sends them to the device.

[1249] Terminal: Displays the loaded design components to the user.

[1250] 3. Selecting a design configuration

[1251] User: Select each part from the displayed design components (e.g., main background "blue", button "circle", etc.).

[1252] Terminal: Sends information about the selected design components to the server.

[1253] Server: Generates an initial design preview using the selected parts and sends it to the device.

[1254] Terminal: The generated preview image is displayed and the user is asked to confirm it.

[1255] 4. Generate and preview your design

[1256] User: Check the preview image and reselect parts and color schemes as necessary.

[1257] Terminal: Sends part information to the server again based on the new selection (if a reselection occurs).

[1258] Server: Uses the generative model to generate the final design based on the selected theme and components, and sends it to the device as a preview image.

[1259] Terminal: Shows the final preview image to the user.

[1260] 5. Intellectual Property Verification and License Fee Calculation

[1261] Server: Check the intellectual property rights status of all design elements used in the final preview.

[1262] Server: Based on the confirmed intellectual property rights, calculates the required license fees and sends the details to the terminal.

[1263] Terminal: Shows the user the license fee and its breakdown.

[1264] 6. Payment of license fee and finalization of design

[1265] User: Enter your credit card information according to the license fee payment information displayed.

[1266] Terminal: Sends payment information to the server and initiates the payment process.

[1267] Server: Performs payment processing and sends the processing results to the terminal.

[1268] Terminal: Notifies the user that the payment has been completed.

[1269] 7. Download your design

[1270] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[1271] Terminal: Display and provide the download link to the user.

[1272] User: Click the download link to save the final design file to your device.

[1273] Specific examples

[1274] For example, suppose a user selects the "Modern" design theme, chooses "Blue" as the main background, and selects "Circular" as the button style. The user makes these selections, and the server uses the generative model to instantly generate a preview image that reflects the selected background and button style.

[1275] Next, the user confirms the license fee calculation and enters their credit card information to make the payment. The server processes the payment, generates the final design files, and provides a download link. Finally, the user can click the link to download and use the design files.

[1276] Prompt Sentence Examples

[1277] "If a user selects 'Modern' as the design theme, 'Blue' as the main background, and 'Circular' as the button, explain how the system generates the design, verifies intellectual property rights, and provides the final design file."

[1278] In this way, this system allows users to freely personalize their designs while properly protecting their intellectual property rights and providing a concrete means for easily generating and obtaining design files.

[1279] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1280] Step 1:

[1281] User authentication

[1282] User: Access the platform, enter your email address and password on the login screen, and click the "Login" button.

[1283] Input: Email address, password

[1284] Terminal: Sends the entered email address and password to the server.

[1285] Output: Authentication request

[1286] Server: Matches the received email address and password with the credentials in its database and generates an authentication status.

[1287] Input: Authentication Request

[1288] Output: Authentication result (success or failure)

[1289] Terminal: Displays the authentication result, and if authentication is successful, proceeds to the next step. If authentication fails, displays an error message.

[1290] Output: Display of authentication result

[1291] Step 2:

[1292] Select a design theme

[1293] User: After logging in, select the desired theme (e.g. "Modern") from the list of design themes displayed.

[1294] Input: Selected Design Theme

[1295] Device: Sends the selected theme ID to the server.

[1296] Output: Send theme ID

[1297] Server: Based on the theme ID, retrieves related design elements (background, font, color, etc.) from the database and sends them to the device.

[1298] Input: Theme ID

[1299] Output: Associated design components

[1300] Terminal: Displays the design components received from the server to the user.

[1301] Output: Display of design components

[1302] Step 3:

[1303] Selecting a design configuration

[1304] User: Select each part (e.g., main background "blue," button "circle," etc.) from the displayed design components.

[1305] Input: Selected design component

[1306] Terminal: Collects information about the selected design components and sends their IDs to the server.

[1307] Output: Send ID of design component

[1308] Server: Based on the IDs of the received design components, it generates an initial design preview and sends it to the device.

[1309] Input: ID of the design component

[1310] Output: Initial design preview image

[1311] Terminal: The generated preview image is displayed to the user.

[1312] Output: Show preview image

[1313] Step 4:

[1314] Generate and preview your design

[1315] User: Check the preview image and reselect parts and color schemes if necessary. If there is no need to reselect, proceed to the next step.

[1316] Input: Reselected design components

[1317] Terminal: Sends part information to the server again based on the new selection (if a reselection occurs).

[1318] Output: Sending reselected part information

[1319] Server: Uses the generative model to generate the final design based on the selected theme and components, and sends it to the device as a preview image.

[1320] Input: Reselected part information

[1321] Output: Final preview image

[1322] Terminal: Shows the final preview image to the user.

[1323] Output: Display final preview image

[1324] Step 5:

[1325] Intellectual property verification and license fee calculation

[1326] Server: All design elements used in the final preview are checked against a database to verify their intellectual property rights.

[1327] Inputs: Design components used in the final preview

[1328] Output: Intellectual property rights verification results

[1329] Server: Based on the confirmed intellectual property rights, calculates the required license fees and sends the details to the terminal.

[1330] Input: Intellectual property rights confirmation result

[1331] Output: License fee details

[1332] Terminal: Shows the user the license fee and its breakdown.

[1333] Output: Display license fee

[1334] Step 6:

[1335] Pay the license fee and finalize the design

[1336] User: Enter your credit card information according to the license fee payment information displayed.

[1337] Input: Credit card information

[1338] Terminal: Sends payment information to the server and initiates the payment process.

[1339] Output: Send payment information

[1340] Server: Performs payment processing and sends the processing results to the terminal.

[1341] Input: Payment information

[1342] Output: Payment processing result

[1343] Terminal: Notifies the user that the payment has been completed.

[1344] Output: Notification of successful payment

[1345] Step 7:

[1346] Download the design

[1347] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[1348] Input: Payment confirmation

[1349] Output: Final design files, download link

[1350] On the device: Show the download link to the user.

[1351] Output: Download link displayed

[1352] User: Click the download link to save the final design file to your device.

[1353] Input: Download link

[1354] Output: Save the final design file

[1355] (Application example 1)

[1356] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1357] In the modern design industry, there is a growing need for users to create their own customized designs. However, when users freely create designs, it is difficult to protect the intellectual property rights of the designs and calculate appropriate license fees. It is also challenging to quickly provide users with generated design previews and safely store and download the final design files. Furthermore, a system that can perform these processes seamlessly is required.

[1358] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1359] In this invention, the server includes: means for providing multiple design elements based on a design theme individually selected by the user; means for generating a design preview based on the design elements selected by the user; means for verifying intellectual property rights of each design element used in the generated design preview and calculating a license fee; means for presenting the license fee to the user and processing payment; means for generating a final design file and providing it to the user after payment is completed; means for sending a notification to the user's device; and means for saving the final design file in cloud storage and generating a download link. This allows users to freely customize designs, protect intellectual property rights, and ensure appropriate license fee payment. It also enables users to quickly and securely obtain the final design file.

[1360] "User" means an individual or organization that utilizes the system to customize a design and obtain a final design file.

[1361] A "design theme" is a setting selected by the user that indicates the overall design direction or style.

[1362] "Design elements" are the individual elements that make up a design, including background, font, color, etc.

[1363] A "design preview" is a preliminary visual representation of a design that is generated based on user-selected design elements.

[1364] "Intellectual property rights" refers to rights protected by law, such as copyrights, patents, and trademarks, relating to design parts.

[1365] "License Fee" means the amount paid as consideration for the use of Design Parts.

[1366] "Final Design File" means the final and completed design data generated based on the user's customized design.

[1367] A "terminal" is an electronic device such as a computer, smartphone, or tablet that a user uses to operate the system.

[1368] "Cloud storage" refers to a remote storage device where data can be stored and accessed over the Internet.

[1369] "Download Link" means the URL or hyperlink where a User can obtain the Final Design File via the Internet.

[1370] "Notification" refers to messages such as update information and processing results sent from the system to the user.

[1371] A "generative AI model" is a program that uses artificial intelligence to automatically generate designs based on user selections.

[1372] A "server" is a computer system used to process user requests and provide data.

[1373] The following describes the mode for carrying out the present invention. The system of the present invention allows users to freely customize designs and provides functions to protect intellectual property rights. This system consists of three main components: a user, a terminal, and a server.

[1374] Program processing and natural language explanation

[1375] 1. User Authentication

[1376] User: Accesses the system and enters their email address and password on the login screen.

[1377] Terminal: Sends the entered credentials to the server.

[1378] Server: Checks the user's credentials in a database (e.g., MySQL) and returns the authentication result to the device (e.g., "Authentication successful").

[1379] Terminal: Displays the authentication result, and if successful, allows you to proceed to the next step.

[1380] 2. Design theme and product selection

[1381] User: In the system, select the product to customize (e.g., a phone case) and the design theme (e.g., "Modern").

[1382] Terminal: Sends the selected product ID and design theme ID to the server.

[1383] Server: Loads relevant design elements (background, fonts, colors, etc.) from the database and sends them to the device.

[1384] 3. Selecting a design configuration

[1385] User: Selects the background color "blue" and the button "circle" from the design elements displayed on the terminal.

[1386] Terminal: Sends the selected design element information to the server.

[1387] Server: Based on the user's selections, generates an initial design preview and sends it to the device.

[1388] 4. Generate and preview your design

[1389] User: Review the design preview and reselect design elements as needed.

[1390] Terminal: If the user makes a new selection, it sends that information back to the server.

[1391] Server: Uses a generative AI model (e.g., Stable Diffusion) to generate the final design and send it to the device as a preview.

[1392] Terminal: Shows the final preview image to the user.

[1393] 5. Identifying Intellectual Property Rights and Calculating License Fees

[1394] Server: Check the intellectual property rights status of all design elements used in the final design (e.g., using Google Cloud Vision AI).

[1395] Server: Calculates the license fee based on the confirmed intellectual property rights and sends the details to the terminal.

[1396] Terminal: Shows the user the license fee and its breakdown.

[1397] 6. Payment of License Fees

[1398] User: Enter your credit card information according to the license fee payment information.

[1399] Terminal: Sends payment information to the server and initiates the payment process (e.g., using Stripe).

[1400] Server: Performs payment processing and sends the result to the terminal.

[1401] Terminal: Displays a payment completion notification to the user.

[1402] 7. Final design provided

[1403] Server: After payment is confirmed, generate the final design files and store them in cloud storage (e.g. AWS S3).

[1404] Server: Generates the download link and sends it to the device.

[1405] On your device: You can display a download link to the user, allowing them to obtain the design file.

[1406] Examples and prompts

[1407] As a concrete example, we will show what a user would do to customize a smartphone case with a "modern" design theme.

[1408] Example prompt sentence:

[1409] Choose "Modern" as the design theme for your customized phone case, then select "Blue" as the background color and "Circle" as the button shape.

[1410] The system allows users to customize designs in real time, streamlines intellectual property rights verification and licensing payments, and securely stores final design files for immediate download.

[1411] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1412] Step 1:

[1413] User authentication

[1414] Input: The user enters their email address and password into the terminal and sends a request to the server.

[1415] Data processing / calculation: The server performs authentication by checking the received email address and password information against a database (e.g., using a MySQL database).

[1416] Specific behavior: The server performs a database query to check the credentials and generates an authentication result.

[1417] Output: The server returns the authentication result to the terminal, which displays it to the user. If the authentication is successful, proceed to the next step.

[1418] Step 2:

[1419] Design theme and product selection

[1420] Input: The user selects a product and design theme on the system and sends it to the terminal.

[1421] Data processing / calculation: The terminal sends the selected product ID and design theme ID to the server, which retrieves the corresponding design elements from the database.

[1422] Specific operation: Based on the product ID and theme ID, the server executes a database query and loads the corresponding design elements.

[1423] Output: The server sends the acquired design element data to the terminal, and the terminal displays a list of design elements to the user.

[1424] Step 3:

[1425] Selecting a design configuration

[1426] Input: The user selects a design element (e.g., background "blue," button "circle") and presses the confirm button on the terminal.

[1427] Data processing / calculation: The device sends the design element selection information to the server, which then generates an initial design preview based on this information. For example, a generative AI model (Stable Diffusion) is used.

[1428] Specific operation: The server receives the selection information and invokes the generative AI model to generate an initial design preview.

[1429] Output: The server sends the generated preview image data to the terminal, which displays it to the user.

[1430] Step 4:

[1431] Generate and preview your design

[1432] Input: The user checks the preview image and reselects the design elements if necessary. If there is reselection, the information is entered into the terminal.

[1433] Data processing / calculation: The terminal sends the reselected design element information to the server, and the server generates a new design preview. If there is no reselection, the final design is reflected in the preview.

[1434] Specific operation: The server receives the reselection information and calls the generative AI model again to update the design preview.

[1435] Output: The server sends the updated preview image data to the terminal, which displays it to the user.

[1436] Step 5:

[1437] Identifying intellectual property rights and calculating license fees

[1438] Input: The server retrieves information about all design elements used in the final design preview.

[1439] Data processing / calculation: The server uses the acquired design element information to check the intellectual property rights status (using Google Cloud Vision AI, etc.), and calculates the license fee based on the results of the check.

[1440] Specific operation: The server obtains intellectual property information, calculates and sums up the license fees for each design element.

[1441] Output: The server sends the license fee details to the terminal, which displays them to the user.

[1442] Step 6:

[1443] License fee payment

[1444] Input: The user enters the license fee payment information into the terminal and begins the payment process.

[1445] Data processing / calculation: The terminal sends payment information (such as credit card information) to the server, which processes the payment using a payment system (such as Stripe).

[1446] Specific operation: The server passes the received payment information to the payment system and executes the payment process.

[1447] Output: The server sends the result of the payment process to the terminal, which notifies the user.

[1448] Step 7:

[1449] Final design provided

[1450] Input: The server will generate the final design files after confirming payment.

[1451] Data processing / calculation: The server saves the final design data in cloud storage (e.g., AWS S3) and generates a download link.

[1452] Specific operation: The server uploads the final design data and obtains a download link from the cloud storage service.

[1453] Output: The server sends a download link to the device, which displays it to the user, who then uses the download link to get the final design file.

[1454] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1455] The following describes an embodiment of the present invention. The present invention is a system that aims to promote the creative creation and personalization of designs while ensuring the protection of intellectual property rights. This system incorporates an emotion engine, which adds functionality to recognize a user's emotions and suggest and adjust design themes and parts based on those emotions.

[1456] Overall system overview

[1457] The system consists of three main components: the user, the device, and the server, and is equipped with an emotion engine. The user selects a design theme and sends a request to the server via their device. The server loads the relevant design parts and generates a design preview. During the generation process, the emotion engine recognizes the user's emotions and provides appropriate advice and adjustments. The server also verifies intellectual property rights, calculates the license fee, and presents it to the user. Once the user pays the license fee, the server generates the final design file and provides it to the user.

[1458] Program processing and natural language explanation

[1459] 1. User Authentication

[1460] User: Accesses the platform and enters their email address and password on the login screen.

[1461] Terminal: Sends the entered email address and password to the server.

[1462] Server: Checks the credentials in the database and returns the authentication result to the device.

[1463] Terminal: Displays the authentication result. If authentication is successful, the user can proceed to the next step.

[1464] 2. Select a design theme

[1465] User: On the home screen, select the desired theme (e.g., "Modern") from the list of design themes.

[1466] Device: Sends the selected theme ID to the server.

[1467] Server: Loads design elements related to the theme (background, font, color, etc.) from the database and sends them to the terminal.

[1468] Terminal: Displays the loaded design parts to the user.

[1469] 3. Emotion Recognition by Emotion Engine

[1470] Device: The emotion engine is activated and analyzes the user's facial expressions and voice using the device's camera, microphone, etc.

[1471] Server: Detects the user's emotional state based on the emotional data sent from the emotion engine.

[1472] Server: Based on the detected emotions, suggests appropriate design themes and parts to the user.

[1473] 4. Selecting a design configuration

[1474] User: Select each part from the displayed design parts (e.g., main background "blue", button "circle", etc.).

[1475] Terminal: Sends information about the selected design parts to the server.

[1476] Server: Using the selected parts, generate an initial design preview using AI, and send the generated preview image to the device.

[1477] Terminal: The generated preview image is displayed to the user.

[1478] Emotion engine: Re-analyzes user responses and suggests corrections if necessary.

[1479] 5. Intellectual Property Verification and License Fee Calculation

[1480] Server: Based on the final selected design parts, it checks the intellectual property rights, calculates the license fee for each part, and sends the detailed information to the terminal.

[1481] Terminal: Displays intellectual property information and license fee details to the user.

[1482] 6. Payment of license fee and finalization of design

[1483] User: Confirm license fee payment information and enter payment information, including credit card information.

[1484] Terminal: Sends the entered payment information to the server.

[1485] Server: Performs payment processing and sends the processing results to the terminal.

[1486] Terminal: Notifies the user that the payment has been completed.

[1487] 7. Download your design

[1488] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[1489] On the device: Display the download link to the user.

[1490] User: Click the download link and save the final design file to your device.

[1491] Specific examples

[1492] For example, suppose a user selects the "Modern" design theme, "Blue" as the main background, and "Circular" as the button style. After the user selects these, the server uses AI to instantly generate a preview image that reflects the selected background and button style.

[1493] The emotion engine analyzes the user's facial expressions and voice to determine whether they are satisfied, for example. If they are not satisfied, the emotion engine will suggest alternatives, and the user can make a new selection based on those suggestions.

[1494] Next, the user confirms the license fee calculation and enters their credit card information to make the payment. The server processes the payment, generates the final design files, and provides a download link. Finally, the user can click the link to download and use the design files.

[1495] In this way, users can easily generate designs that match their emotions using the emotion engine while ensuring both design customization and protection of intellectual property rights.

[1496] The processing flow will be explained below.

[1497] Step 1:

[1498] User: Accesses the platform and enters their email address and password on the login screen.

[1499] Terminal: Sends the entered email address and password to the server.

[1500] Server: Checks the credentials in the database and returns the authentication result to the device.

[1501] Terminal: Displays the authentication result. If authentication is successful, the user can proceed to the next step.

[1502] Step 2:

[1503] User: On the home screen, select the desired theme (e.g., "Modern") from the list of design themes.

[1504] Device: Sends the selected theme ID to the server.

[1505] Server: Loads design elements related to the theme (background, font, color, etc.) from the database and sends them to the terminal.

[1506] Terminal: Displays the loaded design parts to the user.

[1507] Step 3:

[1508] Device: The emotion engine is activated and analyzes the user's facial expressions and voice using the device's camera, microphone, etc.

[1509] Server: Detects the user's emotional state based on the emotional data sent from the emotion engine.

[1510] Server: Based on the detected emotions, suggests appropriate design themes and parts to the user.

[1511] On the device: Display suggestions to the user based on the detected emotions.

[1512] Step 4:

[1513] User: Select each part from the displayed design parts (e.g., main background "blue", button "circle", etc.).

[1514] Terminal: Sends information about the selected design parts to the server.

[1515] Server: Using the selected parts, generate an initial design preview using AI, and send the generated preview image to the device.

[1516] Terminal: The generated preview image is displayed to the user.

[1517] Step 5:

[1518] User: Check the preview image and reselect design elements and color schemes as needed.

[1519] Terminal: Sends design part information to the server again based on the new selection (if reselection occurs).

[1520] Server: Generates an updated design preview using the reselected parts and sends it to the device.

[1521] Terminal: Show updated preview image to user.

[1522] Emotion engine: Re-analyzes user responses and suggests corrections if necessary.

[1523] Step 6:

[1524] Server: Based on the final selected design parts, it checks the intellectual property rights, calculates the license fee for each part, and sends the detailed information to the terminal.

[1525] Terminal: Displays intellectual property information and license fee details to the user.

[1526] Step 7:

[1527] User: Confirm license fee payment information and enter payment information, including credit card information.

[1528] Terminal: Sends the entered payment information to the server.

[1529] Server: Performs payment processing and sends the processing results to the terminal.

[1530] Terminal: Notifies the user that the payment has been completed.

[1531] Step 8:

[1532] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[1533] On the device: Display the download link to the user.

[1534] User: Click the download link and save the final design file to your device.

[1535] Through these steps, users can select a design theme and elements, generate a design based on them, review it, and finally download it after paying the license fee. The addition of an emotion engine enables more appropriate suggestions and modifications based on the user's emotions, improving the user experience.

[1536] Example 2

[1537] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1538] When customizing and personalizing designs, it is difficult to automatically suggest appropriate design elements that match the user's emotions, while simultaneously generating the final design quickly and effectively while protecting intellectual property rights. There is also a need to automate the selection of design elements and the generation of previews that meet diverse user needs. This allows users to carry out the design process easily and intuitively, but conventional systems have had difficulty meeting this requirement.

[1539] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1540] In this invention, the server includes: means for providing multiple design elements based on a design theme individually selected by the user; means for generating a design preview based on the design elements selected by the user; means for verifying intellectual property rights of each design element used in the generated design preview and calculating a license fee; means for presenting the license fee to the user and processing payment; means for generating a final design file and providing it to the user after payment is completed; means for recognizing the user's emotions; and means for suggesting appropriate design elements based on the recognized emotions. This enables automatic suggestion of design elements that match the user's emotions. Furthermore, a system can be provided that protects intellectual property rights, streamlines the design generation process, and simplifies design customization and personalization.

[1541] "User" means any person or entity that uses the System to enjoy the convenience of customizing and personalizing designs.

[1542] A "design theme" is a collective term for multiple visual styles or concepts that a user can select, and which determine the basic direction and atmosphere of a design.

[1543] "Design elements" are individual parts related to a design theme and include specific design components such as background, font, color, and shape.

[1544] A "design preview" is a preliminary visual representation of a design that is generated by combining design elements selected by the user.

[1545] "Intellectual Property Rights" means legal rights in and to design elements and other creative works, including copyright, trademark, and patent rights.

[1546] A "license fee" is a fee paid to the owner of the intellectual property rights, and is a fee required when a user uses a design element.

[1547] "Emotion recognition" is the process of analyzing data such as a user's facial expressions and voice to determine their emotional state (e.g., joy, sadness, surprise, etc.).

[1548] "Generative model" is a general term for algorithms and techniques for generating design previews using artificial intelligence.

[1549] "Authentication Information" refers to the credentials, such as email address and password, that a user uses to access a system.

[1550] "Authentication processing" is a process of verifying the authentication information of a user attempting to access a system and determining whether the user has the right to access the system.

[1551] The present invention is a system that aims to promote the creative creation and personalization of designs while ensuring the protection of intellectual property rights. The system incorporates an emotion engine that recognizes the user's emotions and suggests and adjusts design themes and parts based on those emotions.

[1552] System configuration

[1553] This system consists of three main components: the user, the terminal, and the server, and is equipped with an emotion engine.

[1554] 1. User: The user accesses the system through an interface and selects design themes and parts. The user also has the ability to adjust the design based on suggestions from the emotion engine.

[1555] 2. Device: A computer or mobile device used by a user. The device sends input from the user to the server and displays the data received from the server. The device also runs an emotion engine and captures the user's emotions using a camera or microphone.

[1556] 3. Server: The server processes data received from users, manages design parts and theme data, generates design previews using generative AI models, and is also responsible for intellectual property rights verification and license fee calculation.

[1557] System Operation

[1558] The general operation flow of this system is as follows:

[1559] 1. User Authentication

[1560] The user logs in to the system using their email address and password. The device sends this information to the server, which then performs the authentication process. If the authentication is successful, the user proceeds to the next step.

[1561] 2. Select a design theme

[1562] The user selects a desired theme from a list of design themes, and the device sends the theme ID to the server, which then loads the associated design parts from the database and sends them to the device.

[1563] 3. Emotion Recognition by Emotion Engine

[1564] The device activates the emotion engine and captures the user's facial expressions and voice in real time using a camera and microphone. The server analyzes the emotion data and suggests appropriate design parts based on the user's emotional state.

[1565] 4. Selecting a design configuration

[1566] The user selects each design part from the displayed list, and the device sends the selection information to the server, which then uses the generative AI model to generate a design preview and sends it to the device.

[1567] 5. Intellectual Property Verification and License Fee Calculation

[1568] The server checks the intellectual property rights of the design parts used in the design preview and calculates the license fee, and the calculation result is presented to the user via the terminal.

[1569] 6. Payment of license fee and finalization of design

[1570] The user confirms the license fee and enters payment information. The server processes the payment and, upon completion, generates the final design files and provides a download link.

[1571] 7. Download your design

[1572] The user clicks on the download link to get the final design file.

[1573] Specific examples

[1574] For example, if a user selects the "Modern" design theme, "Blue" for the main background, and "Circular" for the button shape, the server instantly generates a preview image using the generative AI model. The emotion engine analyzes the user's emotions from their facial expressions and voice to confirm whether they are satisfied. If it determines that they are not satisfied, the emotion engine will suggest alternatives and the user can make another selection.

[1575] Prompt Sentence Examples

[1576] Please explain in detail the processing steps of a system where a user selects a design theme, analyzes their emotions using an emotion engine, and suggests appropriate design parts.

[1577] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1578] Step 1: User authentication

[1579] Input: The user enters their email address and password.

[1580] Processing: The device encodes the entered email address and password and sends them to the server using the HTTPS protocol. The server checks the received credentials against its database to determine if a matching user exists.

[1581] Output: The server returns the authentication result (success or failure) to the terminal. The terminal displays the authentication result to the user and proceeds to the next step if the authentication is successful.

[1582] Step 2: Choose a design theme

[1583] Input: The user selects the desired theme from a list of design themes provided on the home screen.

[1584] Processing: The device sends the ID of the selected theme to the server, which loads the design elements associated with the theme (background, font, color, etc.) from a database and sends this information to the device.

[1585] Output: The terminal visually displays the loaded design elements to the user.

[1586] Step 3: Emotion recognition by the emotion engine

[1587] Input: As the user views the design elements, the device uses the camera and microphone to capture the user's emotional data (facial expressions and voice).

[1588] Processing: The device processes the emotion data and sends it to the server in real time. The server then uses an emotion engine to analyze the emotion data and determine the user's emotional state.

[1589] Output: The server generates data suggesting appropriate design elements and themes based on the user's emotional state and sends it to the device. The device then presents the suggested data to the user.

[1590] Step 4: Select a design configuration

[1591] Input: The user selects each part from the proposed design elements (e.g., main background "blue," button "circular," etc.).

[1592] Processing: The device sends information about the selected design elements to the server, which uses the generative AI model to create a design preview and sends this preview image to the device.

[1593] Output: The device displays the generated design preview to the user and then activates the emotion engine to analyze the user's reaction and, if necessary, suggest further revisions.

[1594] Step 5: Identifying intellectual property and calculating license fees

[1595] Input: When the user performs an action to finalize the design preview, the server receives information about the design elements used.

[1596] Processing: The server checks the intellectual property rights of the selected design elements, calculates the license fee for each element, and then sums up the calculated license fees to calculate the total license fee.

[1597] Output: The server sends the license fee details to the terminal, which displays them to the user.

[1598] Step 6: Pay the license fee and finalize the design

[1599] Input: The user confirms the proposed license fee and enters payment information (such as credit card information).

[1600] Processing: The terminal sends the payment information to the server using the HTTPS protocol. The server processes the payment and returns the processing result to the terminal. If the payment is successful, the server generates the final design file.

[1601] Output: The terminal will notify the user of the payment result. After notifying that the payment was successful, a download link will be displayed.

[1602] Step 7: Download your design

[1603] Input: User clicks on download link.

[1604] Processing: The server generates the final design file and sends a secure download link to the device, which displays this link to the user.

[1605] Output: Users can click a link to save the final design file to their device.

[1606] (Application example 2)

[1607] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1608] Conventional design generation systems offer limited design parts and themes to users, and do not adequately personalize the design based on individual emotions and preferences. Furthermore, it is difficult to visualize designs in real space, making it difficult to maximize user satisfaction. Furthermore, the verification of intellectual property rights and the calculation of license fees are complex, making the system cumbersome for users. These issues need to be resolved.

[1609] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1610] In this invention, the server includes: means for providing multiple design components based on a design theme individually selected by the user; means for generating a design forecast based on the design components selected by the user; means for verifying intellectual property rights for each design component used in the generated design forecast and calculating royalties; means for presenting royalties to the user and processing payment; means for generating a final design file and providing it to the user after payment is completed; means for recognizing the user's emotions and suggesting and adjusting design themes and components based on the emotions; and means for applying and visualizing the design forecast in real space through the user's scaled display device. This allows the user to receive design suggestions based on their own emotions and make a satisfying design selection through visualization in real space. Furthermore, intellectual property rights verification and license fee calculation are automated, simplifying use.

[1611] 1. "Design Theme" means the overall style or concept of a design that a user can choose from.

[1612] 2. "Design Components" refers to the individual parts or elements that make up a design theme, such as background, font, color, shape, etc.

[1613] 3. "Design Preview" is a preview of the design generated based on the design components selected by the user.

[1614] 4. "Intellectual Property Rights" means legally protected rights in design parts and themes.

[1615] 5. "Royalty" means the fee payable for the use of any Intellectual Property Rights-containing item.

[1616] 6. "Means for recognizing emotions" refers to technology or devices that analyze a user's facial expressions and voice to recognize their emotional state.

[1617] 7. "Means for suggesting and adjusting" refers to the function of recommending appropriate design themes and components to users based on the recognized user emotions.

[1618] 8. "Scaled display device" refers to a device that uses augmented reality (AR) technology to apply designs to real-world space and allow users to visualize them.

[1619] The following describes an embodiment of the present invention: This invention is a system that provides multiple design components based on a design theme individually selected by a user, proposes designs based on the user's emotions, and visualizes the final design in the user's real space.

[1620] Overall system configuration

[1621] The system consists of three main components: the user, the device, and the server. The device includes a scaled display device (e.g., smart glasses), and the server includes an emotion engine (e.g., Emotion API) that recognizes emotions and makes suggestions, and a generative AI model (e.g., Generative Adversarial Networks, hereafter referred to as "GAN") that generates design predictions. It also has the ability to visualize the design predictions in real space using 3D modeling software (e.g., Blender).

[1622] System Procedures

[1623] 1. User Authentication

[1624] The user enters login information through the terminal and sends it to the server. The server performs authentication processing and returns the results to the terminal.

[1625] 2. Select a design theme

[1626] The user selects a design theme using the terminal interface, and the selection is sent to the server, which loads and sends the associated design parts to the terminal.

[1627] 3. Emotion Recognition by Emotion Engine

[1628] The device's built-in camera and microphone capture the user's facial expressions and voice in real time and send the data to a server, which then uses an emotion engine to analyze the user's emotions.

[1629] 4. Design prediction and proposal

[1630] The server makes design suggestions based on emotions and generates design predictions using a generative AI model (GAN) based on the design components selected by the user. The generated design predictions are sent to the device and displayed to the user.

[1631] 5. AR Preview

[1632] The generated design predictions are applied and visualized in real space using the user's scaled display device (smart glasses), and previewed in real time using 3D modeling software (Blender).

[1633] 6. Intellectual property rights verification and license management

[1634] The server checks the intellectual property rights of each design component used in the design forecast and calculates the royalty. The calculation results are sent to the terminal and presented to the user.

[1635] 7. Payment Processing and Download of Final Design

[1636] Once the user pays the license fee, the server generates the final design file and sends a download link to the device, which the user clicks to download the design file.

[1637] Specific examples

[1638] For example, if a user selects a "minimalist" design theme, sets the wall color to "white," and the furniture style to "modern," the smart glasses will reflect those settings in the AR preview of the room in real time. The emotion engine analyzes the user's satisfaction level from their facial expressions and may suggest changing the color to "light gray" if the user is not satisfied.

[1639] Example prompts to input to the generative AI model

[1640] "Generate a living room design preview with a minimalist theme, white wall color, and modern furniture style."

[1641] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1642] Step 1:

[1643] User Authentication

[1644] The user enters login information (email address and password) through the device interface. The device sends this authentication information to the server. The server checks the authentication information in the database and returns the authentication result to the device. The device displays the authentication result to the user, and if authentication is successful, the user can proceed to the next step.

[1645] Input: User login information

[1646] Output: Authentication result (success or failure)

[1647] Specific operations: Sending authentication information, checking database, displaying authentication results

[1648] Step 2:

[1649] Select a design theme

[1650] The user selects the desired theme from a list of design themes presented on the device's home screen. The device then sends the selected theme's ID to the server. The server then loads design elements (background, font, color, etc.) associated with the theme from the database and sends them to the device. The device then displays the loaded design elements to the user.

[1651] Input: Design theme selection information

[1652] Output: Display of related design parts

[1653] Specific operations: Select design theme, send theme ID, load design parts, display selection candidates

[1654] Step 3:

[1655] emotion recognition

[1656] The device's built-in camera and microphone capture the user's facial expressions and voice in real time and send the data to a server, which then uses an emotion engine (e.g., Emotion API) to analyze the emotion data and detect the user's emotional state.

[1657] Input: User's facial expression data, voice data

[1658] Output: Emotional state detection result

[1659] Specific operations: data capture, data transmission, emotion analysis, emotional state detection

[1660] Step 4:

[1661] Design prediction and proposal

[1662] The server proposes appropriate design components based on the user's emotional state. Based on the design components selected by the user, a design forecast is generated using a generative AI model (e.g., GAN). The generated design forecast is sent to the device and displayed to the user.

[1663] Input: User's emotional state, selected design part

[1664] Output: Generated design predictions

[1665] Specific actions: Proposals based on emotional state, prediction generation by generative AI model

[1666] Step 5:

[1667] AR Preview

[1668] The server generates design predictions that are then visualized in real space through a scaled display device (e.g., smart glasses) on the device. A real-time preview is performed using 3D modeling software (e.g., Blender). The user can review the preview and accept suggested revisions if necessary.

[1669] Input: Generated design forecast

[1670] Output: Visualized design preview in real space

[1671] Specific operation: Applying design predictions, displaying real-time samples

[1672] Step 6:

[1673] Intellectual property rights verification and license management

[1674] The server checks the intellectual property rights of each design part used in the design forecast and calculates the usage fee. The calculated usage fee is sent to the terminal and displayed to the user. The user then approves the payment.

[1675] Input: Information on the design components used in the design prediction

[1676] Output: Calculation result of usage fee, presented to the user

[1677] Specific operations: Checking intellectual property rights, calculating royalties, displaying royalties

[1678] Step 7:

[1679] Payment processing and download of final design

[1680] The user approves the license fee and enters payment information. The entered payment information is sent to the server, which processes the payment. Once payment is complete, the server generates the final design file and sends a download link to the device. The user downloads the design file from the link.

[1681] Input: Payment information

[1682] Output: Payment completion notification, download link for the final design file

[1683] Specific actions: Sending payment information, processing payments, sending links, downloading files

[1684] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1685] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1686] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1687] [Fourth embodiment]

[1688] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1689] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1690] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1691] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1692] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1693] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1694] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1695] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1696] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1697] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1698] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1699] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1700] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1701] The following describes an embodiment of the present invention. The present invention is a system that allows users to freely personalize designs while protecting intellectual property rights. In this system, the user selects a design theme and design parts, generates a design preview based on the selected design, and finally confirms the intellectual property rights, calculates the license fee, and provides the final design file once payment is completed.

[1702] Overall system overview

[1703] The system consists of three main components: the user, the terminal, and the server. The user selects a design theme and sends a request to the server through the terminal. The server loads the related design parts and generates a design preview. The server then verifies the intellectual property rights, calculates the license fee, and presents it to the user. Once the user pays the license fee, the server generates the final design file and provides it to the user.

[1704] Program processing and natural language explanation

[1705] 1. User Authentication

[1706] User: Accesses the platform and enters their email address and password on the login screen.

[1707] Terminal: Sends the entered email address and password to the server.

[1708] Server: Checks the credentials in the database and returns the authentication result to the device.

[1709] Terminal: Displays the authentication result, and if authentication is successful, proceeds to the next step.

[1710] 2. Select a design theme

[1711] User: Select the desired theme (e.g. "Modern") from the list of design themes.

[1712] Device: Sends the selected theme ID to the server.

[1713] Server: Loads design elements related to the theme (background, font, color, etc.) from the database and sends them to the terminal.

[1714] Terminal: Displays the loaded design parts to the user.

[1715] 3. Selecting a design configuration

[1716] User: Select each part from the displayed design parts (e.g., main background "blue", button "circle", etc.).

[1717] Terminal: Sends information about the selected design parts to the server.

[1718] Server: Generates an initial design preview using the selected parts and sends it to the device.

[1719] Terminal: The generated preview image is displayed and the user is asked to confirm it.

[1720] 4. Generate and preview your design

[1721] User: Check the preview image and reselect parts and color schemes as necessary.

[1722] Terminal: Sends part information to the server again based on the new selection (if a reselection occurs).

[1723] Server: [Using AI] generates the final design based on the selected theme and components and sends it to the device as a preview image.

[1724] Terminal: Shows the final preview image to the user.

[1725] 5. Intellectual Property Verification and License Fee Calculation

[1726] Server: Check the intellectual property rights status of all design parts used in the final preview.

[1727] Server: Based on the confirmed intellectual property rights, calculates the required license fees and sends the detailed information to the terminal.

[1728] Terminal: Shows the user the license fee and its breakdown.

[1729] 6. Payment of license fee and finalization of design

[1730] User: Enter your credit card information according to the license fee payment information displayed.

[1731] Terminal: Sends payment information to the server and initiates the payment process.

[1732] Server: Performs payment processing and sends the processing results to the terminal.

[1733] Terminal: Notifies the user that the payment has been completed.

[1734] 7. Download your design

[1735] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[1736] Terminal: Display and provide the download link to the user.

[1737] User: Click the download link to save the final design file to your device.

[1738] Specific examples

[1739] For example, suppose a user selects the "Modern" design theme, "Blue" as the main background, and "Circular" as the button style. After the user selects these, the server uses AI to instantly generate a preview image that reflects the selected background and button style.

[1740] Next, the user confirms the license fee calculation and enters their credit card information to make the payment. The server processes the payment, generates the final design files, and provides a download link. Finally, the user can click the link to download and use the design files.

[1741] In this way, users can easily create their own preferred designs while ensuring both customization of the design and protection of intellectual property rights.

[1742] The processing flow will be explained below.

[1743] Step 1:

[1744] User: Accesses the platform and enters their email address and password on the login screen.

[1745] Terminal: Sends the entered email address and password to the server.

[1746] Server: Checks the credentials in the database and returns the authentication result to the device.

[1747] Terminal: Displays the authentication result. If authentication is successful, the user can proceed to the next step.

[1748] Step 2:

[1749] User: On the home screen, select the desired theme (e.g., "Modern") from the list of design themes.

[1750] Device: Sends the selected theme ID to the server.

[1751] Server: Loads design elements related to the theme (background, fonts, colors, etc.) from the database and sends them to the device.

[1752] Terminal: Displays the loaded design parts to the user.

[1753] Step 3:

[1754] User: Select each part from the displayed design parts (e.g., main background "blue", button "circle", etc.).

[1755] Terminal: Sends information about the selected design parts to the server.

[1756] Server: Using the selected parts, generate an initial design preview using AI, and send the generated preview image to the device.

[1757] Terminal: The generated preview image is displayed to the user.

[1758] Step 4:

[1759] User: Check the preview image and reselect design elements and color schemes as needed.

[1760] Terminal: Sends design part information to the server again based on the new selection (if reselection occurs).

[1761] Server: Generates an updated design preview using the reselected parts and sends it to the device.

[1762] Terminal: Show updated preview image to user.

[1763] Step 5:

[1764] Server: Based on the final selected design parts, it checks the intellectual property rights, calculates the license fee for each part, and sends the detailed information to the terminal.

[1765] Terminal: Displays intellectual property information and license fee details to the user.

[1766] Step 6:

[1767] User: Confirm license fee payment information and enter payment information, including credit card information.

[1768] Terminal: Sends the entered payment information to the server.

[1769] Server: Performs payment processing and sends the processing results to the terminal.

[1770] Terminal: Notifies the user that the payment has been completed.

[1771] Step 7:

[1772] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[1773] On the device: Display the download link to the user.

[1774] User: Click the download link and save the final design file to your device.

[1775] By following these steps, users can complete the process of selecting a design theme and parts, generating and confirming a design based on those themes, and finally paying the license fee and downloading the design.

[1776] Example 1

[1777] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1778] With conventional design generation systems, it is difficult for users to easily personalize designs according to their preferences, and the process of verifying intellectual property rights and calculating license fees is cumbersome. Therefore, there is a need for a system that allows users to quickly and easily generate designs and use them while protecting appropriate intellectual property rights.

[1779] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1780] In this invention, the server includes means for providing a plurality of design components based on a design theme individually selected by the user, means for generating a design preview based on the design components selected by the user, means for checking the intellectual property rights of each design component used in the generated design preview and calculating a license fee, means for presenting the license fee to the user and processing payment, and means for generating a final design file and providing it to the user after payment is completed, thereby enabling users to easily personalize designs and use them while appropriately protecting their intellectual property rights.

[1781] A "design theme" is a category that can be selected by the user to determine the basic style, color scheme, and components of the overall system design.

[1782] "Design components" are specific design parts such as background, font, color, button shape, etc. that are selected based on the design theme.

[1783] A "design preview" is a display image that the system generates based on the selected design components, allowing you to preview how the final design will look.

[1784] "Intellectual Property Rights" means copyright, patent, trademark, or other legal rights protected in and to the Design Elements and combinations thereof.

[1785] "License Fee" means the fee payable for the use of a Design Component used in a Generated Design.

[1786] "Payment processing means" refers to the system and process that processes payment information, such as credit card information, used by users to pay license fees.

[1787] A "final design file" is a file containing the final generated design based on the design theme and design components selected by the user.

[1788] An embodiment of the present invention will be described. The present invention is a system that allows users to freely personalize designs while protecting intellectual property rights. This system consists of three main components: a user, a terminal, and a server. A user selects a design theme and sends a request to the server through their terminal. The server loads related design components and generates a design preview. The server then verifies the intellectual property rights, calculates a license fee, and presents it to the user. Once the user pays the license fee, the server generates the final design file and provides it to the user. This process also uses a generative model to streamline the generation of the design preview.

[1789] Hardware and software used

[1790] The system of the present invention uses the following hardware and software:

[1791] Servers: Database servers, servers for running AI generative models (e.g., TensorFlow or PyTorch-based models), and license management systems.

[1792] Device: A device operated by a user, such as a computer, smartphone, or tablet.

[1793] Software: web browser, payment system (e.g. Stripe, PayPal, etc.), design preview display system.

[1794] Program processing

[1795] 1. User Authentication

[1796] User: Accesses the platform and enters their email address and password on the login screen.

[1797] Terminal: Sends the entered email address and password to the server.

[1798] Server: Checks the credentials in the database and returns the authentication result to the device.

[1799] Terminal: Displays the authentication result, and if authentication is successful, proceeds to the next step.

[1800] 2. Select a design theme

[1801] User: Select the desired theme (e.g. "Modern") from the list of design themes.

[1802] Device: Sends the selected theme ID to the server.

[1803] Server: Loads the design elements related to the theme (background, fonts, colors, etc.) from a database and sends them to the device.

[1804] Terminal: Displays the loaded design components to the user.

[1805] 3. Selecting a design configuration

[1806] User: Select each part from the displayed design components (e.g., main background "blue", button "circle", etc.).

[1807] Terminal: Sends information about the selected design components to the server.

[1808] Server: Generates an initial design preview using the selected parts and sends it to the device.

[1809] Terminal: The generated preview image is displayed and the user is asked to confirm it.

[1810] 4. Generate and preview your design

[1811] User: Check the preview image and reselect parts and color schemes as necessary.

[1812] Terminal: Sends part information to the server again based on the new selection (if a reselection occurs).

[1813] Server: Uses the generative model to generate the final design based on the selected theme and components, and sends it to the device as a preview image.

[1814] Terminal: Shows the final preview image to the user.

[1815] 5. Intellectual Property Verification and License Fee Calculation

[1816] Server: Check the intellectual property rights status of all design elements used in the final preview.

[1817] Server: Based on the confirmed intellectual property rights, calculates the required license fees and sends the details to the terminal.

[1818] Terminal: Shows the user the license fee and its breakdown.

[1819] 6. Payment of license fee and finalization of design

[1820] User: Enter your credit card information according to the license fee payment information displayed.

[1821] Terminal: Sends payment information to the server and initiates the payment process.

[1822] Server: Performs payment processing and sends the processing results to the terminal.

[1823] Terminal: Notifies the user that the payment has been completed.

[1824] 7. Download your design

[1825] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[1826] Terminal: Display and provide the download link to the user.

[1827] User: Click the download link to save the final design file to your device.

[1828] Specific examples

[1829] For example, suppose a user selects the "Modern" design theme, chooses "Blue" as the main background, and selects "Circular" as the button style. The user makes these selections, and the server uses the generative model to instantly generate a preview image that reflects the selected background and button style.

[1830] Next, the user confirms the license fee calculation and enters their credit card information to make the payment. The server processes the payment, generates the final design files, and provides a download link. Finally, the user can click the link to download and use the design files.

[1831] Prompt Sentence Examples

[1832] "If a user selects 'Modern' as the design theme, 'Blue' as the main background, and 'Circular' as the button, explain how the system generates the design, verifies intellectual property rights, and provides the final design file."

[1833] In this way, this system allows users to freely personalize their designs while properly protecting their intellectual property rights and providing a concrete means for easily generating and obtaining design files.

[1834] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1835] Step 1:

[1836] User authentication

[1837] User: Access the platform, enter your email address and password on the login screen, and click the "Login" button.

[1838] Input: Email address, password

[1839] Terminal: Sends the entered email address and password to the server.

[1840] Output: Authentication request

[1841] Server: Matches the received email address and password with the credentials in its database and generates an authentication status.

[1842] Input: Authentication Request

[1843] Output: Authentication result (success or failure)

[1844] Terminal: Displays the authentication result, and if authentication is successful, proceeds to the next step. If authentication fails, displays an error message.

[1845] Output: Display of authentication result

[1846] Step 2:

[1847] Select a design theme

[1848] User: After logging in, select the desired theme (e.g. "Modern") from the list of design themes displayed.

[1849] Input: Selected Design Theme

[1850] Device: Sends the selected theme ID to the server.

[1851] Output: Send theme ID

[1852] Server: Based on the theme ID, retrieves related design elements (background, font, color, etc.) from the database and sends them to the device.

[1853] Input: Theme ID

[1854] Output: Associated design components

[1855] Terminal: Displays the design components received from the server to the user.

[1856] Output: Display of design components

[1857] Step 3:

[1858] Selecting a design configuration

[1859] User: Select each part (e.g., main background "blue," button "circle," etc.) from the displayed design components.

[1860] Input: Selected design component

[1861] Terminal: Collects information about the selected design components and sends their IDs to the server.

[1862] Output: Send ID of design component

[1863] Server: Based on the IDs of the received design components, it generates an initial design preview and sends it to the device.

[1864] Input: ID of the design component

[1865] Output: Initial design preview image

[1866] Terminal: The generated preview image is displayed to the user.

[1867] Output: Show preview image

[1868] Step 4:

[1869] Generate and preview your design

[1870] User: Check the preview image and reselect parts and color schemes if necessary. If there is no need to reselect, proceed to the next step.

[1871] Input: Reselected design components

[1872] Terminal: Sends part information to the server again based on the new selection (if a reselection occurs).

[1873] Output: Sending reselected part information

[1874] Server: Uses the generative model to generate the final design based on the selected theme and components, and sends it to the device as a preview image.

[1875] Input: Reselected part information

[1876] Output: Final preview image

[1877] Terminal: Shows the final preview image to the user.

[1878] Output: Display final preview image

[1879] Step 5:

[1880] Intellectual property verification and license fee calculation

[1881] Server: All design elements used in the final preview are checked against a database to verify their intellectual property rights.

[1882] Inputs: Design components used in the final preview

[1883] Output: Intellectual property rights verification results

[1884] Server: Based on the confirmed intellectual property rights, calculates the required license fees and sends the details to the terminal.

[1885] Input: Intellectual property rights confirmation result

[1886] Output: License fee details

[1887] Terminal: Shows the user the license fee and its breakdown.

[1888] Output: Display license fee

[1889] Step 6:

[1890] Pay the license fee and finalize the design

[1891] User: Enter your credit card information according to the license fee payment information displayed.

[1892] Input: Credit card information

[1893] Terminal: Sends payment information to the server and initiates the payment process.

[1894] Output: Send payment information

[1895] Server: Performs payment processing and sends the processing results to the terminal.

[1896] Input: Payment information

[1897] Output: Payment processing result

[1898] Terminal: Notifies the user that the payment has been completed.

[1899] Output: Notification of successful payment

[1900] Step 7:

[1901] Download the design

[1902] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[1903] Input: Payment confirmation

[1904] Output: Final design files, download link

[1905] On the device: Show the download link to the user.

[1906] Output: Download link displayed

[1907] User: Click the download link to save the final design file to your device.

[1908] Input: Download link

[1909] Output: Save the final design file

[1910] (Application example 1)

[1911] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1912] In the modern design industry, there is a growing need for users to create their own customized designs. However, when users freely create designs, it is difficult to protect the intellectual property rights of the designs and calculate appropriate license fees. It is also challenging to quickly provide users with generated design previews and safely store and download the final design files. Furthermore, a system that can perform these processes seamlessly is required.

[1913] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1914] In this invention, the server includes: means for providing multiple design elements based on a design theme individually selected by the user; means for generating a design preview based on the design elements selected by the user; means for verifying intellectual property rights of each design element used in the generated design preview and calculating a license fee; means for presenting the license fee to the user and processing payment; means for generating a final design file and providing it to the user after payment is completed; means for sending a notification to the user's device; and means for saving the final design file in cloud storage and generating a download link. This allows users to freely customize designs, protect intellectual property rights, and ensure appropriate license fee payment. It also enables users to quickly and securely obtain the final design file.

[1915] "User" means an individual or organization that utilizes the system to customize a design and obtain a final design file.

[1916] A "design theme" is a setting selected by the user that indicates the overall design direction or style.

[1917] "Design elements" are the individual elements that make up a design, including background, font, color, etc.

[1918] A "design preview" is a preliminary visual representation of a design that is generated based on user-selected design elements.

[1919] "Intellectual property rights" refers to rights protected by law, such as copyrights, patents, and trademarks, relating to design parts.

[1920] "License Fee" means the amount paid as consideration for the use of Design Parts.

[1921] "Final Design File" means the final and completed design data generated based on the user's customized design.

[1922] A "terminal" is an electronic device such as a computer, smartphone, or tablet that a user uses to operate the system.

[1923] "Cloud storage" refers to a remote storage device where data can be stored and accessed over the Internet.

[1924] "Download Link" means the URL or hyperlink where a User can obtain the Final Design File via the Internet.

[1925] "Notification" refers to messages such as update information and processing results sent from the system to the user.

[1926] A "generative AI model" is a program that uses artificial intelligence to automatically generate designs based on user selections.

[1927] A "server" is a computer system used to process user requests and provide data.

[1928] The following describes the mode for carrying out the present invention. The system of the present invention allows users to freely customize designs and provides functions to protect intellectual property rights. This system consists of three main components: a user, a terminal, and a server.

[1929] Program processing and natural language explanation

[1930] 1. User Authentication

[1931] User: Accesses the system and enters their email address and password on the login screen.

[1932] Terminal: Sends the entered credentials to the server.

[1933] Server: Checks the user's credentials in a database (e.g., MySQL) and returns the authentication result to the device (e.g., "Authentication successful").

[1934] Terminal: Displays the authentication result, and if successful, allows you to proceed to the next step.

[1935] 2. Design theme and product selection

[1936] User: In the system, select the product to customize (e.g., a phone case) and the design theme (e.g., "Modern").

[1937] Terminal: Sends the selected product ID and design theme ID to the server.

[1938] Server: Loads relevant design elements (background, fonts, colors, etc.) from the database and sends them to the device.

[1939] 3. Selecting a design configuration

[1940] User: Selects the background color "blue" and the button "circle" from the design elements displayed on the terminal.

[1941] Terminal: Sends the selected design element information to the server.

[1942] Server: Based on the user's selections, generates an initial design preview and sends it to the device.

[1943] 4. Generate and preview your design

[1944] User: Review the design preview and reselect design elements as needed.

[1945] Terminal: If the user makes a new selection, it sends that information back to the server.

[1946] Server: Uses a generative AI model (e.g., Stable Diffusion) to generate the final design and send it to the device as a preview.

[1947] Terminal: Shows the final preview image to the user.

[1948] 5. Identifying Intellectual Property Rights and Calculating License Fees

[1949] Server: Check the intellectual property rights status of all design elements used in the final design (e.g., using Google Cloud Vision AI).

[1950] Server: Calculates the license fee based on the confirmed intellectual property rights and sends the details to the terminal.

[1951] Terminal: Shows the user the license fee and its breakdown.

[1952] 6. Payment of License Fees

[1953] User: Enter your credit card information according to the license fee payment information.

[1954] Terminal: Sends payment information to the server and initiates the payment process (e.g., using Stripe).

[1955] Server: Performs payment processing and sends the result to the terminal.

[1956] Terminal: Displays a payment completion notification to the user.

[1957] 7. Final design provided

[1958] Server: After payment is confirmed, generate the final design files and store them in cloud storage (e.g. AWS S3).

[1959] Server: Generates the download link and sends it to the device.

[1960] On your device: You can display a download link to the user, allowing them to obtain the design file.

[1961] Examples and prompts

[1962] As a concrete example, we will show what a user would do to customize a smartphone case with a "modern" design theme.

[1963] Example prompt sentence:

[1964] Choose "Modern" as the design theme for your customized phone case, then select "Blue" as the background color and "Circle" as the button shape.

[1965] The system allows users to customize designs in real time, streamlines intellectual property rights verification and licensing payments, and securely stores final design files for immediate download.

[1966] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1967] Step 1:

[1968] User authentication

[1969] Input: The user enters their email address and password into the terminal and sends a request to the server.

[1970] Data processing / calculation: The server performs authentication by checking the received email address and password information against a database (e.g., using a MySQL database).

[1971] Specific behavior: The server performs a database query to check the credentials and generates an authentication result.

[1972] Output: The server returns the authentication result to the terminal, which displays it to the user. If the authentication is successful, proceed to the next step.

[1973] Step 2:

[1974] Design theme and product selection

[1975] Input: The user selects a product and design theme on the system and sends it to the terminal.

[1976] Data processing / calculation: The terminal sends the selected product ID and design theme ID to the server, which retrieves the corresponding design elements from the database.

[1977] Specific operation: Based on the product ID and theme ID, the server executes a database query and loads the corresponding design elements.

[1978] Output: The server sends the acquired design element data to the terminal, and the terminal displays a list of design elements to the user.

[1979] Step 3:

[1980] Selecting a design configuration

[1981] Input: The user selects a design element (e.g., background "blue," button "circle") and presses the confirm button on the terminal.

[1982] Data processing / calculation: The device sends the design element selection information to the server, which then generates an initial design preview based on this information. For example, a generative AI model (Stable Diffusion) is used.

[1983] Specific operation: The server receives the selection information and invokes the generative AI model to generate an initial design preview.

[1984] Output: The server sends the generated preview image data to the terminal, which displays it to the user.

[1985] Step 4:

[1986] Generate and preview your design

[1987] Input: The user checks the preview image and reselects the design elements if necessary. If there is reselection, the information is entered into the terminal.

[1988] Data processing / calculation: The terminal sends the reselected design element information to the server, and the server generates a new design preview. If there is no reselection, the final design is reflected in the preview.

[1989] Specific operation: The server receives the reselection information and calls the generative AI model again to update the design preview.

[1990] Output: The server sends the updated preview image data to the terminal, which displays it to the user.

[1991] Step 5:

[1992] Identifying intellectual property rights and calculating license fees

[1993] Input: The server retrieves information about all design elements used in the final design preview.

[1994] Data processing / calculation: The server uses the acquired design element information to check the intellectual property rights status (using Google Cloud Vision AI, etc.), and calculates the license fee based on the results of the check.

[1995] Specific operation: The server obtains intellectual property information, calculates and sums up the license fees for each design element.

[1996] Output: The server sends the license fee details to the terminal, which displays them to the user.

[1997] Step 6:

[1998] License fee payment

[1999] Input: The user enters the license fee payment information into the terminal and begins the payment process.

[2000] Data processing / calculation: The terminal sends payment information (such as credit card information) to the server, which processes the payment using a payment system (such as Stripe).

[2001] Specific operation: The server passes the received payment information to the payment system and executes the payment process.

[2002] Output: The server sends the result of the payment process to the terminal, which notifies the user.

[2003] Step 7:

[2004] Final design provided

[2005] Input: The server will generate the final design files after confirming payment.

[2006] Data processing / calculation: The server saves the final design data in cloud storage (e.g., AWS S3) and generates a download link.

[2007] Specific operation: The server uploads the final design data and obtains a download link from the cloud storage service.

[2008] Output: The server sends a download link to the device, which displays it to the user, who then uses the download link to get the final design file.

[2009] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2010] The following describes an embodiment of the present invention. The present invention is a system that aims to promote the creative creation and personalization of designs while ensuring the protection of intellectual property rights. This system incorporates an emotion engine, which adds functionality to recognize a user's emotions and suggest and adjust design themes and parts based on those emotions.

[2011] Overall system overview

[2012] The system consists of three main components: the user, the device, and the server, and is equipped with an emotion engine. The user selects a design theme and sends a request to the server via their device. The server loads the relevant design parts and generates a design preview. During the generation process, the emotion engine recognizes the user's emotions and provides appropriate advice and adjustments. The server also verifies intellectual property rights, calculates the license fee, and presents it to the user. Once the user pays the license fee, the server generates the final design file and provides it to the user.

[2013] Program processing and natural language explanation

[2014] 1. User Authentication

[2015] User: Accesses the platform and enters their email address and password on the login screen.

[2016] Terminal: Sends the entered email address and password to the server.

[2017] Server: Checks the credentials in the database and returns the authentication result to the device.

[2018] Terminal: Displays the authentication result. If authentication is successful, the user can proceed to the next step.

[2019] 2. Select a design theme

[2020] User: On the home screen, select the desired theme (e.g., "Modern") from the list of design themes.

[2021] Device: Sends the selected theme ID to the server.

[2022] Server: Loads design elements related to the theme (background, font, color, etc.) from the database and sends them to the terminal.

[2023] Terminal: Displays the loaded design parts to the user.

[2024] 3. Emotion Recognition by Emotion Engine

[2025] Device: The emotion engine is activated and analyzes the user's facial expressions and voice using the device's camera, microphone, etc.

[2026] Server: Detects the user's emotional state based on the emotional data sent from the emotion engine.

[2027] Server: Based on the detected emotions, suggests appropriate design themes and parts to the user.

[2028] 4. Selecting a design configuration

[2029] User: Select each part from the displayed design parts (e.g., main background "blue", button "circle", etc.).

[2030] Terminal: Sends information about the selected design parts to the server.

[2031] Server: Using the selected parts, generate an initial design preview using AI, and send the generated preview image to the device.

[2032] Terminal: The generated preview image is displayed to the user.

[2033] Emotion engine: Re-analyzes user responses and suggests corrections if necessary.

[2034] 5. Intellectual Property Verification and License Fee Calculation

[2035] Server: Based on the final selected design parts, it checks the intellectual property rights, calculates the license fee for each part, and sends the detailed information to the terminal.

[2036] Terminal: Displays intellectual property information and license fee details to the user.

[2037] 6. Payment of license fee and finalization of design

[2038] User: Confirm license fee payment information and enter payment information, including credit card information.

[2039] Terminal: Sends the entered payment information to the server.

[2040] Server: Performs payment processing and sends the processing results to the terminal.

[2041] Terminal: Notifies the user that the payment has been completed.

[2042] 7. Download your design

[2043] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[2044] On the device: Display the download link to the user.

[2045] User: Click the download link and save the final design file to your device.

[2046] Specific examples

[2047] For example, suppose a user selects the "Modern" design theme, "Blue" as the main background, and "Circular" as the button style. After the user selects these, the server uses AI to instantly generate a preview image that reflects the selected background and button style.

[2048] The emotion engine analyzes the user's facial expressions and voice to determine whether they are satisfied, for example. If they are not satisfied, the emotion engine will suggest alternatives, and the user can make a new selection based on those suggestions.

[2049] Next, the user confirms the license fee calculation and enters their credit card information to make the payment. The server processes the payment, generates the final design files, and provides a download link. Finally, the user can click the link to download and use the design files.

[2050] In this way, users can easily generate designs that match their emotions using the emotion engine while ensuring both design customization and protection of intellectual property rights.

[2051] The processing flow will be explained below.

[2052] Step 1:

[2053] User: Accesses the platform and enters their email address and password on the login screen.

[2054] Terminal: Sends the entered email address and password to the server.

[2055] Server: Checks the credentials in the database and returns the authentication result to the device.

[2056] Terminal: Displays the authentication result. If authentication is successful, the user can proceed to the next step.

[2057] Step 2:

[2058] User: On the home screen, select the desired theme (e.g., "Modern") from the list of design themes.

[2059] Device: Sends the selected theme ID to the server.

[2060] Server: Loads design elements related to the theme (background, font, color, etc.) from the database and sends them to the terminal.

[2061] Terminal: Displays the loaded design parts to the user.

[2062] Step 3:

[2063] Device: The emotion engine is activated and analyzes the user's facial expressions and voice using the device's camera, microphone, etc.

[2064] Server: Detects the user's emotional state based on the emotional data sent from the emotion engine.

[2065] Server: Based on the detected emotions, suggests appropriate design themes and parts to the user.

[2066] On the device: Display suggestions to the user based on the detected emotions.

[2067] Step 4:

[2068] User: Select each part from the displayed design parts (e.g., main background "blue", button "circle", etc.).

[2069] Terminal: Sends information about the selected design parts to the server.

[2070] Server: Using the selected parts, generate an initial design preview using AI, and send the generated preview image to the device.

[2071] Terminal: The generated preview image is displayed to the user.

[2072] Step 5:

[2073] User: Check the preview image and reselect design elements and color schemes as needed.

[2074] Terminal: Sends design part information to the server again based on the new selection (if reselection occurs).

[2075] Server: Generates an updated design preview using the reselected parts and sends it to the device.

[2076] Terminal: Show updated preview image to user.

[2077] Emotion engine: Re-analyzes user responses and suggests corrections if necessary.

[2078] Step 6:

[2079] Server: Based on the final selected design parts, it checks the intellectual property rights, calculates the license fee for each part, and sends the detailed information to the terminal.

[2080] Terminal: Displays intellectual property information and license fee details to the user.

[2081] Step 7:

[2082] User: Confirm license fee payment information and enter payment information, including credit card information.

[2083] Terminal: Sends the entered payment information to the server.

[2084] Server: Performs payment processing and sends the processing results to the terminal.

[2085] Terminal: Notifies the user that the payment has been completed.

[2086] Step 8:

[2087] Server: After payment is confirmed, generates the final design files and sends the download link to your device.

[2088] On the device: Display the download link to the user.

[2089] User: Click the download link and save the final design file to your device.

[2090] Through these steps, users can select a design theme and elements, generate a design based on them, review it, and finally download it after paying the license fee. The addition of an emotion engine enables more appropriate suggestions and modifications based on the user's emotions, improving the user experience.

[2091] Example 2

[2092] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2093] When customizing and personalizing designs, it is difficult to automatically suggest appropriate design elements that match the user's emotions, while simultaneously generating the final design quickly and effectively while protecting intellectual property rights. There is also a need to automate the selection of design elements and the generation of previews that meet diverse user needs. This allows users to carry out the design process easily and intuitively, but conventional systems have had difficulty meeting this requirement.

[2094] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2095] In this invention, the server includes: means for providing multiple design elements based on a design theme individually selected by the user; means for generating a design preview based on the design elements selected by the user; means for verifying intellectual property rights of each design element used in the generated design preview and calculating a license fee; means for presenting the license fee to the user and processing payment; means for generating a final design file and providing it to the user after payment is completed; means for recognizing the user's emotions; and means for suggesting appropriate design elements based on the recognized emotions. This enables automatic suggestion of design elements that match the user's emotions. Furthermore, a system can be provided that protects intellectual property rights, streamlines the design generation process, and simplifies design customization and personalization.

[2096] "User" means any person or entity that uses the System to enjoy the convenience of customizing and personalizing designs.

[2097] A "design theme" is a collective term for multiple visual styles or concepts that a user can select, and which determine the basic direction and atmosphere of a design.

[2098] "Design elements" are individual parts related to a design theme and include specific design components such as background, font, color, and shape.

[2099] A "design preview" is a preliminary visual representation of a design that is generated by combining design elements selected by the user.

[2100] "Intellectual Property Rights" means legal rights in and to design elements and other creative works, including copyright, trademark, and patent rights.

[2101] A "license fee" is a fee paid to the owner of the intellectual property rights, and is a fee required when a user uses a design element.

[2102] "Emotion recognition" is the process of analyzing data such as a user's facial expressions and voice to determine their emotional state (e.g., joy, sadness, surprise, etc.).

[2103] "Generative model" is a general term for algorithms and techniques for generating design previews using artificial intelligence.

[2104] "Authentication Information" refers to the credentials, such as email address and password, that a user uses to access a system.

[2105] "Authentication processing" is a process of verifying the authentication information of a user attempting to access a system and determining whether the user has the right to access the system.

[2106] The present invention is a system that aims to promote the creative creation and personalization of designs while ensuring the protection of intellectual property rights. The system incorporates an emotion engine that recognizes the user's emotions and suggests and adjusts design themes and parts based on those emotions.

[2107] System configuration

[2108] This system consists of three main components: the user, the terminal, and the server, and is equipped with an emotion engine.

[2109] 1. User: The user accesses the system through an interface and selects design themes and parts. The user also has the ability to adjust the design based on suggestions from the emotion engine.

[2110] 2. Device: A computer or mobile device used by a user. The device sends input from the user to the server and displays the data received from the server. The device also runs an emotion engine and captures the user's emotions using a camera or microphone.

[2111] 3. Server: The server processes data received from users, manages design parts and theme data, generates design previews using generative AI models, and is also responsible for intellectual property rights verification and license fee calculation.

[2112] System Operation

[2113] The general operation flow of this system is as follows:

[2114] 1. User Authentication

[2115] The user logs in to the system using their email address and password. The device sends this information to the server, which then performs the authentication process. If the authentication is successful, the user proceeds to the next step.

[2116] 2. Select a design theme

[2117] The user selects a desired theme from a list of design themes, and the device sends the theme ID to the server, which then loads the associated design parts from the database and sends them to the device.

[2118] 3. Emotion Recognition by Emotion Engine

[2119] The device activates the emotion engine and captures the user's facial expressions and voice in real time using a camera and microphone. The server analyzes the emotion data and suggests appropriate design parts based on the user's emotional state.

[2120] 4. Selecting a design configuration

[2121] The user selects each design part from the displayed list, and the device sends the selection information to the server, which then uses the generative AI model to generate a design preview and sends it to the device.

[2122] 5. Intellectual Property Verification and License Fee Calculation

[2123] The server checks the intellectual property rights of the design parts used in the design preview and calculates the license fee, and the calculation result is presented to the user via the terminal.

[2124] 6. Payment of license fee and finalization of design

[2125] The user confirms the license fee and enters payment information. The server processes the payment and, upon completion, generates the final design files and provides a download link.

[2126] 7. Download your design

[2127] The user clicks on the download link to get the final design file.

[2128] Specific examples

[2129] For example, if a user selects the "Modern" design theme, "Blue" for the main background, and "Circular" for the button shape, the server instantly generates a preview image using the generative AI model. The emotion engine analyzes the user's emotions from their facial expressions and voice to confirm whether they are satisfied. If it determines that they are not satisfied, the emotion engine will suggest alternatives and the user can make another selection.

[2130] Prompt Sentence Examples

[2131] Please explain in detail the processing steps of a system where a user selects a design theme, analyzes their emotions using an emotion engine, and suggests appropriate design parts.

[2132] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2133] Step 1: User authentication

[2134] Input: The user enters their email address and password.

[2135] Processing: The device encodes the entered email address and password and sends them to the server using the HTTPS protocol. The server checks the received credentials against its database to determine if a matching user exists.

[2136] Output: The server returns the authentication result (success or failure) to the terminal. The terminal displays the authentication result to the user and proceeds to the next step if the authentication is successful.

[2137] Step 2: Choose a design theme

[2138] Input: The user selects the desired theme from a list of design themes provided on the home screen.

[2139] Processing: The device sends the ID of the selected theme to the server, which loads the design elements associated with the theme (background, font, color, etc.) from a database and sends this information to the device.

[2140] Output: The terminal visually displays the loaded design elements to the user.

[2141] Step 3: Emotion recognition by the emotion engine

[2142] Input: As the user views the design elements, the device uses the camera and microphone to capture the user's emotional data (facial expressions and voice).

[2143] Processing: The device processes the emotion data and sends it to the server in real time. The server then uses an emotion engine to analyze the emotion data and determine the user's emotional state.

[2144] Output: The server generates data suggesting appropriate design elements and themes based on the user's emotional state and sends it to the device. The device then presents the suggested data to the user.

[2145] Step 4: Select a design configuration

[2146] Input: The user selects each part from the proposed design elements (e.g., main background "blue," button "circular," etc.).

[2147] Processing: The device sends information about the selected design elements to the server, which uses the generative AI model to create a design preview and sends this preview image to the device.

[2148] Output: The device displays the generated design preview to the user and then activates the emotion engine to analyze the user's reaction and, if necessary, suggest further revisions.

[2149] Step 5: Identifying intellectual property and calculating license fees

[2150] Input: When the user performs an action to finalize the design preview, the server receives information about the design elements used.

[2151] Processing: The server checks the intellectual property rights of the selected design elements, calculates the license fee for each element, and then sums up the calculated license fees to calculate the total license fee.

[2152] Output: The server sends the license fee details to the terminal, which displays them to the user.

[2153] Step 6: Pay the license fee and finalize the design

[2154] Input: The user confirms the proposed license fee and enters payment information (such as credit card information).

[2155] Processing: The terminal sends the payment information to the server using the HTTPS protocol. The server processes the payment and returns the processing result to the terminal. If the payment is successful, the server generates the final design file.

[2156] Output: The terminal will notify the user of the payment result. After notifying that the payment was successful, a download link will be displayed.

[2157] Step 7: Download your design

[2158] Input: User clicks on download link.

[2159] Processing: The server generates the final design file and sends a secure download link to the device, which displays this link to the user.

[2160] Output: Users can click a link to save the final design file to their device.

[2161] (Application example 2)

[2162] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2163] Conventional design generation systems offer limited design parts and themes to users, and do not adequately personalize the design based on individual emotions and preferences. Furthermore, it is difficult to visualize designs in real space, making it difficult to maximize user satisfaction. Furthermore, the verification of intellectual property rights and the calculation of license fees are complex, making the system cumbersome for users. These issues need to be resolved.

[2164] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2165] In this invention, the server includes: means for providing multiple design components based on a design theme individually selected by the user; means for generating a design forecast based on the design components selected by the user; means for verifying intellectual property rights for each design component used in the generated design forecast and calculating royalties; means for presenting royalties to the user and processing payment; means for generating a final design file and providing it to the user after payment is completed; means for recognizing the user's emotions and suggesting and adjusting design themes and components based on the emotions; and means for applying and visualizing the design forecast in real space through the user's scaled display device. This allows the user to receive design suggestions based on their own emotions and make a satisfying design selection through visualization in real space. Furthermore, intellectual property rights verification and license fee calculation are automated, simplifying use.

[2166] 1. "Design Theme" means the overall style or concept of a design that a user can choose from.

[2167] 2. "Design Components" refers to the individual parts or elements that make up a design theme, such as background, font, color, shape, etc.

[2168] 3. "Design Preview" is a preview of the design generated based on the design components selected by the user.

[2169] 4. "Intellectual Property Rights" means legally protected rights in design parts and themes.

[2170] 5. "Royalty" means the fee payable for the use of any Intellectual Property Rights-containing item.

[2171] 6. "Means for recognizing emotions" refers to technology or devices that analyze a user's facial expressions and voice to recognize their emotional state.

[2172] 7. "Means for suggesting and adjusting" refers to the function of recommending appropriate design themes and components to users based on the recognized user emotions.

[2173] 8. "Scaled display device" refers to a device that uses augmented reality (AR) technology to apply designs to real-world space and allow users to visualize them.

[2174] The following describes an embodiment of the present invention: This invention is a system that provides multiple design components based on a design theme individually selected by a user, proposes designs based on the user's emotions, and visualizes the final design in the user's real space.

[2175] Overall system configuration

[2176] The system consists of three main components: the user, the device, and the server. The device includes a scaled display device (e.g., smart glasses), and the server includes an emotion engine (e.g., Emotion API) that recognizes emotions and makes suggestions, and a generative AI model (e.g., Generative Adversarial Networks, hereafter referred to as "GAN") that generates design predictions. It also has the ability to visualize the design predictions in real space using 3D modeling software (e.g., Blender).

[2177] System Procedures

[2178] 1. User Authentication

[2179] The user enters login information through the terminal and sends it to the server. The server performs authentication processing and returns the results to the terminal.

[2180] 2. Select a design theme

[2181] The user selects a design theme using the terminal interface, and the selection is sent to the server, which loads and sends the associated design parts to the terminal.

[2182] 3. Emotion Recognition by Emotion Engine

[2183] The device's built-in camera and microphone capture the user's facial expressions and voice in real time and send the data to a server, which then uses an emotion engine to analyze the user's emotions.

[2184] 4. Design prediction and proposal

[2185] The server makes design suggestions based on emotions and generates design predictions using a generative AI model (GAN) based on the design components selected by the user. The generated design predictions are sent to the device and displayed to the user.

[2186] 5. AR Preview

[2187] The generated design predictions are applied and visualized in real space using the user's scaled display device (smart glasses), and previewed in real time using 3D modeling software (Blender).

[2188] 6. Intellectual property rights verification and license management

[2189] The server checks the intellectual property rights of each design component used in the design forecast and calculates the royalty. The calculation results are sent to the terminal and presented to the user.

[2190] 7. Payment Processing and Download of Final Design

[2191] Once the user pays the license fee, the server generates the final design file and sends a download link to the device, which the user clicks to download the design file.

[2192] Specific examples

[2193] For example, if a user selects a "minimalist" design theme, sets the wall color to "white," and the furniture style to "modern," the smart glasses will reflect those settings in the AR preview of the room in real time. The emotion engine analyzes the user's satisfaction level from their facial expressions and may suggest changing the color to "light gray" if the user is not satisfied.

[2194] Example prompts to input to the generative AI model

[2195] "Generate a living room design preview with a minimalist theme, white wall color, and modern furniture style."

[2196] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2197] Step 1:

[2198] User Authentication

[2199] The user enters login information (email address and password) through the device interface. The device sends this authentication information to the server. The server checks the authentication information in the database and returns the authentication result to the device. The device displays the authentication result to the user, and if authentication is successful, the user can proceed to the next step.

[2200] Input: User login information

[2201] Output: Authentication result (success or failure)

[2202] Specific operations: Sending authentication information, checking database, displaying authentication results

[2203] Step 2:

[2204] Select a design theme

[2205] The user selects the desired theme from a list of design themes presented on the device's home screen. The device then sends the selected theme's ID to the server. The server then loads design elements (background, font, color, etc.) associated with the theme from the database and sends them to the device. The device then displays the loaded design elements to the user.

[2206] Input: Design theme selection information

[2207] Output: Display of related design parts

[2208] Specific operations: Select design theme, send theme ID, load design parts, display selection candidates

[2209] Step 3:

[2210] emotion recognition

[2211] The device's built-in camera and microphone capture the user's facial expressions and voice in real time and send the data to a server, which then uses an emotion engine (e.g., Emotion API) to analyze the emotion data and detect the user's emotional state.

[2212] Input: User's facial expression data, voice data

[2213] Output: Emotional state detection result

[2214] Specific operations: data capture, data transmission, emotion analysis, emotional state detection

[2215] Step 4:

[2216] Design prediction and proposal

[2217] The server proposes appropriate design components based on the user's emotional state. Based on the design components selected by the user, a design forecast is generated using a generative AI model (e.g., GAN). The generated design forecast is sent to the device and displayed to the user.

[2218] Input: User's emotional state, selected design part

[2219] Output: Generated design predictions

[2220] Specific actions: Proposals based on emotional state, prediction generation by generative AI model

[2221] Step 5:

[2222] AR Preview

[2223] The server generates design predictions that are then visualized in real space through a scaled display device (e.g., smart glasses) on the device. A real-time preview is performed using 3D modeling software (e.g., Blender). The user can review the preview and accept suggested revisions if necessary.

[2224] Input: Generated design forecast

[2225] Output: Visualized design preview in real space

[2226] Specific operation: Applying design predictions, displaying real-time samples

[2227] Step 6:

[2228] Intellectual property rights verification and license management

[2229] The server checks the intellectual property rights of each design part used in the design forecast and calculates the usage fee. The calculated usage fee is sent to the terminal and displayed to the user. The user then approves the payment.

[2230] Input: Information on the design components used in the design prediction

[2231] Output: Calculation result of usage fee, presented to the user

[2232] Specific operations: Checking intellectual property rights, calculating royalties, displaying royalties

[2233] Step 7:

[2234] Payment processing and download of final design

[2235] The user approves the license fee and enters payment information. The entered payment information is sent to the server, which processes the payment. Once payment is complete, the server generates the final design file and sends a download link to the device. The user downloads the design file from the link.

[2236] Input: Payment information

[2237] Output: Payment completion notification, download link for the final design file

[2238] Specific actions: Sending payment information, processing payments, sending links, downloading files

[2239] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2240] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2241] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2242] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2243] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2244] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2245] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2246] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2247] The emotion map defines two emotions that promote learning. One is a negative emot...

Claims

1. means for providing a plurality of design parts based on a design theme individually selected by a user; means for generating a design preview based on design parts selected by a user; A means for verifying intellectual property rights and calculating license fees for each design part used in the generated design preview; means for presenting license fees to users and processing payments; A means for generating and providing the final design files to the user after payment is completed; A system including:

2. The system of claim 1 , further comprising means for generating a design preview using AI based on the selected design theme and design parts.

3. The system of claim 1 , further comprising means for verifying user authentication information and performing authentication processing.

Images