System

Abstract

A system is provided.SOLUTION: A system comprising: means for obtaining and authenticating user authentication information; a database storing a plurality of pre-generated art templates; means for providing a list of art templates from the database to the user; means for displaying a user-selected art template in an editing mode and providing a customization tool; means for receiving a template customization operation by the user and generating a preview in real-time; and means for storing and outputting the customized template.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, the number of users who create their own artistic content, such as New Year's cards and postcards, using computers and digital devices has been increasing. However, many of these users find it difficult to easily create high-quality artistic content due to their unfamiliarity with digital technology. Elderly users, in particular, often find it difficult to operate software and perform complex customization tasks. To address this issue, there is a demand for an artistic content generation system that is intuitive and easy for users to operate, and that allows for diverse customization. [Means for solving the problem]

[0005] This invention provides a system that enables users to easily create artistic content. Specifically, the system includes a means for acquiring and authenticating user authentication information, a database that stores multiple pre-generated art templates, a means for providing the user with a list of art templates from the database, a means for displaying the art template selected by the user in an edit mode and providing customization tools, a means for receiving template customization operations performed by the user and generating a real-time preview, and a means for saving and outputting the customized template. This system allows even users unfamiliar with digital technology to easily create, save, and output artistic content.

[0006] "User Credentials" means the authentication data provided by a User to be granted access to a System.

[0007] "Means of authentication" is a function that verifies the authentication information provided by the user and verifies that the user has legitimate authority.

[0008] A "database" is a storage device or system that stores a plurality of pre-generated art templates and allows the data to be searched and retrieved as needed.

[0009] An "art template" is a base graphic design that provides a basic design or layout that users can customize.

[0010] The "means for providing a list" is a function for visually presenting the art template information in the database to the user.

[0011] "Edit mode" is a display state that provides the tools and interface necessary for a user to customize a selected art template.

[0012] The "Customization Tool" is a function that allows users to edit templates to suit their preferences, such as adding text, adding images, and changing colors.

[0013] "Customization operation" refers to a specific editing action that a user performs on an art template.

[0014] The "means for generating a preview in real time" is a function that immediately visually reflects changes made by a user when the user performs a customization operation.

[0015] The "storing means" is a function for recording customized template data in a storage device, either permanently or temporarily.

[0016] "Means to output" refers to the ability to generate customized templates as PDF or image files and provide them to users in a format that they can download or print. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] This invention is a system that allows users to intuitively create and customize artistic content. It is designed especially for users who want to easily create artistic content such as New Year's cards and postcards. Specific embodiments of this system are described below.

[0039] User authentication and initialization

[0040] server

[0041] When a user submits a login request, the server receives authentication information, which includes the user's email address and password. The server checks this against a database, and if authentication is successful, it starts a session for the user and loads the user's configuration information. If authentication fails, it generates an error message and sends it to the terminal.

[0042] Terminal

[0043] A login screen for entering authentication information is displayed, and the next operation screen (main menu or error message) is displayed depending on the authentication result.

[0044] User

[0045] Enter your account information to log in to the system.

[0046] Providing sample templates

[0047] server

[0048] A generative AI model is used to pre-generate various art templates and store them in a sample database. When a user submits a template request, the server provides the user with a list of sample templates.

[0049] Terminal

[0050] Displays a list of sample templates for the user to choose from.

[0051] User

[0052] Choose your favorite design from the provided templates.

[0053] Customizing the template

[0054] Terminal

[0055] Displays the selected template in edit mode and provides customization tools such as adding text, adding images, and changing colors.

[0056] User

[0057] Customize templates to your liking by adding text and images, changing colors and designs, etc. Work while checking the preview as you make changes.

[0058] server

[0059] The system receives and stores user operation data during customization in real time, and generates and sends a preview of the customization to the device as needed.

[0060] Saving and exporting content

[0061] User

[0062] Once you've finished customizing, select "Save" or "Export."

[0063] Terminal

[0064] Depending on the user's selection, a save or print request is sent to the server.

[0065] server

[0066] The received customized template data is saved in the user's account, and if necessary, it can be output as a PDF or image file and a download link sent to the device.

[0067] Specific examples

[0068] For example, if a user wants to create a "2023 New Year's card," the specific steps would be as follows:

[0069] 1. The user enters their account information on the login screen and logs in.

[0070] 2. The device receives the user's input and sends the authentication information to the server.

[0071] 3. The server verifies the authentication information, and if authentication is successful, starts the session and loads the configuration information. If authentication fails, it sends an error message to the terminal.

[0072] 4. The user clicks the "Choose Template" button and a template request is sent to the server.

[0073] 5. The server sends the sample template list to the terminal, which displays it.

[0074] 6. The user selects the "2023 New Year's Card" template and sends the selection information to the server.

[0075] 7. The server sends the template data to the terminal, and the terminal displays the template in edit mode.

[0076] 8. Users can customize the template by adding text, uploading images, and changing the background color.

[0077] 9. The server receives the customization operation data, generates a preview in real time, and sends it to the device.

[0078] 10. When the user has finished customizing, they click the "Save" button and the device sends a save request to the server.

[0079] 11. The server saves the customized template, generates output files if necessary, and sends download links.

[0080] This system allows even users who are unfamiliar with digital technology to easily create high-quality New Year's cards and postcards.

[0081] The processing flow will be explained below.

[0082] Program processing steps

[0083] 1. User authentication and initialization

[0084] Step 1:

[0085] The user enters their email address and password on the login screen and clicks the "Login" button.

[0086] Step 2:

[0087] The terminal receives the entered authentication information and sends it to the server.

[0088] Step 3:

[0089] The server compares the received authentication information with the database and generates an authentication result.

[0090] If authentication is successful, it starts a user session and loads the user configuration information.

[0091] If authentication fails, an error message is generated.

[0092] Step 4:

[0093] The server sends the authentication result to the terminal.

[0094] Step 5:

[0095] The terminal receives the authentication result, and if successful, displays the main menu screen, or if unsuccessful, displays a pop-up error message.

[0096] 2. Providing sample templates

[0097] Step 1:

[0098] The server uses a generative AI model to pre-generate various art templates and store them in a sample database.

[0099] Step 2:

[0100] The user clicks the "Choose a template" button on the main menu screen.

[0101] Step 3:

[0102] The device sends a template request to the server.

[0103] Step 4:

[0104] The server retrieves the template list from the sample database and sends it to the terminal.

[0105] Step 5:

[0106] The terminal displays the template list received from the server on the screen.

[0107] Step 6:

[0108] The user clicks on a template of their choice from the displayed list of templates and sends the selected template ID to the server.

[0109] 3. Customize the template

[0110] Step 1:

[0111] The server transmits the selected template data to the terminal.

[0112] Step 2:

[0113] The device will display the template in edit mode and provide customization tools such as adding text, adding images, and changing colors.

[0114] Step 3:

[0115] A user edits the template using the customization tools.

[0116] Add text: Enter your message in the text box and adjust the position.

[0117] Image Adding Operation: Upload an image and adjust its size and position.

[0118] Color change operations: Select background and text colors.

[0119] Step 4:

[0120] The terminal transmits the user's customized operation data to the server in real time.

[0121] Step 5:

[0122] The server sequentially stores the received customization operation data, generates preview data in real time, and transmits it to the terminal.

[0123] Step 6:

[0124] Your device will display your edits in real time in a preview window.

[0125] 4. Saving and exporting content

[0126] Step 1:

[0127] When the user has finished customizing, he clicks the "Save" or "Export" button.

[0128] Step 2:

[0129] The terminal sends a save request or an output request to the server.

[0130] Step 3:

[0131] The server stores the received customized template data in the user's account.

[0132] Step 4:

[0133] The server generates the customized template as a PDF or image file.

[0134] Step 5:

[0135] The server sends a download link for the generated output file to your device.

[0136] Step 6:

[0137] The device displays the download link to the user.

[0138] Step 7:

[0139] The user clicks the download link to download the customized art content.

[0140] This allows users to easily and intuitively create, save, and output high-quality art content.

[0141] Example 1

[0142] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0143] There is a demand for systems that allow even users unfamiliar with digital technology to easily create high-quality artistic content such as New Year's cards and postcards. However, existing systems tend to be complex to use, as template selection and customization are not intuitive. Furthermore, real-time preview generation and template saving and output often do not work smoothly, making it difficult to improve the user experience.

[0144] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0145] In this invention, the server includes means for acquiring and authenticating user authentication information, a database storing multiple pre-generated art templates, means for providing the user with a list of art templates from the database, means for displaying the art template selected by the user in edit mode and providing customization tools such as adding text, images, and changing colors, means for pre-generating the art template using a generative AI model, means for receiving the user's template customization operations and generating a preview in real time, and means for saving and outputting the customized template. This allows users to intuitively select and customize art templates and proceed with their work while viewing a preview in real time. Furthermore, the ability to easily save and output customized templates is expected to improve the user experience.

[0146] "User authentication information" refers to information such as an email address and password required by a user to access a system.

[0147] "Art templates" are pre-created graphical templates that contain design elements for New Year's cards, postcards, etc.

[0148] A "database" is a system that systematically stores and manages data such as templates and user information.

[0149] "Customization Tool" means a software tool that provides functionality for a User to edit and modify Templates.

[0150] A "generative AI model" is an algorithm or technology that uses artificial intelligence to generate art templates in advance.

[0151] "Preview" is a feature that allows users to visually check the results of their customizations in real time.

[0152] "Means for saving" is a function that allows a user to save a customized template in a database or the like.

[0153] "Means of output" is a function that generates customized templates as PDF or image files and allows users to download them.

[0154] This invention is a system that allows users to intuitively create and customize artistic content such as New Year's cards and postcards. The system is mainly composed of three elements: a server, a terminal, and a user.

[0155] User authentication and initialization

[0156] server

[0157] When a user submits a login request, the server receives authentication information (email address and password). The server compares this information with the database and determines the authentication result. If authentication is successful, the server starts a user session, loads configuration information, and sends it to the terminal. If authentication fails, an error message is generated and sent to the terminal.

[0158] Terminal

[0159] The terminal provides a login screen for the user to enter information and displays the main menu or an error message depending on the authentication result.

[0160] User

[0161] The user logs into the system by entering account information.

[0162] Providing sample templates

[0163] server

[0164] The server uses a generative AI model to pre-generate various art templates and stores them in a sample database. When a user submits a template request, the server provides a list of sample templates to the device.

[0165] Terminal

[0166] The terminal displays a list of sample templates for the user to choose from.

[0167] User

[0168] The user selects their preferred design from the provided templates.

[0169] Customizing the template

[0170] Terminal

[0171] The terminal displays the selected template in an edit mode and provides customization tools such as means for adding text, adding images, and changing colors.

[0172] User

[0173] Users can customize templates to their liking by adding text and images, changing colors and designs, etc. They can proceed while checking a preview as they make each customization.

[0174] server

[0175] The server receives user operation data during customization at any time, generates a preview in real time, and sends it to the device.

[0176] Saving and exporting content

[0177] User

[0178] When the user has finished customizing, he clicks the "Save" or "Export" button.

[0179] Terminal

[0180] The terminal sends a save request or an output request to the server depending on the user's selection.

[0181] server

[0182] The server then saves the customized template data to the user's account, and optionally outputs it as a PDF or image file, providing a download link to the device.

[0183] Specific examples

[0184] For example, if a user wants to create a "2023 New Year's card," the flow would be as follows:

[0185] 1. The user enters their email address and password to log in.

[0186] 2. The device sends authentication information to the server, and the server performs authentication.

[0187] 3. After successful authentication, the server loads the user's configuration information and sends it to the terminal.

[0188] 4. The user clicks the template selection button, sending a template request to the server.

[0189] 5. The server retrieves the sample template list and sends it to the terminal.

[0190] 6. The user selects the "2023 New Year's Card" template, and the device sends the selection information to the server.

[0191] 7. The server sends the template data to the terminal, and the terminal displays the template in edit mode.

[0192] 8. Users can add text, upload images and change background colors.

[0193] 9. The server receives the customization operations in real time, generates a preview, and sends it to the device.

[0194] 10. The user finishes their work and clicks the "Save" button.

[0195] 11. The device sends a save request to the server, and the server saves the customized template to the user's account.

[0196] 12. If necessary, the server generates the output file and provides a download link to the device.

[0197] This system allows even users who are unfamiliar with digital technology to easily create high-quality New Year's cards and postcards.

[0198] Examples of prompt statements

[0199] Example prompt for creating a "2023 New Year's card":

[0200] "Generate an art template for a 2023 New Year's card"

[0201] "Please use red and gold as the main colors and include an illustration of the animal of the Chinese zodiac."

[0202] "Please add a background that gives off a New Year's atmosphere."

[0203] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0204] Program processing steps

[0205] User authentication and initialization

[0206] Step 1:

[0207] The user enters their email address and password on the login screen.

[0208] Input: Email address, Password

[0209] Output: None

[0210] Specific behavior: The user enters account information into the form and clicks the login button.

[0211] Step 2:

[0212] The terminal transmits the entered authentication information to the server.

[0213] Input: Email address, Password

[0214] Output: Request to server

[0215] Specific operation: The device obtains user input and sends it to the server as a POST request.

[0216] Step 3:

[0217] The server checks the authentication information against a database and determines the authentication result.

[0218] Input: Authentication information (email address, password)

[0219] Output: Authentication result (success / failure), configuration information or error message

[0220] What happens: The server performs a database query to verify the authentication information.

[0221] Step 4:

[0222] The terminal receives the response from the server and displays the next screen depending on the authentication result.

[0223] Input: Authentication result, setting information or error message

[0224] Output: Display of main menu or error message

[0225] Specific operation: If authentication is successful, the main menu screen will be displayed; if unsuccessful, an error message will be displayed.

[0226] Providing sample templates

[0227] Step 5:

[0228] The user clicks the "Choose a template" button from the main menu.

[0229] Input: Button click event

[0230] Output: Template request

[0231] Specific behavior: The user clicks a button, sending a template request to the device.

[0232] Step 6:

[0233] The device sends a template request to the server.

[0234] Input: User request

[0235] Output: A template request to the server

[0236] Specific operation: The device sends a request to the server.

[0237] Step 7:

[0238] The server retrieves pre-generated art templates from a sample database using a generative AI model.

[0239] Input: Template request

[0240] Output: Art template list

[0241] What happens next: The server performs a database query to retrieve a list of sample templates.

[0242] Step 8:

[0243] The server sends the template list to the terminal.

[0244] Input: Art template list

[0245] Output: Send template list

[0246] Specific operation: The server returns the template list to the terminal.

[0247] Step 9:

[0248] The terminal displays a list of templates for the user to select.

[0249] Input: Template list

[0250] Output: Display the template list

[0251] Specific behavior: The device displays a list of templates and provides a UI for selection.

[0252] Customizing the template

[0253] Step 10:

[0254] The user selects a template of their choice from the displayed template list.

[0255] Input: Template selection information

[0256] Output: Sends selected information to the terminal

[0257] Specific behavior: The user clicks on a template and the selection information is sent to the device.

[0258] Step 11:

[0259] The terminal transmits the selection information to the server.

[0260] Input: Template selection information

[0261] Output: Request to server

[0262] Specific operation: The terminal sends the selection information to the server.

[0263] Step 12:

[0264] The server transmits the selected template data to the terminal.

[0265] Input: Selection information

[0266] Output: Template data

[0267] Specific operation: The server retrieves the selected template from the database and sends it to the terminal.

[0268] Step 13:

[0269] The device displays the template in edit mode, providing the means to add text, add images, and change colors.

[0270] Input: Template data

[0271] Output: Edit screen

[0272] What it does: The device displays the template on the screen along with editing tools.

[0273] Step 14:

[0274] Users can add text and images to templates and change the colors and design.

[0275] Input: Customization instructions

[0276] Output: Customization data

[0277] Specific actions: User enters text, uploads an image, or changes a color.

[0278] Step 15:

[0279] The terminal sends various customization operations to the server.

[0280] Input: Customization data

[0281] Output: Request to server

[0282] Specific operation: The device sends the user's customization operations to the server at any time.

[0283] Step 16:

[0284] The server receives the customization operation data in real time, generates a preview image, and transmits it to the terminal.

[0285] Input: Customization data

[0286] Output: Preview image

[0287] Specific operation: The server generates a preview image in real time and sends it to the device.

[0288] Step 17:

[0289] The device will display a preview image, allowing the user to see the results of the customization.

[0290] Input: Preview image

[0291] Output: Preview

[0292] Specific behavior: The device displays a preview image on the screen for the user to review.

[0293] Saving and exporting content

[0294] Step 18:

[0295] When the user has finished customizing, he clicks the "Save" or "Export" button.

[0296] Input: Button click event

[0297] Output: Save or output request

[0298] Specific action: The user clicks the save or print button.

[0299] Step 19:

[0300] The terminal sends a save request or an output request to the server.

[0301] Input: Request

[0302] Output: Request to server

[0303] Specific operation: The terminal sends a user request to the server.

[0304] Step 20:

[0305] The server stores the received customized template data in the user's account.

[0306] Input: Customized template data

[0307] Output: Data storage

[0308] Specific behavior: The server saves the template in the database.

[0309] Step 21:

[0310] The server outputs the customized template as a PDF or image file as needed and sends a download link to the device.

[0311] Input: Customized template data

[0312] Output: Output file, download link

[0313] Specific operation: The server generates the output file and sends a download link to the device.

[0314] Step 22:

[0315] The device displays a download link to the user, and the user downloads the required file.

[0316] Input: Download link

[0317] Output: Downloadable link displayed

[0318] What happens: The device displays a link, allowing the user to download the file.

[0319] (Application example 1)

[0320] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0321] Conventional art content generation systems typically involve selecting and customizing templates using a PC or smartphone. However, these methods tend to be limited by location and time, making them inconvenient, especially when intuitive operation is desired in a brick-and-mortar store or on the go. Furthermore, the advertising industry is seeking systems that can create and display interactive advertisements in real time, but current systems cannot meet these requirements. This invention aims to solve these issues and provide a system that allows users to intuitively create, customize, and display interactive art content and advertisements anywhere via smart glasses.

[0322] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0323] In this invention, the server includes means for acquiring and authenticating user authentication information, a database storing multiple pre-generated art templates, means for providing the user with a list of art templates from the database, means for displaying the art template selected by the user in an edit mode and providing a customization tool, means for receiving the user's template customization operation and generating a preview in real time, means for saving and outputting the customized template, means for generating and displaying an interactive advertisement in real time via smart glasses, and means for enabling the customization tool to be operated using voice commands and touchpad operations, thereby enabling the user to intuitively operate the smart glasses to generate, customize, and display interactive advertisements and art content in real time.

[0324] "User Credentials" means identifying information, such as an email address or password, provided by a User to access a System.

[0325] A "database" is a storage device for storing and managing multiple pre-generated art templates and related information.

[0326] An "art template" is a basic design and layout template that users can freely customize.

[0327] "Customization tools" are a set of functions that allow users to edit and modify templates, including adding text, adding images, and changing colors.

[0328] "Edit mode" is an operation screen that allows the user to change and modify the art template they have selected.

[0329] "Real-time preview" is a preview display of a template that is instantly updated in response to the user's customization operations.

[0330] "Storage" is a feature that allows a user to save customized templates to their account.

[0331] "Output means" is a function for generating and providing customized templates as PDF or image files.

[0332] "Smart glasses" are eyeglass-shaped wearable devices equipped with displays and various sensors that allow users to display and manipulate information in real time.

[0333] "Interactive advertising" refers to advertising content that users can control and customize in real time.

[0334] "Voice commands" are instructions that a user uses to operate the system using voice.

[0335] "Touchpad operation" refers to the method by which a user operates a system using a touchpad.

[0336] The present invention relates to a system that allows users to create and customize interactive art content and advertisements in real time using smart glasses. Specific embodiments are described below.

[0337] System configuration

[0338] Hardware

[0339] 1. Smart glasses: A wearable device in the shape of glasses equipped with a display and various sensors, it displays information in real time and can be operated using voice commands or a touchpad.

[0340] 2. Server: A computer system with a database, generative AI model, and real-time preview generation capabilities.

[0341] software

[0342] 1. Generative AI model: An AI system for automatically generating art templates.

[0343] 2. Server program: Performs user authentication, provides template lists, saves and outputs customized data, etc.

[0344] 3. Smart Glasses App: Users can select and customize templates using voice commands or the touchpad.

[0345] Program processing

[0346] 1. User authentication and initialization

[0347] The user enters their account information on the login screen of the smart glasses and submits a login request.

[0348] The server checks the authentication information against a database, and after successful authentication starts the user's session and loads the configuration information. If authentication fails, it generates an error message and sends it to the smart glasses.

[0349] 2. Providing sample templates

[0350] The server uses a generative AI model to pre-generate various art templates and store them in a sample database.

[0351] When a user sends a template request from their smart glasses, the server provides a list of sample templates.

[0352] 3. Customize the template

[0353] Once a user selects a template, the smart glasses will display it in edit mode, providing customization tools for adding text, adding images, and changing colors.

[0354] Users can customize templates using voice commands or the touchpad, previewing their changes in real time.

[0355] The customization data is sent to the server at any time, and a real-time preview is generated.

[0356] 4. Saving and exporting content

[0357] When the user has finished customizing, they select the "Save" or "Export" option.

[0358] The smart glasses send a save or output request to the server.

[0359] The server saves the customized template, generates it as a PDF or image file, and provides a download link.

[0360] Specific examples

[0361] For example, to create an interactive ad for a new product launch campaign, the following prompt sentences could be input into the generative AI model:

[0362] Prompt Sentence Examples

[0363] Template name: "New product launch campaign"

[0364] Requirements:

[0365] Visually impactful design

[0366] Text fields: "New product name", "Features", "Release date"

[0367] Image field: "New product image"

[0368] Customization Options:

[0369] Color Change

[0370] Text position change

[0371] Change font size

[0372] This invention allows users to intuitively control and generate, customize, and display interactive advertising and art content in real time through smart glasses.

[0373] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0374] Step 1:

[0375] Obtaining and authenticating user credentials

[0376] The user enters their account information (email address, password) on the login screen of the smart glasses and sends a login request.

[0377] Input: Email address, password

[0378] Output: Authentication token, error message (if authentication failed)

[0379] The terminal receives the login information and sends it to the server.

[0380] Input: Login information

[0381] Output: Authentication request

[0382] The server checks the authentication information against a database, and if authentication is successful, starts the session and loads the user's configuration information. If authentication fails, it generates an error message and sends it to the terminal.

[0383] Input: Login information

[0384] Data processing: Matching with database, session generation

[0385] Output: Authentication result, user setting information, error message

[0386] Step 2:

[0387] Providing sample templates

[0388] The user sends a template request from the smart glasses.

[0389] Input: Template request

[0390] Output: Template list

[0391] The terminal relays the template request to the server.

[0392] Input: Template request

[0393] Output: Template list request

[0394] The server retrieves pre-generated art templates from a database, generates a list of templates, and sends it to the terminal.

[0395] Input: Template list request

[0396] Data processing: Obtaining template data and generating lists

[0397] Output: Template list

[0398] Step 3:

[0399] Select and customize a template

[0400] The user selects a template from the provided template list and transmits the selection information to the terminal.

[0401] Input: Template selection information

[0402] Output:Selection Template

[0403] The device will display the selected template in edit mode and provide customization tools (add text, add images, change colors).

[0404] Input:Select Template

[0405] Output: Edit mode screen, customization tools

[0406] Users can customize templates using voice commands or the touchpad, then enter changes into the device.

[0407] Input: Customized instructions (voice commands, touchpad operations)

[0408] Output: Customized operation data

[0409] The terminal transmits customized operation data to the server, and the server generates a real-time preview and transmits it back to the terminal.

[0410] Input: Customized operation data

[0411] Data processing: Real-time preview generation

[0412] Output: Preview screen

[0413] Step 4:

[0414] Saving and exporting customization data

[0415] When the user has finished customizing, they can select the "Save" or "Export" option.

[0416] Input: Save request or Output request

[0417] Output: Save completion notification, download link

[0418] The terminal sends a save request or an output request to the server.

[0419] Input: Save request or Output request

[0420] Output: Save instruction, output instruction

[0421] The server saves the customized template in the user's account, generates it as a PDF or image file if necessary, and provides a download link to the device.

[0422] Input: Customized template data

[0423] Data processing: file creation, link creation

[0424] Output: Save completion notification, download link

[0425] Through these steps, users can intuitively operate the smart glasses to generate, customize, and display interactive advertising and art content in real time.

[0426] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0427] This invention is a system that allows users to intuitively create and customize artistic content, and further incorporates an emotion engine that recognizes the user's emotions and supports operation. Specific embodiments of this system are described below.

[0428] User authentication and initialization

[0429] server

[0430] When a user submits a login request, the server receives authentication information, which includes the user's email address and password. The server compares this with the database and generates an authentication result. If authentication is successful, it starts a user session and loads the user's configuration information. If authentication fails, it generates an error message and sends it to the terminal.

[0431] Terminal

[0432] A login screen for entering authentication information is displayed, and the next operation screen (main menu or error message) is displayed depending on the authentication result.

[0433] User

[0434] Enter your account information to log in to the system.

[0435] Providing sample templates

[0436] server

[0437] A generative AI model is used to pre-generate various art templates and store them in a sample database. When a user submits a template request, the server provides the user with a list of sample templates.

[0438] Terminal

[0439] Displays a list of sample templates for the user to choose from.

[0440] User

[0441] Choose your favorite design from the provided templates.

[0442] User emotion recognition and template customization

[0443] Emotion Engine

[0444] It recognizes the user's emotions in real time from their facial expressions and tone of voice, and sends that information to the server.

[0445] server

[0446] The list of art templates is customized based on the user's emotional information received from the emotion engine. For example, if the user is happy, it will prioritize bright and colorful designs, and if the user is calm, it will prioritize simple and refreshing designs.

[0447] Terminal

[0448] Display a list of customized templates for users to choose from.

[0449] User

[0450] Begin customizing the selected template.

[0451] Terminal

[0452] Displays the selected template in edit mode and provides customization tools such as adding text, adding images, and changing colors.

[0453] User

[0454] Users can customize the template to their liking by adding text and images, changing the color and design, etc. The recommended settings of the customization tool will change based on the user's emotions as determined by the emotion engine.

[0455] server

[0456] The system receives and stores user operation data during customization in real time, and generates and sends a preview of the customization to the device as needed.

[0457] Saving and exporting content

[0458] User

[0459] Once you've finished customizing, select "Save" or "Export."

[0460] Terminal

[0461] Depending on the user's selection, a save or print request is sent to the server.

[0462] server

[0463] The received customized template data is saved in the user's account, and if necessary, it can be output as a PDF or image file, with a download link sent to the device.

[0464] Specific examples

[0465] For example, if a user wants to create a "2023 New Year's card," the specific steps would be as follows:

[0466] 1. The user enters their account information on the login screen and logs in.

[0467] 2. The device receives the user's input and sends the authentication information to the server.

[0468] 3. The server verifies the authentication information, and if authentication is successful, starts the session and loads the configuration information. If authentication fails, it sends an error message to the terminal.

[0469] 4. The user clicks the "Choose Template" button and a template request is sent to the server.

[0470] 5. The server sends the sample template list to the terminal, which displays it.

[0471] 6. The emotion engine analyzes the user's facial expressions and tone of voice to determine that the user is relaxed.

[0472] 7. The server prioritizes templates that match the relaxed state and places them at the top of the list, then sends them to the terminal.

[0473] 8. The user selects the "2023 New Year's Card" template and sends the selection information to the server.

[0474] 9. The server sends the template data to the terminal, and the terminal displays the template in edit mode.

[0475] 10. Users customize the template by adding text, uploading images, and changing the background color. Based on the sentiment engine, text font and color recommendations are provided.

[0476] 11. The server receives the customization operation data, generates a preview in real time, and sends it to the terminal.

[0477] 12. When the user has finished customizing, they click the "Save" button and the device sends a save request to the server.

[0478] 13. The server saves the customized template, generates output files if necessary, and sends download links.

[0479] This system provides optimal templates and customization tool settings based on the user's emotions, allowing them to create high-quality art content more comfortably.

[0480] The processing flow will be explained below.

[0481] Program processing steps

[0482] 1. User authentication and initialization

[0483] Step 1:

[0484] The user enters their email address and password on the login screen and clicks the "Login" button.

[0485] Step 2:

[0486] The terminal receives the entered authentication information and sends it to the server.

[0487] Step 3:

[0488] The server compares the received authentication information with the database and generates an authentication result.

[0489] If authentication is successful, it starts a user session and loads the user configuration information.

[0490] If authentication fails, an error message is generated.

[0491] Step 4:

[0492] The server sends the authentication result to the terminal.

[0493] Step 5:

[0494] The terminal receives the authentication result, and if successful, displays the main menu screen, or if unsuccessful, displays a pop-up error message.

[0495] 2. Providing sample templates

[0496] Step 1:

[0497] The server uses a generative AI model to pre-generate various art templates and store them in a sample database.

[0498] Step 2:

[0499] The user clicks the "Choose a template" button on the main menu screen.

[0500] Step 3:

[0501] The device sends a template request to the server.

[0502] Step 4:

[0503] The server retrieves the template list from the sample database and sends it to the terminal.

[0504] Step 5:

[0505] The terminal displays the template list received from the server on the screen.

[0506] Step 6:

[0507] The emotion engine analyzes the user's facial expressions and tone of voice and transmits the user's emotional state to the server.

[0508] Step 7:

[0509] The server customizes the template list based on the user's emotional information received (e.g., preferentially displaying simple designs to users in a relaxed state).

[0510] Step 8:

[0511] The device will redisplay the customized template list on the screen.

[0512] Step 9:

[0513] The user clicks on a template of their choice from the displayed list of templates and sends the selected template ID to the server.

[0514] 3. Customize the template

[0515] Step 1:

[0516] The server transmits the selected template data to the terminal.

[0517] Step 2:

[0518] The device will display the template in edit mode and provide customization tools such as adding text, adding images, and changing colors.

[0519] Step 3:

[0520] An emotion engine analyzes a user's facial expressions and tone of voice to recommend settings for customization tools based on their emotional state (e.g., recommending bright colors if they are happy).

[0521] Step 4:

[0522] A user edits the template using the customization tools.

[0523] Add text: Enter your message in the text box and adjust the position.

[0524] Image Adding Operation: Upload an image and adjust its size and position.

[0525] Color change operations: Select background and text colors.

[0526] Step 5:

[0527] The terminal transmits the user's customized operation data to the server in real time.

[0528] Step 6:

[0529] The server sequentially stores the received customization operation data, generates preview data in real time, and transmits it to the terminal.

[0530] Step 7:

[0531] Your device will display your edits in real time in a preview window.

[0532] 4. Saving and exporting content

[0533] Step 1:

[0534] When the user has finished customizing, he clicks the "Save" or "Export" button.

[0535] Step 2:

[0536] The terminal sends a save request or an output request to the server.

[0537] Step 3:

[0538] The server stores the received customized template data in the user's account.

[0539] Step 4:

[0540] The server generates the customized template as a PDF or image file.

[0541] Step 5:

[0542] The server sends a download link for the generated output file to your device.

[0543] Step 6:

[0544] The device displays the download link to the user.

[0545] Step 7:

[0546] The user clicks the download link to download the customized art content.

[0547] In this way, the optimal template and customization tool settings are provided according to the user's emotions, enabling the creation of more comfortable, high-quality art content.

[0548] Example 2

[0549] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0550] Previous art content generation systems provided templates without considering user emotions and lacked intuitive customization features. Furthermore, they lacked real-time operation data saving and preview generation, resulting in a poor user experience. Furthermore, the template output formats were limited, making it difficult to meet diverse user needs.

[0551] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0552] In this invention, the server includes means for acquiring and authenticating user authentication information, a database for storing a plurality of pre-generated content templates, means for providing the user with a list of content templates from the database, means for displaying the content template selected by the user in an edit mode and providing a customization tool, means for recognizing emotions from the user's facial expressions and tone of voice and customizing the list of content templates based thereon, means for receiving template customization operations performed by the user and generating previews in real time, and means for saving and outputting customized templates. This makes it possible to provide optimal templates based on the user's emotions and to perform intuitive and efficient customization work.

[0553] "User authentication information" refers to information such as an email address and password used to authenticate a user's personal information.

[0554] "Multiple pre-generated content templates" refers to a group of templates with diverse designs that have been pre-generated by a generative AI model.

[0555] A database is a system that systematically organizes and stores information, making it easy to access and manage.

[0556] The "content template list" is a list of multiple templates that the user can select from.

[0557] "Edit mode" means that the user can freely customize the template.

[0558] "Customization Tools" means a set of tools that a User can use to edit a Template, including adding text, adding images, changing colors, etc.

[0559] "Emotion recognition" means analyzing the user's facial expressions and tone of voice to determine their emotions at that time.

[0560] "Generating a preview in real time" means displaying changes immediately in response to user actions.

[0561] A "customized template" is a template that has been edited and customized by a user.

[0562] "Output means" is a function for saving and providing customized templates in formats such as PDF or image files.

[0563] MODE FOR CARRYING OUT THE INVENTION

[0564] This invention is a system that allows users to intuitively create and customize artistic content, and further incorporates an emotion engine that recognizes the user's emotions and assists in operation. A series of processes is provided that allows users to log in, select a template, customize it, and finally save or output it. A specific embodiment of this system is described below.

[0565] User authentication and initialization

[0566] server

[0567] When a user submits a login request, the server receives authentication information (email address and password) and checks it against a database (e.g., MySQL (registered trademark)). If authentication is successful, the server starts a user session and loads configuration information. If authentication fails, it generates an error message and sends it to the terminal as an HTTP response.

[0568] Terminal

[0569] The terminal displays a login screen and provides fields for the user to enter their email address and password. When the user enters the authentication information and clicks the "Login" button, the terminal sends the authentication information to the server. Upon receiving the authentication result, the terminal displays the main menu screen if successful, or an error message if unsuccessful.

[0570] User

[0571] The user enters their email address and password on the login screen and clicks the "Login" button.

[0572] Providing sample templates

[0573] server

[0574] A variety of art templates are pre-generated using a generative AI model (e.g., GPT-3 (registered trademark)) and stored in a sample database. When a user submits a template request, the server generates a list of sample templates and sends them to the device as an HTTP response.

[0575] Terminal

[0576] The device displays a list of sample templates received from the server, with thumbnail images and descriptions displayed on the interface to help the user select a template.

[0577] User

[0578] Users can select their favorite design from the sample templates displayed.

[0579] User emotion recognition and template customization

[0580] Emotion Engine

[0581] The emotion engine analyzes the user's facial expressions and tone of voice in real time. For this analysis, OpenCV and Emotion SDK are used, for example. The emotion engine sends the analysis results to the server.

[0582] server

[0583] The server customizes the list of art templates based on the emotion data received from the emotion engine. For example, if the user is happy, it prioritizes bright and colorful designs. It generates the customized template list and sends it to the device as an HTTP response.

[0584] Terminal

[0585] It displays a list of customized templates for users to choose from, and after users select a template, it switches them into edit mode and provides customization tools (add text, add images, change colors, etc.).

[0586] User

[0587] Users select a template and customize it by adding text and images, changing colors and fonts, etc., guided by the tool's recommended settings based on an emotion engine.

[0588] Saving and exporting content

[0589] User

[0590] Once the user has completed customization, they click the "Save" or "Export" button.

[0591] Terminal

[0592] The terminal sends a save request or an output request to the server in response to the user's click.

[0593] server

[0594] The server saves the received customized template data in the user's account, using a database such as MongoDB. If output is selected, the server outputs the data as a PDF or image file, generates a download link, and sends it to the terminal as an HTTP response.

[0595] Specific examples

[0596] For example, if a user wants to create a "2023 New Year's card," the process would be as follows:

[0597] 1. The user enters their email address and password on the login screen to log in.

[0598] 2. The terminal sends authentication information to the server, the server performs authentication, and if successful, the session starts and the main menu is displayed on the terminal.

[0599] 3. The user clicks the "Choose a template" button in the main menu, and a template request is sent to the server.

[0600] 4. The server generates a sample template list, which the terminal displays.

[0601] 5. The emotion engine analyzes the user's facial expressions and tone of voice and determines that they are relaxed.

[0602] 6. The server places the template suitable for the relaxed state at the top of the list and sends it to the terminal.

[0603] 7. The user selects the "2023 New Year's Card" template and sends the selection information to the server.

[0604] 8. The server sends the template data to the terminal, and the terminal displays the template in edit mode.

[0605] 9. Users customize the template by adding text, uploading images, and changing the background color. Recommendations are provided based on the sentiment engine.

[0606] 10. The server receives the customization operation data in real time, generates a preview, and sends it to the device.

[0607] 11. The user finishes customizing and clicks the "Save" or "Export" button.

[0608] 12. The device sends a save or output request to the server.

[0609] 13. The server saves the customized template, generates the output as a PDF or image file, and sends a download link.

[0610] Prompt Sentence Examples

[0611] I want to choose a template based on the theme "New Year's Cards 2023." If the user has a happy expression, what design would you recommend?

[0612] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0613] Step 1: User authentication and initialization

[0614] server

[0615] A login request is received from the user. The input data is an email address and password. The server compares this authentication information with the information in the database and generates an authentication result. If successful, a session is started and the user's configuration information is loaded. If unsuccessful, an error message is generated and sent to the terminal as an HTTP response.

[0616] Terminal

[0617] The device displays a login screen for entering an email address and password. When the user enters the authentication information and clicks the "Login" button, the data is sent to the server. The device receives the authentication result from the server, and if successful, displays the main menu screen, otherwise displays an error message.

[0618] User

[0619] The user enters their email address and password on the login screen and clicks the "Login" button.

[0620] Step 2: Provide a sample template

[0621] server

[0622] A variety of pre-generated art templates are stored in a sample database using a generative AI model (e.g., GPT-3). When a user sends a template request, the server generates a list of sample templates and sends it to the device as an HTTP response. The data input is the user request, and the output is the template list.

[0623] Terminal

[0624] The device displays a list of sample templates received from the server, with thumbnail images and descriptions displayed on the interface to help the user select a template.

[0625] User

[0626] Users can select their favorite design from the sample templates displayed.

[0627] Step 3: User Emotion Recognition and Template Customization

[0628] Emotion Engine

[0629] It analyzes the user's facial expressions and tone of voice in real time. The input is video and audio data from the user. The analysis is performed using OpenCV or Emotion SDK, for example, and the analysis results are sent to the server.

[0630] server

[0631] The server customizes the list of art templates based on the emotion data received from the emotion engine. The input is emotion data, and the output is the customized template list. For example, for a happy emotion, it prioritizes bright and colorful designs. It sends the customized template list to the terminal as an HTTP response.

[0632] Terminal

[0633] It displays a list of customized templates for users to choose from, and after users select a template, it switches them into edit mode and provides customization tools (add text, add images, change colors, etc.).

[0634] User

[0635] Users select a template and customize it by adding text and images, changing colors and fonts, etc., guided by the tool's recommended settings based on an emotion engine.

[0636] Step 4: Save and export content

[0637] User

[0638] Once the user has completed customization, they click the "Save" or "Export" button.

[0639] Terminal

[0640] The terminal sends a save request or an output request to the server in response to the user's click.

[0641] server

[0642] The server saves the received customized template data in the user's account. The input is the customized template data, and the storage destination is a database (e.g., MongoDB). If output is selected, it outputs it as a PDF or image file, generates a download link, and sends it to the terminal as an HTTP response.

[0643] (Application example 2)

[0644] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0645] Conventional art content generation systems lack intuitive template selection and customization functions that take user emotions into account, making it difficult for users to find the design that best suits them. Furthermore, they do not provide real-time previews of customization operations or recommended settings based on emotion information, which makes it difficult to improve the user experience.

[0646] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring and authenticating user authentication information, a database that stores a plurality of pre-generated art templates, means for providing the user with a list of art templates from the database, means for recognizing the user's emotion and customizing the list of art templates based on the emotion information, means for displaying the art template selected by the user in an edit mode and providing a customization tool, means for receiving the user's template customization operation and generating a preview in real time, and means for saving and outputting the customized template. This makes it easier for users to select the optimal template based on their emotion, enabling them to intuitively and efficiently generate and customize art content.

[0647] "User Credentials" means information required to identify a user and grant access to a system.

[0648] A "database" is an information management system for storing a plurality of pre-generated art templates.

[0649] "Emotional information" is data about the user's emotional state obtained from facial expressions, tone of voice, etc.

[0650] "Edit mode" is an operating environment for customizing a user-selected art template.

[0651] The "Customization Tools" are a set of functions for editing art templates, such as adding text, adding images, changing colors, and recommending settings based on emotional information.

[0652] "Preview" is a display means for visually checking the results of customization operations performed by the user in real time.

[0653] "Storage" is a function that allows users to record customized templates so that they can be reused later.

[0654] The "output means" is a function for generating a customized template as a digital file and providing it to the user.

[0655] This invention provides a system for acquiring and authenticating user authentication information, providing multiple art templates, and customizing the template list based on the user's emotional information. The system displays the user-selected art template in an edit mode, provides customization tools, generates a real-time preview, and saves and outputs the customized template. Specific embodiments are described below.

[0656] System Configuration

[0657] 1. User authentication and initialization

[0658] server

[0659] When a user submits a login request, the server receives user authentication information, which includes the user's email address and password. This information is compared with the database to generate an authentication result. If authentication is successful, a user session is started and configuration information is loaded. The software used is Flask and SQLite.

[0660] Terminal

[0661] The terminal displays a login screen for inputting authentication information, and displays an operation screen (main menu or error message) according to the authentication result.

[0662] User

[0663] The user logs into the system by entering their account information.

[0664] 2. Providing sample templates

[0665] server

[0666] The server uses a generative AI model to pre-generate various art templates and stores them in a sample database. When a user submits a template request, the server provides a list of templates.

[0667] Terminal

[0668] The terminal displays a list of sample templates for the user to choose from.

[0669] User

[0670] Users can choose their favorite design from a list of templates.

[0671] 3. User emotion recognition and template customization

[0672] Emotion Engine

[0673] The emotion engine recognizes emotions from the user's facial expressions and tone of voice in real time and sends that information to the server. The library used is EmotionEngine.

[0674] server

[0675] The server customizes the art template list based on the user's emotional information received from the emotion engine. For example, if the user is happy, it will prioritize bright and colorful designs, and if the user is calm, it will prioritize simple and refreshing designs.

[0676] Terminal

[0677] The device will display a list of customized templates for the user to choose from.

[0678] User

[0679] The user initiates a customization operation on the selected template.

[0680] Terminal

[0681] The terminal displays the selected template in edit mode and provides customization tools such as adding text, adding images, and changing colors.

[0682] User

[0683] Users can customize the templates to their liking by adding text and images, changing colors and designs, etc. The recommended settings in the customization tool are changed based on the emotions determined by the emotion engine.

[0684] server

[0685] The server receives user operation data during customization at any time, generates a preview in real time, and sends it to the device.

[0686] 4. Saving and exporting content

[0687] User

[0688] Once the user has finished customizing, they can select "Save" or "Export."

[0689] Terminal

[0690] The terminal sends a save request or an output request to the server depending on the user's selection.

[0691] server

[0692] The server stores the received customized template data in the user's account, generates digital files as needed, and sends download links to the device.

[0693] Specific examples

[0694] For example, consider a user creating a "2023 New Year's card." The user enters account information on the login screen and logs in. The device receives the user's input and sends authentication information to the server. The server verifies the authentication information, and if authentication is successful, starts a session and loads the configuration information. If authentication fails, an error message is sent to the device.

[0695] Next, the user clicks the "Choose a template" button, and a template request is sent to the server. The server sends a list of sample templates to the device, which displays them. The emotion engine analyzes the user's facial expressions and tone of voice to detect their state of relaxation. The server prioritizes templates that match that state to the top of the list and sends them to the device. The user selects the "2023 New Year's Card" template and sends the selection information to the server. The server sends the template data to the device, and the device displays the template in edit mode.

[0696] Users customize templates by adding text, uploading images, and changing background colors. Based on the emotion engine, the server receives the customization data, generates a real-time preview, and sends it to the device.

[0697] When the user finishes customization, they click the "Save" button and the device sends a save request to the server. The server saves the customized template, generates the output file if necessary, and sends a download link. The prompt message "We will suggest an art template that matches your emotion. Please turn on the camera, relax, and wait." will be displayed.

[0698] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0699] Step 1:

[0700] The server receives user authentication information (email address and password). The input is user information, which is checked against a database to generate an authentication result. If authentication is successful, a session is started and configuration information is loaded. The output is the authentication result (success or failure).

[0701] Step 2:

[0702] The terminal displays a login screen and the user enters authentication information. The input is the user's email address and password, which are then prepared to be sent to the server. The output is the execution of the authentication information transmission.

[0703] Step 3:

[0704] The server verifies the authentication information and sends the authentication result to the terminal. The input is the user's authentication information, which is verified against the database to generate an authentication result (success or failure). The output is the authentication result (session ID if successful).

[0705] Step 4:

[0706] The terminal displays the following screen based on the authentication result. The input is the authentication result received from the server, and if successful, the main menu is displayed, or if unsuccessful, an error message is displayed. The output is the display content (main menu or error message).

[0707] Step 5:

[0708] The user issues a template request. The input is the user's operation, which sends a request to the terminal to display the art template list. The output is the template request.

[0709] Step 6:

[0710] The server uses the generative AI model to generate a template list and sends it to the device. The input is a template request, and the generative AI model generates a template list to create a template list tailored to the user. The output is the template list.

[0711] Step 7:

[0712] The terminal displays a template list. The input is the template list sent from the server and displayed for the user to select. The output is the displayed template list.

[0713] Step 8:

[0714] The emotion engine recognizes emotional information from the user's facial expressions and tone of voice in real time and sends that information to the server. The input is the user's facial expressions and voice data, which is analyzed to generate emotional information. The output is emotional information.

[0715] Step 9:

[0716] The server customizes the template list based on emotional information and displays templates that match the emotional state with priority. The input is emotional information, and the template list is processed to match the emotional state. The output is the customized template list.

[0717] Step 10:

[0718] The terminal displays the customized template list. The input is the customized template list sent from the server, allowing the user to select a more appropriate template. The output is the displayed customized template list.

[0719] Step 11:

[0720] The user selects a template and begins customization. The input is the template selection operation, and the selection information is sent to the terminal. The output is the selected template.

[0721] Step 12:

[0722] The device displays the selected template in edit mode and provides customization tools such as adding text, adding images, and changing colors. The input is the selected template, which is displayed for the user to edit. The output is the template displayed in edit mode.

[0723] Step 13:

[0724] The user customizes a template. The input is the operation of the customization tool, adding text, images, changing colors, etc. The output is the customized template.

[0725] Step 14:

[0726] The emotion engine changes the recommended settings of the customization tool based on the user's emotional information during the customization operation. The input is the user's facial expression and voice data, which is analyzed to generate emotional information and adjust the settings of the customization tool. The output is recommended settings based on the emotional information.

[0727] Step 15:

[0728] The server receives the customization operation data, generates a real-time preview, and sends it to the terminal. The input is the customization operation data, and the real-time preview is generated based on the data. The output is a preview image.

[0729] Step 16:

[0730] When the user finishes customization, they select "Save" or "Output." Input is the user's operation, which sends a save or output request to the terminal. Output is the save or output request.

[0731] Step 17:

[0732] The terminal sends a save or output request to the server. The input is the save or output request, which it prepares to send to the server. The output is the sending of the request.

[0733] Step 18:

[0734] The server receives the customized template data, stores it in the user's account, generates a digital file as needed, and sends a download link to the device. The input is the customized template data, which is saved and output as a file. The output is the saved data and a download link.

[0735] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0736] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0737] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0738] [Second embodiment]

[0739] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0740] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0741] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0742] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0743] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0744] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0745] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0746] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0747] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0748] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0749] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0750] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0751] This invention is a system that allows users to intuitively create and customize artistic content. It is designed especially for users who want to easily create artistic content such as New Year's cards and postcards. Specific embodiments of this system are described below.

[0752] User authentication and initialization

[0753] server

[0754] When a user submits a login request, the server receives authentication information, which includes the user's email address and password. The server checks this against a database, and if authentication is successful, it starts a session for the user and loads the user's configuration information. If authentication fails, it generates an error message and sends it to the terminal.

[0755] Terminal

[0756] A login screen for entering authentication information is displayed, and the next operation screen (main menu or error message) is displayed depending on the authentication result.

[0757] User

[0758] Enter your account information to log in to the system.

[0759] Providing sample templates

[0760] server

[0761] A generative AI model is used to pre-generate various art templates and store them in a sample database. When a user submits a template request, the server provides the user with a list of sample templates.

[0762] Terminal

[0763] Displays a list of sample templates for the user to choose from.

[0764] User

[0765] Choose your favorite design from the provided templates.

[0766] Customizing the template

[0767] Terminal

[0768] Displays the selected template in edit mode and provides customization tools such as adding text, adding images, and changing colors.

[0769] User

[0770] Customize templates to your liking by adding text and images, changing colors and designs, etc. Work while checking the preview as you make changes.

[0771] server

[0772] The system receives and stores user operation data during customization in real time, and generates and sends a preview of the customization to the device as needed.

[0773] Saving and exporting content

[0774] User

[0775] Once you've finished customizing, select "Save" or "Export."

[0776] Terminal

[0777] Depending on the user's selection, a save or print request is sent to the server.

[0778] server

[0779] The received customized template data is saved in the user's account, and if necessary, it can be output as a PDF or image file and a download link sent to the device.

[0780] Specific examples

[0781] For example, if a user wants to create a "2023 New Year's card," the specific steps would be as follows:

[0782] 1. The user enters their account information on the login screen and logs in.

[0783] 2. The device receives the user's input and sends the authentication information to the server.

[0784] 3. The server verifies the authentication information, and if authentication is successful, starts the session and loads the configuration information. If authentication fails, it sends an error message to the terminal.

[0785] 4. The user clicks the "Choose Template" button and a template request is sent to the server.

[0786] 5. The server sends the sample template list to the terminal, which displays it.

[0787] 6. The user selects the "2023 New Year's Card" template and sends the selection information to the server.

[0788] 7. The server sends the template data to the terminal, and the terminal displays the template in edit mode.

[0789] 8. Users can customize the template by adding text, uploading images, and changing the background color.

[0790] 9. The server receives the customization operation data, generates a preview in real time, and sends it to the device.

[0791] 10. When the user has finished customizing, they click the "Save" button and the device sends a save request to the server.

[0792] 11. The server saves the customized template, generates output files if necessary, and sends download links.

[0793] This system allows even users who are unfamiliar with digital technology to easily create high-quality New Year's cards and postcards.

[0794] The processing flow will be explained below.

[0795] Program processing steps

[0796] 1. User authentication and initialization

[0797] Step 1:

[0798] The user enters their email address and password on the login screen and clicks the "Login" button.

[0799] Step 2:

[0800] The terminal receives the entered authentication information and sends it to the server.

[0801] Step 3:

[0802] The server compares the received authentication information with the database and generates an authentication result.

[0803] If authentication is successful, it starts a user session and loads the user configuration information.

[0804] If authentication fails, an error message is generated.

[0805] Step 4:

[0806] The server sends the authentication result to the terminal.

[0807] Step 5:

[0808] The terminal receives the authentication result, and if successful, displays the main menu screen, or if unsuccessful, displays a pop-up error message.

[0809] 2. Providing sample templates

[0810] Step 1:

[0811] The server uses a generative AI model to pre-generate various art templates and store them in a sample database.

[0812] Step 2:

[0813] The user clicks the "Choose a template" button on the main menu screen.

[0814] Step 3:

[0815] The device sends a template request to the server.

[0816] Step 4:

[0817] The server retrieves the template list from the sample database and sends it to the terminal.

[0818] Step 5:

[0819] The terminal displays the template list received from the server on the screen.

[0820] Step 6:

[0821] The user clicks on a template of their choice from the displayed list of templates and sends the selected template ID to the server.

[0822] 3. Customize the template

[0823] Step 1:

[0824] The server transmits the selected template data to the terminal.

[0825] Step 2:

[0826] The device will display the template in edit mode and provide customization tools such as adding text, adding images, and changing colors.

[0827] Step 3:

[0828] A user edits the template using the customization tools.

[0829] Add text: Enter your message in the text box and adjust the position.

[0830] Image Adding Operation: Upload an image and adjust its size and position.

[0831] Color change operations: Select background and text colors.

[0832] Step 4:

[0833] The terminal transmits the user's customized operation data to the server in real time.

[0834] Step 5:

[0835] The server sequentially stores the received customization operation data, generates preview data in real time, and transmits it to the terminal.

[0836] Step 6:

[0837] Your device will display your edits in real time in a preview window.

[0838] 4. Saving and exporting content

[0839] Step 1:

[0840] When the user has finished customizing, he clicks the "Save" or "Export" button.

[0841] Step 2:

[0842] The terminal sends a save request or an output request to the server.

[0843] Step 3:

[0844] The server stores the received customized template data in the user's account.

[0845] Step 4:

[0846] The server generates the customized template as a PDF or image file.

[0847] Step 5:

[0848] The server sends a download link for the generated output file to your device.

[0849] Step 6:

[0850] The device displays the download link to the user.

[0851] Step 7:

[0852] The user clicks the download link to download the customized art content.

[0853] This allows users to easily and intuitively create, save, and output high-quality art content.

[0854] Example 1

[0855] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0856] There is a demand for systems that allow even users unfamiliar with digital technology to easily create high-quality artistic content such as New Year's cards and postcards. However, existing systems tend to be complex to use, as template selection and customization are not intuitive. Furthermore, real-time preview generation and template saving and output often do not work smoothly, making it difficult to improve the user experience.

[0857] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0858] In this invention, the server includes means for acquiring and authenticating user authentication information, a database storing multiple pre-generated art templates, means for providing the user with a list of art templates from the database, means for displaying the art template selected by the user in edit mode and providing customization tools such as adding text, images, and changing colors, means for pre-generating the art template using a generative AI model, means for receiving the user's template customization operations and generating a preview in real time, and means for saving and outputting the customized template. This allows users to intuitively select and customize art templates and proceed with their work while viewing a preview in real time. Furthermore, the ability to easily save and output customized templates is expected to improve the user experience.

[0859] "User authentication information" refers to information such as an email address and password required by a user to access a system.

[0860] "Art templates" are pre-created graphical templates that contain design elements for New Year's cards, postcards, etc.

[0861] A "database" is a system that systematically stores and manages data such as templates and user information.

[0862] "Customization Tool" means a software tool that provides functionality for a User to edit and modify Templates.

[0863] A "generative AI model" is an algorithm or technology that uses artificial intelligence to generate art templates in advance.

[0864] "Preview" is a feature that allows users to visually check the results of their customizations in real time.

[0865] "Means for saving" is a function that allows a user to save a customized template in a database or the like.

[0866] "Means of output" is a function that generates customized templates as PDF or image files and allows users to download them.

[0867] This invention is a system that allows users to intuitively create and customize artistic content such as New Year's cards and postcards. The system is mainly composed of three elements: a server, a terminal, and a user.

[0868] User authentication and initialization

[0869] server

[0870] When a user submits a login request, the server receives authentication information (email address and password). The server compares this information with the database and determines the authentication result. If authentication is successful, the server starts a user session, loads configuration information, and sends it to the terminal. If authentication fails, an error message is generated and sent to the terminal.

[0871] Terminal

[0872] The terminal provides a login screen for the user to enter information and displays the main menu or an error message depending on the authentication result.

[0873] User

[0874] The user logs into the system by entering account information.

[0875] Providing sample templates

[0876] server

[0877] The server uses a generative AI model to pre-generate various art templates and stores them in a sample database. When a user submits a template request, the server provides a list of sample templates to the device.

[0878] Terminal

[0879] The terminal displays a list of sample templates for the user to choose from.

[0880] User

[0881] The user selects their preferred design from the provided templates.

[0882] Customizing the template

[0883] Terminal

[0884] The terminal displays the selected template in an edit mode and provides customization tools such as means for adding text, adding images, and changing colors.

[0885] User

[0886] Users can customize templates to their liking by adding text and images, changing colors and designs, etc. They can proceed while checking a preview as they make each customization.

[0887] server

[0888] The server receives user operation data during customization at any time, generates a preview in real time, and sends it to the device.

[0889] Saving and exporting content

[0890] User

[0891] When the user has finished customizing, he clicks the "Save" or "Export" button.

[0892] Terminal

[0893] The terminal sends a save request or an output request to the server depending on the user's selection.

[0894] server

[0895] The server then saves the customized template data to the user's account, and optionally outputs it as a PDF or image file, providing a download link to the device.

[0896] Specific examples

[0897] For example, if a user wants to create a "2023 New Year's card," the flow would be as follows:

[0898] 1. The user enters their email address and password to log in.

[0899] 2. The device sends authentication information to the server, and the server performs authentication.

[0900] 3. After successful authentication, the server loads the user's configuration information and sends it to the terminal.

[0901] 4. The user clicks the template selection button, sending a template request to the server.

[0902] 5. The server retrieves the sample template list and sends it to the terminal.

[0903] 6. The user selects the "2023 New Year's Card" template, and the device sends the selection information to the server.

[0904] 7. The server sends the template data to the terminal, and the terminal displays the template in edit mode.

[0905] 8. Users can add text, upload images and change background colors.

[0906] 9. The server receives the customization operations in real time, generates a preview, and sends it to the device.

[0907] 10. The user finishes their work and clicks the "Save" button.

[0908] 11. The device sends a save request to the server, and the server saves the customized template to the user's account.

[0909] 12. If necessary, the server generates the output file and provides a download link to the device.

[0910] This system allows even users who are unfamiliar with digital technology to easily create high-quality New Year's cards and postcards.

[0911] Examples of prompt statements

[0912] Example prompt for creating a "2023 New Year's card":

[0913] "Generate an art template for a 2023 New Year's card"

[0914] "Please use red and gold as the main colors and include an illustration of the animal of the Chinese zodiac."

[0915] "Please add a background that gives off a New Year's atmosphere."

[0916] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0917] Program processing steps

[0918] User authentication and initialization

[0919] Step 1:

[0920] The user enters their email address and password on the login screen.

[0921] Input: Email address, Password

[0922] Output: None

[0923] Specific behavior: The user enters account information into the form and clicks the login button.

[0924] Step 2:

[0925] The terminal transmits the entered authentication information to the server.

[0926] Input: Email address, Password

[0927] Output: Request to server

[0928] Specific operation: The device obtains user input and sends it to the server as a POST request.

[0929] Step 3:

[0930] The server checks the authentication information against a database and determines the authentication result.

[0931] Input: Authentication information (email address, password)

[0932] Output: Authentication result (success / failure), configuration information or error message

[0933] What happens: The server performs a database query to verify the authentication information.

[0934] Step 4:

[0935] The terminal receives the response from the server and displays the next screen depending on the authentication result.

[0936] Input: Authentication result, setting information or error message

[0937] Output: Display of main menu or error message

[0938] Specific operation: If authentication is successful, the main menu screen will be displayed; if unsuccessful, an error message will be displayed.

[0939] Providing sample templates

[0940] Step 5:

[0941] The user clicks the "Choose a template" button from the main menu.

[0942] Input: Button click event

[0943] Output: Template request

[0944] Specific behavior: The user clicks a button, sending a template request to the device.

[0945] Step 6:

[0946] The device sends a template request to the server.

[0947] Input: User request

[0948] Output: A template request to the server

[0949] Specific operation: The device sends a request to the server.

[0950] Step 7:

[0951] The server retrieves pre-generated art templates from a sample database using a generative AI model.

[0952] Input: Template request

[0953] Output: Art template list

[0954] What happens next: The server performs a database query to retrieve a list of sample templates.

[0955] Step 8:

[0956] The server sends the template list to the terminal.

[0957] Input: Art template list

[0958] Output: Send template list

[0959] Specific operation: The server returns the template list to the terminal.

[0960] Step 9:

[0961] The terminal displays a list of templates for the user to select.

[0962] Input: Template list

[0963] Output: Display the template list

[0964] Specific behavior: The device displays a list of templates and provides a UI for selection.

[0965] Customizing the template

[0966] Step 10:

[0967] The user selects a template of their choice from the displayed template list.

[0968] Input: Template selection information

[0969] Output: Sends selected information to the terminal

[0970] Specific behavior: The user clicks on a template and the selection information is sent to the device.

[0971] Step 11:

[0972] The terminal transmits the selection information to the server.

[0973] Input: Template selection information

[0974] Output: Request to server

[0975] Specific operation: The terminal sends the selection information to the server.

[0976] Step 12:

[0977] The server transmits the selected template data to the terminal.

[0978] Input: Selection information

[0979] Output: Template data

[0980] Specific operation: The server retrieves the selected template from the database and sends it to the terminal.

[0981] Step 13:

[0982] The device displays the template in edit mode, providing the means to add text, add images, and change colors.

[0983] Input: Template data

[0984] Output: Edit screen

[0985] What it does: The device displays the template on the screen along with editing tools.

[0986] Step 14:

[0987] Users can add text and images to templates and change the colors and design.

[0988] Input: Customization instructions

[0989] Output: Customization data

[0990] Specific actions: User enters text, uploads an image, or changes a color.

[0991] Step 15:

[0992] The terminal sends various customization operations to the server.

[0993] Input: Customization data

[0994] Output: Request to server

[0995] Specific operation: The device sends the user's customization operations to the server at any time.

[0996] Step 16:

[0997] The server receives the customization operation data in real time, generates a preview image, and transmits it to the terminal.

[0998] Input: Customization data

[0999] Output: Preview image

[1000] Specific operation: The server generates a preview image in real time and sends it to the device.

[1001] Step 17:

[1002] The device will display a preview image, allowing the user to see the results of the customization.

[1003] Input: Preview image

[1004] Output: Preview

[1005] Specific behavior: The device displays a preview image on the screen for the user to review.

[1006] Saving and exporting content

[1007] Step 18:

[1008] When the user has finished customizing, he clicks the "Save" or "Export" button.

[1009] Input: Button click event

[1010] Output: Save or output request

[1011] Specific action: The user clicks the save or print button.

[1012] Step 19:

[1013] The terminal sends a save request or an output request to the server.

[1014] Input: Request

[1015] Output: Request to server

[1016] Specific operation: The terminal sends a user request to the server.

[1017] Step 20:

[1018] The server stores the received customized template data in the user's account.

[1019] Input: Customized template data

[1020] Output: Data storage

[1021] Specific behavior: The server saves the template in the database.

[1022] Step 21:

[1023] The server outputs the customized template as a PDF or image file as needed and sends a download link to the device.

[1024] Input: Customized template data

[1025] Output: Output file, download link

[1026] Specific operation: The server generates the output file and sends a download link to the device.

[1027] Step 22:

[1028] The device displays a download link to the user, and the user downloads the required file.

[1029] Input: Download link

[1030] Output: Downloadable link displayed

[1031] What happens: The device displays a link, allowing the user to download the file.

[1032] (Application example 1)

[1033] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1034] Conventional art content generation systems typically involve selecting and customizing templates using a PC or smartphone. However, these methods tend to be limited by location and time, making them inconvenient, especially when intuitive operation is desired in a brick-and-mortar store or on the go. Furthermore, the advertising industry is seeking systems that can create and display interactive advertisements in real time, but current systems cannot meet these requirements. This invention aims to solve these issues and provide a system that allows users to intuitively create, customize, and display interactive art content and advertisements anywhere via smart glasses.

[1035] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1036] In this invention, the server includes means for acquiring and authenticating user authentication information, a database storing multiple pre-generated art templates, means for providing the user with a list of art templates from the database, means for displaying the art template selected by the user in an edit mode and providing a customization tool, means for receiving the user's template customization operation and generating a preview in real time, means for saving and outputting the customized template, means for generating and displaying an interactive advertisement in real time via smart glasses, and means for enabling the customization tool to be operated using voice commands and touchpad operations, thereby enabling the user to intuitively operate the smart glasses to generate, customize, and display interactive advertisements and art content in real time.

[1037] "User Credentials" means identifying information, such as an email address or password, provided by a User to access a System.

[1038] A "database" is a storage device for storing and managing multiple pre-generated art templates and related information.

[1039] An "art template" is a basic design and layout template that users can freely customize.

[1040] "Customization tools" are a set of functions that allow users to edit and modify templates, including adding text, adding images, and changing colors.

[1041] "Edit mode" is an operation screen that allows the user to change and modify the art template they have selected.

[1042] "Real-time preview" is a preview display of a template that is instantly updated in response to the user's customization operations.

[1043] "Storage" is a feature that allows a user to save customized templates to their account.

[1044] "Output means" is a function for generating and providing customized templates as PDF or image files.

[1045] "Smart glasses" are eyeglass-shaped wearable devices equipped with displays and various sensors that allow users to display and manipulate information in real time.

[1046] "Interactive advertising" refers to advertising content that users can control and customize in real time.

[1047] "Voice commands" are instructions that a user uses to operate the system using voice.

[1048] "Touchpad operation" refers to the method by which a user operates a system using a touchpad.

[1049] The present invention relates to a system that allows users to create and customize interactive art content and advertisements in real time using smart glasses. Specific embodiments are described below.

[1050] System configuration

[1051] Hardware

[1052] 1. Smart glasses: A wearable device in the shape of glasses equipped with a display and various sensors, it displays information in real time and can be operated using voice commands or a touchpad.

[1053] 2. Server: A computer system with a database, generative AI model, and real-time preview generation capabilities.

[1054] software

[1055] 1. Generative AI model: An AI system for automatically generating art templates.

[1056] 2. Server program: Performs user authentication, provides template lists, saves and outputs customized data, etc.

[1057] 3. Smart Glasses App: Users can select and customize templates using voice commands or the touchpad.

[1058] Program processing

[1059] 1. User authentication and initialization

[1060] The user enters their account information on the login screen of the smart glasses and submits a login request.

[1061] The server checks the authentication information against a database, and after successful authentication starts the user's session and loads the configuration information. If authentication fails, it generates an error message and sends it to the smart glasses.

[1062] 2. Providing sample templates

[1063] The server uses a generative AI model to pre-generate various art templates and store them in a sample database.

[1064] When a user sends a template request from their smart glasses, the server provides a list of sample templates.

[1065] 3. Customize the template

[1066] Once a user selects a template, the smart glasses will display it in edit mode, providing customization tools for adding text, adding images, and changing colors.

[1067] Users can customize templates using voice commands or the touchpad, previewing their changes in real time.

[1068] The customization data is sent to the server at any time, and a real-time preview is generated.

[1069] 4. Saving and exporting content

[1070] When the user has finished customizing, they select the "Save" or "Export" option.

[1071] The smart glasses send a save or output request to the server.

[1072] The server saves the customized template, generates it as a PDF or image file, and provides a download link.

[1073] Specific examples

[1074] For example, to create an interactive ad for a new product launch campaign, the following prompt sentences could be input into the generative AI model:

[1075] Prompt Sentence Examples

[1076] Template name: "New product launch campaign"

[1077] Requirements:

[1078] Visually impactful design

[1079] Text fields: "New product name", "Features", "Release date"

[1080] Image field: "New product image"

[1081] Customization Options:

[1082] Color Change

[1083] Text position change

[1084] Change font size

[1085] This invention allows users to intuitively control and generate, customize, and display interactive advertising and art content in real time through smart glasses.

[1086] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1087] Step 1:

[1088] Obtaining and authenticating user credentials

[1089] The user enters their account information (email address, password) on the login screen of the smart glasses and sends a login request.

[1090] Input: Email address, password

[1091] Output: Authentication token, error message (if authentication failed)

[1092] The terminal receives the login information and sends it to the server.

[1093] Input: Login information

[1094] Output: Authentication request

[1095] The server checks the authentication information against a database, and if authentication is successful, starts the session and loads the user's configuration information. If authentication fails, it generates an error message and sends it to the terminal.

[1096] Input: Login information

[1097] Data processing: Matching with database, session generation

[1098] Output: Authentication result, user setting information, error message

[1099] Step 2:

[1100] Providing sample templates

[1101] The user sends a template request from the smart glasses.

[1102] Input: Template request

[1103] Output: Template list

[1104] The terminal relays the template request to the server.

[1105] Input: Template request

[1106] Output: Template list request

[1107] The server retrieves pre-generated art templates from a database, generates a list of templates, and sends it to the terminal.

[1108] Input: Template list request

[1109] Data processing: Obtaining template data and generating lists

[1110] Output: Template list

[1111] Step 3:

[1112] Select and customize a template

[1113] The user selects a template from the provided template list and transmits the selection information to the terminal.

[1114] Input: Template selection information

[1115] Output:Selection Template

[1116] The device will display the selected template in edit mode and provide customization tools (add text, add images, change colors).

[1117] Input:Select Template

[1118] Output: Edit mode screen, customization tools

[1119] Users can customize templates using voice commands or the touchpad, then enter changes into the device.

[1120] Input: Customized instructions (voice commands, touchpad operations)

[1121] Output: Customized operation data

[1122] The terminal transmits customized operation data to the server, and the server generates a real-time preview and transmits it back to the terminal.

[1123] Input: Customized operation data

[1124] Data processing: Real-time preview generation

[1125] Output: Preview screen

[1126] Step 4:

[1127] Saving and exporting customization data

[1128] When the user has finished customizing, they can select the "Save" or "Export" option.

[1129] Input: Save request or Output request

[1130] Output: Save completion notification, download link

[1131] The terminal sends a save request or an output request to the server.

[1132] Input: Save request or Output request

[1133] Output: Save instruction, output instruction

[1134] The server saves the customized template in the user's account, generates it as a PDF or image file if necessary, and provides a download link to the device.

[1135] Input: Customized template data

[1136] Data processing: file creation, link creation

[1137] Output: Save completion notification, download link

[1138] Through these steps, users can intuitively operate the smart glasses to generate, customize, and display interactive advertising and art content in real time.

[1139] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1140] This invention is a system that allows users to intuitively create and customize artistic content, and further incorporates an emotion engine that recognizes the user's emotions and supports operation. Specific embodiments of this system are described below.

[1141] User authentication and initialization

[1142] server

[1143] When a user submits a login request, the server receives authentication information, which includes the user's email address and password. The server compares this with the database and generates an authentication result. If authentication is successful, it starts a user session and loads the user's configuration information. If authentication fails, it generates an error message and sends it to the terminal.

[1144] Terminal

[1145] A login screen for entering authentication information is displayed, and the next operation screen (main menu or error message) is displayed depending on the authentication result.

[1146] User

[1147] Enter your account information to log in to the system.

[1148] Providing sample templates

[1149] server

[1150] A generative AI model is used to pre-generate various art templates and store them in a sample database. When a user submits a template request, the server provides the user with a list of sample templates.

[1151] Terminal

[1152] Displays a list of sample templates for the user to choose from.

[1153] User

[1154] Choose your favorite design from the provided templates.

[1155] User emotion recognition and template customization

[1156] Emotion Engine

[1157] It recognizes the user's emotions in real time from their facial expressions and tone of voice, and sends that information to the server.

[1158] server

[1159] The list of art templates is customized based on the user's emotional information received from the emotion engine. For example, if the user is happy, it will prioritize bright and colorful designs, and if the user is calm, it will prioritize simple and refreshing designs.

[1160] Terminal

[1161] Display a list of customized templates for users to choose from.

[1162] User

[1163] Begin customizing the selected template.

[1164] Terminal

[1165] Displays the selected template in edit mode and provides customization tools such as adding text, adding images, and changing colors.

[1166] User

[1167] Users can customize the template to their liking by adding text and images, changing the color and design, etc. The recommended settings of the customization tool will change based on the user's emotions as determined by the emotion engine.

[1168] server

[1169] The system receives and stores user operation data during customization in real time, and generates and sends a preview of the customization to the device as needed.

[1170] Saving and exporting content

[1171] User

[1172] Once you've finished customizing, select "Save" or "Export."

[1173] Terminal

[1174] Depending on the user's selection, a save or print request is sent to the server.

[1175] server

[1176] The received customized template data is saved in the user's account, and if necessary, it can be output as a PDF or image file, with a download link sent to the device.

[1177] Specific examples

[1178] For example, if a user wants to create a "2023 New Year's card," the specific steps would be as follows:

[1179] 1. The user enters their account information on the login screen and logs in.

[1180] 2. The device receives the user's input and sends the authentication information to the server.

[1181] 3. The server verifies the authentication information, and if authentication is successful, starts the session and loads the configuration information. If authentication fails, it sends an error message to the terminal.

[1182] 4. The user clicks the "Choose Template" button and a template request is sent to the server.

[1183] 5. The server sends the sample template list to the terminal, which displays it.

[1184] 6. The emotion engine analyzes the user's facial expressions and tone of voice to determine that the user is relaxed.

[1185] 7. The server prioritizes templates that match the relaxed state and places them at the top of the list, then sends them to the terminal.

[1186] 8. The user selects the "2023 New Year's Card" template and sends the selection information to the server.

[1187] 9. The server sends the template data to the terminal, and the terminal displays the template in edit mode.

[1188] 10. Users customize the template by adding text, uploading images, and changing the background color. Based on the sentiment engine, text font and color recommendations are provided.

[1189] 11. The server receives the customization operation data, generates a preview in real time, and sends it to the terminal.

[1190] 12. When the user has finished customizing, they click the "Save" button and the device sends a save request to the server.

[1191] 13. The server saves the customized template, generates output files if necessary, and sends download links.

[1192] This system provides optimal templates and customization tool settings based on the user's emotions, allowing them to create high-quality art content more comfortably.

[1193] The processing flow will be explained below.

[1194] Program processing steps

[1195] 1. User authentication and initialization

[1196] Step 1:

[1197] The user enters their email address and password on the login screen and clicks the "Login" button.

[1198] Step 2:

[1199] The terminal receives the entered authentication information and sends it to the server.

[1200] Step 3:

[1201] The server compares the received authentication information with the database and generates an authentication result.

[1202] If authentication is successful, it starts a user session and loads the user configuration information.

[1203] If authentication fails, an error message is generated.

[1204] Step 4:

[1205] The server sends the authentication result to the terminal.

[1206] Step 5:

[1207] The terminal receives the authentication result, and if successful, displays the main menu screen, or if unsuccessful, displays a pop-up error message.

[1208] 2. Providing sample templates

[1209] Step 1:

[1210] The server uses a generative AI model to pre-generate various art templates and store them in a sample database.

[1211] Step 2:

[1212] The user clicks the "Choose a template" button on the main menu screen.

[1213] Step 3:

[1214] The device sends a template request to the server.

[1215] Step 4:

[1216] The server retrieves the template list from the sample database and sends it to the terminal.

[1217] Step 5:

[1218] The terminal displays the template list received from the server on the screen.

[1219] Step 6:

[1220] The emotion engine analyzes the user's facial expressions and tone of voice and transmits the user's emotional state to the server.

[1221] Step 7:

[1222] The server customizes the template list based on the user's emotional information received (e.g., preferentially displaying simple designs to users in a relaxed state).

[1223] Step 8:

[1224] The device will redisplay the customized template list on the screen.

[1225] Step 9:

[1226] The user clicks on a template of their choice from the displayed list of templates and sends the selected template ID to the server.

[1227] 3. Customize the template

[1228] Step 1:

[1229] The server transmits the selected template data to the terminal.

[1230] Step 2:

[1231] The device will display the template in edit mode and provide customization tools such as adding text, adding images, and changing colors.

[1232] Step 3:

[1233] An emotion engine analyzes a user's facial expressions and tone of voice to recommend settings for customization tools based on their emotional state (e.g., recommending bright colors if they are happy).

[1234] Step 4:

[1235] A user edits the template using the customization tools.

[1236] Add text: Enter your message in the text box and adjust the position.

[1237] Image Adding Operation: Upload an image and adjust its size and position.

[1238] Color change operations: Select background and text colors.

[1239] Step 5:

[1240] The terminal transmits the user's customized operation data to the server in real time.

[1241] Step 6:

[1242] The server sequentially stores the received customization operation data, generates preview data in real time, and transmits it to the terminal.

[1243] Step 7:

[1244] Your device will display your edits in real time in a preview window.

[1245] 4. Saving and exporting content

[1246] Step 1:

[1247] When the user has finished customizing, he clicks the "Save" or "Export" button.

[1248] Step 2:

[1249] The terminal sends a save request or an output request to the server.

[1250] Step 3:

[1251] The server stores the received customized template data in the user's account.

[1252] Step 4:

[1253] The server generates the customized template as a PDF or image file.

[1254] Step 5:

[1255] The server sends a download link for the generated output file to your device.

[1256] Step 6:

[1257] The device displays the download link to the user.

[1258] Step 7:

[1259] The user clicks the download link to download the customized art content.

[1260] In this way, the optimal template and customization tool settings are provided according to the user's emotions, enabling the creation of more comfortable, high-quality art content.

[1261] Example 2

[1262] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1263] Previous art content generation systems provided templates without considering user emotions and lacked intuitive customization features. Furthermore, they lacked real-time operation data saving and preview generation, resulting in a poor user experience. Furthermore, the template output formats were limited, making it difficult to meet diverse user needs.

[1264] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1265] In this invention, the server includes means for acquiring and authenticating user authentication information, a database for storing a plurality of pre-generated content templates, means for providing the user with a list of content templates from the database, means for displaying the content template selected by the user in an edit mode and providing a customization tool, means for recognizing emotions from the user's facial expressions and tone of voice and customizing the list of content templates based thereon, means for receiving template customization operations performed by the user and generating previews in real time, and means for saving and outputting customized templates. This makes it possible to provide optimal templates based on the user's emotions and to perform intuitive and efficient customization work.

[1266] "User authentication information" refers to information such as an email address and password used to authenticate a user's personal information.

[1267] "Multiple pre-generated content templates" refers to a group of templates with diverse designs that have been pre-generated by a generative AI model.

[1268] A database is a system that systematically organizes and stores information, making it easy to access and manage.

[1269] The "content template list" is a list of multiple templates that the user can select from.

[1270] "Edit mode" means that the user can freely customize the template.

[1271] "Customization Tools" means a set of tools that a User can use to edit a Template, including adding text, adding images, changing colors, etc.

[1272] "Emotion recognition" means analyzing the user's facial expressions and tone of voice to determine their emotions at that time.

[1273] "Generating a preview in real time" means displaying changes immediately in response to user actions.

[1274] A "customized template" is a template that has been edited and customized by a user.

[1275] "Output means" is a function for saving and providing customized templates in formats such as PDF or image files.

[1276] MODE FOR CARRYING OUT THE INVENTION

[1277] This invention is a system that allows users to intuitively create and customize artistic content, and further incorporates an emotion engine that recognizes the user's emotions and assists in operation. A series of processes is provided that allows users to log in, select a template, customize it, and finally save or output it. A specific embodiment of this system is described below.

[1278] User authentication and initialization

[1279] server

[1280] When a user submits a login request, the server receives the authentication information (email address and password) and checks it against a database (e.g., MySQL). If authentication is successful, the server starts a session for the user and loads the configuration information. If authentication fails, it generates an error message and sends it to the terminal as an HTTP response.

[1281] Terminal

[1282] The terminal displays a login screen and provides fields for the user to enter their email address and password. When the user enters the authentication information and clicks the "Login" button, the terminal sends the authentication information to the server. Upon receiving the authentication result, the terminal displays the main menu screen if successful, or an error message if unsuccessful.

[1283] User

[1284] The user enters their email address and password on the login screen and clicks the "Login" button.

[1285] Providing sample templates

[1286] server

[1287] A generative AI model (e.g., GPT-3) is used to pre-generate a variety of art templates and store them in a sample database. When a user submits a template request, the server generates a list of sample templates and sends them to the device as an HTTP response.

[1288] Terminal

[1289] The device displays a list of sample templates received from the server, with thumbnail images and descriptions displayed on the interface to help the user select a template.

[1290] User

[1291] Users can select their favorite design from the sample templates displayed.

[1292] User emotion recognition and template customization

[1293] Emotion Engine

[1294] The emotion engine analyzes the user's facial expressions and tone of voice in real time. For this analysis, OpenCV and Emotion SDK are used, for example. The emotion engine sends the analysis results to the server.

[1295] server

[1296] The server customizes the list of art templates based on the emotion data received from the emotion engine. For example, if the user is happy, it prioritizes bright and colorful designs. It generates the customized template list and sends it to the device as an HTTP response.

[1297] Terminal

[1298] It displays a list of customized templates for users to choose from, and after users select a template, it switches them into edit mode and provides customization tools (add text, add images, change colors, etc.).

[1299] User

[1300] Users select a template and customize it by adding text and images, changing colors and fonts, etc., guided by the tool's recommended settings based on an emotion engine.

[1301] Saving and exporting content

[1302] User

[1303] Once the user has completed customization, they click the "Save" or "Export" button.

[1304] Terminal

[1305] The terminal sends a save request or an output request to the server in response to the user's click.

[1306] server

[1307] The server saves the received customized template data in the user's account, using a database such as MongoDB. If output is selected, the server outputs the data as a PDF or image file, generates a download link, and sends it to the terminal as an HTTP response.

[1308] Specific examples

[1309] For example, if a user wants to create a "2023 New Year's card," the process would be as follows:

[1310] 1. The user enters their email address and password on the login screen to log in.

[1311] 2. The terminal sends authentication information to the server, the server performs authentication, and if successful, the session starts and the main menu is displayed on the terminal.

[1312] 3. The user clicks the "Choose a template" button in the main menu, and a template request is sent to the server.

[1313] 4. The server generates a sample template list, which the terminal displays.

[1314] 5. The emotion engine analyzes the user's facial expressions and tone of voice and determines that they are relaxed.

[1315] 6. The server places the template suitable for the relaxed state at the top of the list and sends it to the terminal.

[1316] 7. The user selects the "2023 New Year's Card" template and sends the selection information to the server.

[1317] 8. The server sends the template data to the terminal, and the terminal displays the template in edit mode.

[1318] 9. Users customize the template by adding text, uploading images, and changing the background color. Recommendations are provided based on the sentiment engine.

[1319] 10. The server receives the customization operation data in real time, generates a preview, and sends it to the device.

[1320] 11. The user finishes customizing and clicks the "Save" or "Export" button.

[1321] 12. The device sends a save or output request to the server.

[1322] 13. The server saves the customized template, generates the output as a PDF or image file, and sends a download link.

[1323] Prompt Sentence Examples

[1324] I want to choose a template based on the theme "New Year's Cards 2023." If the user has a happy expression, what design would you recommend?

[1325] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1326] Step 1: User authentication and initialization

[1327] server

[1328] A login request is received from the user. The input data is an email address and password. The server compares this authentication information with the information in the database and generates an authentication result. If successful, a session is started and the user's configuration information is loaded. If unsuccessful, an error message is generated and sent to the terminal as an HTTP response.

[1329] Terminal

[1330] The device displays a login screen for entering an email address and password. When the user enters the authentication information and clicks the "Login" button, the data is sent to the server. The device receives the authentication result from the server, and if successful, displays the main menu screen, otherwise displays an error message.

[1331] User

[1332] The user enters their email address and password on the login screen and clicks the "Login" button.

[1333] Step 2: Provide a sample template

[1334] server

[1335] A variety of pre-generated art templates are stored in a sample database using a generative AI model (e.g., GPT-3). When a user sends a template request, the server generates a list of sample templates and sends it to the device as an HTTP response. The data input is the user request, and the output is the template list.

[1336] Terminal

[1337] The device displays a list of sample templates received from the server, with thumbnail images and descriptions displayed on the interface to help the user select a template.

[1338] User

[1339] Users can select their favorite design from the sample templates displayed.

[1340] Step 3: User Emotion Recognition and Template Customization

[1341] Emotion Engine

[1342] It analyzes the user's facial expressions and tone of voice in real time. The input is video and audio data from the user. The analysis is performed using OpenCV or Emotion SDK, for example, and the analysis results are sent to the server.

[1343] server

[1344] The server customizes the list of art templates based on the emotion data received from the emotion engine. The input is emotion data, and the output is the customized template list. For example, for a happy emotion, it prioritizes bright and colorful designs. It sends the customized template list to the terminal as an HTTP response.

[1345] Terminal

[1346] It displays a list of customized templates for users to choose from, and after users select a template, it switches them into edit mode and provides customization tools (add text, add images, change colors, etc.).

[1347] User

[1348] Users select a template and customize it by adding text and images, changing colors and fonts, etc., guided by the tool's recommended settings based on an emotion engine.

[1349] Step 4: Save and export content

[1350] User

[1351] Once the user has completed customization, they click the "Save" or "Export" button.

[1352] Terminal

[1353] The terminal sends a save request or an output request to the server in response to the user's click.

[1354] server

[1355] The server saves the received customized template data in the user's account. The input is the customized template data, and the storage destination is a database (e.g., MongoDB). If output is selected, it outputs it as a PDF or image file, generates a download link, and sends it to the terminal as an HTTP response.

[1356] (Application example 2)

[1357] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1358] Conventional art content generation systems lack intuitive template selection and customization functions that take user emotions into account, making it difficult for users to find the design that best suits them. Furthermore, they do not provide real-time previews of customization operations or recommended settings based on emotion information, which makes it difficult to improve the user experience.

[1359] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring and authenticating user authentication information, a database that stores a plurality of pre-generated art templates, means for providing the user with a list of art templates from the database, means for recognizing the user's emotion and customizing the list of art templates based on the emotion information, means for displaying the art template selected by the user in an edit mode and providing a customization tool, means for receiving the user's template customization operation and generating a preview in real time, and means for saving and outputting the customized template. This makes it easier for users to select the optimal template based on their emotion, enabling them to intuitively and efficiently generate and customize art content.

[1360] "User Credentials" means information required to identify a user and grant access to a system.

[1361] A "database" is an information management system for storing a plurality of pre-generated art templates.

[1362] "Emotional information" is data about the user's emotional state obtained from facial expressions, tone of voice, etc.

[1363] "Edit mode" is an operating environment for customizing a user-selected art template.

[1364] The "Customization Tools" are a set of functions for editing art templates, such as adding text, adding images, changing colors, and recommending settings based on emotional information.

[1365] "Preview" is a display means for visually checking the results of customization operations performed by the user in real time.

[1366] "Storage" is a function that allows users to record customized templates so that they can be reused later.

[1367] The "output means" is a function for generating a customized template as a digital file and providing it to the user.

[1368] This invention provides a system for acquiring and authenticating user authentication information, providing multiple art templates, and customizing the template list based on the user's emotional information. The system displays the user-selected art template in an edit mode, provides customization tools, generates a real-time preview, and saves and outputs the customized template. Specific embodiments are described below.

[1369] System Configuration

[1370] 1. User authentication and initialization

[1371] server

[1372] When a user submits a login request, the server receives user authentication information, which includes the user's email address and password. This information is compared with the database to generate an authentication result. If authentication is successful, a user session is started and configuration information is loaded. The software used is Flask and SQLite.

[1373] Terminal

[1374] The terminal displays a login screen for inputting authentication information, and displays an operation screen (main menu or error message) according to the authentication result.

[1375] User

[1376] The user logs into the system by entering their account information.

[1377] 2. Providing sample templates

[1378] server

[1379] The server uses a generative AI model to pre-generate various art templates and stores them in a sample database. When a user submits a template request, the server provides a list of templates.

[1380] Terminal

[1381] The terminal displays a list of sample templates for the user to choose from.

[1382] User

[1383] Users can choose their favorite design from a list of templates.

[1384] 3. User emotion recognition and template customization

[1385] Emotion Engine

[1386] The emotion engine recognizes emotions from the user's facial expressions and tone of voice in real time and sends that information to the server. The library used is EmotionEngine.

[1387] server

[1388] The server customizes the art template list based on the user's emotional information received from the emotion engine. For example, if the user is happy, it will prioritize bright and colorful designs, and if the user is calm, it will prioritize simple and refreshing designs.

[1389] Terminal

[1390] The device will display a list of customized templates for the user to choose from.

[1391] User

[1392] The user initiates a customization operation on the selected template.

[1393] Terminal

[1394] The terminal displays the selected template in edit mode and provides customization tools such as adding text, adding images, and changing colors.

[1395] User

[1396] Users can customize the templates to their liking by adding text and images, changing colors and designs, etc. The recommended settings in the customization tool are changed based on the emotions determined by the emotion engine.

[1397] server

[1398] The server receives user operation data during customization at any time, generates a preview in real time, and sends it to the device.

[1399] 4. Saving and exporting content

[1400] User

[1401] Once the user has finished customizing, they can select "Save" or "Export."

[1402] Terminal

[1403] The terminal sends a save request or an output request to the server depending on the user's selection.

[1404] server

[1405] The server stores the received customized template data in the user's account, generates digital files as needed, and sends download links to the device.

[1406] Specific examples

[1407] For example, consider a user creating a "2023 New Year's card." The user enters account information on the login screen and logs in. The device receives the user's input and sends authentication information to the server. The server verifies the authentication information, and if authentication is successful, starts a session and loads the configuration information. If authentication fails, an error message is sent to the device.

[1408] Next, the user clicks the "Choose a template" button, and a template request is sent to the server. The server sends a list of sample templates to the device, which displays them. The emotion engine analyzes the user's facial expressions and tone of voice to detect their state of relaxation. The server prioritizes templates that match that state to the top of the list and sends them to the device. The user selects the "2023 New Year's Card" template and sends the selection information to the server. The server sends the template data to the device, and the device displays the template in edit mode.

[1409] Users customize templates by adding text, uploading images, and changing background colors. Based on the emotion engine, the server receives the customization data, generates a real-time preview, and sends it to the device.

[1410] When the user finishes customization, they click the "Save" button and the device sends a save request to the server. The server saves the customized template, generates the output file if necessary, and sends a download link. The prompt message "We will suggest an art template that matches your emotion. Please turn on the camera, relax, and wait." will be displayed.

[1411] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1412] Step 1:

[1413] The server receives user authentication information (email address and password). The input is user information, which is checked against a database to generate an authentication result. If authentication is successful, a session is started and configuration information is loaded. The output is the authentication result (success or failure).

[1414] Step 2:

[1415] The terminal displays a login screen and the user enters authentication information. The input is the user's email address and password, which are then prepared to be sent to the server. The output is the execution of the authentication information transmission.

[1416] Step 3:

[1417] The server verifies the authentication information and sends the authentication result to the terminal. The input is the user's authentication information, which is verified against the database to generate an authentication result (success or failure). The output is the authentication result (session ID if successful).

[1418] Step 4:

[1419] The terminal displays the following screen based on the authentication result. The input is the authentication result received from the server, and if successful, the main menu is displayed, or if unsuccessful, an error message is displayed. The output is the display content (main menu or error message).

[1420] Step 5:

[1421] The user issues a template request. The input is the user's operation, which sends a request to the terminal to display the art template list. The output is the template request.

[1422] Step 6:

[1423] The server uses the generative AI model to generate a template list and sends it to the device. The input is a template request, and the generative AI model generates a template list to create a template list tailored to the user. The output is the template list.

[1424] Step 7:

[1425] The terminal displays a template list. The input is the template list sent from the server and displayed for the user to select. The output is the displayed template list.

[1426] Step 8:

[1427] The emotion engine recognizes emotional information from the user's facial expressions and tone of voice in real time and sends that information to the server. The input is the user's facial expressions and voice data, which is analyzed to generate emotional information. The output is emotional information.

[1428] Step 9:

[1429] The server customizes the template list based on emotional information and displays templates that match the emotional state with priority. The input is emotional information, and the template list is processed to match the emotional state. The output is the customized template list.

[1430] Step 10:

[1431] The terminal displays the customized template list. The input is the customized template list sent from the server, allowing the user to select a more appropriate template. The output is the displayed customized template list.

[1432] Step 11:

[1433] The user selects a template and begins customization. The input is the template selection operation, and the selection information is sent to the terminal. The output is the selected template.

[1434] Step 12:

[1435] The device displays the selected template in edit mode and provides customization tools such as adding text, adding images, and changing colors. The input is the selected template, which is displayed for the user to edit. The output is the template displayed in edit mode.

[1436] Step 13:

[1437] The user customizes a template. The input is the operation of the customization tool, adding text, images, changing colors, etc. The output is the customized template.

[1438] Step 14:

[1439] The emotion engine changes the recommended settings of the customization tool based on the user's emotional information during the customization operation. The input is the user's facial expression and voice data, which is analyzed to generate emotional information and adjust the settings of the customization tool. The output is recommended settings based on the emotional information.

[1440] Step 15:

[1441] The server receives the customization operation data, generates a real-time preview, and sends it to the terminal. The input is the customization operation data, and the real-time preview is generated based on the data. The output is a preview image.

[1442] Step 16:

[1443] When the user finishes customization, they select "Save" or "Output." Input is the user's operation, which sends a save or output request to the terminal. Output is the save or output request.

[1444] Step 17:

[1445] The terminal sends a save or output request to the server. The input is the save or output request, which it prepares to send to the server. The output is the sending of the request.

[1446] Step 18:

[1447] The server receives the customized template data, stores it in the user's account, generates a digital file as needed, and sends a download link to the device. The input is the customized template data, which is saved and output as a file. The output is the saved data and a download link.

[1448] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1449] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1450] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1451] [Third embodiment]

[1452] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1453] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1454] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1455] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1456] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1457] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1458] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1459] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1460] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1461] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1462] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1463] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1464] This invention is a system that allows users to intuitively create and customize artistic content. It is designed especially for users who want to easily create artistic content such as New Year's cards and postcards. Specific embodiments of this system are described below.

[1465] User authentication and initialization

[1466] server

[1467] When a user submits a login request, the server receives authentication information, which includes the user's email address and password. The server checks this against a database, and if authentication is successful, it starts a session for the user and loads the user's configuration information. If authentication fails, it generates an error message and sends it to the terminal.

[1468] Terminal

[1469] A login screen for entering authentication information is displayed, and the next operation screen (main menu or error message) is displayed depending on the authentication result.

[1470] User

[1471] Enter your account information to log in to the system.

[1472] Providing sample templates

[1473] server

[1474] A generative AI model is used to pre-generate various art templates and store them in a sample database. When a user submits a template request, the server provides the user with a list of sample templates.

[1475] Terminal

[1476] Displays a list of sample templates for the user to choose from.

[1477] User

[1478] Choose your favorite design from the provided templates.

[1479] Customizing the template

[1480] Terminal

[1481] Displays the selected template in edit mode and provides customization tools such as adding text, adding images, and changing colors.

[1482] User

[1483] Customize templates to your liking by adding text and images, changing colors and designs, etc. Work while checking the preview as you make changes.

[1484] server

[1485] The system receives and stores user operation data during customization in real time, and generates and sends a preview of the customization to the device as needed.

[1486] Saving and exporting content

[1487] User

[1488] Once you've finished customizing, select "Save" or "Export."

[1489] Terminal

[1490] Depending on the user's selection, a save or print request is sent to the server.

[1491] server

[1492] The received customized template data is saved in the user's account, and if necessary, it can be output as a PDF or image file and a download link sent to the device.

[1493] Specific examples

[1494] For example, if a user wants to create a "2023 New Year's card," the specific steps would be as follows:

[1495] 1. The user enters their account information on the login screen and logs in.

[1496] 2. The device receives the user's input and sends the authentication information to the server.

[1497] 3. The server verifies the authentication information, and if authentication is successful, starts the session and loads the configuration information. If authentication fails, it sends an error message to the terminal.

[1498] 4. The user clicks the "Choose Template" button and a template request is sent to the server.

[1499] 5. The server sends the sample template list to the terminal, which displays it.

[1500] 6. The user selects the "2023 New Year's Card" template and sends the selection information to the server.

[1501] 7. The server sends the template data to the terminal, and the terminal displays the template in edit mode.

[1502] 8. Users can customize the template by adding text, uploading images, and changing the background color.

[1503] 9. The server receives the customization operation data, generates a preview in real time, and sends it to the device.

[1504] 10. When the user has finished customizing, they click the "Save" button and the device sends a save request to the server.

[1505] 11. The server saves the customized template, generates output files if necessary, and sends download links.

[1506] This system allows even users who are unfamiliar with digital technology to easily create high-quality New Year's cards and postcards.

[1507] The processing flow will be explained below.

[1508] Program processing steps

[1509] 1. User authentication and initialization

[1510] Step 1:

[1511] The user enters their email address and password on the login screen and clicks the "Login" button.

[1512] Step 2:

[1513] The terminal receives the entered authentication information and sends it to the server.

[1514] Step 3:

[1515] The server compares the received authentication information with the database and generates an authentication result.

[1516] If authentication is successful, it starts a user session and loads the user configuration information.

[1517] If authentication fails, an error message is generated.

[1518] Step 4:

[1519] The server sends the authentication result to the terminal.

[1520] Step 5:

[1521] The terminal receives the authentication result, and if successful, displays the main menu screen, or if unsuccessful, displays a pop-up error message.

[1522] 2. Providing sample templates

[1523] Step 1:

[1524] The server uses a generative AI model to pre-generate various art templates and store them in a sample database.

[1525] Step 2:

[1526] The user clicks the "Choose a template" button on the main menu screen.

[1527] Step 3:

[1528] The device sends a template request to the server.

[1529] Step 4:

[1530] The server retrieves the template list from the sample database and sends it to the terminal.

[1531] Step 5:

[1532] The terminal displays the template list received from the server on the screen.

[1533] Step 6:

[1534] The user clicks on a template of their choice from the displayed list of templates and sends the selected template ID to the server.

[1535] 3. Customize the template

[1536] Step 1:

[1537] The server transmits the selected template data to the terminal.

[1538] Step 2:

[1539] The device will display the template in edit mode and provide customization tools such as adding text, adding images, and changing colors.

[1540] Step 3:

[1541] A user edits the template using the customization tools.

[1542] Add text: Enter your message in the text box and adjust the position.

[1543] Image Adding Operation: Upload an image and adjust its size and position.

[1544] Color change operations: Select background and text colors.

[1545] Step 4:

[1546] The terminal transmits the user's customized operation data to the server in real time.

[1547] Step 5:

[1548] The server sequentially stores the received customization operation data, generates preview data in real time, and transmits it to the terminal.

[1549] Step 6:

[1550] Your device will display your edits in real time in a preview window.

[1551] 4. Saving and exporting content

[1552] Step 1:

[1553] When the user has finished customizing, he clicks the "Save" or "Export" button.

[1554] Step 2:

[1555] The terminal sends a save request or an output request to the server.

[1556] Step 3:

[1557] The server stores the received customized template data in the user's account.

[1558] Step 4:

[1559] The server generates the customized template as a PDF or image file.

[1560] Step 5:

[1561] The server sends a download link for the generated output file to your device.

[1562] Step 6:

[1563] The device displays the download link to the user.

[1564] Step 7:

[1565] The user clicks the download link to download the customized art content.

[1566] This allows users to easily and intuitively create, save, and output high-quality art content.

[1567] Example 1

[1568] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1569] There is a demand for systems that allow even users unfamiliar with digital technology to easily create high-quality artistic content such as New Year's cards and postcards. However, existing systems tend to be complex to use, as template selection and customization are not intuitive. Furthermore, real-time preview generation and template saving and output often do not work smoothly, making it difficult to improve the user experience.

[1570] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1571] In this invention, the server includes means for acquiring and authenticating user authentication information, a database storing multiple pre-generated art templates, means for providing the user with a list of art templates from the database, means for displaying the art template selected by the user in edit mode and providing customization tools such as adding text, images, and changing colors, means for pre-generating the art template using a generative AI model, means for receiving the user's template customization operations and generating a preview in real time, and means for saving and outputting the customized template. This allows users to intuitively select and customize art templates and proceed with their work while viewing a preview in real time. Furthermore, the ability to easily save and output customized templates is expected to improve the user experience.

[1572] "User authentication information" refers to information such as an email address and password required by a user to access a system.

[1573] "Art templates" are pre-created graphical templates that contain design elements for New Year's cards, postcards, etc.

[1574] A "database" is a system that systematically stores and manages data such as templates and user information.

[1575] "Customization Tool" means a software tool that provides functionality for a User to edit and modify Templates.

[1576] A "generative AI model" is an algorithm or technology that uses artificial intelligence to generate art templates in advance.

[1577] "Preview" is a feature that allows users to visually check the results of their customizations in real time.

[1578] "Means for saving" is a function that allows a user to save a customized template in a database or the like.

[1579] "Means of output" is a function that generates customized templates as PDF or image files and allows users to download them.

[1580] This invention is a system that allows users to intuitively create and customize artistic content such as New Year's cards and postcards. The system is mainly composed of three elements: a server, a terminal, and a user.

[1581] User authentication and initialization

[1582] server

[1583] When a user submits a login request, the server receives authentication information (email address and password). The server compares this information with the database and determines the authentication result. If authentication is successful, the server starts a user session, loads configuration information, and sends it to the terminal. If authentication fails, an error message is generated and sent to the terminal.

[1584] Terminal

[1585] The terminal provides a login screen for the user to enter information and displays the main menu or an error message depending on the authentication result.

[1586] User

[1587] The user logs into the system by entering account information.

[1588] Providing sample templates

[1589] server

[1590] The server uses a generative AI model to pre-generate various art templates and stores them in a sample database. When a user submits a template request, the server provides a list of sample templates to the device.

[1591] Terminal

[1592] The terminal displays a list of sample templates for the user to choose from.

[1593] User

[1594] The user selects their preferred design from the provided templates.

[1595] Customizing the template

[1596] Terminal

[1597] The terminal displays the selected template in an edit mode and provides customization tools such as means for adding text, adding images, and changing colors.

[1598] User

[1599] Users can customize templates to their liking by adding text and images, changing colors and designs, etc. They can proceed while checking a preview as they make each customization.

[1600] server

[1601] The server receives user operation data during customization at any time, generates a preview in real time, and sends it to the device.

[1602] Saving and exporting content

[1603] User

[1604] When the user has finished customizing, he clicks the "Save" or "Export" button.

[1605] Terminal

[1606] The terminal sends a save request or an output request to the server depending on the user's selection.

[1607] server

[1608] The server then saves the customized template data to the user's account, and optionally outputs it as a PDF or image file, providing a download link to the device.

[1609] Specific examples

[1610] For example, if a user wants to create a "2023 New Year's card," the flow would be as follows:

[1611] 1. The user enters their email address and password to log in.

[1612] 2. The device sends authentication information to the server, and the server performs authentication.

[1613] 3. After successful authentication, the server loads the user's configuration information and sends it to the terminal.

[1614] 4. The user clicks the template selection button, sending a template request to the server.

[1615] 5. The server retrieves the sample template list and sends it to the terminal.

[1616] 6. The user selects the "2023 New Year's Card" template, and the device sends the selection information to the server.

[1617] 7. The server sends the template data to the terminal, and the terminal displays the template in edit mode.

[1618] 8. Users can add text, upload images and change background colors.

[1619] 9. The server receives the customization operations in real time, generates a preview, and sends it to the device.

[1620] 10. The user finishes their work and clicks the "Save" button.

[1621] 11. The device sends a save request to the server, and the server saves the customized template to the user's account.

[1622] 12. If necessary, the server generates the output file and provides a download link to the device.

[1623] This system allows even users who are unfamiliar with digital technology to easily create high-quality New Year's cards and postcards.

[1624] Examples of prompt statements

[1625] Example prompt for creating a "2023 New Year's card":

[1626] "Generate an art template for a 2023 New Year's card"

[1627] "Please use red and gold as the main colors and include an illustration of the animal of the Chinese zodiac."

[1628] "Please add a background that gives off a New Year's atmosphere."

[1629] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1630] Program processing steps

[1631] User authentication and initialization

[1632] Step 1:

[1633] The user enters their email address and password on the login screen.

[1634] Input: Email address, Password

[1635] Output: None

[1636] Specific behavior: The user enters account information into the form and clicks the login button.

[1637] Step 2:

[1638] The terminal transmits the entered authentication information to the server.

[1639] Input: Email address, Password

[1640] Output: Request to server

[1641] Specific operation: The device obtains user input and sends it to the server as a POST request.

[1642] Step 3:

[1643] The server checks the authentication information against a database and determines the authentication result.

[1644] Input: Authentication information (email address, password)

[1645] Output: Authentication result (success / failure), configuration information or error message

[1646] What happens: The server performs a database query to verify the authentication information.

[1647] Step 4:

[1648] The terminal receives the response from the server and displays the next screen depending on the authentication result.

[1649] Input: Authentication result, setting information or error message

[1650] Output: Display of main menu or error message

[1651] Specific operation: If authentication is successful, the main menu screen will be displayed; if unsuccessful, an error message will be displayed.

[1652] Providing sample templates

[1653] Step 5:

[1654] The user clicks the "Choose a template" button from the main menu.

[1655] Input: Button click event

[1656] Output: Template request

[1657] Specific behavior: The user clicks a button, sending a template request to the device.

[1658] Step 6:

[1659] The device sends a template request to the server.

[1660] Input: User request

[1661] Output: A template request to the server

[1662] Specific operation: The device sends a request to the server.

[1663] Step 7:

[1664] The server retrieves pre-generated art templates from a sample database using a generative AI model.

[1665] Input: Template request

[1666] Output: Art template list

[1667] What happens next: The server performs a database query to retrieve a list of sample templates.

[1668] Step 8:

[1669] The server sends the template list to the terminal.

[1670] Input: Art template list

[1671] Output: Send template list

[1672] Specific operation: The server returns the template list to the terminal.

[1673] Step 9:

[1674] The terminal displays a list of templates for the user to select.

[1675] Input: Template list

[1676] Output: Display the template list

[1677] Specific behavior: The device displays a list of templates and provides a UI for selection.

[1678] Customizing the template

[1679] Step 10:

[1680] The user selects a template of their choice from the displayed template list.

[1681] Input: Template selection information

[1682] Output: Sends selected information to the terminal

[1683] Specific behavior: The user clicks on a template and the selection information is sent to the device.

[1684] Step 11:

[1685] The terminal transmits the selection information to the server.

[1686] Input: Template selection information

[1687] Output: Request to server

[1688] Specific operation: The terminal sends the selection information to the server.

[1689] Step 12:

[1690] The server transmits the selected template data to the terminal.

[1691] Input: Selection information

[1692] Output: Template data

[1693] Specific operation: The server retrieves the selected template from the database and sends it to the terminal.

[1694] Step 13:

[1695] The device displays the template in edit mode, providing the means to add text, add images, and change colors.

[1696] Input: Template data

[1697] Output: Edit screen

[1698] What it does: The device displays the template on the screen along with editing tools.

[1699] Step 14:

[1700] Users can add text and images to templates and change the colors and design.

[1701] Input: Customization instructions

[1702] Output: Customization data

[1703] Specific actions: User enters text, uploads an image, or changes a color.

[1704] Step 15:

[1705] The terminal sends various customization operations to the server.

[1706] Input: Customization data

[1707] Output: Request to server

[1708] Specific operation: The device sends the user's customization operations to the server at any time.

[1709] Step 16:

[1710] The server receives the customization operation data in real time, generates a preview image, and transmits it to the terminal.

[1711] Input: Customization data

[1712] Output: Preview image

[1713] Specific operation: The server generates a preview image in real time and sends it to the device.

[1714] Step 17:

[1715] The device will display a preview image, allowing the user to see the results of the customization.

[1716] Input: Preview image

[1717] Output: Preview

[1718] Specific behavior: The device displays a preview image on the screen for the user to review.

[1719] Saving and exporting content

[1720] Step 18:

[1721] When the user has finished customizing, he clicks the "Save" or "Export" button.

[1722] Input: Button click event

[1723] Output: Save or output request

[1724] Specific action: The user clicks the save or print button.

[1725] Step 19:

[1726] The terminal sends a save request or an output request to the server.

[1727] Input: Request

[1728] Output: Request to server

[1729] Specific operation: The terminal sends a user request to the server.

[1730] Step 20:

[1731] The server stores the received customized template data in the user's account.

[1732] Input: Customized template data

[1733] Output: Data storage

[1734] Specific behavior: The server saves the template in the database.

[1735] Step 21:

[1736] The server outputs the customized template as a PDF or image file as needed and sends a download link to the device.

[1737] Input: Customized template data

[1738] Output: Output file, download link

[1739] Specific operation: The server generates the output file and sends a download link to the device.

[1740] Step 22:

[1741] The device displays a download link to the user, and the user downloads the required file.

[1742] Input: Download link

[1743] Output: Downloadable link displayed

[1744] What happens: The device displays a link, allowing the user to download the file.

[1745] (Application example 1)

[1746] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1747] Conventional art content generation systems typically involve selecting and customizing templates using a PC or smartphone. However, these methods tend to be limited by location and time, making them inconvenient, especially when intuitive operation is desired in a brick-and-mortar store or on the go. Furthermore, the advertising industry is seeking systems that can create and display interactive advertisements in real time, but current systems cannot meet these requirements. This invention aims to solve these issues and provide a system that allows users to intuitively create, customize, and display interactive art content and advertisements anywhere via smart glasses.

[1748] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1749] In this invention, the server includes means for acquiring and authenticating user authentication information, a database storing multiple pre-generated art templates, means for providing the user with a list of art templates from the database, means for displaying the art template selected by the user in an edit mode and providing a customization tool, means for receiving the user's template customization operation and generating a preview in real time, means for saving and outputting the customized template, means for generating and displaying an interactive advertisement in real time via smart glasses, and means for enabling the customization tool to be operated using voice commands and touchpad operations, thereby enabling the user to intuitively operate the smart glasses to generate, customize, and display interactive advertisements and art content in real time.

[1750] "User Credentials" means identifying information, such as an email address or password, provided by a User to access a System.

[1751] A "database" is a storage device for storing and managing multiple pre-generated art templates and related information.

[1752] An "art template" is a basic design and layout template that users can freely customize.

[1753] "Customization tools" are a set of functions that allow users to edit and modify templates, including adding text, adding images, and changing colors.

[1754] "Edit mode" is an operation screen that allows the user to change and modify the art template they have selected.

[1755] "Real-time preview" is a preview display of a template that is instantly updated in response to the user's customization operations.

[1756] "Storage" is a feature that allows a user to save customized templates to their account.

[1757] "Output means" is a function for generating and providing customized templates as PDF or image files.

[1758] "Smart glasses" are eyeglass-shaped wearable devices equipped with displays and various sensors that allow users to display and manipulate information in real time.

[1759] "Interactive advertising" refers to advertising content that users can control and customize in real time.

[1760] "Voice commands" are instructions that a user uses to operate the system using voice.

[1761] "Touchpad operation" refers to the method by which a user operates a system using a touchpad.

[1762] The present invention relates to a system that allows users to create and customize interactive art content and advertisements in real time using smart glasses. Specific embodiments are described below.

[1763] System configuration

[1764] Hardware

[1765] 1. Smart glasses: A wearable device in the shape of glasses equipped with a display and various sensors, it displays information in real time and can be operated using voice commands or a touchpad.

[1766] 2. Server: A computer system with a database, generative AI model, and real-time preview generation capabilities.

[1767] software

[1768] 1. Generative AI model: An AI system for automatically generating art templates.

[1769] 2. Server program: Performs user authentication, provides template lists, saves and outputs customized data, etc.

[1770] 3. Smart Glasses App: Users can select and customize templates using voice commands or the touchpad.

[1771] Program processing

[1772] 1. User authentication and initialization

[1773] The user enters their account information on the login screen of the smart glasses and submits a login request.

[1774] The server checks the authentication information against a database, and after successful authentication starts the user's session and loads the configuration information. If authentication fails, it generates an error message and sends it to the smart glasses.

[1775] 2. Providing sample templates

[1776] The server uses a generative AI model to pre-generate various art templates and store them in a sample database.

[1777] When a user sends a template request from their smart glasses, the server provides a list of sample templates.

[1778] 3. Customize the template

[1779] Once a user selects a template, the smart glasses will display it in edit mode, providing customization tools for adding text, adding images, and changing colors.

[1780] Users can customize templates using voice commands or the touchpad, previewing their changes in real time.

[1781] The customization data is sent to the server at any time, and a real-time preview is generated.

[1782] 4. Saving and exporting content

[1783] When the user has finished customizing, they select the "Save" or "Export" option.

[1784] The smart glasses send a save or output request to the server.

[1785] The server saves the customized template, generates it as a PDF or image file, and provides a download link.

[1786] Specific examples

[1787] For example, to create an interactive ad for a new product launch campaign, the following prompt sentences could be input into the generative AI model:

[1788] Prompt Sentence Examples

[1789] Template name: "New product launch campaign"

[1790] Requirements:

[1791] Visually impactful design

[1792] Text fields: "New product name", "Features", "Release date"

[1793] Image field: "New product image"

[1794] Customization Options:

[1795] Color Change

[1796] Text position change

[1797] Change font size

[1798] This invention allows users to intuitively control and generate, customize, and display interactive advertising and art content in real time through smart glasses.

[1799] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1800] Step 1:

[1801] Obtaining and authenticating user credentials

[1802] The user enters their account information (email address, password) on the login screen of the smart glasses and sends a login request.

[1803] Input: Email address, password

[1804] Output: Authentication token, error message (if authentication failed)

[1805] The terminal receives the login information and sends it to the server.

[1806] Input: Login information

[1807] Output: Authentication request

[1808] The server checks the authentication information against a database, and if authentication is successful, starts the session and loads the user's configuration information. If authentication fails, it generates an error message and sends it to the terminal.

[1809] Input: Login information

[1810] Data processing: Matching with database, session generation

[1811] Output: Authentication result, user setting information, error message

[1812] Step 2:

[1813] Providing sample templates

[1814] The user sends a template request from the smart glasses.

[1815] Input: Template request

[1816] Output: Template list

[1817] The terminal relays the template request to the server.

[1818] Input: Template request

[1819] Output: Template list request

[1820] The server retrieves pre-generated art templates from a database, generates a list of templates, and sends it to the terminal.

[1821] Input: Template list request

[1822] Data processing: Obtaining template data and generating lists

[1823] Output: Template list

[1824] Step 3:

[1825] Select and customize a template

[1826] The user selects a template from the provided template list and transmits the selection information to the terminal.

[1827] Input: Template selection information

[1828] Output:Selection Template

[1829] The device will display the selected template in edit mode and provide customization tools (add text, add images, change colors).

[1830] Input:Select Template

[1831] Output: Edit mode screen, customization tools

[1832] Users can customize templates using voice commands or the touchpad, then enter changes into the device.

[1833] Input: Customized instructions (voice commands, touchpad operations)

[1834] Output: Customized operation data

[1835] The terminal transmits customized operation data to the server, and the server generates a real-time preview and transmits it back to the terminal.

[1836] Input: Customized operation data

[1837] Data processing: Real-time preview generation

[1838] Output: Preview screen

[1839] Step 4:

[1840] Saving and exporting customization data

[1841] When the user has finished customizing, they can select the "Save" or "Export" option.

[1842] Input: Save request or Output request

[1843] Output: Save completion notification, download link

[1844] The terminal sends a save request or an output request to the server.

[1845] Input: Save request or Output request

[1846] Output: Save instruction, output instruction

[1847] The server saves the customized template in the user's account, generates it as a PDF or image file if necessary, and provides a download link to the device.

[1848] Input: Customized template data

[1849] Data processing: file creation, link creation

[1850] Output: Save completion notification, download link

[1851] Through these steps, users can intuitively operate the smart glasses to generate, customize, and display interactive advertising and art content in real time.

[1852] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1853] This invention is a system that allows users to intuitively create and customize artistic content, and further incorporates an emotion engine that recognizes the user's emotions and supports operation. Specific embodiments of this system are described below.

[1854] User authentication and initialization

[1855] server

[1856] When a user submits a login request, the server receives authentication information, which includes the user's email address and password. The server compares this with the database and generates an authentication result. If authentication is successful, it starts a user session and loads the user's configuration information. If authentication fails, it generates an error message and sends it to the terminal.

[1857] Terminal

[1858] A login screen for entering authentication information is displayed, and the next operation screen (main menu or error message) is displayed depending on the authentication result.

[1859] User

[1860] Enter your account information to log in to the system.

[1861] Providing sample templates

[1862] server

[1863] A generative AI model is used to pre-generate various art templates and store them in a sample database. When a user submits a template request, the server provides the user with a list of sample templates.

[1864] Terminal

[1865] Displays a list of sample templates for the user to choose from.

[1866] User

[1867] Choose your favorite design from the provided templates.

[1868] User emotion recognition and template customization

[1869] Emotion Engine

[1870] It recognizes the user's emotions in real time from their facial expressions and tone of voice, and sends that information to the server.

[1871] server

[1872] The list of art templates is customized based on the user's emotional information received from the emotion engine. For example, if the user is happy, it will prioritize bright and colorful designs, and if the user is calm, it will prioritize simple and refreshing designs.

[1873] Terminal

[1874] Display a list of customized templates for users to choose from.

[1875] User

[1876] Begin customizing the selected template.

[1877] Terminal

[1878] Displays the selected template in edit mode and provides customization tools such as adding text, adding images, and changing colors.

[1879] User

[1880] Users can customize the template to their liking by adding text and images, changing the color and design, etc. The recommended settings of the customization tool will change based on the user's emotions as determined by the emotion engine.

[1881] server

[1882] The system receives and stores user operation data during customization in real time, and generates and sends a preview of the customization to the device as needed.

[1883] Saving and exporting content

[1884] User

[1885] Once you've finished customizing, select "Save" or "Export."

[1886] Terminal

[1887] Depending on the user's selection, a save or print request is sent to the server.

[1888] server

[1889] The received customized template data is saved in the user's account, and if necessary, it can be output as a PDF or image file, with a download link sent to the device.

[1890] Specific examples

[1891] For example, if a user wants to create a "2023 New Year's card," the specific steps would be as follows:

[1892] 1. The user enters their account information on the login screen and logs in.

[1893] 2. The device receives the user's input and sends the authentication information to the server.

[1894] 3. The server verifies the authentication information, and if authentication is successful, starts the session and loads the configuration information. If authentication fails, it sends an error message to the terminal.

[1895] 4. The user clicks the "Choose Template" button and a template request is sent to the server.

[1896] 5. The server sends the sample template list to the terminal, which displays it.

[1897] 6. The emotion engine analyzes the user's facial expressions and tone of voice to determine that the user is relaxed.

[1898] 7. The server prioritizes templates that match the relaxed state and places them at the top of the list, then sends them to the terminal.

[1899] 8. The user selects the "2023 New Year's Card" template and sends the selection information to the server.

[1900] 9. The server sends the template data to the terminal, and the terminal displays the template in edit mode.

[1901] 10. Users customize the template by adding text, uploading images, and changing the background color. Based on the sentiment engine, text font and color recommendations are provided.

[1902] 11. The server receives the customization operation data, generates a preview in real time, and sends it to the terminal.

[1903] 12. When the user has finished customizing, they click the "Save" button and the device sends a save request to the server.

[1904] 13. The server saves the customized template, generates output files if necessary, and sends download links.

[1905] This system provides optimal templates and customization tool settings based on the user's emotions, allowing them to create high-quality art content more comfortably.

[1906] The processing flow will be explained below.

[1907] Program processing steps

[1908] 1. User authentication and initialization

[1909] Step 1:

[1910] The user enters their email address and password on the login screen and clicks the "Login" button.

[1911] Step 2:

[1912] The terminal receives the entered authentication information and sends it to the server.

[1913] Step 3:

[1914] The server compares the received authentication information with the database and generates an authentication result.

[1915] If authentication is successful, it starts a user session and loads the user configuration information.

[1916] If authentication fails, an error message is generated.

[1917] Step 4:

[1918] The server sends the authentication result to the terminal.

[1919] Step 5:

[1920] The terminal receives the authentication result, and if successful, displays the main menu screen, or if unsuccessful, displays a pop-up error message.

[1921] 2. Providing sample templates

[1922] Step 1:

[1923] The server uses a generative AI model to pre-generate various art templates and store them in a sample database.

[1924] Step 2:

[1925] The user clicks the "Choose a template" button on the main menu screen.

[1926] Step 3:

[1927] The device sends a template request to the server.

[1928] Step 4:

[1929] The server retrieves the template list from the sample database and sends it to the terminal.

[1930] Step 5:

[1931] The terminal displays the template list received from the server on the screen.

[1932] Step 6:

[1933] The emotion engine analyzes the user's facial expressions and tone of voice and transmits the user's emotional state to the server.

[1934] Step 7:

[1935] The server customizes the template list based on the user's emotional information received (e.g., preferentially displaying simple designs to users in a relaxed state).

[1936] Step 8:

[1937] The device will redisplay the customized template list on the screen.

[1938] Step 9:

[1939] The user clicks on a template of their choice from the displayed list of templates and sends the selected template ID to the server.

[1940] 3. Customize the template

[1941] Step 1:

[1942] The server transmits the selected template data to the terminal.

[1943] Step 2:

[1944] The device will display the template in edit mode and provide customization tools such as adding text, adding images, and changing colors.

[1945] Step 3:

[1946] An emotion engine analyzes a user's facial expressions and tone of voice to recommend settings for customization tools based on their emotional state (e.g., recommending bright colors if they are happy).

[1947] Step 4:

[1948] A user edits the template using the customization tools.

[1949] Add text: Enter your message in the text box and adjust the position.

[1950] Image Adding Operation: Upload an image and adjust its size and position.

[1951] Color change operations: Select background and text colors.

[1952] Step 5:

[1953] The terminal transmits the user's customized operation data to the server in real time.

[1954] Step 6:

[1955] The server sequentially stores the received customization operation data, generates preview data in real time, and transmits it to the terminal.

[1956] Step 7:

[1957] Your device will display your edits in real time in a preview window.

[1958] 4. Saving and exporting content

[1959] Step 1:

[1960] When the user has finished customizing, he clicks the "Save" or "Export" button.

[1961] Step 2:

[1962] The terminal sends a save request or an output request to the server.

[1963] Step 3:

[1964] The server stores the received customized template data in the user's account.

[1965] Step 4:

[1966] The server generates the customized template as a PDF or image file.

[1967] Step 5:

[1968] The server sends a download link for the generated output file to your device.

[1969] Step 6:

[1970] The device displays the download link to the user.

[1971] Step 7:

[1972] The user clicks the download link to download the customized art content.

[1973] In this way, the optimal template and customization tool settings are provided according to the user's emotions, enabling the creation of more comfortable, high-quality art content.

[1974] Example 2

[1975] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1976] Previous art content generation systems provided templates without considering user emotions and lacked intuitive customization features. Furthermore, they lacked real-time operation data saving and preview generation, resulting in a poor user experience. Furthermore, the template output formats were limited, making it difficult to meet diverse user needs.

[1977] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1978] In this invention, the server includes means for acquiring and authenticating user authentication information, a database for storing a plurality of pre-generated content templates, means for providing the user with a list of content templates from the database, means for displaying the content template selected by the user in an edit mode and providing a customization tool, means for recognizing emotions from the user's facial expressions and tone of voice and customizing the list of content templates based thereon, means for receiving template customization operations performed by the user and generating previews in real time, and means for saving and outputting customized templates. This makes it possible to provide optimal templates based on the user's emotions and to perform intuitive and efficient customization work.

[1979] "User authentication information" refers to information such as an email address and password used to authenticate a user's personal information.

[1980] "Multiple pre-generated content templates" refers to a group of templates with diverse designs that have been pre-generated by a generative AI model.

[1981] A database is a system that systematically organizes and stores information, making it easy to access and manage.

[1982] The "content template list" is a list of multiple templates that the user can select from.

[1983] "Edit mode" means that the user can freely customize the template.

[1984] "Customization Tools" means a set of tools that a User can use to edit a Template, including adding text, adding images, changing colors, etc.

[1985] "Emotion recognition" means analyzing the user's facial expressions and tone of voice to determine their emotions at that time.

[1986] "Generating a preview in real time" means displaying changes immediately in response to user actions.

[1987] A "customized template" is a template that has been edited and customized by a user.

[1988] "Output means" is a function for saving and providing customized templates in formats such as PDF or image files.

[1989] MODE FOR CARRYING OUT THE INVENTION

[1990] This invention is a system that allows users to intuitively create and customize artistic content, and further incorporates an emotion engine that recognizes the user's emotions and assists in operation. A series of processes is provided that allows users to log in, select a template, customize it, and finally save or output it. A specific embodiment of this system is described below.

[1991] User authentication and initialization

[1992] server

[1993] When a user submits a login request, the server receives the authentication information (email address and password) and checks it against a database (e.g., MySQL). If authentication is successful, the server starts a session for the user and loads the configuration information. If authentication fails, it generates an error message and sends it to the terminal as an HTTP response.

[1994] Terminal

[1995] The terminal displays a login screen and provides fields for the user to enter their email address and password. When the user enters the authentication information and clicks the "Login" button, the terminal sends the authentication information to the server. Upon receiving the authentication result, the terminal displays the main menu screen if successful, or an error message if unsuccessful.

[1996] User

[1997] The user enters their email address and password on the login screen and clicks the "Login" button.

[1998] Providing sample templates

[1999] server

[2000] A generative AI model (e.g., GPT-3) is used to pre-generate a variety of art templates and store them in a sample database. When a user submits a template request, the server generates a list of sample templates and sends them to the device as an HTTP response.

[2001] Terminal

[2002] The device displays a list of sample templates received from the server, with thumbnail images and descriptions displayed on the interface to help the user select a template.

[2003] User

[2004] Users can select their favorite design from the sample templates displayed.

[2005] User emotion recognition and template customization

[2006] Emotion Engine

[2007] The emotion engine analyzes the user's facial expressions and tone of voice in real time. For this analysis, OpenCV and Emotion SDK are used, for example. The emotion engine sends the analysis results to the server.

[2008] server

[2009] The server customizes the list of art templates based on the emotion data received from the emotion engine. For example, if the user is happy, it prioritizes bright and colorful designs. It generates the customized template list and sends it to the device as an HTTP response.

[2010] Terminal

[2011] It displays a list of customized templates for users to choose from, and after users select a template, it switches them into edit mode and provides customization tools (add text, add images, change colors, etc.).

[2012] User

[2013] Users select a template and customize it by adding text and images, changing colors and fonts, etc., guided by the tool's recommended settings based on an emotion engine.

[2014] Saving and exporting content

[2015] User

[2016] Once the user has completed customization, they click the "Save" or "Export" button.

[2017] Terminal

[2018] The terminal sends a save request or an output request to the server in response to the user's click.

[2019] server

[2020] The server saves the received customized template data in the user's account, using a database such as MongoDB. If output is selected, the server outputs the data as a PDF or image file, generates a download link, and sends it to the terminal as an HTTP response.

[2021] Specific examples

[2022] For example, if a user wants to create a "2023 New Year's card," the process would be as follows:

[2023] 1. The user enters their email address and password on the login screen to log in.

[2024] 2. The terminal sends authentication information to the server, the server performs authentication, and if successful, the session starts and the main menu is displayed on the terminal.

[2025] 3. The user clicks the "Choose a template" button in the main menu, and a template request is sent to the server.

[2026] 4. The server generates a sample template list, which the terminal displays.

[2027] 5. The emotion engine analyzes the user's facial expressions and tone of voice and determines that they are relaxed.

[2028] 6. The server places the template suitable for the relaxed state at the top of the list and sends it to the terminal.

[2029] 7. The user selects the "2023 New Year's Card" template and sends the selection information to the server.

[2030] 8. The server sends the template data to the terminal, and the terminal displays the template in edit mode.

[2031] 9. Users customize the template by adding text, uploading images, and changing the background color. Recommendations are provided based on the sentiment engine.

[2032] 10. The server receives the customization operation data in real time, generates a preview, and sends it to the device.

[2033] 11. The user finishes customizing and clicks the "Save" or "Export" button.

[2034] 12. The device sends a save or output request to the server.

[2035] 13. The server saves the customized template, generates the output as a PDF or image file, and sends a download link.

[2036] Prompt Sentence Examples

[2037] I want to choose a template based on the theme "New Year's Cards 2023." If the user has a happy expression, what design would you recommend?

[2038] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2039] Step 1: User authentication and initialization

[2040] server

[2041] A login request is received from the user. The input data is an email address and password. The server compares this authentication information with the information in the database and generates an authentication result. If successful, a session is started and the user's configuration information is loaded. If unsuccessful, an error message is generated and sent to the terminal as an HTTP response.

[2042] Terminal

[2043] The device displays a login screen for entering an email address and password. When the user enters the authentication information and clicks the "Login" button, the data is sent to the server. The device receives the authentication result from the server, and if successful, displays the main menu screen, otherwise displays an error message.

[2044] User

[2045] The user enters their email address and password on the login screen and clicks the "Login" button.

[2046] Step 2: Provide a sample template

[2047] server

[2048] A variety of pre-generated art templates are stored in a sample database using a generative AI model (e.g., GPT-3). When a user sends a template request, the server generates a list of sample templates and sends it to the device as an HTTP response. The data input is the user request, and the output is the template list.

[2049] Terminal

[2050] The device displays a list of sample templates received from the server, with thumbnail images and descriptions displayed on the interface to help the user select a template.

[2051] User

[2052] Users can select their favorite design from the sample templates displayed.

[2053] Step 3: User Emotion Recognition and Template Customization

[2054] Emotion Engine

[2055] It analyzes the user's facial expressions and tone of voice in real time. The input is video and audio data from the user. The analysis is performed using OpenCV or Emotion SDK, for example, and the analysis results are sent to the server.

[2056] server

[2057] The server customizes the list of art templates based on the emotion data received from the emotion engine. The input is emotion data, and the output is the customized template list. For example, for a happy emotion, it prioritizes bright and colorful designs. It sends the customized template list to the terminal as an HTTP response.

[2058] Terminal

[2059] It displays a list of customized templates for users to choose from, and after users select a template, it switches them into edit mode and provides customization tools (add text, add images, change colors, etc.).

[2060] User

[2061] Users select a template and customize it by adding text and images, changing colors and fonts, etc., guided by the tool's recommended settings based on an emotion engine.

[2062] Step 4: Save and export content

[2063] User

[2064] Once the user has completed customization, they click the "Save" or "Export" button.

[2065] Terminal

[2066] The terminal sends a save request or an output request to the server in response to the user's click.

[2067] server

[2068] The server saves the received customized template data in the user's account. The input is the customized template data, and the storage destination is a database (e.g., MongoDB). If output is selected, it outputs it as a PDF or image file, generates a download link, and sends it to the terminal as an HTTP response.

[2069] (Application example 2)

[2070] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2071] Conventional art content generation systems lack intuitive template selection and customization functions that take user emotions into account, making it difficult for users to find the design that best suits them. Furthermore, they do not provide real-time previews of customization operations or recommended settings based on emotion information, which makes it difficult to improve the user experience.

[2072] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring and authenticating user authentication information, a database that stores a plurality of pre-generated art templates, means for providing the user with a list of art templates from the database, means for recognizing the user's emotion and customizing the list of art templates based on the emotion information, means for displaying the art template selected by the user in an edit mode and providing a customization tool, means for receiving the user's template customization operation and generating a preview in real time, and means for saving and outputting the customized template. This makes it easier for users to select the optimal template based on their emotion, enabling them to intuitively and efficiently generate and customize art content.

[2073] "User Credentials" means information required to identify a user and grant access to a system.

[2074] A "database" is an information management system for storing a plurality of pre-generated art templates.

[2075] "Emotional information" is data about the user's emotional state obtained from facial expressions, tone of voice, etc.

[2076] "Edit mode" is an operating environment for customizing a user-selected art template.

[2077] The "Customization Tools" are a set of functions for editing art templates, such as adding text, adding images, changing colors, and recommending settings based on emotional information.

[2078] "Preview" is a display means for visually checking the results of customization operations performed by the user in real time.

[2079] "Storage" is a function that allows users to record customized templates so that they can be reused later.

[2080] The "output means" is a function for generating a customized template as a digital file and providing it to the user.

[2081] This invention provides a system for acquiring and authenticating user authentication information, providing multiple art templates, and customizing the template list based on the user's emotional information. The system displays the user-selected art template in an edit mode, provides customization tools, generates a real-time preview, and saves and outputs the customized template. Specific embodiments are described below.

[2082] System Configuration

[2083] 1. User authentication and initialization

[2084] server

[2085] When a user submits a login request, the server receives user authentication information, which includes the user's email address and password. This information is compared with the database to generate an authentication result. If authentication is successful, a user session is started and configuration information is loaded. The software used is Flask and SQLite.

[2086] Terminal

[2087] The terminal displays a login screen for inputting authentication information, and displays an operation screen (main menu or error message) according to the authentication result.

[2088] User

[2089] The user logs into the system by entering their account information.

[2090] 2. Providing sample templates

[2091] server

[2092] The server uses a generative AI model to pre-generate various art templates and stores them in a sample database. When a user submits a template request, the server provides a list of templates.

[2093] Terminal

[2094] The terminal displays a list of sample templates for the user to choose from.

[2095] User

[2096] Users can choose their favorite design from a list of templates.

[2097] 3. User emotion recognition and template customization

[2098] Emotion Engine

[2099] The emotion engine recognizes emotions from the user's facial expressions and tone of voice in real time and sends that information to the server. The library used is EmotionEngine.

[2100] server

[2101] The server customizes the art template list based on the user's emotional information received from the emotion engine. For example, if the user is happy, it will prioritize bright and colorful designs, and if the user is calm, it will prioritize simple and refreshing designs.

[2102] Terminal

[2103] The device will display a list of customized templates for the user to choose from.

[2104] User

[2105] The user initiates a customization operation on the selected template.

[2106] Terminal

[2107] The terminal displays the selected template in edit mode and provides customization tools such as adding text, adding images, and changing colors.

[2108] User

[2109] Users can customize the templates to their liking by adding text and images, changing colors and designs, etc. The recommended settings in the customization tool are changed based on the emotions determined by the emotion engine.

[2110] server

[2111] The server receives user operation data during customization at any time, generates a preview in real time, and sends it to the device.

[2112] 4. Saving and exporting content

[2113] User

[2114] Once the user has finished customizing, they can select "Save" or "Export."

[2115] Terminal

[2116] The terminal sends a save request or an output request to the server depending on the user's selection.

[2117] server

[2118] The server stores the received customized template data in the user's account, generates digital files as needed, and sends download links to the device.

[2119] Specific examples

[2120] For example, consider a user creating a "2023 New Year's card." The user enters account information on the login screen and logs in. The device receives the user's input and sends authentication information to the server. The server verifies the authentication information, and if authentication is successful, starts a session and loads the configuration information. If authentication fails, an error message is sent to the device.

[2121] Next, the user clicks the "Choose a template" button, and a template request is sent to the server. The server sends a list of sample templates to the device, which displays them. The emotion engine analyzes the user's facial expressions and tone of voice to detect their state of relaxation. The server prioritizes templates that match that state to the top of the list and sends them to the device. The user selects the "2023 New Year's Card" template and sends the selection information to the server. The server sends the template data to the device, and the device displays the template in edit mode.

[2122] Users customize templates by adding text, uploading images, and changing background colors. Based on the emotion engine, the server receives the customization data, generates a real-time preview, and sends it to the device.

[2123] When the user finishes customization, they click the "Save" button and the device sends a save request to the server. The server saves the customized template, generates the output file if necessary, and sends a download link. The prompt message "We will suggest an art template that matches your emotion. Please turn on the camera, relax, and wait." will be displayed.

[2124] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2125] Step 1:

[2126] The server receives user authentication information (email address and password). The input is user information, which is checked against a database to generate an authentication result. If authentication is successful, a session is started and configuration information is loaded. The output is the authentication result (success or failure).

[2127] Step 2:

[2128] The terminal displays a login screen and the user enters authentication information. The input is the user's email address and password, which are then prepared to be sent to the server. The output is the execution of the authentication information transmission.

[2129] Step 3:

[2130] The server verifies the authentication information and sends the authentication result to the terminal. The input is the user's authentication information, which is verified against the database to generate an authentication result (success or failure). The output is the authentication result (session ID if successful).

[2131] Step 4:

[2132] The terminal displays the following screen based on the authentication result. The input is the authentication result received from the server, and if successful, the main menu is displayed, or if unsuccessful, an error message is displayed. The output is the display content (main menu or error message).

[2133] Step 5:

[2134] The user issues a template request. The input is the user's operation, which sends a request to the terminal to display the art template list. The output is the template request.

[2135] Step 6:

[2136] The server uses the generative AI model to generate a template list and sends it to the device. The input is a template request, and the generative AI model generates a template list to create a template list tailored to the user. The output is the template list.

[2137] Step 7:

[2138] The terminal displays a template list. The input is the template list sent from the server and displayed for the user to select. The output is the displayed template list.

[2139] Step 8:

[2140] The emotion engine recognizes emotional information from the user's facial expressions and tone of voice in real time and sends that information to the server. The input is the user's facial expressions and voice data, which is analyzed to generate emotional information. The output is emotional information.

[2141] Step 9:

[2142] The server customizes the template list based on emotional information and displays templates that match the emotional state with priority. The input is emotional information, and the template list is processed to match the emotional state. The output is the customized template list.

[2143] Step 10:

[2144] The terminal displays the customized template list. The input is the customized template list sent from the server, allowing the user to select a more appropriate template. The output is the displayed customized template list.

[2145] Step 11:

[2146] The user selects a template and begins customization. The input is the template selection operation, and the selection information is sent to the terminal. The output is the selected template.

[2147] Step 12:

[2148] The device displays the selected template in edit mode and provides customization tools such as adding text, adding images, and changing colors. The input is the selected template, which is displayed for the user to edit. The output is the template displayed in edit mode.

[2149] Step 13:

[2150] The user customizes a template. The input is the operation of the customization tool, adding text, images, changing colors, etc. The output is the customized template.

[2151] Step 14:

[2152] The emotion engine changes the recommended settings of the customization tool based on the user's emotional information during the customization operation. The input is the user's facial expression and voice data, which is analyzed to generate emotional information and adjust the settings of the customization tool. The output is recommended settings based on the emotional information.

[2153] Step 15:

[2154] The server receives the customization operation data, generates a real-time preview, and sends it to the terminal. The input is the customization operation data, and the real-time preview is generated based on the data. The output is a preview image.

[2155] Step 16:

[2156] When the user finishes customization, they select "Save" or "Output." Input is the user's operation, which sends a save or output request to the terminal. Output is the save or output request.

[2157] Step 17:

[2158] The terminal sends a save or output request to the server. The input is the save or output request, which it prepares to send to the server. The output is the sending of the request.

[2159] Step 18:

[2160] The server receives the customized template data, stores it in the user's account, generates a digital file as needed, and sends a download link to the device. The input is the customized template data, which is saved and output as a file. The output is the saved data and a download link.

[2161] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2162] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2163] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2164] [Fourth embodiment]

[2165] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2166] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2167] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2168] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2169] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2170] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2171] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2172] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2173] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2174] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2175] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2176] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2177] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2178] This invention is a system that allows users to intuitively create and customize artistic content. It is designed especially for users who want to easily create artistic content such as New Year's cards and postcards. Specific embodiments of this system are described below.

[2179] User authentication and initialization

[2180] server

[2181] When a user submits a login request, the server receives authentication information, which includes the user's email address and password. The server checks this against a database, and if authentication is successful, it starts a session for the user and loads the user's configuration information. If authentication fails, it generates an error message and sends it to the terminal.

[2182] Terminal

[2183] A login screen for entering authentication information is displayed, and the next operation screen (main menu or error message) is displayed depending on the authentication result.

[2184] User

[2185] Enter your account information to log in to the system.

[2186] Providing sample templates

[2187] server

[2188] A generative AI model is used to pre-generate various art templates and store them in a sample database. When a user submits a template request, the server provides the user with a list of sample templates.

[2189] Terminal

[2190] Displays a list of sample templates for the user to choose from.

[2191] User

[2192] Choose your favorite design from the provided templates.

[2193] Customizing the template

[2194] Terminal

[2195] Displays the selected template in edit mode and provides customization tools such as adding text, adding images, and changing colors.

[2196] User

[2197] Customize templates to your liking by adding text and images, changing colors and designs, etc. Work while checking the preview as you make changes.

[2198] server

[2199] The system receives and stores user operation data during customization in real time, and generates and sends a preview of the customization to the device as needed.

[2200] Saving and exporting content

[2201] User

[2202] Once you've finished customizing, select "Save" or "Export."

[2203] Terminal

[2204] Depending on the user's selection, a save or print request is sent to the server.

[2205] server

[2206] The received customized template data is saved in the user's account, and if necessary, it can be output as a PDF or image file and a download link sent to the device.

[2207] Specific examples

[2208] For example, if a user wants to create a "2023 New Year's card," the specific steps would be as follows:

[2209] 1. The user enters their account information on the login screen and logs in.

[2210] 2. The device receives the user's input and sends the authentication information to the server.

[2211] 3. The server verifies the authentication information, and if authentication is successful, starts the session and loads the configuration information. If authentication fails, it sends an error message to the terminal.

[2212] 4. The user clicks the "Choose Template" button and a template request is sent to the server.

[2213] 5. The server sends the sample template list to the terminal, which displays it.

[2214] 6. The user selects the "2023 New Year's Card" template and sends the selection information to the server.

[2215] 7. The server sends the template data to the terminal, and the terminal displays the template in edit mode.

[2216] 8. Users can customize the template by adding text, uploading images, and changing the background color.

[2217] 9. The server receives the customization operation data, generates a preview in real time, and sends it to the device.

[2218] 10. When the user has finished customizing, they click the "Save" button and the device sends a save request to the server.

[2219] 11. The server saves the customized template, generates output files if necessary, and sends download links.

[2220] This system allows even users who are unfamiliar with digital technology to easily create high-quality New Year's cards and postcards.

[2221] The processing flow will be explained below.

[2222] Program processing steps

[2223] 1. User authentication and initialization

[2224] Step 1:

[2225] The user enters their email address and password on the login screen and clicks the "Login" button.

[2226] Step 2:

[2227] The terminal receives the entered authentication information and sends it to the server.

[2228] Step 3:

[2229] The server compares the received authentication information with the database and generates an authentication result.

[2230] If authentication is successful, it starts a user session and loads the user configuration information.

[2231] If authentication fails, an error message is generated.

[2232] Step 4:

[2233] The server sends the authentication result to the terminal.

[2234] Step 5:

[2235] The terminal receives the authentication result, and if successful, displays the main menu screen, or if unsuccessful, displays a pop-up error message.

[2236] 2. Providing sample templates

[2237] Step 1:

[2238] The server uses a generative AI model to pre-generate various art templates and store them in a sample database.

[2239] Step 2:

[2240] The user clicks the "Choose a template" button on the main menu screen.

[2241] Step 3:

[2242] The device sends a template request to the server.

[2243] Step 4:

[2244] The server retrieves the template list from the sample database and sends it to the terminal.

[2245] Step 5:

[2246] The terminal displays the template list received from the server on the screen.

[2247] Step 6:

[2248] The user clicks on a template of their choice from the displayed list of templates and sends the selected template ID to the server.

[2249] 3. Customize the template

[2250] Step 1:

[2251] The server transmits the selected template data to the terminal.

[2252] Step 2:

[2253] The device will display the template in edit mode and provide customization tools such as adding text, adding images, and changing colors.

[2254] Step 3:

[2255] A user edits the template using the customization tools.

[2256] Add text: Enter your message in the text box and adjust the position.

[2257] Image Adding Operation: Upload an image and adjust its size and position.

[2258] Color change operations: Select background and text colors.

[2259] Step 4:

[2260] The terminal transmits the user's customized operation data to the server in real time.

[2261] Step 5:

[2262] The server sequentially stores the received customization operation data, generates preview data in real time, and transmits it to the terminal.

[2263] Step 6:

[2264] Your device will display your edits in real time in a preview window.

[2265] 4. Saving and exporting content

[2266] Step 1:

[2267] When the user has finished customizing, he clicks the "Save" or "Export" button.

[2268] Step 2:

[2269] The terminal sends a save request or an output request to the server.

[2270] Step 3:

[2271] The server stores the received customized template data in the user's account.

[2272] Step 4:

[2273] The server generates the customized template as a PDF or image file.

[2274] Step 5:

[2275] The server sends a download link for the generated output file to your device.

[2276] Step 6:

[2277] The device displays the download link to the user.

[2278] Step 7:

[2279] The user clicks the download link to download the customized art content.

[2280] This allows users to easily and intuitively create, save, and output high-quality art content.

[2281] Example 1

[2282] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2283] There is a demand for systems that allow even users unfamiliar with digital technology to easily create high-quality artistic content such as New Year's cards and postcards. However, existing systems tend to be complex to use, as template selection and customization are not intuitive. Furthermore, real-time preview generation and template saving and output often do not work smoothly, making it difficult to improve the user experience.

[2284] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2285] In this invention, the server includes means for acquiring and authenticating user authentication information, a database storing multiple pre-generated art templates, means for providing the user with a list of art templates from the database, means for displaying the art template selected by the user in edit mode and providing customization tools such as adding text, images, and changing colors, means for pre-generating the art template using a generative AI model, means for receiving the user's template customization operations and generating a preview in real time, and means for saving and outputting the customized template. This allows users to intuitively select and customize art templates and proceed with their work while viewing a preview in real time. Furthermore, the ability to easily save and output customized templates is expected to improve the user experience.

[2286] "User authentication information" refers to information such as an email address and password required by a user to access a system.

[2287] "Art templates" are pre-created graphical templates that contain design elements for New Year's cards, postcards, etc.

[2288] A "database" is a system that systematically stores and manages data such as templates and user information.

[2289] "Customization Tool" means a software tool that provides functionality for a User to edit and modify Templates.

[2290] A "generative AI model" is an algorithm or technology that uses artificial intelligence to generate art templates in advance.

[2291] "Preview" is a feature that allows users to visually check the results of their customizations in real time.

[2292] "Means for saving" is a function that allows a user to save a customized template in a database or the like.

[2293] "Means of output" is a function that generates customized templates as PDF or image files and allows users to download them.

[2294] This invention is a system that allows users to intuitively create and customize artistic content such as New Year's cards and postcards. The system is mainly composed of three elements: a server, a terminal, and a user.

[2295] User authentication and initialization

[2296] server

[2297] When a user submits a login request, the server receives authentication information (email address and password). The server compares this information with the database and determines the authentication result. If authentication is successful, the server starts a user session, loads configuration information, and sends it to the terminal. If authentication fails, an error message is generated and sent to the terminal.

[2298] Terminal

[2299] The terminal provides a login screen for the user to enter information and displays the main menu or an error message depending on the authentication result.

[2300] User

[2301] The user logs into the system by entering account information.

[2302] Providing sample templates

[2303] server

[2304] The server uses a generative AI model to pre-generate various art templates and stores them in a sample database. When a user submits a template request, the server provides a list of sample templates to the device.

[2305] Terminal

[2306] The terminal displays a list of sample templates for the user to choose from.

[2307] User

[2308] The user selects their preferred design from the provided templates.

[2309] Customizing the template

[2310] Terminal

[2311] The terminal displays the selected template in an edit mode and provides customization tools such as means for adding text, adding images, and changing colors.

[2312] User

[2313] Users can customize templates to their liking by adding text and images, changing colors and designs, etc. They can proceed while checking a preview as they make each customization.

[2314] server

[2315] The server receives user operation data during customization at any time, generates a preview in real time, and sends it to the device.

[2316] Saving and exporting content

[2317] User

[2318] When the user has finished customizing, he clicks the "Save" or "Export" button.

[2319] Terminal

[2320] The terminal sends a save request or an output request to the server depending on the user's selection.

[2321] server

[2322] The server then saves the customized template data to the user's account, and optionally outputs it as a PDF or image file, providing a download link to the device.

[2323] Specific examples

[2324] For example, if a user wants to create a "2023 New Year's card," the flow would be as follows:

[2325] 1. The user enters their email address and password to log in.

[2326] 2. The device sends authentication information to the server, and the server performs authentication.

[2327] 3. After successful authentication, the server loads the user's configuration information and sends it to the terminal.

[2328] 4. The user clicks the template selection button, sending a template request to the server.

[2329] 5. The server retrieves the sample template list and sends it to the terminal.

[2330] 6. The user selects the "2023 New Year's Card" template, and the device sends the selection information to the server.

[2331] 7. The server sends the template data to the terminal, and the terminal displays the template in edit mode.

[2332] 8. Users can add text, upload images and change background colors.

[2333] 9. The server receives the customization operations in real time, generates a preview, and sends it to the device.

[2334] 10. The user finishes their work and clicks the "Save" button.

[2335] 11. The device sends a save request to the server, and the server saves the customized template to the user's account.

[2336] 12. If necessary, the server generates the output file and provides a download link to the device.

[2337] This system allows even users who are unfamiliar with digital technology to easily create high-quality New Year's cards and postcards.

[2338] Examples of prompt statements

[2339] Example prompt for creating a "2023 New Year's card":

[2340] "Generate an art template for a 2023 New Year's card"

[2341] "Please use red and gold as the main colors and include an illustration of the animal of the Chinese zodiac."

[2342] "Please add a background that gives off a New Year's atmosphere."

[2343] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2344] Program processing steps

[2345] User authentication and initialization

[2346] Step 1:

[2347] The user enters their email address and password on the login screen.

[2348] Input: Email address, Password

[2349] Output: None

[2350] Specific behavior: The user enters account information into the form and clicks the login button.

[2351] Step 2:

[2352] The terminal transmits the entered authentication information to the server.

[2353] Input: Email address, Password

[2354] Output: Request to server

[2355] Specific operation: The device obtains user input and sends it to the server as a POST request.

[2356] Step 3:

[2357] The server checks the authentication information against a database and determines the authentication result.

[2358] Input: Authentication information (email address, password)

[2359] Output: Authentication result (success / failure), configuration information or error message

[2360] What happens: The server performs a database query to verify the authentication information.

[2361] Step 4:

[2362] The terminal receives the response from the server and displays the next screen depending on the authentication result.

[2363] Input: Authentication result, setting information or error message

[2364] Output: Display of main menu or error message

[2365] Specific operation: If authentication is successful, the main menu screen will be displayed; if unsuccessful, an error message will be displayed.

[2366] Providing sample templates

[2367] Step 5:

[2368] The user clicks the "Choose a template" button from the main menu.

[2369] Input: Button click event

[2370] Output: Template request

[2371] Specific behavior: The user clicks a button, sending a template request to the device.

[2372] Step 6:

[2373] The device sends a template request to the server.

[2374] Input: User request

[2375] Output: A template request to the server

[2376] Specific operation: The device sends a request to the server.

[2377] Step 7:

[2378] The server retrieves pre-generated art templates from a sample database using a generative AI model.

[2379] Input: Template request

[2380] Output: Art template list

[2381] What happens next: The server performs a database query to retrieve a list of sample templates.

[2382] Step 8:

[2383] The server sends the template list to the terminal.

[2384] Input: Art template list

[2385] Output: Send template list

[2386] Specific operation: The server returns the template list to the terminal.

[2387] Step 9:

[2388] The terminal displays a list of templates for the user to select.

[2389] Input: Template list

[2390] Output: Display the template list

[2391] Specific behavior: The device displays a list of templates and provides a UI for selection.

[2392] Customizing the template

[2393] Step 10:

[2394] The user selects a template of their choice from the displayed template list.

[2395] Input: Template selection information

[2396] Output: Sends selected information to the terminal

[2397] Specific behavior: The user clicks on a template and the selection information is sent to the device.

[2398] Step 11:

[2399] The terminal transmits the selection information to the server.

[2400] Input: Template selection information

[2401] Output: Request to server

[2402] Specific operation: The terminal sends the selection information to the server.

[2403] Step 12:

[2404] The server transmits the selected template data to the terminal.

[2405] Input: Selection information

[2406] Output: Template data

[2407] Specific operation: The server retrieves the selected template from the database and sends it to the terminal.

[2408] Step 13:

[2409] The device displays the template in edit mode, providing the means to add text, add images, and change colors.

[2410] Input: Template data

[2411] Output: Edit screen

[2412] What it does: The device displays the template on the screen along with editing tools.

[2413] Step 14:

[2414] Users can add text and images to templates and change the colors and design.

[2415] Input: Customization instructions

[2416] Output: Customization data

[2417] Specific actions: User enters text, uploads an image, or changes a color.

[2418] Step 15:

[2419] The terminal sends various customization operations to the server.

[2420] Input: Customization data

[2421] Output: Request to server

[2422] Specific operation: The device sends the user's customization operations to the server at any time.

[2423] Step 16:

[2424] The server receives the customization operation data in real time, generates a preview image, and transmits it to the terminal.

[2425] Input: Customization data

[2426] Output: Preview image

[2427] Specific operation: The server generates a preview image in real time and sends it to the device.

[2428] Step 17:

[2429] The device will display a preview image, allowing the user to see the results of the customization.

[2430] Input: Preview image

[2431] Output: Preview

[2432] Specific behavior: The device displays a preview image on the screen for the user to review.

[2433] Saving and exporting content

[2434] Step 18:

[2435] When the user has finished customizing, he clicks the "Save" or "Export" button.

[2436] Input: Button click event

[2437] Output: Save or output request

[2438] Specific action: The user clicks the save or print button.

[2439] Step 19:

[2440] The terminal sends a save request or an output request to the server.

[2441] Input: Request

[2442] Output: Request to server

[2443] Specific operation: The terminal sends a user request to the server.

[2444] Step 20:

[2445] The server stores the received customized template data in the user's account.

[2446] Input: Customized template data

[2447] Output: Data storage

[2448] Specific behavior: The server saves the template in the database.

[2449] Step 21:

[2450] The server outputs the customized template as a PDF or image file as needed and sends a download link to the device.

[2451] Input: Customized template data

[2452] Output: Output file, download link

[2453] Specific operation: The server generates the output file and sends a download link to the device.

[2454] Step 22:

[2455] The device displays a download link to the user, and the user downloads the required file.

[2456] Input: Download link

[2457] Output: Downloadable link displayed

[2458] What happens: The device displays a link, allowing the user to download the file.

[2459] (Application example 1)

[2460] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2461] Conventional art content generation systems typically involve selecting and customizing templates using a PC or smartphone. However, these methods tend to be limited by location and time, making them inconvenient, especially when intuitive operation is desired in a brick-and-mortar store or on the go. Furthermore, the advertising industry is seeking systems that can create and display interactive advertisements in real time, but current systems cannot meet these requirements. This invention aims to solve these issues and provide a system that allows users to intuitively create, customize, and display interactive art content and advertisements anywhere via smart glasses.

[2462] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2463] In this invention, the server includes means for acquiring and authenticating user authentication information, a database storing multiple pre-generated art templates, means for providing the user with a list of art templates from the database, means for displaying the art template selected by the user in an edit mode and providing a customization tool, means for receiving the user's template customization operation and generating a preview in real time, means for saving and outputting the customized template, means for generating and displaying an interactive advertisement in real time via smart glasses, and means for enabling the customization tool to be operated using voice commands and touchpad operations, thereby enabling the user to intuitively operate the smart glasses to generate, customize, and display interactive advertisements and art content in real time.

[2464] "User Credentials" means identifying information, such as an email address or password, provided by a User to access a System.

[2465] A "database" is a storage device for storing and managing multiple pre-generated art templates and related information.

[2466] An "art template" is a basic design and layout template that users can freely customize.

[2467] "Customization tools" are a set of functions that allow users to edit and modify templates, including adding text, adding images, and changing colors.

[2468] "Edit mode" is an operation screen that allows the user to change and modify the art template they have selected.

[2469] "Real-time preview" is a preview display of a template that is instantly updated in response to the user's customization operations.

[2470] "Storage" is a feature that allows a user to save customized templates to their account.

[2471] "Output means" is a function for generating and providing customized templates as PDF or image files.

[2472] "Smart glasses" are eyeglass-shaped wearable devices equipped with displays and various sensors that allow users to display and manipulate information in real time.

[2473] "Interactive advertising" refers to advertising content that users can control and customize in real time.

[2474] "Voice commands" are instructions that a user uses to operate the system using voice.

[2475] "Touchpad operation" refers to the method by which a user operates a system using a touchpad.

[2476] The present invention relates to a system that allows users to create and customize interactive art content and advertisements in real time using smart glasses. Specific embodiments are described below.

[2477] System configuration

[2478] Hardware

[2479] 1. Smart glasses: A wearable device in the shape of glasses equipped with a display and various sensors, it displays information in real time and can be operated using voice commands or a touchpad.

[2480] 2. Server: A computer system with a database, generative AI model, and real-time preview generation capabilities.

[2481] software

[2482] 1. Generative AI model: An AI system for automatically generating art templates.

[2483] 2. Server program: Performs user authentication, provides template lists, saves and outputs customized data, etc.

[2484] 3. Smart Glasses App: Users can select and customize templates using voice commands or the touchpad.

[2485] Program processing

[2486] 1. User authentication and initialization

[2487] The user enters their account information on the login screen of the smart glasses and submits a login request.

[2488] The server checks the authentication information against a database, and after successful authentication starts the user's session and loads the configuration information. If authentication fails, it generates an error message and sends it to the smart glasses.

[2489] 2. Providing sample templates

[2490] The server uses a generative AI model to pre-generate various art templates and store them in a sample database.

[2491] When a user sends a template request from their smart glasses, the server provides a list of sample templates.

[2492] 3. Customize the template

[2493] Once a user selects a template, the smart glasses will display it in edit mode, providing customization tools for adding text, adding images, and changing colors.

[2494] Users can customize templates using voice commands or the touchpad, previewing their changes in real time.

[2495] The customization data is sent to the server at any time, and a real-time preview is generated.

[2496] 4. Saving and exporting content

[2497] When the user has finished customizing, they select the "Save" or "Export" option.

[2498] The smart glasses send a save or output request to the server.

[2499] The server saves the customized template, generates it as a PDF or image file, and provides a download link.

[2500] Specific examples

[2501] For example, to create an interactive ad for a new product launch campaign, the following prompt sentences could be input into the generative AI model:

[2502] Prompt Sentence Examples

[2503] Template name: "New product launch campaign"

[2504] Requirements:

[2505] Visually impactful design

[2506] Text fields: "New product name", "Features", "Release date"

[2507] Image field: "New product image"

[2508] Customization Options:

[2509] Color Change

[2510] Text position change

[2511] Change font size

[2512] This invention allows users to intuitively control and generate, customize, and display interactive advertising and art content in real time through smart glasses.

[2513] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2514] Step 1:

[2515] Obtaining and authenticating user credentials

[2516] The user enters their account information (email address, password) on the login screen of the smart glasses and sends a login request.

[2517] Input: Email address, password

[2518] Output: Authentication token, error message (if authentication failed)

[2519] The terminal receives the login information and sends it to the server.

[2520] Input: Login information

[2521] Output: Authentication request

[2522] The server checks the authentication information against a database, and if authentication is successful, starts the session and loads the user's configuration information. If authentication fails, it generates an error message and sends it to the terminal.

[2523] Input: Login information

[2524] Data processing: Matching with database, session generation

[2525] Output: Authentication result, user setting information, error message

[2526] Step 2:

[2527] Providing sample templates

[2528] The user sends a template request from the smart glasses.

[2529] Input: Template request

[2530] Output: Template list

[2531] The terminal relays the template request to the server.

[2532] Input: Template request

[2533] Output: Template list request

[2534] The server retrieves pre-generated art templates from a database, generates a list of templates, and sends it to the terminal.

[2535] Input: Template list request

[2536] Data processing: Obtaining template data and generating lists

[2537] Output: Template list

[2538] Step 3:

[2539] Select and customize a template

[2540] The user selects a template from the provided template list and transmits the selection information to the terminal.

[2541] Input: Template selection information

[2542] Output:Selection Template

[2543] The device will display the selected template in edit mode and provide customization tools (add text, add images, change colors).

[2544] Input:Select Template

[2545] Output: Edit mode screen, customization tools

[2546] Users can customize templates using voice commands or the touchpad, then enter changes into the device.

[2547] Input: Customized instructions (voice commands, touchpad operations)

[2548] Output: Customized operation data

[2549] The terminal transmits customized operation data to the server, and the server generates a real-time preview and transmits it back to the terminal.

[2550] Input: Customized operation data

[2551] Data processing: Real-time preview generation

[2552] Output: Preview screen

[2553] Step 4:

[2554] Saving and exporting customization data

[2555] When the user has finished customizing, they can select the "Save" or "Export" option.

[2556] Input: Save request or Output request

[2557] Output: Save completion notification, download link

[2558] The terminal sends a save request or an output request to the server.

[2559] Input: Save request or Output request

[2560] Output: Save instruction, output instruction

[2561] The server saves the customized template in the user's account, generates it as a PDF or image file if necessary, and provides a download link to the device.

[2562] Input: Customized template data

[2563] Data processing: file creation, link creation

[2564] Output: Save completion notification, download link

[2565] Through these steps, users can intuitively operate the smart glasses to generate, customize, and display interactive advertising and art content in real time.

[2566] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2567] This invention is a system that allows users to intuitively create and customize artistic content, and further incorporates an emotion engine that recognizes the user's emotions and supports operation. Specific embodiments of this system are described below.

[2568] User authentication and initialization

[2569] server

[2570] When a user submits a login request, the server receives authentication information, which includes the user's email address and password. The server compares this with the database and generates an authentication result. If authentication is successful, it starts a user session and loads the user's configuration information. If authentication fails, it generates an error message and sends it to the terminal.

[2571] Terminal

[2572] A login screen for entering authentication information is displayed, and the next operation screen (main menu or error message) is displayed depending on the authentication result.

[2573] User

[2574] Enter your account information to log in to the system.

[2575] Providing sample templates

[2576] server

[2577] A generative AI model is used to pre-generate various art templates and store them in a sample database. When a user submits a template request, the server provides the user with a list of sample templates.

[2578] Terminal

[2579] Displays a list of sample templates for the user to choose from.

[2580] User

[2581] Choose your favorite design from the provided templates.

[2582] User emotion recognition and template customization

[2583] Emotion Engine

[2584] It recognizes the user's emotions in real time from their facial expressions and tone of voice, and sends that information to the server.

[2585] server

[2586] The list of art templates is customized based on the user's emotional information received from the emotion engine. For example, if the user is happy, it will prioritize bright and colorful designs, and if the user is calm, it will prioritize simple and refreshing designs.

[2587] Terminal

[2588] Display a list of customized templates for users to choose from.

[2589] User

[2590] Begin customizing the selected template.

[2591] Terminal

[2592] Displays the selected template in edit mode and provides customization tools such as adding text, adding images, and changing colors.

[2593] User

[2594] Users can customize the template to their liking by adding text and images, changing the color and design, etc. The recommended settings of the customization tool will change based on the user's emotions as determined by the emotion engine.

[2595] server

[2596] The system receives and stores user operation data during customization in real time, and generates and sends a preview of the customization to the device as needed.

[2597] Saving and exporting content

[2598] User

[2599] Once you've finished customizing, select "Save" or "Export."

[2600] Terminal

[2601] Depending on the user's selection, a save or print request is sent to the server.

[2602] server

[2603] The received customized template data is saved in the user's account, and if necessary, it can be output as a PDF or image file, with a download link sent to the device.

[2604] Specific examples

[2605] For example, if a user wants to create a "2023 New Year's card," the specific steps would be as follows:

[2606] 1. The user enters their account information on the login screen and logs in.

[2607] 2. The device receives the user's input and sends the authentication information to the server.

[2608] 3. The server verifies the authentication information, and if authentication is successful, starts the session and loads the configuration information. If authentication fails, it sends an error message to the terminal.

[2609] 4. The user clicks the "Choose Template" button and a template request is sent to the server.

[2610] 5. The server sends the sample template list to the terminal, which displays it.

[2611] 6. The emotion engine analyzes the user's facial expressions and tone of voice to determine that the user is relaxed.

[2612] 7. The server prioritizes templates that match the relaxed state and places them at the top of the list, then sends them to the terminal.

[2613] 8. The user selects the "2023 New Year's Card" template and sends the selection information to the server.

[2614] 9. The server sends the template data to the terminal, and the terminal displays the template in edit mode.

[2615] 10. Users customize the template by adding text, uploading images, and changing the background color. Based on the sentiment engine, text font and color recommendations are provided.

[2616] 11. The server receives the customization operation data, generates a preview in real time, and sends it to the terminal.

[2617] 12. When the user has finished customizing, they click the "Save" button and the device sends a save request to the server.

[2618] 13. The server saves the customized template, generates output files if necessary, and sends download links.

[2619] This system provides optimal templates and customization tool settings based on the user's emotions, allowing them to create high-quality art content more comfortably.

[2620] The processing flow will be explained below.

[2621] Program processing steps

[2622] 1. User authentication and initialization

[2623] Step 1:

[2624] The user enters their email address and password on the login screen and clicks the "Login" button.

[2625] Step 2:

[2626] The terminal receives the entered authentication information and sends it to the server.

[2627] Step 3:

[2628] The server compares the received authentication information with the database and generates an authentication result.

[2629] If authentication is successful, it starts a user session and loads the user configuration information.

[2630] If authentication fails, an error message is generated.

[2631] Step 4:

[2632] The server sends the authentication result to the terminal.

[2633] Step 5:

[2634] The terminal receives the authentication result, and if successful, displays the main menu screen, or if unsuccessful, displays a pop-up error message.

[2635] 2. Providing sample templates

[2636] Step 1:

[2637] The server uses a generative AI model to pre-generate various art templates and store them in a sample database.

[2638] Step 2:

[2639] The user clicks the "Choose a template" button on the main menu screen.

[2640] Step 3:

[2641] The device sends a template request to the server.

[2642] Step 4:

[2643] The server retrieves the template list from the sample database and sends it to the terminal.

[2644] Step 5:

[2645] The terminal displays the template list received from the server on the screen.

[2646] Step 6:

[2647] The emotion engine analyzes the user's facial expressions and tone of voice and transmits the user's emotional state to the server.

[2648] Step 7:

[2649] The server customizes the template list based on the user's emotional information received (e.g., preferentially displaying simple designs to users in a relaxed state).

[2650] Step 8:

[2651] The device will redisplay the customized template list on the screen.

[2652] Step 9:

[2653] The user clicks on a template of their choice from the displayed list of templates and sends the selected template ID to the server.

[2654] 3. Customize the template

[2655] Step 1:

[2656] The server transmits the selected template data to the terminal.

[2657] Step 2:

[2658] The device will display the template in edit mode and provide customization tools such as adding text, adding images, and changing colors.

[2659] Step 3:

[2660] An emotion engine analyzes a user's facial expressions and tone of voice to recommend settings for customization tools based on their emotional state (e.g., recommending bright colors if they are happy).

[2661] Step 4:

[2662] A user edits the template using the customization tools.

[2663] Add text: Enter your message in the text box and adjust the position.

[2664] Image Adding Operation: Upload an image and adjust its size and position.

[2665] Color change operations: Select background and text colors.

[2666] Step 5:

[2667] The terminal transmits the user's customized operation data to the server in real time.

[2668] Step 6:

[2669] The server sequentially stores the received customization operation data, generates preview data in real time, and transmits it to the terminal.

[2670] Step 7:

[2671] Your device will display your edits in real time in a preview window.

[2672] 4. Saving and exporting content

[2673] Step 1:

[2674] When the user has finished customizing, he clicks the "Save" or "Export" button.

[2675] Step 2:

[2676] The terminal sends a save request or an output request to the server.

[2677] Step 3:

[2678] The server stores the received customized template data in the user's account.

[2679] Step 4:

[2680] The server generates the customized template as a PDF or image file.

[2681] Step 5:

[2682] The server sends a download link for the generated output file to your device.

[2683] Step 6:

[2684] The device displays the download link to the user.

[2685] Step 7:

[2686] The user clicks the download link to download the customized art content.

[2687] In this way, the optimal template and customization tool settings are provided according to the user's emotions, enabling the creation of more comfortable, high-quality art content.

[2688] Example 2

[2689] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2690] Previous art content generation systems provided templates without considering user emotions and lacked intuitive customization features. Furthermore, they lacked real-time operation data saving and preview generation, resulting in a poor user experience. Furthermore, the template output formats were limited, making it difficult to meet diverse user needs.

[2691] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2692] In this invention, the server includes means for acquiring and authenticating user authentication information, a database for storing a plurality of pre-generated content templates, means for providing the user with a list of content templates from the database, means for displaying the content template selected by the user in an edit mode and providing a customization tool, means for recognizing emotions from the user's facial expressions and tone of voice and customizing the list of content templates based thereon, means for receiving template customization operations performed by the user and generating previews in real time, and means for saving and outputting customized templates. This makes it possible to provide optimal templates based on the user's emotions and to perform intuitive and efficient customization work.

[2693] "User authentication information" refers to information such as an email address and password used to authenticate a user's personal information.

[2694] "Multiple pre-generated content templates" refers to a group of templates with diverse designs that have been pre-generated by a generative AI model.

[2695] A database is a system that systematically organizes and stores information, making it easy to access and manage.

[2696] The "content template list" is a list of multiple templates that the user can select from.

[2697] "Edit mode" means that the user can freely customize the template.

[2698] "Customization Tools" means a set of tools that a User can use to edit a Template, including adding text, adding images, changing colors, etc.

[2699] "Emotion recognition" means analyzing the user's facial expressions and tone of voice to determine their emotions at that time.

[2700] "Generating a preview in real time" means displaying changes immediately in response to user actions.

[2701] A "customized template" is a template that has been edited and customized by a user.

[2702] "Output means" is a function for saving and providing customized templates in formats such as PDF or image files.

[2703] MODE FOR CARRYING OUT THE INVENTION

[2704] This invention is a system that allows users to intuitively create and customize artistic content, and further incorporates an emotion engine that recognizes the user's emotions and assists in operation. A series of processes is provided that allows users to log in, select a template, customize it, and finally save or output it. A specific embodiment of this system is described below.

[2705] User authentication and initialization

[2706] server

[2707] When a user submits a login request, the server receives the authentication information (email address and password) and checks it against a database (e.g., MySQL). If authentication is successful, the server starts a session for the user and loads the configuration information. If authentication fails, it generates an error message and sends it to the terminal as an HTTP response.

[2708] Terminal

[2709] The terminal displays a login screen and provides fields for the user to enter their email address and password. When the user enters the authentication information and clicks the "Login" button, the terminal sends the authentication information to the server. Upon receiving the authentication result, the terminal displays the main menu screen if successful, or an error message if unsuccessful.

[2710] User

[2711] The user enters their email address and password on the login screen and clicks the "Login" button.

[2712] Providing sample templates

[2713] server

[2714] A generative AI model (e.g., GPT-3) is used to pre-generate a variety of art templates and store them in a sample database. When a user submits a template request, the server generates a list of sample templates and sends them to the device as an HTTP response.

[2715] Terminal

[2716] The device displays a list of sample templates received from the server, with thumbnail images and descriptions displayed on the interface to help the user select a template.

[2717] User

[2718] Users can select their favorite design from the sample templates displayed.

[2719] User emotion recognition and template customization

[2720] Emotion Engine

[2721] The emotion engine analyzes the user's facial expressions and tone of voice in real time. For this analysis, OpenCV and Emotion SDK are used, for example. The emotion engine sends the analysis results to the server.

[2722] server

[2723] The server customizes the list of art templates based on the emotion data received from the emotion engine. For example, if the user is happy, it prioritizes bright and colorful designs. It generates the customized template list and sends it to the device as an HTTP response.

[2724] Terminal

[2725] It displays a list of customized templates for users to choose from, and after users select a template, it switches them into edit mode and provides customization tools (add text, add images, change colors, etc.).

[2726] User

[2727] Users select a template and customize it by adding text and images, changing colors and fonts, etc., guided by the tool's recommended settings based on an emotion engine.

[2728] Saving and exporting content

[2729] User

[2730] Once the user has completed customization, they click the "Save" or "Export" button.

[2731] Terminal

[2732] The terminal sends a save request or an output request to the server in response to the user's click.

[2733] server

[2734] The server saves the received customized template data in the user's account, using a database such as MongoDB. If output is selected, the server outputs the data as a PDF or image file, generates a download link, and sends it to the terminal as an HTTP response.

[2735] Specific examples

[2736] For example, if a user wants to create a "2023 New Year's card," the process would be as follows:

[2737] 1. The user enters their email address and password on the login screen to log in.

[2738] 2. The terminal sends authentication information to the server, the server performs authentication, and if successful, the session starts and the main menu is displayed on the terminal.

[2739] 3. The user clicks the "Choose a template" button in the main menu, and a template request is sent to the server.

[2740] 4. The server generates a sample template list, which the terminal displays.

[2741] 5. The emotion engine analyzes the user's facial expressions and tone of voice and determines that they are relaxed.

[2742] 6. The server places the template suitable for the relaxed state at the top of the list and sends it to the terminal.

[2743] 7. The user selects the "2023 New Year's Card" template and sends the selection information to the server.

[2744] 8. The server sends the template data to the terminal, and the terminal displays the template in edit mode.

[2745] 9. Users customize the template by adding text, uploading images, and changing the background color. Recommendations are provided based on the sentiment engine.

[2746] 10. The server receives the customization operation data in real time, generates a preview, and sends it to the device.

[2747] 11. The user finishes customizing and clicks the "Save" or "Export" button.

[2748] 12. The device sends a save or output request to the server.

[2749] 13. The server saves the customized template, generates the output as a PDF or image file, and sends a download link.

[2750] Prompt Sentence Examples

[2751] I want to choose a template based on the theme "New Year's Cards 2023." If the user has a happy expression, what design would you recommend?

[2752] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2753] Step 1: User authentication and initialization

[2754] server

[2755] A login request is received from the user. The input data is an email address and password. The server compares this authentication information with the information in the database and generates an authentication result. If successful, a session is started and the user's configuration information is loaded. If unsuccessful, an error message is generated and sent to the terminal as an HTTP response.

[2756] Terminal

[2757] The device displays a login screen for entering an email address and password. When the user enters the authentication information and clicks the "Login" button, the data is sent to the server. The device receives the authentication result from the server, and if successful, displays the main menu screen, otherwise displays an error message.

[2758] User

[2759] The user enters their email address and password on the login screen and clicks the "Login" button.

[2760] Step 2: Provide a sample template

[2761] server

[2762] A variety of pre-generated art templates are stored in a sample database using a generative AI model (e.g., GPT-3). When a user sends a template request, the server generates a list of sample templates and sends it to the device as an HTTP response. The data input is the user request, and the output is the template list.

[2763] Terminal

[2764] The device displays a list of sample templates received from the server, with thumbnail images and descriptions displayed on the interface to help the user select a template.

[2765] User

[2766] Users can select their favorite design from the sample templates displayed.

[2767] Step 3: User Emotion Recognition and Template Customization

[2768] Emotion Engine

[2769] It analyzes the user's facial expressions and tone of voice in real time. The input is video and audio data from the user. The analysis is performed using OpenCV or Emotion SDK, for example, and the analysis results are sent to the server.

[2770] server

[2771] The server customizes the list of art templates based on the emotion data received from the emotion engine. The input is emotion data, and the output is the customized template list. For example, for a happy emotion, it prioritizes bright and colorful designs. It sends the customized template list to the terminal as an HTTP response.

[2772] Terminal

[2773] It displays a list of customized templates for users to choose from, and after users select a template, it switches them into edit mode and provides customization tools (add text, add images, change colors, etc.).

[2774] User

[2775] Users select a template and customize it by adding text and images, changing colors and fonts, etc., guided by the tool's recommended settings based on an emotion engine.

[2776] Step 4: Save and export content

[2777] User

[2778] Once the user has completed customization, they click the "Save" or "Export" button.

[2779] Terminal

[2780] The terminal sends a save request or an output request to the server in response to the user's click.

[2781] server

[2782] The server saves the received customized template data in the user's account. The input is the customized template data, and the storage destination is a database (e.g., MongoDB). If output is selected, it outputs it as a PDF or image file, generates a download link, and sends it to the terminal as an HTTP response.

[2783] (Application example 2)

[2784] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2785] Conventional art content generation systems lack intuitive template selection and customization functions that take user emotions into account, making it difficult for users to find the design that best suits them. Furthermore, they do not provide real-time previews of customization operations or recommended settings based on emotion information, which makes it difficult to improve the user experience.

[2786] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring and authenticating user authentication information, a database that stores a plurality of pre-generated art templates, means for providing the user with a list of art templates from the database, means for recognizing the user's emotion and customizing the list of art templates based on the emotion information, means for displaying the art template selected by the user in an edit mode and providing a customization tool, means for receiving the user's template customization operation and generating a preview in real time, and means for saving and outputting the customized template. This makes it easier for users to select the optimal template based on their emotion, enabling them to intuitively and efficiently generate and customize art content.

[2787] "User Credentials" means information required to identify a user and grant access to a system.

[2788] A "database" is an information management system for storing a plurality of pre-generated art templates.

[2789] "Emotional information" is data about the user's emotional state obtained from facial expressions, tone of voice, etc.

[2790] "Edit mode" is an operating environment for customizing a ...

Claims

1. a means for obtaining and authenticating user credentials; a database storing a plurality of pre-generated art templates; means for providing said user with a list of art templates from said database; means for displaying the user-selected art template in an edit mode and providing customization tools; means for receiving a template customization operation by the user and generating a preview in real time; The system includes a means for saving and outputting customized templates.

2. 2. The system of claim 1, wherein the customization tools include means for adding text, adding images, and changing colors.

3. 10. The system of claim 1, wherein the output means generates the customized template as a PDF or image file and provides a download link.

Images