System

Abstract

A system is provided.SOLUTION: Means for the user to enter credentials, means for the server to authenticate based on the credentials and redirect the user to a dashboard page, means for the user to create a new digital design, means for providing a user interface and allowing the user to save the design, means for providing AI assistance and allowing the user to upgrade the design, means for the user to upload the completed design to the server, and means for the server to receive the design and review it by AI; The digital design system includes a means for notifying an examination result, a means for allowing a user to set sales information, and a means for allowing a server to store sales setting and to publish it to a digital market place.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Describe the "problem that the invention aims to solve" and the "means for solving the problem."

[0005] When users create and sell digital designs, especially LINE stickers, the existing process is complicated and often requires technical knowledge. Furthermore, there is a lack of adequate support for improving the quality of designs, and the review process and preparation for sale can be time-consuming. This makes it difficult for beginners and users with limited technical knowledge to easily create and sell digital designs. [Means for solving the problem]

[0006] To solve the above problems, the present invention provides the following means. The present invention includes a means for redirecting a user to a dashboard page after the user inputs authentication information and the server performs authentication. The present invention then includes a means for providing a user interface that allows the user to create new digital designs, including a paint tool and an image upload function. The present invention also includes a means for supporting the improvement of design quality through an AI-assisted function.

[0007] Users upload their completed designs to the server, which receives and reviews the design data. An AI algorithm automatically performs the review, notifying the user of the results and providing feedback. Furthermore, the system provides a means for users to set sales information, which the server then saves and publishes on the digital marketplace.

[0008] In this way, it is possible to simplify the entire process from creating digital designs to selling them, and to provide a system that is easy for users to use.

[0009] Understood. Below are definitions of important terms contained in the claims.

[0010] "Authentication information" refers to information used to verify a user's identity, such as an email address or password that a user enters when accessing a system.

[0011] A "server" is a computer that is the core of a digital design system, and is a device that processes requests from users and stores and manages data.

[0012] "User" refers to an individual or organization that uses this system to create and sell digital designs.

[0013] The "dashboard page" is the home screen that a user accesses after logging in, and is a hub for accessing various functions within the system.

[0014] "Digital design" refers to images or artwork created using a computer, and in the case of this invention, it specifically refers to LINE stamps.

[0015] A "user interface" is an interface that includes a screen and input means for a user to operate a system.

[0016] A "paint tool" is drawing software that allows users to create digital designs.

[0017] The "image upload function" is a function that allows users to import images from their own terminals into the system.

[0018] The "AI support function" is a function that uses artificial intelligence technology to assist users in creating designs, making design suggestions and automatic corrections.

[0019] "Design data" refers to a data file relating to a digital design created by a user, and includes image data and metadata.

[0020] "Review" is the process of checking whether the uploaded design data complies with the system's standards and regulations.

[0021] "Sales information" refers to information such as the price and release date set for selling the digital design created by the user.

[0022] A "digital marketplace" is an online platform where created digital designs are made available to the public and sold.

[0023] The above are definitions of important words included in the claims. [Brief explanation of the drawings]

[0024] [Figure 1]1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0025] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0026] First, the terms used in the following description will be explained.

[0027] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0028] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0029] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0030] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0031] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0032] [First embodiment]

[0033] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0034] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0035] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0036] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0037] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0038] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0039] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0040] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0041] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0042] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0043] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0044] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0045] Understood. Below is the "Mode for Carrying Out the Invention" from the patent specification.

[0046] The digital design system of the present invention is designed to enable users to easily create digital designs and complete the entire process from review to sale. This system allows users to log in by entering their authentication information, create a digital design, proceed with the work with AI assistance, upload the completed design to a server, and sell designs that pass review on a digital marketplace.

[0047] Login process

[0048] The user fills out the login form

[0049] The user accesses the system's login screen and enters their email address and password.

[0050] The server performs authentication

[0051] The server authenticates the user based on these credentials and redirects the user to the dashboard page if they are correct, otherwise it returns an error message.

[0052] Digital Design Creation

[0053] User selects to create a new stamp

[0054] A user clicks the "Create a New Stamp" button to start a new digital design project.

[0055] The device will display the stamp creation screen.

[0056] The device displays a user interface that includes painting tools and an image upload function, and the user uses these tools to create a digital design.

[0057] AI support function

[0058] The device provides AI assistance functions

[0059] The device will provide AI-assisted features to help users create designs more efficiently, with AI suggesting color adjustments and composition optimization.

[0060] Save and upload your design

[0061] The device will automatically save

[0062] The device automatically saves design data at regular intervals, and this data is stored in local storage, reducing the risk of data loss during work.

[0063] User completes and uploads the design

[0064] When the user completes a design to their satisfaction, they press the "upload" button to send the design data to the server.

[0065] Review process

[0066] The server receives the design data.

[0067] The server receives the uploaded design data. At this stage, the design data is saved and an AI algorithm begins automatic review.

[0068] The server notifies the review result

[0069] The server uses an AI algorithm to check the design for policy violations and quality. If the design passes the inspection, it is ready for sale. If it fails, the server notifies the user with feedback including corrections.

[0070] Sales Settings and Publication

[0071] User sets sales preferences

[0072] The user specifies the pricing and sales start date for the design.

[0073] The server stores the sales settings

[0074] The server stores the sales information set by the user and publishes the stamps on the digital marketplace on the designated publication date.

[0075] Specific examples

[0076] For example, consider the case where a user wants to create animal-themed LINE stickers. The user logs in to the system and clicks the "Create New Stickers" button. Paint tools and an image upload function are then displayed, and the user uses these tools to draw the animal stickers. AI adjusts colors and suggests placement, improving the quality of the design. The completed stickers are uploaded to the server, and after passing review, they are set up for sale. Finally, the user's animal stickers are sold on the digital marketplace.

[0077] This allows even beginners to easily create and sell high-quality digital designs. Users can work efficiently and effectively to help them sell quickly in a competitive market.

[0078] The processing flow will be explained below.

[0079] Ok, so let me explain step by step what the program does.

[0080] Step 1:

[0081] The user fills out the login form

[0082] The user accesses the system login screen and enters their email address and password.

[0083] Step 2:

[0084] The server performs authentication

[0085] The server authenticates the user based on the entered credentials and redirects them to the dashboard page if the credentials are correct, otherwise it displays an error message.

[0086] Step 3:

[0087] User selects to create a new stamp

[0088] A user clicks the "Create a New Stamp" button to begin a new digital design project.

[0089] Step 4:

[0090] The device will display the stamp creation screen.

[0091] The device displays a user interface that includes a painting tool and image upload functionality.

[0092] Step 5:

[0093] User initiates design

[0094] Users create digital designs using painting tools and upload and edit images as needed.

[0095] Step 6:

[0096] The device will automatically save

[0097] The device automatically saves design data at regular intervals and stores it in local storage.

[0098] Step 7:

[0099] The device provides AI assistance functions

[0100] The device uses AI-assisted functions to suggest improvements to design quality, such as adjusting colors and optimizing placement.

[0101] Step 8:

[0102] The user completes the design

[0103] Once the user has created a design they are happy with, they click the "upload" button.

[0104] Step 9:

[0105] The device sends the design data to the server

[0106] The terminal sends the completed design data to the server.

[0107] Step 10:

[0108] The server receives the design data.

[0109] The server receives and stores the uploaded design data.

[0110] Step 11:

[0111] The server starts the automatic review

[0112] The server uses AI algorithms to automatically review designs and check for policy violations and quality issues.

[0113] Step 12:

[0114] The server notifies the user of the review results.

[0115] The server generates the review results and notifies the user. If the product passes, it can be prepared for sale. If corrections are required, the server provides feedback on the corrections.

[0116] Step 13:

[0117] User sets sales preferences

[0118] The user specifies the pricing and sales start date for the design.

[0119] Step 14:

[0120] The server stores the sales settings

[0121] The server stores the sales information set by the user.

[0122] Step 15:

[0123] Server publishes to digital marketplace

[0124] The server will publish the design on the digital marketplace according to the set schedule and begin selling it.

[0125] The above are the specific processing steps of the program. This system allows users to easily create and sell digital designs.

[0126] Example 1

[0127] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0128] With conventional digital design systems, it was difficult for users to receive support for design creation and quality improvement, and the review process was manual, resulting in problems that reduced efficiency. There was also the risk that the created design data would be lost without being saved, which increased the burden on users. Furthermore, the process from sales setup to publication was complicated and difficult for beginners to use. To solve these issues, a new digital design system was needed.

[0129] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0130] In this invention, the server includes a means for the user to input authentication information, a means for the server to authenticate the user based on the authentication information and redirect the user to a dashboard page, and a means for the user to create a new digital design, so that the user can easily access the system and start creating a design.

[0131] The terminal also includes a means for providing a user interface and allowing the user to save the design, and a means for the terminal to provide AI assistance and for the user to improve the quality of the design, thereby enabling the user to efficiently create high-quality designs.

[0132] Furthermore, the system includes a means for users to upload completed designs to a server, a means for the server to receive the design data, review it using AI, and notify the user of the review results, a means for users to set sales information, a means for the server to save the sales settings and publish them on the digital marketplace, and a means for the device to automatically save the design data periodically, which reduces the risk of losing design data and makes the sales process more efficient.

[0133] "User" means any person who uses the Digital Design System and logs in by entering credentials to create, save, upload and sell Digital Designs.

[0134] "Authentication information" refers to information such as an email address and password that a user enters to access a system.

[0135] "Server" refers to the computer equipment that serves as the center of the digital design system and is responsible for user authentication, design data storage, review, and sales settings.

[0136] "Terminal" refers to a device used by a user to create a digital design, including a PC, smartphone, tablet, etc.

[0137] A "dashboard page" is a screen that a user can access after logging in, and provides an interface for creating and managing digital designs.

[0138] "Digital Design" means design data in digital form that a User creates, stores, uploads, and sells through the System.

[0139] "User interface" refers to the screens and controls that allow users to interact with a digital design system, including paint tools and image upload functions.

[0140] "AI support" refers to artificial intelligence-based assistance functions provided by the device during the digital design creation process, including functions such as color adjustment and composition optimization.

[0141] "Uploading" is the act of a user sending a completed digital design from their device to the system's server.

[0142] "Review" is the process in which the server uses an AI algorithm to check the design data it receives for policy violations and quality, and notifies the user of the results.

[0143] "Sales information" refers to information such as pricing and sales start date for digital designs created by users.

[0144] A "digital marketplace" is an online marketplace where user-created digital designs are published and sold.

[0145] "Auto-save" is a function that allows the device to automatically save the user's design data to local storage at specific intervals.

[0146] The digital design system of the present invention allows users to easily create digital designs and complete the entire process from review to sale. This system allows users to log in by entering their authentication information, create a digital design, proceed with the work with AI assistance, upload the completed design to a server, and sell designs that pass review on a digital marketplace.

[0147] Hardware and software used

[0148] The system mainly uses the following hardware and software:

[0149] Server: User authentication, design data storage and review, and sales settings management. For example, use an Apache server or Nginx server.

[0150] Device: The device on which a user creates a design. Examples include computers, smartphones, and tablets running browser-based or native applications.

[0151] Design tool: Software that allows users to create digital designs, such as Adobe Illustrator or GIMP.

[0152] AI Model: A generative AI model to assist in design creation, such as OpenAI's GPT-3 or Adobe Sensei.

[0153] Example of operation

[0154] 1. User authentication:

[0155] A user accesses the system's login screen and enters their email address and password. The server authenticates the user based on these credentials. If authentication is successful, the user is redirected to the dashboard page. For example, the user enters user@example.com and the appropriate password.

[0156] 2. Design Creation:

[0157] The user clicks the "Create a new stamp" button to create a new digital design. The device displays a user interface that includes painting tools and an image upload function. The user uses these tools to create a digital design.

[0158] 3. AI support:

[0159] The device provides AI assistance functions to assist users in their design tasks, such as adjusting colors, optimizing composition, and suggesting fonts. For example, the following prompts can be input to the generative AI model:

[0160] Prompt: "I'd like to create some cute stamps featuring animals like dogs and cats. Could you please give me some advice on the best color combinations and designs?"

[0161] This allows the AI ​​to provide specific color suggestions and composition advice, which the user can follow to complete the design.

[0162] 4. Save and upload your design:

[0163] The device provides a function that automatically saves design data to local storage at regular intervals. When the user completes the design and presses the "Upload" button, the design data is sent to the server. The server receives this design data and stores it in a database.

[0164] 5. Judging and Sales:

[0165] The server uses an AI algorithm to review the design for policy violations and quality. If the review passes, the user sets the sales information. The sales information is saved on the server and published on the digital marketplace on the specified publication date. For example, the user sets the price of the design to 500 yen and the sales start date to the 1st of the following month.

[0166] This makes it possible for even beginners to easily create high-quality digital designs and sell them quickly and reliably in the market.

[0167] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0168] Step 1:

[0169] The user enters their authentication information.

[0170] As input, a user enters an email address and password into a login form, filling in form fields in the UI of a browser or mobile app. The input data is sent to the server.

[0171] Step 2:

[0172] The server performs authentication based on the authentication information.

[0173] As input, the server receives an email address and password which it checks against its database. The server runs the appropriate authentication query and, if correct, creates a session and redirects the user to a dashboard page. As output, it provides the authentication status (success / failure) and a redirect URL.

[0174] Step 3:

[0175] A user creates a new digital design.

[0176] As input, the user clicks the "Create a new stamp" button. The specific action is to trigger a click event on the button. The device generates a design creation screen, displaying a painting tool and an image upload function.

[0177] Step 4:

[0178] The terminal provides a user interface and allows the user to save designs.

[0179] As input, the user creates a design using the paint tool or image upload function. Specific actions include drawing with the brush tool or selecting an image file. The created design data is obtained as output.

[0180] Step 5:

[0181] The device provides AI assistance, allowing the user to improve the quality of the design.

[0182] As input, the user receives suggestions for adjusting colors and optimizing composition while creating a design. Specific prompts are fed into the generative AI model:

[0183] Prompt: "I'd like to create some cute stamps featuring animals like dogs and cats. Could you please give me some advice on the best color combinations and designs?"

[0184] The AI ​​model then makes suggestions based on this, which the user can then accept or modify, resulting in improved design data.

[0185] Step 6:

[0186] The device automatically saves design data at regular intervals.

[0187] As input, the terminal periodically triggers a timer event to save the current design data to local storage. A specific operation is to automatically save the data every 5 minutes, for example. As output, the latest design data is saved to local storage.

[0188] Step 7:

[0189] The user uploads the completed design to the server.

[0190] As input, the user clicks the "Upload" button. The specific operation is to send the completed design data to the server. As output, the design data received by the server is obtained.

[0191] Step 8:

[0192] The server receives the design data, reviews it using AI, and notifies the user of the review results.

[0193] The server inputs the design data it receives into an AI algorithm, which checks for policy violations and quality. For example, it checks for copyright infringement or inappropriate content. The output is a review result (pass / fail), and if it fails, feedback including corrections is generated and notified to the user.

[0194] Step 9:

[0195] The user sets the sales information.

[0196] As input, the user enters the design's pricing and sales start date into an input form. The specific operation is to enter information on the sales settings screen. As output, the sales information is sent to the server and saved.

[0197] Step 10:

[0198] The server stores the selling settings and publishes them to the digital marketplace.

[0199] As input, the server publishes the design to the digital marketplace on the specified publication date based on the saved sales information. The specific operation is to publish the data using the marketplace's API. As output, the user's design is published and sales begin.

[0200] (Application example 1)

[0201] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0202] While conventional digital design systems support the creation of two-dimensional designs, they lack the ability to efficiently create designs in three-dimensional space, or to use AI to provide real-time color adjustments and composition suggestions. Furthermore, they lacked a set of integrated functions that allowed users to easily save and upload designs and sell them on a virtual marketplace, resulting in issues with overall usability. This made it difficult to improve the quality of digital designs and quickly release them to the market.

[0203] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0204] In this invention, the server includes: means for a user to input authentication information; means for the server to authenticate the user based on the authentication information and redirect the user to a dashboard page; means for a user to create a new digital design; means for providing a user interface and allowing the user to save designs; means for providing AI support and allowing the user to improve the quality of the design; means for a user to upload a completed design to the server; means for the server to receive design data, review using AI, and notify the review results; means for a user to set sales information; means for the server to save sales settings and publish them on a virtual marketplace; means for a user to create a digital design in a 3D space; and means for suggesting color adjustments and composition in real time using an AI-assisted function. This allows users to easily create and improve the quality of digital designs in a three-dimensional space, allowing them to sell on a virtual marketplace quickly and efficiently.

[0205] "User authentication" is a procedure in which the server verifies the legitimacy of a user based on the authentication information entered by the user.

[0206] "Digital design" is visual content created using a computer, typically using paint tools or graphics software.

[0207] A "user interface" is a collection of screens and elements that allow a user to interact with a system, providing the means for creating and saving designs.

[0208] "AI Support" is a function that uses artificial intelligence to assist users in improving the quality of their digital design creation, such as by adjusting colors and suggesting composition.

[0209] "Server" means a computer device on a network that stores and manages design data created by users, verifies authentication information, and reviews designs.

[0210] A "Virtual Marketplace" is a platform for exhibiting and selling digital designs online.

[0211] "3D space" is a three-dimensional virtual space represented by computer graphics in which users can create digital designs.

[0212] "Color adjustment" is the process of optimizing colors in digital designs, automatically suggesting the best shades with the help of AI.

[0213] "Composition suggestion" is a process that uses AI to present optimal layouts to users in order to optimize the placement of elements in digital designs.

[0214] The digital design system of the present invention supports the process of users easily creating digital designs in three-dimensional space, improving their quality with AI support, saving their designs, and selling them in a virtual marketplace. This system is composed of the following hardware and software.

[0215] Hardware and software used

[0216] Smartphone: A modern smartphone running iOS or Android.

[0217] software:

[0218] Unity: Rendering 3D spaces and building user interfaces.

[0219] TensorFlow: Implementing AI-assisted features and real-time color adjustment and composition suggestions.

[0220] Firebase: User authentication, design data storage, sales information management.

[0221] System Details

[0222] 1. User authentication:

[0223] A user accesses the login screen of the smartphone application and enters their email address and password. The authentication information is verified by Firebase Authentication, and if valid, the user is redirected to the virtual design studio.

[0224] 2. Design Creation:

[0225] Users create digital designs in a three-dimensional virtual space built using Unity, and can freely arrange and change design elements using painting tools and image upload functions.

[0226] 3. AI support function:

[0227] While creating a design, AI-assisted features powered by TensorFlow make real-time color adjustment and composition suggestions, helping users create high-quality designs efficiently. For example, the AI ​​can suggest a color palette that suits the user's design and suggest the optimal placement of elements.

[0228] 4. Save and upload your design:

[0229] Design data is automatically saved to Firebase Storage at regular intervals. When a user completes a design and presses the upload button, the design data is sent to the server and stored in Firebase.

[0230] 5. Review Process:

[0231] The server receives the uploaded design data and uses an AI algorithm (TensorFlow) to check the design for policy violations and quality issues. The results of the review are notified to the user, and if there are no policy violations or quality issues, the system proceeds to sales setup.

[0232] 6. Sales Settings and Publication:

[0233] Users set the price and release date for their design, which is stored in Firebase Firestore, and the design is published on the digital marketplace on the specified release date.

[0234] Specific examples

[0235] For example, consider the case where a user creates a three-dimensional digital animal-themed figurine on the Virtual Design Market. The user logs into the system and begins designing the figurine in 3D space. The AI-assisted function suggests colors and composition in real time to achieve the optimal design. The completed design is uploaded to the server, and after passing a review, it is made public on the Virtual Marketplace.

[0236] Prompt Sentence Examples

[0237] "You are an AI in a virtual design market. Users are creating animal-themed designs. Please suggest appropriate color adjustments and placement."

[0238] This allows users to utilize 3D space and AI assistance to create efficient, high-quality digital designs and quickly bring them to market.

[0239] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0240] Step 1:

[0241] A user accesses the login screen of a smartphone application and enters their email address and password. The application sends the entered authentication information to Firebase Authentication. Firebase Authentication authenticates the user based on the entered information, and if the information is valid, generates an authentication token and returns it to the application. Once the authentication token is received, the user is redirected to the virtual design studio. An error message is displayed if the entered information is invalid.

[0242] Step 2:

[0243] Users select the "Create a new design" option in the virtual design studio. This action causes the application to display a design creation screen in a three-dimensional virtual space built using Unity. The user interface includes painting tools and an image upload function, which users can use to place and modify design elements.

[0244] Step 3:

[0245] The user interface uses a TensorFlow model to provide real-time AI support as the user creates their design. When the user changes part of the design, the new design data is input into the TensorFlow model, which then outputs suggestions for color adjustments and composition. The suggestions are displayed in the user interface, allowing the user to adjust the design based on them.

[0246] Step 4:

[0247] While users are creating their designs, their design data is automatically saved to Firebase Storage at regular intervals, reducing the risk of losing data while they are working. The saved data is then uploaded to Firebase as intermediate states of the design.

[0248] Step 5:

[0249] After the user completes the design, they press the "Upload" button. This action sends the final design data to the server and stores it in Firebase Storage. The server receives this design data and records it appropriately in the administrative database.

[0250] Step 6:

[0251] The server inputs the saved design data into a TensorFlow model to check for policy violations and quality. The model analyzes the design and generates a result. The server evaluates the analysis result and notifies the user of the review result. Based on the review result, specific feedback is provided to the user if any corrections are required.

[0252] Step 7:

[0253] Once a design has passed the review, the user can set it up for sale. They can specify the sales price and start date, and enter that information. The application sends the entered information to Firebase Firestore and stores it appropriately. The design is then ready to be published on the marketplace.

[0254] Step 8:

[0255] On the sales start date, the server will publish the design on the virtual marketplace based on the saved sales settings. The published design will be available for other users to view and purchase. Information at the time of publication is updated in real time by the server, and sales status is also monitored.

[0256] This allows users to efficiently create high-quality designs in three-dimensional space and quickly begin selling them on the virtual marketplace.

[0257] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0258] Understood. Below is the "Mode for carrying out the invention" for the invention that combines an emotion engine.

[0259] This invention is a digital design system that allows users to easily create digital designs and realize high-quality designs using AI support and an emotion engine. This system supports the entire process from digital design creation to review and sales.

[0260] Login process

[0261] The user fills out the login form

[0262] The user accesses the system's login screen and enters their email address and password.

[0263] The server performs authentication

[0264] The server authenticates the user based on these credentials and redirects them to the dashboard page if the credentials are correct, otherwise it displays an error message.

[0265] Digital Design Creation

[0266] User selects to create a new stamp

[0267] A user clicks the "Create a New Stamp" button to begin a new digital design project.

[0268] The device will display the stamp creation screen.

[0269] The device displays a user interface that includes a painting tool and image upload functionality.

[0270] Navigating the User Interface

[0271] The user starts the design process, creates a digital design using the paint tool, and uploads and edits images as needed. The device automatically saves the design data at regular intervals and stores it in local storage.

[0272] AI Assistance and Emotion Engine

[0273] Activating the Emotion Engine

[0274] While the user is creating a design, the device activates an emotion engine that analyzes the user's facial expressions and voice to recognize their emotions.

[0275] Emotion-based suggestions

[0276] The emotion engine analyzes the user's emotional state, and the AI ​​assistance feature makes design suggestions and modifications based on the recognized emotion. For example, if the user is feeling down, it will suggest brighter colors and more fun design options.

[0277] Quality improvement with AI-assisted functions

[0278] The device uses AI-assisted functions to suggest improvements to design quality, such as adjusting colors and optimizing composition.

[0279] Complete and upload your design

[0280] The user completes the design

[0281] Once the user has created a design they are happy with, they click the "upload" button.

[0282] The device sends the design data to the server

[0283] The terminal sends the completed design data to the server.

[0284] Review process

[0285] The server receives the design data.

[0286] The server receives and stores the uploaded design data.

[0287] The server starts the automatic review

[0288] The server uses AI algorithms to automatically review designs and check for policy violations and quality issues.

[0289] The server notifies the user of the review results.

[0290] The server generates the review results and notifies the user. If the product passes, it can be prepared for sale. If corrections are required, the server provides feedback on the corrections.

[0291] Sales Settings and Publication

[0292] User sets sales preferences

[0293] The user specifies the pricing and sales start date for the design.

[0294] The server stores the sales settings

[0295] The server stores the sales information set by the user.

[0296] Server publishes to digital marketplace

[0297] The server publishes the digital designs on the digital marketplace according to a set schedule and starts selling them.

[0298] Specific examples

[0299] For example, consider the case where a user wants to create an animal-themed LINE sticker. The user logs in to the system and clicks the "Create a new sticker" button. They then use the paint tool or image upload function to draw an animal sticker. As they work, the emotion engine analyzes the user's facial expressions, and the AI ​​assistance function makes design suggestions based on their emotions. For example, if the user is smiling, the system will suggest adding bright and fun elements to the sticker.

[0300] The completed stamp is uploaded to the server, where it is checked for any issues through an AI review. If it passes, the user enters the price and sales start date, and the server publishes the stamp on the digital marketplace. This allows users to enjoy a more personalized design experience. This system makes it easy for even beginners to create and sell high-quality digital designs.

[0301] The processing flow will be explained below.

[0302] Okay, so let me explain the process step by step below.

[0303] Step 1:

[0304] The user fills out the login form

[0305] The user accesses the system login screen and enters their email address and password.

[0306] Step 2:

[0307] The server performs authentication

[0308] The server authenticates the user based on the entered credentials, redirects them to the dashboard page if the credentials are correct, or displays an error message if the credentials are invalid.

[0309] Step 3:

[0310] User selects to create a new stamp

[0311] A user clicks the "Create a New Stamp" button to begin a new digital design project.

[0312] Step 4:

[0313] The device will display the stamp creation screen.

[0314] The device displays a user interface that includes a painting tool and image upload functionality.

[0315] Step 5:

[0316] The device activates the emotion engine

[0317] The device launches an emotion engine and activates sensors to analyze the user's facial expressions and voice.

[0318] Step 6:

[0319] User initiates design

[0320] Users create digital designs using painting tools and upload and edit images as needed.

[0321] Step 7:

[0322] The device will automatically save

[0323] The device automatically saves design data at regular intervals and stores it in local storage.

[0324] Step 8:

[0325] The device analyzes emotions using an emotion engine

[0326] The device uses an emotion engine to analyze the user's facial expressions and voice to recognize their current emotional state.

[0327] Step 9:

[0328] The device will make emotion-based suggestions

[0329] The device uses AI-assisted features to suggest and modify designs based on the emotions it recognizes: for example, if the user is smiling, it will suggest bright colors and fun motifs.

[0330] Step 10:

[0331] The user completes the design

[0332] Once the user has created a design they are happy with, they click the "upload" button.

[0333] Step 11:

[0334] The device sends the design data to the server

[0335] The terminal sends the completed design data to the server.

[0336] Step 12:

[0337] The server receives the design data.

[0338] The server receives and stores the uploaded design data.

[0339] Step 13:

[0340] The server starts the automatic review

[0341] The server uses AI algorithms to automatically review designs and check for policy violations and quality issues.

[0342] Step 14:

[0343] The server notifies the user of the review results.

[0344] The server generates the review results and notifies the user. If the product passes, it can be prepared for sale. If corrections are required, the server provides feedback on the corrections.

[0345] Step 15:

[0346] User sets sales preferences

[0347] The user specifies the pricing and sales start date for the design.

[0348] Step 16:

[0349] The server stores the sales settings

[0350] The server stores the sales information set by the user.

[0351] Step 17:

[0352] Server publishes to digital marketplace

[0353] The server publishes the digital designs on the digital marketplace according to a set schedule and starts selling them.

[0354] The above are the specific processing steps of the invention combined with the emotion engine. This system allows users to enjoy a more personalized design experience.

[0355] Example 2

[0356] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0357] In conventional digital design systems, users had to create their own designs and rely on their own sense and experience to improve the quality. This made it difficult for beginners and users without specialized knowledge to create high-quality designs. Inconveniences were also pointed out regarding the user interface operation method and the saving and restoring of design data. Furthermore, it was difficult to incorporate emotional elements into the design, making it impossible to realize design proposals based on the user's emotional state. There is a need to provide a system that solves these issues, allows anyone to easily create high-quality digital designs, and enables proposals that take into account the emotional elements of the design.

[0358] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for a user to input authentication information; a means for the server to authenticate the user based on the authentication information and redirect the user to a dashboard page; a means for the user to create a new digital design; a means for providing a user interface and allowing the user to save designs; a means for operating the user interface to create a design; a means for launching an emotion analysis module and analyzing the user's emotional state; a means for providing AI support and proposing designs based on the emotion analysis results; a means for providing AI support and allowing the user to improve the quality of the design; a means for the user to upload the completed design to the server; a means for the server to receive design data, perform AI review, and notify the review results; a means for the user to set sales information; and a means for the server to save the sales settings and publish the design on an online store. This allows even beginners to easily create high-quality digital designs and propose designs that incorporate emotional elements.

[0359] Understood. Below are definitions of important terms found in the claims:

[0360] "User" refers to an individual or organization that uses the System.

[0361] "Authentication information" refers to information used to verify the identity of a user, and specifically includes an ID and password.

[0362] "Server" refers to a computer system that stores, processes, and manages data.

[0363] "Dashboard page" refers to the main operation screen that users can access after logging in.

[0364] "Digital design" refers to any visual content created using a computer.

[0365] "User interface" refers to the screen and operation means that allow a user to operate the system.

[0366] "Paint tool" refers to an on-screen drawing tool used to create digital designs.

[0367] "Image upload function" refers to the function for importing image files into the system.

[0368] An "emotion analysis module" refers to software or hardware for analyzing a user's facial expressions and voice to recognize their emotional state.

[0369] "AI support" refers to a function that uses artificial intelligence to support design suggestions and quality improvement.

[0370] "Design Data" refers to a user-created digital design file and associated metadata.

[0371] "Review" refers to the quality check and policy violation detection performed by AI on uploaded design data.

[0372] "Online Store" means a web-based marketplace for the sale of Digital Designs.

[0373] "Sales Information" refers to the setting information such as price and sales start date required to sell a Digital Design.

[0374] This provides clear definitions of key terms used in the claims.

[0375] This invention is a digital design system that allows users to easily create digital designs and realize high-quality designs using AI support and emotion analysis technology. This system supports a series of processes from digital design creation to review and sales, and can be implemented as follows:

[0376] Hardware and Software Used

[0377] To implement this system, the following hardware and software are used.

[0378] Server: A server system for storing, processing, and managing data.

[0379] Device: The computer, tablet, or smartphone used by the user.

[0380] User interface: Delivered as a web or mobile application.

[0381] Painting tools and image uploading functionality: A set of tools for creating designs.

[0382] Emotion Analysis Module: Uses the camera for facial expression analysis and the microphone for voice analysis.

[0383] AI-assisted features: Generative AI models for design suggestions and quality improvement.

[0384] Data processing and calculation

[0385] Authentication process: The email address and password entered by the user are authenticated on the server, and if authentication is successful, the user is redirected to the dashboard page.

[0386] Design creation: The device provides a painting tool and image upload function, allowing users to create designs through a user interface.

[0387] Emotion Analysis: The emotion analysis module analyzes the user's facial expressions and voice in real time to recognize the user's emotional state.

[0388] AI assistance: A generative AI model makes design suggestions based on the results of sentiment analysis, helping to improve design quality by adjusting color tones and optimizing layouts.

[0389] Saving and uploading designs: The device automatically saves design data to local storage at regular intervals and uploads completed design data to the server.

[0390] Automated review: The server receives the uploaded design data and uses AI algorithms to check the quality and detect policy violations.

[0391] Sales Settings and Publish: The server stores the pricing and sales start date information you entered and publishes the design to the online store at the specified date and time.

[0392] Specific examples

[0393] For example, if a user wants to create an animal-themed LINE stamp, they would perform the following operations.

[0394] 1. A user logs into the system

[0395] The user logs in to the system by entering the email address "user@example.com" and the password "password123".

[0396] 2. Click the Create New Stamp button

[0397] Users click the "Create a new stamp" button and use the painting tools and image upload function to draw an animal stamp.

[0398] 3. The emotion analysis module analyzes the user's facial expressions

[0399] The emotion analysis module analyzes the user's facial expressions in real time, and the AI ​​assistance function makes design suggestions based on their emotions. For example, if the user is smiling, it will suggest bright and cheerful stamp elements.

[0400] 4. User completes design and clicks upload button

[0401] The completed design is uploaded to the server, undergoes automatic review by AI, and if there are no problems, it is set up for sale.

[0402] 5. User sets sales preferences

[0403] The user enters the price and sale start date for the design, and the server stores the information.

[0404] 6. The server publishes the design to the online store at the specified date and time.

[0405] The server will publish the design according to the set schedule and begin selling it.

[0406] Prompt Sentence Examples

[0407] “If you use an emotion engine to indicate that users are in a good mood while designing, what suggestions would you make for the design?”

[0408] This system allows even beginners to create high-quality digital designs and propose designs that incorporate emotional elements.

[0409] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0410] Understood. Below, we will explain the specific operations and data processing steps.

[0411] Login process

[0412] Step 1:

[0413] The user fills out the login form

[0414] The user accesses the system login screen and enters their email address and password, for example "user@example.com" and "password123".

[0415] Enter your email address and password

[0416] Output: Login information sent to the server

[0417] Step 2:

[0418] The server performs authentication

[0419] The server checks the received login information against the database and performs authentication. If the email address is "user@example.com" and the password is "password123", authentication is successful.

[0420] Input: Submitted login information

[0421] Data processing: Retrieving user information from the database and verifying it

[0422] Output: Authentication result (success or failure)

[0423] Step 3:

[0424] The server returns the authentication result

[0425] If authentication is successful, the server returns a URL that redirects to the dashboard page, otherwise it returns an error message.

[0426] Input: Authentication result

[0427] Output: Redirect URL or error message

[0428] Digital Design Creation

[0429] Step 1:

[0430] User selects to create a new stamp

[0431] The user clicks the "Create a new stamp" button on the dashboard page.

[0432] Input: User clicks

[0433] Output: A new stamp project is started

[0434] Step 2:

[0435] The device will display the stamp creation screen.

[0436] The device will display a sticker creation screen with painting tools and image upload functionality.

[0437] Input: Start signal for stamp creation

[0438] Output: Display of stamp creation screen

[0439] Step 3:

[0440] Navigate the user interface

[0441] Users create designs using painting tools and optionally upload images, such as using the brush tool to draw a circle or an animal's face.

[0442] Input: User design operations (brush tool, image file)

[0443] Output: Design data is saved to local storage

[0444] AI Assistance and Emotion Engine

[0445] Step 1:

[0446] Launching the Sentiment Analysis Module

[0447] When the user starts designing, the device will use the built-in camera and microphone to activate the emotion analysis module.

[0448] Input: User design start

[0449] Output: Sentiment analysis module launch

[0450] Step 2:

[0451] Emotion-based suggestions

[0452] The emotion analysis module analyzes the user's facial expressions and voice to recognize their emotional state. Based on the recognized emotional state, the AI ​​assistance function makes design suggestions. For example, if the user is smiling, it will suggest bright colors and fun elements.

[0453] Input: Sentiment analysis results

[0454] Data Computation: AI-assisted functionality generates emotion-driven design suggestions

[0455] Output: Design proposal

[0456] Step 3:

[0457] Quality improvement with AI-assisted functions

[0458] The device uses AI-assisted features to make suggestions to improve the quality of your design, such as adjusting colors (brightness and contrast) or optimizing layouts (positioning objects).

[0459] Input: Current design data

[0460] Data calculation: AI-assisted functions analyze data to improve quality

[0461] Output: Quality improvement proposals

[0462] Complete and upload your design

[0463] Step 1:

[0464] The user completes the design

[0465] Once the user is satisfied with the design, they click the "Upload" button to finalize the design.

[0466] Input: User clicks

[0467] Output: Design complete signal

[0468] Step 2:

[0469] The device sends the design data to the server

[0470] The terminal transmits the design data stored in the local storage to the server.

[0471] Input: Design completion signal

[0472] Output: Sending design data to the server

[0473] Review process

[0474] Step 1:

[0475] The server receives the design data.

[0476] The server receives the uploaded design data and stores it in a database.

[0477] Input: Design data

[0478] Output: Save design data

[0479] Step 2:

[0480] The server performs an automatic review

[0481] The server uses AI algorithms to automatically review designs, specifically checking for policy violations and quality issues.

[0482] Input: Saved design data

[0483] Data calculation: AI algorithm review

[0484] Output: Review result (passed or needs correction)

[0485] Step 3:

[0486] The server notifies the user of the review results.

[0487] The server generates the review result and notifies the user. If the review is successful, the process proceeds to the next sales setting step. If corrections are required, the corrections are provided as feedback.

[0488] Input: Review results

[0489] Output: User notification

[0490] Sales Settings and Publication

[0491] Step 1:

[0492] User sets sales preferences

[0493] The user inputs the pricing and sales start date for the design that has passed the review.

[0494] Input: User setting information (price, sales start date)

[0495] Output: Sales setting information

[0496] Step 2:

[0497] The server stores the sales settings

[0498] The server stores the sales information entered by the user and prepares the sales to begin.

[0499] Input: Sales setting information

[0500] Output:Sales setting information saved

[0501] Step 3:

[0502] The server publishes it to the online store

[0503] The server publishes the digital designs to the online store according to a set schedule and starts selling them.

[0504] Input: Sales start date and time and setting information

[0505] Output: Publishing your design to your online store

[0506] These are the specific processing steps. This system allows users to easily create high-quality digital designs and improve the quality of their designs by receiving personalized design suggestions using emotion analysis.

[0507] (Application example 2)

[0508] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0509] Conventional digital design systems have had problems with not being able to detect changes in facial expressions and emotions when users create designs, or with a lack of design suggestions that reflect these. As a result, the efficiency and quality of design creation tend to decline. In addition, the operation interface is limited, and in some cases the system can only be used on certain devices. This leaves users lacking the experience they need to efficiently create better designs.

[0510] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0511] In this invention, the server includes a means for a user to create a new digital design, a means for using smart glasses as a display device for the user interface, a means for acquiring facial expression and voice data using a camera and microphone of the smart glasses, and a means for performing emotion recognition and proposing a design based on the recognized emotion. This makes it possible to recognize the user's emotion in real time using the camera and microphone of the smart glasses and provide optimal design proposals and displays based on the emotion through the user interface.

[0512] "Authentication information" refers to the identification information required for a user to access a system.

[0513] "User" refers to anyone who uses the digital design system.

[0514] The "dashboard page" is an operation screen that is displayed after a user logs in to the system.

[0515] "Digital design" is visual design or graphics created using a computer.

[0516] "User interface" refers to the screens and operating means through which a user inputs data and interacts with a system.

[0517] "AI support" is a function that uses artificial intelligence to assist users in their design work and improve quality.

[0518] "Smart glasses" are glasses-type wearable devices that incorporate functions such as AR, cameras, and microphones.

[0519] "Facial expressions" are a means of conveying emotions and intentions through facial movements.

[0520] "Voice data" is user voice information acquired through a microphone.

[0521] "Emotion recognition" is a technology that analyzes facial expressions and voice data to understand a user's emotions.

[0522] "Design suggestions" are design ideas and improvements that AI presents based on the user's emotions and input.

[0523] "Design data" refers to digital design information created by a user.

[0524] "AI review" is the process of using artificial intelligence to inspect the quality and suitability of a design.

[0525] "Sales information" refers to information such as the price and start date set when selling the design.

[0526] A "digital marketplace" is an online platform for publishing and selling digital designs.

[0527] A "drawing tool" is an instrument or software that a user uses to create a digital design.

[0528] The "image file upload function" is a function for importing external images into the system.

[0529] The "auto-save function" is a function that automatically saves the user's work at regular intervals.

[0530] This invention is a system that allows users to easily create digital designs and realize high-quality designs using AI support and emotion recognition technology. This system recognizes emotions in real time by analyzing facial expressions and voices while the user is creating digital designs using smart glasses, and proposes or modifies designs based on these emotions.

[0531] System Configuration

[0532] (Hardware)

[0533] Smart glasses: Devices with built-in cameras and microphones that capture the user's facial expressions and voice.

[0534] Server: A computing device that stores design data, provides AI support, and performs emotion recognition.

[0535] (software)

[0536] EmotionRecognizer: A library for recognizing emotions from facial expressions and speech.

[0537] DesignAIAssistant: An AI module that makes design suggestions based on emotion data.

[0538] ARInterface: An interface that displays design proposals through the augmented reality capabilities of smart glasses.

[0539] Program processing

[0540] Server: The user enters their authentication information, and the server authenticates them. If authentication is successful, the user is redirected to the operation screen. On the operation screen, the user can create a new digital design. The server automatically saves the user's design data at regular intervals, and also receives the completed design data and reviews it using AI. The user is notified of the review results.

[0541] Smart Glasses: The camera and microphone of the smart glasses are used to capture the user's facial expressions and voice data in real time, and emotions are recognized using EmotionRecognizer. Based on the recognized emotions, DesignAIAssistant makes design suggestions and displays them on the smart glasses screen through ARInterface.

[0542] Specific examples

[0543] For example, consider a user creating a new product display design. If the user is wearing smart glasses and working while smiling, EmotionRecognizer recognizes the user's facial expression as "joy." As a result, DesignAIAssistant suggests "ideas for bright, colorful displays," which are visually displayed through the ARInterface. By creating the display based on these suggestions, staff can complete more efficient and attractive displays in a shorter time.

[0544] Example prompt for a generative AI model:

[0545] Design an AI assistant that uses the camera and microphone in smart glasses to recognize staff emotions and then suggests in-store decorations and product displays based on those emotions. Suggestions should be made in real time and visually displayed through an AR interface.

[0546] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0547] Step 1:

[0548] The server receives authentication information from the user and performs authentication.

[0549] (Input) User authentication information (email address and password)

[0550] (Output) Authentication result (success or error message)

[0551] (Specific operation) The server receives the authentication information, checks it against the database, and if successful, redirects the user to the operation screen; if unsuccessful, displays an error message.

[0552] Step 2:

[0553] The user operates a user interface on the terminal to create a new digital design.

[0554] (Input) User design input (paint tool or image upload)

[0555] (Output) Design data being created

[0556] (Specific operation) The user creates a design using drawing tools and image file upload functions, and the device automatically saves the design data at regular intervals.

[0557] Step 3:

[0558] The smart glasses' camera and microphone are activated to capture the user's facial expressions and voice data.

[0559] (Input) Real-time facial expression and voice data from a camera and microphone

[0560] (Output) Acquired facial expression and voice data

[0561] (Specific operation) The smart glasses capture the user's face and record their speech.

[0562] Step 4:

[0563] The device analyzes the user's emotions from the data acquired using EmotionRecognizer.

[0564] (Input) Acquired facial expression and voice data

[0565] (Output) Analyzed emotion data (e.g., happiness, sadness, etc.)

[0566] (Specific operation) EmotionRecognizer analyzes facial expressions and voice data to extract specific emotions.

[0567] Step 5:

[0568] Based on the analyzed emotions, the device's DesignAIAssistant generates design suggestions.

[0569] (Input) Analyzed emotion data

[0570] (Output) Design proposals (color changes, layout proposals, etc.)

[0571] (Specific operation) Based on the emotion data, DesignAIAssistant generates appropriate design changes and new ideas and provides them to the user.

[0572] Step 6:

[0573] The ARInterface of the smart glasses visually displays the generated design proposal.

[0574] (Input) Generated design proposals

[0575] (Output) Design proposals displayed on the smart glasses display

[0576] (Specific operation) ARInterface overlays the suggestions on the screen of the smart glasses, providing visual feedback to the user.

[0577] Step 7:

[0578] The terminal uploads the user's completed design to the server.

[0579] (Input) Completed design data

[0580] (Output) Design data stored on the server

[0581] (Specific operation) The terminal sends the completed design data to the server, which stores it in a database.

[0582] Step 8:

[0583] The server uses AI to review the uploaded designs and notify the user of the results.

[0584] (Input) Uploaded design data

[0585] (Output) Review results (pass, corrections, etc.)

[0586] (Specific operation) The AI ​​algorithm analyzes the design data, checks for quality and policy violations, and notifies the user of the results.

[0587] Step 9:

[0588] The user sets up sales information and the server stores it.

[0589] (Input) Sales information (pricing, sales start date, etc.)

[0590] (Output)Sales information saved

[0591] (Specific operation) The user enters sales information, and the server saves it in the database.

[0592] Step 10:

[0593] The server publishes the digital design on the digital marketplace based on the set sales information.

[0594] (Input) Saved sales information and design data

[0595] (Output) Designs published on digital marketplaces

[0596] (Specific operation) The server publishes the design on the online marketplace based on the sales start date and time, and begins sales.

[0597] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0598] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0599] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0600] [Second embodiment]

[0601] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0602] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0603] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0604] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0605] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0606] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0607] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0608] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0609] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0610] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0611] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0612] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0613] Understood. Below is the "Mode for Carrying Out the Invention" from the patent specification.

[0614] The digital design system of the present invention is designed to enable users to easily create digital designs and complete the entire process from review to sale. This system allows users to log in by entering their authentication information, create a digital design, proceed with the work with AI assistance, upload the completed design to a server, and sell designs that pass review on a digital marketplace.

[0615] Login process

[0616] The user fills out the login form

[0617] The user accesses the system's login screen and enters their email address and password.

[0618] The server performs authentication

[0619] The server authenticates the user based on these credentials and redirects the user to the dashboard page if they are correct, otherwise it returns an error message.

[0620] Digital Design Creation

[0621] User selects to create a new stamp

[0622] A user clicks the "Create a New Stamp" button to start a new digital design project.

[0623] The device will display the stamp creation screen.

[0624] The device displays a user interface that includes painting tools and an image upload function, and the user uses these tools to create a digital design.

[0625] AI support function

[0626] The device provides AI assistance functions

[0627] The device will provide AI-assisted features to help users create designs more efficiently, with AI suggesting color adjustments and composition optimization.

[0628] Save and upload your design

[0629] The device will automatically save

[0630] The device automatically saves design data at regular intervals, and this data is stored in local storage, reducing the risk of data loss during work.

[0631] User completes and uploads the design

[0632] When the user completes a design to their satisfaction, they press the "upload" button to send the design data to the server.

[0633] Review process

[0634] The server receives the design data.

[0635] The server receives the uploaded design data. At this stage, the design data is saved and an AI algorithm begins automatic review.

[0636] The server notifies the review result

[0637] The server uses an AI algorithm to check the design for policy violations and quality. If the design passes the inspection, it is ready for sale. If it fails, the server notifies the user with feedback including corrections.

[0638] Sales Settings and Publication

[0639] User sets sales preferences

[0640] The user specifies the pricing and sales start date for the design.

[0641] The server stores the sales settings

[0642] The server stores the sales information set by the user and publishes the stamps on the digital marketplace on the designated publication date.

[0643] Specific examples

[0644] For example, consider the case where a user wants to create animal-themed LINE stickers. The user logs in to the system and clicks the "Create New Stickers" button. Paint tools and an image upload function are then displayed, and the user uses these tools to draw the animal stickers. AI adjusts colors and suggests placement, improving the quality of the design. The completed stickers are uploaded to the server, and after passing review, they are set up for sale. Finally, the user's animal stickers are sold on the digital marketplace.

[0645] This allows even beginners to easily create and sell high-quality digital designs. Users can work efficiently and effectively to help them sell quickly in a competitive market.

[0646] The processing flow will be explained below.

[0647] Ok, so let me explain step by step what the program does.

[0648] Step 1:

[0649] The user fills out the login form

[0650] The user accesses the system login screen and enters their email address and password.

[0651] Step 2:

[0652] The server performs authentication

[0653] The server authenticates the user based on the entered credentials and redirects them to the dashboard page if the credentials are correct, otherwise it displays an error message.

[0654] Step 3:

[0655] User selects to create a new stamp

[0656] A user clicks the "Create a New Stamp" button to begin a new digital design project.

[0657] Step 4:

[0658] The device will display the stamp creation screen.

[0659] The device displays a user interface that includes a painting tool and image upload functionality.

[0660] Step 5:

[0661] User initiates design

[0662] Users create digital designs using painting tools and upload and edit images as needed.

[0663] Step 6:

[0664] The device will automatically save

[0665] The device automatically saves design data at regular intervals and stores it in local storage.

[0666] Step 7:

[0667] The device provides AI assistance functions

[0668] The device uses AI-assisted functions to suggest improvements to design quality, such as adjusting colors and optimizing placement.

[0669] Step 8:

[0670] The user completes the design

[0671] Once the user has created a design they are happy with, they click the "upload" button.

[0672] Step 9:

[0673] The device sends the design data to the server

[0674] The terminal sends the completed design data to the server.

[0675] Step 10:

[0676] The server receives the design data.

[0677] The server receives and stores the uploaded design data.

[0678] Step 11:

[0679] The server starts the automatic review

[0680] The server uses AI algorithms to automatically review designs and check for policy violations and quality issues.

[0681] Step 12:

[0682] The server notifies the user of the review results.

[0683] The server generates the review results and notifies the user. If the product passes, it can be prepared for sale. If corrections are required, the server provides feedback on the corrections.

[0684] Step 13:

[0685] User sets sales preferences

[0686] The user specifies the pricing and sales start date for the design.

[0687] Step 14:

[0688] The server stores the sales settings

[0689] The server stores the sales information set by the user.

[0690] Step 15:

[0691] Server publishes to digital marketplace

[0692] The server will publish the design on the digital marketplace according to the set schedule and begin selling it.

[0693] The above are the specific processing steps of the program. This system allows users to easily create and sell digital designs.

[0694] Example 1

[0695] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0696] With conventional digital design systems, it was difficult for users to receive support for design creation and quality improvement, and the review process was manual, resulting in problems that reduced efficiency. There was also the risk that the created design data would be lost without being saved, which increased the burden on users. Furthermore, the process from sales setup to publication was complicated and difficult for beginners to use. To solve these issues, a new digital design system was needed.

[0697] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0698] In this invention, the server includes a means for the user to input authentication information, a means for the server to authenticate the user based on the authentication information and redirect the user to a dashboard page, and a means for the user to create a new digital design, so that the user can easily access the system and start creating a design.

[0699] The terminal also includes a means for providing a user interface and allowing the user to save the design, and a means for the terminal to provide AI assistance and for the user to improve the quality of the design, thereby enabling the user to efficiently create high-quality designs.

[0700] Furthermore, the system includes a means for users to upload completed designs to a server, a means for the server to receive the design data, review it using AI, and notify the user of the review results, a means for users to set sales information, a means for the server to save the sales settings and publish them on the digital marketplace, and a means for the device to automatically save the design data periodically, which reduces the risk of losing design data and makes the sales process more efficient.

[0701] "User" means any person who uses the Digital Design System and logs in by entering credentials to create, save, upload and sell Digital Designs.

[0702] "Authentication information" refers to information such as an email address and password that a user enters to access a system.

[0703] "Server" refers to the computer equipment that serves as the center of the digital design system and is responsible for user authentication, design data storage, review, and sales settings.

[0704] "Terminal" refers to a device used by a user to create a digital design, including a PC, smartphone, tablet, etc.

[0705] A "dashboard page" is a screen that a user can access after logging in, and provides an interface for creating and managing digital designs.

[0706] "Digital Design" means design data in digital form that a User creates, stores, uploads, and sells through the System.

[0707] "User interface" refers to the screens and controls that allow users to interact with a digital design system, including paint tools and image upload functions.

[0708] "AI support" refers to artificial intelligence-based assistance functions provided by the device during the digital design creation process, including functions such as color adjustment and composition optimization.

[0709] "Uploading" is the act of a user sending a completed digital design from their device to the system's server.

[0710] "Review" is the process in which the server uses an AI algorithm to check the design data it receives for policy violations and quality, and notifies the user of the results.

[0711] "Sales information" refers to information such as pricing and sales start date for digital designs created by users.

[0712] A "digital marketplace" is an online marketplace where user-created digital designs are published and sold.

[0713] "Auto-save" is a function that allows the device to automatically save the user's design data to local storage at specific intervals.

[0714] The digital design system of the present invention allows users to easily create digital designs and complete the entire process from review to sale. This system allows users to log in by entering their authentication information, create a digital design, proceed with the work with AI assistance, upload the completed design to a server, and sell designs that pass review on a digital marketplace.

[0715] Hardware and software used

[0716] The system mainly uses the following hardware and software:

[0717] Server: User authentication, design data storage and review, and sales settings management. For example, use an Apache server or Nginx server.

[0718] Device: The device on which a user creates a design. Examples include computers, smartphones, and tablets running browser-based or native applications.

[0719] Design tool: Software that allows users to create digital designs, such as Adobe Illustrator or GIMP.

[0720] AI Model: A generative AI model to assist in design creation, such as OpenAI's GPT-3 or Adobe Sensei.

[0721] Example of operation

[0722] 1. User authentication:

[0723] A user accesses the system's login screen and enters their email address and password. The server authenticates the user based on these credentials. If authentication is successful, the user is redirected to the dashboard page. For example, the user enters user@example.com and the appropriate password.

[0724] 2. Design Creation:

[0725] The user clicks the "Create a new stamp" button to create a new digital design. The device displays a user interface that includes painting tools and an image upload function. The user uses these tools to create a digital design.

[0726] 3. AI support:

[0727] The device provides AI assistance functions to assist users in their design tasks, such as adjusting colors, optimizing composition, and suggesting fonts. For example, the following prompts can be input to the generative AI model:

[0728] Prompt: "I'd like to create some cute stamps featuring animals like dogs and cats. Could you please give me some advice on the best color combinations and designs?"

[0729] This allows the AI ​​to provide specific color suggestions and composition advice, which the user can follow to complete the design.

[0730] 4. Save and upload your design:

[0731] The device provides a function that automatically saves design data to local storage at regular intervals. When the user completes the design and presses the "Upload" button, the design data is sent to the server. The server receives this design data and stores it in a database.

[0732] 5. Judging and Sales:

[0733] The server uses an AI algorithm to review the design for policy violations and quality. If the review passes, the user sets the sales information. The sales information is saved on the server and published on the digital marketplace on the specified publication date. For example, the user sets the price of the design to 500 yen and the sales start date to the 1st of the following month.

[0734] This makes it possible for even beginners to easily create high-quality digital designs and sell them quickly and reliably in the market.

[0735] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0736] Step 1:

[0737] The user enters their authentication information.

[0738] As input, a user enters an email address and password into a login form, filling in form fields in the UI of a browser or mobile app. The input data is sent to the server.

[0739] Step 2:

[0740] The server performs authentication based on the authentication information.

[0741] As input, the server receives an email address and password which it checks against its database. The server runs the appropriate authentication query and, if correct, creates a session and redirects the user to a dashboard page. As output, it provides the authentication status (success / failure) and a redirect URL.

[0742] Step 3:

[0743] A user creates a new digital design.

[0744] As input, the user clicks the "Create a new stamp" button. The specific action is to trigger a click event on the button. The device generates a design creation screen, displaying a painting tool and an image upload function.

[0745] Step 4:

[0746] The terminal provides a user interface and allows the user to save designs.

[0747] As input, the user creates a design using the paint tool or image upload function. Specific actions include drawing with the brush tool or selecting an image file. The created design data is obtained as output.

[0748] Step 5:

[0749] The device provides AI assistance, allowing the user to improve the quality of the design.

[0750] As input, the user receives suggestions for adjusting colors and optimizing composition while creating a design. Specific prompts are fed into the generative AI model:

[0751] Prompt: "I'd like to create some cute stamps featuring animals like dogs and cats. Could you please give me some advice on the best color combinations and designs?"

[0752] The AI ​​model then makes suggestions based on this, which the user can then accept or modify, resulting in improved design data.

[0753] Step 6:

[0754] The device automatically saves design data at regular intervals.

[0755] As input, the terminal periodically triggers a timer event to save the current design data to local storage. A specific operation is to automatically save the data every 5 minutes, for example. As output, the latest design data is saved to local storage.

[0756] Step 7:

[0757] The user uploads the completed design to the server.

[0758] As input, the user clicks the "Upload" button. The specific operation is to send the completed design data to the server. As output, the design data received by the server is obtained.

[0759] Step 8:

[0760] The server receives the design data, reviews it using AI, and notifies the user of the review results.

[0761] The server inputs the design data it receives into an AI algorithm, which checks for policy violations and quality. For example, it checks for copyright infringement or inappropriate content. The output is a review result (pass / fail), and if it fails, feedback including corrections is generated and notified to the user.

[0762] Step 9:

[0763] The user sets the sales information.

[0764] As input, the user enters the design's pricing and sales start date into an input form. The specific operation is to enter information on the sales settings screen. As output, the sales information is sent to the server and saved.

[0765] Step 10:

[0766] The server stores the selling settings and publishes them to the digital marketplace.

[0767] As input, the server publishes the design to the digital marketplace on the specified publication date based on the saved sales information. The specific operation is to publish the data using the marketplace's API. As output, the user's design is published and sales begin.

[0768] (Application example 1)

[0769] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0770] While conventional digital design systems support the creation of two-dimensional designs, they lack the ability to efficiently create designs in three-dimensional space, or to use AI to provide real-time color adjustments and composition suggestions. Furthermore, they lacked a set of integrated functions that allowed users to easily save and upload designs and sell them on a virtual marketplace, resulting in issues with overall usability. This made it difficult to improve the quality of digital designs and quickly release them to the market.

[0771] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0772] In this invention, the server includes: means for a user to input authentication information; means for the server to authenticate the user based on the authentication information and redirect the user to a dashboard page; means for a user to create a new digital design; means for providing a user interface and allowing the user to save designs; means for providing AI support and allowing the user to improve the quality of the design; means for a user to upload a completed design to the server; means for the server to receive design data, review using AI, and notify the review results; means for a user to set sales information; means for the server to save sales settings and publish them on a virtual marketplace; means for a user to create a digital design in a 3D space; and means for suggesting color adjustments and composition in real time using an AI-assisted function. This allows users to easily create and improve the quality of digital designs in a three-dimensional space, allowing them to sell on a virtual marketplace quickly and efficiently.

[0773] "User authentication" is a procedure in which the server verifies the legitimacy of a user based on the authentication information entered by the user.

[0774] "Digital design" is visual content created using a computer, typically using paint tools or graphics software.

[0775] A "user interface" is a collection of screens and elements that allow a user to interact with a system, providing the means for creating and saving designs.

[0776] "AI Support" is a function that uses artificial intelligence to assist users in improving the quality of their digital design creation, such as by adjusting colors and suggesting composition.

[0777] "Server" means a computer device on a network that stores and manages design data created by users, verifies authentication information, and reviews designs.

[0778] A "Virtual Marketplace" is a platform for exhibiting and selling digital designs online.

[0779] "3D space" is a three-dimensional virtual space represented by computer graphics in which users can create digital designs.

[0780] "Color adjustment" is the process of optimizing colors in digital designs, automatically suggesting the best shades with the help of AI.

[0781] "Composition suggestion" is a process that uses AI to present optimal layouts to users in order to optimize the placement of elements in digital designs.

[0782] The digital design system of the present invention supports the process of users easily creating digital designs in three-dimensional space, improving their quality with AI support, saving their designs, and selling them in a virtual marketplace. This system is composed of the following hardware and software.

[0783] Hardware and software used

[0784] Smartphone: A modern smartphone running iOS or Android.

[0785] software:

[0786] Unity: Rendering 3D spaces and building user interfaces.

[0787] TensorFlow: Implementing AI-assisted features and real-time color adjustment and composition suggestions.

[0788] Firebase: User authentication, design data storage, sales information management.

[0789] System Details

[0790] 1. User authentication:

[0791] A user accesses the login screen of the smartphone application and enters their email address and password. The authentication information is verified by Firebase Authentication, and if valid, the user is redirected to the virtual design studio.

[0792] 2. Design Creation:

[0793] Users create digital designs in a three-dimensional virtual space built using Unity, and can freely arrange and change design elements using painting tools and image upload functions.

[0794] 3. AI support function:

[0795] While creating a design, AI-assisted features powered by TensorFlow make real-time color adjustment and composition suggestions, helping users create high-quality designs efficiently. For example, the AI ​​can suggest a color palette that suits the user's design and suggest the optimal placement of elements.

[0796] 4. Save and upload your design:

[0797] Design data is automatically saved to Firebase Storage at regular intervals. When a user completes a design and presses the upload button, the design data is sent to the server and stored in Firebase.

[0798] 5. Review Process:

[0799] The server receives the uploaded design data and uses an AI algorithm (TensorFlow) to check the design for policy violations and quality issues. The results of the review are notified to the user, and if there are no policy violations or quality issues, the system proceeds to sales setup.

[0800] 6. Sales Settings and Publication:

[0801] Users set the price and release date for their design, which is stored in Firebase Firestore, and the design is published on the digital marketplace on the specified release date.

[0802] Specific examples

[0803] For example, consider the case where a user creates a three-dimensional digital animal-themed figurine on the Virtual Design Market. The user logs into the system and begins designing the figurine in 3D space. The AI-assisted function suggests colors and composition in real time to achieve the optimal design. The completed design is uploaded to the server, and after passing a review, it is made public on the Virtual Marketplace.

[0804] Prompt Sentence Examples

[0805] "You are an AI in a virtual design market. Users are creating animal-themed designs. Please suggest appropriate color adjustments and placement."

[0806] This allows users to utilize 3D space and AI assistance to create efficient, high-quality digital designs and quickly bring them to market.

[0807] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0808] Step 1:

[0809] A user accesses the login screen of a smartphone application and enters their email address and password. The application sends the entered authentication information to Firebase Authentication. Firebase Authentication authenticates the user based on the entered information, and if the information is valid, generates an authentication token and returns it to the application. Once the authentication token is received, the user is redirected to the virtual design studio. An error message is displayed if the entered information is invalid.

[0810] Step 2:

[0811] Users select the "Create a new design" option in the virtual design studio. This action causes the application to display a design creation screen in a three-dimensional virtual space built using Unity. The user interface includes painting tools and an image upload function, which users can use to place and modify design elements.

[0812] Step 3:

[0813] The user interface uses a TensorFlow model to provide real-time AI support as the user creates their design. When the user changes part of the design, the new design data is input into the TensorFlow model, which then outputs suggestions for color adjustments and composition. The suggestions are displayed in the user interface, allowing the user to adjust the design based on them.

[0814] Step 4:

[0815] While users are creating their designs, their design data is automatically saved to Firebase Storage at regular intervals, reducing the risk of losing data while they are working. The saved data is then uploaded to Firebase as intermediate states of the design.

[0816] Step 5:

[0817] After the user completes the design, they press the "Upload" button. This action sends the final design data to the server and stores it in Firebase Storage. The server receives this design data and records it appropriately in the administrative database.

[0818] Step 6:

[0819] The server inputs the saved design data into a TensorFlow model to check for policy violations and quality. The model analyzes the design and generates a result. The server evaluates the analysis result and notifies the user of the review result. Based on the review result, specific feedback is provided to the user if any corrections are required.

[0820] Step 7:

[0821] Once a design has passed the review, the user can set it up for sale. They can specify the sales price and start date, and enter that information. The application sends the entered information to Firebase Firestore and stores it appropriately. The design is then ready to be published on the marketplace.

[0822] Step 8:

[0823] On the sales start date, the server will publish the design on the virtual marketplace based on the saved sales settings. The published design will be available for other users to view and purchase. Information at the time of publication is updated in real time by the server, and sales status is also monitored.

[0824] This allows users to efficiently create high-quality designs in three-dimensional space and quickly begin selling them on the virtual marketplace.

[0825] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0826] Understood. Below is the "Mode for carrying out the invention" for the invention that combines an emotion engine.

[0827] This invention is a digital design system that allows users to easily create digital designs and realize high-quality designs using AI support and an emotion engine. This system supports the entire process from digital design creation to review and sales.

[0828] Login process

[0829] The user fills out the login form

[0830] The user accesses the system's login screen and enters their email address and password.

[0831] The server performs authentication

[0832] The server authenticates the user based on these credentials and redirects them to the dashboard page if the credentials are correct, otherwise it displays an error message.

[0833] Digital Design Creation

[0834] User selects to create a new stamp

[0835] A user clicks the "Create a New Stamp" button to begin a new digital design project.

[0836] The device will display the stamp creation screen.

[0837] The device displays a user interface that includes a painting tool and image upload functionality.

[0838] Navigating the User Interface

[0839] The user starts the design process, creates a digital design using the paint tool, and uploads and edits images as needed. The device automatically saves the design data at regular intervals and stores it in local storage.

[0840] AI Assistance and Emotion Engine

[0841] Activating the Emotion Engine

[0842] While the user is creating a design, the device activates an emotion engine that analyzes the user's facial expressions and voice to recognize their emotions.

[0843] Emotion-based suggestions

[0844] The emotion engine analyzes the user's emotional state, and the AI ​​assistance feature makes design suggestions and modifications based on the recognized emotion. For example, if the user is feeling down, it will suggest brighter colors and more fun design options.

[0845] Quality improvement with AI-assisted functions

[0846] The device uses AI-assisted functions to suggest improvements to design quality, such as adjusting colors and optimizing composition.

[0847] Complete and upload your design

[0848] The user completes the design

[0849] Once the user has created a design they are happy with, they click the "upload" button.

[0850] The device sends the design data to the server

[0851] The terminal sends the completed design data to the server.

[0852] Review process

[0853] The server receives the design data.

[0854] The server receives and stores the uploaded design data.

[0855] The server starts the automatic review

[0856] The server uses AI algorithms to automatically review designs and check for policy violations and quality issues.

[0857] The server notifies the user of the review results.

[0858] The server generates the review results and notifies the user. If the product passes, it can be prepared for sale. If corrections are required, the server provides feedback on the corrections.

[0859] Sales Settings and Publication

[0860] User sets sales preferences

[0861] The user specifies the pricing and sales start date for the design.

[0862] The server stores the sales settings

[0863] The server stores the sales information set by the user.

[0864] Server publishes to digital marketplace

[0865] The server publishes the digital designs on the digital marketplace according to a set schedule and starts selling them.

[0866] Specific examples

[0867] For example, consider the case where a user wants to create an animal-themed LINE sticker. The user logs in to the system and clicks the "Create a new sticker" button. They then use the paint tool or image upload function to draw an animal sticker. As they work, the emotion engine analyzes the user's facial expressions, and the AI ​​assistance function makes design suggestions based on their emotions. For example, if the user is smiling, the system will suggest adding bright and fun elements to the sticker.

[0868] The completed stamp is uploaded to the server, where it is checked for any issues through an AI review. If it passes, the user enters the price and sales start date, and the server publishes the stamp on the digital marketplace. This allows users to enjoy a more personalized design experience. This system makes it easy for even beginners to create and sell high-quality digital designs.

[0869] The processing flow will be explained below.

[0870] Okay, so let me explain the process step by step below.

[0871] Step 1:

[0872] The user fills out the login form

[0873] The user accesses the system login screen and enters their email address and password.

[0874] Step 2:

[0875] The server performs authentication

[0876] The server authenticates the user based on the entered credentials, redirects them to the dashboard page if the credentials are correct, or displays an error message if the credentials are invalid.

[0877] Step 3:

[0878] User selects to create a new stamp

[0879] A user clicks the "Create a New Stamp" button to begin a new digital design project.

[0880] Step 4:

[0881] The device will display the stamp creation screen.

[0882] The device displays a user interface that includes a painting tool and image upload functionality.

[0883] Step 5:

[0884] The device activates the emotion engine

[0885] The device launches an emotion engine and activates sensors to analyze the user's facial expressions and voice.

[0886] Step 6:

[0887] User initiates design

[0888] Users create digital designs using painting tools and upload and edit images as needed.

[0889] Step 7:

[0890] The device will automatically save

[0891] The device automatically saves design data at regular intervals and stores it in local storage.

[0892] Step 8:

[0893] The device analyzes emotions using an emotion engine

[0894] The device uses an emotion engine to analyze the user's facial expressions and voice to recognize their current emotional state.

[0895] Step 9:

[0896] The device will make emotion-based suggestions

[0897] The device uses AI-assisted features to suggest and modify designs based on the emotions it recognizes: for example, if the user is smiling, it will suggest bright colors and fun motifs.

[0898] Step 10:

[0899] The user completes the design

[0900] Once the user has created a design they are happy with, they click the "upload" button.

[0901] Step 11:

[0902] The device sends the design data to the server

[0903] The terminal sends the completed design data to the server.

[0904] Step 12:

[0905] The server receives the design data.

[0906] The server receives and stores the uploaded design data.

[0907] Step 13:

[0908] The server starts the automatic review

[0909] The server uses AI algorithms to automatically review designs and check for policy violations and quality issues.

[0910] Step 14:

[0911] The server notifies the user of the review results.

[0912] The server generates the review results and notifies the user. If the product passes, it can be prepared for sale. If corrections are required, the server provides feedback on the corrections.

[0913] Step 15:

[0914] User sets sales preferences

[0915] The user specifies the pricing and sales start date for the design.

[0916] Step 16:

[0917] The server stores the sales settings

[0918] The server stores the sales information set by the user.

[0919] Step 17:

[0920] Server publishes to digital marketplace

[0921] The server publishes the digital designs on the digital marketplace according to a set schedule and starts selling them.

[0922] The above are the specific processing steps of the invention combined with the emotion engine. This system allows users to enjoy a more personalized design experience.

[0923] Example 2

[0924] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0925] In conventional digital design systems, users had to create their own designs and rely on their own sense and experience to improve the quality. This made it difficult for beginners and users without specialized knowledge to create high-quality designs. Inconveniences were also pointed out regarding the user interface operation method and the saving and restoring of design data. Furthermore, it was difficult to incorporate emotional elements into the design, making it impossible to realize design proposals based on the user's emotional state. There is a need to provide a system that solves these issues, allows anyone to easily create high-quality digital designs, and enables proposals that take into account the emotional elements of the design.

[0926] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for a user to input authentication information; a means for the server to authenticate the user based on the authentication information and redirect the user to a dashboard page; a means for the user to create a new digital design; a means for providing a user interface and allowing the user to save designs; a means for operating the user interface to create a design; a means for launching an emotion analysis module and analyzing the user's emotional state; a means for providing AI support and proposing designs based on the emotion analysis results; a means for providing AI support and allowing the user to improve the quality of the design; a means for the user to upload the completed design to the server; a means for the server to receive design data, perform AI review, and notify the review results; a means for the user to set sales information; and a means for the server to save the sales settings and publish the design on an online store. This allows even beginners to easily create high-quality digital designs and propose designs that incorporate emotional elements.

[0927] Understood. Below are definitions of important terms found in the claims:

[0928] "User" refers to an individual or organization that uses the System.

[0929] "Authentication information" refers to information used to verify the identity of a user, and specifically includes an ID and password.

[0930] "Server" refers to a computer system that stores, processes, and manages data.

[0931] "Dashboard page" refers to the main operation screen that users can access after logging in.

[0932] "Digital design" refers to any visual content created using a computer.

[0933] "User interface" refers to the screen and operation means that allow a user to operate the system.

[0934] "Paint tool" refers to an on-screen drawing tool used to create digital designs.

[0935] "Image upload function" refers to the function for importing image files into the system.

[0936] An "emotion analysis module" refers to software or hardware for analyzing a user's facial expressions and voice to recognize their emotional state.

[0937] "AI support" refers to a function that uses artificial intelligence to support design suggestions and quality improvement.

[0938] "Design Data" refers to a user-created digital design file and associated metadata.

[0939] "Review" refers to the quality check and policy violation detection performed by AI on uploaded design data.

[0940] "Online Store" means a web-based marketplace for the sale of Digital Designs.

[0941] "Sales Information" refers to the setting information such as price and sales start date required to sell a Digital Design.

[0942] This provides clear definitions of key terms used in the claims.

[0943] This invention is a digital design system that allows users to easily create digital designs and realize high-quality designs using AI support and emotion analysis technology. This system supports a series of processes from digital design creation to review and sales, and can be implemented as follows:

[0944] Hardware and Software Used

[0945] To implement this system, the following hardware and software are used.

[0946] Server: A server system for storing, processing, and managing data.

[0947] Device: The computer, tablet, or smartphone used by the user.

[0948] User interface: Delivered as a web or mobile application.

[0949] Painting tools and image uploading functionality: A set of tools for creating designs.

[0950] Emotion Analysis Module: Uses the camera for facial expression analysis and the microphone for voice analysis.

[0951] AI-assisted features: Generative AI models for design suggestions and quality improvement.

[0952] Data processing and calculation

[0953] Authentication process: The email address and password entered by the user are authenticated on the server, and if authentication is successful, the user is redirected to the dashboard page.

[0954] Design creation: The device provides a painting tool and image upload function, allowing users to create designs through a user interface.

[0955] Emotion Analysis: The emotion analysis module analyzes the user's facial expressions and voice in real time to recognize the user's emotional state.

[0956] AI assistance: A generative AI model makes design suggestions based on the results of sentiment analysis, helping to improve design quality by adjusting color tones and optimizing layouts.

[0957] Saving and uploading designs: The device automatically saves design data to local storage at regular intervals and uploads completed design data to the server.

[0958] Automated review: The server receives the uploaded design data and uses AI algorithms to check the quality and detect policy violations.

[0959] Sales Settings and Publish: The server stores the pricing and sales start date information you entered and publishes the design to the online store at the specified date and time.

[0960] Specific examples

[0961] For example, if a user wants to create an animal-themed LINE stamp, they would perform the following operations.

[0962] 1. A user logs into the system

[0963] The user logs in to the system by entering the email address "user@example.com" and the password "password123".

[0964] 2. Click the Create New Stamp button

[0965] Users click the "Create a new stamp" button and use the painting tools and image upload function to draw an animal stamp.

[0966] 3. The emotion analysis module analyzes the user's facial expressions

[0967] The emotion analysis module analyzes the user's facial expressions in real time, and the AI ​​assistance function makes design suggestions based on their emotions. For example, if the user is smiling, it will suggest bright and cheerful stamp elements.

[0968] 4. User completes design and clicks upload button

[0969] The completed design is uploaded to the server, undergoes automatic review by AI, and if there are no problems, it is set up for sale.

[0970] 5. User sets sales preferences

[0971] The user enters the price and sale start date for the design, and the server stores the information.

[0972] 6. The server publishes the design to the online store at the specified date and time.

[0973] The server will publish the design according to the set schedule and begin selling it.

[0974] Prompt Sentence Examples

[0975] “If you use an emotion engine to indicate that users are in a good mood while designing, what suggestions would you make for the design?”

[0976] This system allows even beginners to create high-quality digital designs and propose designs that incorporate emotional elements.

[0977] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0978] Understood. Below, we will explain the specific operations and data processing steps.

[0979] Login process

[0980] Step 1:

[0981] The user fills out the login form

[0982] The user accesses the system login screen and enters their email address and password, for example "user@example.com" and "password123".

[0983] Enter your email address and password

[0984] Output: Login information sent to the server

[0985] Step 2:

[0986] The server performs authentication

[0987] The server checks the received login information against the database and performs authentication. If the email address is "user@example.com" and the password is "password123", authentication is successful.

[0988] Input: Submitted login information

[0989] Data processing: Retrieving user information from the database and verifying it

[0990] Output: Authentication result (success or failure)

[0991] Step 3:

[0992] The server returns the authentication result

[0993] If authentication is successful, the server returns a URL that redirects to the dashboard page, otherwise it returns an error message.

[0994] Input: Authentication result

[0995] Output: Redirect URL or error message

[0996] Digital Design Creation

[0997] Step 1:

[0998] User selects to create a new stamp

[0999] The user clicks the "Create a new stamp" button on the dashboard page.

[1000] Input: User clicks

[1001] Output: A new stamp project is started

[1002] Step 2:

[1003] The device will display the stamp creation screen.

[1004] The device will display a sticker creation screen with painting tools and image upload functionality.

[1005] Input: Start signal for stamp creation

[1006] Output: Display of stamp creation screen

[1007] Step 3:

[1008] Navigate the user interface

[1009] Users create designs using painting tools and optionally upload images, such as using the brush tool to draw a circle or an animal's face.

[1010] Input: User design operations (brush tool, image file)

[1011] Output: Design data is saved to local storage

[1012] AI Assistance and Emotion Engine

[1013] Step 1:

[1014] Launching the Sentiment Analysis Module

[1015] When the user starts designing, the device will use the built-in camera and microphone to activate the emotion analysis module.

[1016] Input: User design start

[1017] Output: Sentiment analysis module launch

[1018] Step 2:

[1019] Emotion-based suggestions

[1020] The emotion analysis module analyzes the user's facial expressions and voice to recognize their emotional state. Based on the recognized emotional state, the AI ​​assistance function makes design suggestions. For example, if the user is smiling, it will suggest bright colors and fun elements.

[1021] Input: Sentiment analysis results

[1022] Data Computation: AI-assisted functionality generates emotion-driven design suggestions

[1023] Output: Design proposal

[1024] Step 3:

[1025] Quality improvement with AI-assisted functions

[1026] The device uses AI-assisted features to make suggestions to improve the quality of your design, such as adjusting colors (brightness and contrast) or optimizing layouts (positioning objects).

[1027] Input: Current design data

[1028] Data calculation: AI-assisted functions analyze data to improve quality

[1029] Output: Quality improvement proposals

[1030] Complete and upload your design

[1031] Step 1:

[1032] The user completes the design

[1033] Once the user is satisfied with the design, they click the "Upload" button to finalize the design.

[1034] Input: User clicks

[1035] Output: Design complete signal

[1036] Step 2:

[1037] The device sends the design data to the server

[1038] The terminal transmits the design data stored in the local storage to the server.

[1039] Input: Design completion signal

[1040] Output: Sending design data to the server

[1041] Review process

[1042] Step 1:

[1043] The server receives the design data.

[1044] The server receives the uploaded design data and stores it in a database.

[1045] Input: Design data

[1046] Output: Save design data

[1047] Step 2:

[1048] The server performs an automatic review

[1049] The server uses AI algorithms to automatically review designs, specifically checking for policy violations and quality issues.

[1050] Input: Saved design data

[1051] Data calculation: AI algorithm review

[1052] Output: Review result (passed or needs correction)

[1053] Step 3:

[1054] The server notifies the user of the review results.

[1055] The server generates the review result and notifies the user. If the review is successful, the process proceeds to the next sales setting step. If corrections are required, the corrections are provided as feedback.

[1056] Input: Review results

[1057] Output: User notification

[1058] Sales Settings and Publication

[1059] Step 1:

[1060] User sets sales preferences

[1061] The user inputs the pricing and sales start date for the design that has passed the review.

[1062] Input: User setting information (price, sales start date)

[1063] Output: Sales setting information

[1064] Step 2:

[1065] The server stores the sales settings

[1066] The server stores the sales information entered by the user and prepares the sales to begin.

[1067] Input: Sales setting information

[1068] Output:Sales setting information saved

[1069] Step 3:

[1070] The server publishes it to the online store

[1071] The server publishes the digital designs to the online store according to a set schedule and starts selling them.

[1072] Input: Sales start date and time and setting information

[1073] Output: Publishing your design to your online store

[1074] These are the specific processing steps. This system allows users to easily create high-quality digital designs and improve the quality of their designs by receiving personalized design suggestions using emotion analysis.

[1075] (Application example 2)

[1076] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1077] Conventional digital design systems have had problems with not being able to detect changes in facial expressions and emotions when users create designs, or with a lack of design suggestions that reflect these. As a result, the efficiency and quality of design creation tend to decline. In addition, the operation interface is limited, and in some cases the system can only be used on certain devices. This leaves users lacking the experience they need to efficiently create better designs.

[1078] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1079] In this invention, the server includes a means for a user to create a new digital design, a means for using smart glasses as a display device for the user interface, a means for acquiring facial expression and voice data using a camera and microphone of the smart glasses, and a means for performing emotion recognition and proposing a design based on the recognized emotion. This makes it possible to recognize the user's emotion in real time using the camera and microphone of the smart glasses and provide optimal design proposals and displays based on the emotion through the user interface.

[1080] "Authentication information" refers to the identification information required for a user to access a system.

[1081] "User" refers to anyone who uses the digital design system.

[1082] The "dashboard page" is an operation screen that is displayed after a user logs in to the system.

[1083] "Digital design" is visual design or graphics created using a computer.

[1084] "User interface" refers to the screens and operating means through which a user inputs data and interacts with a system.

[1085] "AI support" is a function that uses artificial intelligence to assist users in their design work and improve quality.

[1086] "Smart glasses" are glasses-type wearable devices that incorporate functions such as AR, cameras, and microphones.

[1087] "Facial expressions" are a means of conveying emotions and intentions through facial movements.

[1088] "Voice data" is user voice information acquired through a microphone.

[1089] "Emotion recognition" is a technology that analyzes facial expressions and voice data to understand a user's emotions.

[1090] "Design suggestions" are design ideas and improvements that AI presents based on the user's emotions and input.

[1091] "Design data" refers to digital design information created by a user.

[1092] "AI review" is the process of using artificial intelligence to inspect the quality and suitability of a design.

[1093] "Sales information" refers to information such as the price and start date set when selling the design.

[1094] A "digital marketplace" is an online platform for publishing and selling digital designs.

[1095] A "drawing tool" is an instrument or software that a user uses to create a digital design.

[1096] The "image file upload function" is a function for importing external images into the system.

[1097] The "auto-save function" is a function that automatically saves the user's work at regular intervals.

[1098] This invention is a system that allows users to easily create digital designs and realize high-quality designs using AI support and emotion recognition technology. This system recognizes emotions in real time by analyzing facial expressions and voices while the user is creating digital designs using smart glasses, and proposes or modifies designs based on these emotions.

[1099] System Configuration

[1100] (Hardware)

[1101] Smart glasses: Devices with built-in cameras and microphones that capture the user's facial expressions and voice.

[1102] Server: A computing device that stores design data, provides AI support, and performs emotion recognition.

[1103] (software)

[1104] EmotionRecognizer: A library for recognizing emotions from facial expressions and speech.

[1105] DesignAIAssistant: An AI module that makes design suggestions based on emotion data.

[1106] ARInterface: An interface that displays design proposals through the augmented reality capabilities of smart glasses.

[1107] Program processing

[1108] Server: The user enters their authentication information, and the server authenticates them. If authentication is successful, the user is redirected to the operation screen. On the operation screen, the user can create a new digital design. The server automatically saves the user's design data at regular intervals, and also receives the completed design data and reviews it using AI. The user is notified of the review results.

[1109] Smart Glasses: The camera and microphone of the smart glasses are used to capture the user's facial expressions and voice data in real time, and emotions are recognized using EmotionRecognizer. Based on the recognized emotions, DesignAIAssistant makes design suggestions and displays them on the smart glasses screen through ARInterface.

[1110] Specific examples

[1111] For example, consider a user creating a new product display design. If the user is wearing smart glasses and working while smiling, EmotionRecognizer recognizes the user's facial expression as "joy." As a result, DesignAIAssistant suggests "ideas for bright, colorful displays," which are visually displayed through the ARInterface. By creating the display based on these suggestions, staff can complete more efficient and attractive displays in a shorter time.

[1112] Example prompt for a generative AI model:

[1113] Design an AI assistant that uses the camera and microphone in smart glasses to recognize staff emotions and then suggests in-store decorations and product displays based on those emotions. Suggestions should be made in real time and visually displayed through an AR interface.

[1114] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1115] Step 1:

[1116] The server receives authentication information from the user and performs authentication.

[1117] (Input) User authentication information (email address and password)

[1118] (Output) Authentication result (success or error message)

[1119] (Specific operation) The server receives the authentication information, checks it against the database, and if successful, redirects the user to the operation screen; if unsuccessful, displays an error message.

[1120] Step 2:

[1121] The user operates a user interface on the terminal to create a new digital design.

[1122] (Input) User design input (paint tool or image upload)

[1123] (Output) Design data being created

[1124] (Specific operation) The user creates a design using drawing tools and image file upload functions, and the device automatically saves the design data at regular intervals.

[1125] Step 3:

[1126] The smart glasses' camera and microphone are activated to capture the user's facial expressions and voice data.

[1127] (Input) Real-time facial expression and voice data from a camera and microphone

[1128] (Output) Acquired facial expression and voice data

[1129] (Specific operation) The smart glasses capture the user's face and record their speech.

[1130] Step 4:

[1131] The device analyzes the user's emotions from the data acquired using EmotionRecognizer.

[1132] (Input) Acquired facial expression and voice data

[1133] (Output) Analyzed emotion data (e.g., happiness, sadness, etc.)

[1134] (Specific operation) EmotionRecognizer analyzes facial expressions and voice data to extract specific emotions.

[1135] Step 5:

[1136] Based on the analyzed emotions, the device's DesignAIAssistant generates design suggestions.

[1137] (Input) Analyzed emotion data

[1138] (Output) Design proposals (color changes, layout proposals, etc.)

[1139] (Specific operation) Based on the emotion data, DesignAIAssistant generates appropriate design changes and new ideas and provides them to the user.

[1140] Step 6:

[1141] The ARInterface of the smart glasses visually displays the generated design proposal.

[1142] (Input) Generated design proposals

[1143] (Output) Design proposals displayed on the smart glasses display

[1144] (Specific operation) ARInterface overlays the suggestions on the screen of the smart glasses, providing visual feedback to the user.

[1145] Step 7:

[1146] The terminal uploads the user's completed design to the server.

[1147] (Input) Completed design data

[1148] (Output) Design data stored on the server

[1149] (Specific operation) The terminal sends the completed design data to the server, which stores it in a database.

[1150] Step 8:

[1151] The server uses AI to review the uploaded designs and notify the user of the results.

[1152] (Input) Uploaded design data

[1153] (Output) Review results (pass, corrections, etc.)

[1154] (Specific operation) The AI ​​algorithm analyzes the design data, checks for quality and policy violations, and notifies the user of the results.

[1155] Step 9:

[1156] The user sets up sales information and the server stores it.

[1157] (Input) Sales information (pricing, sales start date, etc.)

[1158] (Output)Sales information saved

[1159] (Specific operation) The user enters sales information, and the server saves it in the database.

[1160] Step 10:

[1161] The server publishes the digital design on the digital marketplace based on the set sales information.

[1162] (Input) Saved sales information and design data

[1163] (Output) Designs published on digital marketplaces

[1164] (Specific operation) The server publishes the design on the online marketplace based on the sales start date and time, and begins sales.

[1165] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1166] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1167] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1168] [Third embodiment]

[1169] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1170] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1171] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1172] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1173] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1174] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1175] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1176] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1177] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1178] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1179] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1180] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1181] Understood. Below is the "Mode for Carrying Out the Invention" from the patent specification.

[1182] The digital design system of the present invention is designed to enable users to easily create digital designs and complete the entire process from review to sale. This system allows users to log in by entering their authentication information, create a digital design, proceed with the work with AI assistance, upload the completed design to a server, and sell designs that pass review on a digital marketplace.

[1183] Login process

[1184] The user fills out the login form

[1185] The user accesses the system's login screen and enters their email address and password.

[1186] The server performs authentication

[1187] The server authenticates the user based on these credentials and redirects the user to the dashboard page if they are correct, otherwise it returns an error message.

[1188] Digital Design Creation

[1189] User selects to create a new stamp

[1190] A user clicks the "Create a New Stamp" button to start a new digital design project.

[1191] The device will display the stamp creation screen.

[1192] The device displays a user interface that includes painting tools and an image upload function, and the user uses these tools to create a digital design.

[1193] AI support function

[1194] The device provides AI assistance functions

[1195] The device will provide AI-assisted features to help users create designs more efficiently, with AI suggesting color adjustments and composition optimization.

[1196] Save and upload your design

[1197] The device will automatically save

[1198] The device automatically saves design data at regular intervals, and this data is stored in local storage, reducing the risk of data loss during work.

[1199] User completes and uploads the design

[1200] When the user completes a design to their satisfaction, they press the "upload" button to send the design data to the server.

[1201] Review process

[1202] The server receives the design data.

[1203] The server receives the uploaded design data. At this stage, the design data is saved and an AI algorithm begins automatic review.

[1204] The server notifies the review result

[1205] The server uses an AI algorithm to check the design for policy violations and quality. If the design passes the inspection, it is ready for sale. If it fails, the server notifies the user with feedback including corrections.

[1206] Sales Settings and Publication

[1207] User sets sales preferences

[1208] The user specifies the pricing and sales start date for the design.

[1209] The server stores the sales settings

[1210] The server stores the sales information set by the user and publishes the stamps on the digital marketplace on the designated publication date.

[1211] Specific examples

[1212] For example, consider the case where a user wants to create animal-themed LINE stickers. The user logs in to the system and clicks the "Create New Stickers" button. Paint tools and an image upload function are then displayed, and the user uses these tools to draw the animal stickers. AI adjusts colors and suggests placement, improving the quality of the design. The completed stickers are uploaded to the server, and after passing review, they are set up for sale. Finally, the user's animal stickers are sold on the digital marketplace.

[1213] This allows even beginners to easily create and sell high-quality digital designs. Users can work efficiently and effectively to help them sell quickly in a competitive market.

[1214] The processing flow will be explained below.

[1215] Ok, so let me explain step by step what the program does.

[1216] Step 1:

[1217] The user fills out the login form

[1218] The user accesses the system login screen and enters their email address and password.

[1219] Step 2:

[1220] The server performs authentication

[1221] The server authenticates the user based on the entered credentials and redirects them to the dashboard page if the credentials are correct, otherwise it displays an error message.

[1222] Step 3:

[1223] User selects to create a new stamp

[1224] A user clicks the "Create a New Stamp" button to begin a new digital design project.

[1225] Step 4:

[1226] The device will display the stamp creation screen.

[1227] The device displays a user interface that includes a painting tool and image upload functionality.

[1228] Step 5:

[1229] User initiates design

[1230] Users create digital designs using painting tools and upload and edit images as needed.

[1231] Step 6:

[1232] The device will automatically save

[1233] The device automatically saves design data at regular intervals and stores it in local storage.

[1234] Step 7:

[1235] The device provides AI assistance functions

[1236] The device uses AI-assisted functions to suggest improvements to design quality, such as adjusting colors and optimizing placement.

[1237] Step 8:

[1238] The user completes the design

[1239] Once the user has created a design they are happy with, they click the "upload" button.

[1240] Step 9:

[1241] The device sends the design data to the server

[1242] The terminal sends the completed design data to the server.

[1243] Step 10:

[1244] The server receives the design data.

[1245] The server receives and stores the uploaded design data.

[1246] Step 11:

[1247] The server starts the automatic review

[1248] The server uses AI algorithms to automatically review designs and check for policy violations and quality issues.

[1249] Step 12:

[1250] The server notifies the user of the review results.

[1251] The server generates the review results and notifies the user. If the product passes, it can be prepared for sale. If corrections are required, the server provides feedback on the corrections.

[1252] Step 13:

[1253] User sets sales preferences

[1254] The user specifies the pricing and sales start date for the design.

[1255] Step 14:

[1256] The server stores the sales settings

[1257] The server stores the sales information set by the user.

[1258] Step 15:

[1259] Server publishes to digital marketplace

[1260] The server will publish the design on the digital marketplace according to the set schedule and begin selling it.

[1261] The above are the specific processing steps of the program. This system allows users to easily create and sell digital designs.

[1262] Example 1

[1263] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1264] With conventional digital design systems, it was difficult for users to receive support for design creation and quality improvement, and the review process was manual, resulting in problems that reduced efficiency. There was also the risk that the created design data would be lost without being saved, which increased the burden on users. Furthermore, the process from sales setup to publication was complicated and difficult for beginners to use. To solve these issues, a new digital design system was needed.

[1265] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1266] In this invention, the server includes a means for the user to input authentication information, a means for the server to authenticate the user based on the authentication information and redirect the user to a dashboard page, and a means for the user to create a new digital design, so that the user can easily access the system and start creating a design.

[1267] The terminal also includes a means for providing a user interface and allowing the user to save the design, and a means for the terminal to provide AI assistance and for the user to improve the quality of the design, thereby enabling the user to efficiently create high-quality designs.

[1268] Furthermore, the system includes a means for users to upload completed designs to a server, a means for the server to receive the design data, review it using AI, and notify the user of the review results, a means for users to set sales information, a means for the server to save the sales settings and publish them on the digital marketplace, and a means for the device to automatically save the design data periodically, which reduces the risk of losing design data and makes the sales process more efficient.

[1269] "User" means any person who uses the Digital Design System and logs in by entering credentials to create, save, upload and sell Digital Designs.

[1270] "Authentication information" refers to information such as an email address and password that a user enters to access a system.

[1271] "Server" refers to the computer equipment that serves as the center of the digital design system and is responsible for user authentication, design data storage, review, and sales settings.

[1272] "Terminal" refers to a device used by a user to create a digital design, including a PC, smartphone, tablet, etc.

[1273] A "dashboard page" is a screen that a user can access after logging in, and provides an interface for creating and managing digital designs.

[1274] "Digital Design" means design data in digital form that a User creates, stores, uploads, and sells through the System.

[1275] "User interface" refers to the screens and controls that allow users to interact with a digital design system, including paint tools and image upload functions.

[1276] "AI support" refers to artificial intelligence-based assistance functions provided by the device during the digital design creation process, including functions such as color adjustment and composition optimization.

[1277] "Uploading" is the act of a user sending a completed digital design from their device to the system's server.

[1278] "Review" is the process in which the server uses an AI algorithm to check the design data it receives for policy violations and quality, and notifies the user of the results.

[1279] "Sales information" refers to information such as pricing and sales start date for digital designs created by users.

[1280] A "digital marketplace" is an online marketplace where user-created digital designs are published and sold.

[1281] "Auto-save" is a function that allows the device to automatically save the user's design data to local storage at specific intervals.

[1282] The digital design system of the present invention allows users to easily create digital designs and complete the entire process from review to sale. This system allows users to log in by entering their authentication information, create a digital design, proceed with the work with AI assistance, upload the completed design to a server, and sell designs that pass review on a digital marketplace.

[1283] Hardware and software used

[1284] The system mainly uses the following hardware and software:

[1285] Server: User authentication, design data storage and review, and sales settings management. For example, use an Apache server or Nginx server.

[1286] Device: The device on which a user creates a design. Examples include computers, smartphones, and tablets running browser-based or native applications.

[1287] Design tool: Software that allows users to create digital designs, such as Adobe Illustrator or GIMP.

[1288] AI Model: A generative AI model to assist in design creation, such as OpenAI's GPT-3 or Adobe Sensei.

[1289] Example of operation

[1290] 1. User authentication:

[1291] A user accesses the system's login screen and enters their email address and password. The server authenticates the user based on these credentials. If authentication is successful, the user is redirected to the dashboard page. For example, the user enters user@example.com and the appropriate password.

[1292] 2. Design Creation:

[1293] The user clicks the "Create a new stamp" button to create a new digital design. The device displays a user interface that includes painting tools and an image upload function. The user uses these tools to create a digital design.

[1294] 3. AI support:

[1295] The device provides AI assistance functions to assist users in their design tasks, such as adjusting colors, optimizing composition, and suggesting fonts. For example, the following prompts can be input to the generative AI model:

[1296] Prompt: "I'd like to create some cute stamps featuring animals like dogs and cats. Could you please give me some advice on the best color combinations and designs?"

[1297] This allows the AI ​​to provide specific color suggestions and composition advice, which the user can follow to complete the design.

[1298] 4. Save and upload your design:

[1299] The device provides a function that automatically saves design data to local storage at regular intervals. When the user completes the design and presses the "Upload" button, the design data is sent to the server. The server receives this design data and stores it in a database.

[1300] 5. Judging and Sales:

[1301] The server uses an AI algorithm to review the design for policy violations and quality. If the review passes, the user sets the sales information. The sales information is saved on the server and published on the digital marketplace on the specified publication date. For example, the user sets the price of the design to 500 yen and the sales start date to the 1st of the following month.

[1302] This makes it possible for even beginners to easily create high-quality digital designs and sell them quickly and reliably in the market.

[1303] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1304] Step 1:

[1305] The user enters their authentication information.

[1306] As input, a user enters an email address and password into a login form, filling in form fields in the UI of a browser or mobile app. The input data is sent to the server.

[1307] Step 2:

[1308] The server performs authentication based on the authentication information.

[1309] As input, the server receives an email address and password which it checks against its database. The server runs the appropriate authentication query and, if correct, creates a session and redirects the user to a dashboard page. As output, it provides the authentication status (success / failure) and a redirect URL.

[1310] Step 3:

[1311] A user creates a new digital design.

[1312] As input, the user clicks the "Create a new stamp" button. The specific action is to trigger a click event on the button. The device generates a design creation screen, displaying a painting tool and an image upload function.

[1313] Step 4:

[1314] The terminal provides a user interface and allows the user to save designs.

[1315] As input, the user creates a design using the paint tool or image upload function. Specific actions include drawing with the brush tool or selecting an image file. The created design data is obtained as output.

[1316] Step 5:

[1317] The device provides AI assistance, allowing the user to improve the quality of the design.

[1318] As input, the user receives suggestions for adjusting colors and optimizing composition while creating a design. Specific prompts are fed into the generative AI model:

[1319] Prompt: "I'd like to create some cute stamps featuring animals like dogs and cats. Could you please give me some advice on the best color combinations and designs?"

[1320] The AI ​​model then makes suggestions based on this, which the user can then accept or modify, resulting in improved design data.

[1321] Step 6:

[1322] The device automatically saves design data at regular intervals.

[1323] As input, the terminal periodically triggers a timer event to save the current design data to local storage. A specific operation is to automatically save the data every 5 minutes, for example. As output, the latest design data is saved to local storage.

[1324] Step 7:

[1325] The user uploads the completed design to the server.

[1326] As input, the user clicks the "Upload" button. The specific operation is to send the completed design data to the server. As output, the design data received by the server is obtained.

[1327] Step 8:

[1328] The server receives the design data, reviews it using AI, and notifies the user of the review results.

[1329] The server inputs the design data it receives into an AI algorithm, which checks for policy violations and quality. For example, it checks for copyright infringement or inappropriate content. The output is a review result (pass / fail), and if it fails, feedback including corrections is generated and notified to the user.

[1330] Step 9:

[1331] The user sets the sales information.

[1332] As input, the user enters the design's pricing and sales start date into an input form. The specific operation is to enter information on the sales settings screen. As output, the sales information is sent to the server and saved.

[1333] Step 10:

[1334] The server stores the selling settings and publishes them to the digital marketplace.

[1335] As input, the server publishes the design to the digital marketplace on the specified publication date based on the saved sales information. The specific operation is to publish the data using the marketplace's API. As output, the user's design is published and sales begin.

[1336] (Application example 1)

[1337] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1338] While conventional digital design systems support the creation of two-dimensional designs, they lack the ability to efficiently create designs in three-dimensional space, or to use AI to provide real-time color adjustments and composition suggestions. Furthermore, they lacked a set of integrated functions that allowed users to easily save and upload designs and sell them on a virtual marketplace, resulting in issues with overall usability. This made it difficult to improve the quality of digital designs and quickly release them to the market.

[1339] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1340] In this invention, the server includes: means for a user to input authentication information; means for the server to authenticate the user based on the authentication information and redirect the user to a dashboard page; means for a user to create a new digital design; means for providing a user interface and allowing the user to save designs; means for providing AI support and allowing the user to improve the quality of the design; means for a user to upload a completed design to the server; means for the server to receive design data, review using AI, and notify the review results; means for a user to set sales information; means for the server to save sales settings and publish them on a virtual marketplace; means for a user to create a digital design in a 3D space; and means for suggesting color adjustments and composition in real time using an AI-assisted function. This allows users to easily create and improve the quality of digital designs in a three-dimensional space, allowing them to sell on a virtual marketplace quickly and efficiently.

[1341] "User authentication" is a procedure in which the server verifies the legitimacy of a user based on the authentication information entered by the user.

[1342] "Digital design" is visual content created using a computer, typically using paint tools or graphics software.

[1343] A "user interface" is a collection of screens and elements that allow a user to interact with a system, providing the means for creating and saving designs.

[1344] "AI Support" is a function that uses artificial intelligence to assist users in improving the quality of their digital design creation, such as by adjusting colors and suggesting composition.

[1345] "Server" means a computer device on a network that stores and manages design data created by users, verifies authentication information, and reviews designs.

[1346] A "Virtual Marketplace" is a platform for exhibiting and selling digital designs online.

[1347] "3D space" is a three-dimensional virtual space represented by computer graphics in which users can create digital designs.

[1348] "Color adjustment" is the process of optimizing colors in digital designs, automatically suggesting the best shades with the help of AI.

[1349] "Composition suggestion" is a process that uses AI to present optimal layouts to users in order to optimize the placement of elements in digital designs.

[1350] The digital design system of the present invention supports the process of users easily creating digital designs in three-dimensional space, improving their quality with AI support, saving their designs, and selling them in a virtual marketplace. This system is composed of the following hardware and software.

[1351] Hardware and software used

[1352] Smartphone: A modern smartphone running iOS or Android.

[1353] software:

[1354] Unity: Rendering 3D spaces and building user interfaces.

[1355] TensorFlow: Implementing AI-assisted features and real-time color adjustment and composition suggestions.

[1356] Firebase: User authentication, design data storage, sales information management.

[1357] System Details

[1358] 1. User authentication:

[1359] A user accesses the login screen of the smartphone application and enters their email address and password. The authentication information is verified by Firebase Authentication, and if valid, the user is redirected to the virtual design studio.

[1360] 2. Design Creation:

[1361] Users create digital designs in a three-dimensional virtual space built using Unity, and can freely arrange and change design elements using painting tools and image upload functions.

[1362] 3. AI support function:

[1363] While creating a design, AI-assisted features powered by TensorFlow make real-time color adjustment and composition suggestions, helping users create high-quality designs efficiently. For example, the AI ​​can suggest a color palette that suits the user's design and suggest the optimal placement of elements.

[1364] 4. Save and upload your design:

[1365] Design data is automatically saved to Firebase Storage at regular intervals. When a user completes a design and presses the upload button, the design data is sent to the server and stored in Firebase.

[1366] 5. Review Process:

[1367] The server receives the uploaded design data and uses an AI algorithm (TensorFlow) to check the design for policy violations and quality issues. The results of the review are notified to the user, and if there are no policy violations or quality issues, the system proceeds to sales setup.

[1368] 6. Sales Settings and Publication:

[1369] Users set the price and release date for their design, which is stored in Firebase Firestore, and the design is published on the digital marketplace on the specified release date.

[1370] Specific examples

[1371] For example, consider the case where a user creates a three-dimensional digital animal-themed figurine on the Virtual Design Market. The user logs into the system and begins designing the figurine in 3D space. The AI-assisted function suggests colors and composition in real time to achieve the optimal design. The completed design is uploaded to the server, and after passing a review, it is made public on the Virtual Marketplace.

[1372] Prompt Sentence Examples

[1373] "You are an AI in a virtual design market. Users are creating animal-themed designs. Please suggest appropriate color adjustments and placement."

[1374] This allows users to utilize 3D space and AI assistance to create efficient, high-quality digital designs and quickly bring them to market.

[1375] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1376] Step 1:

[1377] A user accesses the login screen of a smartphone application and enters their email address and password. The application sends the entered authentication information to Firebase Authentication. Firebase Authentication authenticates the user based on the entered information, and if the information is valid, generates an authentication token and returns it to the application. Once the authentication token is received, the user is redirected to the virtual design studio. An error message is displayed if the entered information is invalid.

[1378] Step 2:

[1379] Users select the "Create a new design" option in the virtual design studio. This action causes the application to display a design creation screen in a three-dimensional virtual space built using Unity. The user interface includes painting tools and an image upload function, which users can use to place and modify design elements.

[1380] Step 3:

[1381] The user interface uses a TensorFlow model to provide real-time AI support as the user creates their design. When the user changes part of the design, the new design data is input into the TensorFlow model, which then outputs suggestions for color adjustments and composition. The suggestions are displayed in the user interface, allowing the user to adjust the design based on them.

[1382] Step 4:

[1383] While users are creating their designs, their design data is automatically saved to Firebase Storage at regular intervals, reducing the risk of losing data while they are working. The saved data is then uploaded to Firebase as intermediate states of the design.

[1384] Step 5:

[1385] After the user completes the design, they press the "Upload" button. This action sends the final design data to the server and stores it in Firebase Storage. The server receives this design data and records it appropriately in the administrative database.

[1386] Step 6:

[1387] The server inputs the saved design data into a TensorFlow model to check for policy violations and quality. The model analyzes the design and generates a result. The server evaluates the analysis result and notifies the user of the review result. Based on the review result, specific feedback is provided to the user if any corrections are required.

[1388] Step 7:

[1389] Once a design has passed the review, the user can set it up for sale. They can specify the sales price and start date, and enter that information. The application sends the entered information to Firebase Firestore and stores it appropriately. The design is then ready to be published on the marketplace.

[1390] Step 8:

[1391] On the sales start date, the server will publish the design on the virtual marketplace based on the saved sales settings. The published design will be available for other users to view and purchase. Information at the time of publication is updated in real time by the server, and sales status is also monitored.

[1392] This allows users to efficiently create high-quality designs in three-dimensional space and quickly begin selling them on the virtual marketplace.

[1393] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1394] Understood. Below is the "Mode for carrying out the invention" for the invention that combines an emotion engine.

[1395] This invention is a digital design system that allows users to easily create digital designs and realize high-quality designs using AI support and an emotion engine. This system supports the entire process from digital design creation to review and sales.

[1396] Login process

[1397] The user fills out the login form

[1398] The user accesses the system's login screen and enters their email address and password.

[1399] The server performs authentication

[1400] The server authenticates the user based on these credentials and redirects them to the dashboard page if the credentials are correct, otherwise it displays an error message.

[1401] Digital Design Creation

[1402] User selects to create a new stamp

[1403] A user clicks the "Create a New Stamp" button to begin a new digital design project.

[1404] The device will display the stamp creation screen.

[1405] The device displays a user interface that includes a painting tool and image upload functionality.

[1406] Navigating the User Interface

[1407] The user starts the design process, creates a digital design using the paint tool, and uploads and edits images as needed. The device automatically saves the design data at regular intervals and stores it in local storage.

[1408] AI Assistance and Emotion Engine

[1409] Activating the Emotion Engine

[1410] While the user is creating a design, the device activates an emotion engine that analyzes the user's facial expressions and voice to recognize their emotions.

[1411] Emotion-based suggestions

[1412] The emotion engine analyzes the user's emotional state, and the AI ​​assistance feature makes design suggestions and modifications based on the recognized emotion. For example, if the user is feeling down, it will suggest brighter colors and more fun design options.

[1413] Quality improvement with AI-assisted functions

[1414] The device uses AI-assisted functions to suggest improvements to design quality, such as adjusting colors and optimizing composition.

[1415] Complete and upload your design

[1416] The user completes the design

[1417] Once the user has created a design they are happy with, they click the "upload" button.

[1418] The device sends the design data to the server

[1419] The terminal sends the completed design data to the server.

[1420] Review process

[1421] The server receives the design data.

[1422] The server receives and stores the uploaded design data.

[1423] The server starts the automatic review

[1424] The server uses AI algorithms to automatically review designs and check for policy violations and quality issues.

[1425] The server notifies the user of the review results.

[1426] The server generates the review results and notifies the user. If the product passes, it can be prepared for sale. If corrections are required, the server provides feedback on the corrections.

[1427] Sales Settings and Publication

[1428] User sets sales preferences

[1429] The user specifies the pricing and sales start date for the design.

[1430] The server stores the sales settings

[1431] The server stores the sales information set by the user.

[1432] Server publishes to digital marketplace

[1433] The server publishes the digital designs on the digital marketplace according to a set schedule and starts selling them.

[1434] Specific examples

[1435] For example, consider the case where a user wants to create an animal-themed LINE sticker. The user logs in to the system and clicks the "Create a new sticker" button. They then use the paint tool or image upload function to draw an animal sticker. As they work, the emotion engine analyzes the user's facial expressions, and the AI ​​assistance function makes design suggestions based on their emotions. For example, if the user is smiling, the system will suggest adding bright and fun elements to the sticker.

[1436] The completed stamp is uploaded to the server, where it is checked for any issues through an AI review. If it passes, the user enters the price and sales start date, and the server publishes the stamp on the digital marketplace. This allows users to enjoy a more personalized design experience. This system makes it easy for even beginners to create and sell high-quality digital designs.

[1437] The processing flow will be explained below.

[1438] Okay, so let me explain the process step by step below.

[1439] Step 1:

[1440] The user fills out the login form

[1441] The user accesses the system login screen and enters their email address and password.

[1442] Step 2:

[1443] The server performs authentication

[1444] The server authenticates the user based on the entered credentials, redirects them to the dashboard page if the credentials are correct, or displays an error message if the credentials are invalid.

[1445] Step 3:

[1446] User selects to create a new stamp

[1447] A user clicks the "Create a New Stamp" button to begin a new digital design project.

[1448] Step 4:

[1449] The device will display the stamp creation screen.

[1450] The device displays a user interface that includes a painting tool and image upload functionality.

[1451] Step 5:

[1452] The device activates the emotion engine

[1453] The device launches an emotion engine and activates sensors to analyze the user's facial expressions and voice.

[1454] Step 6:

[1455] User initiates design

[1456] Users create digital designs using painting tools and upload and edit images as needed.

[1457] Step 7:

[1458] The device will automatically save

[1459] The device automatically saves design data at regular intervals and stores it in local storage.

[1460] Step 8:

[1461] The device analyzes emotions using an emotion engine

[1462] The device uses an emotion engine to analyze the user's facial expressions and voice to recognize their current emotional state.

[1463] Step 9:

[1464] The device will make emotion-based suggestions

[1465] The device uses AI-assisted features to suggest and modify designs based on the emotions it recognizes: for example, if the user is smiling, it will suggest bright colors and fun motifs.

[1466] Step 10:

[1467] The user completes the design

[1468] Once the user has created a design they are happy with, they click the "upload" button.

[1469] Step 11:

[1470] The device sends the design data to the server

[1471] The terminal sends the completed design data to the server.

[1472] Step 12:

[1473] The server receives the design data.

[1474] The server receives and stores the uploaded design data.

[1475] Step 13:

[1476] The server starts the automatic review

[1477] The server uses AI algorithms to automatically review designs and check for policy violations and quality issues.

[1478] Step 14:

[1479] The server notifies the user of the review results.

[1480] The server generates the review results and notifies the user. If the product passes, it can be prepared for sale. If corrections are required, the server provides feedback on the corrections.

[1481] Step 15:

[1482] User sets sales preferences

[1483] The user specifies the pricing and sales start date for the design.

[1484] Step 16:

[1485] The server stores the sales settings

[1486] The server stores the sales information set by the user.

[1487] Step 17:

[1488] Server publishes to digital marketplace

[1489] The server publishes the digital designs on the digital marketplace according to a set schedule and starts selling them.

[1490] The above are the specific processing steps of the invention combined with the emotion engine. This system allows users to enjoy a more personalized design experience.

[1491] Example 2

[1492] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1493] In conventional digital design systems, users had to create their own designs and rely on their own sense and experience to improve the quality. This made it difficult for beginners and users without specialized knowledge to create high-quality designs. Inconveniences were also pointed out regarding the user interface operation method and the saving and restoring of design data. Furthermore, it was difficult to incorporate emotional elements into the design, making it impossible to realize design proposals based on the user's emotional state. There is a need to provide a system that solves these issues, allows anyone to easily create high-quality digital designs, and enables proposals that take into account the emotional elements of the design.

[1494] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for a user to input authentication information; a means for the server to authenticate the user based on the authentication information and redirect the user to a dashboard page; a means for the user to create a new digital design; a means for providing a user interface and allowing the user to save designs; a means for operating the user interface to create a design; a means for launching an emotion analysis module and analyzing the user's emotional state; a means for providing AI support and proposing designs based on the emotion analysis results; a means for providing AI support and allowing the user to improve the quality of the design; a means for the user to upload the completed design to the server; a means for the server to receive design data, perform AI review, and notify the review results; a means for the user to set sales information; and a means for the server to save the sales settings and publish the design on an online store. This allows even beginners to easily create high-quality digital designs and propose designs that incorporate emotional elements.

[1495] Understood. Below are definitions of important terms found in the claims:

[1496] "User" refers to an individual or organization that uses the System.

[1497] "Authentication information" refers to information used to verify the identity of a user, and specifically includes an ID and password.

[1498] "Server" refers to a computer system that stores, processes, and manages data.

[1499] "Dashboard page" refers to the main operation screen that users can access after logging in.

[1500] "Digital design" refers to any visual content created using a computer.

[1501] "User interface" refers to the screen and operation means that allow a user to operate the system.

[1502] "Paint tool" refers to an on-screen drawing tool used to create digital designs.

[1503] "Image upload function" refers to the function for importing image files into the system.

[1504] An "emotion analysis module" refers to software or hardware for analyzing a user's facial expressions and voice to recognize their emotional state.

[1505] "AI support" refers to a function that uses artificial intelligence to support design suggestions and quality improvement.

[1506] "Design Data" refers to a user-created digital design file and associated metadata.

[1507] "Review" refers to the quality check and policy violation detection performed by AI on uploaded design data.

[1508] "Online Store" means a web-based marketplace for the sale of Digital Designs.

[1509] "Sales Information" refers to the setting information such as price and sales start date required to sell a Digital Design.

[1510] This provides clear definitions of key terms used in the claims.

[1511] This invention is a digital design system that allows users to easily create digital designs and realize high-quality designs using AI support and emotion analysis technology. This system supports a series of processes from digital design creation to review and sales, and can be implemented as follows:

[1512] Hardware and Software Used

[1513] To implement this system, the following hardware and software are used.

[1514] Server: A server system for storing, processing, and managing data.

[1515] Device: The computer, tablet, or smartphone used by the user.

[1516] User interface: Delivered as a web or mobile application.

[1517] Painting tools and image uploading functionality: A set of tools for creating designs.

[1518] Emotion Analysis Module: Uses the camera for facial expression analysis and the microphone for voice analysis.

[1519] AI-assisted features: Generative AI models for design suggestions and quality improvement.

[1520] Data processing and calculation

[1521] Authentication process: The email address and password entered by the user are authenticated on the server, and if authentication is successful, the user is redirected to the dashboard page.

[1522] Design creation: The device provides a painting tool and image upload function, allowing users to create designs through a user interface.

[1523] Emotion Analysis: The emotion analysis module analyzes the user's facial expressions and voice in real time to recognize the user's emotional state.

[1524] AI assistance: A generative AI model makes design suggestions based on the results of sentiment analysis, helping to improve design quality by adjusting color tones and optimizing layouts.

[1525] Saving and uploading designs: The device automatically saves design data to local storage at regular intervals and uploads completed design data to the server.

[1526] Automated review: The server receives the uploaded design data and uses AI algorithms to check the quality and detect policy violations.

[1527] Sales Settings and Publish: The server stores the pricing and sales start date information you entered and publishes the design to the online store at the specified date and time.

[1528] Specific examples

[1529] For example, if a user wants to create an animal-themed LINE stamp, they would perform the following operations.

[1530] 1. A user logs into the system

[1531] The user logs in to the system by entering the email address "user@example.com" and the password "password123".

[1532] 2. Click the Create New Stamp button

[1533] Users click the "Create a new stamp" button and use the painting tools and image upload function to draw an animal stamp.

[1534] 3. The emotion analysis module analyzes the user's facial expressions

[1535] The emotion analysis module analyzes the user's facial expressions in real time, and the AI ​​assistance function makes design suggestions based on their emotions. For example, if the user is smiling, it will suggest bright and cheerful stamp elements.

[1536] 4. User completes design and clicks upload button

[1537] The completed design is uploaded to the server, undergoes automatic review by AI, and if there are no problems, it is set up for sale.

[1538] 5. User sets sales preferences

[1539] The user enters the price and sale start date for the design, and the server stores the information.

[1540] 6. The server publishes the design to the online store at the specified date and time.

[1541] The server will publish the design according to the set schedule and begin selling it.

[1542] Prompt Sentence Examples

[1543] “If you use an emotion engine to indicate that users are in a good mood while designing, what suggestions would you make for the design?”

[1544] This system allows even beginners to create high-quality digital designs and propose designs that incorporate emotional elements.

[1545] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1546] Understood. Below, we will explain the specific operations and data processing steps.

[1547] Login process

[1548] Step 1:

[1549] The user fills out the login form

[1550] The user accesses the system login screen and enters their email address and password, for example "user@example.com" and "password123".

[1551] Enter your email address and password

[1552] Output: Login information sent to the server

[1553] Step 2:

[1554] The server performs authentication

[1555] The server checks the received login information against the database and performs authentication. If the email address is "user@example.com" and the password is "password123", authentication is successful.

[1556] Input: Submitted login information

[1557] Data processing: Retrieving user information from the database and verifying it

[1558] Output: Authentication result (success or failure)

[1559] Step 3:

[1560] The server returns the authentication result

[1561] If authentication is successful, the server returns a URL that redirects to the dashboard page, otherwise it returns an error message.

[1562] Input: Authentication result

[1563] Output: Redirect URL or error message

[1564] Digital Design Creation

[1565] Step 1:

[1566] User selects to create a new stamp

[1567] The user clicks the "Create a new stamp" button on the dashboard page.

[1568] Input: User clicks

[1569] Output: A new stamp project is started

[1570] Step 2:

[1571] The device will display the stamp creation screen.

[1572] The device will display a sticker creation screen with painting tools and image upload functionality.

[1573] Input: Start signal for stamp creation

[1574] Output: Display of stamp creation screen

[1575] Step 3:

[1576] Navigate the user interface

[1577] Users create designs using painting tools and optionally upload images, such as using the brush tool to draw a circle or an animal's face.

[1578] Input: User design operations (brush tool, image file)

[1579] Output: Design data is saved to local storage

[1580] AI Assistance and Emotion Engine

[1581] Step 1:

[1582] Launching the Sentiment Analysis Module

[1583] When the user starts designing, the device will use the built-in camera and microphone to activate the emotion analysis module.

[1584] Input: User design start

[1585] Output: Sentiment analysis module launch

[1586] Step 2:

[1587] Emotion-based suggestions

[1588] The emotion analysis module analyzes the user's facial expressions and voice to recognize their emotional state. Based on the recognized emotional state, the AI ​​assistance function makes design suggestions. For example, if the user is smiling, it will suggest bright colors and fun elements.

[1589] Input: Sentiment analysis results

[1590] Data Computation: AI-assisted functionality generates emotion-driven design suggestions

[1591] Output: Design proposal

[1592] Step 3:

[1593] Quality improvement with AI-assisted functions

[1594] The device uses AI-assisted features to make suggestions to improve the quality of your design, such as adjusting colors (brightness and contrast) or optimizing layouts (positioning objects).

[1595] Input: Current design data

[1596] Data calculation: AI-assisted functions analyze data to improve quality

[1597] Output: Quality improvement proposals

[1598] Complete and upload your design

[1599] Step 1:

[1600] The user completes the design

[1601] Once the user is satisfied with the design, they click the "Upload" button to finalize the design.

[1602] Input: User clicks

[1603] Output: Design complete signal

[1604] Step 2:

[1605] The device sends the design data to the server

[1606] The terminal transmits the design data stored in the local storage to the server.

[1607] Input: Design completion signal

[1608] Output: Sending design data to the server

[1609] Review process

[1610] Step 1:

[1611] The server receives the design data.

[1612] The server receives the uploaded design data and stores it in a database.

[1613] Input: Design data

[1614] Output: Save design data

[1615] Step 2:

[1616] The server performs an automatic review

[1617] The server uses AI algorithms to automatically review designs, specifically checking for policy violations and quality issues.

[1618] Input: Saved design data

[1619] Data calculation: AI algorithm review

[1620] Output: Review result (passed or needs correction)

[1621] Step 3:

[1622] The server notifies the user of the review results.

[1623] The server generates the review result and notifies the user. If the review is successful, the process proceeds to the next sales setting step. If corrections are required, the corrections are provided as feedback.

[1624] Input: Review results

[1625] Output: User notification

[1626] Sales Settings and Publication

[1627] Step 1:

[1628] User sets sales preferences

[1629] The user inputs the pricing and sales start date for the design that has passed the review.

[1630] Input: User setting information (price, sales start date)

[1631] Output: Sales setting information

[1632] Step 2:

[1633] The server stores the sales settings

[1634] The server stores the sales information entered by the user and prepares the sales to begin.

[1635] Input: Sales setting information

[1636] Output:Sales setting information saved

[1637] Step 3:

[1638] The server publishes it to the online store

[1639] The server publishes the digital designs to the online store according to a set schedule and starts selling them.

[1640] Input: Sales start date and time and setting information

[1641] Output: Publishing your design to your online store

[1642] These are the specific processing steps. This system allows users to easily create high-quality digital designs and improve the quality of their designs by receiving personalized design suggestions using emotion analysis.

[1643] (Application example 2)

[1644] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1645] Conventional digital design systems have had problems with not being able to detect changes in facial expressions and emotions when users create designs, or with a lack of design suggestions that reflect these. As a result, the efficiency and quality of design creation tend to decline. In addition, the operation interface is limited, and in some cases the system can only be used on certain devices. This leaves users lacking the experience they need to efficiently create better designs.

[1646] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1647] In this invention, the server includes a means for a user to create a new digital design, a means for using smart glasses as a display device for the user interface, a means for acquiring facial expression and voice data using a camera and microphone of the smart glasses, and a means for performing emotion recognition and proposing a design based on the recognized emotion. This makes it possible to recognize the user's emotion in real time using the camera and microphone of the smart glasses and provide optimal design proposals and displays based on the emotion through the user interface.

[1648] "Authentication information" refers to the identification information required for a user to access a system.

[1649] "User" refers to anyone who uses the digital design system.

[1650] The "dashboard page" is an operation screen that is displayed after a user logs in to the system.

[1651] "Digital design" is visual design or graphics created using a computer.

[1652] "User interface" refers to the screens and operating means through which a user inputs data and interacts with a system.

[1653] "AI support" is a function that uses artificial intelligence to assist users in their design work and improve quality.

[1654] "Smart glasses" are glasses-type wearable devices that incorporate functions such as AR, cameras, and microphones.

[1655] "Facial expressions" are a means of conveying emotions and intentions through facial movements.

[1656] "Voice data" is user voice information acquired through a microphone.

[1657] "Emotion recognition" is a technology that analyzes facial expressions and voice data to understand a user's emotions.

[1658] "Design suggestions" are design ideas and improvements that AI presents based on the user's emotions and input.

[1659] "Design data" refers to digital design information created by a user.

[1660] "AI review" is the process of using artificial intelligence to inspect the quality and suitability of a design.

[1661] "Sales information" refers to information such as the price and start date set when selling the design.

[1662] A "digital marketplace" is an online platform for publishing and selling digital designs.

[1663] A "drawing tool" is an instrument or software that a user uses to create a digital design.

[1664] The "image file upload function" is a function for importing external images into the system.

[1665] The "auto-save function" is a function that automatically saves the user's work at regular intervals.

[1666] This invention is a system that allows users to easily create digital designs and realize high-quality designs using AI support and emotion recognition technology. This system recognizes emotions in real time by analyzing facial expressions and voices while the user is creating digital designs using smart glasses, and proposes or modifies designs based on these emotions.

[1667] System Configuration

[1668] (Hardware)

[1669] Smart glasses: Devices with built-in cameras and microphones that capture the user's facial expressions and voice.

[1670] Server: A computing device that stores design data, provides AI support, and performs emotion recognition.

[1671] (software)

[1672] EmotionRecognizer: A library for recognizing emotions from facial expressions and speech.

[1673] DesignAIAssistant: An AI module that makes design suggestions based on emotion data.

[1674] ARInterface: An interface that displays design proposals through the augmented reality capabilities of smart glasses.

[1675] Program processing

[1676] Server: The user enters their authentication information, and the server authenticates them. If authentication is successful, the user is redirected to the operation screen. On the operation screen, the user can create a new digital design. The server automatically saves the user's design data at regular intervals, and also receives the completed design data and reviews it using AI. The user is notified of the review results.

[1677] Smart Glasses: The camera and microphone of the smart glasses are used to capture the user's facial expressions and voice data in real time, and emotions are recognized using EmotionRecognizer. Based on the recognized emotions, DesignAIAssistant makes design suggestions and displays them on the smart glasses screen through ARInterface.

[1678] Specific examples

[1679] For example, consider a user creating a new product display design. If the user is wearing smart glasses and working while smiling, EmotionRecognizer recognizes the user's facial expression as "joy." As a result, DesignAIAssistant suggests "ideas for bright, colorful displays," which are visually displayed through the ARInterface. By creating the display based on these suggestions, staff can complete more efficient and attractive displays in a shorter time.

[1680] Example prompt for a generative AI model:

[1681] Design an AI assistant that uses the camera and microphone in smart glasses to recognize staff emotions and then suggests in-store decorations and product displays based on those emotions. Suggestions should be made in real time and visually displayed through an AR interface.

[1682] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1683] Step 1:

[1684] The server receives authentication information from the user and performs authentication.

[1685] (Input) User authentication information (email address and password)

[1686] (Output) Authentication result (success or error message)

[1687] (Specific operation) The server receives the authentication information, checks it against the database, and if successful, redirects the user to the operation screen; if unsuccessful, displays an error message.

[1688] Step 2:

[1689] The user operates a user interface on the terminal to create a new digital design.

[1690] (Input) User design input (paint tool or image upload)

[1691] (Output) Design data being created

[1692] (Specific operation) The user creates a design using drawing tools and image file upload functions, and the device automatically saves the design data at regular intervals.

[1693] Step 3:

[1694] The smart glasses' camera and microphone are activated to capture the user's facial expressions and voice data.

[1695] (Input) Real-time facial expression and voice data from a camera and microphone

[1696] (Output) Acquired facial expression and voice data

[1697] (Specific operation) The smart glasses capture the user's face and record their speech.

[1698] Step 4:

[1699] The device analyzes the user's emotions from the data acquired using EmotionRecognizer.

[1700] (Input) Acquired facial expression and voice data

[1701] (Output) Analyzed emotion data (e.g., happiness, sadness, etc.)

[1702] (Specific operation) EmotionRecognizer analyzes facial expressions and voice data to extract specific emotions.

[1703] Step 5:

[1704] Based on the analyzed emotions, the device's DesignAIAssistant generates design suggestions.

[1705] (Input) Analyzed emotion data

[1706] (Output) Design proposals (color changes, layout proposals, etc.)

[1707] (Specific operation) Based on the emotion data, DesignAIAssistant generates appropriate design changes and new ideas and provides them to the user.

[1708] Step 6:

[1709] The ARInterface of the smart glasses visually displays the generated design proposal.

[1710] (Input) Generated design proposals

[1711] (Output) Design proposals displayed on the smart glasses display

[1712] (Specific operation) ARInterface overlays the suggestions on the screen of the smart glasses, providing visual feedback to the user.

[1713] Step 7:

[1714] The terminal uploads the user's completed design to the server.

[1715] (Input) Completed design data

[1716] (Output) Design data stored on the server

[1717] (Specific operation) The terminal sends the completed design data to the server, which stores it in a database.

[1718] Step 8:

[1719] The server uses AI to review the uploaded designs and notify the user of the results.

[1720] (Input) Uploaded design data

[1721] (Output) Review results (pass, corrections, etc.)

[1722] (Specific operation) The AI ​​algorithm analyzes the design data, checks for quality and policy violations, and notifies the user of the results.

[1723] Step 9:

[1724] The user sets up sales information and the server stores it.

[1725] (Input) Sales information (pricing, sales start date, etc.)

[1726] (Output)Sales information saved

[1727] (Specific operation) The user enters sales information, and the server saves it in the database.

[1728] Step 10:

[1729] The server publishes the digital design on the digital marketplace based on the set sales information.

[1730] (Input) Saved sales information and design data

[1731] (Output) Designs published on digital marketplaces

[1732] (Specific operation) The server publishes the design on the online marketplace based on the sales start date and time, and begins sales.

[1733] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1734] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1735] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1736] [Fourth embodiment]

[1737] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1738] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1739] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1740] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1741] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1742] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1743] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1744] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1745] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1746] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1747] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1748] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1749] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1750] Understood. Below is the "Mode for Carrying Out the Invention" from the patent specification.

[1751] The digital design system of the present invention is designed to enable users to easily create digital designs and complete the entire process from review to sale. This system allows users to log in by entering their authentication information, create a digital design, proceed with the work with AI assistance, upload the completed design to a server, and sell designs that pass review on a digital marketplace.

[1752] Login process

[1753] The user fills out the login form

[1754] The user accesses the system's login screen and enters their email address and password.

[1755] The server performs authentication

[1756] The server authenticates the user based on these credentials and redirects the user to the dashboard page if they are correct, otherwise it returns an error message.

[1757] Digital Design Creation

[1758] User selects to create a new stamp

[1759] A user clicks the "Create a New Stamp" button to start a new digital design project.

[1760] The device will display the stamp creation screen.

[1761] The device displays a user interface that includes painting tools and an image upload function, and the user uses these tools to create a digital design.

[1762] AI support function

[1763] The device provides AI assistance functions

[1764] The device will provide AI-assisted features to help users create designs more efficiently, with AI suggesting color adjustments and composition optimization.

[1765] Save and upload your design

[1766] The device will automatically save

[1767] The device automatically saves design data at regular intervals, and this data is stored in local storage, reducing the risk of data loss during work.

[1768] User completes and uploads the design

[1769] When the user completes a design to their satisfaction, they press the "upload" button to send the design data to the server.

[1770] Review process

[1771] The server receives the design data.

[1772] The server receives the uploaded design data. At this stage, the design data is saved and an AI algorithm begins automatic review.

[1773] The server notifies the review result

[1774] The server uses an AI algorithm to check the design for policy violations and quality. If the design passes the inspection, it is ready for sale. If it fails, the server notifies the user with feedback including corrections.

[1775] Sales Settings and Publication

[1776] User sets sales preferences

[1777] The user specifies the pricing and sales start date for the design.

[1778] The server stores the sales settings

[1779] The server stores the sales information set by the user and publishes the stamps on the digital marketplace on the designated publication date.

[1780] Specific examples

[1781] For example, consider the case where a user wants to create animal-themed LINE stickers. The user logs in to the system and clicks the "Create New Stickers" button. Paint tools and an image upload function are then displayed, and the user uses these tools to draw the animal stickers. AI adjusts colors and suggests placement, improving the quality of the design. The completed stickers are uploaded to the server, and after passing review, they are set up for sale. Finally, the user's animal stickers are sold on the digital marketplace.

[1782] This allows even beginners to easily create and sell high-quality digital designs. Users can work efficiently and effectively to help them sell quickly in a competitive market.

[1783] The processing flow will be explained below.

[1784] Ok, so let me explain step by step what the program does.

[1785] Step 1:

[1786] The user fills out the login form

[1787] The user accesses the system login screen and enters their email address and password.

[1788] Step 2:

[1789] The server performs authentication

[1790] The server authenticates the user based on the entered credentials and redirects them to the dashboard page if the credentials are correct, otherwise it displays an error message.

[1791] Step 3:

[1792] User selects to create a new stamp

[1793] A user clicks the "Create a New Stamp" button to begin a new digital design project.

[1794] Step 4:

[1795] The device will display the stamp creation screen.

[1796] The device displays a user interface that includes a painting tool and image upload functionality.

[1797] Step 5:

[1798] User initiates design

[1799] Users create digital designs using painting tools and upload and edit images as needed.

[1800] Step 6:

[1801] The device will automatically save

[1802] The device automatically saves design data at regular intervals and stores it in local storage.

[1803] Step 7:

[1804] The device provides AI assistance functions

[1805] The device uses AI-assisted functions to suggest improvements to design quality, such as adjusting colors and optimizing placement.

[1806] Step 8:

[1807] The user completes the design

[1808] Once the user has created a design they are happy with, they click the "upload" button.

[1809] Step 9:

[1810] The device sends the design data to the server

[1811] The terminal sends the completed design data to the server.

[1812] Step 10:

[1813] The server receives the design data.

[1814] The server receives and stores the uploaded design data.

[1815] Step 11:

[1816] The server starts the automatic review

[1817] The server uses AI algorithms to automatically review designs and check for policy violations and quality issues.

[1818] Step 12:

[1819] The server notifies the user of the review results.

[1820] The server generates the review results and notifies the user. If the product passes, it can be prepared for sale. If corrections are required, the server provides feedback on the corrections.

[1821] Step 13:

[1822] User sets sales preferences

[1823] The user specifies the pricing and sales start date for the design.

[1824] Step 14:

[1825] The server stores the sales settings

[1826] The server stores the sales information set by the user.

[1827] Step 15:

[1828] Server publishes to digital marketplace

[1829] The server will publish the design on the digital marketplace according to the set schedule and begin selling it.

[1830] The above are the specific processing steps of the program. This system allows users to easily create and sell digital designs.

[1831] Example 1

[1832] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1833] With conventional digital design systems, it was difficult for users to receive support for design creation and quality improvement, and the review process was manual, resulting in problems that reduced efficiency. There was also the risk that the created design data would be lost without being saved, which increased the burden on users. Furthermore, the process from sales setup to publication was complicated and difficult for beginners to use. To solve these issues, a new digital design system was needed.

[1834] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1835] In this invention, the server includes a means for the user to input authentication information, a means for the server to authenticate the user based on the authentication information and redirect the user to a dashboard page, and a means for the user to create a new digital design, so that the user can easily access the system and start creating a design.

[1836] The terminal also includes a means for providing a user interface and allowing the user to save the design, and a means for the terminal to provide AI assistance and for the user to improve the quality of the design, thereby enabling the user to efficiently create high-quality designs.

[1837] Furthermore, the system includes a means for users to upload completed designs to a server, a means for the server to receive the design data, review it using AI, and notify the user of the review results, a means for users to set sales information, a means for the server to save the sales settings and publish them on the digital marketplace, and a means for the device to automatically save the design data periodically, which reduces the risk of losing design data and makes the sales process more efficient.

[1838] "User" means any person who uses the Digital Design System and logs in by entering credentials to create, save, upload and sell Digital Designs.

[1839] "Authentication information" refers to information such as an email address and password that a user enters to access a system.

[1840] "Server" refers to the computer equipment that serves as the center of the digital design system and is responsible for user authentication, design data storage, review, and sales settings.

[1841] "Terminal" refers to a device used by a user to create a digital design, including a PC, smartphone, tablet, etc.

[1842] A "dashboard page" is a screen that a user can access after logging in, and provides an interface for creating and managing digital designs.

[1843] "Digital Design" means design data in digital form that a User creates, stores, uploads, and sells through the System.

[1844] "User interface" refers to the screens and controls that allow users to interact with a digital design system, including paint tools and image upload functions.

[1845] "AI support" refers to artificial intelligence-based assistance functions provided by the device during the digital design creation process, including functions such as color adjustment and composition optimization.

[1846] "Uploading" is the act of a user sending a completed digital design from their device to the system's server.

[1847] "Review" is the process in which the server uses an AI algorithm to check the design data it receives for policy violations and quality, and notifies the user of the results.

[1848] "Sales information" refers to information such as pricing and sales start date for digital designs created by users.

[1849] A "digital marketplace" is an online marketplace where user-created digital designs are published and sold.

[1850] "Auto-save" is a function that allows the device to automatically save the user's design data to local storage at specific intervals.

[1851] The digital design system of the present invention allows users to easily create digital designs and complete the entire process from review to sale. This system allows users to log in by entering their authentication information, create a digital design, proceed with the work with AI assistance, upload the completed design to a server, and sell designs that pass review on a digital marketplace.

[1852] Hardware and software used

[1853] The system mainly uses the following hardware and software:

[1854] Server: User authentication, design data storage and review, and sales settings management. For example, use an Apache server or Nginx server.

[1855] Device: The device on which a user creates a design. Examples include computers, smartphones, and tablets running browser-based or native applications.

[1856] Design tool: Software that allows users to create digital designs, such as Adobe Illustrator or GIMP.

[1857] AI Model: A generative AI model to assist in design creation, such as OpenAI's GPT-3 or Adobe Sensei.

[1858] Example of operation

[1859] 1. User authentication:

[1860] A user accesses the system's login screen and enters their email address and password. The server authenticates the user based on these credentials. If authentication is successful, the user is redirected to the dashboard page. For example, the user enters user@example.com and the appropriate password.

[1861] 2. Design Creation:

[1862] The user clicks the "Create a new stamp" button to create a new digital design. The device displays a user interface that includes painting tools and an image upload function. The user uses these tools to create a digital design.

[1863] 3. AI support:

[1864] The device provides AI assistance functions to assist users in their design tasks, such as adjusting colors, optimizing composition, and suggesting fonts. For example, the following prompts can be input to the generative AI model:

[1865] Prompt: "I'd like to create some cute stamps featuring animals like dogs and cats. Could you please give me some advice on the best color combinations and designs?"

[1866] This allows the AI ​​to provide specific color suggestions and composition advice, which the user can follow to complete the design.

[1867] 4. Save and upload your design:

[1868] The device provides a function that automatically saves design data to local storage at regular intervals. When the user completes the design and presses the "Upload" button, the design data is sent to the server. The server receives this design data and stores it in a database.

[1869] 5. Judging and Sales:

[1870] The server uses an AI algorithm to review the design for policy violations and quality. If the review passes, the user sets the sales information. The sales information is saved on the server and published on the digital marketplace on the specified publication date. For example, the user sets the price of the design to 500 yen and the sales start date to the 1st of the following month.

[1871] This makes it possible for even beginners to easily create high-quality digital designs and sell them quickly and reliably in the market.

[1872] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1873] Step 1:

[1874] The user enters their authentication information.

[1875] As input, a user enters an email address and password into a login form, filling in form fields in the UI of a browser or mobile app. The input data is sent to the server.

[1876] Step 2:

[1877] The server performs authentication based on the authentication information.

[1878] As input, the server receives an email address and password which it checks against its database. The server runs the appropriate authentication query and, if correct, creates a session and redirects the user to a dashboard page. As output, it provides the authentication status (success / failure) and a redirect URL.

[1879] Step 3:

[1880] A user creates a new digital design.

[1881] As input, the user clicks the "Create a new stamp" button. The specific action is to trigger a click event on the button. The device generates a design creation screen, displaying a painting tool and an image upload function.

[1882] Step 4:

[1883] The terminal provides a user interface and allows the user to save designs.

[1884] As input, the user creates a design using the paint tool or image upload function. Specific actions include drawing with the brush tool or selecting an image file. The created design data is obtained as output.

[1885] Step 5:

[1886] The device provides AI assistance, allowing the user to improve the quality of the design.

[1887] As input, the user receives suggestions for adjusting colors and optimizing composition while creating a design. Specific prompts are fed into the generative AI model:

[1888] Prompt: "I'd like to create some cute stamps featuring animals like dogs and cats. Could you please give me some advice on the best color combinations and designs?"

[1889] The AI ​​model then makes suggestions based on this, which the user can then accept or modify, resulting in improved design data.

[1890] Step 6:

[1891] The device automatically saves design data at regular intervals.

[1892] As input, the terminal periodically triggers a timer event to save the current design data to local storage. A specific operation is to automatically save the data every 5 minutes, for example. As output, the latest design data is saved to local storage.

[1893] Step 7:

[1894] The user uploads the completed design to the server.

[1895] As input, the user clicks the "Upload" button. The specific operation is to send the completed design data to the server. As output, the design data received by the server is obtained.

[1896] Step 8:

[1897] The server receives the design data, reviews it using AI, and notifies the user of the review results.

[1898] The server inputs the design data it receives into an AI algorithm, which checks for policy violations and quality. For example, it checks for copyright infringement or inappropriate content. The output is a review result (pass / fail), and if it fails, feedback including corrections is generated and notified to the user.

[1899] Step 9:

[1900] The user sets the sales information.

[1901] As input, the user enters the design's pricing and sales start date into an input form. The specific operation is to enter information on the sales settings screen. As output, the sales information is sent to the server and saved.

[1902] Step 10:

[1903] The server stores the selling settings and publishes them to the digital marketplace.

[1904] As input, the server publishes the design to the digital marketplace on the specified publication date based on the saved sales information. The specific operation is to publish the data using the marketplace's API. As output, the user's design is published and sales begin.

[1905] (Application example 1)

[1906] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1907] While conventional digital design systems support the creation of two-dimensional designs, they lack the ability to efficiently create designs in three-dimensional space, or to use AI to provide real-time color adjustments and composition suggestions. Furthermore, they lacked a set of integrated functions that allowed users to easily save and upload designs and sell them on a virtual marketplace, resulting in issues with overall usability. This made it difficult to improve the quality of digital designs and quickly release them to the market.

[1908] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1909] In this invention, the server includes: means for a user to input authentication information; means for the server to authenticate the user based on the authentication information and redirect the user to a dashboard page; means for a user to create a new digital design; means for providing a user interface and allowing the user to save designs; means for providing AI support and allowing the user to improve the quality of the design; means for a user to upload a completed design to the server; means for the server to receive design data, review using AI, and notify the review results; means for a user to set sales information; means for the server to save sales settings and publish them on a virtual marketplace; means for a user to create a digital design in a 3D space; and means for suggesting color adjustments and composition in real time using an AI-assisted function. This allows users to easily create and improve the quality of digital designs in a three-dimensional space, allowing them to sell on a virtual marketplace quickly and efficiently.

[1910] "User authentication" is a procedure in which the server verifies the legitimacy of a user based on the authentication information entered by the user.

[1911] "Digital design" is visual content created using a computer, typically using paint tools or graphics software.

[1912] A "user interface" is a collection of screens and elements that allow a user to interact with a system, providing the means for creating and saving designs.

[1913] "AI Support" is a function that uses artificial intelligence to assist users in improving the quality of their digital design creation, such as by adjusting colors and suggesting composition.

[1914] "Server" means a computer device on a network that stores and manages design data created by users, verifies authentication information, and reviews designs.

[1915] A "Virtual Marketplace" is a platform for exhibiting and selling digital designs online.

[1916] "3D space" is a three-dimensional virtual space represented by computer graphics in which users can create digital designs.

[1917] "Color adjustment" is the process of optimizing colors in digital designs, automatically suggesting the best shades with the help of AI.

[1918] "Composition suggestion" is a process that uses AI to present optimal layouts to users in order to optimize the placement of elements in digital designs.

[1919] The digital design system of the present invention supports the process of users easily creating digital designs in three-dimensional space, improving their quality with AI support, saving their designs, and selling them in a virtual marketplace. This system is composed of the following hardware and software.

[1920] Hardware and software used

[1921] Smartphone: A modern smartphone running iOS or Android.

[1922] software:

[1923] Unity: Rendering 3D spaces and building user interfaces.

[1924] TensorFlow: Implementing AI-assisted features and real-time color adjustment and composition suggestions.

[1925] Firebase: User authentication, design data storage, sales information management.

[1926] System Details

[1927] 1. User authentication:

[1928] A user accesses the login screen of the smartphone application and enters their email address and password. The authentication information is verified by Firebase Authentication, and if valid, the user is redirected to the virtual design studio.

[1929] 2. Design Creation:

[1930] Users create digital designs in a three-dimensional virtual space built using Unity, and can freely arrange and change design elements using painting tools and image upload functions.

[1931] 3. AI support function:

[1932] While creating a design, AI-assisted features powered by TensorFlow make real-time color adjustment and composition suggestions, helping users create high-quality designs efficiently. For example, the AI ​​can suggest a color palette that suits the user's design and suggest the optimal placement of elements.

[1933] 4. Save and upload your design:

[1934] Design data is automatically saved to Firebase Storage at regular intervals. When a user completes a design and presses the upload button, the design data is sent to the server and stored in Firebase.

[1935] 5. Review Process:

[1936] The server receives the uploaded design data and uses an AI algorithm (TensorFlow) to check the design for policy violations and quality issues. The results of the review are notified to the user, and if there are no policy violations or quality issues, the system proceeds to sales setup.

[1937] 6. Sales Settings and Publication:

[1938] Users set the price and release date for their design, which is stored in Firebase Firestore, and the design is published on the digital marketplace on the specified release date.

[1939] Specific examples

[1940] For example, consider the case where a user creates a three-dimensional digital animal-themed figurine on the Virtual Design Market. The user logs into the system and begins designing the figurine in 3D space. The AI-assisted function suggests colors and composition in real time to achieve the optimal design. The completed design is uploaded to the server, and after passing a review, it is made public on the Virtual Marketplace.

[1941] Prompt Sentence Examples

[1942] "You are an AI in a virtual design market. Users are creating animal-themed designs. Please suggest appropriate color adjustments and placement."

[1943] This allows users to utilize 3D space and AI assistance to create efficient, high-quality digital designs and quickly bring them to market.

[1944] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1945] Step 1:

[1946] A user accesses the login screen of a smartphone application and enters their email address and password. The application sends the entered authentication information to Firebase Authentication. Firebase Authentication authenticates the user based on the entered information, and if the information is valid, generates an authentication token and returns it to the application. Once the authentication token is received, the user is redirected to the virtual design studio. An error message is displayed if the entered information is invalid.

[1947] Step 2:

[1948] Users select the "Create a new design" option in the virtual design studio. This action causes the application to display a design creation screen in a three-dimensional virtual space built using Unity. The user interface includes painting tools and an image upload function, which users can use to place and modify design elements.

[1949] Step 3:

[1950] The user interface uses a TensorFlow model to provide real-time AI support as the user creates their design. When the user changes part of the design, the new design data is input into the TensorFlow model, which then outputs suggestions for color adjustments and composition. The suggestions are displayed in the user interface, allowing the user to adjust the design based on them.

[1951] Step 4:

[1952] While users are creating their designs, their design data is automatically saved to Firebase Storage at regular intervals, reducing the risk of losing data while they are working. The saved data is then uploaded to Firebase as intermediate states of the design.

[1953] Step 5:

[1954] After the user completes the design, they press the "Upload" button. This action sends the final design data to the server and stores it in Firebase Storage. The server receives this design data and records it appropriately in the administrative database.

[1955] Step 6:

[1956] The server inputs the saved design data into a TensorFlow model to check for policy violations and quality. The model analyzes the design and generates a result. The server evaluates the analysis result and notifies the user of the review result. Based on the review result, specific feedback is provided to the user if any corrections are required.

[1957] Step 7:

[1958] Once a design has passed the review, the user can set it up for sale. They can specify the sales price and start date, and enter that information. The application sends the entered information to Firebase Firestore and stores it appropriately. The design is then ready to be published on the marketplace.

[1959] Step 8:

[1960] On the sales start date, the server will publish the design on the virtual marketplace based on the saved sales settings. The published design will be available for other users to view and purchase. Information at the time of publication is updated in real time by the server, and sales status is also monitored.

[1961] This allows users to efficiently create high-quality designs in three-dimensional space and quickly begin selling them on the virtual marketplace.

[1962] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1963] Understood. Below is the "Mode for carrying out the invention" for the invention that combines an emotion engine.

[1964] This invention is a digital design system that allows users to easily create digital designs and realize high-quality designs using AI support and an emotion engine. This system supports the entire process from digital design creation to review and sales.

[1965] Login process

[1966] The user fills out the login form

[1967] The user accesses the system's login screen and enters their email address and password.

[1968] The server performs authentication

[1969] The server authenticates the user based on these credentials and redirects them to the dashboard page if the credentials are correct, otherwise it displays an error message.

[1970] Digital Design Creation

[1971] User selects to create a new stamp

[1972] A user clicks the "Create a New Stamp" button to begin a new digital design project.

[1973] The device will display the stamp creation screen.

[1974] The device displays a user interface that includes a painting tool and image upload functionality.

[1975] Navigating the User Interface

[1976] The user starts the design process, creates a digital design using the paint tool, and uploads and edits images as needed. The device automatically saves the design data at regular intervals and stores it in local storage.

[1977] AI Assistance and Emotion Engine

[1978] Activating the Emotion Engine

[1979] While the user is creating a design, the device activates an emotion engine that analyzes the user's facial expressions and voice to recognize their emotions.

[1980] Emotion-based suggestions

[1981] The emotion engine analyzes the user's emotional state, and the AI ​​assistance feature makes design suggestions and modifications based on the recognized emotion. For example, if the user is feeling down, it will suggest brighter colors and more fun design options.

[1982] Quality improvement with AI-assisted functions

[1983] The device uses AI-assisted functions to suggest improvements to design quality, such as adjusting colors and optimizing composition.

[1984] Complete and upload your design

[1985] The user completes the design

[1986] Once the user has created a design they are happy with, they click the "upload" button.

[1987] The device sends the design data to the server

[1988] The terminal sends the completed design data to the server.

[1989] Review process

[1990] The server receives the design data.

[1991] The server receives and stores the uploaded design data.

[1992] The server starts the automatic review

[1993] The server uses AI algorithms to automatically review designs and check for policy violations and quality issues.

[1994] The server notifies the user of the review results.

[1995] The server generates the review results and notifies the user. If the product passes, it can be prepared for sale. If corrections are required, the server provides feedback on the corrections.

[1996] Sales Settings and Publication

[1997] User sets sales preferences

[1998] The user specifies the pricing and sales start date for the design.

[1999] The server stores the sales settings

[2000] The server stores the sales information set by the user.

[2001] Server publishes to digital marketplace

[2002] The server publishes the digital designs on the digital marketplace according to a set schedule and starts selling them.

[2003] Specific examples

[2004] For example, consider the case where a user wants to create an animal-themed LINE sticker. The user logs in to the system and clicks the "Create a new sticker" button. They then use the paint tool or image upload function to draw an animal sticker. As they work, the emotion engine analyzes the user's facial expressions, and the AI ​​assistance function makes design suggestions based on their emotions. For example, if the user is smiling, the system will suggest adding bright and fun elements to the sticker.

[2005] The completed stamp is uploaded to the server, where it is checked for any issues through an AI review. If it passes, the user enters the price and sales start date, and the server publishes the stamp on the digital marketplace. This allows users to enjoy a more personalized design experience. This system makes it easy for even beginners to create and sell high-quality digital designs.

[2006] The processing flow will be explained below.

[2007] Okay, so let me explain the process step by step below.

[2008] Step 1:

[2009] The user fills out the login form

[2010] The user accesses the system login screen and enters their email address and password.

[2011] Step 2:

[2012] The server performs authentication

[2013] The server authenticates the user based on the entered credentials, redirects them to the dashboard page if the credentials are correct, or displays an error message if the credentials are invalid.

[2014] Step 3:

[2015] User selects to create a new stamp

[2016] A user clicks the "Create a New Stamp" button to begin a new digital design project.

[2017] Step 4:

[2018] The device will display the stamp creation screen.

[2019] The device displays a user interface that includes a painting tool and image upload functionality.

[2020] Step 5:

[2021] The device activates the emotion engine

[2022] The device launches an emotion engine and activates sensors to analyze the user's facial expressions and voice.

[2023] Step 6:

[2024] User initiates design

[2025] Users create digital designs using painting tools and upload and edit images as needed.

[2026] Step 7:

[2027] The device will automatically save

[2028] The device automatically saves design data at regular intervals and stores it in local storage.

[2029] Step 8:

[2030] The device analyzes emotions using an emotion engine

[2031] The device uses an emotion engine to analyze the user's facial expressions and voice to recognize their current emotional state.

[2032] Step 9:

[2033] The device will make emotion-based suggestions

[2034] The device uses AI-assisted features to suggest and modify designs based on the emotions it recognizes: for example, if the user is smiling, it will suggest bright colors and fun motifs.

[2035] Step 10:

[2036] The user completes the design

[2037] Once the user has created a design they are happy with, they click the "upload" button.

[2038] Step 11:

[2039] The device sends the design data to the server

[2040] The terminal sends the completed design data to the server.

[2041] Step 12:

[2042] The server receives the design data.

[2043] The server receives and stores the uploaded design data.

[2044] Step 13:

[2045] The server starts the automatic review

[2046] The server uses AI algorithms to automatically review designs and check for policy violations and quality issues.

[2047] Step 14:

[2048] The server notifies the user of the review results.

[2049] The server generates the review results and notifies the user. If the product passes, it can be prepared for sale. If corrections are required, the server provides feedback on the corrections.

[2050] Step 15:

[2051] User sets sales preferences

[2052] The user specifies the pricing and sales start date for the design.

[2053] Step 16:

[2054] The server stores the sales settings

[2055] The server stores the sales information set by the user.

[2056] Step 17:

[2057] Server publishes to digital marketplace

[2058] The server publishes the digital designs on the digital marketplace according to a set schedule and starts selling them.

[2059] The above are the specific processing steps of the invention combined with the emotion engine. This system allows users to enjoy a more personalized design experience.

[2060] Example 2

[2061] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2062] In conventional digital design systems, users had to create their own designs and rely on their own sense and experience to improve the quality. This made it difficult for beginners and users without specialized knowledge to create high-quality designs. Inconveniences were also pointed out regarding the user interface operation method and the saving and restoring of design data. Furthermore, it was difficult to incorporate emotional elements into the design, making it impossible to realize design proposals based on the user's emotional state. There is a need to provide a system that solves these issues, allows anyone to easily create high-quality digital designs, and enables proposals that take into account the emotional elements of the design.

[2063] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for a user to input authentication information; a means for the server to authenticate the user based on the authentication information and redirect the user to a dashboard page; a means for the user to create a new digital design; a means for providing a user interface and allowing the user to save designs; a means for operating the user interface to create a design; a means for launching an emotion analysis module and analyzing the user's emotional state; a means for providing AI support and proposing designs based on the emotion analysis results; a means for providing AI support and allowing the user to improve the quality of the design; a means for the user to upload the completed design to the server; a means for the server to receive design data, perform AI review, and notify the review results; a means for the user to set sales information; and a means for the server to save the sales settings and publish the design on an online store. This allows even beginners to easily create high-quality digital designs and propose designs that incorporate emotional elements.

[2064] Understood. Below are definitions of important terms found in the claims:

[2065] "User" refers to an individual or organization that uses the System.

[2066] "Authentication information" refers to information used to verify the identity of a user, and specifically includes an ID and password.

[2067] "Server" refers to a computer system that stores, processes, and manages data.

[2068] "Dashboard page" refers to the main operation screen that users can access after logging in.

[2069] "Digital design" refers to any visual content created using a computer.

[2070] "User interface" refers to the screen and operation means that allow a user to operate the system.

[2071] "Paint tool" refers to an on-screen drawing tool used to create digital designs.

[2072] "Image upload function" refers to the function for importing image files into the system.

[2073] An "emotion analysis module" refers to software or hardware for analyzing a user's facial expressions and voice to recognize their emotional state.

[2074] "AI support" refers to a function that uses artificial intelligence to support design suggestions and quality improvement.

[2075] "Design Data" refers to a user-created digital design file and associated metadata.

[2076] "Review" refers to the quality check and policy violation detection performed by AI on uploaded design data.

[2077] "Online Store" means a web-based marketplace for the sale of Digital Designs.

[2078] "Sales Information" refers to the setting information such as price and sales start date required to sell a Digital Design.

[2079] This provides clear definitions of key terms used in the claims.

[2080] This invention is a digital design system that allows users to easily create digital designs and realize high-quality designs using AI support and emotion analysis technology. This system supports a series of processes from digital design creation to review and sales, and can be implemented as follows:

[2081] Hardware and Software Used

[2082] To implement this system, the following hardware and software are used.

[2083] Server: A server system for storing, processing, and managing data.

[2084] Device: The computer, tablet, or smartphone used by the user.

[2085] User interface: Delivered as a web or mobile application.

[2086] Painting tools and image uploading functionality: A set of tools for creating designs.

[2087] Emotion Analysis Module: Uses the camera for facial expression analysis and the microphone for voice analysis.

[2088] AI-assisted features: Generative AI models for design suggestions and quality improvement.

[2089] Data processing and calculation

[2090] Authentication process: The email address and password entered by the user are authenticated on the server, and if authentication is successful, the user is redirected to the dashboard page.

[2091] Design creation: The device provides a painting tool and image upload function, allowing users to create designs through a user interface.

[2092] Emotion Analysis: The emotion analysis module analyzes the user's facial expressions and voice in real time to recognize the user's emotional state.

[2093] AI assistance: A generative AI model makes design suggestions based on the results of sentiment analysis, helping to improve design quality by adjusting color tones and optimizing layouts.

[2094] Saving and uploading designs: The device automatically saves design data to local storage at regular intervals and uploads completed design data to the server.

[2095] Automated review: The server receives the uploaded design data and uses AI algorithms to check the quality and detect policy violations.

[2096] Sales Settings and Publish: The server stores the pricing and sales start date information you entered and publishes the design to the online store at the specified date and time.

[2097] Specific examples

[2098] For example, if a user wants to create an animal-themed LINE stamp, they would perform the following operations.

[2099] 1. A user logs into the system

[2100] The user logs in to the system by entering the email address "user@example.com" and the password "password123".

[2101] 2. Click the Create New Stamp button

[2102] Users click the "Create a new stamp" button and use the painting tools and image upload function to draw an animal stamp.

[2103] 3. The emotion analysis module analyzes the user's facial expressions

[2104] The emotion analysis module analyzes the user's facial expressions in real time, and the AI ​​assistance function makes design suggestions based on their emotions. For example, if the user is smiling, it will suggest bright and cheerful stamp elements.

[2105] 4. User completes design and clicks upload button

[2106] The completed design is uploaded to the server, undergoes automatic review by AI, and if there are no problems, it is set up for sale.

[2107] 5. User sets sales preferences

[2108] The user enters the price and sale start date for the design, and the server stores the information.

[2109] 6. The server publishes the design to the online store at the specified date and time.

[2110] The server will publish the design according to the set schedule and begin selling it.

[2111] Prompt Sentence Examples

[2112] “If you use an emotion engine to indicate that users are in a good mood while designing, what suggestions would you make for the design?”

[2113] This system allows even beginners to create high-quality digital designs and propose designs that incorporate emotional elements.

[2114] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2115] Understood. Below, we will explain the specific operations and data processing steps.

[2116] Login process

[2117] Step 1:

[2118] The user fills out the login form

[2119] The user accesses the system login screen and enters their email address and password, for example "user@example.com" and "password123".

[2120] Enter your email address and password

[2121] Output: Login information sent to the server

[2122] Step 2:

[2123] The server performs authentication

[2124] The server checks the received login information against the database and performs authentication. If the email address is "user@example.com" and the password is "password123", authentication is successful.

[2125] Input: Submitted login information

[2126] Data processing: Retrieving user information from the database and verifying it

[2127] Output: Authentication result (success or failure)

[2128] Step 3:

[2129] The server returns the authentication result

[2130] If authentication is successful, the server returns a URL that redirects to the dashboard page, otherwise it returns an error message.

[2131] Input: Authentication result

[2132] Output: Redirect URL or error message

[2133] Digital Design Creation

[2134] Step 1:

[2135] User selects to create a new stamp

[2136] The user clicks the "Create a new stamp" button on the dashboard page.

[2137] Input: User clicks

[2138] Output: A new stamp project is started

[2139] Step 2:

[2140] The device will display the stamp creation screen.

[2141] The device will display a sticker creation screen with painting tools and image upload functionality.

[2142] Input: Start signal for stamp creation

[2143] Output: Display of stamp creation screen

[2144] Step 3:

[2145] Navigate the user interface

[2146] Users create designs using painting tools and optionally upload images, such as using the brush tool to draw a circle or an animal's face.

[2147] Input: User design operations (brush tool, image file)

[2148] Output: Design data is saved to local storage

[2149] AI Assistance and Emotion Engine

[2150] Step 1:

[2151] Launching the Sentiment Analysis Module

[2152] When the user starts designing, the device will use the built-in camera and microphone to activate the emotion analysis module.

[2153] Input: User design start

[2154] Output: Sentiment analysis module launch

[2155] Step 2:

[2156] Emotion-based suggestions

[2157] The emotion analysis module analyzes the user's facial expressions and voice to recognize their emotional state. Based on the recognized emotional state, the AI ​​assistance function makes design suggestions. For example, if the user is smiling, it will suggest bright colors and fun elements.

[2158] Input: Sentiment analysis results

[2159] Data Computation: AI-assisted functionality generates emotion-driven design suggestions

[2160] Output: Design proposal

[2161] Step 3:

[2162] Quality improvement with AI-assisted functions

[2163] The device uses AI-assisted features to make suggestions to improve the quality of your design, such as adjusting colors (brightness and contrast) or optimizing layouts (positioning objects).

[2164] Input: Current design data

[2165] Data calculation: AI-assisted functions analyze data to improve quality

[2166] Output: Quality improvement proposals

[2167] Complete and upload your design

[2168] Step 1:

[2169] The user completes the design

[2170] Once the user is satisfied with the design, they click the "Upload" button to finalize the design.

[2171] Input: User clicks

[2172] Output: Design complete signal

[2173] Step 2:

[2174] The device sends the design data to the server

[2175] The terminal transmits the design data stored in the local storage to the server.

[2176] Input: Design completion signal

[2177] Output: Sending design data to the server

[2178] Review process

[2179] Step 1:

[2180] The server receives the design data.

[2181] The server receives the uploaded design data and stores it in a database.

[2182] Input: Design data

[2183] Output: Save design data

[2184] Step 2:

[2185] The server performs an automatic review

[2186] The server uses AI algorithms to automatically review designs, specifically checking for policy violations and quality issues.

[2187] Input: Saved design data

[2188] Data calculation: AI algorithm review

[2189] Output: Review result (passed or needs correction)

[2190] Step 3:

[2191] The server notifies the user of the review results.

[2192] The server generates the review result and notifies the user. If the review is successful, the process proceeds to the next sales setting step. If corrections are required, the corrections are provided as feedback.

[2193] Input: Review results

[2194] Output: User notification

[2195] Sales Settings and Publication

[2196] Step 1:

[2197] User sets sales preferences

[2198] The user inputs the pricing and sales start date for the design that has passed the review.

[2199] Input: User setting information (price, sales start date)

[2200] Output: Sales setting information

[2201] Step 2:

[2202] The server stores the sales settings

[2203] The server stores the sales information entered by the user and prepares the sales to begin.

[2204] Input: Sales setting information

[2205] Output:Sales setting information saved

[2206] Step 3:

[2207] The server publishes it to the online store

[2208] The server publishes the digital designs to the online store according to a set schedule and starts selling them.

[2209] Input: Sales start date and time and setting information

[2210] Output: Publishing your design to your online store

[2211] These are the specific processing steps. This system allows users to easily create high-quality digital designs and improve the quality of their designs by receiving personalized design suggestions using emotion analysis.

[2212] (Application example 2)

[2213] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2214] Conventional digital design systems have had problems with not being able to detect changes in facial expressions and emotions when users create designs, or with a lack of design suggestions that reflect these. As a result, the efficiency and quality of design creation tend to decline. In addition, the operation interface is limited, and in some cases the system can only be used on certain devices. This leaves users lacking the experience they need to efficiently create better designs.

[2215] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2216] In this invention, the server includes a means for a user to create a new digital design, a means for using smart glasses as a display device for the user interface, a means for acquiring facial expression and voice data using a camera and microphone of the smart glasses, and a means for performing emotion recognition and proposing a design based on the recognized emotion. This makes it possible to recognize the user's emotion in real time using the camera and microphone of the smart glasses and provide optimal design proposals and displays based on the emotion through the user interface.

[2217] "Authentication information" refers to the identification information required for a user to access a system.

[2218] "User" refers to anyone who uses the digital design system.

[2219] The "dashboard page" is an operation screen that is displayed after a user logs in to the system.

[2220] "Digital design" is visual design or graphics created using a computer.

[2221] "User interface" refers to the screens and operating means through which a user inputs data and interacts with a system.

[2222] "AI support" is a function that uses artificial intelligence to assist users in their design work and improve quality.

[2223] "Smart glasses" are glasses-type wearable devices that incorporate functions such as AR, cameras, and microphones.

[2224] "Facial expressions" are a means of conveying emotions and intentions through facial movements.

[2225] "Voice data" is user voice information acquired through a microphone.

[2226] "Emotion recognition" is a technology that analyzes facial expressions and voice data to understand a user's emotions.

[2227] "Design suggestions" are design ideas and improvements that AI presents based on the user's emotions and input.

[2228] "Design data" refers to digital design information created by a user.

[2229] "AI review" is the process of using artificial intelligence to inspect the quality and suitability of a design.

[2230] "Sales information" refers to information such as the price and start date set when selling the design.

[2231] A "digital marketplace" is an online platform for publishing and selling digital designs.

[2232] A "drawing tool" is an instrument or software that a user uses to create a digital design.

[2233] The "image file upload function" is a function for importing external images into the system.

[2234] The "auto-save function" is a function that automatically saves the user's work at regular intervals.

[2235] This invention is a system that allows users to easily create digital designs and realize high-quality designs using AI support and emotion recognition technology. This system recognizes emotions in real time by analyzing facial expressions and voices while the user is creating digital designs using smart glasses, and proposes or modifies designs based on these emotions.

[2236] System Configuration

[2237] (Hardware)

[2238] Smart glasses: Devices with built-in cameras and microphones that capture the user's facial expressions and voice.

[2239] Server: A computing device that stores design data, provides AI support, and performs emotion recognition.

[2240] (software)

[2241] EmotionRecognizer: A library for recognizing emotions from facial expressions and speech.

[2242] DesignAIAssistant: An AI module that makes design suggestions based on emotion data.

[2243] ARInterface: An interface that displays design proposals through the augmented reality capabilities of smart glasses.

[2244] Program processing

[2245] Server: The user enters their authentication information, and the server authenticates them. If authentication is successful, the user is redirected to the operation screen. On the operation screen, the user can create a new digital design. The server automatically saves the user's design data at regular intervals, and also receives the completed design data and reviews it using AI. The user is notified of the review results.

[2246] Smart Glasses: The camera and microphone of the smart glasses are used to capture the user's facial expressions and voice data in real time, and emotions are recognized using EmotionRecognizer. Based on the recognized emotions, DesignAIAssistant makes design suggestions and displays them on the smart glasses screen through ARInterface.

[2247] Specific examples

[2248] For example, consider a user creating a new product display design. If the user is wearing smart glasses and working while smiling, EmotionRecognizer recognizes the user's facial expression as "joy." As a result, DesignAIAssistant suggests "ideas for bright, colorful displays," which are visually displayed through the ARInterface. By creating the display based on these suggestions, staff can complete more efficient and attractive displays in a shorter time.

[2249] Example prompt for a generative AI model:

[2250] Design an AI assistant that uses the camera and microphone in smart glasses to recognize staff emotions and then suggests in-store decorations and product displays based on those emotions. Suggestions should be made in real time and visually displayed through an AR interface.

[2251] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2252] Step 1:

[2253] The server receives authentication information from the user and performs authentication.

[2254] (Input) User authentication information (email address and password)

[2255] (Output) Authentication result (success or error message)

[2256] (Specific operation) The server receives the authentication information, checks it against the database, and if successful, redirects the user to the operation screen; if unsuccessful, displays an error message.

[2257] Step 2:

[2258] The user operates a user interface on the terminal to create a new digital design.

[2259] (Input) User design input (paint tool or image upload)

[2260] (Output) Design data being created

[2261] (Specific operation) The user creates a design using drawing tools and image file upload functions, and the device automatically saves the design data at regular intervals.

[2262] Step 3:

[2263] The smart glasses' camera and microphone are activated to capture the user's facial expressions and voice data.

[2264] (Input) Real-time facial expression and voice data from a camera and microphone

[2265] (Output) Acquired facial expression and voice data

[2266] (Specific operation) The smart glasses capture the user's face and record their speech.

[2267] Step 4:

[2268] The device analyzes the user's emotions from the data acquired using EmotionRecognizer.

[2269] (Input) Acquired facial expression and voice data

[2270] (Output) Analyzed emotion data (e.g., happiness, sadness, etc.)

[2271] (Specific operation) EmotionRecognizer analyzes facial expressions and voice data to extract specific emotions.

[2272] Step 5:

[2273] Based on the analyzed emotions, the device's DesignAIAssistant generates design suggestions.

[2274] (Input) Analyzed emotion data

[2275] (Output) Design proposals (color changes, layout proposals, etc.)

[2276] (Specific operation) Based on the emotion data, DesignAIAssistant generates appropriate design changes and new ideas and provides them to the user.

[2277] Step 6:

[2278] The ARInterface of the smart glasses visually displays the generated design proposal.

[2279] (Input) Generated design proposals

[2280] (Output) Design proposals displayed on the smart glasses display

[2281] (Specific operation) ARInterface overlays the suggestions on the screen of the smart glasses, providing visual feedback to the user.

[2282] Step 7:

[2283] The terminal uploads the user's completed design to the server.

[2284] (Input) Completed design data

[2285] (Output) Design data stored on the server

[2286] (Specific operation) The terminal sends the completed design data to the server, which stores it in a database.

[2287] Step 8:

[2288] The server uses AI to review the uploaded designs and notify the user of the results.

[2289] (Input) Uploaded design data

[2290] (Output) Review results (pass, corrections, etc.)

[2291] (Specific operation) The AI ​​algorithm analyzes the design data, checks for quality and policy violations, and notifies the user of the results.

[2292] Step 9:

[2293] The user sets up sales information and the server stores it.

[2294] (Input) Sales information (pricing, sales start date, etc.)

[2295] (Output)Sales information saved

[2296] (Specific operation) The user enters sales information, and the server saves it in the database.

[2297] Step 10:

[2298] The server publishes the digital design on the digital marketplace based on the set sales information.

[2299] (Input) Saved sales information and design data

[2300] (Output) Designs published on digital marketplaces

[2301] (Specific operation) The server publishes the design on the online marketplace based on the sales start date and time, and begins sales.

[2302] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2303] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2304] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2305] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2306] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2307] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2308] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2309] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2310] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2311] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2312] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2313] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2314] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2315] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2316] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2317] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2318] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2319] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2320] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2321] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2322] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2323] The following is further disclosed regarding the above embodiment.

[2324] Ok, so here are some suggested claims for your patent application:

[2325] (Claim 1)

[2326] a means for a user to enter authentication information;

[2327] A means for the server to authenticate the user based on the credentials and redirect the user to the dashboard page;

[2328] a means for users to create new digital designs;

[2329] providing a user interface and a means for users to save designs;

[2330] Providing AI support to help users improve the quality of their designs;

[2331] a means for users to upload their completed designs to the server;

[2332] The server receives the design data, reviews it using AI, and notifies the results of the review.

[2333] A means for a user to set sales information;

[2334] a means by which the server stores and publishes the selling preferences to the digital marketplace;

[2335] Digital design systems including.

[2336] (Claim 2)

[2337] 10. The digital design system of claim 1, wherein the user interface provides a painting tool and an image upload function.

[2338] (Claim 3)

[2339] 2. The digital design system according to claim 1, wherein the server includes a function for automatically saving the user's design data at regular intervals.

[2340] The above is the draft of the claims for the patent application, which clearly defines the technical features of the system.

[2341] "Example 1"

[2342] (Claim 1)

[2343] a means for a user to enter authentication information;

[2344] A means for the server to authenticate the user based on the credentials and redirect the user to the dashboard page;

[2345] a means for users to create new digital designs;

[2346] providing a user interface and a means for users to save designs;

[2347] The device provides AI support to help users improve the quality of their designs.

[2348] a means for users to upload their completed designs to the server;

[2349] The server receives the design data, reviews it using AI, and notifies the results of the review.

[2350] A means for a user to set sales information;

[2351] a means by which the server stores and publishes the selling preferences to the digital marketplace;

[2352] A means for the device to automatically save design data periodically;

[2353] Digital design systems including.

[2354] (Claim 2)

[2355] 10. The digital design system of claim 1, wherein the user interface provides a painting tool and an image upload function.

[2356] (Claim 3)

[2357] 10. The digital design system of claim 1, wherein the terminal uses the generative AI model to provide color adjustments, composition optimization, and font suggestions.

[2358] "Application Example 1"

[2359] New Claims

[2360] (Claim 1)

[2361] a means for a user to enter authentication information;

[2362] A means for the server to authenticate the user based on the credentials and redirect the user to the dashboard page;

[2363] a means for users to create new digital designs;

[2364] providing a user interface and a means for users to save designs;

[2365] Providing AI support to help users improve the quality of their designs;

[2366] a means for users to upload their completed designs to the server;

[2367] The server receives the design data, reviews it using AI, and notifies the results of the review.

[2368] A means for a user to set sales information;

[2369] a means by which the server stores and publishes the selling configuration to the virtual marketplace;

[2370] A means by which users can create digital designs in 3D space;

[2371] AI-assisted functions provide real-time color adjustment and composition suggestions,

[2372] Digital design systems including.

[2373] (Claim 2)

[2374] 10. The digital design system of claim 1, wherein the user interface provides a painting tool and an image upload function.

[2375] (Claim 3)

[2376] 2. The digital design system according to claim 1, wherein the server includes a function for automatically saving the user's design data at regular intervals.

[2377] This is the draft claim for a new invention patent application, which clearly defines the technical features of the system.

[2378] "Example 2: Combining Emotion Engines"

[2379] Understood. Below are the patent claims based on the new invention.

[2380] (Claim 1)

[2381] a means for a user to enter authentication information;

[2382] A means for the server to authenticate the user based on the credentials and redirect the user to the dashboard page;

[2383] a means for users to create new digital designs;

[2384] providing a user interface and a means for users to save designs;

[2385] a means for manipulating a user interface to create a design;

[2386] means for activating an emotion analysis module to analyze the user's emotional state;

[2387] A means to provide AI support and make design suggestions based on the results of emotion analysis;

[2388] Providing AI support to help users improve the quality of their designs;

[2389] a means for users to upload their completed designs to the server;

[2390] The server receives the design data, reviews it using AI, and notifies the results of the review.

[2391] A means for a user to set sales information;

[2392] A means by which the server stores and publishes sales settings to the online store;

[2393] A system including:

[2394] (Claim 2)

[2395] 10. The system of claim 1, wherein the user interface provides a painting tool and an image upload function.

[2396] (Claim 3)

[2397] 2. The system according to claim 1, wherein the server includes a function for automatically saving the user's design data at regular intervals.

[2398] The above is the scope of the patent claims that reflect the new invention.

[2399] "Application example 2 when combining emotion engines"

[2400] Rewriting of claims

[2401] (Claim 1)

[2402] a means for a user to enter authentication information;

[2403] A means for the server to perform authentication based on the authentication information and redirect the user to an operation screen;

[2404] a means for users to create new digital designs;

[2405] providing a user interface and a means for users to save designs;

[2406] Providing AI support to help users improve the quality of their designs;

[2407] means for using smart glasses as a display device for a user interface;

[2408] a means for capturing facial expression an...

Claims

1. a means for a user to enter authentication information; A means for the server to authenticate the user based on the credentials and redirect the user to the dashboard page; a means for users to create new digital designs; providing a user interface and a means for users to save designs; Providing AI support to help users improve the quality of their designs; a means for users to upload their completed designs to the server; The server receives the design data, reviews it using AI, and notifies the results of the review. A means for a user to set sales information; a means by which the server stores and publishes the selling preferences to the digital marketplace; Digital design systems including.

2. The digital design system of claim 1 , wherein the user interface provides a painting tool and an image upload function.

3. 2. The digital design system according to claim 1, wherein the server includes a function for automatically saving the user's design data at regular intervals. The above is the draft of the claims for the patent application, which clearly defines the technical features of the system.

Images