System

The system addresses collaboration challenges by using a server-generated project ID, AI suggestions, and real-time feedback to ensure consistency and fair compensation, enhancing the quality and fairness of creative projects.

JP2026035443APending Publication Date: 2026-03-04SOFTBANK GROUP CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024138286
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-08-19
Publication Date
2026-03-04

Smart Images

  • Figure 2026035443000001_ABST
    Figure 2026035443000001_ABST
Patent Text Reader

Abstract

To provide a system capable of promoting cooperation between creators and realizing a project with high completeness.SOLUTION: Means for receiving a request from a creator to start a project, means for generating a project ID and sending it back to the creator, means for sending theme information set by the creator to an AI and searching and analyzing related styles and elements from a database, means for recording the styles and elements selected by the creator, means for transmitting a notification of participation in the project to other creators, means for providing a platform for collaboration, and means for monitoring a work status in real time; A system comprising: means for managing progress; means for analyzing work content and providing feedback; means for collecting feedback from end users and providing it to creators; means for publishing works; and means for calculating and distributing copyrights and royalties appropriately.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] When creators with different art forms and styles collaborate to create artwork or projects, the following challenges can arise. First, it can be difficult to collaborate with other creators and incorporate different styles and techniques. Second, it can be difficult to blend different visual styles and art designs, which can lead to a lack of consistency in the overall direction of the project. As a result, it can be difficult to achieve a high-quality project. Furthermore, lack of transparency regarding the distribution of resources, copyrights, and compensation can hinder collaboration between creators. [Means for solving the problem]

[0005] To solve the above problems, the present invention provides the following solutions. First, a means is provided for receiving theme settings when a creator starts a project, generating and returning a project ID. Next, a means is provided for activating an AI module, searching and analyzing related art styles and elements from a database based on the set theme information, and suggesting them to the creator. A means is provided for recording the styles and elements selected by the creator and sending project participation notifications to other creators. Furthermore, a platform is provided for multiple creators to collaborate in real time, and a means is provided for monitoring the creators' work status in real time and managing progress. The AI ​​has a means for analyzing each creator's work and providing feedback to ensure consistency. A means is provided for disclosing project progress and intermediate deliverables to end users, collecting feedback from end users, and providing it to creators. By disclosing the final work and providing a means for properly calculating and distributing copyrights and remuneration, collaboration among creators is promoted and high-quality projects are realized.

[0006] "Creator" refers to an artist, writer, designer, or other person engaged in creative work on a project.

[0007] A "project" refers to an artwork or creative activity that is carried out jointly by creators based on a specific theme or purpose.

[0008] A "request" refers to the information a creator sends to a server to begin an art project.

[0009] A "server" refers to a computer system that receives requests from creators and performs tasks such as generating project IDs and launching AI modules.

[0010] "Project ID" means a server-generated unique identifier that identifies a particular project.

[0011] "Theme Information" refers to information about the project's theme and outline that a creator provides when starting a project.

[0012] "AI Module" refers to an artificial intelligence system that suggests relevant art styles and elements based on specified thematic information.

[0013] The "database" refers to a source of information that stores information such as past projects and art styles, and is searched and analyzed by the AI ​​module.

[0014] "Style" refers to a particular method or technique of expression in art or design.

[0015] "Elements" refer to the individual parts or features that make up a work of art or design.

[0016] "Notification" refers to a message sent by the server to other creators to encourage them to participate in the project.

[0017] A "platform" refers to an online environment or system that allows creators to collaborate in real time.

[0018] "Monitoring" refers to the server monitoring the creator's work status and progress in real time.

[0019] "Feedback" refers to the analysis results of work and suggestions for improvement that AI provides to creators.

[0020] "End users" refer to third parties who provide feedback on the progress and deliverables of a project.

[0021] "Publication" refers to providing the progress of a project or the finished product on the Internet or elsewhere for public viewing.

[0022] "Copyright" refers to the legal rights that creators have in their creative works.

[0023] "Remuneration" refers to the compensation or distribution that a creator receives for a project. [Brief explanation of the drawings]

[0024] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0025] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0026] First, the terms used in the following description will be explained.

[0027] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0028] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0029] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0030] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0031] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0032] [First embodiment]

[0033] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0034] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0035] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0036] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0037] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0038] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0039] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0040] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0041] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0042] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0043] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0044] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0045] As a specific embodiment of the present invention, a creative collaboration system using AI will be described in detail below. This system is composed of a server, a client (terminal), and an AI module.

[0046] Basic system configuration

[0047] Server: The server receives a request from a creator to start a project, generates a project ID, returns the project ID to the creator, and activates the AI ​​module. It also monitors the progress of the project and manages collaboration between creators.

[0048] Device: A device is used by each creator to set the project theme, input work details, receive and incorporate feedback from AI, and collaborate with other creators in real time.

[0049] AI Module: The AI ​​module searches the database based on the theme information set by the creator, suggests related art styles and elements, and analyzes the creator's work to provide feedback to ensure consistency.

[0050] System Operation

[0051] User starts a project:

[0052] The creator (user) sends a request to start an art project to the server from their device, entering the theme information (e.g., "future city"). The server receives this request, generates a project ID, and returns it to the user.

[0053] AI generates thematic suggestions:

[0054] The server launches an AI module based on the project ID and theme information. The AI ​​module searches the database for relevant art styles (e.g., cyberpunk, retro-future, metal city) and suggests them to the user. The user can then review these suggestions on their device and select the styles and elements that interest them.

[0055] Notifying and participating with other creators:

[0056] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators (User B, User C) access the project from their devices and approve their participation. Each creator may have a different role, such as design, concept, or story.

[0057] Real-time collaboration:

[0058] The server provides a platform where multiple creators can collaborate in real time. Creators input their work and share it with other creators. The AI ​​module analyzes the creators' work in real time and provides feedback to ensure consistency. For example, while a designer (User C) is creating a visual of a futuristic city, a writer (User B) is writing a story about that city. The AI ​​then makes suggestions to harmonize these different pieces of content.

[0059] End-user feedback and project completion:

[0060] The server will publish the project's progress and intermediate results to end users and collect feedback. End user feedback will be provided to the creator, and if necessary, the AI ​​will reanalyze and re-suggest the direction of the project. Finally, once all feedback has been incorporated and the project is complete, the server will publish the project.

[0061] Copyright and Revenue Sharing:

[0062] After a project is completed, the server will properly calculate and distribute copyright and compensation. By distributing appropriate compensation based on each creator's contribution, a fair and transparent compensation system is realized.

[0063] This embodiment allows creators with different styles and techniques to collaborate on consistent, high-quality art projects, and further enhances the quality of the projects by incorporating feedback from end users.

[0064] The processing flow will be explained below.

[0065] Step 1:

[0066] User: Sends a request to the server from the device to start an art project, entering the project's theme information (e.g., "future city").

[0067] Step 2:

[0068] Server: Receives the request from the user, generates a project ID, and returns it to the user.

[0069] Step 3:

[0070] Server: Sends the project ID and theme information to the AI ​​module and starts the AI ​​module.

[0071] Step 4:

[0072] AI module: Searches and analyzes related art styles and elements from a database and suggests them to the creator (e.g., cyberpunk, retro-future, metal city).

[0073] Step 5:

[0074] User: Review AI suggestions on your device and select the style or element that interests you (e.g., choose Cyberpunk).

[0075] Step 6:

[0076] Server: Records user choices and establishes project direction.

[0077] Step 7:

[0078] Server: Sends a notification to other creators (User B, User C) to join the project.

[0079] Step 8:

[0080] User B and User C: Access the project from their device and approve their participation.

[0081] Step 9:

[0082] Server: Provides a platform where multiple creators can collaborate in real time.

[0083] Step 10:

[0084] Creators (Users A, B, and C): Enter and share their work on the platform.

[0085] Step 11:

[0086] Server: Monitors the creators' work status in real time and manages progress.

[0087] Step 12:

[0088] AI module: Analyzes each creator's work and provides feedback to ensure consistency. For example, it suggests incorporating User B's story elements into User C's design.

[0089] Step 13:

[0090] Creators (Users A, B, and C): Review the AI's feedback and incorporate it into their own work.

[0091] Step 14:

[0092] Server: Publishes project progress and intermediate deliverables to end users and gathers feedback.

[0093] Step 15:

[0094] End users: Enter feedback and ratings from their devices and send them to the server.

[0095] Step 16:

[0096] Server: Provides collected feedback to project creators, and if necessary, the AI ​​reanalyzes and re-proposes new directions for the project.

[0097] Step 17:

[0098] Creators (Users A, B, and C): Incorporate feedback, work on it, and refine the project into its final form.

[0099] Step 18:

[0100] Server: Confirms that the project is complete and officially publishes the final product.

[0101] Step 19:

[0102] Server: Calculates and distributes copyrights and rewards appropriately. Distributes appropriate rewards to each creator based on their contribution.

[0103] Step 20:

[0104] Creators (Users A, B, and C): Receive rewards distributed in a fair and transparent manner.

[0105] Example 1

[0106] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0107] Modern creative projects require creators from different genres to collaborate on consistent, high-quality works. However, challenges exist, such as a lack of collaboration between individual creators and difficulty in unifying the overall direction. Furthermore, the lack of a mechanism for effectively incorporating feedback from end users makes it difficult to improve the quality of the final project. Furthermore, the distribution of copyright and compensation based on each creator's contribution is unclear, creating problems of unfairness.

[0108] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0109] In this invention, the server includes: means for receiving a request from a creator, such as an artist, writer, or designer, to start a project; means for generating a project ID based on the received request and returning it to the creator; means for activating an artificial intelligence module based on the project ID and sending theme information set by the creator to the artificial intelligence; means for searching and analyzing related styles and elements from a database and suggesting them; means for displaying the suggestions to the creator and recording the selected styles and elements; means for sending project participation notifications to other creators; means for providing a platform for multiple creators to collaborate in real time; means for monitoring the work status of creators in real time and managing progress; means for analyzing the work content of creators and providing feedback to ensure consistency using a web socket; means for disclosing the project progress and intermediate results to end users; means for collecting feedback from end users and providing it to creators; means for disclosing the final work; and means for appropriately calculating and distributing copyrights and remuneration. This enables creators of different genres to effectively collaborate and collaborate on consistent, high-quality works. Furthermore, by incorporating feedback from end users, we can improve the quality of projects and ensure fair distribution of copyright and rewards based on each creator's contribution.

[0110] An "artist" is a professional who creates works of art such as music, painting, or sculpture.

[0111] An "author" is a professional who writes literary works such as novels, essays, poems, and plays.

[0112] A "designer" is a professional who works on visual and functional design, such as product design, graphic design, and industrial design.

[0113] "Creator" is a general term that refers to professionals who produce creative works, such as artists, writers, and designers.

[0114] A "project" is a plan that is set up around a specific theme or purpose and is produced jointly by multiple creators.

[0115] A "request" is a request that a creator sends to the server when starting a project.

[0116] A "project ID" is an identification code generated to uniquely identify a project.

[0117] The "artificial intelligence module" is a machine learning algorithm that analyzes the theme information set by the creator and suggests related styles and elements.

[0118] A "database" is an information management system that systematically organizes information and makes it easy to search and retrieve.

[0119] A "style" is a particular method of expression or artistic school in creative work.

[0120] "Elements" are the individual components or parts that make up a creative work.

[0121] "Infrastructure" refers to the infrastructure and systems that allow multiple creators to collaborate in real time.

[0122] "Monitoring" means that the system monitors the creator's work status in real time and detects progress and abnormalities.

[0123] "Feedback" refers to the advice and evaluation provided by the artificial intelligence module on the creator's work.

[0124] "WEB Socket" is a communication protocol for real-time two-way communication between a client and a server.

[0125] "End User" refers to a general user who views and evaluates a completed creative project.

[0126] "Copyright" refers to the exclusive legal rights that creators have in their work.

[0127] "Remuneration" refers to the compensation or salary paid to creators based on their contribution.

[0128] As a specific embodiment of the present invention, a creative collaboration system using AI will be described. This system is realized by a server, a terminal, and an AI module.

[0129] Basic system configuration

[0130] Server: The server receives a project start request from a creator, generates a unique project ID, returns the generated project ID to the creator, and activates the AI ​​module. It also monitors the progress of the project and manages collaboration between creators.

[0131] Device: A device used by each creator to set the project theme, input work details, receive and incorporate feedback from AI, and collaborate with other creators in real time.

[0132] AI module: Searches the database based on thematic information provided by the user, suggests related styles and elements, and analyzes the creator's work and provides feedback to ensure consistency.

[0133] Hardware and Software

[0134] Server: An AWS (registered trademark) EC2 instance is used, which provides the main server-side functions such as generating a project ID, launching an AI module, and managing the project progress.

[0135] Devices: PCs, tablets, smartphones, etc. These devices run common operating systems such as Windows 10, iOS 14, and ANDROID® 11.

[0136] AI module: Uses the GPT-4® model and a custom model by TENSORFLOW®, which allows for thematic suggestions and feedback on styles and elements.

[0137] Detailed description of operation

[0138] Project Start:

[0139] The creator (user) uses a device to send a project start request to the server. The request includes theme information (e.g., "future city"). The server receives this request, generates a project ID, and returns it to the user.

[0140] AI-generated suggestions:

[0141] The server launches an artificial intelligence module based on the project ID and theme information. The AI ​​module searches for relevant styles and elements in a database (e.g., Guardian DB, Style Repository) and sends suggestions to the user. The user can review these suggestions on their device and select the styles and elements they are interested in.

[0142] Creator Notification and Involvement:

[0143] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators (User B, User C) access the project from their devices and approve their participation. Each creator has a different role (designer, writer, etc.).

[0144] Real-time collaboration:

[0145] The server provides a platform for multiple creators to collaborate in real time. Creators input their work and share it with other creators. The AI ​​module analyzes the work in real time and provides feedback to ensure consistency. For example, while a designer (User C) is creating a visual of a futuristic city, a writer (User B) is writing a story about that city. The AI ​​makes suggestions to harmonize these different pieces of content.

[0146] End-user feedback and project completion:

[0147] The server will make the project's progress and intermediate results public to end users and collect feedback. The end users' feedback will be provided to the creator, and if necessary, the AI ​​will reanalyze and re-suggest the direction of the project. Finally, when all feedback has been incorporated and the project is completed, the server will publish the finished work.

[0148] Copyright and Revenue Sharing:

[0149] After the project is completed, the server will properly calculate and distribute copyright and rewards, distributing appropriate rewards to each creator based on their contribution.

[0150] Specific examples

[0151] Project theme: "Future City"

[0152] Example prompt for generative AI model:

[0153] Start your futuristic city-themed art project. Choose from cyberpunk, retrofuture, and metal city styles.

[0154] This system allows creators from different genres to collaborate effectively and collaborate to produce consistent, high-quality works. By incorporating feedback from end users, the quality of the projects can be further improved and fair copyright and reward distribution can be achieved.

[0155] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0156] Step 1:

[0157] Submitting a Project Start Request

[0158] User: Sends a request from the device to the server to start an art project, including the theme information.

[0159] Input: Theme information (e.g. "Future City")

[0160] Output: Request data to the server

[0161] Specific operation: The user enters the theme information in a dedicated form and clicks the "Start" button.

[0162] Step 2:

[0163] Generate and return a project ID

[0164] Server: Receives the project start request, generates a unique project ID, and returns it to the user.

[0165] Input: Project Start Request

[0166] Output: Project ID

[0167] Specific operation: The server generates a project ID using the UUID algorithm and returns it to the user's device as an HTTP response.

[0168] Step 3:

[0169] Launching the AI ​​module and sending thematic information

[0170] Server: Starts the AI ​​module based on the generated project ID and theme information, and sends the theme information to the AI.

[0171] Input: Project ID, Theme information

[0172] Output: AI startup state based on theme information

[0173] What it does: The server triggers a Python script that passes the theme information to an AI model (e.g., GPT-4).

[0174] Step 4:

[0175] AI-powered style and element suggestions

[0176] AI module: Searches and analyzes relevant styles and elements from a database and generates suggestions.

[0177] Input: Theme information

[0178] Output: Style suggestions (e.g. cyberpunk, retro-future, metal city)

[0179] What it does: The AI ​​module uses the GPT-4 model to generate related styles like cyberpunk and retro-future.

[0180] Step 5:

[0181] View and select suggestions

[0182] User: Review AI-generated style suggestions on their device and select the styles and elements that interest them.

[0183] Input: Style suggestions

[0184] Output: Selected Style

[0185] Specific behavior: The user clicks to select the style they prefer from multiple style suggestions displayed on the web interface.

[0186] Step 6:

[0187] Creator participation notification

[0188] Server: Once the user confirms their selection, they notify other creators that they have joined the project.

[0189] Input: Selected style information

[0190] Output: Notification of joining other creators

[0191] What it does: The server uses the notification API to send emails and in-app notifications to creators, providing them with project details and a link to join.

[0192] Step 7:

[0193] Real-time collaboration

[0194] Server: Provides a real-time collaboration platform, allowing creators to input and share their work.

[0195] Input: Creator's work

[0196] Output: Shared work in real time

[0197] Specific operation: The server uses WebSocket to ensure real-time communication, and each creator's actions are immediately reflected to other users.

[0198] Step 8:

[0199] Providing Feedback

[0200] AI module: Analyzes creators' work in real time and provides feedback to ensure consistency.

[0201] Input: Creator's work

[0202] Output: Feedback information

[0203] How it works: The AI ​​module periodically collects data and evaluates consistency. For example, while a designer is creating a visual representation of a futuristic city, the AI ​​can suggest consistent color schemes and design elements.

[0204] Step 9:

[0205] Gathering feedback from end users

[0206] Server: Publishes project progress and intermediate deliverables to end users and gathers feedback.

[0207] Input: Intermediate deliverables

[0208] Output: End-user feedback data

[0209] What it does: The server sends surveys to end users at specific time intervals and collects feedback form data.

[0210] Step 10:

[0211] Publishing the project

[0212] Server: Publish the final project incorporating all feedback.

[0213] Input: End-user feedback

[0214] Output: Published final project

[0215] Specific operation: The server uploads the final data of the project to the specified public server, generates a URL and provides it to the end user.

[0216] Step 11:

[0217] Copyright and Remuneration Distribution

[0218] Server: After the project is completed, we will properly calculate and distribute copyright and remuneration.

[0219] Input: Creator contribution data

[0220] Output: Distributed rewards

[0221] How it works: The server runs an algorithm that calculates each creator's contribution and transfers the rewards directly to their digital wallet.

[0222] (Application example 1)

[0223] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0224] Conventional creative collaboration systems not only make it difficult for different creators to collaborate in real time, but also limit the production of consistent, high-quality content. They also make it difficult to improve the project's quality because they cannot collect feedback from end users in real time and incorporate it into the project. Furthermore, they do not support the generation and sharing of augmented reality content using smart devices, so they cannot meet the diverse creative needs of today.

[0225] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0226] In this invention, the server includes: means for receiving a request from a creator such as an artist, writer, or designer to start a project; means for generating a project ID based on the received request and returning it to the creator; means for activating an AI module based on the project ID and sending theme information set by the creator to the AI; means for searching, analyzing, and suggesting related styles and elements from a database; means for displaying the suggested content to the creator and recording the selected style and elements; means for sending notifications of project participation to other creators; means for providing a platform for multiple creators to collaborate in real time; means for monitoring the work status of creators in real time and managing progress; means for analyzing the work content of creators and providing feedback to ensure consistency; means for disclosing the project progress and intermediate deliverables to end users; means for collecting feedback from end users and providing it to creators; means for disclosing the final work; means for a user to start a project using a smart device and input theme settings and work content; means for displaying augmented reality content generated on the smart device in real time and sharing it with other creators; and means for collecting feedback from end users via an external device in real time and providing it to creators. This not only strengthens real-time collaboration between creators and enables the creation of consistent, high-quality content, but also allows for feedback from end users to be reflected in real time, improving the completeness of projects. It also supports the creation and sharing of augmented reality content using smart devices.

[0227] A "creator" is an individual or group that performs creative work on a project, such as an artist, writer, or designer.

[0228] "Project ID" means a unique identifier generated at the initiation of a project and used to manage and track the project.

[0229] An "AI module" is a software component that uses artificial intelligence to analyze data and make suggestions.

[0230] "Theme information" is information that indicates the general framework and direction of the creation set by the creator for the project.

[0231] A "database" is a collection of data that stores related styles and elements that creators can reference.

[0232] "Styles and elements" refer to the designs, concepts, techniques, etc. used in creative work.

[0233] A "platform" is a system that serves as the technical foundation for multiple creators to collaborate in real time.

[0234] "Progress" is information that indicates the progress and achievement of a project.

[0235] "Feedback" means opinions or ratings provided by End Users or other Creators.

[0236] "End users" are the recipients of the final product and the providers of feedback.

[0237] "Copyright" is the legal right that creators have in the works they create.

[0238] "Remuneration" is the compensation a creator receives based on their contribution to the project.

[0239] A "smart device" is an electronic device with advanced computing power and internet connectivity, including, for example, smartphones and smart glasses.

[0240] "Augmented reality content" is content that overlays digital information onto visual information from the real world.

[0241] An "external device" is hardware that is used as part of a system but is not integrated into the internal structure.

[0242] As a specific embodiment of the present invention, a system in which creators start projects using smart devices and collaborate in real time is described below. This system is composed of a server, terminals (smart devices), and an AI module.

[0243] Basic system configuration

[0244] Server: The server receives project start requests from creators, generates a project ID, returns the project ID to the creator, and activates the AI ​​module. It also monitors the progress of the project and manages collaboration between creators.

[0245] Terminal (Smart Device): A terminal is a device used by each creator to set the theme, input work content, receive and incorporate feedback from AI, and collaborate with other creators in real time. Examples of smart devices include smart glasses and smartphones.

[0246] AI Module: The AI ​​module searches the database based on the theme information set by the creator, suggests related styles and elements, and analyzes the creator's work to provide feedback to ensure consistency.

[0247] System Operation

[0248] 1. User starts a project:

[0249] The user uses a smart device to send a project start request to the server, entering the theme information (e.g., "Future Fashion"). The server receives this request, generates a project ID, and returns it to the user.

[0250] 2. AI generates thematic suggestions:

[0251] The server launches an AI module based on the project ID and theme information. The AI ​​module searches the database for relevant styles and elements and suggests them to the user (e.g., cyberpunk design). The user can then review these suggestions on their device and select the styles and elements they are interested in.

[0252] 3. Notifying and Involving Other Creators:

[0253] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators can access the project from their devices and approve their participation. Each creator has a different role, such as design or concept.

[0254] 4. Real-time collaboration:

[0255] The server provides a platform where multiple creators can collaborate in real time. Creators input their work via smart devices and share it with other creators. For example, a designer might create a futuristic fashion item in augmented reality (AR), while other creators write a story related to that item. The AI ​​module analyzes these different pieces of content and provides feedback to ensure consistency.

[0256] 5. End-user feedback and project completion:

[0257] The server displays the project's progress and intermediate results to end users and collects feedback. The collected feedback is provided to the creator in real time, and the AI ​​module reanalyzes the project's direction as needed. Finally, when all feedback has been incorporated and the project is complete, the server publishes the project.

[0258] Examples of concrete examples and prompts

[0259] Example: A user wants to design new AR outfits for a future fashion show and starts the project using smart glasses.

[0260] Example prompt sentence:

[0261] Project Theme: Future Fashion

[0262] Design direction: Cyberpunk

[0263] Required elements: metallic texture, neon lights

[0264] In this way, the system of the present invention not only strengthens real-time collaboration between creators and enables the creation of consistent, high-quality content, but also improves the completeness of projects by incorporating feedback from end users in real time. It also supports the creation and sharing of augmented reality content using smart devices.

[0265] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0266] Step 1:

[0267] A user sends a project start request to the server using a smart device. The request data includes theme information (e.g., "Future Fashion") as input, and the server receives this data. The server analyzes the request data, recognizes the start of a project, and generates a project ID as output.

[0268] Step 2:

[0269] The server returns the generated project ID to the user and activates the AI ​​module, which sends the theme information to the AI ​​module. The server receives the project ID and theme information as input and sends them to the AI ​​module. The AI ​​module searches the database based on the theme information and generates related style and element suggestions as output.

[0270] Step 3:

[0271] The server sends the suggestions from the AI ​​module to the device and displays them to the user. The user reviews these suggestions on the device and selects the styles and elements they are interested in. The input is the suggestions, which the device displays to the user. After the user selects the styles and elements, the selection data is generated as the output and sent to the server.

[0272] Step 4:

[0273] The server records the user's selection data and sends notifications to other creators about their participation in the project. The server receives the user's selection data and other creator information as input, generates notifications based on this, and sends them to other creators. The server also generates notifications to other creators about their participation in the project as output.

[0274] Step 5:

[0275] Other creators access the project from their devices and approve their participation. The input is a participation notification, which the device displays to other creators. When other creators approve their participation, participation approval data is generated as output and sent to the server.

[0276] Step 6:

[0277] The server provides a real-time collaboration platform for projects, where creators can input their work details via smart devices and share them with other creators. The server receives the work data from each creator in real time and shares it on the collaboration platform as output.

[0278] Step 7:

[0279] The AI ​​module analyzes each creator's work and provides feedback to ensure consistency. As input, the AI ​​module analyzes each creator's work data. As output, consistency feedback is generated and provided to each creator.

[0280] Step 8:

[0281] The server publishes the project progress and intermediate results to end users and collects feedback. The input is intermediate result data, which the server publishes to end users. Feedback from end users is collected, and feedback data is generated as output and provided to the creator.

[0282] Step 9:

[0283] The server reanalyzes the AI ​​module based on the collected feedback data and makes a new proposal for the project's direction. The AI ​​module reanalyzes the feedback data and current project data as input. The output is a new proposal that is provided to the creator.

[0284] Step 10:

[0285] Finally, when all feedback is incorporated and the project is completed, the server publishes the project. The input is the final product data, which the server processes in the end. The output is the published data of the final product.

[0286] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0287] As a specific embodiment of the present invention, we will explain in detail a creative collaboration system using AI combined with an emotion engine that recognizes user emotions. This system is composed of a server, a client (terminal), an AI module, and an emotion engine.

[0288] Basic system configuration

[0289] Server: The server receives a project start request from a creator, generates a project ID, returns the project ID to the creator, and starts the AI ​​module and emotion engine. The server monitors the progress of the project and manages collaboration between creators.

[0290] Terminal: A terminal is a device used by each creator to set the project theme and input work content, receive and incorporate feedback from AI, receive interface information from the emotion engine, and collaborate in real time with other creators.

[0291] AI Module: The AI ​​module searches the database based on the theme information set by the creator, suggests related art styles and elements, and analyzes the creator's work to provide feedback to ensure consistency.

[0292] Emotion Engine: The emotion engine recognizes the user's emotions and suggests appropriate art styles and elements based on the emotions. It also monitors the user's emotions in real time and uses that information for feedback and interface generation.

[0293] System Operation

[0294] User starts a project:

[0295] The creator (user) sends a request to start an art project to the server from their device, entering the theme information (e.g., "future city"). The server receives this request, generates a project ID, and returns it to the user.

[0296] AI generates thematic suggestions:

[0297] The server launches an AI module and emotion engine based on the project ID and theme information. The AI ​​module searches the database for relevant art styles (e.g., cyberpunk, retrofuture, metal city) and suggests them to the user. The emotion engine analyzes the user's emotions and adjusts the suggestions based on the results. The user then reviews these suggestions on their device and selects the style or element that interests them (e.g., cyberpunk).

[0298] Notifying and participating with other creators:

[0299] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators (User B, User C) access the project from their devices and approve their participation. Each creator may have a different role, such as design, concept, or story.

[0300] Real-time collaboration:

[0301] The server provides a platform where multiple creators can collaborate in real time. Creators input their work and share it with other creators. The AI ​​module analyzes the creators' work in real time and provides feedback to ensure consistency. The emotion engine monitors the creators' emotional state and makes adjustments to the interface or suggestions for additions accordingly. For example, if a designer (User C) is nervous, the emotion engine will suggest graphics that have a relaxing effect.

[0302] End-user feedback and project completion:

[0303] The server will publish the project's progress and intermediate results to end users and collect feedback. End user feedback will be provided to the creator, and the AI ​​and emotion engine will reanalyze and re-suggest the direction of the project as needed. Finally, once all feedback has been incorporated and the project is complete, the server will publish the project.

[0304] Copyright and Revenue Sharing:

[0305] After a project is completed, the server will properly calculate and distribute copyright and compensation. By distributing appropriate compensation based on each creator's contribution, a fair and transparent compensation system is realized.

[0306] Database update:

[0307] The server accumulates project data and feedback along with the analysis results of the emotion engine, and updates it as a database that will be useful for the next project.

[0308] This embodiment allows creators with different styles and techniques to collaborate on consistent, high-quality art projects. Analyzing user sentiment and adjusting suggestions and feedback based on it provides a more natural and effective collaborative environment. Furthermore, incorporating feedback from end users can further refine the quality of the project.

[0309] The processing flow will be explained below.

[0310] Step 1:

[0311] User: Sends a request to the server from the device to start an art project, entering project theme information (e.g., "future city") and initial setting information.

[0312] Step 2:

[0313] Server: Receives the request from the user, generates a project ID, and returns it to the user.

[0314] Step 3:

[0315] Server: Activates the AI ​​module and emotion engine based on the project ID and theme information.

[0316] Step 4:

[0317] Emotion engine: Analyzes the initial setup information and the user's real-time emotional data, for example, by using the camera and microphone to analyze the user's facial expressions and tone of voice to identify their emotional state.

[0318] Step 5:

[0319] AI module: Searches and analyzes related art styles and elements (e.g., cyberpunk, retro-future, metal city) from the database and suggests them to the user.

[0320] Step 6:

[0321] Emotion engine: Adjusts the AI ​​module's suggestions based on the user's real-time emotional data, for example, suggesting bolder styles if the user is excited.

[0322] Step 7:

[0323] User: Review suggestions from the AI ​​and emotion engine on their device and choose the style or element that interests them (e.g., choose Cyberpunk).

[0324] Step 8:

[0325] Server: Records user choices and establishes project direction.

[0326] Step 9:

[0327] Server: Sends a notification to other creators (User B, User C) to join the project.

[0328] Step 10:

[0329] User B and User C: Access the project from their device and approve their participation.

[0330] Step 11:

[0331] Server: Provides a platform where multiple creators can collaborate in real time.

[0332] Step 12:

[0333] Creators (Users A, B, and C): Enter and share their work on the platform.

[0334] Step 13:

[0335] Server: Monitors the creators' work status in real time and manages progress.

[0336] Step 14:

[0337] AI module: Analyzes each creator's work and provides feedback to ensure consistency. For example, it suggests incorporating User B's story elements into User C's design.

[0338] Step 15:

[0339] Emotion Engine: Monitors the creators' emotional state in real time and adjusts the interface and feedback as needed. For example, if User A is feeling stressed, it will provide encouraging messages and inspiration.

[0340] Step 16:

[0341] Creators (Users A, B, and C): Review the feedback from the AI ​​and emotion engine and incorporate it into their work.

[0342] Step 17:

[0343] Server: Publishes project progress and intermediate deliverables to end users and gathers feedback.

[0344] Step 18:

[0345] End users: Enter feedback and ratings from their devices and send them to the server.

[0346] Step 19:

[0347] Server: Provides collected feedback to project creators, and if necessary, the AI ​​and emotion engine reanalyze and resuggest the direction of the project.

[0348] Step 20:

[0349] Creators (Users A, B, and C): Incorporate feedback, work on it, and refine the project into its final form.

[0350] Step 21:

[0351] Server: Confirms that the project is complete and officially publishes the final product.

[0352] Step 22:

[0353] Server: Calculates and distributes copyrights and rewards appropriately. Distributes appropriate rewards to each creator based on their contribution.

[0354] Step 23:

[0355] Creators (Users A, B, and C): Receive rewards distributed in a fair and transparent manner.

[0356] Example 2

[0357] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0358] In traditional creative projects, it is not easy for multiple creators to collaborate and produce consistent, high-quality deliverables. Many challenges exist, including collaboration between creators, progress management, feedback sharing, and maintaining consistency. Coordinating emotional collaboration is also difficult with traditional systems. Furthermore, effectively incorporating feedback from end users and properly allocating rewards based on creators' contributions are also challenges.

[0359] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for receiving a request from a creator to start a project, means for generating a project ID based on the received request and returning it to the creator, means for activating an artificial intelligence module based on the project ID and transmitting theme information set by the creator to the artificial intelligence, means for searching and analyzing related styles and elements from a database and suggesting them, means for displaying the suggested content to the creator and recording the selected style and element, means for sending project participation notifications to other creators, means for providing a platform for multiple creators to collaborate in real time, means for monitoring the work status of creators in real time and managing the progress, means for analyzing the work content of creators and providing feedback to ensure consistency, means for disclosing the progress of the project and intermediate deliverables to end users, means for collecting feedback from end users and providing it to creators, means for disclosing the final work, means for appropriately calculating and distributing copyrights and remuneration, and means for monitoring user sentiment in real time and adjusting suggestions and interfaces based on the results. This allows multiple creators to efficiently collaborate on consistent, high-quality art projects, realizing natural and effective collaboration based on emotions. It also allows for proper incorporation of feedback from end users, improving the quality of projects, and ensuring fair and transparent reward distribution based on creators' contributions.

[0360] A "creator" is a person who participates in an art project and engages in creative activities, including artists, writers, designers, etc.

[0361] "Project ID" is a unique identifier generated by the server to identify each project.

[0362] "Artificial intelligence" is an advanced computer program that searches and analyzes a database based on thematic information set by the creator, and suggests related styles and elements.

[0363] "Theme information" refers to information about the subject and concept of a project that a creator enters at the start of the project.

[0364] A "database" is a collection of data that stores related styles and elements for AI to search and analyze.

[0365] "Style and Elements" refers to the designs, concepts, and components associated with an art project that ensure its consistency and quality.

[0366] A "collaboration platform" is an environment within a system that allows multiple creators to collaborate in real time.

[0367] "Feedback" refers to opinions and reactions regarding the progress and content of a project provided by creators and end users.

[0368] "End users" are the final users who view the progress and intermediate deliverables of a project and provide feedback.

[0369] "Copyright" is the legal ownership of a creator's work.

[0370] "Remuneration" means monetary compensation that is calculated and distributed fairly based on the creator's level of contribution.

[0371] "Means for monitoring user emotions in real time" refers to technology that instantly analyzes the user's emotional state and adjusts suggestions and interfaces based on the results.

[0372] This invention relates to an AI-based creative collaboration system that combines an emotion engine that recognizes user emotions. This system consists of a server, a client (terminal), an AI module, and an emotion engine.

[0373] server:

[0374] The server receives a request from a creator to start a project and generates a project ID. The generated project ID is returned to the creator, after which the artificial intelligence module and emotion engine are activated. Furthermore, the server monitors the progress of the project and manages collaboration between creators.

[0375] Device:

[0376] The terminal is a device used by each creator to set the project theme and input work details, receive and reflect feedback from artificial intelligence, receive interface information from the emotion engine, and collaborate in real time with other creators.

[0377] Artificial Intelligence Module:

[0378] The AI ​​module searches the database based on the theme information set by the creator, suggests related art styles and elements, analyzes the creator's work, and provides feedback to ensure consistency. For example, if the theme is "future city," it will suggest art styles such as "cyberpunk," "retrofuture," and "metal city."

[0379] Emotion Engine:

[0380] The emotion engine recognizes the user's emotions and suggests appropriate art styles and elements based on their emotions. It also monitors the user's emotions in real time and uses that information for feedback and interface generation. For example, if the user is tense, it suggests elements that have a relaxing effect.

[0381] System Operation

[0382] Project Start:

[0383] The user sends a request to start an art project from their device to the server, entering the theme information (e.g., "future city"). The server receives this request, generates a project ID, and returns it to the user.

[0384] AI-generated suggestions:

[0385] The server launches an AI module and emotion engine based on the project ID and theme information. The AI ​​module searches the database for relevant art styles and generates suggestions. The emotion engine analyzes the user's emotions and adjusts the suggestions. The user can review these suggestions on their device and select the style or element that interests them (e.g., "cyberpunk").

[0386] Creator-to-creator participation notifications:

[0387] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators (User B and User C) can access the project from their devices and approve their participation.

[0388] Real-time collaboration:

[0389] The server provides a platform where multiple creators can collaborate in real time. Creators can input their work and share it with other creators. An artificial intelligence module analyzes the creators' work and provides feedback to ensure consistency. An emotion engine monitors the creators' emotional state and makes interface adjustments and additional suggestions accordingly.

[0390] End-user feedback:

[0391] The server displays the progress of the project and intermediate results to end users and collects their feedback. End users' feedback is provided to the creator, and if necessary, the AI ​​and emotion engine reanalyze and re-suggest the direction of the project.

[0392] Complete and publish the project:

[0393] Finally, when all feedback is incorporated and the project is completed, the server will publish the project. For the completed project, the server will properly calculate and distribute copyright and rewards.

[0394] Database update:

[0395] The server accumulates project data, feedback, and the analysis results of the emotion engine, and updates it as a database that will be useful for the next project.

[0396] Specific prompt examples:

[0397] At the start of the project:

[0398] "Start an art project with a futuristic city theme. Choose an appropriate style from Cyberpunk, Retrofuture, or Metal City."

[0399] When collaborating in real time:

[0400] "Based on the current work, please maintain consistency between creators and incorporate the feedback suggested by the emotion engine. If a designer is nervous, suggest a relaxation graphic."

[0401] This embodiment allows creators with different styles and techniques to collaborate on consistent, high-quality art projects. Analyzing user sentiment and adjusting suggestions and feedback based on it provides a more natural and effective collaborative environment. Furthermore, incorporating feedback from end users can further refine the quality of the project.

[0402] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0403] Step 1:

[0404] The user sends a request to start an art project from their device. The input is the project start request and theme information (e.g., "future city"). The server receives the request, generates a project ID (e.g., "123XYZ"), and returns it to the user. This allows the server to generate a unique ID as an identifier for the project, providing a basis for recognizing the project. Specifically, the user enters "future city" as the theme and clicks the "Start Project" button.

[0405] Step 2:

[0406] The server launches the AI ​​module and emotion engine based on the project ID and theme information. The input is the project ID and theme information, and the output is the startup status of the AI ​​module and emotion engine. This lays the foundation for all analysis and proposals related to the project. Specifically, the server sends the project ID "123XYZ" and theme "Future City" to the AI ​​module and simultaneously launches the emotion engine.

[0407] Step 3:

[0408] The AI ​​module searches and analyzes related art styles and elements from the database to generate suggestions. The input is theme information, and the output is suggested art styles (e.g., "cyberpunk," "retrofuture," "metal city"). This gives users multiple options for the direction of their project. Specifically, the AI ​​module searches the database based on the theme "future city" and suggests related art styles.

[0409] Step 4:

[0410] The emotion engine monitors the user's emotions and adjusts the suggestions based on the results. The input is the user's emotional data, and the output is adjusted suggestions (e.g., suggestions that will relax a user who is in a tense state). This allows the engine to provide suggestions that are appropriate for the user's emotional state. Specifically, the emotion engine analyzes the camera feed and identifies the user's emotional state.

[0411] Step 5:

[0412] The user reviews the proposed art styles on their device and selects the style or elements they like. The input is the proposed art style, and the output is the selected style (e.g., "cyberpunk"). This confirms the progress of the project based on the user's preferences. Specifically, the user selects "cyberpunk" on their device and sends that information to the server.

[0413] Step 6:

[0414] The server sends a notification to other creators to join the project. The input is the user's selection and the project ID, and the output is a participation notification. This prepares other creators to join the project. As a specific operation, the server sends a participation invitation email to other creators.

[0415] Step 7:

[0416] Other creators access the project from their devices and approve their participation. The input is a participation notification, and the output is an acceptance of participation. This confirms that multiple creators are officially participating in the project. Specifically, the other creators check the email notification and approve their participation in the project.

[0417] Step 8:

[0418] The server provides a platform for multiple creators to collaborate in real time. The input is the creator's consent to participate, and the output is access rights to the shared platform. This allows creators to collaborate smoothly. Specifically, the server grants access rights to the collaborative platform.

[0419] Step 9:

[0420] Each creator inputs their own work content from their device and shares it with other creators in real time. The input is the work content, and the output is the shared work content. This allows information sharing among all creators. In concrete terms, user C inputs a character design from their device and shares it.

[0421] Step 10:

[0422] The AI ​​module analyzes the creator's work and provides feedback to ensure consistency. The input is the creator's work and the output is feedback. This ensures the consistency and quality of the project. Specifically, the AI ​​module checks the consistency of the design and provides feedback on any necessary corrections.

[0423] Step 11:

[0424] The emotion engine monitors the creator's emotional state and adjusts the interface or suggests additional features accordingly. The input is the creator's emotional data, and the output is an adjusted interface or additional suggestions. This optimizes the creator's working environment. Specifically, the emotion engine suggests relaxing graphics to creators who are feeling tense.

[0425] Step 12:

[0426] The server publishes project progress and intermediate deliverables to end users and collects feedback. The input is project progress information, and the output is feedback from end users. This allows the project to be improved based on end user opinions. Specifically, the server publishes intermediate deliverables on a website and collects feedback from end users.

[0427] Step 13:

[0428] The creator makes revisions based on the end user's feedback and finally completes the project. The input is the end user's feedback, and the output is the revised final product. This results in a high-quality final product. In concrete terms, the creator revise the design based on the feedback.

[0429] Step 14:

[0430] The server publishes the project and notifies the creator. The input is the completed project, and the output is the published project and a notification. This officially publishes the completed project. Specifically, the server uploads the final product to the public page and sends a notification email to the creator.

[0431] Step 15:

[0432] The server properly calculates and distributes copyrights and rewards. The input is the project data and the creator's contribution, and the output is the calculated reward. This ensures fair reward distribution based on each creator's contribution. Specifically, the server calculates each creator's work volume and contribution from the database and distributes rewards based on that.

[0433] Step 16:

[0434] The server accumulates project data and feedback along with the analysis results of the emotion engine, and updates the database to be useful for the next project. The input is project data and feedback, and the output is an updated database. This allows past project data to be utilized in the next project, enabling more advanced proposals. Specifically, the server collects all project data and updates the database.

[0435] (Application example 2)

[0436] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0437] In recent years, opportunities for creators to collaborate to produce high-quality projects have increased. However, differences in emotions and uneven work progress often lead to reduced project consistency and efficiency. Furthermore, methods for effectively incorporating feedback from end users have not been fully established. Furthermore, the lack of a system that makes suggestions based on a creator's emotional state can lead to a lack of creative inspiration. A system that can resolve these issues, support collaboration among creators, and improve the quality and efficiency of projects is needed.

[0438] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means. In this invention, the server includes: means for receiving a request from a creator such as an artist, writer, or designer to start a project; means for generating a project ID based on the received request and returning it to the creator; means for activating an AI module based on the project ID and sending theme information set by the creator to the AI; means for searching, analyzing, and suggesting related styles and elements from a database; means for displaying the suggestions to the creator and recording the selected style and elements; means for sending notifications of project participation to other creators; means for providing a platform for multiple creators to collaborate in real time; means for monitoring the work status of creators in real time and managing progress; means for analyzing the work content of creators and providing feedback to ensure consistency; means for disclosing project progress and intermediate deliverables to end users; means for collecting feedback from end users and providing it to creators; means for analyzing user emotions using an emotion engine and providing suggestions based on the emotions; means for monitoring user emotions in real time and adjusting the interface; means for disclosing the final work; means for appropriately calculating and distributing copyrights and remuneration; and means for accumulating project data and feedback and updating it as a database useful for the next project. This allows for optimal suggestions based on the creator's emotions, improving the consistency and quality of projects through real-time collaboration.

[0439] "Creator" refers to an artist, writer, designer, or other person who performs creative work on a project.

[0440] "Project ID" is a unique identifier generated to identify a project.

[0441] The "AI module" uses artificial intelligence to search, analyze, and make suggestions about related styles and elements.

[0442] A "database" is an information system containing stored information for searching and analyzing related styles and elements.

[0443] The "emotion engine" is a module that analyzes the user's emotions and provides suggestions based on the results.

[0444] "Interface" refers to the means and screen layout for interaction between the user and the system.

[0445] "Consistency" is the characteristic of maintaining a unified theme or style throughout a project.

[0446] "Feedback" refers to opinions and evaluations collected from end users and creators regarding the progress of a project and the content of proposals.

[0447] A "platform" refers to a common infrastructure or system that allows multiple creators to collaborate in real time.

[0448] "Progress" is the status that indicates how much work a creator has currently completed on a project.

[0449] The present invention is a system for enabling creators to efficiently start and progress projects, and aims to provide optimal suggestions based on the creator's emotional state. Specific embodiments of the present invention are described below.

[0450] Basic system configuration

[0451] This system consists of a server, terminals, an AI module, and an emotion engine. The server manages projects and aggregates data, while the terminals are devices used by each creator. The AI ​​module suggests styles and elements, and the emotion engine analyzes user emotions.

[0452] 1. Server:

[0453] The server receives a request from a creator to start a project and generates a project ID. The generated project ID is sent back to the creator. The server monitors the progress of the project and manages collaboration between creators. It also accumulates project data and feedback from end users, updating it as a database to be used for future projects.

[0454] 2. Terminal:

[0455] The terminal is a device that allows creators to set the theme of their project and input the details of their work. Based on the theme information sent from the terminal, the AI ​​module and emotion engine are activated and suggestions are made. Creators can collaborate with other creators in real time through the terminal.

[0456] 3. AI module:

[0457] The AI ​​module searches and analyzes the database for relevant styles and elements based on the theme information set by the creator, and makes suggestions. The suggestions are displayed to the creator, and the selected styles and elements are recorded. It also analyzes the creator's work and provides feedback to ensure consistency.

[0458] 4. Emotion Engine:

[0459] The emotion engine analyzes the user's emotions and provides appropriate suggestions based on their emotions. It also monitors the user's emotions in real time and adjusts the interface accordingly. For example, if the user is in a positive emotional state, it will suggest appropriate art styles and elements.

[0460] System Operation

[0461] When a user sends a request to start a project from their device, the server receives the request, generates a project ID, and returns it. The server then starts the AI ​​module and emotion engine based on this project ID.

[0462] The AI ​​module searches a database for related styles (e.g., cyberpunk, retro-future) based on the theme information set by the creator (e.g., "future city") and makes suggestions. The emotion engine analyzes the user's emotions in real time and adjusts the suggestions. These suggestions are displayed on the device, allowing the creator to select the style and elements that interest them.

[0463] Other creators are notified of their participation in the project, providing a platform for multiple creators to collaborate in real time. The server monitors each creator's work, manages their progress, and provides consistent feedback.

[0464] The project's progress and intermediate results are made public to end users, and feedback from end users is collected and provided to creators. This feedback is then reanalyzed by the emotion engine and AI module, and new suggestions are made regarding the project's direction.

[0465] Finally, the project is completed with all feedback incorporated, and the server publishes the work, with copyright and compensation properly calculated and distributed.

[0466] Examples and prompts

[0467] If a creator is starting a project with the theme "future cities" and the user's sentiment is positive, they could use the following prompt:

[0468] User sentiment: [Positive]

[0469] Project theme: [Future City]

[0470] User Preferences: [Cyberpunk, Retro-future]

[0471] This allows the emotion engine and AI module to work together to suggest content that best suits the creator's emotional state, facilitating the completion of high-quality projects.

[0472] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0473] Step 1:

[0474] The user sends a request to start a project from their device to the server. The input includes the theme information set by the user (e.g., "Future City"). The server receives this request, generates a project ID, and returns it to the creator. The output is a project ID that is notified to the user.

[0475] Step 2:

[0476] The server launches the AI ​​module and emotion engine based on the generated project ID. The project ID and theme information are used as inputs. This initiates the search and analysis of related data. A list of suggestions is returned as output.

[0477] Step 3:

[0478] The terminal displays the styles and elements suggested by the AI ​​module to the user. As input, it uses the list of suggestions received from the server. The user selects the ones that interest them from these suggestions. As output, the style and elements selected by the user are recorded.

[0479] Step 4:

[0480] The server sends project participation notifications to other creators based on the user's selection. The input includes the user's selection and the project ID. The output is a project participation notification sent to other creators.

[0481] Step 5:

[0482] The server provides a platform where multiple creators can collaborate in real time. On this platform, each creator's work is input and shared with other creators. The output reflects the shared work and the real-time status of the work.

[0483] Step 6:

[0484] The emotion engine monitors each creator's emotional state in real time. As input, the creator's emotional data is collected periodically. Emotional data is derived from the creator's facial expressions, vocal tone, etc. As output, it makes interface adjustments and additional suggestions based on the emotion.

[0485] Step 7:

[0486] The server exposes project progress and intermediate deliverables to end users and collects feedback. The input includes work results from creators and feedback from end users. Feedback is collected as text comments and evaluation points. The output is feedback provided to creators.

[0487] Step 8:

[0488] The AI ​​module and emotion engine reanalyze and re-propose the direction of the project based on feedback from end users and creators. The input includes collected feedback data and current project progress data. The output is a re-proposed style and elements.

[0489] Step 9:

[0490] The server publishes the final work when it is complete. The input contains the work of all creators. The output is the publication of the final work and notification to the end user.

[0491] Step 10:

[0492] The server properly calculates and distributes copyrights and rewards. The input includes contribution data for each creator. The output is the distributed rewards and notification to each creator.

[0493] Step 11:

[0494] The server accumulates the project data and feedback and updates it as a database that will be useful for the next project. As input, it contains all the data and feedback from the project. As output, the updated database will be used for the next project.

[0495] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0496] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0497] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0498] [Second embodiment]

[0499] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0500] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0501] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0502] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0503] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0504] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0505] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0506] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0507] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0508] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0509] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0510] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0511] As a specific embodiment of the present invention, a creative collaboration system using AI will be described in detail below. This system is composed of a server, a client (terminal), and an AI module.

[0512] Basic system configuration

[0513] Server: The server receives a request from a creator to start a project, generates a project ID, returns the project ID to the creator, and activates the AI ​​module. It also monitors the progress of the project and manages collaboration between creators.

[0514] Device: A device is used by each creator to set the project theme, input work details, receive and incorporate feedback from AI, and collaborate with other creators in real time.

[0515] AI Module: The AI ​​module searches the database based on the theme information set by the creator, suggests related art styles and elements, and analyzes the creator's work to provide feedback to ensure consistency.

[0516] System Operation

[0517] User starts a project:

[0518] The creator (user) sends a request to start an art project to the server from their device, entering the theme information (e.g., "future city"). The server receives this request, generates a project ID, and returns it to the user.

[0519] AI generates thematic suggestions:

[0520] The server launches an AI module based on the project ID and theme information. The AI ​​module searches the database for relevant art styles (e.g., cyberpunk, retro-future, metal city) and suggests them to the user. The user can then review these suggestions on their device and select the styles and elements that interest them.

[0521] Notifying and participating with other creators:

[0522] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators (User B, User C) access the project from their devices and approve their participation. Each creator may have a different role, such as design, concept, or story.

[0523] Real-time collaboration:

[0524] The server provides a platform where multiple creators can collaborate in real time. Creators input their work and share it with other creators. The AI ​​module analyzes the creators' work in real time and provides feedback to ensure consistency. For example, while a designer (User C) is creating a visual of a futuristic city, a writer (User B) is writing a story about that city. The AI ​​then makes suggestions to harmonize these different pieces of content.

[0525] End-user feedback and project completion:

[0526] The server will publish the project's progress and intermediate results to end users and collect feedback. End user feedback will be provided to the creator, and if necessary, the AI ​​will reanalyze and re-suggest the direction of the project. Finally, once all feedback has been incorporated and the project is complete, the server will publish the project.

[0527] Copyright and Revenue Sharing:

[0528] After a project is completed, the server will properly calculate and distribute copyright and compensation. By distributing appropriate compensation based on each creator's contribution, a fair and transparent compensation system is realized.

[0529] This embodiment allows creators with different styles and techniques to collaborate on consistent, high-quality art projects, and further enhances the quality of the projects by incorporating feedback from end users.

[0530] The processing flow will be explained below.

[0531] Step 1:

[0532] User: Sends a request to the server from the device to start an art project, entering the project's theme information (e.g., "future city").

[0533] Step 2:

[0534] Server: Receives the request from the user, generates a project ID, and returns it to the user.

[0535] Step 3:

[0536] Server: Sends the project ID and theme information to the AI ​​module and starts the AI ​​module.

[0537] Step 4:

[0538] AI module: Searches and analyzes related art styles and elements from a database and suggests them to the creator (e.g., cyberpunk, retro-future, metal city).

[0539] Step 5:

[0540] User: Review AI suggestions on your device and select the style or element that interests you (e.g., choose Cyberpunk).

[0541] Step 6:

[0542] Server: Records user choices and establishes project direction.

[0543] Step 7:

[0544] Server: Sends a notification to other creators (User B, User C) to join the project.

[0545] Step 8:

[0546] User B and User C: Access the project from their device and approve their participation.

[0547] Step 9:

[0548] Server: Provides a platform where multiple creators can collaborate in real time.

[0549] Step 10:

[0550] Creators (Users A, B, and C): Enter and share their work on the platform.

[0551] Step 11:

[0552] Server: Monitors the creators' work status in real time and manages progress.

[0553] Step 12:

[0554] AI module: Analyzes each creator's work and provides feedback to ensure consistency. For example, it suggests incorporating User B's story elements into User C's design.

[0555] Step 13:

[0556] Creators (Users A, B, and C): Review the AI's feedback and incorporate it into their own work.

[0557] Step 14:

[0558] Server: Publishes project progress and intermediate deliverables to end users and gathers feedback.

[0559] Step 15:

[0560] End users: Enter feedback and ratings from their devices and send them to the server.

[0561] Step 16:

[0562] Server: Provides collected feedback to project creators, and if necessary, the AI ​​reanalyzes and re-proposes new directions for the project.

[0563] Step 17:

[0564] Creators (Users A, B, and C): Incorporate feedback, work on it, and refine the project into its final form.

[0565] Step 18:

[0566] Server: Confirms that the project is complete and officially publishes the final product.

[0567] Step 19:

[0568] Server: Calculates and distributes copyrights and rewards appropriately. Distributes appropriate rewards to each creator based on their contribution.

[0569] Step 20:

[0570] Creators (Users A, B, and C): Receive rewards distributed in a fair and transparent manner.

[0571] Example 1

[0572] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0573] Modern creative projects require creators from different genres to collaborate on consistent, high-quality works. However, challenges exist, such as a lack of collaboration between individual creators and difficulty in unifying the overall direction. Furthermore, the lack of a mechanism for effectively incorporating feedback from end users makes it difficult to improve the quality of the final project. Furthermore, the distribution of copyright and compensation based on each creator's contribution is unclear, creating problems of unfairness.

[0574] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0575] In this invention, the server includes: means for receiving a request from a creator, such as an artist, writer, or designer, to start a project; means for generating a project ID based on the received request and returning it to the creator; means for activating an artificial intelligence module based on the project ID and sending theme information set by the creator to the artificial intelligence; means for searching and analyzing related styles and elements from a database and suggesting them; means for displaying the suggestions to the creator and recording the selected styles and elements; means for sending project participation notifications to other creators; means for providing a platform for multiple creators to collaborate in real time; means for monitoring the work status of creators in real time and managing progress; means for analyzing the work content of creators and providing feedback to ensure consistency using a web socket; means for disclosing the project progress and intermediate results to end users; means for collecting feedback from end users and providing it to creators; means for disclosing the final work; and means for appropriately calculating and distributing copyrights and remuneration. This enables creators of different genres to effectively collaborate and collaborate on consistent, high-quality works. Furthermore, by incorporating feedback from end users, we can improve the quality of projects and ensure fair distribution of copyright and rewards based on each creator's contribution.

[0576] An "artist" is a professional who creates works of art such as music, painting, or sculpture.

[0577] An "author" is a professional who writes literary works such as novels, essays, poems, and plays.

[0578] A "designer" is a professional who works on visual and functional design, such as product design, graphic design, and industrial design.

[0579] "Creator" is a general term that refers to professionals who produce creative works, such as artists, writers, and designers.

[0580] A "project" is a plan that is set up around a specific theme or purpose and is produced jointly by multiple creators.

[0581] A "request" is a request that a creator sends to the server when starting a project.

[0582] A "project ID" is an identification code generated to uniquely identify a project.

[0583] The "artificial intelligence module" is a machine learning algorithm that analyzes the theme information set by the creator and suggests related styles and elements.

[0584] A "database" is an information management system that systematically organizes information and makes it easy to search and retrieve.

[0585] A "style" is a particular method of expression or artistic school in creative work.

[0586] "Elements" are the individual components or parts that make up a creative work.

[0587] "Infrastructure" refers to the infrastructure and systems that allow multiple creators to collaborate in real time.

[0588] "Monitoring" means that the system monitors the creator's work status in real time and detects progress and abnormalities.

[0589] "Feedback" refers to the advice and evaluation provided by the artificial intelligence module on the creator's work.

[0590] "WEB Socket" is a communication protocol for real-time two-way communication between a client and a server.

[0591] "End User" refers to a general user who views and evaluates a completed creative project.

[0592] "Copyright" refers to the exclusive legal rights that creators have in their work.

[0593] "Remuneration" refers to the compensation or salary paid to creators based on their contribution.

[0594] As a specific embodiment of the present invention, a creative collaboration system using AI will be described. This system is realized by a server, a terminal, and an AI module.

[0595] Basic system configuration

[0596] Server: The server receives a project start request from a creator, generates a unique project ID, returns the generated project ID to the creator, and activates the AI ​​module. It also monitors the progress of the project and manages collaboration between creators.

[0597] Device: A device used by each creator to set the project theme, input work details, receive and incorporate feedback from AI, and collaborate with other creators in real time.

[0598] AI module: Searches the database based on thematic information provided by the user, suggests related styles and elements, and analyzes the creator's work and provides feedback to ensure consistency.

[0599] Hardware and Software

[0600] Server: An AWS EC2 instance is used, which provides the main server-side functions such as generating project IDs, launching AI modules, and managing project progress.

[0601] Devices: PCs, tablets, smartphones, etc. These devices run common operating systems such as Windows 10, iOS 14, and Android 11.

[0602] AI module: uses the GPT-4 model and custom models with TensorFlow, which allows for thematic style and element suggestions and feedback.

[0603] Detailed description of operation

[0604] Project Start:

[0605] The creator (user) uses a device to send a project start request to the server. The request includes theme information (e.g., "future city"). The server receives this request, generates a project ID, and returns it to the user.

[0606] AI-generated suggestions:

[0607] The server launches an artificial intelligence module based on the project ID and theme information. The AI ​​module searches for relevant styles and elements in a database (e.g., Guardian DB, Style Repository) and sends suggestions to the user. The user can review these suggestions on their device and select the styles and elements they are interested in.

[0608] Creator Notification and Involvement:

[0609] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators (User B, User C) access the project from their devices and approve their participation. Each creator has a different role (designer, writer, etc.).

[0610] Real-time collaboration:

[0611] The server provides a platform for multiple creators to collaborate in real time. Creators input their work and share it with other creators. The AI ​​module analyzes the work in real time and provides feedback to ensure consistency. For example, while a designer (User C) is creating a visual of a futuristic city, a writer (User B) is writing a story about that city. The AI ​​makes suggestions to harmonize these different pieces of content.

[0612] End-user feedback and project completion:

[0613] The server will make the project's progress and intermediate results public to end users and collect feedback. The end users' feedback will be provided to the creator, and if necessary, the AI ​​will reanalyze and re-suggest the direction of the project. Finally, when all feedback has been incorporated and the project is completed, the server will publish the finished work.

[0614] Copyright and Revenue Sharing:

[0615] After the project is completed, the server will properly calculate and distribute copyright and rewards, distributing appropriate rewards to each creator based on their contribution.

[0616] Specific examples

[0617] Project theme: "Future City"

[0618] Example prompt for generative AI model:

[0619] Start your futuristic city-themed art project. Choose from cyberpunk, retrofuture, and metal city styles.

[0620] This system allows creators from different genres to collaborate effectively and collaborate to produce consistent, high-quality works. By incorporating feedback from end users, the quality of the projects can be further improved and fair copyright and reward distribution can be achieved.

[0621] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0622] Step 1:

[0623] Submitting a Project Start Request

[0624] User: Sends a request from the device to the server to start an art project, including the theme information.

[0625] Input: Theme information (e.g. "Future City")

[0626] Output: Request data to the server

[0627] Specific operation: The user enters the theme information in a dedicated form and clicks the "Start" button.

[0628] Step 2:

[0629] Generate and return a project ID

[0630] Server: Receives the project start request, generates a unique project ID, and returns it to the user.

[0631] Input: Project Start Request

[0632] Output: Project ID

[0633] Specific operation: The server generates a project ID using the UUID algorithm and returns it to the user's device as an HTTP response.

[0634] Step 3:

[0635] Launching the AI ​​module and sending thematic information

[0636] Server: Starts the AI ​​module based on the generated project ID and theme information, and sends the theme information to the AI.

[0637] Input: Project ID, Theme information

[0638] Output: AI startup state based on theme information

[0639] What it does: The server triggers a Python script that passes the theme information to an AI model (e.g., GPT-4).

[0640] Step 4:

[0641] AI-powered style and element suggestions

[0642] AI module: Searches and analyzes relevant styles and elements from a database and generates suggestions.

[0643] Input: Theme information

[0644] Output: Style suggestions (e.g. cyberpunk, retro-future, metal city)

[0645] What it does: The AI ​​module uses the GPT-4 model to generate related styles like cyberpunk and retro-future.

[0646] Step 5:

[0647] View and select suggestions

[0648] User: Review AI-generated style suggestions on their device and select the styles and elements that interest them.

[0649] Input: Style suggestions

[0650] Output: Selected Style

[0651] Specific behavior: The user clicks to select the style they prefer from multiple style suggestions displayed on the web interface.

[0652] Step 6:

[0653] Creator participation notification

[0654] Server: Once the user confirms their selection, they notify other creators that they have joined the project.

[0655] Input: Selected style information

[0656] Output: Notification of joining other creators

[0657] What it does: The server uses the notification API to send emails and in-app notifications to creators, providing them with project details and a link to join.

[0658] Step 7:

[0659] Real-time collaboration

[0660] Server: Provides a real-time collaboration platform, allowing creators to input and share their work.

[0661] Input: Creator's work

[0662] Output: Shared work in real time

[0663] Specific operation: The server uses WebSocket to ensure real-time communication, and each creator's actions are immediately reflected to other users.

[0664] Step 8:

[0665] Providing Feedback

[0666] AI module: Analyzes creators' work in real time and provides feedback to ensure consistency.

[0667] Input: Creator's work

[0668] Output: Feedback information

[0669] How it works: The AI ​​module periodically collects data and evaluates consistency. For example, while a designer is creating a visual representation of a futuristic city, the AI ​​can suggest consistent color schemes and design elements.

[0670] Step 9:

[0671] Gathering feedback from end users

[0672] Server: Publishes project progress and intermediate deliverables to end users and gathers feedback.

[0673] Input: Intermediate deliverables

[0674] Output: End-user feedback data

[0675] What it does: The server sends surveys to end users at specific time intervals and collects feedback form data.

[0676] Step 10:

[0677] Publishing the project

[0678] Server: Publish the final project incorporating all feedback.

[0679] Input: End-user feedback

[0680] Output: Published final project

[0681] Specific operation: The server uploads the final data of the project to the specified public server, generates a URL and provides it to the end user.

[0682] Step 11:

[0683] Copyright and Remuneration Distribution

[0684] Server: After the project is completed, we will properly calculate and distribute copyright and remuneration.

[0685] Input: Creator contribution data

[0686] Output: Distributed rewards

[0687] How it works: The server runs an algorithm that calculates each creator's contribution and transfers the rewards directly to their digital wallet.

[0688] (Application example 1)

[0689] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0690] Conventional creative collaboration systems not only make it difficult for different creators to collaborate in real time, but also limit the production of consistent, high-quality content. They also make it difficult to improve the project's quality because they cannot collect feedback from end users in real time and incorporate it into the project. Furthermore, they do not support the generation and sharing of augmented reality content using smart devices, so they cannot meet the diverse creative needs of today.

[0691] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0692] In this invention, the server includes: means for receiving a request from a creator such as an artist, writer, or designer to start a project; means for generating a project ID based on the received request and returning it to the creator; means for activating an AI module based on the project ID and sending theme information set by the creator to the AI; means for searching, analyzing, and suggesting related styles and elements from a database; means for displaying the suggested content to the creator and recording the selected style and elements; means for sending notifications of project participation to other creators; means for providing a platform for multiple creators to collaborate in real time; means for monitoring the work status of creators in real time and managing progress; means for analyzing the work content of creators and providing feedback to ensure consistency; means for disclosing the project progress and intermediate deliverables to end users; means for collecting feedback from end users and providing it to creators; means for disclosing the final work; means for a user to start a project using a smart device and input theme settings and work content; means for displaying augmented reality content generated on the smart device in real time and sharing it with other creators; and means for collecting feedback from end users via an external device in real time and providing it to creators. This not only strengthens real-time collaboration between creators and enables the creation of consistent, high-quality content, but also allows for feedback from end users to be reflected in real time, improving the completeness of projects. It also supports the creation and sharing of augmented reality content using smart devices.

[0693] A "creator" is an individual or group that performs creative work on a project, such as an artist, writer, or designer.

[0694] "Project ID" means a unique identifier generated at the initiation of a project and used to manage and track the project.

[0695] An "AI module" is a software component that uses artificial intelligence to analyze data and make suggestions.

[0696] "Theme information" is information that indicates the general framework and direction of the creation set by the creator for the project.

[0697] A "database" is a collection of data that stores related styles and elements that creators can reference.

[0698] "Styles and elements" refer to the designs, concepts, techniques, etc. used in creative work.

[0699] A "platform" is a system that serves as the technical foundation for multiple creators to collaborate in real time.

[0700] "Progress" is information that indicates the progress and achievement of a project.

[0701] "Feedback" means opinions or ratings provided by End Users or other Creators.

[0702] "End users" are the recipients of the final product and the providers of feedback.

[0703] "Copyright" is the legal right that creators have in the works they create.

[0704] "Remuneration" is the compensation a creator receives based on their contribution to the project.

[0705] A "smart device" is an electronic device with advanced computing power and internet connectivity, including, for example, smartphones and smart glasses.

[0706] "Augmented reality content" is content that overlays digital information onto visual information from the real world.

[0707] An "external device" is hardware that is used as part of a system but is not integrated into the internal structure.

[0708] As a specific embodiment of the present invention, a system in which creators start projects using smart devices and collaborate in real time is described below. This system is composed of a server, terminals (smart devices), and an AI module.

[0709] Basic system configuration

[0710] Server: The server receives project start requests from creators, generates a project ID, returns the project ID to the creator, and activates the AI ​​module. It also monitors the progress of the project and manages collaboration between creators.

[0711] Terminal (Smart Device): A terminal is a device used by each creator to set the theme, input work content, receive and incorporate feedback from AI, and collaborate with other creators in real time. Examples of smart devices include smart glasses and smartphones.

[0712] AI Module: The AI ​​module searches the database based on the theme information set by the creator, suggests related styles and elements, and analyzes the creator's work to provide feedback to ensure consistency.

[0713] System Operation

[0714] 1. User starts a project:

[0715] The user uses a smart device to send a project start request to the server, entering the theme information (e.g., "Future Fashion"). The server receives this request, generates a project ID, and returns it to the user.

[0716] 2. AI generates thematic suggestions:

[0717] The server launches an AI module based on the project ID and theme information. The AI ​​module searches the database for relevant styles and elements and suggests them to the user (e.g., cyberpunk design). The user can then review these suggestions on their device and select the styles and elements they are interested in.

[0718] 3. Notifying and Involving Other Creators:

[0719] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators can access the project from their devices and approve their participation. Each creator has a different role, such as design or concept.

[0720] 4. Real-time collaboration:

[0721] The server provides a platform where multiple creators can collaborate in real time. Creators input their work via smart devices and share it with other creators. For example, a designer might create a futuristic fashion item in augmented reality (AR), while other creators write a story related to that item. The AI ​​module analyzes these different pieces of content and provides feedback to ensure consistency.

[0722] 5. End-user feedback and project completion:

[0723] The server displays the project's progress and intermediate results to end users and collects feedback. The collected feedback is provided to the creator in real time, and the AI ​​module reanalyzes the project's direction as needed. Finally, when all feedback has been incorporated and the project is complete, the server publishes the project.

[0724] Examples of concrete examples and prompts

[0725] Example: A user wants to design new AR outfits for a future fashion show and starts the project using smart glasses.

[0726] Example prompt sentence:

[0727] Project Theme: Future Fashion

[0728] Design direction: Cyberpunk

[0729] Required elements: metallic texture, neon lights

[0730] In this way, the system of the present invention not only strengthens real-time collaboration between creators and enables the creation of consistent, high-quality content, but also improves the completeness of projects by incorporating feedback from end users in real time. It also supports the creation and sharing of augmented reality content using smart devices.

[0731] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0732] Step 1:

[0733] A user sends a project start request to the server using a smart device. The request data includes theme information (e.g., "Future Fashion") as input, and the server receives this data. The server analyzes the request data, recognizes the start of a project, and generates a project ID as output.

[0734] Step 2:

[0735] The server returns the generated project ID to the user and activates the AI ​​module, which sends the theme information to the AI ​​module. The server receives the project ID and theme information as input and sends them to the AI ​​module. The AI ​​module searches the database based on the theme information and generates related style and element suggestions as output.

[0736] Step 3:

[0737] The server sends the suggestions from the AI ​​module to the device and displays them to the user. The user reviews these suggestions on the device and selects the styles and elements they are interested in. The input is the suggestions, which the device displays to the user. After the user selects the styles and elements, the selection data is generated as the output and sent to the server.

[0738] Step 4:

[0739] The server records the user's selection data and sends notifications to other creators about their participation in the project. The server receives the user's selection data and other creator information as input, generates notifications based on this, and sends them to other creators. The server also generates notifications to other creators about their participation in the project as output.

[0740] Step 5:

[0741] Other creators access the project from their devices and approve their participation. The input is a participation notification, which the device displays to other creators. When other creators approve their participation, participation approval data is generated as output and sent to the server.

[0742] Step 6:

[0743] The server provides a real-time collaboration platform for projects, where creators can input their work details via smart devices and share them with other creators. The server receives the work data from each creator in real time and shares it on the collaboration platform as output.

[0744] Step 7:

[0745] The AI ​​module analyzes each creator's work and provides feedback to ensure consistency. As input, the AI ​​module analyzes each creator's work data. As output, consistency feedback is generated and provided to each creator.

[0746] Step 8:

[0747] The server publishes the project progress and intermediate results to end users and collects feedback. The input is intermediate result data, which the server publishes to end users. Feedback from end users is collected, and feedback data is generated as output and provided to the creator.

[0748] Step 9:

[0749] The server reanalyzes the AI ​​module based on the collected feedback data and makes a new proposal for the project's direction. The AI ​​module reanalyzes the feedback data and current project data as input. The output is a new proposal that is provided to the creator.

[0750] Step 10:

[0751] Finally, when all feedback is incorporated and the project is completed, the server publishes the project. The input is the final product data, which the server processes in the end. The output is the published data of the final product.

[0752] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0753] As a specific embodiment of the present invention, we will explain in detail a creative collaboration system using AI combined with an emotion engine that recognizes user emotions. This system is composed of a server, a client (terminal), an AI module, and an emotion engine.

[0754] Basic system configuration

[0755] Server: The server receives a project start request from a creator, generates a project ID, returns the project ID to the creator, and starts the AI ​​module and emotion engine. The server monitors the progress of the project and manages collaboration between creators.

[0756] Terminal: A terminal is a device used by each creator to set the project theme and input work content, receive and incorporate feedback from AI, receive interface information from the emotion engine, and collaborate in real time with other creators.

[0757] AI Module: The AI ​​module searches the database based on the theme information set by the creator, suggests related art styles and elements, and analyzes the creator's work to provide feedback to ensure consistency.

[0758] Emotion Engine: The emotion engine recognizes the user's emotions and suggests appropriate art styles and elements based on the emotions. It also monitors the user's emotions in real time and uses that information for feedback and interface generation.

[0759] System Operation

[0760] User starts a project:

[0761] The creator (user) sends a request to start an art project to the server from their device, entering the theme information (e.g., "future city"). The server receives this request, generates a project ID, and returns it to the user.

[0762] AI generates thematic suggestions:

[0763] The server launches an AI module and emotion engine based on the project ID and theme information. The AI ​​module searches the database for relevant art styles (e.g., cyberpunk, retrofuture, metal city) and suggests them to the user. The emotion engine analyzes the user's emotions and adjusts the suggestions based on the results. The user then reviews these suggestions on their device and selects the style or element that interests them (e.g., cyberpunk).

[0764] Notifying and participating with other creators:

[0765] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators (User B, User C) access the project from their devices and approve their participation. Each creator may have a different role, such as design, concept, or story.

[0766] Real-time collaboration:

[0767] The server provides a platform where multiple creators can collaborate in real time. Creators input their work and share it with other creators. The AI ​​module analyzes the creators' work in real time and provides feedback to ensure consistency. The emotion engine monitors the creators' emotional state and makes adjustments to the interface or suggestions for additions accordingly. For example, if a designer (User C) is nervous, the emotion engine will suggest graphics that have a relaxing effect.

[0768] End-user feedback and project completion:

[0769] The server will publish the project's progress and intermediate results to end users and collect feedback. End user feedback will be provided to the creator, and the AI ​​and emotion engine will reanalyze and re-suggest the direction of the project as needed. Finally, once all feedback has been incorporated and the project is complete, the server will publish the project.

[0770] Copyright and Revenue Sharing:

[0771] After a project is completed, the server will properly calculate and distribute copyright and compensation. By distributing appropriate compensation based on each creator's contribution, a fair and transparent compensation system is realized.

[0772] Database update:

[0773] The server accumulates project data and feedback along with the analysis results of the emotion engine, and updates it as a database that will be useful for the next project.

[0774] This embodiment allows creators with different styles and techniques to collaborate on consistent, high-quality art projects. Analyzing user sentiment and adjusting suggestions and feedback based on it provides a more natural and effective collaborative environment. Furthermore, incorporating feedback from end users can further refine the quality of the project.

[0775] The processing flow will be explained below.

[0776] Step 1:

[0777] User: Sends a request to the server from the device to start an art project, entering project theme information (e.g., "future city") and initial setting information.

[0778] Step 2:

[0779] Server: Receives the request from the user, generates a project ID, and returns it to the user.

[0780] Step 3:

[0781] Server: Activates the AI ​​module and emotion engine based on the project ID and theme information.

[0782] Step 4:

[0783] Emotion engine: Analyzes the initial setup information and the user's real-time emotional data, for example, by using the camera and microphone to analyze the user's facial expressions and tone of voice to identify their emotional state.

[0784] Step 5:

[0785] AI module: Searches and analyzes related art styles and elements (e.g., cyberpunk, retro-future, metal city) from the database and suggests them to the user.

[0786] Step 6:

[0787] Emotion engine: Adjusts the AI ​​module's suggestions based on the user's real-time emotional data, for example, suggesting bolder styles if the user is excited.

[0788] Step 7:

[0789] User: Review suggestions from the AI ​​and emotion engine on their device and choose the style or element that interests them (e.g., choose Cyberpunk).

[0790] Step 8:

[0791] Server: Records user choices and establishes project direction.

[0792] Step 9:

[0793] Server: Sends a notification to other creators (User B, User C) to join the project.

[0794] Step 10:

[0795] User B and User C: Access the project from their device and approve their participation.

[0796] Step 11:

[0797] Server: Provides a platform where multiple creators can collaborate in real time.

[0798] Step 12:

[0799] Creators (Users A, B, and C): Enter and share their work on the platform.

[0800] Step 13:

[0801] Server: Monitors the creators' work status in real time and manages progress.

[0802] Step 14:

[0803] AI module: Analyzes each creator's work and provides feedback to ensure consistency. For example, it suggests incorporating User B's story elements into User C's design.

[0804] Step 15:

[0805] Emotion Engine: Monitors the creators' emotional state in real time and adjusts the interface and feedback as needed. For example, if User A is feeling stressed, it will provide encouraging messages and inspiration.

[0806] Step 16:

[0807] Creators (Users A, B, and C): Review the feedback from the AI ​​and emotion engine and incorporate it into their work.

[0808] Step 17:

[0809] Server: Publishes project progress and intermediate deliverables to end users and gathers feedback.

[0810] Step 18:

[0811] End users: Enter feedback and ratings from their devices and send them to the server.

[0812] Step 19:

[0813] Server: Provides collected feedback to project creators, and if necessary, the AI ​​and emotion engine reanalyze and resuggest the direction of the project.

[0814] Step 20:

[0815] Creators (Users A, B, and C): Incorporate feedback, work on it, and refine the project into its final form.

[0816] Step 21:

[0817] Server: Confirms that the project is complete and officially publishes the final product.

[0818] Step 22:

[0819] Server: Calculates and distributes copyrights and rewards appropriately. Distributes appropriate rewards to each creator based on their contribution.

[0820] Step 23:

[0821] Creators (Users A, B, and C): Receive rewards distributed in a fair and transparent manner.

[0822] Example 2

[0823] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0824] In traditional creative projects, it is not easy for multiple creators to collaborate and produce consistent, high-quality deliverables. Many challenges exist, including collaboration between creators, progress management, feedback sharing, and maintaining consistency. Coordinating emotional collaboration is also difficult with traditional systems. Furthermore, effectively incorporating feedback from end users and properly allocating rewards based on creators' contributions are also challenges.

[0825] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for receiving a request from a creator to start a project, means for generating a project ID based on the received request and returning it to the creator, means for activating an artificial intelligence module based on the project ID and transmitting theme information set by the creator to the artificial intelligence, means for searching and analyzing related styles and elements from a database and suggesting them, means for displaying the suggested content to the creator and recording the selected style and element, means for sending project participation notifications to other creators, means for providing a platform for multiple creators to collaborate in real time, means for monitoring the work status of creators in real time and managing the progress, means for analyzing the work content of creators and providing feedback to ensure consistency, means for disclosing the progress of the project and intermediate deliverables to end users, means for collecting feedback from end users and providing it to creators, means for disclosing the final work, means for appropriately calculating and distributing copyrights and remuneration, and means for monitoring user sentiment in real time and adjusting suggestions and interfaces based on the results. This allows multiple creators to efficiently collaborate on consistent, high-quality art projects, realizing natural and effective collaboration based on emotions. It also allows for proper incorporation of feedback from end users, improving the quality of projects, and ensuring fair and transparent reward distribution based on creators' contributions.

[0826] A "creator" is a person who participates in an art project and engages in creative activities, including artists, writers, designers, etc.

[0827] "Project ID" is a unique identifier generated by the server to identify each project.

[0828] "Artificial intelligence" is an advanced computer program that searches and analyzes a database based on thematic information set by the creator, and suggests related styles and elements.

[0829] "Theme information" refers to information about the subject and concept of a project that a creator enters at the start of the project.

[0830] A "database" is a collection of data that stores related styles and elements for AI to search and analyze.

[0831] "Style and Elements" refers to the designs, concepts, and components associated with an art project that ensure its consistency and quality.

[0832] A "collaboration platform" is an environment within a system that allows multiple creators to collaborate in real time.

[0833] "Feedback" refers to opinions and reactions regarding the progress and content of a project provided by creators and end users.

[0834] "End users" are the final users who view the progress and intermediate deliverables of a project and provide feedback.

[0835] "Copyright" is the legal ownership of a creator's work.

[0836] "Remuneration" means monetary compensation that is calculated and distributed fairly based on the creator's level of contribution.

[0837] "Means for monitoring user emotions in real time" refers to technology that instantly analyzes the user's emotional state and adjusts suggestions and interfaces based on the results.

[0838] This invention relates to an AI-based creative collaboration system that combines an emotion engine that recognizes user emotions. This system consists of a server, a client (terminal), an AI module, and an emotion engine.

[0839] server:

[0840] The server receives a request from a creator to start a project and generates a project ID. The generated project ID is returned to the creator, after which the artificial intelligence module and emotion engine are activated. Furthermore, the server monitors the progress of the project and manages collaboration between creators.

[0841] Device:

[0842] The terminal is a device used by each creator to set the project theme and input work details, receive and reflect feedback from artificial intelligence, receive interface information from the emotion engine, and collaborate in real time with other creators.

[0843] Artificial Intelligence Module:

[0844] The AI ​​module searches the database based on the theme information set by the creator, suggests related art styles and elements, analyzes the creator's work, and provides feedback to ensure consistency. For example, if the theme is "future city," it will suggest art styles such as "cyberpunk," "retrofuture," and "metal city."

[0845] Emotion Engine:

[0846] The emotion engine recognizes the user's emotions and suggests appropriate art styles and elements based on their emotions. It also monitors the user's emotions in real time and uses that information for feedback and interface generation. For example, if the user is tense, it suggests elements that have a relaxing effect.

[0847] System Operation

[0848] Project Start:

[0849] The user sends a request to start an art project from their device to the server, entering the theme information (e.g., "future city"). The server receives this request, generates a project ID, and returns it to the user.

[0850] AI-generated suggestions:

[0851] The server launches an AI module and emotion engine based on the project ID and theme information. The AI ​​module searches the database for relevant art styles and generates suggestions. The emotion engine analyzes the user's emotions and adjusts the suggestions. The user can review these suggestions on their device and select the style or element that interests them (e.g., "cyberpunk").

[0852] Creator-to-creator participation notifications:

[0853] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators (User B and User C) can access the project from their devices and approve their participation.

[0854] Real-time collaboration:

[0855] The server provides a platform where multiple creators can collaborate in real time. Creators can input their work and share it with other creators. An artificial intelligence module analyzes the creators' work and provides feedback to ensure consistency. An emotion engine monitors the creators' emotional state and makes interface adjustments and additional suggestions accordingly.

[0856] End-user feedback:

[0857] The server displays the progress of the project and intermediate results to end users and collects their feedback. End users' feedback is provided to the creator, and if necessary, the AI ​​and emotion engine reanalyze and re-suggest the direction of the project.

[0858] Complete and publish the project:

[0859] Finally, when all feedback is incorporated and the project is completed, the server will publish the project. For the completed project, the server will properly calculate and distribute copyright and rewards.

[0860] Database update:

[0861] The server accumulates project data, feedback, and the analysis results of the emotion engine, and updates it as a database that will be useful for the next project.

[0862] Specific prompt examples:

[0863] At the start of the project:

[0864] "Start an art project with a futuristic city theme. Choose an appropriate style from Cyberpunk, Retrofuture, or Metal City."

[0865] When collaborating in real time:

[0866] "Based on the current work, please maintain consistency between creators and incorporate the feedback suggested by the emotion engine. If a designer is nervous, suggest a relaxation graphic."

[0867] This embodiment allows creators with different styles and techniques to collaborate on consistent, high-quality art projects. Analyzing user sentiment and adjusting suggestions and feedback based on it provides a more natural and effective collaborative environment. Furthermore, incorporating feedback from end users can further refine the quality of the project.

[0868] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0869] Step 1:

[0870] The user sends a request to start an art project from their device. The input is the project start request and theme information (e.g., "future city"). The server receives the request, generates a project ID (e.g., "123XYZ"), and returns it to the user. This allows the server to generate a unique ID as an identifier for the project, providing a basis for recognizing the project. Specifically, the user enters "future city" as the theme and clicks the "Start Project" button.

[0871] Step 2:

[0872] The server launches the AI ​​module and emotion engine based on the project ID and theme information. The input is the project ID and theme information, and the output is the startup status of the AI ​​module and emotion engine. This lays the foundation for all analysis and proposals related to the project. Specifically, the server sends the project ID "123XYZ" and theme "Future City" to the AI ​​module and simultaneously launches the emotion engine.

[0873] Step 3:

[0874] The AI ​​module searches and analyzes related art styles and elements from the database to generate suggestions. The input is theme information, and the output is suggested art styles (e.g., "cyberpunk," "retrofuture," "metal city"). This gives users multiple options for the direction of their project. Specifically, the AI ​​module searches the database based on the theme "future city" and suggests related art styles.

[0875] Step 4:

[0876] The emotion engine monitors the user's emotions and adjusts the suggestions based on the results. The input is the user's emotional data, and the output is adjusted suggestions (e.g., suggestions that will relax a user who is in a tense state). This allows the engine to provide suggestions that are appropriate for the user's emotional state. Specifically, the emotion engine analyzes the camera feed and identifies the user's emotional state.

[0877] Step 5:

[0878] The user reviews the proposed art styles on their device and selects the style or elements they like. The input is the proposed art style, and the output is the selected style (e.g., "cyberpunk"). This confirms the progress of the project based on the user's preferences. Specifically, the user selects "cyberpunk" on their device and sends that information to the server.

[0879] Step 6:

[0880] The server sends a notification to other creators to join the project. The input is the user's selection and the project ID, and the output is a participation notification. This prepares other creators to join the project. As a specific operation, the server sends a participation invitation email to other creators.

[0881] Step 7:

[0882] Other creators access the project from their devices and approve their participation. The input is a participation notification, and the output is an acceptance of participation. This confirms that multiple creators are officially participating in the project. Specifically, the other creators check the email notification and approve their participation in the project.

[0883] Step 8:

[0884] The server provides a platform for multiple creators to collaborate in real time. The input is the creator's consent to participate, and the output is access rights to the shared platform. This allows creators to collaborate smoothly. Specifically, the server grants access rights to the collaborative platform.

[0885] Step 9:

[0886] Each creator inputs their own work content from their device and shares it with other creators in real time. The input is the work content, and the output is the shared work content. This allows information sharing among all creators. In concrete terms, user C inputs a character design from their device and shares it.

[0887] Step 10:

[0888] The AI ​​module analyzes the creator's work and provides feedback to ensure consistency. The input is the creator's work and the output is feedback. This ensures the consistency and quality of the project. Specifically, the AI ​​module checks the consistency of the design and provides feedback on any necessary corrections.

[0889] Step 11:

[0890] The emotion engine monitors the creator's emotional state and adjusts the interface or suggests additional features accordingly. The input is the creator's emotional data, and the output is an adjusted interface or additional suggestions. This optimizes the creator's working environment. Specifically, the emotion engine suggests relaxing graphics to creators who are feeling tense.

[0891] Step 12:

[0892] The server publishes project progress and intermediate deliverables to end users and collects feedback. The input is project progress information, and the output is feedback from end users. This allows the project to be improved based on end user opinions. Specifically, the server publishes intermediate deliverables on a website and collects feedback from end users.

[0893] Step 13:

[0894] The creator makes revisions based on the end user's feedback and finally completes the project. The input is the end user's feedback, and the output is the revised final product. This results in a high-quality final product. In concrete terms, the creator revise the design based on the feedback.

[0895] Step 14:

[0896] The server publishes the project and notifies the creator. The input is the completed project, and the output is the published project and a notification. This officially publishes the completed project. Specifically, the server uploads the final product to the public page and sends a notification email to the creator.

[0897] Step 15:

[0898] The server properly calculates and distributes copyrights and rewards. The input is the project data and the creator's contribution, and the output is the calculated reward. This ensures fair reward distribution based on each creator's contribution. Specifically, the server calculates each creator's work volume and contribution from the database and distributes rewards based on that.

[0899] Step 16:

[0900] The server accumulates project data and feedback along with the analysis results of the emotion engine, and updates the database to be useful for the next project. The input is project data and feedback, and the output is an updated database. This allows past project data to be utilized in the next project, enabling more advanced proposals. Specifically, the server collects all project data and updates the database.

[0901] (Application example 2)

[0902] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0903] In recent years, opportunities for creators to collaborate to produce high-quality projects have increased. However, differences in emotions and uneven work progress often lead to reduced project consistency and efficiency. Furthermore, methods for effectively incorporating feedback from end users have not been fully established. Furthermore, the lack of a system that makes suggestions based on a creator's emotional state can lead to a lack of creative inspiration. A system that can resolve these issues, support collaboration among creators, and improve the quality and efficiency of projects is needed.

[0904] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means. In this invention, the server includes: means for receiving a request from a creator such as an artist, writer, or designer to start a project; means for generating a project ID based on the received request and returning it to the creator; means for activating an AI module based on the project ID and sending theme information set by the creator to the AI; means for searching, analyzing, and suggesting related styles and elements from a database; means for displaying the suggestions to the creator and recording the selected style and elements; means for sending notifications of project participation to other creators; means for providing a platform for multiple creators to collaborate in real time; means for monitoring the work status of creators in real time and managing progress; means for analyzing the work content of creators and providing feedback to ensure consistency; means for disclosing project progress and intermediate deliverables to end users; means for collecting feedback from end users and providing it to creators; means for analyzing user emotions using an emotion engine and providing suggestions based on the emotions; means for monitoring user emotions in real time and adjusting the interface; means for disclosing the final work; means for appropriately calculating and distributing copyrights and remuneration; and means for accumulating project data and feedback and updating it as a database useful for the next project. This allows for optimal suggestions based on the creator's emotions, improving the consistency and quality of projects through real-time collaboration.

[0905] "Creator" refers to an artist, writer, designer, or other person who performs creative work on a project.

[0906] "Project ID" is a unique identifier generated to identify a project.

[0907] The "AI module" uses artificial intelligence to search, analyze, and make suggestions about related styles and elements.

[0908] A "database" is an information system containing stored information for searching and analyzing related styles and elements.

[0909] The "emotion engine" is a module that analyzes the user's emotions and provides suggestions based on the results.

[0910] "Interface" refers to the means and screen layout for interaction between the user and the system.

[0911] "Consistency" is the characteristic of maintaining a unified theme or style throughout a project.

[0912] "Feedback" refers to opinions and evaluations collected from end users and creators regarding the progress of a project and the content of proposals.

[0913] A "platform" refers to a common infrastructure or system that allows multiple creators to collaborate in real time.

[0914] "Progress" is the status that indicates how much work a creator has currently completed on a project.

[0915] The present invention is a system for enabling creators to efficiently start and progress projects, and aims to provide optimal suggestions based on the creator's emotional state. Specific embodiments of the present invention are described below.

[0916] Basic system configuration

[0917] This system consists of a server, terminals, an AI module, and an emotion engine. The server manages projects and aggregates data, while the terminals are devices used by each creator. The AI ​​module suggests styles and elements, and the emotion engine analyzes user emotions.

[0918] 1. Server:

[0919] The server receives a request from a creator to start a project and generates a project ID. The generated project ID is sent back to the creator. The server monitors the progress of the project and manages collaboration between creators. It also accumulates project data and feedback from end users, updating it as a database to be used for future projects.

[0920] 2. Terminal:

[0921] The terminal is a device that allows creators to set the theme of their project and input the details of their work. Based on the theme information sent from the terminal, the AI ​​module and emotion engine are activated and suggestions are made. Creators can collaborate with other creators in real time through the terminal.

[0922] 3. AI module:

[0923] The AI ​​module searches and analyzes the database for relevant styles and elements based on the theme information set by the creator, and makes suggestions. The suggestions are displayed to the creator, and the selected styles and elements are recorded. It also analyzes the creator's work and provides feedback to ensure consistency.

[0924] 4. Emotion Engine:

[0925] The emotion engine analyzes the user's emotions and provides appropriate suggestions based on their emotions. It also monitors the user's emotions in real time and adjusts the interface accordingly. For example, if the user is in a positive emotional state, it will suggest appropriate art styles and elements.

[0926] System Operation

[0927] When a user sends a request to start a project from their device, the server receives the request, generates a project ID, and returns it. The server then starts the AI ​​module and emotion engine based on this project ID.

[0928] The AI ​​module searches a database for related styles (e.g., cyberpunk, retro-future) based on the theme information set by the creator (e.g., "future city") and makes suggestions. The emotion engine analyzes the user's emotions in real time and adjusts the suggestions. These suggestions are displayed on the device, allowing the creator to select the style and elements that interest them.

[0929] Other creators are notified of their participation in the project, providing a platform for multiple creators to collaborate in real time. The server monitors each creator's work, manages their progress, and provides consistent feedback.

[0930] The project's progress and intermediate results are made public to end users, and feedback from end users is collected and provided to creators. This feedback is then reanalyzed by the emotion engine and AI module, and new suggestions are made regarding the project's direction.

[0931] Finally, the project is completed with all feedback incorporated, and the server publishes the work, with copyright and compensation properly calculated and distributed.

[0932] Examples and prompts

[0933] If a creator is starting a project with the theme "future cities" and the user's sentiment is positive, they could use the following prompt:

[0934] User sentiment: [Positive]

[0935] Project theme: [Future City]

[0936] User Preferences: [Cyberpunk, Retro-future]

[0937] This allows the emotion engine and AI module to work together to suggest content that best suits the creator's emotional state, facilitating the completion of high-quality projects.

[0938] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0939] Step 1:

[0940] The user sends a request to start a project from their device to the server. The input includes the theme information set by the user (e.g., "Future City"). The server receives this request, generates a project ID, and returns it to the creator. The output is a project ID that is notified to the user.

[0941] Step 2:

[0942] The server launches the AI ​​module and emotion engine based on the generated project ID. The project ID and theme information are used as inputs. This initiates the search and analysis of related data. A list of suggestions is returned as output.

[0943] Step 3:

[0944] The terminal displays the styles and elements suggested by the AI ​​module to the user. As input, it uses the list of suggestions received from the server. The user selects the ones that interest them from these suggestions. As output, the style and elements selected by the user are recorded.

[0945] Step 4:

[0946] The server sends project participation notifications to other creators based on the user's selection. The input includes the user's selection and the project ID. The output is a project participation notification sent to other creators.

[0947] Step 5:

[0948] The server provides a platform where multiple creators can collaborate in real time. On this platform, each creator's work is input and shared with other creators. The output reflects the shared work and the real-time status of the work.

[0949] Step 6:

[0950] The emotion engine monitors each creator's emotional state in real time. As input, the creator's emotional data is collected periodically. Emotional data is derived from the creator's facial expressions, vocal tone, etc. As output, it makes interface adjustments and additional suggestions based on the emotion.

[0951] Step 7:

[0952] The server exposes project progress and intermediate deliverables to end users and collects feedback. The input includes work results from creators and feedback from end users. Feedback is collected as text comments and evaluation points. The output is feedback provided to creators.

[0953] Step 8:

[0954] The AI ​​module and emotion engine reanalyze and re-propose the direction of the project based on feedback from end users and creators. The input includes collected feedback data and current project progress data. The output is a re-proposed style and elements.

[0955] Step 9:

[0956] The server publishes the final work when it is complete. The input contains the work of all creators. The output is the publication of the final work and notification to the end user.

[0957] Step 10:

[0958] The server properly calculates and distributes copyrights and rewards. The input includes contribution data for each creator. The output is the distributed rewards and notification to each creator.

[0959] Step 11:

[0960] The server accumulates the project data and feedback and updates it as a database that will be useful for the next project. As input, it contains all the data and feedback from the project. As output, the updated database will be used for the next project.

[0961] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0962] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0963] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0964] [Third embodiment]

[0965] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0966] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0967] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0968] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0969] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0970] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0971] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0972] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0973] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0974] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0975] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0976] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0977] As a specific embodiment of the present invention, a creative collaboration system using AI will be described in detail below. This system is composed of a server, a client (terminal), and an AI module.

[0978] Basic system configuration

[0979] Server: The server receives a request from a creator to start a project, generates a project ID, returns the project ID to the creator, and activates the AI ​​module. It also monitors the progress of the project and manages collaboration between creators.

[0980] Device: A device is used by each creator to set the project theme, input work details, receive and incorporate feedback from AI, and collaborate with other creators in real time.

[0981] AI Module: The AI ​​module searches the database based on the theme information set by the creator, suggests related art styles and elements, and analyzes the creator's work to provide feedback to ensure consistency.

[0982] System Operation

[0983] User starts a project:

[0984] The creator (user) sends a request to start an art project to the server from their device, entering the theme information (e.g., "future city"). The server receives this request, generates a project ID, and returns it to the user.

[0985] AI generates thematic suggestions:

[0986] The server launches an AI module based on the project ID and theme information. The AI ​​module searches the database for relevant art styles (e.g., cyberpunk, retro-future, metal city) and suggests them to the user. The user can then review these suggestions on their device and select the styles and elements that interest them.

[0987] Notifying and participating with other creators:

[0988] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators (User B, User C) access the project from their devices and approve their participation. Each creator may have a different role, such as design, concept, or story.

[0989] Real-time collaboration:

[0990] The server provides a platform where multiple creators can collaborate in real time. Creators input their work and share it with other creators. The AI ​​module analyzes the creators' work in real time and provides feedback to ensure consistency. For example, while a designer (User C) is creating a visual of a futuristic city, a writer (User B) is writing a story about that city. The AI ​​then makes suggestions to harmonize these different pieces of content.

[0991] End-user feedback and project completion:

[0992] The server will publish the project's progress and intermediate results to end users and collect feedback. End user feedback will be provided to the creator, and if necessary, the AI ​​will reanalyze and re-suggest the direction of the project. Finally, once all feedback has been incorporated and the project is complete, the server will publish the project.

[0993] Copyright and Revenue Sharing:

[0994] After a project is completed, the server will properly calculate and distribute copyright and compensation. By distributing appropriate compensation based on each creator's contribution, a fair and transparent compensation system is realized.

[0995] This embodiment allows creators with different styles and techniques to collaborate on consistent, high-quality art projects, and further enhances the quality of the projects by incorporating feedback from end users.

[0996] The processing flow will be explained below.

[0997] Step 1:

[0998] User: Sends a request to the server from the device to start an art project, entering the project's theme information (e.g., "future city").

[0999] Step 2:

[1000] Server: Receives the request from the user, generates a project ID, and returns it to the user.

[1001] Step 3:

[1002] Server: Sends the project ID and theme information to the AI ​​module and starts the AI ​​module.

[1003] Step 4:

[1004] AI module: Searches and analyzes related art styles and elements from a database and suggests them to the creator (e.g., cyberpunk, retro-future, metal city).

[1005] Step 5:

[1006] User: Review AI suggestions on your device and select the style or element that interests you (e.g., choose Cyberpunk).

[1007] Step 6:

[1008] Server: Records user choices and establishes project direction.

[1009] Step 7:

[1010] Server: Sends a notification to other creators (User B, User C) to join the project.

[1011] Step 8:

[1012] User B and User C: Access the project from their device and approve their participation.

[1013] Step 9:

[1014] Server: Provides a platform where multiple creators can collaborate in real time.

[1015] Step 10:

[1016] Creators (Users A, B, and C): Enter and share their work on the platform.

[1017] Step 11:

[1018] Server: Monitors the creators' work status in real time and manages progress.

[1019] Step 12:

[1020] AI module: Analyzes each creator's work and provides feedback to ensure consistency. For example, it suggests incorporating User B's story elements into User C's design.

[1021] Step 13:

[1022] Creators (Users A, B, and C): Review the AI's feedback and incorporate it into their own work.

[1023] Step 14:

[1024] Server: Publishes project progress and intermediate deliverables to end users and gathers feedback.

[1025] Step 15:

[1026] End users: Enter feedback and ratings from their devices and send them to the server.

[1027] Step 16:

[1028] Server: Provides collected feedback to project creators, and if necessary, the AI ​​reanalyzes and re-proposes new directions for the project.

[1029] Step 17:

[1030] Creators (Users A, B, and C): Incorporate feedback, work on it, and refine the project into its final form.

[1031] Step 18:

[1032] Server: Confirms that the project is complete and officially publishes the final product.

[1033] Step 19:

[1034] Server: Calculates and distributes copyrights and rewards appropriately. Distributes appropriate rewards to each creator based on their contribution.

[1035] Step 20:

[1036] Creators (Users A, B, and C): Receive rewards distributed in a fair and transparent manner.

[1037] Example 1

[1038] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1039] Modern creative projects require creators from different genres to collaborate on consistent, high-quality works. However, challenges exist, such as a lack of collaboration between individual creators and difficulty in unifying the overall direction. Furthermore, the lack of a mechanism for effectively incorporating feedback from end users makes it difficult to improve the quality of the final project. Furthermore, the distribution of copyright and compensation based on each creator's contribution is unclear, creating problems of unfairness.

[1040] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1041] In this invention, the server includes: means for receiving a request from a creator, such as an artist, writer, or designer, to start a project; means for generating a project ID based on the received request and returning it to the creator; means for activating an artificial intelligence module based on the project ID and sending theme information set by the creator to the artificial intelligence; means for searching and analyzing related styles and elements from a database and suggesting them; means for displaying the suggestions to the creator and recording the selected styles and elements; means for sending project participation notifications to other creators; means for providing a platform for multiple creators to collaborate in real time; means for monitoring the work status of creators in real time and managing progress; means for analyzing the work content of creators and providing feedback to ensure consistency using a web socket; means for disclosing the project progress and intermediate results to end users; means for collecting feedback from end users and providing it to creators; means for disclosing the final work; and means for appropriately calculating and distributing copyrights and remuneration. This enables creators of different genres to effectively collaborate and collaborate on consistent, high-quality works. Furthermore, by incorporating feedback from end users, we can improve the quality of projects and ensure fair distribution of copyright and rewards based on each creator's contribution.

[1042] An "artist" is a professional who creates works of art such as music, painting, or sculpture.

[1043] An "author" is a professional who writes literary works such as novels, essays, poems, and plays.

[1044] A "designer" is a professional who works on visual and functional design, such as product design, graphic design, and industrial design.

[1045] "Creator" is a general term that refers to professionals who produce creative works, such as artists, writers, and designers.

[1046] A "project" is a plan that is set up around a specific theme or purpose and is produced jointly by multiple creators.

[1047] A "request" is a request that a creator sends to the server when starting a project.

[1048] A "project ID" is an identification code generated to uniquely identify a project.

[1049] The "artificial intelligence module" is a machine learning algorithm that analyzes the theme information set by the creator and suggests related styles and elements.

[1050] A "database" is an information management system that systematically organizes information and makes it easy to search and retrieve.

[1051] A "style" is a particular method of expression or artistic school in creative work.

[1052] "Elements" are the individual components or parts that make up a creative work.

[1053] "Infrastructure" refers to the infrastructure and systems that allow multiple creators to collaborate in real time.

[1054] "Monitoring" means that the system monitors the creator's work status in real time and detects progress and abnormalities.

[1055] "Feedback" refers to the advice and evaluation provided by the artificial intelligence module on the creator's work.

[1056] "WEB Socket" is a communication protocol for real-time two-way communication between a client and a server.

[1057] "End User" refers to a general user who views and evaluates a completed creative project.

[1058] "Copyright" refers to the exclusive legal rights that creators have in their work.

[1059] "Remuneration" refers to the compensation or salary paid to creators based on their contribution.

[1060] As a specific embodiment of the present invention, a creative collaboration system using AI will be described. This system is realized by a server, a terminal, and an AI module.

[1061] Basic system configuration

[1062] Server: The server receives a project start request from a creator, generates a unique project ID, returns the generated project ID to the creator, and activates the AI ​​module. It also monitors the progress of the project and manages collaboration between creators.

[1063] Device: A device used by each creator to set the project theme, input work details, receive and incorporate feedback from AI, and collaborate with other creators in real time.

[1064] AI module: Searches the database based on thematic information provided by the user, suggests related styles and elements, and analyzes the creator's work and provides feedback to ensure consistency.

[1065] Hardware and Software

[1066] Server: An AWS EC2 instance is used, which provides the main server-side functions such as generating project IDs, launching AI modules, and managing project progress.

[1067] Devices: PCs, tablets, smartphones, etc. These devices run common operating systems such as Windows 10, iOS 14, and Android 11.

[1068] AI module: uses the GPT-4 model and custom models with TensorFlow, which allows for thematic style and element suggestions and feedback.

[1069] Detailed description of operation

[1070] Project Start:

[1071] The creator (user) uses a device to send a project start request to the server. The request includes theme information (e.g., "future city"). The server receives this request, generates a project ID, and returns it to the user.

[1072] AI-generated suggestions:

[1073] The server launches an artificial intelligence module based on the project ID and theme information. The AI ​​module searches for relevant styles and elements in a database (e.g., Guardian DB, Style Repository) and sends suggestions to the user. The user can review these suggestions on their device and select the styles and elements they are interested in.

[1074] Creator Notification and Involvement:

[1075] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators (User B, User C) access the project from their devices and approve their participation. Each creator has a different role (designer, writer, etc.).

[1076] Real-time collaboration:

[1077] The server provides a platform for multiple creators to collaborate in real time. Creators input their work and share it with other creators. The AI ​​module analyzes the work in real time and provides feedback to ensure consistency. For example, while a designer (User C) is creating a visual of a futuristic city, a writer (User B) is writing a story about that city. The AI ​​makes suggestions to harmonize these different pieces of content.

[1078] End-user feedback and project completion:

[1079] The server will make the project's progress and intermediate results public to end users and collect feedback. The end users' feedback will be provided to the creator, and if necessary, the AI ​​will reanalyze and re-suggest the direction of the project. Finally, when all feedback has been incorporated and the project is completed, the server will publish the finished work.

[1080] Copyright and Revenue Sharing:

[1081] After the project is completed, the server will properly calculate and distribute copyright and rewards, distributing appropriate rewards to each creator based on their contribution.

[1082] Specific examples

[1083] Project theme: "Future City"

[1084] Example prompt for generative AI model:

[1085] Start your futuristic city-themed art project. Choose from cyberpunk, retrofuture, and metal city styles.

[1086] This system allows creators from different genres to collaborate effectively and collaborate to produce consistent, high-quality works. By incorporating feedback from end users, the quality of the projects can be further improved and fair copyright and reward distribution can be achieved.

[1087] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1088] Step 1:

[1089] Submitting a Project Start Request

[1090] User: Sends a request from the device to the server to start an art project, including the theme information.

[1091] Input: Theme information (e.g. "Future City")

[1092] Output: Request data to the server

[1093] Specific operation: The user enters the theme information in a dedicated form and clicks the "Start" button.

[1094] Step 2:

[1095] Generate and return a project ID

[1096] Server: Receives the project start request, generates a unique project ID, and returns it to the user.

[1097] Input: Project Start Request

[1098] Output: Project ID

[1099] Specific operation: The server generates a project ID using the UUID algorithm and returns it to the user's device as an HTTP response.

[1100] Step 3:

[1101] Launching the AI ​​module and sending thematic information

[1102] Server: Starts the AI ​​module based on the generated project ID and theme information, and sends the theme information to the AI.

[1103] Input: Project ID, Theme information

[1104] Output: AI startup state based on theme information

[1105] What it does: The server triggers a Python script that passes the theme information to an AI model (e.g., GPT-4).

[1106] Step 4:

[1107] AI-powered style and element suggestions

[1108] AI module: Searches and analyzes relevant styles and elements from a database and generates suggestions.

[1109] Input: Theme information

[1110] Output: Style suggestions (e.g. cyberpunk, retro-future, metal city)

[1111] What it does: The AI ​​module uses the GPT-4 model to generate related styles like cyberpunk and retro-future.

[1112] Step 5:

[1113] View and select suggestions

[1114] User: Review AI-generated style suggestions on their device and select the styles and elements that interest them.

[1115] Input: Style suggestions

[1116] Output: Selected Style

[1117] Specific behavior: The user clicks to select the style they prefer from multiple style suggestions displayed on the web interface.

[1118] Step 6:

[1119] Creator participation notification

[1120] Server: Once the user confirms their selection, they notify other creators that they have joined the project.

[1121] Input: Selected style information

[1122] Output: Notification of joining other creators

[1123] What it does: The server uses the notification API to send emails and in-app notifications to creators, providing them with project details and a link to join.

[1124] Step 7:

[1125] Real-time collaboration

[1126] Server: Provides a real-time collaboration platform, allowing creators to input and share their work.

[1127] Input: Creator's work

[1128] Output: Shared work in real time

[1129] Specific operation: The server uses WebSocket to ensure real-time communication, and each creator's actions are immediately reflected to other users.

[1130] Step 8:

[1131] Providing Feedback

[1132] AI module: Analyzes creators' work in real time and provides feedback to ensure consistency.

[1133] Input: Creator's work

[1134] Output: Feedback information

[1135] How it works: The AI ​​module periodically collects data and evaluates consistency. For example, while a designer is creating a visual representation of a futuristic city, the AI ​​can suggest consistent color schemes and design elements.

[1136] Step 9:

[1137] Gathering feedback from end users

[1138] Server: Publishes project progress and intermediate deliverables to end users and gathers feedback.

[1139] Input: Intermediate deliverables

[1140] Output: End-user feedback data

[1141] What it does: The server sends surveys to end users at specific time intervals and collects feedback form data.

[1142] Step 10:

[1143] Publishing the project

[1144] Server: Publish the final project incorporating all feedback.

[1145] Input: End-user feedback

[1146] Output: Published final project

[1147] Specific operation: The server uploads the final data of the project to the specified public server, generates a URL and provides it to the end user.

[1148] Step 11:

[1149] Copyright and Remuneration Distribution

[1150] Server: After the project is completed, we will properly calculate and distribute copyright and remuneration.

[1151] Input: Creator contribution data

[1152] Output: Distributed rewards

[1153] How it works: The server runs an algorithm that calculates each creator's contribution and transfers the rewards directly to their digital wallet.

[1154] (Application example 1)

[1155] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1156] Conventional creative collaboration systems not only make it difficult for different creators to collaborate in real time, but also limit the production of consistent, high-quality content. They also make it difficult to improve the project's quality because they cannot collect feedback from end users in real time and incorporate it into the project. Furthermore, they do not support the generation and sharing of augmented reality content using smart devices, so they cannot meet the diverse creative needs of today.

[1157] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1158] In this invention, the server includes: means for receiving a request from a creator such as an artist, writer, or designer to start a project; means for generating a project ID based on the received request and returning it to the creator; means for activating an AI module based on the project ID and sending theme information set by the creator to the AI; means for searching, analyzing, and suggesting related styles and elements from a database; means for displaying the suggested content to the creator and recording the selected style and elements; means for sending notifications of project participation to other creators; means for providing a platform for multiple creators to collaborate in real time; means for monitoring the work status of creators in real time and managing progress; means for analyzing the work content of creators and providing feedback to ensure consistency; means for disclosing the project progress and intermediate deliverables to end users; means for collecting feedback from end users and providing it to creators; means for disclosing the final work; means for a user to start a project using a smart device and input theme settings and work content; means for displaying augmented reality content generated on the smart device in real time and sharing it with other creators; and means for collecting feedback from end users via an external device in real time and providing it to creators. This not only strengthens real-time collaboration between creators and enables the creation of consistent, high-quality content, but also allows for feedback from end users to be reflected in real time, improving the completeness of projects. It also supports the creation and sharing of augmented reality content using smart devices.

[1159] A "creator" is an individual or group that performs creative work on a project, such as an artist, writer, or designer.

[1160] "Project ID" means a unique identifier generated at the initiation of a project and used to manage and track the project.

[1161] An "AI module" is a software component that uses artificial intelligence to analyze data and make suggestions.

[1162] "Theme information" is information that indicates the general framework and direction of the creation set by the creator for the project.

[1163] A "database" is a collection of data that stores related styles and elements that creators can reference.

[1164] "Styles and elements" refer to the designs, concepts, techniques, etc. used in creative work.

[1165] A "platform" is a system that serves as the technical foundation for multiple creators to collaborate in real time.

[1166] "Progress" is information that indicates the progress and achievement of a project.

[1167] "Feedback" means opinions or ratings provided by End Users or other Creators.

[1168] "End users" are the recipients of the final product and the providers of feedback.

[1169] "Copyright" is the legal right that creators have in the works they create.

[1170] "Remuneration" is the compensation a creator receives based on their contribution to the project.

[1171] A "smart device" is an electronic device with advanced computing power and internet connectivity, including, for example, smartphones and smart glasses.

[1172] "Augmented reality content" is content that overlays digital information onto visual information from the real world.

[1173] An "external device" is hardware that is used as part of a system but is not integrated into the internal structure.

[1174] As a specific embodiment of the present invention, a system in which creators start projects using smart devices and collaborate in real time is described below. This system is composed of a server, terminals (smart devices), and an AI module.

[1175] Basic system configuration

[1176] Server: The server receives project start requests from creators, generates a project ID, returns the project ID to the creator, and activates the AI ​​module. It also monitors the progress of the project and manages collaboration between creators.

[1177] Terminal (Smart Device): A terminal is a device used by each creator to set the theme, input work content, receive and incorporate feedback from AI, and collaborate with other creators in real time. Examples of smart devices include smart glasses and smartphones.

[1178] AI Module: The AI ​​module searches the database based on the theme information set by the creator, suggests related styles and elements, and analyzes the creator's work to provide feedback to ensure consistency.

[1179] System Operation

[1180] 1. User starts a project:

[1181] The user uses a smart device to send a project start request to the server, entering the theme information (e.g., "Future Fashion"). The server receives this request, generates a project ID, and returns it to the user.

[1182] 2. AI generates thematic suggestions:

[1183] The server launches an AI module based on the project ID and theme information. The AI ​​module searches the database for relevant styles and elements and suggests them to the user (e.g., cyberpunk design). The user can then review these suggestions on their device and select the styles and elements they are interested in.

[1184] 3. Notifying and Involving Other Creators:

[1185] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators can access the project from their devices and approve their participation. Each creator has a different role, such as design or concept.

[1186] 4. Real-time collaboration:

[1187] The server provides a platform where multiple creators can collaborate in real time. Creators input their work via smart devices and share it with other creators. For example, a designer might create a futuristic fashion item in augmented reality (AR), while other creators write a story related to that item. The AI ​​module analyzes these different pieces of content and provides feedback to ensure consistency.

[1188] 5. End-user feedback and project completion:

[1189] The server displays the project's progress and intermediate results to end users and collects feedback. The collected feedback is provided to the creator in real time, and the AI ​​module reanalyzes the project's direction as needed. Finally, when all feedback has been incorporated and the project is complete, the server publishes the project.

[1190] Examples of concrete examples and prompts

[1191] Example: A user wants to design new AR outfits for a future fashion show and starts the project using smart glasses.

[1192] Example prompt sentence:

[1193] Project Theme: Future Fashion

[1194] Design direction: Cyberpunk

[1195] Required elements: metallic texture, neon lights

[1196] In this way, the system of the present invention not only strengthens real-time collaboration between creators and enables the creation of consistent, high-quality content, but also improves the completeness of projects by incorporating feedback from end users in real time. It also supports the creation and sharing of augmented reality content using smart devices.

[1197] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1198] Step 1:

[1199] A user sends a project start request to the server using a smart device. The request data includes theme information (e.g., "Future Fashion") as input, and the server receives this data. The server analyzes the request data, recognizes the start of a project, and generates a project ID as output.

[1200] Step 2:

[1201] The server returns the generated project ID to the user and activates the AI ​​module, which sends the theme information to the AI ​​module. The server receives the project ID and theme information as input and sends them to the AI ​​module. The AI ​​module searches the database based on the theme information and generates related style and element suggestions as output.

[1202] Step 3:

[1203] The server sends the suggestions from the AI ​​module to the device and displays them to the user. The user reviews these suggestions on the device and selects the styles and elements they are interested in. The input is the suggestions, which the device displays to the user. After the user selects the styles and elements, the selection data is generated as the output and sent to the server.

[1204] Step 4:

[1205] The server records the user's selection data and sends notifications to other creators about their participation in the project. The server receives the user's selection data and other creator information as input, generates notifications based on this, and sends them to other creators. The server also generates notifications to other creators about their participation in the project as output.

[1206] Step 5:

[1207] Other creators access the project from their devices and approve their participation. The input is a participation notification, which the device displays to other creators. When other creators approve their participation, participation approval data is generated as output and sent to the server.

[1208] Step 6:

[1209] The server provides a real-time collaboration platform for projects, where creators can input their work details via smart devices and share them with other creators. The server receives the work data from each creator in real time and shares it on the collaboration platform as output.

[1210] Step 7:

[1211] The AI ​​module analyzes each creator's work and provides feedback to ensure consistency. As input, the AI ​​module analyzes each creator's work data. As output, consistency feedback is generated and provided to each creator.

[1212] Step 8:

[1213] The server publishes the project progress and intermediate results to end users and collects feedback. The input is intermediate result data, which the server publishes to end users. Feedback from end users is collected, and feedback data is generated as output and provided to the creator.

[1214] Step 9:

[1215] The server reanalyzes the AI ​​module based on the collected feedback data and makes a new proposal for the project's direction. The AI ​​module reanalyzes the feedback data and current project data as input. The output is a new proposal that is provided to the creator.

[1216] Step 10:

[1217] Finally, when all feedback is incorporated and the project is completed, the server publishes the project. The input is the final product data, which the server processes in the end. The output is the published data of the final product.

[1218] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1219] As a specific embodiment of the present invention, we will explain in detail a creative collaboration system using AI combined with an emotion engine that recognizes user emotions. This system is composed of a server, a client (terminal), an AI module, and an emotion engine.

[1220] Basic system configuration

[1221] Server: The server receives a project start request from a creator, generates a project ID, returns the project ID to the creator, and starts the AI ​​module and emotion engine. The server monitors the progress of the project and manages collaboration between creators.

[1222] Terminal: A terminal is a device used by each creator to set the project theme and input work content, receive and incorporate feedback from AI, receive interface information from the emotion engine, and collaborate in real time with other creators.

[1223] AI Module: The AI ​​module searches the database based on the theme information set by the creator, suggests related art styles and elements, and analyzes the creator's work to provide feedback to ensure consistency.

[1224] Emotion Engine: The emotion engine recognizes the user's emotions and suggests appropriate art styles and elements based on the emotions. It also monitors the user's emotions in real time and uses that information for feedback and interface generation.

[1225] System Operation

[1226] User starts a project:

[1227] The creator (user) sends a request to start an art project to the server from their device, entering the theme information (e.g., "future city"). The server receives this request, generates a project ID, and returns it to the user.

[1228] AI generates thematic suggestions:

[1229] The server launches an AI module and emotion engine based on the project ID and theme information. The AI ​​module searches the database for relevant art styles (e.g., cyberpunk, retrofuture, metal city) and suggests them to the user. The emotion engine analyzes the user's emotions and adjusts the suggestions based on the results. The user then reviews these suggestions on their device and selects the style or element that interests them (e.g., cyberpunk).

[1230] Notifying and participating with other creators:

[1231] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators (User B, User C) access the project from their devices and approve their participation. Each creator may have a different role, such as design, concept, or story.

[1232] Real-time collaboration:

[1233] The server provides a platform where multiple creators can collaborate in real time. Creators input their work and share it with other creators. The AI ​​module analyzes the creators' work in real time and provides feedback to ensure consistency. The emotion engine monitors the creators' emotional state and makes adjustments to the interface or suggestions for additions accordingly. For example, if a designer (User C) is nervous, the emotion engine will suggest graphics that have a relaxing effect.

[1234] End-user feedback and project completion:

[1235] The server will publish the project's progress and intermediate results to end users and collect feedback. End user feedback will be provided to the creator, and the AI ​​and emotion engine will reanalyze and re-suggest the direction of the project as needed. Finally, once all feedback has been incorporated and the project is complete, the server will publish the project.

[1236] Copyright and Revenue Sharing:

[1237] After a project is completed, the server will properly calculate and distribute copyright and compensation. By distributing appropriate compensation based on each creator's contribution, a fair and transparent compensation system is realized.

[1238] Database update:

[1239] The server accumulates project data and feedback along with the analysis results of the emotion engine, and updates it as a database that will be useful for the next project.

[1240] This embodiment allows creators with different styles and techniques to collaborate on consistent, high-quality art projects. Analyzing user sentiment and adjusting suggestions and feedback based on it provides a more natural and effective collaborative environment. Furthermore, incorporating feedback from end users can further refine the quality of the project.

[1241] The processing flow will be explained below.

[1242] Step 1:

[1243] User: Sends a request to the server from the device to start an art project, entering project theme information (e.g., "future city") and initial setting information.

[1244] Step 2:

[1245] Server: Receives the request from the user, generates a project ID, and returns it to the user.

[1246] Step 3:

[1247] Server: Activates the AI ​​module and emotion engine based on the project ID and theme information.

[1248] Step 4:

[1249] Emotion engine: Analyzes the initial setup information and the user's real-time emotional data, for example, by using the camera and microphone to analyze the user's facial expressions and tone of voice to identify their emotional state.

[1250] Step 5:

[1251] AI module: Searches and analyzes related art styles and elements (e.g., cyberpunk, retro-future, metal city) from the database and suggests them to the user.

[1252] Step 6:

[1253] Emotion engine: Adjusts the AI ​​module's suggestions based on the user's real-time emotional data, for example, suggesting bolder styles if the user is excited.

[1254] Step 7:

[1255] User: Review suggestions from the AI ​​and emotion engine on their device and choose the style or element that interests them (e.g., choose Cyberpunk).

[1256] Step 8:

[1257] Server: Records user choices and establishes project direction.

[1258] Step 9:

[1259] Server: Sends a notification to other creators (User B, User C) to join the project.

[1260] Step 10:

[1261] User B and User C: Access the project from their device and approve their participation.

[1262] Step 11:

[1263] Server: Provides a platform where multiple creators can collaborate in real time.

[1264] Step 12:

[1265] Creators (Users A, B, and C): Enter and share their work on the platform.

[1266] Step 13:

[1267] Server: Monitors the creators' work status in real time and manages progress.

[1268] Step 14:

[1269] AI module: Analyzes each creator's work and provides feedback to ensure consistency. For example, it suggests incorporating User B's story elements into User C's design.

[1270] Step 15:

[1271] Emotion Engine: Monitors the creators' emotional state in real time and adjusts the interface and feedback as needed. For example, if User A is feeling stressed, it will provide encouraging messages and inspiration.

[1272] Step 16:

[1273] Creators (Users A, B, and C): Review the feedback from the AI ​​and emotion engine and incorporate it into their work.

[1274] Step 17:

[1275] Server: Publishes project progress and intermediate deliverables to end users and gathers feedback.

[1276] Step 18:

[1277] End users: Enter feedback and ratings from their devices and send them to the server.

[1278] Step 19:

[1279] Server: Provides collected feedback to project creators, and if necessary, the AI ​​and emotion engine reanalyze and resuggest the direction of the project.

[1280] Step 20:

[1281] Creators (Users A, B, and C): Incorporate feedback, work on it, and refine the project into its final form.

[1282] Step 21:

[1283] Server: Confirms that the project is complete and officially publishes the final product.

[1284] Step 22:

[1285] Server: Calculates and distributes copyrights and rewards appropriately. Distributes appropriate rewards to each creator based on their contribution.

[1286] Step 23:

[1287] Creators (Users A, B, and C): Receive rewards distributed in a fair and transparent manner.

[1288] Example 2

[1289] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1290] In traditional creative projects, it is not easy for multiple creators to collaborate and produce consistent, high-quality deliverables. Many challenges exist, including collaboration between creators, progress management, feedback sharing, and maintaining consistency. Coordinating emotional collaboration is also difficult with traditional systems. Furthermore, effectively incorporating feedback from end users and properly allocating rewards based on creators' contributions are also challenges.

[1291] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for receiving a request from a creator to start a project, means for generating a project ID based on the received request and returning it to the creator, means for activating an artificial intelligence module based on the project ID and transmitting theme information set by the creator to the artificial intelligence, means for searching and analyzing related styles and elements from a database and suggesting them, means for displaying the suggested content to the creator and recording the selected style and element, means for sending project participation notifications to other creators, means for providing a platform for multiple creators to collaborate in real time, means for monitoring the work status of creators in real time and managing the progress, means for analyzing the work content of creators and providing feedback to ensure consistency, means for disclosing the progress of the project and intermediate deliverables to end users, means for collecting feedback from end users and providing it to creators, means for disclosing the final work, means for appropriately calculating and distributing copyrights and remuneration, and means for monitoring user sentiment in real time and adjusting suggestions and interfaces based on the results. This allows multiple creators to efficiently collaborate on consistent, high-quality art projects, realizing natural and effective collaboration based on emotions. It also allows for proper incorporation of feedback from end users, improving the quality of projects, and ensuring fair and transparent reward distribution based on creators' contributions.

[1292] A "creator" is a person who participates in an art project and engages in creative activities, including artists, writers, designers, etc.

[1293] "Project ID" is a unique identifier generated by the server to identify each project.

[1294] "Artificial intelligence" is an advanced computer program that searches and analyzes a database based on thematic information set by the creator, and suggests related styles and elements.

[1295] "Theme information" refers to information about the subject and concept of a project that a creator enters at the start of the project.

[1296] A "database" is a collection of data that stores related styles and elements for AI to search and analyze.

[1297] "Style and Elements" refers to the designs, concepts, and components associated with an art project that ensure its consistency and quality.

[1298] A "collaboration platform" is an environment within a system that allows multiple creators to collaborate in real time.

[1299] "Feedback" refers to opinions and reactions regarding the progress and content of a project provided by creators and end users.

[1300] "End users" are the final users who view the progress and intermediate deliverables of a project and provide feedback.

[1301] "Copyright" is the legal ownership of a creator's work.

[1302] "Remuneration" means monetary compensation that is calculated and distributed fairly based on the creator's level of contribution.

[1303] "Means for monitoring user emotions in real time" refers to technology that instantly analyzes the user's emotional state and adjusts suggestions and interfaces based on the results.

[1304] This invention relates to an AI-based creative collaboration system that combines an emotion engine that recognizes user emotions. This system consists of a server, a client (terminal), an AI module, and an emotion engine.

[1305] server:

[1306] The server receives a request from a creator to start a project and generates a project ID. The generated project ID is returned to the creator, after which the artificial intelligence module and emotion engine are activated. Furthermore, the server monitors the progress of the project and manages collaboration between creators.

[1307] Device:

[1308] The terminal is a device used by each creator to set the project theme and input work details, receive and reflect feedback from artificial intelligence, receive interface information from the emotion engine, and collaborate in real time with other creators.

[1309] Artificial Intelligence Module:

[1310] The AI ​​module searches the database based on the theme information set by the creator, suggests related art styles and elements, analyzes the creator's work, and provides feedback to ensure consistency. For example, if the theme is "future city," it will suggest art styles such as "cyberpunk," "retrofuture," and "metal city."

[1311] Emotion Engine:

[1312] The emotion engine recognizes the user's emotions and suggests appropriate art styles and elements based on their emotions. It also monitors the user's emotions in real time and uses that information for feedback and interface generation. For example, if the user is tense, it suggests elements that have a relaxing effect.

[1313] System Operation

[1314] Project Start:

[1315] The user sends a request to start an art project from their device to the server, entering the theme information (e.g., "future city"). The server receives this request, generates a project ID, and returns it to the user.

[1316] AI-generated suggestions:

[1317] The server launches an AI module and emotion engine based on the project ID and theme information. The AI ​​module searches the database for relevant art styles and generates suggestions. The emotion engine analyzes the user's emotions and adjusts the suggestions. The user can review these suggestions on their device and select the style or element that interests them (e.g., "cyberpunk").

[1318] Creator-to-creator participation notifications:

[1319] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators (User B and User C) can access the project from their devices and approve their participation.

[1320] Real-time collaboration:

[1321] The server provides a platform where multiple creators can collaborate in real time. Creators can input their work and share it with other creators. An artificial intelligence module analyzes the creators' work and provides feedback to ensure consistency. An emotion engine monitors the creators' emotional state and makes interface adjustments and additional suggestions accordingly.

[1322] End-user feedback:

[1323] The server displays the progress of the project and intermediate results to end users and collects their feedback. End users' feedback is provided to the creator, and if necessary, the AI ​​and emotion engine reanalyze and re-suggest the direction of the project.

[1324] Complete and publish the project:

[1325] Finally, when all feedback is incorporated and the project is completed, the server will publish the project. For the completed project, the server will properly calculate and distribute copyright and rewards.

[1326] Database update:

[1327] The server accumulates project data, feedback, and the analysis results of the emotion engine, and updates it as a database that will be useful for the next project.

[1328] Specific prompt examples:

[1329] At the start of the project:

[1330] "Start an art project with a futuristic city theme. Choose an appropriate style from Cyberpunk, Retrofuture, or Metal City."

[1331] When collaborating in real time:

[1332] "Based on the current work, please maintain consistency between creators and incorporate the feedback suggested by the emotion engine. If a designer is nervous, suggest a relaxation graphic."

[1333] This embodiment allows creators with different styles and techniques to collaborate on consistent, high-quality art projects. Analyzing user sentiment and adjusting suggestions and feedback based on it provides a more natural and effective collaborative environment. Furthermore, incorporating feedback from end users can further refine the quality of the project.

[1334] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1335] Step 1:

[1336] The user sends a request to start an art project from their device. The input is the project start request and theme information (e.g., "future city"). The server receives the request, generates a project ID (e.g., "123XYZ"), and returns it to the user. This allows the server to generate a unique ID as an identifier for the project, providing a basis for recognizing the project. Specifically, the user enters "future city" as the theme and clicks the "Start Project" button.

[1337] Step 2:

[1338] The server launches the AI ​​module and emotion engine based on the project ID and theme information. The input is the project ID and theme information, and the output is the startup status of the AI ​​module and emotion engine. This lays the foundation for all analysis and proposals related to the project. Specifically, the server sends the project ID "123XYZ" and theme "Future City" to the AI ​​module and simultaneously launches the emotion engine.

[1339] Step 3:

[1340] The AI ​​module searches and analyzes related art styles and elements from the database to generate suggestions. The input is theme information, and the output is suggested art styles (e.g., "cyberpunk," "retrofuture," "metal city"). This gives users multiple options for the direction of their project. Specifically, the AI ​​module searches the database based on the theme "future city" and suggests related art styles.

[1341] Step 4:

[1342] The emotion engine monitors the user's emotions and adjusts the suggestions based on the results. The input is the user's emotional data, and the output is adjusted suggestions (e.g., suggestions that will relax a user who is in a tense state). This allows the engine to provide suggestions that are appropriate for the user's emotional state. Specifically, the emotion engine analyzes the camera feed and identifies the user's emotional state.

[1343] Step 5:

[1344] The user reviews the proposed art styles on their device and selects the style or elements they like. The input is the proposed art style, and the output is the selected style (e.g., "cyberpunk"). This confirms the progress of the project based on the user's preferences. Specifically, the user selects "cyberpunk" on their device and sends that information to the server.

[1345] Step 6:

[1346] The server sends a notification to other creators to join the project. The input is the user's selection and the project ID, and the output is a participation notification. This prepares other creators to join the project. As a specific operation, the server sends a participation invitation email to other creators.

[1347] Step 7:

[1348] Other creators access the project from their devices and approve their participation. The input is a participation notification, and the output is an acceptance of participation. This confirms that multiple creators are officially participating in the project. Specifically, the other creators check the email notification and approve their participation in the project.

[1349] Step 8:

[1350] The server provides a platform for multiple creators to collaborate in real time. The input is the creator's consent to participate, and the output is access rights to the shared platform. This allows creators to collaborate smoothly. Specifically, the server grants access rights to the collaborative platform.

[1351] Step 9:

[1352] Each creator inputs their own work content from their device and shares it with other creators in real time. The input is the work content, and the output is the shared work content. This allows information sharing among all creators. In concrete terms, user C inputs a character design from their device and shares it.

[1353] Step 10:

[1354] The AI ​​module analyzes the creator's work and provides feedback to ensure consistency. The input is the creator's work and the output is feedback. This ensures the consistency and quality of the project. Specifically, the AI ​​module checks the consistency of the design and provides feedback on any necessary corrections.

[1355] Step 11:

[1356] The emotion engine monitors the creator's emotional state and adjusts the interface or suggests additional features accordingly. The input is the creator's emotional data, and the output is an adjusted interface or additional suggestions. This optimizes the creator's working environment. Specifically, the emotion engine suggests relaxing graphics to creators who are feeling tense.

[1357] Step 12:

[1358] The server publishes project progress and intermediate deliverables to end users and collects feedback. The input is project progress information, and the output is feedback from end users. This allows the project to be improved based on end user opinions. Specifically, the server publishes intermediate deliverables on a website and collects feedback from end users.

[1359] Step 13:

[1360] The creator makes revisions based on the end user's feedback and finally completes the project. The input is the end user's feedback, and the output is the revised final product. This results in a high-quality final product. In concrete terms, the creator revise the design based on the feedback.

[1361] Step 14:

[1362] The server publishes the project and notifies the creator. The input is the completed project, and the output is the published project and a notification. This officially publishes the completed project. Specifically, the server uploads the final product to the public page and sends a notification email to the creator.

[1363] Step 15:

[1364] The server properly calculates and distributes copyrights and rewards. The input is the project data and the creator's contribution, and the output is the calculated reward. This ensures fair reward distribution based on each creator's contribution. Specifically, the server calculates each creator's work volume and contribution from the database and distributes rewards based on that.

[1365] Step 16:

[1366] The server accumulates project data and feedback along with the analysis results of the emotion engine, and updates the database to be useful for the next project. The input is project data and feedback, and the output is an updated database. This allows past project data to be utilized in the next project, enabling more advanced proposals. Specifically, the server collects all project data and updates the database.

[1367] (Application example 2)

[1368] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1369] In recent years, opportunities for creators to collaborate to produce high-quality projects have increased. However, differences in emotions and uneven work progress often lead to reduced project consistency and efficiency. Furthermore, methods for effectively incorporating feedback from end users have not been fully established. Furthermore, the lack of a system that makes suggestions based on a creator's emotional state can lead to a lack of creative inspiration. A system that can resolve these issues, support collaboration among creators, and improve the quality and efficiency of projects is needed.

[1370] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means. In this invention, the server includes: means for receiving a request from a creator such as an artist, writer, or designer to start a project; means for generating a project ID based on the received request and returning it to the creator; means for activating an AI module based on the project ID and sending theme information set by the creator to the AI; means for searching, analyzing, and suggesting related styles and elements from a database; means for displaying the suggestions to the creator and recording the selected style and elements; means for sending notifications of project participation to other creators; means for providing a platform for multiple creators to collaborate in real time; means for monitoring the work status of creators in real time and managing progress; means for analyzing the work content of creators and providing feedback to ensure consistency; means for disclosing project progress and intermediate deliverables to end users; means for collecting feedback from end users and providing it to creators; means for analyzing user emotions using an emotion engine and providing suggestions based on the emotions; means for monitoring user emotions in real time and adjusting the interface; means for disclosing the final work; means for appropriately calculating and distributing copyrights and remuneration; and means for accumulating project data and feedback and updating it as a database useful for the next project. This allows for optimal suggestions based on the creator's emotions, improving the consistency and quality of projects through real-time collaboration.

[1371] "Creator" refers to an artist, writer, designer, or other person who performs creative work on a project.

[1372] "Project ID" is a unique identifier generated to identify a project.

[1373] The "AI module" uses artificial intelligence to search, analyze, and make suggestions about related styles and elements.

[1374] A "database" is an information system containing stored information for searching and analyzing related styles and elements.

[1375] The "emotion engine" is a module that analyzes the user's emotions and provides suggestions based on the results.

[1376] "Interface" refers to the means and screen layout for interaction between the user and the system.

[1377] "Consistency" is the characteristic of maintaining a unified theme or style throughout a project.

[1378] "Feedback" refers to opinions and evaluations collected from end users and creators regarding the progress of a project and the content of proposals.

[1379] A "platform" refers to a common infrastructure or system that allows multiple creators to collaborate in real time.

[1380] "Progress" is the status that indicates how much work a creator has currently completed on a project.

[1381] The present invention is a system for enabling creators to efficiently start and progress projects, and aims to provide optimal suggestions based on the creator's emotional state. Specific embodiments of the present invention are described below.

[1382] Basic system configuration

[1383] This system consists of a server, terminals, an AI module, and an emotion engine. The server manages projects and aggregates data, while the terminals are devices used by each creator. The AI ​​module suggests styles and elements, and the emotion engine analyzes user emotions.

[1384] 1. Server:

[1385] The server receives a request from a creator to start a project and generates a project ID. The generated project ID is sent back to the creator. The server monitors the progress of the project and manages collaboration between creators. It also accumulates project data and feedback from end users, updating it as a database to be used for future projects.

[1386] 2. Terminal:

[1387] The terminal is a device that allows creators to set the theme of their project and input the details of their work. Based on the theme information sent from the terminal, the AI ​​module and emotion engine are activated and suggestions are made. Creators can collaborate with other creators in real time through the terminal.

[1388] 3. AI module:

[1389] The AI ​​module searches and analyzes the database for relevant styles and elements based on the theme information set by the creator, and makes suggestions. The suggestions are displayed to the creator, and the selected styles and elements are recorded. It also analyzes the creator's work and provides feedback to ensure consistency.

[1390] 4. Emotion Engine:

[1391] The emotion engine analyzes the user's emotions and provides appropriate suggestions based on their emotions. It also monitors the user's emotions in real time and adjusts the interface accordingly. For example, if the user is in a positive emotional state, it will suggest appropriate art styles and elements.

[1392] System Operation

[1393] When a user sends a request to start a project from their device, the server receives the request, generates a project ID, and returns it. The server then starts the AI ​​module and emotion engine based on this project ID.

[1394] The AI ​​module searches a database for related styles (e.g., cyberpunk, retro-future) based on the theme information set by the creator (e.g., "future city") and makes suggestions. The emotion engine analyzes the user's emotions in real time and adjusts the suggestions. These suggestions are displayed on the device, allowing the creator to select the style and elements that interest them.

[1395] Other creators are notified of their participation in the project, providing a platform for multiple creators to collaborate in real time. The server monitors each creator's work, manages their progress, and provides consistent feedback.

[1396] The project's progress and intermediate results are made public to end users, and feedback from end users is collected and provided to creators. This feedback is then reanalyzed by the emotion engine and AI module, and new suggestions are made regarding the project's direction.

[1397] Finally, the project is completed with all feedback incorporated, and the server publishes the work, with copyright and compensation properly calculated and distributed.

[1398] Examples and prompts

[1399] If a creator is starting a project with the theme "future cities" and the user's sentiment is positive, they could use the following prompt:

[1400] User sentiment: [Positive]

[1401] Project theme: [Future City]

[1402] User Preferences: [Cyberpunk, Retro-future]

[1403] This allows the emotion engine and AI module to work together to suggest content that best suits the creator's emotional state, facilitating the completion of high-quality projects.

[1404] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1405] Step 1:

[1406] The user sends a request to start a project from their device to the server. The input includes the theme information set by the user (e.g., "Future City"). The server receives this request, generates a project ID, and returns it to the creator. The output is a project ID that is notified to the user.

[1407] Step 2:

[1408] The server launches the AI ​​module and emotion engine based on the generated project ID. The project ID and theme information are used as inputs. This initiates the search and analysis of related data. A list of suggestions is returned as output.

[1409] Step 3:

[1410] The terminal displays the styles and elements suggested by the AI ​​module to the user. As input, it uses the list of suggestions received from the server. The user selects the ones that interest them from these suggestions. As output, the style and elements selected by the user are recorded.

[1411] Step 4:

[1412] The server sends project participation notifications to other creators based on the user's selection. The input includes the user's selection and the project ID. The output is a project participation notification sent to other creators.

[1413] Step 5:

[1414] The server provides a platform where multiple creators can collaborate in real time. On this platform, each creator's work is input and shared with other creators. The output reflects the shared work and the real-time status of the work.

[1415] Step 6:

[1416] The emotion engine monitors each creator's emotional state in real time. As input, the creator's emotional data is collected periodically. Emotional data is derived from the creator's facial expressions, vocal tone, etc. As output, it makes interface adjustments and additional suggestions based on the emotion.

[1417] Step 7:

[1418] The server exposes project progress and intermediate deliverables to end users and collects feedback. The input includes work results from creators and feedback from end users. Feedback is collected as text comments and evaluation points. The output is feedback provided to creators.

[1419] Step 8:

[1420] The AI ​​module and emotion engine reanalyze and re-propose the direction of the project based on feedback from end users and creators. The input includes collected feedback data and current project progress data. The output is a re-proposed style and elements.

[1421] Step 9:

[1422] The server publishes the final work when it is complete. The input contains the work of all creators. The output is the publication of the final work and notification to the end user.

[1423] Step 10:

[1424] The server properly calculates and distributes copyrights and rewards. The input includes contribution data for each creator. The output is the distributed rewards and notification to each creator.

[1425] Step 11:

[1426] The server accumulates the project data and feedback and updates it as a database that will be useful for the next project. As input, it contains all the data and feedback from the project. As output, the updated database will be used for the next project.

[1427] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1428] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1429] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1430] [Fourth embodiment]

[1431] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1432] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1433] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1434] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1435] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1436] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1437] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1438] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1439] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1440] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1441] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1442] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1443] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1444] As a specific embodiment of the present invention, a creative collaboration system using AI will be described in detail below. This system is composed of a server, a client (terminal), and an AI module.

[1445] Basic system configuration

[1446] Server: The server receives a request from a creator to start a project, generates a project ID, returns the project ID to the creator, and activates the AI ​​module. It also monitors the progress of the project and manages collaboration between creators.

[1447] Device: A device is used by each creator to set the project theme, input work details, receive and incorporate feedback from AI, and collaborate with other creators in real time.

[1448] AI Module: The AI ​​module searches the database based on the theme information set by the creator, suggests related art styles and elements, and analyzes the creator's work to provide feedback to ensure consistency.

[1449] System Operation

[1450] User starts a project:

[1451] The creator (user) sends a request to start an art project to the server from their device, entering the theme information (e.g., "future city"). The server receives this request, generates a project ID, and returns it to the user.

[1452] AI generates thematic suggestions:

[1453] The server launches an AI module based on the project ID and theme information. The AI ​​module searches the database for relevant art styles (e.g., cyberpunk, retro-future, metal city) and suggests them to the user. The user can then review these suggestions on their device and select the styles and elements that interest them.

[1454] Notifying and participating with other creators:

[1455] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators (User B, User C) access the project from their devices and approve their participation. Each creator may have a different role, such as design, concept, or story.

[1456] Real-time collaboration:

[1457] The server provides a platform where multiple creators can collaborate in real time. Creators input their work and share it with other creators. The AI ​​module analyzes the creators' work in real time and provides feedback to ensure consistency. For example, while a designer (User C) is creating a visual of a futuristic city, a writer (User B) is writing a story about that city. The AI ​​then makes suggestions to harmonize these different pieces of content.

[1458] End-user feedback and project completion:

[1459] The server will publish the project's progress and intermediate results to end users and collect feedback. End user feedback will be provided to the creator, and if necessary, the AI ​​will reanalyze and re-suggest the direction of the project. Finally, once all feedback has been incorporated and the project is complete, the server will publish the project.

[1460] Copyright and Revenue Sharing:

[1461] After a project is completed, the server will properly calculate and distribute copyright and compensation. By distributing appropriate compensation based on each creator's contribution, a fair and transparent compensation system is realized.

[1462] This embodiment allows creators with different styles and techniques to collaborate on consistent, high-quality art projects, and further enhances the quality of the projects by incorporating feedback from end users.

[1463] The processing flow will be explained below.

[1464] Step 1:

[1465] User: Sends a request to the server from the device to start an art project, entering the project's theme information (e.g., "future city").

[1466] Step 2:

[1467] Server: Receives the request from the user, generates a project ID, and returns it to the user.

[1468] Step 3:

[1469] Server: Sends the project ID and theme information to the AI ​​module and starts the AI ​​module.

[1470] Step 4:

[1471] AI module: Searches and analyzes related art styles and elements from a database and suggests them to the creator (e.g., cyberpunk, retro-future, metal city).

[1472] Step 5:

[1473] User: Review AI suggestions on your device and select the style or element that interests you (e.g., choose Cyberpunk).

[1474] Step 6:

[1475] Server: Records user choices and establishes project direction.

[1476] Step 7:

[1477] Server: Sends a notification to other creators (User B, User C) to join the project.

[1478] Step 8:

[1479] User B and User C: Access the project from their device and approve their participation.

[1480] Step 9:

[1481] Server: Provides a platform where multiple creators can collaborate in real time.

[1482] Step 10:

[1483] Creators (Users A, B, and C): Enter and share their work on the platform.

[1484] Step 11:

[1485] Server: Monitors the creators' work status in real time and manages progress.

[1486] Step 12:

[1487] AI module: Analyzes each creator's work and provides feedback to ensure consistency. For example, it suggests incorporating User B's story elements into User C's design.

[1488] Step 13:

[1489] Creators (Users A, B, and C): Review the AI's feedback and incorporate it into their own work.

[1490] Step 14:

[1491] Server: Publishes project progress and intermediate deliverables to end users and gathers feedback.

[1492] Step 15:

[1493] End users: Enter feedback and ratings from their devices and send them to the server.

[1494] Step 16:

[1495] Server: Provides collected feedback to project creators, and if necessary, the AI ​​reanalyzes and re-proposes new directions for the project.

[1496] Step 17:

[1497] Creators (Users A, B, and C): Incorporate feedback, work on it, and refine the project into its final form.

[1498] Step 18:

[1499] Server: Confirms that the project is complete and officially publishes the final product.

[1500] Step 19:

[1501] Server: Calculates and distributes copyrights and rewards appropriately. Distributes appropriate rewards to each creator based on their contribution.

[1502] Step 20:

[1503] Creators (Users A, B, and C): Receive rewards distributed in a fair and transparent manner.

[1504] Example 1

[1505] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1506] Modern creative projects require creators from different genres to collaborate on consistent, high-quality works. However, challenges exist, such as a lack of collaboration between individual creators and difficulty in unifying the overall direction. Furthermore, the lack of a mechanism for effectively incorporating feedback from end users makes it difficult to improve the quality of the final project. Furthermore, the distribution of copyright and compensation based on each creator's contribution is unclear, creating problems of unfairness.

[1507] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1508] In this invention, the server includes: means for receiving a request from a creator, such as an artist, writer, or designer, to start a project; means for generating a project ID based on the received request and returning it to the creator; means for activating an artificial intelligence module based on the project ID and sending theme information set by the creator to the artificial intelligence; means for searching and analyzing related styles and elements from a database and suggesting them; means for displaying the suggestions to the creator and recording the selected styles and elements; means for sending project participation notifications to other creators; means for providing a platform for multiple creators to collaborate in real time; means for monitoring the work status of creators in real time and managing progress; means for analyzing the work content of creators and providing feedback to ensure consistency using a web socket; means for disclosing the project progress and intermediate results to end users; means for collecting feedback from end users and providing it to creators; means for disclosing the final work; and means for appropriately calculating and distributing copyrights and remuneration. This enables creators of different genres to effectively collaborate and collaborate on consistent, high-quality works. Furthermore, by incorporating feedback from end users, we can improve the quality of projects and ensure fair distribution of copyright and rewards based on each creator's contribution.

[1509] An "artist" is a professional who creates works of art such as music, painting, or sculpture.

[1510] An "author" is a professional who writes literary works such as novels, essays, poems, and plays.

[1511] A "designer" is a professional who works on visual and functional design, such as product design, graphic design, and industrial design.

[1512] "Creator" is a general term that refers to professionals who produce creative works, such as artists, writers, and designers.

[1513] A "project" is a plan that is set up around a specific theme or purpose and is produced jointly by multiple creators.

[1514] A "request" is a request that a creator sends to the server when starting a project.

[1515] A "project ID" is an identification code generated to uniquely identify a project.

[1516] The "artificial intelligence module" is a machine learning algorithm that analyzes the theme information set by the creator and suggests related styles and elements.

[1517] A "database" is an information management system that systematically organizes information and makes it easy to search and retrieve.

[1518] A "style" is a particular method of expression or artistic school in creative work.

[1519] "Elements" are the individual components or parts that make up a creative work.

[1520] "Infrastructure" refers to the infrastructure and systems that allow multiple creators to collaborate in real time.

[1521] "Monitoring" means that the system monitors the creator's work status in real time and detects progress and abnormalities.

[1522] "Feedback" refers to the advice and evaluation provided by the artificial intelligence module on the creator's work.

[1523] "WEB Socket" is a communication protocol for real-time two-way communication between a client and a server.

[1524] "End User" refers to a general user who views and evaluates a completed creative project.

[1525] "Copyright" refers to the exclusive legal rights that creators have in their work.

[1526] "Remuneration" refers to the compensation or salary paid to creators based on their contribution.

[1527] As a specific embodiment of the present invention, a creative collaboration system using AI will be described. This system is realized by a server, a terminal, and an AI module.

[1528] Basic system configuration

[1529] Server: The server receives a project start request from a creator, generates a unique project ID, returns the generated project ID to the creator, and activates the AI ​​module. It also monitors the progress of the project and manages collaboration between creators.

[1530] Device: A device used by each creator to set the project theme, input work details, receive and incorporate feedback from AI, and collaborate with other creators in real time.

[1531] AI module: Searches the database based on thematic information provided by the user, suggests related styles and elements, and analyzes the creator's work and provides feedback to ensure consistency.

[1532] Hardware and Software

[1533] Server: An AWS EC2 instance is used, which provides the main server-side functions such as generating project IDs, launching AI modules, and managing project progress.

[1534] Devices: PCs, tablets, smartphones, etc. These devices run common operating systems such as Windows 10, iOS 14, and Android 11.

[1535] AI module: uses the GPT-4 model and custom models with TensorFlow, which allows for thematic style and element suggestions and feedback.

[1536] Detailed description of operation

[1537] Project Start:

[1538] The creator (user) uses a device to send a project start request to the server. The request includes theme information (e.g., "future city"). The server receives this request, generates a project ID, and returns it to the user.

[1539] AI-generated suggestions:

[1540] The server launches an artificial intelligence module based on the project ID and theme information. The AI ​​module searches for relevant styles and elements in a database (e.g., Guardian DB, Style Repository) and sends suggestions to the user. The user can review these suggestions on their device and select the styles and elements they are interested in.

[1541] Creator Notification and Involvement:

[1542] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators (User B, User C) access the project from their devices and approve their participation. Each creator has a different role (designer, writer, etc.).

[1543] Real-time collaboration:

[1544] The server provides a platform for multiple creators to collaborate in real time. Creators input their work and share it with other creators. The AI ​​module analyzes the work in real time and provides feedback to ensure consistency. For example, while a designer (User C) is creating a visual of a futuristic city, a writer (User B) is writing a story about that city. The AI ​​makes suggestions to harmonize these different pieces of content.

[1545] End-user feedback and project completion:

[1546] The server will make the project's progress and intermediate results public to end users and collect feedback. The end users' feedback will be provided to the creator, and if necessary, the AI ​​will reanalyze and re-suggest the direction of the project. Finally, when all feedback has been incorporated and the project is completed, the server will publish the finished work.

[1547] Copyright and Revenue Sharing:

[1548] After the project is completed, the server will properly calculate and distribute copyright and rewards, distributing appropriate rewards to each creator based on their contribution.

[1549] Specific examples

[1550] Project theme: "Future City"

[1551] Example prompt for generative AI model:

[1552] Start your futuristic city-themed art project. Choose from cyberpunk, retrofuture, and metal city styles.

[1553] This system allows creators from different genres to collaborate effectively and collaborate to produce consistent, high-quality works. By incorporating feedback from end users, the quality of the projects can be further improved and fair copyright and reward distribution can be achieved.

[1554] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1555] Step 1:

[1556] Submitting a Project Start Request

[1557] User: Sends a request from the device to the server to start an art project, including the theme information.

[1558] Input: Theme information (e.g. "Future City")

[1559] Output: Request data to the server

[1560] Specific operation: The user enters the theme information in a dedicated form and clicks the "Start" button.

[1561] Step 2:

[1562] Generate and return a project ID

[1563] Server: Receives the project start request, generates a unique project ID, and returns it to the user.

[1564] Input: Project Start Request

[1565] Output: Project ID

[1566] Specific operation: The server generates a project ID using the UUID algorithm and returns it to the user's device as an HTTP response.

[1567] Step 3:

[1568] Launching the AI ​​module and sending thematic information

[1569] Server: Starts the AI ​​module based on the generated project ID and theme information, and sends the theme information to the AI.

[1570] Input: Project ID, Theme information

[1571] Output: AI startup state based on theme information

[1572] What it does: The server triggers a Python script that passes the theme information to an AI model (e.g., GPT-4).

[1573] Step 4:

[1574] AI-powered style and element suggestions

[1575] AI module: Searches and analyzes relevant styles and elements from a database and generates suggestions.

[1576] Input: Theme information

[1577] Output: Style suggestions (e.g. cyberpunk, retro-future, metal city)

[1578] What it does: The AI ​​module uses the GPT-4 model to generate related styles like cyberpunk and retro-future.

[1579] Step 5:

[1580] View and select suggestions

[1581] User: Review AI-generated style suggestions on their device and select the styles and elements that interest them.

[1582] Input: Style suggestions

[1583] Output: Selected Style

[1584] Specific behavior: The user clicks to select the style they prefer from multiple style suggestions displayed on the web interface.

[1585] Step 6:

[1586] Creator participation notification

[1587] Server: Once the user confirms their selection, they notify other creators that they have joined the project.

[1588] Input: Selected style information

[1589] Output: Notification of joining other creators

[1590] What it does: The server uses the notification API to send emails and in-app notifications to creators, providing them with project details and a link to join.

[1591] Step 7:

[1592] Real-time collaboration

[1593] Server: Provides a real-time collaboration platform, allowing creators to input and share their work.

[1594] Input: Creator's work

[1595] Output: Shared work in real time

[1596] Specific operation: The server uses WebSocket to ensure real-time communication, and each creator's actions are immediately reflected to other users.

[1597] Step 8:

[1598] Providing Feedback

[1599] AI module: Analyzes creators' work in real time and provides feedback to ensure consistency.

[1600] Input: Creator's work

[1601] Output: Feedback information

[1602] How it works: The AI ​​module periodically collects data and evaluates consistency. For example, while a designer is creating a visual representation of a futuristic city, the AI ​​can suggest consistent color schemes and design elements.

[1603] Step 9:

[1604] Gathering feedback from end users

[1605] Server: Publishes project progress and intermediate deliverables to end users and gathers feedback.

[1606] Input: Intermediate deliverables

[1607] Output: End-user feedback data

[1608] What it does: The server sends surveys to end users at specific time intervals and collects feedback form data.

[1609] Step 10:

[1610] Publishing the project

[1611] Server: Publish the final project incorporating all feedback.

[1612] Input: End-user feedback

[1613] Output: Published final project

[1614] Specific operation: The server uploads the final data of the project to the specified public server, generates a URL and provides it to the end user.

[1615] Step 11:

[1616] Copyright and Remuneration Distribution

[1617] Server: After the project is completed, we will properly calculate and distribute copyright and remuneration.

[1618] Input: Creator contribution data

[1619] Output: Distributed rewards

[1620] How it works: The server runs an algorithm that calculates each creator's contribution and transfers the rewards directly to their digital wallet.

[1621] (Application example 1)

[1622] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1623] Conventional creative collaboration systems not only make it difficult for different creators to collaborate in real time, but also limit the production of consistent, high-quality content. They also make it difficult to improve the project's quality because they cannot collect feedback from end users in real time and incorporate it into the project. Furthermore, they do not support the generation and sharing of augmented reality content using smart devices, so they cannot meet the diverse creative needs of today.

[1624] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1625] In this invention, the server includes: means for receiving a request from a creator such as an artist, writer, or designer to start a project; means for generating a project ID based on the received request and returning it to the creator; means for activating an AI module based on the project ID and sending theme information set by the creator to the AI; means for searching, analyzing, and suggesting related styles and elements from a database; means for displaying the suggested content to the creator and recording the selected style and elements; means for sending notifications of project participation to other creators; means for providing a platform for multiple creators to collaborate in real time; means for monitoring the work status of creators in real time and managing progress; means for analyzing the work content of creators and providing feedback to ensure consistency; means for disclosing the project progress and intermediate deliverables to end users; means for collecting feedback from end users and providing it to creators; means for disclosing the final work; means for a user to start a project using a smart device and input theme settings and work content; means for displaying augmented reality content generated on the smart device in real time and sharing it with other creators; and means for collecting feedback from end users via an external device in real time and providing it to creators. This not only strengthens real-time collaboration between creators and enables the creation of consistent, high-quality content, but also allows for feedback from end users to be reflected in real time, improving the completeness of projects. It also supports the creation and sharing of augmented reality content using smart devices.

[1626] A "creator" is an individual or group that performs creative work on a project, such as an artist, writer, or designer.

[1627] "Project ID" means a unique identifier generated at the initiation of a project and used to manage and track the project.

[1628] An "AI module" is a software component that uses artificial intelligence to analyze data and make suggestions.

[1629] "Theme information" is information that indicates the general framework and direction of the creation set by the creator for the project.

[1630] A "database" is a collection of data that stores related styles and elements that creators can reference.

[1631] "Styles and elements" refer to the designs, concepts, techniques, etc. used in creative work.

[1632] A "platform" is a system that serves as the technical foundation for multiple creators to collaborate in real time.

[1633] "Progress" is information that indicates the progress and achievement of a project.

[1634] "Feedback" means opinions or ratings provided by End Users or other Creators.

[1635] "End users" are the recipients of the final product and the providers of feedback.

[1636] "Copyright" is the legal right that creators have in the works they create.

[1637] "Remuneration" is the compensation a creator receives based on their contribution to the project.

[1638] A "smart device" is an electronic device with advanced computing power and internet connectivity, including, for example, smartphones and smart glasses.

[1639] "Augmented reality content" is content that overlays digital information onto visual information from the real world.

[1640] An "external device" is hardware that is used as part of a system but is not integrated into the internal structure.

[1641] As a specific embodiment of the present invention, a system in which creators start projects using smart devices and collaborate in real time is described below. This system is composed of a server, terminals (smart devices), and an AI module.

[1642] Basic system configuration

[1643] Server: The server receives project start requests from creators, generates a project ID, returns the project ID to the creator, and activates the AI ​​module. It also monitors the progress of the project and manages collaboration between creators.

[1644] Terminal (Smart Device): A terminal is a device used by each creator to set the theme, input work content, receive and incorporate feedback from AI, and collaborate with other creators in real time. Examples of smart devices include smart glasses and smartphones.

[1645] AI Module: The AI ​​module searches the database based on the theme information set by the creator, suggests related styles and elements, and analyzes the creator's work to provide feedback to ensure consistency.

[1646] System Operation

[1647] 1. User starts a project:

[1648] The user uses a smart device to send a project start request to the server, entering the theme information (e.g., "Future Fashion"). The server receives this request, generates a project ID, and returns it to the user.

[1649] 2. AI generates thematic suggestions:

[1650] The server launches an AI module based on the project ID and theme information. The AI ​​module searches the database for relevant styles and elements and suggests them to the user (e.g., cyberpunk design). The user can then review these suggestions on their device and select the styles and elements they are interested in.

[1651] 3. Notifying and Involving Other Creators:

[1652] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators can access the project from their devices and approve their participation. Each creator has a different role, such as design or concept.

[1653] 4. Real-time collaboration:

[1654] The server provides a platform where multiple creators can collaborate in real time. Creators input their work via smart devices and share it with other creators. For example, a designer might create a futuristic fashion item in augmented reality (AR), while other creators write a story related to that item. The AI ​​module analyzes these different pieces of content and provides feedback to ensure consistency.

[1655] 5. End-user feedback and project completion:

[1656] The server displays the project's progress and intermediate results to end users and collects feedback. The collected feedback is provided to the creator in real time, and the AI ​​module reanalyzes the project's direction as needed. Finally, when all feedback has been incorporated and the project is complete, the server publishes the project.

[1657] Examples of concrete examples and prompts

[1658] Example: A user wants to design new AR outfits for a future fashion show and starts the project using smart glasses.

[1659] Example prompt sentence:

[1660] Project Theme: Future Fashion

[1661] Design direction: Cyberpunk

[1662] Required elements: metallic texture, neon lights

[1663] In this way, the system of the present invention not only strengthens real-time collaboration between creators and enables the creation of consistent, high-quality content, but also improves the completeness of projects by incorporating feedback from end users in real time. It also supports the creation and sharing of augmented reality content using smart devices.

[1664] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1665] Step 1:

[1666] A user sends a project start request to the server using a smart device. The request data includes theme information (e.g., "Future Fashion") as input, and the server receives this data. The server analyzes the request data, recognizes the start of a project, and generates a project ID as output.

[1667] Step 2:

[1668] The server returns the generated project ID to the user and activates the AI ​​module, which sends the theme information to the AI ​​module. The server receives the project ID and theme information as input and sends them to the AI ​​module. The AI ​​module searches the database based on the theme information and generates related style and element suggestions as output.

[1669] Step 3:

[1670] The server sends the suggestions from the AI ​​module to the device and displays them to the user. The user reviews these suggestions on the device and selects the styles and elements they are interested in. The input is the suggestions, which the device displays to the user. After the user selects the styles and elements, the selection data is generated as the output and sent to the server.

[1671] Step 4:

[1672] The server records the user's selection data and sends notifications to other creators about their participation in the project. The server receives the user's selection data and other creator information as input, generates notifications based on this, and sends them to other creators. The server also generates notifications to other creators about their participation in the project as output.

[1673] Step 5:

[1674] Other creators access the project from their devices and approve their participation. The input is a participation notification, which the device displays to other creators. When other creators approve their participation, participation approval data is generated as output and sent to the server.

[1675] Step 6:

[1676] The server provides a real-time collaboration platform for projects, where creators can input their work details via smart devices and share them with other creators. The server receives the work data from each creator in real time and shares it on the collaboration platform as output.

[1677] Step 7:

[1678] The AI ​​module analyzes each creator's work and provides feedback to ensure consistency. As input, the AI ​​module analyzes each creator's work data. As output, consistency feedback is generated and provided to each creator.

[1679] Step 8:

[1680] The server publishes the project progress and intermediate results to end users and collects feedback. The input is intermediate result data, which the server publishes to end users. Feedback from end users is collected, and feedback data is generated as output and provided to the creator.

[1681] Step 9:

[1682] The server reanalyzes the AI ​​module based on the collected feedback data and makes a new proposal for the project's direction. The AI ​​module reanalyzes the feedback data and current project data as input. The output is a new proposal that is provided to the creator.

[1683] Step 10:

[1684] Finally, when all feedback is incorporated and the project is completed, the server publishes the project. The input is the final product data, which the server processes in the end. The output is the published data of the final product.

[1685] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1686] As a specific embodiment of the present invention, we will explain in detail a creative collaboration system using AI combined with an emotion engine that recognizes user emotions. This system is composed of a server, a client (terminal), an AI module, and an emotion engine.

[1687] Basic system configuration

[1688] Server: The server receives a project start request from a creator, generates a project ID, returns the project ID to the creator, and starts the AI ​​module and emotion engine. The server monitors the progress of the project and manages collaboration between creators.

[1689] Terminal: A terminal is a device used by each creator to set the project theme and input work content, receive and incorporate feedback from AI, receive interface information from the emotion engine, and collaborate in real time with other creators.

[1690] AI Module: The AI ​​module searches the database based on the theme information set by the creator, suggests related art styles and elements, and analyzes the creator's work to provide feedback to ensure consistency.

[1691] Emotion Engine: The emotion engine recognizes the user's emotions and suggests appropriate art styles and elements based on the emotions. It also monitors the user's emotions in real time and uses that information for feedback and interface generation.

[1692] System Operation

[1693] User starts a project:

[1694] The creator (user) sends a request to start an art project to the server from their device, entering the theme information (e.g., "future city"). The server receives this request, generates a project ID, and returns it to the user.

[1695] AI generates thematic suggestions:

[1696] The server launches an AI module and emotion engine based on the project ID and theme information. The AI ​​module searches the database for relevant art styles (e.g., cyberpunk, retrofuture, metal city) and suggests them to the user. The emotion engine analyzes the user's emotions and adjusts the suggestions based on the results. The user then reviews these suggestions on their device and selects the style or element that interests them (e.g., cyberpunk).

[1697] Notifying and participating with other creators:

[1698] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators (User B, User C) access the project from their devices and approve their participation. Each creator may have a different role, such as design, concept, or story.

[1699] Real-time collaboration:

[1700] The server provides a platform where multiple creators can collaborate in real time. Creators input their work and share it with other creators. The AI ​​module analyzes the creators' work in real time and provides feedback to ensure consistency. The emotion engine monitors the creators' emotional state and makes adjustments to the interface or suggestions for additions accordingly. For example, if a designer (User C) is nervous, the emotion engine will suggest graphics that have a relaxing effect.

[1701] End-user feedback and project completion:

[1702] The server will publish the project's progress and intermediate results to end users and collect feedback. End user feedback will be provided to the creator, and the AI ​​and emotion engine will reanalyze and re-suggest the direction of the project as needed. Finally, once all feedback has been incorporated and the project is complete, the server will publish the project.

[1703] Copyright and Revenue Sharing:

[1704] After a project is completed, the server will properly calculate and distribute copyright and compensation. By distributing appropriate compensation based on each creator's contribution, a fair and transparent compensation system is realized.

[1705] Database update:

[1706] The server accumulates project data and feedback along with the analysis results of the emotion engine, and updates it as a database that will be useful for the next project.

[1707] This embodiment allows creators with different styles and techniques to collaborate on consistent, high-quality art projects. Analyzing user sentiment and adjusting suggestions and feedback based on it provides a more natural and effective collaborative environment. Furthermore, incorporating feedback from end users can further refine the quality of the project.

[1708] The processing flow will be explained below.

[1709] Step 1:

[1710] User: Sends a request to the server from the device to start an art project, entering project theme information (e.g., "future city") and initial setting information.

[1711] Step 2:

[1712] Server: Receives the request from the user, generates a project ID, and returns it to the user.

[1713] Step 3:

[1714] Server: Activates the AI ​​module and emotion engine based on the project ID and theme information.

[1715] Step 4:

[1716] Emotion engine: Analyzes the initial setup information and the user's real-time emotional data, for example, by using the camera and microphone to analyze the user's facial expressions and tone of voice to identify their emotional state.

[1717] Step 5:

[1718] AI module: Searches and analyzes related art styles and elements (e.g., cyberpunk, retro-future, metal city) from the database and suggests them to the user.

[1719] Step 6:

[1720] Emotion engine: Adjusts the AI ​​module's suggestions based on the user's real-time emotional data, for example, suggesting bolder styles if the user is excited.

[1721] Step 7:

[1722] User: Review suggestions from the AI ​​and emotion engine on their device and choose the style or element that interests them (e.g., choose Cyberpunk).

[1723] Step 8:

[1724] Server: Records user choices and establishes project direction.

[1725] Step 9:

[1726] Server: Sends a notification to other creators (User B, User C) to join the project.

[1727] Step 10:

[1728] User B and User C: Access the project from their device and approve their participation.

[1729] Step 11:

[1730] Server: Provides a platform where multiple creators can collaborate in real time.

[1731] Step 12:

[1732] Creators (Users A, B, and C): Enter and share their work on the platform.

[1733] Step 13:

[1734] Server: Monitors the creators' work status in real time and manages progress.

[1735] Step 14:

[1736] AI module: Analyzes each creator's work and provides feedback to ensure consistency. For example, it suggests incorporating User B's story elements into User C's design.

[1737] Step 15:

[1738] Emotion Engine: Monitors the creators' emotional state in real time and adjusts the interface and feedback as needed. For example, if User A is feeling stressed, it will provide encouraging messages and inspiration.

[1739] Step 16:

[1740] Creators (Users A, B, and C): Review the feedback from the AI ​​and emotion engine and incorporate it into their work.

[1741] Step 17:

[1742] Server: Publishes project progress and intermediate deliverables to end users and gathers feedback.

[1743] Step 18:

[1744] End users: Enter feedback and ratings from their devices and send them to the server.

[1745] Step 19:

[1746] Server: Provides collected feedback to project creators, and if necessary, the AI ​​and emotion engine reanalyze and resuggest the direction of the project.

[1747] Step 20:

[1748] Creators (Users A, B, and C): Incorporate feedback, work on it, and refine the project into its final form.

[1749] Step 21:

[1750] Server: Confirms that the project is complete and officially publishes the final product.

[1751] Step 22:

[1752] Server: Calculates and distributes copyrights and rewards appropriately. Distributes appropriate rewards to each creator based on their contribution.

[1753] Step 23:

[1754] Creators (Users A, B, and C): Receive rewards distributed in a fair and transparent manner.

[1755] Example 2

[1756] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1757] In traditional creative projects, it is not easy for multiple creators to collaborate and produce consistent, high-quality deliverables. Many challenges exist, including collaboration between creators, progress management, feedback sharing, and maintaining consistency. Coordinating emotional collaboration is also difficult with traditional systems. Furthermore, effectively incorporating feedback from end users and properly allocating rewards based on creators' contributions are also challenges.

[1758] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for receiving a request from a creator to start a project, means for generating a project ID based on the received request and returning it to the creator, means for activating an artificial intelligence module based on the project ID and transmitting theme information set by the creator to the artificial intelligence, means for searching and analyzing related styles and elements from a database and suggesting them, means for displaying the suggested content to the creator and recording the selected style and element, means for sending project participation notifications to other creators, means for providing a platform for multiple creators to collaborate in real time, means for monitoring the work status of creators in real time and managing the progress, means for analyzing the work content of creators and providing feedback to ensure consistency, means for disclosing the progress of the project and intermediate deliverables to end users, means for collecting feedback from end users and providing it to creators, means for disclosing the final work, means for appropriately calculating and distributing copyrights and remuneration, and means for monitoring user sentiment in real time and adjusting suggestions and interfaces based on the results. This allows multiple creators to efficiently collaborate on consistent, high-quality art projects, realizing natural and effective collaboration based on emotions. It also allows for proper incorporation of feedback from end users, improving the quality of projects, and ensuring fair and transparent reward distribution based on creators' contributions.

[1759] A "creator" is a person who participates in an art project and engages in creative activities, including artists, writers, designers, etc.

[1760] "Project ID" is a unique identifier generated by the server to identify each project.

[1761] "Artificial intelligence" is an advanced computer program that searches and analyzes a database based on thematic information set by the creator, and suggests related styles and elements.

[1762] "Theme information" refers to information about the subject and concept of a project that a creator enters at the start of the project.

[1763] A "database" is a collection of data that stores related styles and elements for AI to search and analyze.

[1764] "Style and Elements" refers to the designs, concepts, and components associated with an art project that ensure its consistency and quality.

[1765] A "collaboration platform" is an environment within a system that allows multiple creators to collaborate in real time.

[1766] "Feedback" refers to opinions and reactions regarding the progress and content of a project provided by creators and end users.

[1767] "End users" are the final users who view the progress and intermediate deliverables of a project and provide feedback.

[1768] "Copyright" is the legal ownership of a creator's work.

[1769] "Remuneration" means monetary compensation that is calculated and distributed fairly based on the creator's level of contribution.

[1770] "Means for monitoring user emotions in real time" refers to technology that instantly analyzes the user's emotional state and adjusts suggestions and interfaces based on the results.

[1771] This invention relates to an AI-based creative collaboration system that combines an emotion engine that recognizes user emotions. This system consists of a server, a client (terminal), an AI module, and an emotion engine.

[1772] server:

[1773] The server receives a request from a creator to start a project and generates a project ID. The generated project ID is returned to the creator, after which the artificial intelligence module and emotion engine are activated. Furthermore, the server monitors the progress of the project and manages collaboration between creators.

[1774] Device:

[1775] The terminal is a device used by each creator to set the project theme and input work details, receive and reflect feedback from artificial intelligence, receive interface information from the emotion engine, and collaborate in real time with other creators.

[1776] Artificial Intelligence Module:

[1777] The AI ​​module searches the database based on the theme information set by the creator, suggests related art styles and elements, analyzes the creator's work, and provides feedback to ensure consistency. For example, if the theme is "future city," it will suggest art styles such as "cyberpunk," "retrofuture," and "metal city."

[1778] Emotion Engine:

[1779] The emotion engine recognizes the user's emotions and suggests appropriate art styles and elements based on their emotions. It also monitors the user's emotions in real time and uses that information for feedback and interface generation. For example, if the user is tense, it suggests elements that have a relaxing effect.

[1780] System Operation

[1781] Project Start:

[1782] The user sends a request to start an art project from their device to the server, entering the theme information (e.g., "future city"). The server receives this request, generates a project ID, and returns it to the user.

[1783] AI-generated suggestions:

[1784] The server launches an AI module and emotion engine based on the project ID and theme information. The AI ​​module searches the database for relevant art styles and generates suggestions. The emotion engine analyzes the user's emotions and adjusts the suggestions. The user can review these suggestions on their device and select the style or element that interests them (e.g., "cyberpunk").

[1785] Creator-to-creator participation notifications:

[1786] Once the user confirms their selection, the server sends a notification to the other creators to join the project. The other creators (User B and User C) can access the project from their devices and approve their participation.

[1787] Real-time collaboration:

[1788] The server provides a platform where multiple creators can collaborate in real time. Creators can input their work and share it with other creators. An artificial intelligence module analyzes the creators' work and provides feedback to ensure consistency. An emotion engine monitors the creators' emotional state and makes interface adjustments and additional suggestions accordingly.

[1789] End-user feedback:

[1790] The server displays the progress of the project and intermediate results to end users and collects their feedback. End users' feedback is provided to the creator, and if necessary, the AI ​​and emotion engine reanalyze and re-suggest the direction of the project.

[1791] Complete and publish the project:

[1792] Finally, when all feedback is incorporated and the project is completed, the server will publish the project. For the completed project, the server will properly calculate and distribute copyright and rewards.

[1793] Database update:

[1794] The server accumulates project data, feedback, and the analysis results of the emotion engine, and updates it as a database that will be useful for the next project.

[1795] Specific prompt examples:

[1796] At the start of the project:

[1797] "Start an art project with a futuristic city theme. Choose an appropriate style from Cyberpunk, Retrofuture, or Metal City."

[1798] When collaborating in real time:

[1799] "Based on the current work, please maintain consistency between creators and incorporate the feedback suggested by the emotion engine. If a designer is nervous, suggest a relaxation graphic."

[1800] This embodiment allows creators with different styles and techniques to collaborate on consistent, high-quality art projects. Analyzing user sentiment and adjusting suggestions and feedback based on it provides a more natural and effective collaborative environment. Furthermore, incorporating feedback from end users can further refine the quality of the project.

[1801] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1802] Step 1:

[1803] The user sends a request to start an art project from their device. The input is the project start request and theme information (e.g., "future city"). The server receives the request, generates a project ID (e.g., "123XYZ"), and returns it to the user. This allows the server to generate a unique ID as an identifier for the project, providing a basis for recognizing the project. Specifically, the user enters "future city" as the theme and clicks the "Start Project" button.

[1804] Step 2:

[1805] The server launches the AI ​​module and emotion engine based on the project ID and theme information. The input is the project ID and theme information, and the output is the startup status of the AI ​​module and emotion engine. This lays the foundation for all analysis and proposals related to the project. Specifically, the server sends the project ID "123XYZ" and theme "Future City" to the AI ​​module and simultaneously launches the emotion engine.

[1806] Step 3:

[1807] The AI ​​module searches and analyzes related art styles and elements from the database to generate suggestions. The input is theme information, and the output is suggested art styles (e.g., "cyberpunk," "retrofuture," "metal city"). This gives users multiple options for the direction of their project. Specifically, the AI ​​module searches the database based on the theme "future city" and suggests related art styles.

[1808] Step 4:

[1809] The emotion engine monitors the user's emotions and adjusts the suggestions based on the results. The input is the user's emotional data, and the output is adjusted suggestions (e.g., suggestions that will relax a user who is in a tense state). This allows the engine to provide suggestions that are appropriate for the user's emotional state. Specifically, the emotion engine analyzes the camera feed and identifies the user's emotional state.

[1810] Step 5:

[1811] The user reviews the proposed art styles on their device and selects the style or elements they like. The input is the proposed art style, and the output is the selected style (e.g., "cyberpunk"). This confirms the progress of the project based on the user's preferences. Specifically, the user selects "cyberpunk" on their device and sends that information to the server.

[1812] Step 6:

[1813] The server sends a notification to other creators to join the project. The input is the user's selection and the project ID, and the output is a participation notification. This prepares other creators to join the project. As a specific operation, the server sends a participation invitation email to other creators.

[1814] Step 7:

[1815] Other creators access the project from their devices and approve their participation. The input is a participation notification, and the output is an acceptance of participation. This confirms that multiple creators are officially participating in the project. Specifically, the other creators check the email notification and approve their participation in the project.

[1816] Step 8:

[1817] The server provides a platform for multiple creators to collaborate in real time. The input is the creator's consent to participate, and the output is access rights to the shared platform. This allows creators to collaborate smoothly. Specifically, the server grants access rights to the collaborative platform.

[1818] Step 9:

[1819] Each creator inputs their own work content from their device and shares it with other creators in real time. The input is the work content, and the output is the shared work content. This allows information sharing among all creators. In concrete terms, user C inputs a character design from their device and shares it.

[1820] Step 10:

[1821] The AI ​​module analyzes the creator's work and provides feedback to ensure consistency. The input is the creator's work and the output is feedback. This ensures the consistency and quality of the project. Specifically, the AI ​​module checks the consistency of the design and provides feedback on any necessary corrections.

[1822] Step 11:

[1823] The emotion engine monitors the creator's emotional state and adjusts the interface or suggests additional features accordingly. The input is the creator's emotional data, and the output is an adjusted interface or additional suggestions. This optimizes the creator's working environment. Specifically, the emotion engine suggests relaxing graphics to creators who are feeling tense.

[1824] Step 12:

[1825] The server publishes project progress and intermediate deliverables to end users and collects feedback. The input is project progress information, and the output is feedback from end users. This allows the project to be improved based on end user opinions. Specifically, the server publishes intermediate deliverables on a website and collects feedback from end users.

[1826] Step 13:

[1827] The creator makes revisions based on the end user's feedback and finally completes the project. The input is the end user's feedback, and the output is the revised final product. This results in a high-quality final product. In concrete terms, the creator revise the design based on the feedback.

[1828] Step 14:

[1829] The server publishes the project and notifies the creator. The input is the completed project, and the output is the published project and a notification. This officially publishes the completed project. Specifically, the server uploads the final product to the public page and sends a notification email to the creator.

[1830] Step 15:

[1831] The server properly calculates and distributes copyrights and rewards. The input is the project data and the creator's contribution, and the output is the calculated reward. This ensures fair reward distribution based on each creator's contribution. Specifically, the server calculates each creator's work volume and contribution from the database and distributes rewards based on that.

[1832] Step 16:

[1833] The server accumulates project data and feedback along with the analysis results of the emotion engine, and updates the database to be useful for the next project. The input is project data and feedback, and the output is an updated database. This allows past project data to be utilized in the next project, enabling more advanced proposals. Specifically, the server collects all project data and updates the database.

[1834] (Application example 2)

[1835] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1836] In recent years, opportunities for creators to collaborate to produce high-quality projects have increased. However, differences in emotions and uneven work progress often lead to reduced project consistency and efficiency. Furthermore, methods for effectively incorporating feedback from end users have not been fully established. Furthermore, the lack of a system that makes suggestions based on a creator's emotional state can lead to a lack of creative inspiration. A system that can resolve these issues, support collaboration among creators, and improve the quality and efficiency of projects is needed.

[1837] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means. In this invention, the server includes: means for receiving a request from a creator such as an artist, writer, or designer to start a project; means for generating a project ID based on the received request and returning it to the creator; means for activating an AI module based on the project ID and sending theme information set by the creator to the AI; means for searching, analyzing, and suggesting related styles and elements from a database; means for displaying the suggestions to the creator and recording the selected style and elements; means for sending notifications of project participation to other creators; means for providing a platform for multiple creators to collaborate in real time; means for monitoring the work status of creators in real time and managing progress; means for analyzing the work content of creators and providing feedback to ensure consistency; means for disclosing project progress and intermediate deliverables to end users; means for collecting feedback from end users and providing it to creators; means for analyzing user emotions using an emotion engine and providing suggestions based on the emotions; means for monitoring user emotions in real time and adjusting the interface; means for disclosing the final work; means for appropriately calculating and distributing copyrights and remuneration; and means for accumulating project data and feedback and updating it as a database useful for the next project. This allows for optimal suggestions based on the creator's emotions, improving the consistency and quality of projects through real-time collaboration.

[1838] "Creator" refers to an artist, writer, designer, or other person who performs creative work on a project.

[1839] "Project ID" is a unique identifier generated to identify a project.

[1840] The "AI module" uses artificial intelligence to search, analyze, and make suggestions about related styles and elements.

[1841] A "database" is an information system containing stored information for searching and analyzing related styles and elements.

[1842] The "emotion engine" is a module that analyzes the user's emotions and provides suggestions based on the results.

[1843] "Interface" refers to the means and screen layout for interaction between the user and the system.

[1844] "Consistency" is the characteristic of maintaining a unified theme or style throughout a project.

[1845] "Feedback" refers to opinions and evaluations collected from end users and creators regarding the progress of a project and the content of proposals.

[1846] A "platform" refers to a common infrastructure or system that allows multiple creators to collaborate in real time.

[1847] "Progress" is the status that indicates how much work a creator has currently completed on a project.

[1848] The present invention is a system for enabling creators to efficiently start and progress projects, and aims to provide optimal suggestions based on the creator's emotional state. Specific embodiments of the present invention are described below.

[1849] Basic system configuration

[1850] This system consists of a server, terminals, an AI module, and an emotion engine. The server manages projects and aggregates data, while the terminals are devices used by each creator. The AI ​​module suggests styles and elements, and the emotion engine analyzes user emotions.

[1851] 1. Server:

[1852] The server receives a request from a creator to start a project and generates a project ID. The generated project ID is sent back to the creator. The server monitors the progress of the project and manages collaboration between creators. It also accumulates project data and feedback from end users, updating it as a database to be used for future projects.

[1853] 2. Terminal:

[1854] The terminal is a device that allows creators to set the theme of their project and input the details of their work. Based on the theme information sent from the terminal, the AI ​​module and emotion engine are activated and suggestions are made. Creators can collaborate with other creators in real time through the terminal.

[1855] 3. AI module:

[1856] The AI ​​module searches and analyzes the database for relevant styles and elements based on the theme information set by the creator, and makes suggestions. The suggestions are displayed to the creator, and the selected styles and elements are recorded. It also analyzes the creator's work and provides feedback to ensure consistency.

[1857] 4. Emotion Engine:

[1858] The emotion engine analyzes the user's emotions and provides appropriate suggestions based on their emotions. It also monitors the user's emotions in real time and adjusts the interface accordingly. For example, if the user is in a positive emotional state, it will suggest appropriate art styles and elements.

[1859] System Operation

[1860] When a user sends a request to start a project from their device, the server receives the request, generates a project ID, and returns it. The server then starts the AI ​​module and emotion engine based on this project ID.

[1861] The AI ​​module searches a database for related styles (e.g., cyberpunk, retro-future) based on the theme information set by the creator (e.g., "future city") and makes suggestions. The emotion engine analyzes the user's emotions in real time and adjusts the suggestions. These suggestions are displayed on the device, allowing the creator to select the style and elements that interest them.

[1862] Other creators are notified of their participation in the project, providing a platform for multiple creators to collaborate in real time. The server monitors each creator's work, manages their progress, and provides consistent feedback.

[1863] The project's progress and intermediate results are made public to end users, and feedback from end users is collected and provided to creators. This feedback is then reanalyzed by the emotion engine and AI module, and new suggestions are made regarding the project's direction.

[1864] Finally, the project is completed with all feedback incorporated, and the server publishes the work, with copyright and compensation properly calculated and distributed.

[1865] Examples and prompts

[1866] If a creator is starting a project with the theme "future cities" and the user's sentiment is positive, they could use the follow...

Claims

1. A means for artists, writers, designers, and other creators to receive requests to start projects; A means of generating a project ID based on the received request and returning it to the creator; A method to start the AI ​​module based on the project ID and send the theme information set by the creator to the AI, A means to search and analyze related styles and elements from a database and suggest them; A means to display suggestions to creators and record selected styles and elements; A way to notify other creators of your participation in the project, A means to provide a platform for multiple creators to collaborate in real time, A means to monitor the creators' work status in real time and manage their progress, A way to analyze creators' work and provide feedback to ensure consistency, A means to make project progress and intermediate deliverables available to end users, and A means to collect and provide end-user feedback to creators; a means to publish the final work; A means to properly calculate and distribute copyrights and remuneration A system including:

2. The system according to claim 1 , further comprising means for reanalyzing the direction of the project based on feedback from a plurality of creators and making a new proposal.

3. 10. The system of claim 1, further comprising means for accumulating project data and feedback and updating the data base to be useful for subsequent projects.

Citation Information

Patent Citations

  • Persona chatbot control method and system

    JP2022180282A