System

Abstract

A system is provided.SOLUTION: The system includes a user setting means for a user to set a favorite theme and a display schedule, an art generation means for a server to generate an art based on the designated theme, a distribution means for distributing the generated art to a terminal of the user, a reception display means for the terminal of the user to receive and display the art distributed from the server, a feedback collection means for collecting feedback of the user and transmitting the feedback to the server, and a feedback analysis means for the server to analyze the feedback and reflect it on the next generation of the art.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] ---

[0005] In modern living spaces, the choice of artworks that can be hung on the walls is limited, making it difficult to enjoy a variety of art without getting bored. Furthermore, frequently changing physical artworks is expensive and time-consuming. Therefore, flexible and economical solutions are needed that allow people to easily enjoy new art on a daily basis. [Means for solving the problem]

[0006] To solve the above-mentioned problems, we provide an art display system that includes the following means: a "user setting means" for a user to set a preferred theme and display schedule; an "art generation means" for a server to generate art based on the specified theme; a "distribution means" for distributing the generated art to the user's terminal; a "receiving and display means" for the user's terminal to receive and display the art distributed from the server; a "feedback collection means" for collecting user feedback and sending it to the server; and a "feedback analysis means" for the server to analyze the feedback and reflect it in the next art generation. The art generation means can generate art using customizable parameters based on the user's preferences, and the system also includes a "schedule management means" for automatically updating the art based on a display schedule set by the user. This system allows users to easily enjoy new art every day.

[0007] ---

[0008] ---

[0009] The "user setting means" is a means for the user to set a preferred theme and display schedule.

[0010] The "art generation means" is a means by which the server generates art based on a specified theme.

[0011] The "distribution means" is a means for distributing the generated art to the user's terminal.

[0012] The "receiving and displaying means" is a means by which the user's terminal receives art distributed from the server and displays it.

[0013] The "feedback collection means" is a means for collecting user feedback and transmitting it to the server.

[0014] The "feedback analysis means" is a means for analyzing the feedback received by the server and reflecting the results in the next art generation.

[0015] The "schedule management means" is a means for automatically updating art based on a display schedule set by the user.

[0016] "Generative AI" is an artificial intelligence technology that generates artwork based on a specified theme.

[0017] --- [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11]FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0026] [First embodiment]

[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0039] ---

[0040] The system of the present invention is a generative AI picture frame system that allows users to enjoy new art every day. This system includes a user setting means, an art generation means, a distribution means, a receiving and displaying means, a feedback collection means, a feedback analysis means, and a schedule management means.

[0041] User setting method

[0042] User: During initial setup, the user accesses a dedicated application or website and creates an account. The user selects a theme (e.g., nature landscapes, abstract paintings, modern art, etc.) and a display schedule (e.g., daily, weekly, specific time, etc.). This information is sent to the server and saved as part of the user settings.

[0043] Art Creation Method

[0044] Server: Starts the process of generating art based on the set schedule and the selected theme. The generation AI generates an art piece that fits the specified theme and sends the generated art back to the server. For example, if the user selects "nature landscapes," the generation AI creates art depicting beautiful natural landscapes.

[0045] Delivery Method

[0046] Server: Stores the generated art and prepares it for distribution to the user's device. The server notifies the user device that the art is ready for distribution.

[0047] Reception and display means

[0048] Device: Receives notification from the server and downloads new art. The device replaces the existing art with the new art and displays it in the frame. For example, a new piece of art will automatically appear in the frame every morning at 8:00 AM.

[0049] Feedback collection methods

[0050] User: Provides feedback on the displayed art. Through a simple interface, users can select and submit feedback such as "like," "average," or "dislike."

[0051] Feedback Analysis Methods

[0052] Device: Collects user feedback and sends it to the server. The server stores the feedback in a database and reflects it in the next art generation. This allows the art generation to gradually improve in accordance with the user's preferences.

[0053] Schedule management tools

[0054] Server: Manages the schedule for generating and delivering art based on the display schedule set by the user. For example, if a user sets "display new art every day at 8:00," the server will trigger the process of generating and delivering art every morning at 8:00.

[0055] Specific examples

[0056] If a user wants to "set it so that new nature scenery art is displayed every morning at 8:00," the user first selects "nature scenery" as the theme and sets the display schedule to "every morning at 8:00." The server saves this setting, and every morning at 8:00, it requests the generation AI to generate "nature scenery" art. The generation AI receives the request and generates new nature scenery art. Once that is complete, the server delivers the generated art to the user's device. The device receives the new art and displays it in the frame. When the user views the art and provides feedback, that feedback is analyzed by the server and reflected in the next art generation.

[0057] This system allows users to easily enjoy new art on a daily basis without incurring high costs or hassle.

[0058] The processing flow will be explained below.

[0059] ---

[0060] Step 1:

[0061] User: Access the dedicated application or website, create an account, enter the required information (name, email address, password, etc.), and press the registration button.

[0062] Step 2:

[0063] Server: Saves the information entered by the user in a database. Sends a message to the user confirming successful registration.

[0064] Step 3:

[0065] User: After logging in, select your preferred theme (e.g., nature landscape, abstract painting, modern art, etc.) and then set the display schedule (e.g., daily, weekly, specific time, etc.).

[0066] Step 4:

[0067] Server: Stores user selections and settings in a database. Calculates the next art generation timing based on the display schedule.

[0068] Step 5:

[0069] Server: Sends art generation requests to the AI ​​according to a set schedule. For example, it requests that new art be generated every morning at 8am.

[0070] Step 6:

[0071] Generative AI: Receives requests and generates new art based on a given theme. Sends the generated art back to the server.

[0072] Step 7:

[0073] Server: The generated art is stored on the server and prepared for distribution to the user's device.

[0074] Step 8:

[0075] Server: Notifies the user device that the art is ready to be delivered. The notification includes a download link for the new art.

[0076] Step 9:

[0077] Device: Receives notifications from the server and downloads new art.

[0078] Step 10:

[0079] On your device: Display the downloaded art in your frame. Replace the existing art with the new art.

[0080] Step 11:

[0081] User: View new art displayed in the frame and provide feedback through a simple interface (e.g., "like," "neutral," "dislike," etc.).

[0082] Step 12:

[0083] Terminal: Collects user feedback and sends it to the server.

[0084] Step 13:

[0085] Server: Stores the received feedback in a database and reflects it in the next art generation.

[0086] Step 14:

[0087] Server: Analyzes user feedback and adjusts the parameters of the generation AI to reflect user preferences in the next art generation.

[0088] Step 15:

[0089] Server: Repeat the process of art generation and distribution based on the next display schedule.

[0090] ---

[0091] Example 1

[0092] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0093] Conventional art appreciation methods require users to select and configure artworks themselves, which is time-consuming and makes it difficult to enjoy new art according to the user's preferences and mood. Furthermore, updating and managing artworks is cumbersome, and there has been no system that generates art that reflects user feedback.

[0094] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0095] In this invention, the server includes a setting means for allowing a user to set a theme and display schedule that the user prefers, a generation means for the server to generate a prompt based on the specified theme and display schedule and generate art using a generative AI model, a distribution means for distributing the generated art to the user's device, a display means for the user's device to receive and display the art distributed from the server, a collection means for collecting user feedback and transmitting it to the server, and an analysis means for the server to analyze the feedback and reflect it in the next art generation. This allows users to automatically and easily enjoy new art according to their preferences, and art that further suits the user's preferences can be provided through the feedback.

[0096] The "user setting means" is a means by which a user accesses the system and sets his / her preferred theme and display schedule.

[0097] The "generation means" is a means by which the server generates prompt sentences based on the theme and display schedule set by the user and generates art using a generative AI model.

[0098] The "distribution means" is a means by which the server distributes the generated art to the user's terminal.

[0099] The "display means" is a means by which the user's terminal receives art distributed from the server and displays it on the display.

[0100] The "feedback collection means" is a means for collecting user feedback and sending it to the server.

[0101] The "feedback analysis means" is a means by which the server analyzes the feedback sent from the user and reflects it in the next art generation.

[0102] The "setting means" refers to means including an interface and software for allowing the user to set the theme and display schedule.

[0103] A "generative AI model" is an artificial intelligence model used by the server to automatically generate art based on a prompt.

[0104] A "prompt" is a text instruction that instructs a generative AI model to generate art based on a specific theme.

[0105] The present invention is a generative AI picture frame system that allows users to enjoy new art every day. The system includes a user setting means, a generation means, a distribution means, a display means, a feedback collection means, and a feedback analysis means.

[0106] User setting method

[0107] User: During initial setup, the user accesses a dedicated application or website and creates an account. The user selects a theme (e.g., nature landscapes, abstract paintings, modern art, etc.) and a display schedule (e.g., daily, weekly, specific time, etc.). This information is sent to the server and saved as a user profile.

[0108] generation means

[0109] Server: Based on the set schedule and theme, the server generates a prompt to be sent to the generative AI model. Based on this prompt, an art piece is generated using a generative AI model (e.g., DALL-E from OpenAI (registered trademark)). For example, if the user selects "natural scenery," the prompt will be "Please generate art depicting a beautiful natural scenery."

[0110] Delivery Method

[0111] Server: Stores the generated art and prepares it for distribution to the user's device. The server notifies the device that the art is ready for distribution and sends the URL and binary data of the generated art.

[0112] Display means

[0113] Device: Receives notification from the server and downloads new art. The device replaces the existing art with the new art and displays the new art on the display at the set time. For example, new nature scenery art will be automatically displayed on the frame every morning at 8:00.

[0114] Feedback collection methods

[0115] User: After viewing the displayed art, the user provides feedback through the application or website. Here, the user selects feedback such as "like," "average," or "dislike" and sends it to the server.

[0116] Feedback Analysis Methods

[0117] Server: Collects and analyzes the feedback sent by users. The analysis results are reflected in the next art generation, gradually providing art that matches the user's preferences. This feedback analysis process improves the accuracy of the art generation algorithm.

[0118] Specific examples

[0119] If a user wants to "set it up so that new nature scenery art is displayed every morning at 8:00," the user first selects "nature scenery" as the theme and sets the display schedule to "every morning at 8:00." The server saves this setting and sends a prompt to the generative AI model shortly before 8:00 each morning: "Please generate art depicting a beautiful nature scenery." The generative AI model receives the request and generates new nature scenery art. Once completed, the server delivers the generated art to the user's device. The device downloads the new art at 8:00 and displays it on the display. When the user views the art and provides feedback, the feedback is analyzed by the server and reflected in the next art generation.

[0120] This system allows users to enjoy new art every day without any effort. Furthermore, the next art generation is adjusted based on user feedback, so the system gradually provides art that matches the user's preferences.

[0121] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0122] Step 1: Account Creation and Initial Settings

[0123] User: During initial setup, access the dedicated application or website, click the "Create a new account" button, enter the required information, and press the submit button. Then, select "Nature Scenery" on the "Theme Selection" screen and "Every morning at 8:00" on the "Schedule Settings" screen. This setting information is sent to the server and saved as a user profile.

[0124] Input: User information (name, email address, etc.), theme selection information, display schedule information.

[0125] Output: User profile stored on the server.

[0126] Step 2: Art Creation Request

[0127] Server: Manages the timing of new art generation based on the display schedule set by the user. For example, if the schedule is set to display new art every morning at 8:00, the server prepares to send a prompt to the generation AI model shortly before that time. The prompt might be, "Please generate art depicting a beautiful natural landscape."

[0128] Input: The user's display schedule information.

[0129] Output: The prompt to send to the generative AI model.

[0130] Step 3: Art generation

[0131] Server: Sends the prompt to the generative AI model. The generative AI model (e.g., DALL-E) generates a new artwork based on the prompt and sends the result back to the server. The returned artwork is stored on the server.

[0132] Input: The prompt statement.

[0133] Output: Art files returned from the generative AI model.

[0134] Step 4: Art Delivery

[0135] Server: Stores the generated art file and prepares it for distribution to the user's device. The server notifies the user device that the art is ready to be distributed and sends the URL and binary data of the art file.

[0136] Input: Generated art files.

[0137] Output: Art file URL, notification message.

[0138] Step 5: Art receiving and display

[0139] Device: Analyzes the notification message received from the server and downloads the image data from the URL of the art file. After the download is complete, the new art replaces the existing art. The device automatically displays the new art on the display at the set time. For example, the latest nature landscape art will be displayed on the frame at 8:00 every morning.

[0140] Input: Art file URL, notification message.

[0141] Output: The new art to be displayed.

[0142] Step 6: Provide feedback

[0143] User: On the application's feedback screen, select "Like," "Average," or "Dislike" for the displayed art, then press the submit button. The feedback is sent to the server.

[0144] Input: User feedback.

[0145] Output: Feedback data sent to the server.

[0146] Step 7: Analyze the feedback

[0147] Server: Collects the received feedback data and stores it in a database. It then analyzes the feedback and reflects it in the next art generation, thereby adjusting the algorithm of the generative AI model to suit the user's preferences.

[0148] Input: Feedback data.

[0149] Output: Parsed feedback, updated parameters of the generative AI model.

[0150] Step 8: Schedule Management

[0151] Server: Manages the timing of the next art generation and distribution based on the display schedule set by the user. For example, if a user requests new art every morning at 8:00, the server automatically executes the process from sending prompts to distribution at that time.

[0152] Input: The user's viewing schedule.

[0153] Output: Sending prompts, generating art and scheduling delivery.

[0154] (Application example 1)

[0155] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0156] In a generative AI painting frame system that allows users to enjoy new art every day, it has been difficult to enhance the personalization of art display and the interactive user experience. Furthermore, there was a need for an efficient method for generating art that reflects user preferences. Furthermore, there was also a challenge in dynamically displaying art in a virtual space, providing an environment in which users could appreciate art with a more immersive feeling.

[0157] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0158] In this invention, the server includes a user setting means for allowing a user to set a theme and display schedule of their choice, an art generation means for the server to use a generative model based on the theme specified by the server, a distribution means for distributing the generated art to the user's terminal, a receiving and display means for the user's terminal to receive and display the art distributed from the server, a feedback collection means for collecting user feedback and transmitting it to the server, a feedback analysis means for the server to analyze the feedback and reflect it in the next art generation, and a virtual display means for displaying art in a virtual space using a head-mounted display. This allows users to immerse themselves in viewing art that suits their preferences in a virtual space and provide interactive feedback.

[0159] The "user setting means" is a function that allows the user to set a theme or display schedule of their choice.

[0160] A "generative model" is an algorithm or system that uses artificial intelligence to automatically generate art based on a specific theme.

[0161] "Art generation means" is a function that generates art using a generative model based on a set theme.

[0162] "Distribution means" is a function that transmits the generated art to the user's terminal.

[0163] The "receiving and displaying means" is a function that allows the user's terminal to receive and display art distributed from the server.

[0164] The "feedback collection means" is a function that allows users to input their evaluations and opinions about art and send them to the server.

[0165] The "feedback analysis means" is a function for analyzing collected user feedback and reflecting it in the next art creation.

[0166] "Virtual display means" is a function for displaying art in a virtual space using a head-mounted display.

[0167] A "prompt" is a textual instruction that gives a generative model specific thematic or stylistic instructions.

[0168] The "schedule management means" is a function that automatically manages the creation and distribution of art based on a display schedule set by the user.

[0169] The system of the present invention is a generative AI painting frame system that allows users to enjoy new art every day. This system includes a user setting unit, an art generation unit using a generative model, a distribution unit, a receiving and display unit, a feedback collection unit, a feedback analysis unit, a virtual display unit, and a schedule management unit.

[0170] User setting method

[0171] Users first create an account using a dedicated application or website, then select their preferred theme (e.g., nature landscapes, abstract paintings, modern art, etc.) and display schedule (e.g., daily, weekly, specific time, etc.), which is then sent to the server and saved as part of the user's settings.

[0172] Art Creation Method

[0173] The server generates art using a generative model based on a schedule set by the user and a selected theme. The generation AI generates an artwork that fits the specified theme and sends the generated art back to the server. For example, if the user selects the theme "natural scenery," the generation AI creates art depicting beautiful natural scenery. An example of a prompt required for generation is "Please generate art of a natural scenery."

[0174] Delivery Method

[0175] The server stores the generated art and prepares it for distribution to the user's terminal. The server notifies the user terminal that the art is ready for distribution.

[0176] Reception and display means

[0177] The user's device receives a notification from the server and downloads the new artwork. The device replaces the existing artwork with the new artwork and displays it in the frame. For example, a new artwork will automatically appear in the frame every morning at 8:00 AM.

[0178] Feedback collection methods

[0179] Users can provide feedback on the displayed art by selecting and submitting feedback such as "like," "average," or "dislike" through a simple interface.

[0180] Feedback Analysis Methods

[0181] The device collects user feedback and sends it to the server, which stores it in a database and reflects it in the next art generation. This allows the art to be generated more accurately based on the user's preferences.

[0182] Virtual Display Means

[0183] The system uses a head-mounted display (HMD) to display new artworks in a virtual space. Users can wear the HMD and explore the virtual gallery. This immersive environment allows users to view art in a more interactive way.

[0184] Schedule management tools

[0185] The server manages the schedule for generating and delivering art based on the display schedule set by the user. For example, if a user sets "display new art every day at 8 o'clock," the server will trigger the process of generating and delivering art every morning at 8 o'clock.

[0186] Specific examples

[0187] If a user wants to "set it so that new nature scenery art is displayed every morning at 8:00," they first select "nature scenery" as the theme and set the display schedule to "every morning at 8:00." The server saves this setting, and every morning at 8:00, it requests the generation AI to generate "nature scenery" art. The generation AI receives the request and generates new nature scenery art. Once generation is complete, the server distributes the generated art to the user's device. The device receives the new art and displays it in a virtual gallery using an HMD. Furthermore, if the user views the art and provides feedback, that feedback is analyzed by the server and reflected in the next art generation.

[0188] This system allows users to easily enjoy new art on a daily basis without incurring high costs or hassle.

[0189] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0190] Step 1:

[0191] User setting method

[0192] A user accesses a dedicated application or website and creates an account. Then, they select their preferred theme (e.g., nature landscapes, abstract paintings, modern art, etc.) and display schedule (e.g., daily, weekly, specific time, etc.). This information is sent as input to the server, which stores it in a user preference database. The output is the user's preference information.

[0193] Step 2:

[0194] Art Creation Method

[0195] The server generates a prompt statement to instruct the generative model based on the theme and display schedule set by the user. An example of a prompt statement is "Please generate art of a natural landscape." This prompt statement is sent as input to the generative AI. The generative AI generates an artwork based on the specified theme, and the generated art is sent back to the server. The output is the generated artwork.

[0196] Step 3:

[0197] Delivery Method

[0198] The server stores the generated art and prepares it for distribution to the user's device. As a distribution method, it sends a notification message containing the art's URL to the user's device. This notification arrives at the device as input, and the art's URL is output.

[0199] Step 4:

[0200] Reception and display means

[0201] The device receives a notification from the server, requests the art URL included in the notification message, and downloads the new art. The device uses this URL as input to retrieve the art data and display it in the frame. The output is a display of the new art.

[0202] Step 5:

[0203] Virtual Display Means

[0204] The user wears a head-mounted display (HMD) and views new art in a virtual space. The device displays a virtual gallery and applies the downloaded art to the environment. The input to this process is the new art data, and the output is the display of the art in the virtual space.

[0205] Step 6:

[0206] Feedback collection methods

[0207] Users provide feedback on the displayed art. Through a simple interface, they select feedback such as "like," "average," or "dislike," and send this as input to the terminal. The terminal then sends this feedback data to the server, and the output is user feedback.

[0208] Step 7:

[0209] Feedback Analysis Methods

[0210] The server receives the feedback data sent from the device and analyzes it using a feedback analysis program. The server updates the parameters of the generative model to reflect the analysis results in the next art generation. The input is user feedback, and the output is the updated parameters of the generative model.

[0211] Step 8:

[0212] Schedule management tools

[0213] The server manages the schedule for generating and distributing art based on the display schedule set by the user. At the time set by the user (e.g., 8:00 a.m. every morning), the server automatically requests the generation AI to generate new art and starts the process of distributing the generated art to the user's device. The input is the user's display schedule, and the output is the execution of generating and distributing new art.

[0214] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0215] ---

[0216] The system of the present invention is a generative AI painting frame system that allows users to enjoy new art every day. The system includes a user setting unit, an art generation unit, a distribution unit, a receiving and display unit, a feedback collection unit, a feedback analysis unit, a schedule management unit, and an emotion engine unit.

[0217] User setting method

[0218] User: During initial setup, access the dedicated application or website to create an account. Enter the required information (name, email address, password, etc.) and press the registration button.

[0219] Server: Stores the information entered by the user in a database and sends the user a message confirming successful registration.

[0220] User: After logging in, select your preferred theme (e.g., nature landscape, abstract painting, modern art, etc.) and then set the display schedule (e.g., daily, weekly, specific time, etc.).

[0221] Server: Saves user selections and settings in a database and calculates the next art generation timing based on the display schedule.

[0222] Art Creation Method

[0223] Server: Sends art generation requests to the AI ​​according to a set schedule, for example, requesting new art to be generated every morning at 8am.

[0224] Generative AI: Receives requests and generates new art based on a given theme. Sends the generated art back to the server.

[0225] Delivery Method

[0226] Server: The generated art is stored on the server and prepared for distribution to the user's device.

[0227] Server: Notifies the user device that the art is ready to be delivered. The notification includes a download link for the new art.

[0228] Reception and display means

[0229] Device: Receives notifications from the server and downloads new art.

[0230] On your device: Display the downloaded art in your frame, replacing the existing art with the new art.

[0231] Feedback collection methods

[0232] User: View new art displayed in the frame and provide feedback through a simple interface (e.g., "like," "neutral," "dislike," etc.).

[0233] Terminal: Collects user feedback and sends it to the server.

[0234] Feedback Analysis Methods

[0235] Server: Stores the received feedback in a database and reflects it in the next art generation.

[0236] Server: Analyzes feedback and adjusts the parameters of the generation AI to reflect user preferences in the next art generation.

[0237] Schedule management tools

[0238] Server: Manages and repeats the art generation and delivery process based on a display schedule set by the user.

[0239] Emotion Engine Means

[0240] Device: Analyzes the user's facial expressions, voice, and body movements to recognize their emotions.

[0241] Server: Receives the emotion recognition results sent from the emotion engine means and stores them in a database.

[0242] Server: Adjusts the customizable parameters of the Generator AI based on the results of emotion recognition. For example, if the user expresses happiness, the Generator AI is instructed to generate art with a bright, positive theme. Conversely, if the user expresses stress, the AI ​​is adjusted to generate art with a more relaxing theme.

[0243] Specific examples

[0244] If a user wants to "set it so that new nature scenery art is displayed every morning at 8:00," the user first selects "nature scenery" as the theme and sets the display schedule to "every morning at 8:00." The server saves this setting, and every morning at 8:00, it requests the generation AI to generate "nature scenery" art. The generation AI receives the request and generates new nature scenery art. Once this is complete, the server delivers the generated art to the user's device. The device receives the new art and displays it in the frame. When the user appreciates the art and provides feedback, the feedback is analyzed by the server and reflected in the next art generation. Furthermore, the emotion engine means recognizes the user's emotions and sends the emotion data to the server, so that the user's emotional state is reflected in the art generation.

[0245] This system not only allows users to easily enjoy new art every day without incurring high costs or hassle, but also provides them with art that matches their emotional state.

[0246] The processing flow will be explained below.

[0247] ---

[0248] Step 1:

[0249] User: Access the dedicated application or website, create an account, enter the required information (name, email address, password, etc.), and press the registration button.

[0250] Step 2:

[0251] Server: Saves the information entered by the user in a database. Sends a message to the user confirming successful registration.

[0252] Step 3:

[0253] User: After logging in, select your preferred theme (e.g., nature landscape, abstract painting, modern art, etc.) and then set the display schedule (e.g., daily, weekly, specific time, etc.).

[0254] Step 4:

[0255] Server: Stores user selections and settings in a database and calculates the next art generation timing based on the display schedule.

[0256] Step 5:

[0257] Server: Sends art generation requests to the AI ​​according to a set schedule, for example, requesting new art to be generated every morning at 8am.

[0258] Step 6:

[0259] Generative AI: Receives requests and generates new art based on a given theme. Sends the generated art back to the server.

[0260] Step 7:

[0261] Server: The generated art is stored on the server and prepared for distribution to the user's device.

[0262] Step 8:

[0263] Server: Notifies the user device that the art is ready to be delivered. The notification includes a download link for the new art.

[0264] Step 9:

[0265] Device: Receives notifications from the server and downloads new art.

[0266] Step 10:

[0267] On your device: Display the downloaded art in your frame, replacing the existing art with the new art.

[0268] Step 11:

[0269] Device: Uses built-in cameras and microphones to analyze the user's facial expressions, voice, and body movements to recognize the user's emotions.

[0270] Step 12:

[0271] Device: Sends the recognized emotion data to the server.

[0272] Step 13:

[0273] User: View new art displayed in the frame and provide feedback through a simple interface (e.g., "like," "neutral," "dislike," etc.).

[0274] Step 14:

[0275] Terminal: Collects user feedback and sends it to the server.

[0276] Step 15:

[0277] Server: Stores the received feedback in a database and reflects it in the next art generation.

[0278] Step 16:

[0279] Server: Receives the emotion recognition results sent from the emotion engine means and stores them in a database.

[0280] Step 17:

[0281] Server: Adjusts customizable parameters of the Generative AI based on the results of emotion recognition. For example, if the user expresses happiness, the Generative AI can be instructed to generate art with a bright, positive theme.

[0282] Step 18:

[0283] Server: Repeat the process of art generation and distribution based on the next display schedule.

[0284] ---

[0285] Example 2

[0286] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0287] Conventional art frame systems have the drawback of requiring users to manually select new art, which is inconvenient. They also have difficulty reflecting user feedback and emotions, making it impossible to provide optimal art for each individual user.

[0288] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0289] In this invention, the server includes a user setting means for a user to set a preferred theme and display schedule, an art generation means for sending an art generation request to the generation AI based on the set display schedule, a generation AI means for the generation AI to generate art based on a prompt text, a distribution means for sending the generated art to the user's terminal, a receiving and display means for the user's terminal to receive and display the art distributed from the server, a feedback collection means for collecting user feedback and sending it to the server, a feedback analysis means for the server to analyze the feedback and reflect it in the next art generation, and an emotion recognition means for recognizing the user's emotions and sending it to the server. This allows users to automatically enjoy optimal art that suits their individual preferences and emotions without having to manually select art.

[0290] The "user setting means" is a means for a user to set a preferred theme and display schedule.

[0291] The "art generation means" is a means by which the server sends an art generation request to the generation AI based on a set display schedule.

[0292] "Generative AI means" refers to the means by which the generative AI generates art based on a prompt.

[0293] The "distribution means" is a means for distributing the generated art to the user's terminal.

[0294] The "receiving and displaying means" is a means by which the user's terminal receives and displays art distributed from the server.

[0295] The "feedback collection means" is a means for collecting user feedback and transmitting it to the server.

[0296] The "feedback analysis means" is a means for analyzing the feedback received by the server and reflecting it in the next art generation.

[0297] The "emotion recognition means" is a means for recognizing the user's emotions and transmitting them to the server.

[0298] The "schedule management means" is a means for automatically managing the process of generating and distributing art based on a display schedule set by the user.

[0299] The system of the present invention is a generative AI picture frame system that allows users to enjoy new art every day. This system includes a user setting unit, an art generation unit, a generative AI unit, a distribution unit, a receiving and display unit, a feedback collection unit, a feedback analysis unit, an emotion recognition unit, and a schedule management unit.

[0300] User setting method

[0301] User: During initial setup, access the dedicated application or website to create an account. Enter the required information (name, email address, password, etc.) and press the registration button.

[0302] Server: Stores the information entered by the user in a database and sends the user a message confirming successful registration.

[0303] User: After logging in, select your preferred theme (e.g., nature landscape, abstract painting, modern art, etc.) and then set the display schedule (e.g., daily, weekly, specific time, etc.).

[0304] Server: Stores user selections and settings in a database and calculates the next art generation timing based on the display schedule.

[0305] Art Creation Method

[0306] Server: Sends art generation requests to the AI ​​according to a set schedule, for example, requesting new art to be generated every morning at 8am.

[0307] Generative AI: Receives requests and generates new art based on a given theme. Sends the generated art back to the server.

[0308] Generation AI means

[0309] Generative AI model: Generates art based on prompts sent from the server. This generative AI model uses an existing database to generate images that correspond to the prompts.

[0310] Delivery Method

[0311] Server: The generated art is stored on the server and prepared for distribution to the user's device.

[0312] Server: Notifies the user device that the art is ready to be delivered. The notification includes a download link for the new art.

[0313] Reception and display means

[0314] Device: Receives notifications from the server and downloads new art.

[0315] On your device: Display the downloaded art in your frame, replacing the existing art with the new art.

[0316] Feedback collection methods

[0317] User: View new art displayed in the frame and provide feedback through a simple interface (e.g., "like," "neutral," "dislike," etc.).

[0318] Terminal: Collects user feedback and sends it to the server.

[0319] Feedback Analysis Methods

[0320] Server: Stores the received feedback in a database and reflects it in the next art generation.

[0321] Server: Analyzes feedback and adjusts the parameters of the generation AI to reflect user preferences in the next art generation.

[0322] emotion recognition means

[0323] Device: Analyzes the user's facial expressions, voice, and body movements to recognize their emotions.

[0324] Server: Receives the emotion recognition results sent from the emotion engine means and stores them in a database.

[0325] Server: Adjusts the customizable parameters of the AI ​​based on the emotion recognition results. For example, if the user expresses happiness, the AI ​​can be instructed to generate art with a bright, positive theme. Conversely, if the user expresses stress, the AI ​​can be adjusted to generate art with a more relaxing theme.

[0326] Schedule management tools

[0327] Server: Manages and repeats the art generation and delivery process based on a display schedule set by the user.

[0328] Specific examples

[0329] If a user wants to "set it so that new nature scenery art is displayed every morning at 8:00," the user first selects "nature scenery" as the theme and sets the display schedule to "every morning at 8:00." The server saves this setting, and every morning at 8:00, it requests the generation AI to generate "nature scenery" art. The generation AI receives the request and generates new nature scenery art. Once this is complete, the server delivers the generated art to the user's device. The device receives the new art and displays it in the frame. When the user appreciates the art and provides feedback, the feedback is analyzed by the server and reflected in the next art generation. Furthermore, the emotion engine means recognizes the user's emotions and sends the emotion data to the server, so that the user's emotional state is reflected in the art generation.

[0330] Prompt Sentence Examples

[0331] "Create a summer morning landscape that incorporates elements of natural scenery. It would be nice to have a slightly refreshing breeze."

[0332] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0333] Step 1: User Setup

[0334] User: Accesses a dedicated application or website and creates an account by entering their name, email address, password, etc., and pressing the registration button.

[0335] Input: User's name, email address, and password

[0336] Output: User information sent to the server

[0337] Server: Receives the information entered by the user and stores it in a database. If registration is successful, sends a confirmation email.

[0338] Input: User information

[0339] Output: Send confirmation email

[0340] Users: You will receive a confirmation email and click the link to activate your account. After logging in, you can set your preferred theme and display schedule.

[0341] Input: Confirmation email link, theme, schedule

[0342] Output: Sends the configuration to the server

[0343] Step 2: Submit an art generation request

[0344] Server: Sends art generation requests to the AI ​​based on a set display schedule. For example, it sends a request to generate new art every morning at 8:00.

[0345] Input: User's theme and schedule settings, current time

[0346] Output: Request to the generation AI

[0347] Step 3: Generate Art

[0348] Generation AI: Receives requests from the server and generates new art based on a prompt (e.g., "Generate a summer morning landscape incorporating natural landscape elements.") and sends the generated art back to the server.

[0349] Input: prompt statement

[0350] Output: Generated art

[0351] Server: Receives the generated art and stores it in a database.

[0352] Input: Generated art

[0353] Output: Save to database

[0354] Step 4: Prepare your art for distribution

[0355] Server: Prepares the generated art for distribution to the user's device. Notifies the user's device that the art is ready for distribution, and the notification includes a download link for the new art.

[0356] Input: Art stored in the database

[0357] Output: Delivery notification

[0358] Step 5: Receive and display your art

[0359] Device: Receives notification from the server, downloads new art, and displays the new art in the Smart Art Frame after the download is complete.

[0360] Input: Delivery notification, download link

[0361] Output: Display of new art

[0362] Step 6: Gather feedback

[0363] Users: Use a simple interface to view new art and provide feedback, for example by pressing buttons such as "like," "neutral," or "dislike."

[0364] Input: Feedback (like, neutral, dislike)

[0365] Output: Send feedback to the device

[0366] Terminal: Receives user feedback and sends it to the server.

[0367] Input: User feedback

[0368] Output: Send feedback to the server

[0369] Step 7: Analyze feedback

[0370] Server: Receives feedback data and stores it in a database. Analyzes the feedback and adjusts the parameters of the generation AI to reflect the user's preferences the next time art is generated.

[0371] Input: Feedback data

[0372] Output: Analysis results and new parameter settings for the generated AI

[0373] Step 8: Emotion Recognition

[0374] Device: Analyzes the user's facial expressions, voice, and body movements to recognize emotions. Captures data using a camera and microphone.

[0375] Input: Facial expressions, voice, body movements

[0376] Output: Emotion data

[0377] Server: Receives emotion data and stores it in a database. Based on this data, the parameters of the AI ​​are adjusted to generate art that matches the user's emotional state.

[0378] Input: Emotion data

[0379] Output: New parameter settings for the generated AI

[0380] The above is a description of the specific processing flow of each step, the specific operations performed at each step, and the inputs and outputs.

[0381] (Application example 2)

[0382] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0383] Conventional displays and signage art in brick-and-mortar stores have the drawback of being time-consuming and expensive to frequently change once-installed content, making it difficult to provide a personalized experience that matches the customer's expressions and emotions. This invention solves these challenges and provides a method for providing a more personalized and engaging store experience by dynamically generating and displaying art based on customer feedback and emotional data.

[0384] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a user setting means for a user to set a preferred theme and display schedule; an art generation means for the server to generate art based on the specified theme; a distribution means for distributing the generated art to the user's terminal; a receiving and display means for the user's terminal to receive and display the art distributed from the server; a feedback collection means for collecting user feedback and transmitting it to the server; a feedback analysis means for the server to analyze the feedback and reflect it in the next art generation; an emotion engine means for analyzing customers' facial expressions, voices, and body movements to collect emotion data; and a display means for displaying art on an in-store display or digital signage. This makes it possible to dynamically and personally change the display content in a physical store and display attractive art based on customer interactions.

[0385] The "user setting means" is a means for a user to set a preferred theme and display schedule.

[0386] The "art generation means" is a means by which the server generates art based on a specified theme.

[0387] The "distribution means" is a means for distributing the generated art to the user's terminal.

[0388] The "receiving and displaying means" is a means by which the user's terminal receives and displays art distributed from the server.

[0389] The "feedback collection means" is a means for collecting user feedback and sending it to the server.

[0390] The "feedback analysis means" is a means by which the server analyzes the feedback and reflects it in the next art generation.

[0391] The "emotion engine means" is a means for analyzing the facial expressions, voice, and body movements of the customer to collect emotional data.

[0392] "Display means" refers to a means for displaying art on an in-store display or digital signage.

[0393] The present invention is a system that enables dynamic art display based on customer feedback and emotional data in physical stores. This system is composed of several tools, each of which plays a specific role.

[0394] User setting method

[0395] User: The store manager first creates an account in a dedicated management application and sets their preferred theme (e.g., modern art, abstract paintings, etc.) and display schedule (e.g., refresh every morning at 10 a.m.). This setting information is sent to the server and stored in a database.

[0396] Art Creation Method

[0397] Server: Based on a set schedule, it sends art generation requests to a generative AI model (e.g., GPT-4 (registered trademark) image generation engine). The generative AI generates new art based on the specified theme and sends the generated results back to the server.

[0398] Delivery Method

[0399] Server: Stores the generated artwork in cloud storage, generates a URL link to distribute it to the user's device, and notifies the display device in the store of this link, preparing the artwork for display.

[0400] Reception and display means

[0401] Terminal: The display device receives the URL link sent from the server, downloads the new art, and displays it. Once the display is complete, the new art replaces the existing art.

[0402] Feedback collection methods

[0403] Users and devices: Customer feedback is collected through camera sensors and survey terminals installed around the displays in the store. Feedback includes simple evaluations (e.g., "like," "average," "dislike," etc.). This feedback data is sent to the server.

[0404] Feedback Analysis Methods

[0405] Server: The feedback data is stored in a database and analyzed using machine learning tools (e.g., Scikit-learn) to reflect it in the next art generation. The parameters of the generation AI are adjusted based on the analysis results.

[0406] Emotion Engine Means

[0407] Terminal: Emotional data is collected using image recognition technology (e.g., OpenCV) to analyze the customer's facial expressions, voice, and physical movements. The collected emotional data is sent to the server and is reflected in the next art generation.

[0408] Display Means

[0409] Terminal: In-store displays or digital signage display the art delivered from the server for customers to view. The displayed art changes dynamically based on collected feedback and sentiment data.

[0410] Specific examples

[0411] If a store manager sets the theme to "modern art" and schedules new art to be displayed every morning at 10:00, they will first send a prompt to GPT-4 to generate a "modern art digital painting."

[0412] Example prompt: "Generate a modern art style digital painting with vibrant colors and abstract shapes."

[0413] The generated art is displayed on displays within the store, where customers can view it. Customers provide feedback on their impressions through questionnaires and facial expression analysis, and this data is reflected in the next art generation. This ensures that the in-store display content is always up-to-date and personalized, improving the customer experience.

[0414] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0415] Program Processing Steps

[0416] Step 1:

[0417] Input: Store managers create an account using a dedicated management application and input their preferred themes and display schedules.

[0418] Data processing: The management application converts the input data into a format suitable for storage in the database.

[0419] Output: The server receives these data and stores them in a database.

[0420] Specific operation: The store manager sets the theme "Modern Art" and the display schedule "Every morning at 10:00" in the management app, and sends the setting information to the server. The server saves the setting data in the database.

[0421] Step 2:

[0422] Input: Based on the display schedule, the server knows that the next display update is approaching.

[0423] Data processing: The server reads the saved configuration information and generates prompts to be given to the generative AI model.

[0424] Output: Sends a new art generation request to the generative AI model.

[0425] Specific operation: The server prepares a prompt to generate a "modern art digital painting" based on a schedule and sends it to the generation AI.

[0426] Example prompt: "Generate a modern art style digital painting with vibrant colors and abstract shapes."

[0427] Step 3:

[0428] Input: A generative AI model receives a prompt and generates new art.

[0429] Data calculation: The generative AI model generates image data based on the specified theme and prompt.

[0430] Output: Send the generated art back to the server.

[0431] Specific operation: A generative AI model (e.g., GPT-4) generates modern art based on instructions and sends the image data to a server.

[0432] Step 4:

[0433] Input: The server receives the generated art.

[0434] Data processing: Save the generated art to cloud storage and generate a URL link.

[0435] Output: Sends the URL link to the store's display terminal.

[0436] Specific operation: The server saves the generated art in cloud storage, generates a URL for it, and sends it to the store's display terminal.

[0437] Step 5:

[0438] Input: The display device receives the URL link sent from the server.

[0439] Data processing: The display device downloads new art from the link.

[0440] Output: The downloaded art is displayed on the screen.

[0441] What happens: The display device receives the URL for the new art, downloads it, and displays it, replacing the existing art with the new art.

[0442] Step 6:

[0443] Input: Customers view the displayed art and provide feedback via survey terminals or camera sensors.

[0444] Data processing: Feedback is converted into digital format and sent to a server.

[0445] Output: The collected feedback data is stored on the server.

[0446] Specific operation: Customers use a survey terminal to select "like," "neutral," or "dislike," or the camera sensor recognizes facial expressions and automatically collects feedback.

[0447] Step 7:

[0448] Input: The server receives the collected feedback data.

[0449] Data calculation: Stored in a database and analyzed using machine learning tools (e.g., Scikit-learn).

[0450] Output: The analysis results are reflected in the next parameter setting of the generative AI model.

[0451] How it works: The server saves the feedback data and analyzes it with an analysis tool. Based on the analysis results, the parameters of the next piece of art generated by the AI ​​are adjusted.

[0452] Step 8:

[0453] Input: Real-time analysis of customer facial expressions and behavior is performed by camera sensors.

[0454] Data calculation: Image recognition tools (e.g., OpenCV) analyze facial expressions and behaviors to generate emotion data.

[0455] Output: Emotion data is sent to the server and stored.

[0456] How it works: Cameras installed in stores capture customers' facial expressions, and an analysis tool generates emotional data, which is then sent to a server and stored in a database.

[0457] This detailed processing step allows in-store displays to dynamically update based on customer feedback and sentiment, providing a personalized art experience.

[0458] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0459] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0460] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0461] [Second embodiment]

[0462] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0463] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0464] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0465] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0466] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0467] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0468] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0469] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0470] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0471] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0472] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0473] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0474] ---

[0475] The system of the present invention is a generative AI picture frame system that allows users to enjoy new art every day. This system includes a user setting means, an art generation means, a distribution means, a receiving and displaying means, a feedback collection means, a feedback analysis means, and a schedule management means.

[0476] User setting method

[0477] User: During initial setup, the user accesses a dedicated application or website and creates an account. The user selects a theme (e.g., nature landscapes, abstract paintings, modern art, etc.) and a display schedule (e.g., daily, weekly, specific time, etc.). This information is sent to the server and saved as part of the user settings.

[0478] Art Creation Method

[0479] Server: Starts the process of generating art based on the set schedule and the selected theme. The generation AI generates an art piece that fits the specified theme and sends the generated art back to the server. For example, if the user selects "nature landscapes," the generation AI creates art depicting beautiful natural landscapes.

[0480] Delivery Method

[0481] Server: Stores the generated art and prepares it for distribution to the user's device. The server notifies the user device that the art is ready for distribution.

[0482] Reception and display means

[0483] Device: Receives notification from the server and downloads new art. The device replaces the existing art with the new art and displays it in the frame. For example, a new piece of art will automatically appear in the frame every morning at 8:00 AM.

[0484] Feedback collection methods

[0485] User: Provides feedback on the displayed art. Through a simple interface, users can select and submit feedback such as "like," "average," or "dislike."

[0486] Feedback Analysis Methods

[0487] Device: Collects user feedback and sends it to the server. The server stores the feedback in a database and reflects it in the next art generation. This allows the art generation to gradually improve in accordance with the user's preferences.

[0488] Schedule management tools

[0489] Server: Manages the schedule for generating and delivering art based on the display schedule set by the user. For example, if a user sets "display new art every day at 8:00," the server will trigger the process of generating and delivering art every morning at 8:00.

[0490] Specific examples

[0491] If a user wants to "set it so that new nature scenery art is displayed every morning at 8:00," the user first selects "nature scenery" as the theme and sets the display schedule to "every morning at 8:00." The server saves this setting, and every morning at 8:00, it requests the generation AI to generate "nature scenery" art. The generation AI receives the request and generates new nature scenery art. Once that is complete, the server delivers the generated art to the user's device. The device receives the new art and displays it in the frame. When the user views the art and provides feedback, that feedback is analyzed by the server and reflected in the next art generation.

[0492] This system allows users to easily enjoy new art on a daily basis without incurring high costs or hassle.

[0493] The processing flow will be explained below.

[0494] ---

[0495] Step 1:

[0496] User: Access the dedicated application or website, create an account, enter the required information (name, email address, password, etc.), and press the registration button.

[0497] Step 2:

[0498] Server: Saves the information entered by the user in a database. Sends a message to the user confirming successful registration.

[0499] Step 3:

[0500] User: After logging in, select your preferred theme (e.g., nature landscape, abstract painting, modern art, etc.) and then set the display schedule (e.g., daily, weekly, specific time, etc.).

[0501] Step 4:

[0502] Server: Stores user selections and settings in a database. Calculates the next art generation timing based on the display schedule.

[0503] Step 5:

[0504] Server: Sends art generation requests to the AI ​​according to a set schedule. For example, it requests that new art be generated every morning at 8am.

[0505] Step 6:

[0506] Generative AI: Receives requests and generates new art based on a given theme. Sends the generated art back to the server.

[0507] Step 7:

[0508] Server: The generated art is stored on the server and prepared for distribution to the user's device.

[0509] Step 8:

[0510] Server: Notifies the user device that the art is ready to be delivered. The notification includes a download link for the new art.

[0511] Step 9:

[0512] Device: Receives notifications from the server and downloads new art.

[0513] Step 10:

[0514] On your device: Display the downloaded art in your frame. Replace the existing art with the new art.

[0515] Step 11:

[0516] User: View new art displayed in the frame and provide feedback through a simple interface (e.g., "like," "neutral," "dislike," etc.).

[0517] Step 12:

[0518] Terminal: Collects user feedback and sends it to the server.

[0519] Step 13:

[0520] Server: Stores the received feedback in a database and reflects it in the next art generation.

[0521] Step 14:

[0522] Server: Analyzes user feedback and adjusts the parameters of the generation AI to reflect user preferences in the next art generation.

[0523] Step 15:

[0524] Server: Repeat the process of art generation and distribution based on the next display schedule.

[0525] ---

[0526] Example 1

[0527] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0528] Conventional art appreciation methods require users to select and configure artworks themselves, which is time-consuming and makes it difficult to enjoy new art according to the user's preferences and mood. Furthermore, updating and managing artworks is cumbersome, and there has been no system that generates art that reflects user feedback.

[0529] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0530] In this invention, the server includes a setting means for allowing a user to set a theme and display schedule that the user prefers, a generation means for the server to generate a prompt based on the specified theme and display schedule and generate art using a generative AI model, a distribution means for distributing the generated art to the user's device, a display means for the user's device to receive and display the art distributed from the server, a collection means for collecting user feedback and transmitting it to the server, and an analysis means for the server to analyze the feedback and reflect it in the next art generation. This allows users to automatically and easily enjoy new art according to their preferences, and art that further suits the user's preferences can be provided through the feedback.

[0531] The "user setting means" is a means by which a user accesses the system and sets his / her preferred theme and display schedule.

[0532] The "generation means" is a means by which the server generates prompt sentences based on the theme and display schedule set by the user and generates art using a generative AI model.

[0533] The "distribution means" is a means by which the server distributes the generated art to the user's terminal.

[0534] The "display means" is a means by which the user's terminal receives art distributed from the server and displays it on the display.

[0535] The "feedback collection means" is a means for collecting user feedback and sending it to the server.

[0536] The "feedback analysis means" is a means by which the server analyzes the feedback sent from the user and reflects it in the next art generation.

[0537] The "setting means" refers to means including an interface and software for allowing the user to set the theme and display schedule.

[0538] A "generative AI model" is an artificial intelligence model used by the server to automatically generate art based on a prompt.

[0539] A "prompt" is a text instruction that instructs a generative AI model to generate art based on a specific theme.

[0540] The present invention is a generative AI picture frame system that allows users to enjoy new art every day. The system includes a user setting means, a generation means, a distribution means, a display means, a feedback collection means, and a feedback analysis means.

[0541] User setting method

[0542] User: During initial setup, the user accesses a dedicated application or website and creates an account. The user selects a theme (e.g., nature landscapes, abstract paintings, modern art, etc.) and a display schedule (e.g., daily, weekly, specific time, etc.). This information is sent to the server and saved as a user profile.

[0543] generation means

[0544] Server: Based on the set schedule and theme, the server generates a prompt to be sent to the generative AI model. Based on this prompt, a generative AI model (e.g., OpenAI's DALL-E) is used to generate an artwork. For example, if the user selects "nature scenery," the prompt will be "Please generate art depicting a beautiful nature scene."

[0545] Delivery Method

[0546] Server: Stores the generated art and prepares it for distribution to the user's device. The server notifies the device that the art is ready for distribution and sends the URL and binary data of the generated art.

[0547] Display means

[0548] Device: Receives notification from the server and downloads new art. The device replaces the existing art with the new art and displays the new art on the display at the set time. For example, new nature scenery art will be automatically displayed on the frame every morning at 8:00.

[0549] Feedback collection methods

[0550] User: After viewing the displayed art, the user provides feedback through the application or website. Here, the user selects feedback such as "like," "average," or "dislike" and sends it to the server.

[0551] Feedback Analysis Methods

[0552] Server: Collects and analyzes the feedback sent by users. The analysis results are reflected in the next art generation, gradually providing art that matches the user's preferences. This feedback analysis process improves the accuracy of the art generation algorithm.

[0553] Specific examples

[0554] If a user wants to "set it up so that new nature scenery art is displayed every morning at 8:00," the user first selects "nature scenery" as the theme and sets the display schedule to "every morning at 8:00." The server saves this setting and sends a prompt to the generative AI model shortly before 8:00 each morning: "Please generate art depicting a beautiful nature scenery." The generative AI model receives the request and generates new nature scenery art. Once completed, the server delivers the generated art to the user's device. The device downloads the new art at 8:00 and displays it on the display. When the user views the art and provides feedback, the feedback is analyzed by the server and reflected in the next art generation.

[0555] This system allows users to enjoy new art every day without any effort. Furthermore, the next art generation is adjusted based on user feedback, so the system gradually provides art that matches the user's preferences.

[0556] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0557] Step 1: Account Creation and Initial Settings

[0558] User: During initial setup, access the dedicated application or website, click the "Create a new account" button, enter the required information, and press the submit button. Then, select "Nature Scenery" on the "Theme Selection" screen and "Every morning at 8:00" on the "Schedule Settings" screen. This setting information is sent to the server and saved as a user profile.

[0559] Input: User information (name, email address, etc.), theme selection information, display schedule information.

[0560] Output: User profile stored on the server.

[0561] Step 2: Art Creation Request

[0562] Server: Manages the timing of new art generation based on the display schedule set by the user. For example, if the schedule is set to display new art every morning at 8:00, the server prepares to send a prompt to the generation AI model shortly before that time. The prompt might be, "Please generate art depicting a beautiful natural landscape."

[0563] Input: The user's display schedule information.

[0564] Output: The prompt to send to the generative AI model.

[0565] Step 3: Art generation

[0566] Server: Sends the prompt to the generative AI model. The generative AI model (e.g., DALL-E) generates a new artwork based on the prompt and sends the result back to the server. The returned artwork is stored on the server.

[0567] Input: The prompt statement.

[0568] Output: Art files returned from the generative AI model.

[0569] Step 4: Art Delivery

[0570] Server: Stores the generated art file and prepares it for distribution to the user's device. The server notifies the user device that the art is ready to be distributed and sends the URL and binary data of the art file.

[0571] Input: Generated art files.

[0572] Output: Art file URL, notification message.

[0573] Step 5: Art receiving and display

[0574] Device: Analyzes the notification message received from the server and downloads the image data from the URL of the art file. After the download is complete, the new art replaces the existing art. The device automatically displays the new art on the display at the set time. For example, the latest nature landscape art will be displayed on the frame at 8:00 every morning.

[0575] Input: Art file URL, notification message.

[0576] Output: The new art to be displayed.

[0577] Step 6: Provide feedback

[0578] User: On the application's feedback screen, select "Like," "Average," or "Dislike" for the displayed art, then press the submit button. The feedback is sent to the server.

[0579] Input: User feedback.

[0580] Output: Feedback data sent to the server.

[0581] Step 7: Analyze the feedback

[0582] Server: Collects the received feedback data and stores it in a database. It then analyzes the feedback and reflects it in the next art generation, thereby adjusting the algorithm of the generative AI model to suit the user's preferences.

[0583] Input: Feedback data.

[0584] Output: Parsed feedback, updated parameters of the generative AI model.

[0585] Step 8: Schedule Management

[0586] Server: Manages the timing of the next art generation and distribution based on the display schedule set by the user. For example, if a user requests new art every morning at 8:00, the server automatically executes the process from sending prompts to distribution at that time.

[0587] Input: The user's viewing schedule.

[0588] Output: Sending prompts, generating art and scheduling delivery.

[0589] (Application example 1)

[0590] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0591] In a generative AI painting frame system that allows users to enjoy new art every day, it has been difficult to enhance the personalization of art display and the interactive user experience. Furthermore, there was a need for an efficient method for generating art that reflects user preferences. Furthermore, there was also a challenge in dynamically displaying art in a virtual space, providing an environment in which users could appreciate art with a more immersive feeling.

[0592] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0593] In this invention, the server includes a user setting means for allowing a user to set a theme and display schedule of their choice, an art generation means for the server to use a generative model based on the theme specified by the server, a distribution means for distributing the generated art to the user's terminal, a receiving and display means for the user's terminal to receive and display the art distributed from the server, a feedback collection means for collecting user feedback and transmitting it to the server, a feedback analysis means for the server to analyze the feedback and reflect it in the next art generation, and a virtual display means for displaying art in a virtual space using a head-mounted display. This allows users to immerse themselves in viewing art that suits their preferences in a virtual space and provide interactive feedback.

[0594] The "user setting means" is a function that allows the user to set a theme or display schedule of their choice.

[0595] A "generative model" is an algorithm or system that uses artificial intelligence to automatically generate art based on a specific theme.

[0596] "Art generation means" is a function that generates art using a generative model based on a set theme.

[0597] "Distribution means" is a function that transmits the generated art to the user's terminal.

[0598] The "receiving and displaying means" is a function that allows the user's terminal to receive and display art distributed from the server.

[0599] The "feedback collection means" is a function that allows users to input their evaluations and opinions about art and send them to the server.

[0600] The "feedback analysis means" is a function for analyzing collected user feedback and reflecting it in the next art creation.

[0601] "Virtual display means" is a function for displaying art in a virtual space using a head-mounted display.

[0602] A "prompt" is a textual instruction that gives a generative model specific thematic or stylistic instructions.

[0603] The "schedule management means" is a function that automatically manages the creation and distribution of art based on a display schedule set by the user.

[0604] The system of the present invention is a generative AI painting frame system that allows users to enjoy new art every day. This system includes a user setting unit, an art generation unit using a generative model, a distribution unit, a receiving and display unit, a feedback collection unit, a feedback analysis unit, a virtual display unit, and a schedule management unit.

[0605] User setting method

[0606] Users first create an account using a dedicated application or website, then select their preferred theme (e.g., nature landscapes, abstract paintings, modern art, etc.) and display schedule (e.g., daily, weekly, specific time, etc.), which is then sent to the server and saved as part of the user's settings.

[0607] Art Creation Method

[0608] The server generates art using a generative model based on a schedule set by the user and a selected theme. The generation AI generates an artwork that fits the specified theme and sends the generated art back to the server. For example, if the user selects the theme "natural scenery," the generation AI creates art depicting beautiful natural scenery. An example of a prompt required for generation is "Please generate art of a natural scenery."

[0609] Delivery Method

[0610] The server stores the generated art and prepares it for distribution to the user's terminal. The server notifies the user terminal that the art is ready for distribution.

[0611] Reception and display means

[0612] The user's device receives a notification from the server and downloads the new artwork. The device replaces the existing artwork with the new artwork and displays it in the frame. For example, a new artwork will automatically appear in the frame every morning at 8:00 AM.

[0613] Feedback collection methods

[0614] Users can provide feedback on the displayed art by selecting and submitting feedback such as "like," "average," or "dislike" through a simple interface.

[0615] Feedback Analysis Methods

[0616] The device collects user feedback and sends it to the server, which stores it in a database and reflects it in the next art generation. This allows the art to be generated more accurately based on the user's preferences.

[0617] Virtual Display Means

[0618] The system uses a head-mounted display (HMD) to display new artworks in a virtual space. Users can wear the HMD and explore the virtual gallery. This immersive environment allows users to view art in a more interactive way.

[0619] Schedule management tools

[0620] The server manages the schedule for generating and delivering art based on the display schedule set by the user. For example, if a user sets "display new art every day at 8 o'clock," the server will trigger the process of generating and delivering art every morning at 8 o'clock.

[0621] Specific examples

[0622] If a user wants to "set it so that new nature scenery art is displayed every morning at 8:00," they first select "nature scenery" as the theme and set the display schedule to "every morning at 8:00." The server saves this setting, and every morning at 8:00, it requests the generation AI to generate "nature scenery" art. The generation AI receives the request and generates new nature scenery art. Once generation is complete, the server distributes the generated art to the user's device. The device receives the new art and displays it in a virtual gallery using an HMD. Furthermore, if the user views the art and provides feedback, that feedback is analyzed by the server and reflected in the next art generation.

[0623] This system allows users to easily enjoy new art on a daily basis without incurring high costs or hassle.

[0624] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0625] Step 1:

[0626] User setting method

[0627] A user accesses a dedicated application or website and creates an account. Then, they select their preferred theme (e.g., nature landscapes, abstract paintings, modern art, etc.) and display schedule (e.g., daily, weekly, specific time, etc.). This information is sent as input to the server, which stores it in a user preference database. The output is the user's preference information.

[0628] Step 2:

[0629] Art Creation Method

[0630] The server generates a prompt statement to instruct the generative model based on the theme and display schedule set by the user. An example of a prompt statement is "Please generate art of a natural landscape." This prompt statement is sent as input to the generative AI. The generative AI generates an artwork based on the specified theme, and the generated art is sent back to the server. The output is the generated artwork.

[0631] Step 3:

[0632] Delivery Method

[0633] The server stores the generated art and prepares it for distribution to the user's device. As a distribution method, it sends a notification message containing the art's URL to the user's device. This notification arrives at the device as input, and the art's URL is output.

[0634] Step 4:

[0635] Reception and display means

[0636] The device receives a notification from the server, requests the art URL included in the notification message, and downloads the new art. The device uses this URL as input to retrieve the art data and display it in the frame. The output is a display of the new art.

[0637] Step 5:

[0638] Virtual Display Means

[0639] The user wears a head-mounted display (HMD) and views new art in a virtual space. The device displays a virtual gallery and applies the downloaded art to the environment. The input to this process is the new art data, and the output is the display of the art in the virtual space.

[0640] Step 6:

[0641] Feedback collection methods

[0642] Users provide feedback on the displayed art. Through a simple interface, they select feedback such as "like," "average," or "dislike," and send this as input to the terminal. The terminal then sends this feedback data to the server, and the output is user feedback.

[0643] Step 7:

[0644] Feedback Analysis Methods

[0645] The server receives the feedback data sent from the device and analyzes it using a feedback analysis program. The server updates the parameters of the generative model to reflect the analysis results in the next art generation. The input is user feedback, and the output is the updated parameters of the generative model.

[0646] Step 8:

[0647] Schedule management tools

[0648] The server manages the schedule for generating and distributing art based on the display schedule set by the user. At the time set by the user (e.g., 8:00 a.m. every morning), the server automatically requests the generation AI to generate new art and starts the process of distributing the generated art to the user's device. The input is the user's display schedule, and the output is the execution of generating and distributing new art.

[0649] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0650] ---

[0651] The system of the present invention is a generative AI painting frame system that allows users to enjoy new art every day. The system includes a user setting unit, an art generation unit, a distribution unit, a receiving and display unit, a feedback collection unit, a feedback analysis unit, a schedule management unit, and an emotion engine unit.

[0652] User setting method

[0653] User: During initial setup, access the dedicated application or website to create an account. Enter the required information (name, email address, password, etc.) and press the registration button.

[0654] Server: Stores the information entered by the user in a database and sends the user a message confirming successful registration.

[0655] User: After logging in, select your preferred theme (e.g., nature landscape, abstract painting, modern art, etc.) and then set the display schedule (e.g., daily, weekly, specific time, etc.).

[0656] Server: Saves user selections and settings in a database and calculates the next art generation timing based on the display schedule.

[0657] Art Creation Method

[0658] Server: Sends art generation requests to the AI ​​according to a set schedule, for example, requesting new art to be generated every morning at 8am.

[0659] Generative AI: Receives requests and generates new art based on a given theme. Sends the generated art back to the server.

[0660] Delivery Method

[0661] Server: The generated art is stored on the server and prepared for distribution to the user's device.

[0662] Server: Notifies the user device that the art is ready to be delivered. The notification includes a download link for the new art.

[0663] Reception and display means

[0664] Device: Receives notifications from the server and downloads new art.

[0665] On your device: Display the downloaded art in your frame, replacing the existing art with the new art.

[0666] Feedback collection methods

[0667] User: View new art displayed in the frame and provide feedback through a simple interface (e.g., "like," "neutral," "dislike," etc.).

[0668] Terminal: Collects user feedback and sends it to the server.

[0669] Feedback Analysis Methods

[0670] Server: Stores the received feedback in a database and reflects it in the next art generation.

[0671] Server: Analyzes feedback and adjusts the parameters of the generation AI to reflect user preferences in the next art generation.

[0672] Schedule management tools

[0673] Server: Manages and repeats the art generation and delivery process based on a display schedule set by the user.

[0674] Emotion Engine Means

[0675] Device: Analyzes the user's facial expressions, voice, and body movements to recognize their emotions.

[0676] Server: Receives the emotion recognition results sent from the emotion engine means and stores them in a database.

[0677] Server: Adjusts the customizable parameters of the Generator AI based on the results of emotion recognition. For example, if the user expresses happiness, the Generator AI is instructed to generate art with a bright, positive theme. Conversely, if the user expresses stress, the AI ​​is adjusted to generate art with a more relaxing theme.

[0678] Specific examples

[0679] If a user wants to "set it so that new nature scenery art is displayed every morning at 8:00," the user first selects "nature scenery" as the theme and sets the display schedule to "every morning at 8:00." The server saves this setting, and every morning at 8:00, it requests the generation AI to generate "nature scenery" art. The generation AI receives the request and generates new nature scenery art. Once this is complete, the server delivers the generated art to the user's device. The device receives the new art and displays it in the frame. When the user appreciates the art and provides feedback, the feedback is analyzed by the server and reflected in the next art generation. Furthermore, the emotion engine means recognizes the user's emotions and sends the emotion data to the server, so that the user's emotional state is reflected in the art generation.

[0680] This system not only allows users to easily enjoy new art every day without incurring high costs or hassle, but also provides them with art that matches their emotional state.

[0681] The processing flow will be explained below.

[0682] ---

[0683] Step 1:

[0684] User: Access the dedicated application or website, create an account, enter the required information (name, email address, password, etc.), and press the registration button.

[0685] Step 2:

[0686] Server: Saves the information entered by the user in a database. Sends a message to the user confirming successful registration.

[0687] Step 3:

[0688] User: After logging in, select your preferred theme (e.g., nature landscape, abstract painting, modern art, etc.) and then set the display schedule (e.g., daily, weekly, specific time, etc.).

[0689] Step 4:

[0690] Server: Stores user selections and settings in a database and calculates the next art generation timing based on the display schedule.

[0691] Step 5:

[0692] Server: Sends art generation requests to the AI ​​according to a set schedule, for example, requesting new art to be generated every morning at 8am.

[0693] Step 6:

[0694] Generative AI: Receives requests and generates new art based on a given theme. Sends the generated art back to the server.

[0695] Step 7:

[0696] Server: The generated art is stored on the server and prepared for distribution to the user's device.

[0697] Step 8:

[0698] Server: Notifies the user device that the art is ready to be delivered. The notification includes a download link for the new art.

[0699] Step 9:

[0700] Device: Receives notifications from the server and downloads new art.

[0701] Step 10:

[0702] On your device: Display the downloaded art in your frame, replacing the existing art with the new art.

[0703] Step 11:

[0704] Device: Uses built-in cameras and microphones to analyze the user's facial expressions, voice, and body movements to recognize the user's emotions.

[0705] Step 12:

[0706] Device: Sends the recognized emotion data to the server.

[0707] Step 13:

[0708] User: View new art displayed in the frame and provide feedback through a simple interface (e.g., "like," "neutral," "dislike," etc.).

[0709] Step 14:

[0710] Terminal: Collects user feedback and sends it to the server.

[0711] Step 15:

[0712] Server: Stores the received feedback in a database and reflects it in the next art generation.

[0713] Step 16:

[0714] Server: Receives the emotion recognition results sent from the emotion engine means and stores them in a database.

[0715] Step 17:

[0716] Server: Adjusts customizable parameters of the Generative AI based on the results of emotion recognition. For example, if the user expresses happiness, the Generative AI can be instructed to generate art with a bright, positive theme.

[0717] Step 18:

[0718] Server: Repeat the process of art generation and distribution based on the next display schedule.

[0719] ---

[0720] Example 2

[0721] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0722] Conventional art frame systems have the drawback of requiring users to manually select new art, which is inconvenient. They also have difficulty reflecting user feedback and emotions, making it impossible to provide optimal art for each individual user.

[0723] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0724] In this invention, the server includes a user setting means for a user to set a preferred theme and display schedule, an art generation means for sending an art generation request to the generation AI based on the set display schedule, a generation AI means for the generation AI to generate art based on a prompt text, a distribution means for sending the generated art to the user's terminal, a receiving and display means for the user's terminal to receive and display the art distributed from the server, a feedback collection means for collecting user feedback and sending it to the server, a feedback analysis means for the server to analyze the feedback and reflect it in the next art generation, and an emotion recognition means for recognizing the user's emotions and sending it to the server. This allows users to automatically enjoy optimal art that suits their individual preferences and emotions without having to manually select art.

[0725] The "user setting means" is a means for a user to set a preferred theme and display schedule.

[0726] The "art generation means" is a means by which the server sends an art generation request to the generation AI based on a set display schedule.

[0727] "Generative AI means" refers to the means by which the generative AI generates art based on a prompt.

[0728] The "distribution means" is a means for distributing the generated art to the user's terminal.

[0729] The "receiving and displaying means" is a means by which the user's terminal receives and displays art distributed from the server.

[0730] The "feedback collection means" is a means for collecting user feedback and transmitting it to the server.

[0731] The "feedback analysis means" is a means for analyzing the feedback received by the server and reflecting it in the next art generation.

[0732] The "emotion recognition means" is a means for recognizing the user's emotions and transmitting them to the server.

[0733] The "schedule management means" is a means for automatically managing the process of generating and distributing art based on a display schedule set by the user.

[0734] The system of the present invention is a generative AI picture frame system that allows users to enjoy new art every day. This system includes a user setting unit, an art generation unit, a generative AI unit, a distribution unit, a receiving and display unit, a feedback collection unit, a feedback analysis unit, an emotion recognition unit, and a schedule management unit.

[0735] User setting method

[0736] User: During initial setup, access the dedicated application or website to create an account. Enter the required information (name, email address, password, etc.) and press the registration button.

[0737] Server: Stores the information entered by the user in a database and sends the user a message confirming successful registration.

[0738] User: After logging in, select your preferred theme (e.g., nature landscape, abstract painting, modern art, etc.) and then set the display schedule (e.g., daily, weekly, specific time, etc.).

[0739] Server: Stores user selections and settings in a database and calculates the next art generation timing based on the display schedule.

[0740] Art Creation Method

[0741] Server: Sends art generation requests to the AI ​​according to a set schedule, for example, requesting new art to be generated every morning at 8am.

[0742] Generative AI: Receives requests and generates new art based on a given theme. Sends the generated art back to the server.

[0743] Generation AI means

[0744] Generative AI model: Generates art based on prompts sent from the server. This generative AI model uses an existing database to generate images that correspond to the prompts.

[0745] Delivery Method

[0746] Server: The generated art is stored on the server and prepared for distribution to the user's device.

[0747] Server: Notifies the user device that the art is ready to be delivered. The notification includes a download link for the new art.

[0748] Reception and display means

[0749] Device: Receives notifications from the server and downloads new art.

[0750] On your device: Display the downloaded art in your frame, replacing the existing art with the new art.

[0751] Feedback collection methods

[0752] User: View new art displayed in the frame and provide feedback through a simple interface (e.g., "like," "neutral," "dislike," etc.).

[0753] Terminal: Collects user feedback and sends it to the server.

[0754] Feedback Analysis Methods

[0755] Server: Stores the received feedback in a database and reflects it in the next art generation.

[0756] Server: Analyzes feedback and adjusts the parameters of the generation AI to reflect user preferences in the next art generation.

[0757] emotion recognition means

[0758] Device: Analyzes the user's facial expressions, voice, and body movements to recognize their emotions.

[0759] Server: Receives the emotion recognition results sent from the emotion engine means and stores them in a database.

[0760] Server: Adjusts the customizable parameters of the AI ​​based on the emotion recognition results. For example, if the user expresses happiness, the AI ​​can be instructed to generate art with a bright, positive theme. Conversely, if the user expresses stress, the AI ​​can be adjusted to generate art with a more relaxing theme.

[0761] Schedule management tools

[0762] Server: Manages and repeats the art generation and delivery process based on a display schedule set by the user.

[0763] Specific examples

[0764] If a user wants to "set it so that new nature scenery art is displayed every morning at 8:00," the user first selects "nature scenery" as the theme and sets the display schedule to "every morning at 8:00." The server saves this setting, and every morning at 8:00, it requests the generation AI to generate "nature scenery" art. The generation AI receives the request and generates new nature scenery art. Once this is complete, the server delivers the generated art to the user's device. The device receives the new art and displays it in the frame. When the user appreciates the art and provides feedback, the feedback is analyzed by the server and reflected in the next art generation. Furthermore, the emotion engine means recognizes the user's emotions and sends the emotion data to the server, so that the user's emotional state is reflected in the art generation.

[0765] Prompt Sentence Examples

[0766] "Create a summer morning landscape that incorporates elements of natural scenery. It would be nice to have a slightly refreshing breeze."

[0767] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0768] Step 1: User Setup

[0769] User: Accesses a dedicated application or website and creates an account by entering their name, email address, password, etc., and pressing the registration button.

[0770] Input: User's name, email address, and password

[0771] Output: User information sent to the server

[0772] Server: Receives the information entered by the user and stores it in a database. If registration is successful, sends a confirmation email.

[0773] Input: User information

[0774] Output: Send confirmation email

[0775] Users: You will receive a confirmation email and click the link to activate your account. After logging in, you can set your preferred theme and display schedule.

[0776] Input: Confirmation email link, theme, schedule

[0777] Output: Sends the configuration to the server

[0778] Step 2: Submit an art generation request

[0779] Server: Sends art generation requests to the AI ​​based on a set display schedule. For example, it sends a request to generate new art every morning at 8:00.

[0780] Input: User's theme and schedule settings, current time

[0781] Output: Request to the generation AI

[0782] Step 3: Generate Art

[0783] Generation AI: Receives requests from the server and generates new art based on a prompt (e.g., "Generate a summer morning landscape incorporating natural landscape elements.") and sends the generated art back to the server.

[0784] Input: prompt statement

[0785] Output: Generated art

[0786] Server: Receives the generated art and stores it in a database.

[0787] Input: Generated art

[0788] Output: Save to database

[0789] Step 4: Prepare your art for distribution

[0790] Server: Prepares the generated art for distribution to the user's device. Notifies the user's device that the art is ready for distribution, and the notification includes a download link for the new art.

[0791] Input: Art stored in the database

[0792] Output: Delivery notification

[0793] Step 5: Receive and display your art

[0794] Device: Receives notification from the server, downloads new art, and displays the new art in the Smart Art Frame after the download is complete.

[0795] Input: Delivery notification, download link

[0796] Output: Display of new art

[0797] Step 6: Gather feedback

[0798] Users: Use a simple interface to view new art and provide feedback, for example by pressing buttons such as "like," "neutral," or "dislike."

[0799] Input: Feedback (like, neutral, dislike)

[0800] Output: Send feedback to the device

[0801] Terminal: Receives user feedback and sends it to the server.

[0802] Input: User feedback

[0803] Output: Send feedback to the server

[0804] Step 7: Analyze feedback

[0805] Server: Receives feedback data and stores it in a database. Analyzes the feedback and adjusts the parameters of the generation AI to reflect the user's preferences the next time art is generated.

[0806] Input: Feedback data

[0807] Output: Analysis results and new parameter settings for the generated AI

[0808] Step 8: Emotion Recognition

[0809] Device: Analyzes the user's facial expressions, voice, and body movements to recognize emotions. Captures data using a camera and microphone.

[0810] Input: Facial expressions, voice, body movements

[0811] Output: Emotion data

[0812] Server: Receives emotion data and stores it in a database. Based on this data, the parameters of the AI ​​are adjusted to generate art that matches the user's emotional state.

[0813] Input: Emotion data

[0814] Output: New parameter settings for the generated AI

[0815] The above is a description of the specific processing flow of each step, the specific operations performed at each step, and the inputs and outputs.

[0816] (Application example 2)

[0817] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0818] Conventional displays and signage art in brick-and-mortar stores have the drawback of being time-consuming and expensive to frequently change once-installed content, making it difficult to provide a personalized experience that matches the customer's expressions and emotions. This invention solves these challenges and provides a method for providing a more personalized and engaging store experience by dynamically generating and displaying art based on customer feedback and emotional data.

[0819] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a user setting means for a user to set a preferred theme and display schedule; an art generation means for the server to generate art based on the specified theme; a distribution means for distributing the generated art to the user's terminal; a receiving and display means for the user's terminal to receive and display the art distributed from the server; a feedback collection means for collecting user feedback and transmitting it to the server; a feedback analysis means for the server to analyze the feedback and reflect it in the next art generation; an emotion engine means for analyzing customers' facial expressions, voices, and body movements to collect emotion data; and a display means for displaying art on an in-store display or digital signage. This makes it possible to dynamically and personally change the display content in a physical store and display attractive art based on customer interactions.

[0820] The "user setting means" is a means for a user to set a preferred theme and display schedule.

[0821] The "art generation means" is a means by which the server generates art based on a specified theme.

[0822] The "distribution means" is a means for distributing the generated art to the user's terminal.

[0823] The "receiving and displaying means" is a means by which the user's terminal receives and displays art distributed from the server.

[0824] The "feedback collection means" is a means for collecting user feedback and sending it to the server.

[0825] The "feedback analysis means" is a means by which the server analyzes the feedback and reflects it in the next art generation.

[0826] The "emotion engine means" is a means for analyzing the facial expressions, voice, and body movements of the customer to collect emotional data.

[0827] "Display means" refers to a means for displaying art on an in-store display or digital signage.

[0828] The present invention is a system that enables dynamic art display based on customer feedback and emotional data in physical stores. This system is composed of several tools, each of which plays a specific role.

[0829] User setting method

[0830] User: The store manager first creates an account in a dedicated management application and sets their preferred theme (e.g., modern art, abstract paintings, etc.) and display schedule (e.g., refresh every morning at 10 a.m.). This setting information is sent to the server and stored in a database.

[0831] Art Creation Method

[0832] Server: Based on a set schedule, it sends art generation requests to a generative AI model (e.g., GPT-4's image generation engine). The generative AI generates new art based on a specified theme and sends the results back to the server.

[0833] Delivery Method

[0834] Server: Stores the generated artwork in cloud storage, generates a URL link to distribute it to the user's device, and notifies the display device in the store of this link, preparing the artwork for display.

[0835] Reception and display means

[0836] Terminal: The display device receives the URL link sent from the server, downloads the new art, and displays it. Once the display is complete, the new art replaces the existing art.

[0837] Feedback collection methods

[0838] Users and devices: Customer feedback is collected through camera sensors and survey terminals installed around the displays in the store. Feedback includes simple evaluations (e.g., "like," "average," "dislike," etc.). This feedback data is sent to the server.

[0839] Feedback Analysis Methods

[0840] Server: The feedback data is stored in a database and analyzed using machine learning tools (e.g., Scikit-learn) to reflect it in the next art generation. The parameters of the generation AI are adjusted based on the analysis results.

[0841] Emotion Engine Means

[0842] Terminal: Emotional data is collected using image recognition technology (e.g., OpenCV) to analyze the customer's facial expressions, voice, and physical movements. The collected emotional data is sent to the server and is reflected in the next art generation.

[0843] Display Means

[0844] Terminal: In-store displays or digital signage display the art delivered from the server for customers to view. The displayed art changes dynamically based on collected feedback and sentiment data.

[0845] Specific examples

[0846] If a store manager sets the theme to "modern art" and schedules new art to be displayed every morning at 10:00, they will first send a prompt to GPT-4 to generate a "modern art digital painting."

[0847] Example prompt: "Generate a modern art style digital painting with vibrant colors and abstract shapes."

[0848] The generated art is displayed on displays within the store, where customers can view it. Customers provide feedback on their impressions through questionnaires and facial expression analysis, and this data is reflected in the next art generation. This ensures that the in-store display content is always up-to-date and personalized, improving the customer experience.

[0849] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0850] Program Processing Steps

[0851] Step 1:

[0852] Input: Store managers create an account using a dedicated management application and input their preferred themes and display schedules.

[0853] Data processing: The management application converts the input data into a format suitable for storage in the database.

[0854] Output: The server receives these data and stores them in a database.

[0855] Specific operation: The store manager sets the theme "Modern Art" and the display schedule "Every morning at 10:00" in the management app, and sends the setting information to the server. The server saves the setting data in the database.

[0856] Step 2:

[0857] Input: Based on the display schedule, the server knows that the next display update is approaching.

[0858] Data processing: The server reads the saved configuration information and generates prompts to be given to the generative AI model.

[0859] Output: Sends a new art generation request to the generative AI model.

[0860] Specific operation: The server prepares a prompt to generate a "modern art digital painting" based on a schedule and sends it to the generation AI.

[0861] Example prompt: "Generate a modern art style digital painting with vibrant colors and abstract shapes."

[0862] Step 3:

[0863] Input: A generative AI model receives a prompt and generates new art.

[0864] Data calculation: The generative AI model generates image data based on the specified theme and prompt.

[0865] Output: Send the generated art back to the server.

[0866] Specific operation: A generative AI model (e.g., GPT-4) generates modern art based on instructions and sends the image data to a server.

[0867] Step 4:

[0868] Input: The server receives the generated art.

[0869] Data processing: Save the generated art to cloud storage and generate a URL link.

[0870] Output: Sends the URL link to the store's display terminal.

[0871] Specific operation: The server saves the generated art in cloud storage, generates a URL for it, and sends it to the store's display terminal.

[0872] Step 5:

[0873] Input: The display device receives the URL link sent from the server.

[0874] Data processing: The display device downloads new art from the link.

[0875] Output: The downloaded art is displayed on the screen.

[0876] What happens: The display device receives the URL for the new art, downloads it, and displays it, replacing the existing art with the new art.

[0877] Step 6:

[0878] Input: Customers view the displayed art and provide feedback via survey terminals or camera sensors.

[0879] Data processing: Feedback is converted into digital format and sent to a server.

[0880] Output: The collected feedback data is stored on the server.

[0881] Specific operation: Customers use a survey terminal to select "like," "neutral," or "dislike," or the camera sensor recognizes facial expressions and automatically collects feedback.

[0882] Step 7:

[0883] Input: The server receives the collected feedback data.

[0884] Data calculation: Stored in a database and analyzed using machine learning tools (e.g., Scikit-learn).

[0885] Output: The analysis results are reflected in the next parameter setting of the generative AI model.

[0886] How it works: The server saves the feedback data and analyzes it with an analysis tool. Based on the analysis results, the parameters of the next piece of art generated by the AI ​​are adjusted.

[0887] Step 8:

[0888] Input: Real-time analysis of customer facial expressions and behavior is performed by camera sensors.

[0889] Data calculation: Image recognition tools (e.g., OpenCV) analyze facial expressions and behaviors to generate emotion data.

[0890] Output: Emotion data is sent to the server and stored.

[0891] How it works: Cameras installed in stores capture customers' facial expressions, and an analysis tool generates emotional data, which is then sent to a server and stored in a database.

[0892] This detailed processing step allows in-store displays to dynamically update based on customer feedback and sentiment, providing a personalized art experience.

[0893] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0894] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0895] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0896] [Third embodiment]

[0897] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0898] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0899] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0900] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0901] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0902] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0903] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0904] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0905] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0906] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0907] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0908] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0909] ---

[0910] The system of the present invention is a generative AI picture frame system that allows users to enjoy new art every day. This system includes a user setting means, an art generation means, a distribution means, a receiving and displaying means, a feedback collection means, a feedback analysis means, and a schedule management means.

[0911] User setting method

[0912] User: During initial setup, the user accesses a dedicated application or website and creates an account. The user selects a theme (e.g., nature landscapes, abstract paintings, modern art, etc.) and a display schedule (e.g., daily, weekly, specific time, etc.). This information is sent to the server and saved as part of the user settings.

[0913] Art Creation Method

[0914] Server: Starts the process of generating art based on the set schedule and the selected theme. The generation AI generates an art piece that fits the specified theme and sends the generated art back to the server. For example, if the user selects "nature landscapes," the generation AI creates art depicting beautiful natural landscapes.

[0915] Delivery Method

[0916] Server: Stores the generated art and prepares it for distribution to the user's device. The server notifies the user device that the art is ready for distribution.

[0917] Reception and display means

[0918] Device: Receives notification from the server and downloads new art. The device replaces the existing art with the new art and displays it in the frame. For example, a new piece of art will automatically appear in the frame every morning at 8:00 AM.

[0919] Feedback collection methods

[0920] User: Provides feedback on the displayed art. Through a simple interface, users can select and submit feedback such as "like," "average," or "dislike."

[0921] Feedback Analysis Methods

[0922] Device: Collects user feedback and sends it to the server. The server stores the feedback in a database and reflects it in the next art generation. This allows the art generation to gradually improve in accordance with the user's preferences.

[0923] Schedule management tools

[0924] Server: Manages the schedule for generating and delivering art based on the display schedule set by the user. For example, if a user sets "display new art every day at 8:00," the server will trigger the process of generating and delivering art every morning at 8:00.

[0925] Specific examples

[0926] If a user wants to "set it so that new nature scenery art is displayed every morning at 8:00," the user first selects "nature scenery" as the theme and sets the display schedule to "every morning at 8:00." The server saves this setting, and every morning at 8:00, it requests the generation AI to generate "nature scenery" art. The generation AI receives the request and generates new nature scenery art. Once that is complete, the server delivers the generated art to the user's device. The device receives the new art and displays it in the frame. When the user views the art and provides feedback, that feedback is analyzed by the server and reflected in the next art generation.

[0927] This system allows users to easily enjoy new art on a daily basis without incurring high costs or hassle.

[0928] The processing flow will be explained below.

[0929] ---

[0930] Step 1:

[0931] User: Access the dedicated application or website, create an account, enter the required information (name, email address, password, etc.), and press the registration button.

[0932] Step 2:

[0933] Server: Saves the information entered by the user in a database. Sends a message to the user confirming successful registration.

[0934] Step 3:

[0935] User: After logging in, select your preferred theme (e.g., nature landscape, abstract painting, modern art, etc.) and then set the display schedule (e.g., daily, weekly, specific time, etc.).

[0936] Step 4:

[0937] Server: Stores user selections and settings in a database. Calculates the next art generation timing based on the display schedule.

[0938] Step 5:

[0939] Server: Sends art generation requests to the AI ​​according to a set schedule. For example, it requests that new art be generated every morning at 8am.

[0940] Step 6:

[0941] Generative AI: Receives requests and generates new art based on a given theme. Sends the generated art back to the server.

[0942] Step 7:

[0943] Server: The generated art is stored on the server and prepared for distribution to the user's device.

[0944] Step 8:

[0945] Server: Notifies the user device that the art is ready to be delivered. The notification includes a download link for the new art.

[0946] Step 9:

[0947] Device: Receives notifications from the server and downloads new art.

[0948] Step 10:

[0949] On your device: Display the downloaded art in your frame. Replace the existing art with the new art.

[0950] Step 11:

[0951] User: View new art displayed in the frame and provide feedback through a simple interface (e.g., "like," "neutral," "dislike," etc.).

[0952] Step 12:

[0953] Terminal: Collects user feedback and sends it to the server.

[0954] Step 13:

[0955] Server: Stores the received feedback in a database and reflects it in the next art generation.

[0956] Step 14:

[0957] Server: Analyzes user feedback and adjusts the parameters of the generation AI to reflect user preferences in the next art generation.

[0958] Step 15:

[0959] Server: Repeat the process of art generation and distribution based on the next display schedule.

[0960] ---

[0961] Example 1

[0962] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0963] Conventional art appreciation methods require users to select and configure artworks themselves, which is time-consuming and makes it difficult to enjoy new art according to the user's preferences and mood. Furthermore, updating and managing artworks is cumbersome, and there has been no system that generates art that reflects user feedback.

[0964] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0965] In this invention, the server includes a setting means for allowing a user to set a theme and display schedule that the user prefers, a generation means for the server to generate a prompt based on the specified theme and display schedule and generate art using a generative AI model, a distribution means for distributing the generated art to the user's device, a display means for the user's device to receive and display the art distributed from the server, a collection means for collecting user feedback and transmitting it to the server, and an analysis means for the server to analyze the feedback and reflect it in the next art generation. This allows users to automatically and easily enjoy new art according to their preferences, and art that further suits the user's preferences can be provided through the feedback.

[0966] The "user setting means" is a means by which a user accesses the system and sets his / her preferred theme and display schedule.

[0967] The "generation means" is a means by which the server generates prompt sentences based on the theme and display schedule set by the user and generates art using a generative AI model.

[0968] The "distribution means" is a means by which the server distributes the generated art to the user's terminal.

[0969] The "display means" is a means by which the user's terminal receives art distributed from the server and displays it on the display.

[0970] The "feedback collection means" is a means for collecting user feedback and sending it to the server.

[0971] The "feedback analysis means" is a means by which the server analyzes the feedback sent from the user and reflects it in the next art generation.

[0972] The "setting means" refers to means including an interface and software for allowing the user to set the theme and display schedule.

[0973] A "generative AI model" is an artificial intelligence model used by the server to automatically generate art based on a prompt.

[0974] A "prompt" is a text instruction that instructs a generative AI model to generate art based on a specific theme.

[0975] The present invention is a generative AI picture frame system that allows users to enjoy new art every day. The system includes a user setting means, a generation means, a distribution means, a display means, a feedback collection means, and a feedback analysis means.

[0976] User setting method

[0977] User: During initial setup, the user accesses a dedicated application or website and creates an account. The user selects a theme (e.g., nature landscapes, abstract paintings, modern art, etc.) and a display schedule (e.g., daily, weekly, specific time, etc.). This information is sent to the server and saved as a user profile.

[0978] generation means

[0979] Server: Based on the set schedule and theme, the server generates a prompt to be sent to the generative AI model. Based on this prompt, a generative AI model (e.g., OpenAI's DALL-E) is used to generate an artwork. For example, if the user selects "nature scenery," the prompt will be "Please generate art depicting a beautiful nature scene."

[0980] Delivery Method

[0981] Server: Stores the generated art and prepares it for distribution to the user's device. The server notifies the device that the art is ready for distribution and sends the URL and binary data of the generated art.

[0982] Display means

[0983] Device: Receives notification from the server and downloads new art. The device replaces the existing art with the new art and displays the new art on the display at the set time. For example, new nature scenery art will be automatically displayed on the frame every morning at 8:00.

[0984] Feedback collection methods

[0985] User: After viewing the displayed art, the user provides feedback through the application or website. Here, the user selects feedback such as "like," "average," or "dislike" and sends it to the server.

[0986] Feedback Analysis Methods

[0987] Server: Collects and analyzes the feedback sent by users. The analysis results are reflected in the next art generation, gradually providing art that matches the user's preferences. This feedback analysis process improves the accuracy of the art generation algorithm.

[0988] Specific examples

[0989] If a user wants to "set it up so that new nature scenery art is displayed every morning at 8:00," the user first selects "nature scenery" as the theme and sets the display schedule to "every morning at 8:00." The server saves this setting and sends a prompt to the generative AI model shortly before 8:00 each morning: "Please generate art depicting a beautiful nature scenery." The generative AI model receives the request and generates new nature scenery art. Once completed, the server delivers the generated art to the user's device. The device downloads the new art at 8:00 and displays it on the display. When the user views the art and provides feedback, the feedback is analyzed by the server and reflected in the next art generation.

[0990] This system allows users to enjoy new art every day without any effort. Furthermore, the next art generation is adjusted based on user feedback, so the system gradually provides art that matches the user's preferences.

[0991] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0992] Step 1: Account Creation and Initial Settings

[0993] User: During initial setup, access the dedicated application or website, click the "Create a new account" button, enter the required information, and press the submit button. Then, select "Nature Scenery" on the "Theme Selection" screen and "Every morning at 8:00" on the "Schedule Settings" screen. This setting information is sent to the server and saved as a user profile.

[0994] Input: User information (name, email address, etc.), theme selection information, display schedule information.

[0995] Output: User profile stored on the server.

[0996] Step 2: Art Creation Request

[0997] Server: Manages the timing of new art generation based on the display schedule set by the user. For example, if the schedule is set to display new art every morning at 8:00, the server prepares to send a prompt to the generation AI model shortly before that time. The prompt might be, "Please generate art depicting a beautiful natural landscape."

[0998] Input: The user's display schedule information.

[0999] Output: The prompt to send to the generative AI model.

[1000] Step 3: Art generation

[1001] Server: Sends the prompt to the generative AI model. The generative AI model (e.g., DALL-E) generates a new artwork based on the prompt and sends the result back to the server. The returned artwork is stored on the server.

[1002] Input: The prompt statement.

[1003] Output: Art files returned from the generative AI model.

[1004] Step 4: Art Delivery

[1005] Server: Stores the generated art file and prepares it for distribution to the user's device. The server notifies the user device that the art is ready to be distributed and sends the URL and binary data of the art file.

[1006] Input: Generated art files.

[1007] Output: Art file URL, notification message.

[1008] Step 5: Art receiving and display

[1009] Device: Analyzes the notification message received from the server and downloads the image data from the URL of the art file. After the download is complete, the new art replaces the existing art. The device automatically displays the new art on the display at the set time. For example, the latest nature landscape art will be displayed on the frame at 8:00 every morning.

[1010] Input: Art file URL, notification message.

[1011] Output: The new art to be displayed.

[1012] Step 6: Provide feedback

[1013] User: On the application's feedback screen, select "Like," "Average," or "Dislike" for the displayed art, then press the submit button. The feedback is sent to the server.

[1014] Input: User feedback.

[1015] Output: Feedback data sent to the server.

[1016] Step 7: Analyze the feedback

[1017] Server: Collects the received feedback data and stores it in a database. It then analyzes the feedback and reflects it in the next art generation, thereby adjusting the algorithm of the generative AI model to suit the user's preferences.

[1018] Input: Feedback data.

[1019] Output: Parsed feedback, updated parameters of the generative AI model.

[1020] Step 8: Schedule Management

[1021] Server: Manages the timing of the next art generation and distribution based on the display schedule set by the user. For example, if a user requests new art every morning at 8:00, the server automatically executes the process from sending prompts to distribution at that time.

[1022] Input: The user's viewing schedule.

[1023] Output: Sending prompts, generating art and scheduling delivery.

[1024] (Application example 1)

[1025] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1026] In a generative AI painting frame system that allows users to enjoy new art every day, it has been difficult to enhance the personalization of art display and the interactive user experience. Furthermore, there was a need for an efficient method for generating art that reflects user preferences. Furthermore, there was also a challenge in dynamically displaying art in a virtual space, providing an environment in which users could appreciate art with a more immersive feeling.

[1027] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1028] In this invention, the server includes a user setting means for allowing a user to set a theme and display schedule of their choice, an art generation means for the server to use a generative model based on the theme specified by the server, a distribution means for distributing the generated art to the user's terminal, a receiving and display means for the user's terminal to receive and display the art distributed from the server, a feedback collection means for collecting user feedback and transmitting it to the server, a feedback analysis means for the server to analyze the feedback and reflect it in the next art generation, and a virtual display means for displaying art in a virtual space using a head-mounted display. This allows users to immerse themselves in viewing art that suits their preferences in a virtual space and provide interactive feedback.

[1029] The "user setting means" is a function that allows the user to set a theme or display schedule of their choice.

[1030] A "generative model" is an algorithm or system that uses artificial intelligence to automatically generate art based on a specific theme.

[1031] "Art generation means" is a function that generates art using a generative model based on a set theme.

[1032] "Distribution means" is a function that transmits the generated art to the user's terminal.

[1033] The "receiving and displaying means" is a function that allows the user's terminal to receive and display art distributed from the server.

[1034] The "feedback collection means" is a function that allows users to input their evaluations and opinions about art and send them to the server.

[1035] The "feedback analysis means" is a function for analyzing collected user feedback and reflecting it in the next art creation.

[1036] "Virtual display means" is a function for displaying art in a virtual space using a head-mounted display.

[1037] A "prompt" is a textual instruction that gives a generative model specific thematic or stylistic instructions.

[1038] The "schedule management means" is a function that automatically manages the creation and distribution of art based on a display schedule set by the user.

[1039] The system of the present invention is a generative AI painting frame system that allows users to enjoy new art every day. This system includes a user setting unit, an art generation unit using a generative model, a distribution unit, a receiving and display unit, a feedback collection unit, a feedback analysis unit, a virtual display unit, and a schedule management unit.

[1040] User setting method

[1041] Users first create an account using a dedicated application or website, then select their preferred theme (e.g., nature landscapes, abstract paintings, modern art, etc.) and display schedule (e.g., daily, weekly, specific time, etc.), which is then sent to the server and saved as part of the user's settings.

[1042] Art Creation Method

[1043] The server generates art using a generative model based on a schedule set by the user and a selected theme. The generation AI generates an artwork that fits the specified theme and sends the generated art back to the server. For example, if the user selects the theme "natural scenery," the generation AI creates art depicting beautiful natural scenery. An example of a prompt required for generation is "Please generate art of a natural scenery."

[1044] Delivery Method

[1045] The server stores the generated art and prepares it for distribution to the user's terminal. The server notifies the user terminal that the art is ready for distribution.

[1046] Reception and display means

[1047] The user's device receives a notification from the server and downloads the new artwork. The device replaces the existing artwork with the new artwork and displays it in the frame. For example, a new artwork will automatically appear in the frame every morning at 8:00 AM.

[1048] Feedback collection methods

[1049] Users can provide feedback on the displayed art by selecting and submitting feedback such as "like," "average," or "dislike" through a simple interface.

[1050] Feedback Analysis Methods

[1051] The device collects user feedback and sends it to the server, which stores it in a database and reflects it in the next art generation. This allows the art to be generated more accurately based on the user's preferences.

[1052] Virtual Display Means

[1053] The system uses a head-mounted display (HMD) to display new artworks in a virtual space. Users can wear the HMD and explore the virtual gallery. This immersive environment allows users to view art in a more interactive way.

[1054] Schedule management tools

[1055] The server manages the schedule for generating and delivering art based on the display schedule set by the user. For example, if a user sets "display new art every day at 8 o'clock," the server will trigger the process of generating and delivering art every morning at 8 o'clock.

[1056] Specific examples

[1057] If a user wants to "set it so that new nature scenery art is displayed every morning at 8:00," they first select "nature scenery" as the theme and set the display schedule to "every morning at 8:00." The server saves this setting, and every morning at 8:00, it requests the generation AI to generate "nature scenery" art. The generation AI receives the request and generates new nature scenery art. Once generation is complete, the server distributes the generated art to the user's device. The device receives the new art and displays it in a virtual gallery using an HMD. Furthermore, if the user views the art and provides feedback, that feedback is analyzed by the server and reflected in the next art generation.

[1058] This system allows users to easily enjoy new art on a daily basis without incurring high costs or hassle.

[1059] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1060] Step 1:

[1061] User setting method

[1062] A user accesses a dedicated application or website and creates an account. Then, they select their preferred theme (e.g., nature landscapes, abstract paintings, modern art, etc.) and display schedule (e.g., daily, weekly, specific time, etc.). This information is sent as input to the server, which stores it in a user preference database. The output is the user's preference information.

[1063] Step 2:

[1064] Art Creation Method

[1065] The server generates a prompt statement to instruct the generative model based on the theme and display schedule set by the user. An example of a prompt statement is "Please generate art of a natural landscape." This prompt statement is sent as input to the generative AI. The generative AI generates an artwork based on the specified theme, and the generated art is sent back to the server. The output is the generated artwork.

[1066] Step 3:

[1067] Delivery Method

[1068] The server stores the generated art and prepares it for distribution to the user's device. As a distribution method, it sends a notification message containing the art's URL to the user's device. This notification arrives at the device as input, and the art's URL is output.

[1069] Step 4:

[1070] Reception and display means

[1071] The device receives a notification from the server, requests the art URL included in the notification message, and downloads the new art. The device uses this URL as input to retrieve the art data and display it in the frame. The output is a display of the new art.

[1072] Step 5:

[1073] Virtual Display Means

[1074] The user wears a head-mounted display (HMD) and views new art in a virtual space. The device displays a virtual gallery and applies the downloaded art to the environment. The input to this process is the new art data, and the output is the display of the art in the virtual space.

[1075] Step 6:

[1076] Feedback collection methods

[1077] Users provide feedback on the displayed art. Through a simple interface, they select feedback such as "like," "average," or "dislike," and send this as input to the terminal. The terminal then sends this feedback data to the server, and the output is user feedback.

[1078] Step 7:

[1079] Feedback Analysis Methods

[1080] The server receives the feedback data sent from the device and analyzes it using a feedback analysis program. The server updates the parameters of the generative model to reflect the analysis results in the next art generation. The input is user feedback, and the output is the updated parameters of the generative model.

[1081] Step 8:

[1082] Schedule management tools

[1083] The server manages the schedule for generating and distributing art based on the display schedule set by the user. At the time set by the user (e.g., 8:00 a.m. every morning), the server automatically requests the generation AI to generate new art and starts the process of distributing the generated art to the user's device. The input is the user's display schedule, and the output is the execution of generating and distributing new art.

[1084] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1085] ---

[1086] The system of the present invention is a generative AI painting frame system that allows users to enjoy new art every day. The system includes a user setting unit, an art generation unit, a distribution unit, a receiving and display unit, a feedback collection unit, a feedback analysis unit, a schedule management unit, and an emotion engine unit.

[1087] User setting method

[1088] User: During initial setup, access the dedicated application or website to create an account. Enter the required information (name, email address, password, etc.) and press the registration button.

[1089] Server: Stores the information entered by the user in a database and sends the user a message confirming successful registration.

[1090] User: After logging in, select your preferred theme (e.g., nature landscape, abstract painting, modern art, etc.) and then set the display schedule (e.g., daily, weekly, specific time, etc.).

[1091] Server: Saves user selections and settings in a database and calculates the next art generation timing based on the display schedule.

[1092] Art Creation Method

[1093] Server: Sends art generation requests to the AI ​​according to a set schedule, for example, requesting new art to be generated every morning at 8am.

[1094] Generative AI: Receives requests and generates new art based on a given theme. Sends the generated art back to the server.

[1095] Delivery Method

[1096] Server: The generated art is stored on the server and prepared for distribution to the user's device.

[1097] Server: Notifies the user device that the art is ready to be delivered. The notification includes a download link for the new art.

[1098] Reception and display means

[1099] Device: Receives notifications from the server and downloads new art.

[1100] On your device: Display the downloaded art in your frame, replacing the existing art with the new art.

[1101] Feedback collection methods

[1102] User: View new art displayed in the frame and provide feedback through a simple interface (e.g., "like," "neutral," "dislike," etc.).

[1103] Terminal: Collects user feedback and sends it to the server.

[1104] Feedback Analysis Methods

[1105] Server: Stores the received feedback in a database and reflects it in the next art generation.

[1106] Server: Analyzes feedback and adjusts the parameters of the generation AI to reflect user preferences in the next art generation.

[1107] Schedule management tools

[1108] Server: Manages and repeats the art generation and delivery process based on a display schedule set by the user.

[1109] Emotion Engine Means

[1110] Device: Analyzes the user's facial expressions, voice, and body movements to recognize their emotions.

[1111] Server: Receives the emotion recognition results sent from the emotion engine means and stores them in a database.

[1112] Server: Adjusts the customizable parameters of the Generator AI based on the results of emotion recognition. For example, if the user expresses happiness, the Generator AI is instructed to generate art with a bright, positive theme. Conversely, if the user expresses stress, the AI ​​is adjusted to generate art with a more relaxing theme.

[1113] Specific examples

[1114] If a user wants to "set it so that new nature scenery art is displayed every morning at 8:00," the user first selects "nature scenery" as the theme and sets the display schedule to "every morning at 8:00." The server saves this setting, and every morning at 8:00, it requests the generation AI to generate "nature scenery" art. The generation AI receives the request and generates new nature scenery art. Once this is complete, the server delivers the generated art to the user's device. The device receives the new art and displays it in the frame. When the user appreciates the art and provides feedback, the feedback is analyzed by the server and reflected in the next art generation. Furthermore, the emotion engine means recognizes the user's emotions and sends the emotion data to the server, so that the user's emotional state is reflected in the art generation.

[1115] This system not only allows users to easily enjoy new art every day without incurring high costs or hassle, but also provides them with art that matches their emotional state.

[1116] The processing flow will be explained below.

[1117] ---

[1118] Step 1:

[1119] User: Access the dedicated application or website, create an account, enter the required information (name, email address, password, etc.), and press the registration button.

[1120] Step 2:

[1121] Server: Saves the information entered by the user in a database. Sends a message to the user confirming successful registration.

[1122] Step 3:

[1123] User: After logging in, select your preferred theme (e.g., nature landscape, abstract painting, modern art, etc.) and then set the display schedule (e.g., daily, weekly, specific time, etc.).

[1124] Step 4:

[1125] Server: Stores user selections and settings in a database and calculates the next art generation timing based on the display schedule.

[1126] Step 5:

[1127] Server: Sends art generation requests to the AI ​​according to a set schedule, for example, requesting new art to be generated every morning at 8am.

[1128] Step 6:

[1129] Generative AI: Receives requests and generates new art based on a given theme. Sends the generated art back to the server.

[1130] Step 7:

[1131] Server: The generated art is stored on the server and prepared for distribution to the user's device.

[1132] Step 8:

[1133] Server: Notifies the user device that the art is ready to be delivered. The notification includes a download link for the new art.

[1134] Step 9:

[1135] Device: Receives notifications from the server and downloads new art.

[1136] Step 10:

[1137] On your device: Display the downloaded art in your frame, replacing the existing art with the new art.

[1138] Step 11:

[1139] Device: Uses built-in cameras and microphones to analyze the user's facial expressions, voice, and body movements to recognize the user's emotions.

[1140] Step 12:

[1141] Device: Sends the recognized emotion data to the server.

[1142] Step 13:

[1143] User: View new art displayed in the frame and provide feedback through a simple interface (e.g., "like," "neutral," "dislike," etc.).

[1144] Step 14:

[1145] Terminal: Collects user feedback and sends it to the server.

[1146] Step 15:

[1147] Server: Stores the received feedback in a database and reflects it in the next art generation.

[1148] Step 16:

[1149] Server: Receives the emotion recognition results sent from the emotion engine means and stores them in a database.

[1150] Step 17:

[1151] Server: Adjusts customizable parameters of the Generative AI based on the results of emotion recognition. For example, if the user expresses happiness, the Generative AI can be instructed to generate art with a bright, positive theme.

[1152] Step 18:

[1153] Server: Repeat the process of art generation and distribution based on the next display schedule.

[1154] ---

[1155] Example 2

[1156] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1157] Conventional art frame systems have the drawback of requiring users to manually select new art, which is inconvenient. They also have difficulty reflecting user feedback and emotions, making it impossible to provide optimal art for each individual user.

[1158] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1159] In this invention, the server includes a user setting means for a user to set a preferred theme and display schedule, an art generation means for sending an art generation request to the generation AI based on the set display schedule, a generation AI means for the generation AI to generate art based on a prompt text, a distribution means for sending the generated art to the user's terminal, a receiving and display means for the user's terminal to receive and display the art distributed from the server, a feedback collection means for collecting user feedback and sending it to the server, a feedback analysis means for the server to analyze the feedback and reflect it in the next art generation, and an emotion recognition means for recognizing the user's emotions and sending it to the server. This allows users to automatically enjoy optimal art that suits their individual preferences and emotions without having to manually select art.

[1160] The "user setting means" is a means for a user to set a preferred theme and display schedule.

[1161] The "art generation means" is a means by which the server sends an art generation request to the generation AI based on a set display schedule.

[1162] "Generative AI means" refers to the means by which the generative AI generates art based on a prompt.

[1163] The "distribution means" is a means for distributing the generated art to the user's terminal.

[1164] The "receiving and displaying means" is a means by which the user's terminal receives and displays art distributed from the server.

[1165] The "feedback collection means" is a means for collecting user feedback and transmitting it to the server.

[1166] The "feedback analysis means" is a means for analyzing the feedback received by the server and reflecting it in the next art generation.

[1167] The "emotion recognition means" is a means for recognizing the user's emotions and transmitting them to the server.

[1168] The "schedule management means" is a means for automatically managing the process of generating and distributing art based on a display schedule set by the user.

[1169] The system of the present invention is a generative AI picture frame system that allows users to enjoy new art every day. This system includes a user setting unit, an art generation unit, a generative AI unit, a distribution unit, a receiving and display unit, a feedback collection unit, a feedback analysis unit, an emotion recognition unit, and a schedule management unit.

[1170] User setting method

[1171] User: During initial setup, access the dedicated application or website to create an account. Enter the required information (name, email address, password, etc.) and press the registration button.

[1172] Server: Stores the information entered by the user in a database and sends the user a message confirming successful registration.

[1173] User: After logging in, select your preferred theme (e.g., nature landscape, abstract painting, modern art, etc.) and then set the display schedule (e.g., daily, weekly, specific time, etc.).

[1174] Server: Stores user selections and settings in a database and calculates the next art generation timing based on the display schedule.

[1175] Art Creation Method

[1176] Server: Sends art generation requests to the AI ​​according to a set schedule, for example, requesting new art to be generated every morning at 8am.

[1177] Generative AI: Receives requests and generates new art based on a given theme. Sends the generated art back to the server.

[1178] Generation AI means

[1179] Generative AI model: Generates art based on prompts sent from the server. This generative AI model uses an existing database to generate images that correspond to the prompts.

[1180] Delivery Method

[1181] Server: The generated art is stored on the server and prepared for distribution to the user's device.

[1182] Server: Notifies the user device that the art is ready to be delivered. The notification includes a download link for the new art.

[1183] Reception and display means

[1184] Device: Receives notifications from the server and downloads new art.

[1185] On your device: Display the downloaded art in your frame, replacing the existing art with the new art.

[1186] Feedback collection methods

[1187] User: View new art displayed in the frame and provide feedback through a simple interface (e.g., "like," "neutral," "dislike," etc.).

[1188] Terminal: Collects user feedback and sends it to the server.

[1189] Feedback Analysis Methods

[1190] Server: Stores the received feedback in a database and reflects it in the next art generation.

[1191] Server: Analyzes feedback and adjusts the parameters of the generation AI to reflect user preferences in the next art generation.

[1192] emotion recognition means

[1193] Device: Analyzes the user's facial expressions, voice, and body movements to recognize their emotions.

[1194] Server: Receives the emotion recognition results sent from the emotion engine means and stores them in a database.

[1195] Server: Adjusts the customizable parameters of the AI ​​based on the emotion recognition results. For example, if the user expresses happiness, the AI ​​can be instructed to generate art with a bright, positive theme. Conversely, if the user expresses stress, the AI ​​can be adjusted to generate art with a more relaxing theme.

[1196] Schedule management tools

[1197] Server: Manages and repeats the art generation and delivery process based on a display schedule set by the user.

[1198] Specific examples

[1199] If a user wants to "set it so that new nature scenery art is displayed every morning at 8:00," the user first selects "nature scenery" as the theme and sets the display schedule to "every morning at 8:00." The server saves this setting, and every morning at 8:00, it requests the generation AI to generate "nature scenery" art. The generation AI receives the request and generates new nature scenery art. Once this is complete, the server delivers the generated art to the user's device. The device receives the new art and displays it in the frame. When the user appreciates the art and provides feedback, the feedback is analyzed by the server and reflected in the next art generation. Furthermore, the emotion engine means recognizes the user's emotions and sends the emotion data to the server, so that the user's emotional state is reflected in the art generation.

[1200] Prompt Sentence Examples

[1201] "Create a summer morning landscape that incorporates elements of natural scenery. It would be nice to have a slightly refreshing breeze."

[1202] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1203] Step 1: User Setup

[1204] User: Accesses a dedicated application or website and creates an account by entering their name, email address, password, etc., and pressing the registration button.

[1205] Input: User's name, email address, and password

[1206] Output: User information sent to the server

[1207] Server: Receives the information entered by the user and stores it in a database. If registration is successful, sends a confirmation email.

[1208] Input: User information

[1209] Output: Send confirmation email

[1210] Users: You will receive a confirmation email and click the link to activate your account. After logging in, you can set your preferred theme and display schedule.

[1211] Input: Confirmation email link, theme, schedule

[1212] Output: Sends the configuration to the server

[1213] Step 2: Submit an art generation request

[1214] Server: Sends art generation requests to the AI ​​based on a set display schedule. For example, it sends a request to generate new art every morning at 8:00.

[1215] Input: User's theme and schedule settings, current time

[1216] Output: Request to the generation AI

[1217] Step 3: Generate Art

[1218] Generation AI: Receives requests from the server and generates new art based on a prompt (e.g., "Generate a summer morning landscape incorporating natural landscape elements.") and sends the generated art back to the server.

[1219] Input: prompt statement

[1220] Output: Generated art

[1221] Server: Receives the generated art and stores it in a database.

[1222] Input: Generated art

[1223] Output: Save to database

[1224] Step 4: Prepare your art for distribution

[1225] Server: Prepares the generated art for distribution to the user's device. Notifies the user's device that the art is ready for distribution, and the notification includes a download link for the new art.

[1226] Input: Art stored in the database

[1227] Output: Delivery notification

[1228] Step 5: Receive and display your art

[1229] Device: Receives notification from the server, downloads new art, and displays the new art in the Smart Art Frame after the download is complete.

[1230] Input: Delivery notification, download link

[1231] Output: Display of new art

[1232] Step 6: Gather feedback

[1233] Users: Use a simple interface to view new art and provide feedback, for example by pressing buttons such as "like," "neutral," or "dislike."

[1234] Input: Feedback (like, neutral, dislike)

[1235] Output: Send feedback to the device

[1236] Terminal: Receives user feedback and sends it to the server.

[1237] Input: User feedback

[1238] Output: Send feedback to the server

[1239] Step 7: Analyze feedback

[1240] Server: Receives feedback data and stores it in a database. Analyzes the feedback and adjusts the parameters of the generation AI to reflect the user's preferences the next time art is generated.

[1241] Input: Feedback data

[1242] Output: Analysis results and new parameter settings for the generated AI

[1243] Step 8: Emotion Recognition

[1244] Device: Analyzes the user's facial expressions, voice, and body movements to recognize emotions. Captures data using a camera and microphone.

[1245] Input: Facial expressions, voice, body movements

[1246] Output: Emotion data

[1247] Server: Receives emotion data and stores it in a database. Based on this data, the parameters of the AI ​​are adjusted to generate art that matches the user's emotional state.

[1248] Input: Emotion data

[1249] Output: New parameter settings for the generated AI

[1250] The above is a description of the specific processing flow of each step, the specific operations performed at each step, and the inputs and outputs.

[1251] (Application example 2)

[1252] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1253] Conventional displays and signage art in brick-and-mortar stores have the drawback of being time-consuming and expensive to frequently change once-installed content, making it difficult to provide a personalized experience that matches the customer's expressions and emotions. This invention solves these challenges and provides a method for providing a more personalized and engaging store experience by dynamically generating and displaying art based on customer feedback and emotional data.

[1254] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a user setting means for a user to set a preferred theme and display schedule; an art generation means for the server to generate art based on the specified theme; a distribution means for distributing the generated art to the user's terminal; a receiving and display means for the user's terminal to receive and display the art distributed from the server; a feedback collection means for collecting user feedback and transmitting it to the server; a feedback analysis means for the server to analyze the feedback and reflect it in the next art generation; an emotion engine means for analyzing customers' facial expressions, voices, and body movements to collect emotion data; and a display means for displaying art on an in-store display or digital signage. This makes it possible to dynamically and personally change the display content in a physical store and display attractive art based on customer interactions.

[1255] The "user setting means" is a means for a user to set a preferred theme and display schedule.

[1256] The "art generation means" is a means by which the server generates art based on a specified theme.

[1257] The "distribution means" is a means for distributing the generated art to the user's terminal.

[1258] The "receiving and displaying means" is a means by which the user's terminal receives and displays art distributed from the server.

[1259] The "feedback collection means" is a means for collecting user feedback and sending it to the server.

[1260] The "feedback analysis means" is a means by which the server analyzes the feedback and reflects it in the next art generation.

[1261] The "emotion engine means" is a means for analyzing the facial expressions, voice, and body movements of the customer to collect emotional data.

[1262] "Display means" refers to a means for displaying art on an in-store display or digital signage.

[1263] The present invention is a system that enables dynamic art display based on customer feedback and emotional data in physical stores. This system is composed of several tools, each of which plays a specific role.

[1264] User setting method

[1265] User: The store manager first creates an account in a dedicated management application and sets their preferred theme (e.g., modern art, abstract paintings, etc.) and display schedule (e.g., refresh every morning at 10 a.m.). This setting information is sent to the server and stored in a database.

[1266] Art Creation Method

[1267] Server: Based on a set schedule, it sends art generation requests to a generative AI model (e.g., GPT-4's image generation engine). The generative AI generates new art based on a specified theme and sends the results back to the server.

[1268] Delivery Method

[1269] Server: Stores the generated artwork in cloud storage, generates a URL link to distribute it to the user's device, and notifies the display device in the store of this link, preparing the artwork for display.

[1270] Reception and display means

[1271] Terminal: The display device receives the URL link sent from the server, downloads the new art, and displays it. Once the display is complete, the new art replaces the existing art.

[1272] Feedback collection methods

[1273] Users and devices: Customer feedback is collected through camera sensors and survey terminals installed around the displays in the store. Feedback includes simple evaluations (e.g., "like," "average," "dislike," etc.). This feedback data is sent to the server.

[1274] Feedback Analysis Methods

[1275] Server: The feedback data is stored in a database and analyzed using machine learning tools (e.g., Scikit-learn) to reflect it in the next art generation. The parameters of the generation AI are adjusted based on the analysis results.

[1276] Emotion Engine Means

[1277] Terminal: Emotional data is collected using image recognition technology (e.g., OpenCV) to analyze the customer's facial expressions, voice, and physical movements. The collected emotional data is sent to the server and is reflected in the next art generation.

[1278] Display Means

[1279] Terminal: In-store displays or digital signage display the art delivered from the server for customers to view. The displayed art changes dynamically based on collected feedback and sentiment data.

[1280] Specific examples

[1281] If a store manager sets the theme to "modern art" and schedules new art to be displayed every morning at 10:00, they will first send a prompt to GPT-4 to generate a "modern art digital painting."

[1282] Example prompt: "Generate a modern art style digital painting with vibrant colors and abstract shapes."

[1283] The generated art is displayed on displays within the store, where customers can view it. Customers provide feedback on their impressions through questionnaires and facial expression analysis, and this data is reflected in the next art generation. This ensures that the in-store display content is always up-to-date and personalized, improving the customer experience.

[1284] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1285] Program Processing Steps

[1286] Step 1:

[1287] Input: Store managers create an account using a dedicated management application and input their preferred themes and display schedules.

[1288] Data processing: The management application converts the input data into a format suitable for storage in the database.

[1289] Output: The server receives these data and stores them in a database.

[1290] Specific operation: The store manager sets the theme "Modern Art" and the display schedule "Every morning at 10:00" in the management app, and sends the setting information to the server. The server saves the setting data in the database.

[1291] Step 2:

[1292] Input: Based on the display schedule, the server knows that the next display update is approaching.

[1293] Data processing: The server reads the saved configuration information and generates prompts to be given to the generative AI model.

[1294] Output: Sends a new art generation request to the generative AI model.

[1295] Specific operation: The server prepares a prompt to generate a "modern art digital painting" based on a schedule and sends it to the generation AI.

[1296] Example prompt: "Generate a modern art style digital painting with vibrant colors and abstract shapes."

[1297] Step 3:

[1298] Input: A generative AI model receives a prompt and generates new art.

[1299] Data calculation: The generative AI model generates image data based on the specified theme and prompt.

[1300] Output: Send the generated art back to the server.

[1301] Specific operation: A generative AI model (e.g., GPT-4) generates modern art based on instructions and sends the image data to a server.

[1302] Step 4:

[1303] Input: The server receives the generated art.

[1304] Data processing: Save the generated art to cloud storage and generate a URL link.

[1305] Output: Sends the URL link to the store's display terminal.

[1306] Specific operation: The server saves the generated art in cloud storage, generates a URL for it, and sends it to the store's display terminal.

[1307] Step 5:

[1308] Input: The display device receives the URL link sent from the server.

[1309] Data processing: The display device downloads new art from the link.

[1310] Output: The downloaded art is displayed on the screen.

[1311] What happens: The display device receives the URL for the new art, downloads it, and displays it, replacing the existing art with the new art.

[1312] Step 6:

[1313] Input: Customers view the displayed art and provide feedback via survey terminals or camera sensors.

[1314] Data processing: Feedback is converted into digital format and sent to a server.

[1315] Output: The collected feedback data is stored on the server.

[1316] Specific operation: Customers use a survey terminal to select "like," "neutral," or "dislike," or the camera sensor recognizes facial expressions and automatically collects feedback.

[1317] Step 7:

[1318] Input: The server receives the collected feedback data.

[1319] Data calculation: Stored in a database and analyzed using machine learning tools (e.g., Scikit-learn).

[1320] Output: The analysis results are reflected in the next parameter setting of the generative AI model.

[1321] How it works: The server saves the feedback data and analyzes it with an analysis tool. Based on the analysis results, the parameters of the next piece of art generated by the AI ​​are adjusted.

[1322] Step 8:

[1323] Input: Real-time analysis of customer facial expressions and behavior is performed by camera sensors.

[1324] Data calculation: Image recognition tools (e.g., OpenCV) analyze facial expressions and behaviors to generate emotion data.

[1325] Output: Emotion data is sent to the server and stored.

[1326] How it works: Cameras installed in stores capture customers' facial expressions, and an analysis tool generates emotional data, which is then sent to a server and stored in a database.

[1327] This detailed processing step allows in-store displays to dynamically update based on customer feedback and sentiment, providing a personalized art experience.

[1328] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1329] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1330] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1331] [Fourth embodiment]

[1332] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1333] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1334] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1335] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1336] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1337] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1338] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1339] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1340] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1341] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1342] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1343] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1344] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1345] ---

[1346] The system of the present invention is a generative AI picture frame system that allows users to enjoy new art every day. This system includes a user setting means, an art generation means, a distribution means, a receiving and displaying means, a feedback collection means, a feedback analysis means, and a schedule management means.

[1347] User setting method

[1348] User: During initial setup, the user accesses a dedicated application or website and creates an account. The user selects a theme (e.g., nature landscapes, abstract paintings, modern art, etc.) and a display schedule (e.g., daily, weekly, specific time, etc.). This information is sent to the server and saved as part of the user settings.

[1349] Art Creation Method

[1350] Server: Starts the process of generating art based on the set schedule and the selected theme. The generation AI generates an art piece that fits the specified theme and sends the generated art back to the server. For example, if the user selects "nature landscapes," the generation AI creates art depicting beautiful natural landscapes.

[1351] Delivery Method

[1352] Server: Stores the generated art and prepares it for distribution to the user's device. The server notifies the user device that the art is ready for distribution.

[1353] Reception and display means

[1354] Device: Receives notification from the server and downloads new art. The device replaces the existing art with the new art and displays it in the frame. For example, a new piece of art will automatically appear in the frame every morning at 8:00 AM.

[1355] Feedback collection methods

[1356] User: Provides feedback on the displayed art. Through a simple interface, users can select and submit feedback such as "like," "average," or "dislike."

[1357] Feedback Analysis Methods

[1358] Device: Collects user feedback and sends it to the server. The server stores the feedback in a database and reflects it in the next art generation. This allows the art generation to gradually improve in accordance with the user's preferences.

[1359] Schedule management tools

[1360] Server: Manages the schedule for generating and delivering art based on the display schedule set by the user. For example, if a user sets "display new art every day at 8:00," the server will trigger the process of generating and delivering art every morning at 8:00.

[1361] Specific examples

[1362] If a user wants to "set it so that new nature scenery art is displayed every morning at 8:00," the user first selects "nature scenery" as the theme and sets the display schedule to "every morning at 8:00." The server saves this setting, and every morning at 8:00, it requests the generation AI to generate "nature scenery" art. The generation AI receives the request and generates new nature scenery art. Once that is complete, the server delivers the generated art to the user's device. The device receives the new art and displays it in the frame. When the user views the art and provides feedback, that feedback is analyzed by the server and reflected in the next art generation.

[1363] This system allows users to easily enjoy new art on a daily basis without incurring high costs or hassle.

[1364] The processing flow will be explained below.

[1365] ---

[1366] Step 1:

[1367] User: Access the dedicated application or website, create an account, enter the required information (name, email address, password, etc.), and press the registration button.

[1368] Step 2:

[1369] Server: Saves the information entered by the user in a database. Sends a message to the user confirming successful registration.

[1370] Step 3:

[1371] User: After logging in, select your preferred theme (e.g., nature landscape, abstract painting, modern art, etc.) and then set the display schedule (e.g., daily, weekly, specific time, etc.).

[1372] Step 4:

[1373] Server: Stores user selections and settings in a database. Calculates the next art generation timing based on the display schedule.

[1374] Step 5:

[1375] Server: Sends art generation requests to the AI ​​according to a set schedule. For example, it requests that new art be generated every morning at 8am.

[1376] Step 6:

[1377] Generative AI: Receives requests and generates new art based on a given theme. Sends the generated art back to the server.

[1378] Step 7:

[1379] Server: The generated art is stored on the server and prepared for distribution to the user's device.

[1380] Step 8:

[1381] Server: Notifies the user device that the art is ready to be delivered. The notification includes a download link for the new art.

[1382] Step 9:

[1383] Device: Receives notifications from the server and downloads new art.

[1384] Step 10:

[1385] On your device: Display the downloaded art in your frame. Replace the existing art with the new art.

[1386] Step 11:

[1387] User: View new art displayed in the frame and provide feedback through a simple interface (e.g., "like," "neutral," "dislike," etc.).

[1388] Step 12:

[1389] Terminal: Collects user feedback and sends it to the server.

[1390] Step 13:

[1391] Server: Stores the received feedback in a database and reflects it in the next art generation.

[1392] Step 14:

[1393] Server: Analyzes user feedback and adjusts the parameters of the generation AI to reflect user preferences in the next art generation.

[1394] Step 15:

[1395] Server: Repeat the process of art generation and distribution based on the next display schedule.

[1396] ---

[1397] Example 1

[1398] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1399] Conventional art appreciation methods require users to select and configure artworks themselves, which is time-consuming and makes it difficult to enjoy new art according to the user's preferences and mood. Furthermore, updating and managing artworks is cumbersome, and there has been no system that generates art that reflects user feedback.

[1400] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1401] In this invention, the server includes a setting means for allowing a user to set a theme and display schedule that the user prefers, a generation means for the server to generate a prompt based on the specified theme and display schedule and generate art using a generative AI model, a distribution means for distributing the generated art to the user's device, a display means for the user's device to receive and display the art distributed from the server, a collection means for collecting user feedback and transmitting it to the server, and an analysis means for the server to analyze the feedback and reflect it in the next art generation. This allows users to automatically and easily enjoy new art according to their preferences, and art that further suits the user's preferences can be provided through the feedback.

[1402] The "user setting means" is a means by which a user accesses the system and sets his / her preferred theme and display schedule.

[1403] The "generation means" is a means by which the server generates prompt sentences based on the theme and display schedule set by the user and generates art using a generative AI model.

[1404] The "distribution means" is a means by which the server distributes the generated art to the user's terminal.

[1405] The "display means" is a means by which the user's terminal receives art distributed from the server and displays it on the display.

[1406] The "feedback collection means" is a means for collecting user feedback and sending it to the server.

[1407] The "feedback analysis means" is a means by which the server analyzes the feedback sent from the user and reflects it in the next art generation.

[1408] The "setting means" refers to means including an interface and software for allowing the user to set the theme and display schedule.

[1409] A "generative AI model" is an artificial intelligence model used by the server to automatically generate art based on a prompt.

[1410] A "prompt" is a text instruction that instructs a generative AI model to generate art based on a specific theme.

[1411] The present invention is a generative AI picture frame system that allows users to enjoy new art every day. The system includes a user setting means, a generation means, a distribution means, a display means, a feedback collection means, and a feedback analysis means.

[1412] User setting method

[1413] User: During initial setup, the user accesses a dedicated application or website and creates an account. The user selects a theme (e.g., nature landscapes, abstract paintings, modern art, etc.) and a display schedule (e.g., daily, weekly, specific time, etc.). This information is sent to the server and saved as a user profile.

[1414] generation means

[1415] Server: Based on the set schedule and theme, the server generates a prompt to be sent to the generative AI model. Based on this prompt, a generative AI model (e.g., OpenAI's DALL-E) is used to generate an artwork. For example, if the user selects "nature scenery," the prompt will be "Please generate art depicting a beautiful nature scene."

[1416] Delivery Method

[1417] Server: Stores the generated art and prepares it for distribution to the user's device. The server notifies the device that the art is ready for distribution and sends the URL and binary data of the generated art.

[1418] Display means

[1419] Device: Receives notification from the server and downloads new art. The device replaces the existing art with the new art and displays the new art on the display at the set time. For example, new nature scenery art will be automatically displayed on the frame every morning at 8:00.

[1420] Feedback collection methods

[1421] User: After viewing the displayed art, the user provides feedback through the application or website. Here, the user selects feedback such as "like," "average," or "dislike" and sends it to the server.

[1422] Feedback Analysis Methods

[1423] Server: Collects and analyzes the feedback sent by users. The analysis results are reflected in the next art generation, gradually providing art that matches the user's preferences. This feedback analysis process improves the accuracy of the art generation algorithm.

[1424] Specific examples

[1425] If a user wants to "set it up so that new nature scenery art is displayed every morning at 8:00," the user first selects "nature scenery" as the theme and sets the display schedule to "every morning at 8:00." The server saves this setting and sends a prompt to the generative AI model shortly before 8:00 each morning: "Please generate art depicting a beautiful nature scenery." The generative AI model receives the request and generates new nature scenery art. Once completed, the server delivers the generated art to the user's device. The device downloads the new art at 8:00 and displays it on the display. When the user views the art and provides feedback, the feedback is analyzed by the server and reflected in the next art generation.

[1426] This system allows users to enjoy new art every day without any effort. Furthermore, the next art generation is adjusted based on user feedback, so the system gradually provides art that matches the user's preferences.

[1427] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1428] Step 1: Account Creation and Initial Settings

[1429] User: During initial setup, access the dedicated application or website, click the "Create a new account" button, enter the required information, and press the submit button. Then, select "Nature Scenery" on the "Theme Selection" screen and "Every morning at 8:00" on the "Schedule Settings" screen. This setting information is sent to the server and saved as a user profile.

[1430] Input: User information (name, email address, etc.), theme selection information, display schedule information.

[1431] Output: User profile stored on the server.

[1432] Step 2: Art Creation Request

[1433] Server: Manages the timing of new art generation based on the display schedule set by the user. For example, if the schedule is set to display new art every morning at 8:00, the server prepares to send a prompt to the generation AI model shortly before that time. The prompt might be, "Please generate art depicting a beautiful natural landscape."

[1434] Input: The user's display schedule information.

[1435] Output: The prompt to send to the generative AI model.

[1436] Step 3: Art generation

[1437] Server: Sends the prompt to the generative AI model. The generative AI model (e.g., DALL-E) generates a new artwork based on the prompt and sends the result back to the server. The returned artwork is stored on the server.

[1438] Input: The prompt statement.

[1439] Output: Art files returned from the generative AI model.

[1440] Step 4: Art Delivery

[1441] Server: Stores the generated art file and prepares it for distribution to the user's device. The server notifies the user device that the art is ready to be distributed and sends the URL and binary data of the art file.

[1442] Input: Generated art files.

[1443] Output: Art file URL, notification message.

[1444] Step 5: Art receiving and display

[1445] Device: Analyzes the notification message received from the server and downloads the image data from the URL of the art file. After the download is complete, the new art replaces the existing art. The device automatically displays the new art on the display at the set time. For example, the latest nature landscape art will be displayed on the frame at 8:00 every morning.

[1446] Input: Art file URL, notification message.

[1447] Output: The new art to be displayed.

[1448] Step 6: Provide feedback

[1449] User: On the application's feedback screen, select "Like," "Average," or "Dislike" for the displayed art, then press the submit button. The feedback is sent to the server.

[1450] Input: User feedback.

[1451] Output: Feedback data sent to the server.

[1452] Step 7: Analyze the feedback

[1453] Server: Collects the received feedback data and stores it in a database. It then analyzes the feedback and reflects it in the next art generation, thereby adjusting the algorithm of the generative AI model to suit the user's preferences.

[1454] Input: Feedback data.

[1455] Output: Parsed feedback, updated parameters of the generative AI model.

[1456] Step 8: Schedule Management

[1457] Server: Manages the timing of the next art generation and distribution based on the display schedule set by the user. For example, if a user requests new art every morning at 8:00, the server automatically executes the process from sending prompts to distribution at that time.

[1458] Input: The user's viewing schedule.

[1459] Output: Sending prompts, generating art and scheduling delivery.

[1460] (Application example 1)

[1461] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1462] In a generative AI painting frame system that allows users to enjoy new art every day, it has been difficult to enhance the personalization of art display and the interactive user experience. Furthermore, there was a need for an efficient method for generating art that reflects user preferences. Furthermore, there was also a challenge in dynamically displaying art in a virtual space, providing an environment in which users could appreciate art with a more immersive feeling.

[1463] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1464] In this invention, the server includes a user setting means for allowing a user to set a theme and display schedule of their choice, an art generation means for the server to use a generative model based on the theme specified by the server, a distribution means for distributing the generated art to the user's terminal, a receiving and display means for the user's terminal to receive and display the art distributed from the server, a feedback collection means for collecting user feedback and transmitting it to the server, a feedback analysis means for the server to analyze the feedback and reflect it in the next art generation, and a virtual display means for displaying art in a virtual space using a head-mounted display. This allows users to immerse themselves in viewing art that suits their preferences in a virtual space and provide interactive feedback.

[1465] The "user setting means" is a function that allows the user to set a theme or display schedule of their choice.

[1466] A "generative model" is an algorithm or system that uses artificial intelligence to automatically generate art based on a specific theme.

[1467] "Art generation means" is a function that generates art using a generative model based on a set theme.

[1468] "Distribution means" is a function that transmits the generated art to the user's terminal.

[1469] The "receiving and displaying means" is a function that allows the user's terminal to receive and display art distributed from the server.

[1470] The "feedback collection means" is a function that allows users to input their evaluations and opinions about art and send them to the server.

[1471] The "feedback analysis means" is a function for analyzing collected user feedback and reflecting it in the next art creation.

[1472] "Virtual display means" is a function for displaying art in a virtual space using a head-mounted display.

[1473] A "prompt" is a textual instruction that gives a generative model specific thematic or stylistic instructions.

[1474] The "schedule management means" is a function that automatically manages the creation and distribution of art based on a display schedule set by the user.

[1475] The system of the present invention is a generative AI painting frame system that allows users to enjoy new art every day. This system includes a user setting unit, an art generation unit using a generative model, a distribution unit, a receiving and display unit, a feedback collection unit, a feedback analysis unit, a virtual display unit, and a schedule management unit.

[1476] User setting method

[1477] Users first create an account using a dedicated application or website, then select their preferred theme (e.g., nature landscapes, abstract paintings, modern art, etc.) and display schedule (e.g., daily, weekly, specific time, etc.), which is then sent to the server and saved as part of the user's settings.

[1478] Art Creation Method

[1479] The server generates art using a generative model based on a schedule set by the user and a selected theme. The generation AI generates an artwork that fits the specified theme and sends the generated art back to the server. For example, if the user selects the theme "natural scenery," the generation AI creates art depicting beautiful natural scenery. An example of a prompt required for generation is "Please generate art of a natural scenery."

[1480] Delivery Method

[1481] The server stores the generated art and prepares it for distribution to the user's terminal. The server notifies the user terminal that the art is ready for distribution.

[1482] Reception and display means

[1483] The user's device receives a notification from the server and downloads the new artwork. The device replaces the existing artwork with the new artwork and displays it in the frame. For example, a new artwork will automatically appear in the frame every morning at 8:00 AM.

[1484] Feedback collection methods

[1485] Users can provide feedback on the displayed art by selecting and submitting feedback such as "like," "average," or "dislike" through a simple interface.

[1486] Feedback Analysis Methods

[1487] The device collects user feedback and sends it to the server, which stores it in a database and reflects it in the next art generation. This allows the art to be generated more accurately based on the user's preferences.

[1488] Virtual Display Means

[1489] The system uses a head-mounted display (HMD) to display new artworks in a virtual space. Users can wear the HMD and explore the virtual gallery. This immersive environment allows users to view art in a more interactive way.

[1490] Schedule management tools

[1491] The server manages the schedule for generating and delivering art based on the display schedule set by the user. For example, if a user sets "display new art every day at 8 o'clock," the server will trigger the process of generating and delivering art every morning at 8 o'clock.

[1492] Specific examples

[1493] If a user wants to "set it so that new nature scenery art is displayed every morning at 8:00," they first select "nature scenery" as the theme and set the display schedule to "every morning at 8:00." The server saves this setting, and every morning at 8:00, it requests the generation AI to generate "nature scenery" art. The generation AI receives the request and generates new nature scenery art. Once generation is complete, the server distributes the generated art to the user's device. The device receives the new art and displays it in a virtual gallery using an HMD. Furthermore, if the user views the art and provides feedback, that feedback is analyzed by the server and reflected in the next art generation.

[1494] This system allows users to easily enjoy new art on a daily basis without incurring high costs or hassle.

[1495] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1496] Step 1:

[1497] User setting method

[1498] A user accesses a dedicated application or website and creates an account. Then, they select their preferred theme (e.g., nature landscapes, abstract paintings, modern art, etc.) and display schedule (e.g., daily, weekly, specific time, etc.). This information is sent as input to the server, which stores it in a user preference database. The output is the user's preference information.

[1499] Step 2:

[1500] Art Creation Method

[1501] The server generates a prompt statement to instruct the generative model based on the theme and display schedule set by the user. An example of a prompt statement is "Please generate art of a natural landscape." This prompt statement is sent as input to the generative AI. The generative AI generates an artwork based on the specified theme, and the generated art is sent back to the server. The output is the generated artwork.

[1502] Step 3:

[1503] Delivery Method

[1504] The server stores the generated art and prepares it for distribution to the user's device. As a distribution method, it sends a notification message containing the art's URL to the user's device. This notification arrives at the device as input, and the art's URL is output.

[1505] Step 4:

[1506] Reception and display means

[1507] The device receives a notification from the server, requests the art URL included in the notification message, and downloads the new art. The device uses this URL as input to retrieve the art data and display it in the frame. The output is a display of the new art.

[1508] Step 5:

[1509] Virtual Display Means

[1510] The user wears a head-mounted display (HMD) and views new art in a virtual space. The device displays a virtual gallery and applies the downloaded art to the environment. The input to this process is the new art data, and the output is the display of the art in the virtual space.

[1511] Step 6:

[1512] Feedback collection methods

[1513] Users provide feedback on the displayed art. Through a simple interface, they select feedback such as "like," "average," or "dislike," and send this as input to the terminal. The terminal then sends this feedback data to the server, and the output is user feedback.

[1514] Step 7:

[1515] Feedback Analysis Methods

[1516] The server receives the feedback data sent from the device and analyzes it using a feedback analysis program. The server updates the parameters of the generative model to reflect the analysis results in the next art generation. The input is user feedback, and the output is the updated parameters of the generative model.

[1517] Step 8:

[1518] Schedule management tools

[1519] The server manages the schedule for generating and distributing art based on the display schedule set by the user. At the time set by the user (e.g., 8:00 a.m. every morning), the server automatically requests the generation AI to generate new art and starts the process of distributing the generated art to the user's device. The input is the user's display schedule, and the output is the execution of generating and distributing new art.

[1520] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1521] ---

[1522] The system of the present invention is a generative AI painting frame system that allows users to enjoy new art every day. The system includes a user setting unit, an art generation unit, a distribution unit, a receiving and display unit, a feedback collection unit, a feedback analysis unit, a schedule management unit, and an emotion engine unit.

[1523] User setting method

[1524] User: During initial setup, access the dedicated application or website to create an account. Enter the required information (name, email address, password, etc.) and press the registration button.

[1525] Server: Stores the information entered by the user in a database and sends the user a message confirming successful registration.

[1526] User: After logging in, select your preferred theme (e.g., nature landscape, abstract painting, modern art, etc.) and then set the display schedule (e.g., daily, weekly, specific time, etc.).

[1527] Server: Saves user selections and settings in a database and calculates the next art generation timing based on the display schedule.

[1528] Art Creation Method

[1529] Server: Sends art generation requests to the AI ​​according to a set schedule, for example, requesting new art to be generated every morning at 8am.

[1530] Generative AI: Receives requests and generates new art based on a given theme. Sends the generated art back to the server.

[1531] Delivery Method

[1532] Server: The generated art is stored on the server and prepared for distribution to the user's device.

[1533] Server: Notifies the user device that the art is ready to be delivered. The notification includes a download link for the new art.

[1534] Reception and display means

[1535] Device: Receives notifications from the server and downloads new art.

[1536] On your device: Display the downloaded art in your frame, replacing the existing art with the new art.

[1537] Feedback collection methods

[1538] User: View new art displayed in the frame and provide feedback through a simple interface (e.g., "like," "neutral," "dislike," etc.).

[1539] Terminal: Collects user feedback and sends it to the server.

[1540] Feedback Analysis Methods

[1541] Server: Stores the received feedback in a database and reflects it in the next art generation.

[1542] Server: Analyzes feedback and adjusts the parameters of the generation AI to reflect user preferences in the next art generation.

[1543] Schedule management tools

[1544] Server: Manages and repeats the art generation and delivery process based on a display schedule set by the user.

[1545] Emotion Engine Means

[1546] Device: Analyzes the user's facial expressions, voice, and body movements to recognize their emotions.

[1547] Server: Receives the emotion recognition results sent from the emotion engine means and stores them in a database.

[1548] Server: Adjusts the customizable parameters of the Generator AI based on the results of emotion recognition. For example, if the user expresses happiness, the Generator AI is instructed to generate art with a bright, positive theme. Conversely, if the user expresses stress, the AI ​​is adjusted to generate art with a more relaxing theme.

[1549] Specific examples

[1550] If a user wants to "set it so that new nature scenery art is displayed every morning at 8:00," the user first selects "nature scenery" as the theme and sets the display schedule to "every morning at 8:00." The server saves this setting, and every morning at 8:00, it requests the generation AI to generate "nature scenery" art. The generation AI receives the request and generates new nature scenery art. Once this is complete, the server delivers the generated art to the user's device. The device receives the new art and displays it in the frame. When the user appreciates the art and provides feedback, the feedback is analyzed by the server and reflected in the next art generation. Furthermore, the emotion engine means recognizes the user's emotions and sends the emotion data to the server, so that the user's emotional state is reflected in the art generation.

[1551] This system not only allows users to easily enjoy new art every day without incurring high costs or hassle, but also provides them with art that matches their emotional state.

[1552] The processing flow will be explained below.

[1553] ---

[1554] Step 1:

[1555] User: Access the dedicated application or website, create an account, enter the required information (name, email address, password, etc.), and press the registration button.

[1556] Step 2:

[1557] Server: Saves the information entered by the user in a database. Sends a message to the user confirming successful registration.

[1558] Step 3:

[1559] User: After logging in, select your preferred theme (e.g., nature landscape, abstract painting, modern art, etc.) and then set the display schedule (e.g., daily, weekly, specific time, etc.).

[1560] Step 4:

[1561] Server: Stores user selections and settings in a database and calculates the next art generation timing based on the display schedule.

[1562] Step 5:

[1563] Server: Sends art generation requests to the AI ​​according to a set schedule, for example, requesting new art to be generated every morning at 8am.

[1564] Step 6:

[1565] Generative AI: Receives requests and generates new art based on a given theme. Sends the generated art back to the server.

[1566] Step 7:

[1567] Server: The generated art is stored on the server and prepared for distribution to the user's device.

[1568] Step 8:

[1569] Server: Notifies the user device that the art is ready to be delivered. The notification includes a download link for the new art.

[1570] Step 9:

[1571] Device: Receives notifications from the server and downloads new art.

[1572] Step 10:

[1573] On your device: Display the downloaded art in your frame, replacing the existing art with the new art.

[1574] Step 11:

[1575] Device: Uses built-in cameras and microphones to analyze the user's facial expressions, voice, and body movements to recognize the user's emotions.

[1576] Step 12:

[1577] Device: Sends the recognized emotion data to the server.

[1578] Step 13:

[1579] User: View new art displayed in the frame and provide feedback through a simple interface (e.g., "like," "neutral," "dislike," etc.).

[1580] Step 14:

[1581] Terminal: Collects user feedback and sends it to the server.

[1582] Step 15:

[1583] Server: Stores the received feedback in a database and reflects it in the next art generation.

[1584] Step 16:

[1585] Server: Receives the emotion recognition results sent from the emotion engine means and stores them in a database.

[1586] Step 17:

[1587] Server: Adjusts customizable parameters of the Generative AI based on the results of emotion recognition. For example, if the user expresses happiness, the Generative AI can be instructed to generate art with a bright, positive theme.

[1588] Step 18:

[1589] Server: Repeat the process of art generation and distribution based on the next display schedule.

[1590] ---

[1591] Example 2

[1592] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1593] Conventional art frame systems have the drawback of requiring users to manually select new art, which is inconvenient. They also have difficulty reflecting user feedback and emotions, making it impossible to provide optimal art for each individual user.

[1594] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1595] In this invention, the server includes a user setting means for a user to set a preferred theme and display schedule, an art generation means for sending an art generation request to the generation AI based on the set display schedule, a generation AI means for the generation AI to generate art based on a prompt text, a distribution means for sending the generated art to the user's terminal, a receiving and display means for the user's terminal to receive and display the art distributed from the server, a feedback collection means for collecting user feedback and sending it to the server, a feedback analysis means for the server to analyze the feedback and reflect it in the next art generation, and an emotion recognition means for recognizing the user's emotions and sending it to the server. This allows users to automatically enjoy optimal art that suits their individual preferences and emotions without having to manually select art.

[1596] The "user setting means" is a means for a user to set a preferred theme and display schedule.

[1597] The "art generation means" is a means by which the server sends an art generation request to the generation AI based on a set display schedule.

[1598] "Generative AI means" refers to the means by which the generative AI generates art based on a prompt.

[1599] The "distribution means" is a means for distributing the generated art to the user's terminal.

[1600] The "receiving and displaying means" is a means by which the user's terminal receives and displays art distributed from the server.

[1601] The "feedback collection means" is a means for collecting user feedback and transmitting it to the server.

[1602] The "feedback analysis means" is a means for analyzing the feedback received by the server and reflecting it in the next art generation.

[1603] The "emotion recognition means" is a means for recognizing the user's emotions and transmitting them to the server.

[1604] The "schedule management means" is a means for automatically managing the process of generating and distributing art based on a display schedule set by the user.

[1605] The system of the present invention is a generative AI picture frame system that allows users to enjoy new art every day. This system includes a user setting unit, an art generation unit, a generative AI unit, a distribution unit, a receiving and display unit, a feedback collection unit, a feedback analysis unit, an emotion recognition unit, and a schedule management unit.

[1606] User setting method

[1607] User: During initial setup, access the dedicated application or website to create an account. Enter the required information (name, email address, password, etc.) and press the registration button.

[1608] Server: Stores the information entered by the user in a database and sends the user a message confirming successful registration.

[1609] User: After logging in, select your preferred theme (e.g., nature landscape, abstract painting, modern art, etc.) and then set the display schedule (e.g., daily, weekly, specific time, etc.).

[1610] Server: Stores user selections and settings in a database and calculates the next art generation timing based on the display schedule.

[1611] Art Creation Method

[1612] Server: Sends art generation requests to the AI ​​according to a set schedule, for example, requesting new art to be generated every morning at 8am.

[1613] Generative AI: Receives requests and generates new art based on a given theme. Sends the generated art back to the server.

[1614] Generation AI means

[1615] Generative AI model: Generates art based on prompts sent from the server. This generative AI model uses an existing database to generate images that correspond to the prompts.

[1616] Delivery Method

[1617] Server: The generated art is stored on the server and prepared for distribution to the user's device.

[1618] Server: Notifies the user device that the art is ready to be delivered. The notification includes a download link for the new art.

[1619] Reception and display means

[1620] Device: Receives notifications from the server and downloads new art.

[1621] On your device: Display the downloaded art in your frame, replacing the existing art with the new art.

[1622] Feedback collection methods

[1623] User: View new art displayed in the frame and provide feedback through a simple interface (e.g., "like," "neutral," "dislike," etc.).

[1624] Terminal: Collects user feedback and sends it to the server.

[1625] Feedback Analysis Methods

[1626] Server: Stores the received feedback in a database and reflects it in the next art generation.

[1627] Server: Analyzes feedback and adjusts the parameters of the generation AI to reflect user preferences in the next art generation.

[1628] emotion recognition means

[1629] Device: Analyzes the user's facial expressions, voice, and body movements to recognize their emotions.

[1630] Server: Receives the emotion recognition results sent from the emotion engine means and stores them in a database.

[1631] Server: Adjusts the customizable parameters of the AI ​​based on the emotion recognition results. For example, if the user expresses happiness, the AI ​​can be instructed to generate art with a bright, positive theme. Conversely, if the user expresses stress, the AI ​​can be adjusted to generate art with a more relaxing theme.

[1632] Schedule management tools

[1633] Server: Manages and repeats the art generation and delivery process based on a display schedule set by the user.

[1634] Specific examples

[1635] If a user wants to "set it so that new nature scenery art is displayed every morning at 8:00," the user first selects "nature scenery" as the theme and sets the display schedule to "every morning at 8:00." The server saves this setting, and every morning at 8:00, it requests the generation AI to generate "nature scenery" art. The generation AI receives the request and generates new nature scenery art. Once this is complete, the server delivers the generated art to the user's device. The device receives the new art and displays it in the frame. When the user appreciates the art and provides feedback, the feedback is analyzed by the server and reflected in the next art generation. Furthermore, the emotion engine means recognizes the user's emotions and sends the emotion data to the server, so that the user's emotional state is reflected in the art generation.

[1636] Prompt Sentence Examples

[1637] "Create a summer morning landscape that incorporates elements of natural scenery. It would be nice to have a slightly refreshing breeze."

[1638] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1639] Step 1: User Setup

[1640] User: Accesses a dedicated application or website and creates an account by entering their name, email address, password, etc., and pressing the registration button.

[1641] Input: User's name, email address, and password

[1642] Output: User information sent to the server

[1643] Server: Receives the information entered by the user and stores it in a database. If registration is successful, sends a confirmation email.

[1644] Input: User information

[1645] Output: Send confirmation email

[1646] Users: You will receive a confirmation email and click the link to activate your account. After logging in, you can set your preferred theme and display schedule.

[1647] Input: Confirmation email link, theme, schedule

[1648] Output: Sends the configuration to the server

[1649] Step 2: Submit an art generation request

[1650] Server: Sends art generation requests to the AI ​​based on a set display schedule. For example, it sends a request to generate new art every morning at 8:00.

[1651] Input: User's theme and schedule settings, current time

[1652] Output: Request to the generation AI

[1653] Step 3: Generate Art

[1654] Generation AI: Receives requests from the server and generates new art based on a prompt (e.g., "Generate a summer morning landscape incorporating natural landscape elements.") and sends the generated art back to the server.

[1655] Input: prompt statement

[1656] Output: Generated art

[1657] Server: Receives the generated art and stores it in a database.

[1658] Input: Generated art

[1659] Output: Save to database

[1660] Step 4: Prepare your art for distribution

[1661] Server: Prepares the generated art for distribution to the user's device. Notifies the user's device that the art is ready for distribution, and the notification includes a download link for the new art.

[1662] Input: Art stored in the database

[1663] Output: Delivery notification

[1664] Step 5: Receive and display your art

[1665] Device: Receives notification from the server, downloads new art, and displays the new art in the Smart Art Frame after the download is complete.

[1666] Input: Delivery notification, download link

[1667] Output: Display of new art

[1668] Step 6: Gather feedback

[1669] Users: Use a simple interface to view new art and provide feedback, for example by pressing buttons such as "like," "neutral," or "dislike."

[1670] Input: Feedback (like, neutral, dislike)

[1671] Output: Send feedback to the device

[1672] Terminal: Receives user feedback and sends it to the server.

[1673] Input: User feedback

[1674] Output: Send feedback to the server

[1675] Step 7: Analyze feedback

[1676] Server: Receives feedback data and stores it in a database. Analyzes the feedback and adjusts the parameters of the generation AI to reflect the user's preferences the next time art is generated.

[1677] Input: Feedback data

[1678] Output: Analysis results and new parameter settings for the generated AI

[1679] Step 8: Emotion Recognition

[1680] Device: Analyzes the user's facial expressions, voice, and body movements to recognize emotions. Captures data using a camera and microphone.

[1681] Input: Facial expressions, voice, body movements

[1682] Output: Emotion data

[1683] Server: Receives emotion data and stores it in a database. Based on this data, the parameters of the AI ​​are adjusted to generate art that matches the user's emotional state.

[1684] Input: Emotion data

[1685] Output: New parameter settings for the generated AI

[1686] The above is a description of the specific processing flow of each step, the specific operations performed at each step, and the inputs and outputs.

[1687] (Application example 2)

[1688] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1689] Conventional displays and signage art in brick-and-mortar stores have the drawback of being time-consuming and expensive to frequently change once-installed content, making it difficult to provide a personalized experience that matches the customer's expressions and emotions. This invention solves these challenges and provides a method for providing a more personalized and engaging store experience by dynamically generating and displaying art based on customer feedback and emotional data.

[1690] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a user setting means for a user to set a preferred theme and display schedule; an art generation means for the server to generate art based on the specified theme; a distribution means for distributing the generated art to the user's terminal; a receiving and display means for the user's terminal to receive and display the art distributed from the server; a feedback collection means for collecting user feedback and transmitting it to the server; a feedback analysis means for the server to analyze the feedback and reflect it in the next art generation; an emotion engine means for analyzing customers' facial expressions, voices, and body movements to collect emotion data; and a display means for displaying art on an in-store display or digital signage. This makes it possible to dynamically and personally change the display content in a physical store and display attractive art based on customer interactions.

[1691] The "user setting means" is a means for a user to set a preferred theme and display schedule.

[1692] The "art generation means" is a means by which the server generates art based on a specified theme.

[1693] The "distribution means" is a means for distributing the generated art to the user's terminal.

[1694] The "receiving and displaying means" is a means by which the user's terminal receives and displays art distributed from the server.

[1695] The "feedback collection means" is a means for collecting user feedback and sending it to the server.

[1696] The "feedback analysis means" is a means by which the server analyzes the feedback and reflects it in the next art generation.

[1697] The "emotion engine means" is a means for analyzing the facial expressions, voice, and body movements of the customer to collect emotional data.

[1698] "Display means" refers to a means for displaying art on an in-store display or digital signage.

[1699] The present invention is a system that enables dynamic art display based on customer feedback and emotional data in physical stores. This system is composed of several tools, each of which plays a specific role.

[1700] User setting method

[1701] User: The store manager first creates an account in a dedicated management application and sets their preferred theme (e.g., modern art, abstract paintings, etc.) and display schedule (e.g., refresh every morning at 10 a.m.). This setting information is sent to the server and stored in a database.

[1702] Art Creation Method

[1703] Server: Based on a set schedule, it sends art generation requests to a generative AI model (e.g., GPT-4's image generation engine). The generative AI generates new art based on a specified theme and sends the results back to the server.

[1704] Delivery Method

[1705] Server: Stores the generated artwork in cloud storage, generates a URL link to distribute it to the user's device, and notifies the display device in the store of this link, preparing the artwork for display.

[1706] Reception and display means

[1707] Terminal: The display device receives the URL link sent from the server, downloads the new art, and displays it. Once the display is complete, the new art replaces the existing art.

[1708] Feedback collection methods

[1709] Users and devices: Customer feedback is collected through camera sensors and survey terminals installed around the displays in the store. Feedback includes simple evaluations (e.g., "like," "average," "dislike," etc.). This feedback data is sent to the server.

[1710] Feedback Analysis Methods

[1711] Server: The feedback data is stored in a database and analyzed using machine learning tools (e.g., Scikit-learn) to reflect it in the next art generation. The parameters of the generation AI are adjusted based on the analysis results.

[1712] Emotion Engine Means

[1713] Terminal: Emotional data is collected using image recognition technology (e.g., OpenCV) to analyze the customer's facial expressions, voice, and physical movements. The collected emotional data is sent to the server and is reflected in the next art generation.

[1714] Display Means

[1715] Terminal: In-store displays or digital signage display the art delivered from the server for customers to view. The displayed art changes dynamically based on collected feedback and sentiment data.

[1716] Specific examples

[1717] If a store manager sets the theme to "modern art" and schedules new art to be displayed every morning at 10:00, they will first send a prompt to GPT-4 to generate a "modern art digital painting."

[1718] Example prompt: "Generate a modern art style digital painting with vibrant colors and abstract shapes."

[1719] The generated art is displayed on displays within the store, where customers can view it. Customers provide feedback on their impressions through questionnaires and facial expression analysis, and this data is reflected in the next art generation. This ensures that the in-store display content is always up-to-date and personalized, improving the customer experience.

[1720] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1721] Program Processing Steps

[1722] Step 1:

[1723] Input: Store managers create an account using a dedicated management application and input their preferred themes and display schedules.

[1724] Data processing: The management application converts the input data into a format suitable for storage in the database.

[1725] Output: The server receives these data and stores them in a database.

[1726] Specific operation: The store manager sets the theme "Modern Art" and the display schedule "Every morning at 10:00" in the management app, and sends the setting information to the server. The server saves the setting data in the database.

[1727] Step 2:

[1728] Input: Based on the display schedule, the server knows that the next display update is approaching.

[1729] Data processing: The server reads the saved configuration information and generates prompts to be given to the generative AI model.

[1730] Output: Sends a new art generation request to the generative AI model.

[1731] Specific operation: The server prepares a prompt to generate a "modern art digital painting" based on a schedule and sends it to the generation AI.

[1732] Example prompt: "Generate a modern art style digital painting with vibrant colors and abstract shapes."

[1733] Step 3:

[1734] Input: A generative AI model receives a prompt and generates new art.

[1735] Data calculation: The generative AI model generates image data based on the specified theme and prompt.

[1736] Output: Send the generated art back to the server.

[1737] Specific operation: A generative AI model (e.g., GPT-4) generates modern art based on instructions and sends the image data to a server.

[1738] Step 4:

[1739] Input: The server receives the generated art.

[1740] Data processing: Save the generated art to cloud storage and generate a URL link.

[1741] Output: Sends the URL link to the store's display terminal.

[1742] Specific operation: The server saves the generated art in cloud storage, generates a URL for it, and sends it to the store's display terminal.

[1743] Step 5:

[1744] Input: The display device receives the URL link sent from the server.

[1745] Data processing: The display device downloads new art from the link.

[1746] Output: The downloaded art is displayed on the screen.

[1747] What happens: The display device receives the URL for the new art, downloads it, and displays it, replacing the existing art with the new art.

[1748] Step 6:

[1749] Input: Customers view the displayed art and provide feedback via survey terminals or camera sensors.

[1750] Data processing: Feedback is converted into digital format and sent to a server.

[1751] Output: The collected feedback data is stored on the server.

[1752] Specific operation: Customers use a survey terminal to select "like," "neutral," or "dislike," or the camera sensor recognizes facial expressions and automatically collects feedback.

[1753] Step 7:

[1754] Input: The server receives the collected feedback data.

[1755] Data calculation: Stored in a database and analyzed using machine learning tools (e.g., Scikit-learn).

[1756] Output: The analysis results are reflected in the next parameter setting of the generative AI model.

[1757] How it works: The server saves the feedback data and analyzes it with an analysis tool. Based on the analysis results, the parameters of the next piece of art generated by the AI ​​are adjusted.

[1758] Step 8:

[1759] Input: Real-time analysis of customer facial expressions and behavior is performed by camera sensors.

[1760] Data calculation: Image recognition tools (e.g., OpenCV) analyze facial expressions and behaviors to generate emotion data.

[1761] Output: Emotion data is sent to the server and stored.

[1762] How it works: Cameras installed in stores capture customers' facial expressions, and an analysis tool generates emotional data, which is then sent to a server and stored in a database.

[1763] This detailed processing step allows in-store displays to dynamically update based on customer feedback and sentiment, providing a personalized art experience.

[1764] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1765] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1766] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1767] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1768] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1769] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1770] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1771] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1772] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1773] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1774] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1775] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1776] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1777] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1778] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1779] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1780] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1781] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1782] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1783] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1784] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1785] The following is further disclosed regarding the above embodiment.

[1786] ---

[1787] (Claim 1)

[1788] a user setting means for allowing a user to set a preferred theme and display schedule;

[1789] an art generation means for generating art based on a designated theme by the server;

[1790] a distribution means for distributing the generated art to a user's terminal;

[1791] a receiving and displaying means for receiving and displaying the art distributed by the server at the user's terminal;

[1792] a feedback collection means for collecting user feedback and transmitting it to a server;

[1793] A feedback analysis means for the server to analyze the feedback and reflect it in the next art generation;

[1794] A system including:

[1795] (Claim 2)

[1796] 10. The system of claim 1, wherein the art generation means generates the art using customizable parameters based on user preferences.

[1797] (Claim 3)

[1798] 2. The system according to claim 1, further comprising a schedule management means for automatically updating the art based on a display schedule set by a user.

[1799] "Example 1"

[1800] (Claim 1)

[1801] a setting means for allowing a user to set a preferred theme and display schedule;

[1802] a generation means for generating a prompt sentence based on a theme and a display schedule specified by the server, and generating art using a generative AI model;

[1803] a distribution means for distributing the generated art to a user's terminal;

[1804] a display means for receiving and displaying the art distributed by the server on the user's terminal;

[1805] a collection means for collecting and transmitting user feedback to a server;

[1806] The server analyzes the feedback and reflects it in the next art generation.

[1807] A system including:

[1808] (Claim 2)

[1809] 10. The system of claim 1, wherein the art generation means generates the art using customizable parameters based on user preferences.

[1810] (Claim 3)

[1811] 10. The system of claim 1, further comprising a management means for automatically updating the art based on a display schedule set by a user.

[1812] "Application Example 1"

[1813] (Claim 1)

[1814] a user setting means for allowing a user to set a preferred theme and display schedule;

[1815] an art generation means using a generative model that generates art based on a specified theme;

[1816] a distribution means for distributing the generated art to a user's terminal;

[1817] a receiving and displaying means for receiving and displaying the art distributed by the server at the user's terminal;

[1818] a feedback collection means for collecting user feedback and transmitting it to a server;

[1819] A feedback analysis means for the server to analyze the feedback and reflect it in the next art generation;

[1820] a virtual display means for displaying art in a virtual space using a head-mounted display;

[1821] A system including:

[1822] (Claim 2)

[1823] 10. The system of claim 1, wherein the art generating means generates the art using customizable parameters and prompts based on user preferences.

[1824] (Claim 3)

[1825] 2. The system according to claim 1, further comprising a schedule management means for automatically updating the art based on a display schedule set by a user.

[1826] "Example 2: Combining Emotion Engines"

[1827] (Claim 1)

[1828] a user setting means for allowing a user to set a preferred theme and display schedule;

[1829] an art generation means for transmitting an art generation request to the generation AI based on a display schedule set by the server;

[1830] a generation AI means for generating art based on a prompt;

[1831] a distribution means for distributing the generated art to a user's terminal;

[1832] a receiving and displaying means for receiving and displaying the art distributed by the server at the user's terminal;

[1833] a feedback collection means for collecting user feedback and transmitting it to a server;

[1834] A feedback analysis means for the server to analyze the feedback and reflect it in the next art generation;

[1835] emotion recognition means for recognizing an emotion of a user and transmitting the emotion to a server;

[1836] A system including:

[1837] (Claim 2)

[1838] 10. The system of claim 1, wherein the art generation means generates the art using customizable parameters based on user preferences.

[1839] (Claim 3)

[1840] 2. The system according to claim 1, further comprising a schedule management means for automatically updating the art based on a display schedule set by a user.

[1841] "Application example 2 when combining emotion engines"

[1842] (Claim 1)

[1843] a user setting means for allowing a user to set a preferred theme and display schedule;

[1844] an art generation means for generating art based on a designated theme by the server;

[1845] a distribution means for distributing the generated art to a user's terminal;

[1846] a receiving and displaying means for receiving and displaying the art distributed by the server at the user's terminal;

[1847] a feedback collection means for collecting user feedback and transmitting it to a server;

[1848] A feedback analysis means for the server to analyze the feedback and reflect it in the next art generation;

[1849] an emotion engine means for analyzing the facial expressions, voice, and body movements of the customer to collect emotion data;

[1850] a display means for displaying the art on an in-store display or digital signage;

[1851] A system including:

[1852] (Claim 2)

[1853] 10. The system of claim 1, wherein the art generation means generates the art using customizable parameters based on user preferences.

[1854] (Claim 3)

[1855] 2. The system according to claim 1, further comprising a schedule management means for automatically updating the art based on a display schedule set by a user. [Explanation of symbols]

[1856] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a user setting means for allowing a user to set a preferred theme and display schedule; an art generation means for generating art based on a designated theme by the server; a distribution means for distributing the generated art to a user's terminal; a receiving and displaying means for receiving and displaying the art distributed by the server at the user's terminal; a feedback collection means for collecting user feedback and transmitting it to a server; A feedback analysis means for the server to analyze the feedback and reflect it in the next art generation; A system including:

2. 10. The system of claim 1, wherein the art generating means generates the art using customizable parameters based on user preferences.

3. 2. The system according to claim 1, further comprising a schedule management means for automatically updating the art based on a display schedule set by a user.

Images