System
The system addresses the challenge of users finding suitable artworks and creators marketing their works by enabling account creation, AI-driven recommendations, and seamless purchase processes, improving user and creator experiences.
Patent Information
- Application Number
- JP2024118978
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-24
- Publication Date
- 2026-02-05
AI Technical Summary
General users struggle to discover artworks that suit their tastes, while creators lack the knowledge and resources to effectively market their works, leading to poor sales.
A system that allows users to create accounts, view recommended artworks based on their preferences, and purchase them easily, while creators can submit their artworks to an AI engine for analysis and distribution to a wide audience.
Facilitates easy discovery and purchase of suitable artworks for users and effective distribution of creator works, enhancing user satisfaction and creator visibility.
Smart Images

Figure 2026017917000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] In the traditional art purchasing process, there is a problem in that general users do not know how to discover artworks that suit their tastes. On the other hand, even if creators produce high-quality works, they lack the knowledge and resources to effectively bring them to the market, and as a result, their works do not sell well. There is a need for a new platform that can solve these problems and efficiently connect art lovers and creators. [Means for solving the problem]
[0005] The present invention provides the following means: a system including a means for a user to create an account and log in, a means for a creator to submit artwork and transmit the artwork data to a server, a means for the server to transmit the received artwork data to an AI engine, which analyzes the artwork and extracts its features, a means for the server to generate a profile based on the user's past history and recommend artworks based on the user's preferences, a means for the user to view the recommended artworks and complete the product purchase procedure, and a means for the server to notify creators of artwork sales and issue shipping instructions. This system provides a process for users to easily discover and purchase artworks that match their sensibilities, while at the same time enabling creators to effectively distribute their works to a wide range of users.
[0006] "User" means an individual or organization that uses the Platform to view, receive recommendations for, and purchase artworks.
[0007] "Creators" are artists and creators who use the platform to exhibit their artworks and make them available to users.
[0008] "Account" means the registration and login information required for a User or Creator to access and use the Platform.
[0009] "Server" means a computer system that receives, stores, and processes user and creator data and communicates with the AI Engine.
[0010] An "AI engine" is an artificial intelligence that analyzes received art data, extracts its features, and makes recommendations based on the user's preferences.
[0011] A "profile" is a data set that indicates a user's preferences and tastes, generated based on data such as the user's past browsing history and purchase history.
[0012] "Recommendation" refers to the AI engine suggesting artworks to users based on their profile.
[0013] "Artworks" refer to artworks such as paintings, sculptures, and photographs created by creators and exhibited on the platform.
[0014] "Checkout" refers to the process by which a user confirms detailed information about an artwork and enters payment information to actually purchase the artwork.
[0015] A "shipping instruction" is a notification from the server to the creator instructing them to ship the artwork purchased by the user. [Brief explanation of the drawings]
[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0018] First, the terms used in the following description will be explained.
[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0024] [First embodiment]
[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0037] The present invention relates to an AI-based recommendation platform for connecting art lovers and creators. The system of the present invention allows users to easily discover and purchase artworks that suit their tastes, and also allows creators to reach a wide audience with their artworks. The following describes an embodiment of the present invention.
[0038] System Configuration
[0039] The system of the present invention consists of the following major components:
[0040] 1. User device: A device (PC, smartphone, tablet, etc.) that a user uses to create an account, log in, view artworks, check recommendations, and complete purchases.
[0041] 2. Creator device: A device that allows creators to create accounts, log in, and exhibit their artworks.
[0042] 3. Server: A central computer system that receives, processes, and stores information from users and creators. The server also communicates with the AI engine to generate artwork recommendations for users.
[0043] 4. AI Engine: An artificial intelligence system that analyzes data on artworks and extracts their characteristics. Based on the extracted characteristics, it matches them with the user's profile and generates recommendations.
[0044] User usage process
[0045] 1. Account creation and login: When a user uses the platform for the first time, they create an account. After entering the required information (such as name, email address, and password) from the user's device, the server receives this information and stores it in the database. A success notification is sent to the user's device, and the user is redirected to the login page. Next, the user enters their registered email address and password to log in.
[0046] 2. Viewing and Recommending Artworks: After logging in, users access the artwork viewing page on the platform. The server profiles the user's preferences based on their past browsing and purchase history, and uses an AI engine to recommend art works that suit the user. The list of recommended works is displayed on the user's device.
[0047] 3. Purchasing an artwork: When the user selects the artwork they wish to purchase from the recommended artworks and clicks the "Purchase" button on the details page, the server redirects them to a page where they can enter their payment information. The user then enters the necessary payment information and completes the payment process.
[0048] Creator usage process
[0049] 1. Create an account and log in: Creators also create an account on the platform and log in.
[0050] 2. Artwork listing: When a creator wants to list their work, they enter information such as an image, title, description, and price on their device and click the "List" button. The server receives this information and stores it in a database. At the same time, the work data is sent to an AI engine, which analyzes the work and extracts its features.
[0051] Recommendations and the purchase process
[0052] 1. AI analysis: The AI engine analyzes the images and descriptions of artworks submitted by creators and extracts features such as color, style, and theme. This feature information is stored in a database.
[0053] 2. Recommendations to users: The server compares the user's profile with the feature information of the works extracted by the AI engine to generate a list of recommended works. This list of recommended works is displayed on the user's device, and the user can select, view, and purchase works that interest them.
[0054] 3. Purchase procedure: When the user enters payment information on the details page of the work they have decided to purchase and completes the payment procedure, the server notifies the creator of the successful purchase. A sales notification and shipping instructions for the work are sent to the creator.
[0055] As a concrete example, consider the case where a user who likes abstract paintings uses this system. After logging in, the user browses abstract paintings recommended based on features extracted by the AI engine from their past browsing history, and then purchases one of them. If the purchase is successful, a notification is sent to the creator, and the work is delivered to the user. This entire process is carried out smoothly by the system of the present invention.
[0056] This allows users to easily find and purchase artwork that suits their tastes, and allows creators to promote their work to a large number of potential customers.
[0057] The processing flow will be explained below.
[0058] Step 1:
[0059] User device: The user accesses the account creation page, enters the required information such as name, email address, and password, and clicks the "Register" button.
[0060] Step 2:
[0061] Server: Receives the information sent by the user and checks that the input does not overlap with existing data. If there are no duplicates, saves the user's information in the database and sends a notification of successful account creation to the user's device. If there are duplicates, sends an error message.
[0062] Step 3:
[0063] User device: After receiving notification from the server, if the account creation is successful, the user will be redirected to the login page.
[0064] Step 4:
[0065] User device: Access the login page, enter the registered email address and password, and click the "Login" button.
[0066] Step 5:
[0067] Server: Checks the email address and password entered by the user against a database, and if authentication is successful, starts a session and redirects the user to the home page. If authentication fails, sends an error message to the user's terminal.
[0068] Step 6:
[0069] Creator terminal: Creators log in to their account and access the work listing page.
[0070] Step 7:
[0071] Creator's terminal: Enter the necessary information such as the image file, title, description, and price of the work, and click the "List" button.
[0072] Step 8:
[0073] Server: Receives the work data sent by the creator and stores it in a database. After storing it, it sends the work data to the AI engine and requests analysis.
[0074] Step 9:
[0075] AI engine (on the server): Analyzes the images and descriptions of the artwork received, extracts features such as color, style, and theme, and stores the results in a database.
[0076] Step 10:
[0077] Server: When a user accesses an art browsing page, a user profile is generated based on the user's past browsing history and purchase history.
[0078] Step 11:
[0079] Server: The AI engine compares the extracted feature information of the artwork with the user's profile and generates a list of recommended artworks that match the user's preferences.
[0080] Step 12:
[0081] Server: Sends the generated recommendation list to the user terminal.
[0082] Step 13:
[0083] User device: The user receives a list of recommended artworks and clicks on the artwork of interest to view more information.
[0084] Step 14:
[0085] User device: Click the "Purchase" button on the details page of the work you want to purchase.
[0086] Step 15:
[0087] Server: Receives the purchase request and redirects to a page where payment information is entered.
[0088] Step 16:
[0089] User device: Enter payment information (such as credit card information) and click the "Pay" button.
[0090] Step 17:
[0091] Server: Receives payment information and sends it to the payment service to process the payment.
[0092] Step 18:
[0093] Payment Service: Processes the payment information and notifies the server of success or failure.
[0094] Step 19:
[0095] Server: If the payment is successful, a purchase completion message is sent to the user's device and the creator is notified of the sale of the work and shipping instructions. If the payment is unsuccessful, an error message is sent to the user's device.
[0096] Step 20:
[0097] Creator device: Receives purchase notifications and prepares purchased works for shipping.
[0098] Example 1
[0099] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0100] In today's art market, it is difficult for art lovers to easily find and purchase works that suit their tastes. It is also difficult for creators to reach a wide audience. In this situation, a system is needed to efficiently connect art lovers and creators.
[0101] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0102] In this invention, the server includes: means for users to create accounts and log in; means for creators to submit artworks and transmit artwork data to a central processing unit; means for the central processing unit to transmit the received artwork data to an artificial intelligence engine, which analyzes the artworks and extracts features; means for the central processing unit to generate a profile based on the user's past history and recommend artworks based on the user's preferences; means for users to view the recommended artworks and complete the product purchase procedure; means for the central processing unit to notify the creator of artwork sales and issue shipping instructions; means for the user terminal to send an HTTP POST request to the server and exchange account information and payment information; and means for the central processing unit to process payments using a payment gateway API and notify the user terminal of the results. This allows users to easily find and purchase artworks that suit their preferences, and allows creators to promote their works to many potential customers.
[0103] A "user device" is a device (such as a computer, smartphone, or tablet) that a user uses to create an account, log in, view artworks, check recommendations, and complete purchases.
[0104] A "creator terminal" is a device that allows creators to create accounts, log in, and exhibit their artworks.
[0105] The "Central Processing Unit" is a central computer system that receives, processes, and stores information from users and creators, communicates with the AI engine, and generates artwork recommendations for users.
[0106] The "artificial intelligence engine" is an artificial intelligence system that analyzes data on artworks and extracts their characteristics. Based on the extracted characteristics, it matches them with the user's profile and generates recommendations.
[0107] "Profiling" refers to analyzing a user's preferences and tastes based on their past browsing history and purchase history, and extracting their characteristics.
[0108] "Recommendation" means that the artificial intelligence engine presents artworks that may be of interest to the user based on the user's profile.
[0109] An "HTTP POST request" is one of the Internet communication protocols used by user devices and creator devices to send data to a server, and is used when sending data to a server.
[0110] "Payment Gateway API" means the program interface of an external payment service provider that is used by the Server to process payments and is used to verify and process payment information.
[0111] The present invention relates to an artificial intelligence (AI)-based recommendation platform for connecting art lovers and creators. To specifically implement the present invention, the following main components and their respective functions are used:
[0112] System Configuration
[0113] This system consists of the following main components:
[0114] 1. User device: A device used by a user to create an account, log in, view artworks, check recommendations, and complete purchases. This includes computers, smartphones, tablets, etc.
[0115] 2. Creator device: This is the device that creators use to create accounts, log in, and list their artworks. This can be a PC, smartphone, tablet, etc.
[0116] 3. Central Processing Unit: A central computer system that receives, processes, and stores information from users and creators. The server is built using frameworks such as Python or Flask.
[0117] 4. Artificial Intelligence Engine: An AI system that analyzes data from artworks and extracts features. Specifically, it uses machine learning libraries such as TensorFlow and PyTorch.
[0118] User usage process
[0119] 1. Create an account and log in:
[0120] When a user first uses the platform, they create an account by entering information such as their name, email address, and password. The information sent from the user's device is sent to the central processing unit via an HTTP POST request. The central processing unit stores the information in a database and returns a success notification to the user's device. The user then logs in in the same way.
[0121] 2. Viewing and recommending artworks:
[0122] After logging in, the user accesses the artwork viewing page. The central processing unit creates a profile based on the user's past browsing and purchase history. The profile information is sent to an artificial intelligence engine, which then recommends artworks based on the user's preferences. The recommendation list is returned to the user's device and displayed.
[0123] 3. Purchasing artwork:
[0124] The user selects the artwork they wish to purchase from the recommended artworks and clicks the "Purchase" button on the details page. The user's device is redirected to a payment information entry page where they enter their payment information. The payment is processed through a central processing unit using a payment gateway API (e.g., Stripe), and the payment result is notified to the user's device. After the purchase is successful, sales information and shipping instructions are sent to the creator.
[0125] Creator usage process
[0126] 1. Create an account and log in:
[0127] Creators also create accounts in the same way as users. Information sent from creator terminals is stored in the central processing unit and can be accessed by logging in.
[0128] 2. Submitting artwork:
[0129] Creators enter an image of their work, a title, a description, and a price, and then click the "List" button. The data sent from the creator's device is stored in the central processing unit and simultaneously sent to an artificial intelligence engine. The AI engine analyzes the data and extracts features such as color, style, and theme.
[0130] Recommendations and the purchase process
[0131] 1. AI analysis:
[0132] The AI engine receives artwork data sent from the creator's device, analyzes the images and descriptions, and extracts features, which are then stored in the central processing unit's database.
[0133] 2. User Recommendations:
[0134] The central processing unit generates a recommendation list based on the user's profile data by comparing it with the feature data generated by the AI engine. The recommendation list is then displayed on the user's device, allowing the user to select and view works that interest them.
[0135] 3. Purchase procedure:
[0136] Once a user selects a work they wish to purchase and enters their payment information on the details page to complete the payment, the central processing unit processes the payment through the payment gateway, and a success notification is sent to the user, along with a sales notification and shipping instructions to the creator.
[0137] Examples of concrete examples and prompts
[0138] As a concrete example, consider the case where a user who likes abstract paintings uses the system. After the user logs in, the AI engine recommends abstract paintings based on features extracted from the user's past browsing history. When the user selects one and purchases it, a notification is sent to the creator, and the work is delivered to the user.
[0139] An example prompt is:
[0140] "Please extract the characteristics of abstract paintings that art lovers like and recommend them appropriately."
[0141] "Suggest the best impressionist paintings for this user based on their past purchases."
[0142] The above is a specific embodiment of the present invention. This system allows users to easily find and purchase artworks that suit their tastes, and allows creators to promote their works to a large number of potential customers.
[0143] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0144] User usage process
[0145] Account creation and login
[0146] Step 1:
[0147] A user visits the account creation page and enters information such as their name, email address, and password.
[0148] Input: User information (name, email address, password)
[0149] Specific operation: The user terminal sends the input data to the server using an HTTP POST request.
[0150] Output: The server holds the received data.
[0151] Step 2:
[0152] The server stores the received user information in a database.
[0153] Input: User information (name, email address, password)
[0154] Data processing and data calculation: The server formats the input data, generates SQL queries, and inserts them into the database.
[0155] Specific operation: The server stores data using a database access library (e.g., SQLAlchemy).
[0156] Output: The server generates a user creation success message.
[0157] Step 3:
[0158] The server notifies the user terminal of the success of the account creation and redirects them to the login page.
[0159] Input: User creation success message
[0160] Specific operation: The server returns a success message to the user device in the HTTP response and performs a redirect using JavaScript.
[0161] Output: The user terminal displays the login page.
[0162] Step 4:
[0163] The user attempts to log in by entering their email address and password.
[0164] Input: Login information (email address, password)
[0165] Specific operation: The user terminal sends login information to the server via an HTTP POST request.
[0166] Output: The server holds the received data.
[0167] Step 5:
[0168] The server checks the received login information against a database and performs authentication.
[0169] Input: Login information (email address, password)
[0170] Data processing and data calculation: The server uses a database query to match the email address and password and generate an authentication result.
[0171] What happens: The server uses a database access library to compare the authentication information.
[0172] Output: Authentication success or failure message
[0173] Step 6:
[0174] If the server is successful in the authentication, it generates session information and returns it to the user terminal.
[0175] Input: Authentication success message
[0176] Specific behavior: The server generates session information using a session manager (e.g., Flask-Session).
[0177] Output: Session information and a success message
[0178] Viewing and recommending artworks
[0179] Step 1:
[0180] The user accesses the artwork viewing page.
[0181] Input: Session information
[0182] Specific operation: The user terminal sends an HTTP GET request to the server, requesting the page to be viewed.
[0183] Output: The server stores the viewed page data.
[0184] Step 2:
[0185] The server profiles the user based on their past browsing and purchasing history.
[0186] Input: User ID (in session information), past browsing history, purchase history
[0187] Data processing and calculation: The server uses database queries to retrieve historical data and generate profiles.
[0188] What happens: The server uses the user ID to perform a database query to retrieve and parse the data.
[0189] Output: User profile data
[0190] Step 3:
[0191] The server sends the profile data to an artificial intelligence engine, instructing it to generate recommendations.
[0192] Input: User profile data
[0193] Specific operation: The server sends the profile data to the AI engine via an HTTP POST request.
[0194] Output: Recommendation request
[0195] Step 4:
[0196] An artificial intelligence engine analyzes profile data and generates a recommendation list.
[0197] Input: User profile data
[0198] Data processing and calculation: The artificial intelligence engine uses machine learning models to analyze input data and generate an optimal recommendation list.
[0199] Specific operation: The artificial intelligence engine runs the model and generates analysis results.
[0200] Output: Recommendation list
[0201] Step 5:
[0202] The server transmits the recommendation list obtained from the artificial intelligence engine to the user terminal.
[0203] Input: Recommendation list
[0204] Specific operation: The server returns the recommendation data to the user device as an HTTP response.
[0205] Output: The user device stores the recommendation list data.
[0206] Step 6:
[0207] The user terminal displays the recommendation list on the screen.
[0208] Input: Recommendation list data
[0209] Specific behavior: The user device dynamically renders the data using JavaScript or a front-end framework.
[0210] Output: Recommendation list display
[0211] Purchase artwork
[0212] Step 1:
[0213] The user selects the artwork they wish to purchase from the recommendation list and displays the details page.
[0214] Input: Work ID
[0215] Specific operation: The user device sends the ID of the selected work to the server via an HTTP GET request, requesting detailed data.
[0216] Output: Work details data
[0217] Step 2:
[0218] The user clicks the "Buy" button and is redirected to a page to enter payment information.
[0219] Input: Work details data
[0220] Specific action: The user device triggers a click event and redirects to a payment information input page.
[0221] Output: Payment information entry page displayed
[0222] Step 3:
[0223] The user enters payment information and clicks the "Pay" button.
[0224] Input: Payment Information
[0225] Specific operation: The user terminal sends payment information to the server via an HTTP POST request.
[0226] Output: Payment information data
[0227] Step 4:
[0228] The server verifies the payment information and processes the payment.
[0229] Input: Payment information data
[0230] Data processing and calculation: The server uses the payment gateway API to send payment information for verification and processing.
[0231] Specific behavior: The server sends an HTTP POST request to the payment gateway API (e.g., Stripe).
[0232] Output: Payment result
[0233] Step 5:
[0234] If the server is successful in the payment, it notifies the user terminal of the success of the purchase and sends sales information and shipping instructions to the creator.
[0235] Input: Payment result
[0236] Specific operation: The server sends a notification to the user's device via an HTTP response, and sends sales information and shipping instructions to the creator using an email API or HTTP request.
[0237] Output: Purchase success notification and sales notification
[0238] Creator usage process
[0239] Account creation and login
[0240] Step 1:
[0241] The creator accesses the account creation page and enters the required information.
[0242] Input: Creator information (name, email address, password)
[0243] Specific operation: The creator device sends the input data to the server via an HTTP POST request.
[0244] Output: The server holds the received data.
[0245] Step 2:
[0246] The server stores the received information in a database.
[0247] Input: Creator information (name, email address, password)
[0248] Data processing and data calculation: The server generates SQL queries to store the input data in the database.
[0249] What happens: The server uses a database access library to store the data.
[0250] Output: Account creation successful message
[0251] Step 3:
[0252] After creating an account, the creator logs in on the login page.
[0253] Input: Login information (email address, password)
[0254] Specific operation: The creator device sends login information to the server via an HTTP POST request.
[0255] Output: Login result
[0256] Artwork exhibit
[0257] Step 1:
[0258] Creators access the listing page for their work and enter an image, title, description, and price.
[0259] Input: Work information (image, title, description, price)
[0260] Specific operation: The creator device sends the input data to the server via an HTTP POST request.
[0261] Output: Work listing information
[0262] Step 2:
[0263] The server stores the received listing information in a database.
[0264] Input: Artwork listing information
[0265] Data processing and data calculation: The server stores the input data using a database query.
[0266] What happens: The server uses a database access library to store the data.
[0267] Output: Save complete message
[0268] Step 3:
[0269] The server sends the listing information to the artificial intelligence engine and instructs it to extract features.
[0270] Input: Artwork listing information
[0271] Specific operation: The server makes an HTTP POST request to the AI engine and sends the work data.
[0272] Output: Feature extraction instructions
[0273] Step 4:
[0274] An artificial intelligence engine analyzes the work and extracts characteristics such as color, style, and theme.
[0275] Input: Work data
[0276] Data processing and calculation: The artificial intelligence engine uses machine learning models to analyze the artwork data and generate feature data.
[0277] What happens: The AI engine runs the model and generates results.
[0278] Output: Artwork feature data
[0279] Recommendations and the purchase process
[0280] AI-powered analysis
[0281] Step 1:
[0282] The artificial intelligence engine receives and analyzes artwork data from creators.
[0283] Input: Work data
[0284] How it works: The AI engine uses image analysis algorithms to extract features such as color, style, and theme.
[0285] Output: Artwork feature data
[0286] Step 2:
[0287] The extracted feature data is stored in a database on the server.
[0288] Input: Artwork characteristics data
[0289] Specific operation: The server stores the feature data using a database access library.
[0290] Output: Database update
[0291] User recommendations
[0292] Step 1:
[0293] The server performs a match based on the user's profile data and the feature data generated by the AI engine.
[0294] Input: User profile data, work feature data
[0295] Data processing and calculation: The server uses a database query to select the best piece of work.
[0296] Specific operation: The server performs matching and generates a recommendation list.
[0297] Output: Recommendation list
[0298] Step 2:
[0299] The server generates a recommendation list and transmits it to the user terminal.
[0300] Input: Recommendation list
[0301] Specific operation: The server sends the data as an HTTP response.
[0302] Output: Recommendation results
[0303] Step 3:
[0304] The user terminal displays the recommendation list.
[0305] Input: Recommendation results
[0306] What it does: Renders the list to the screen using front-end technology.
[0307] Output: Recommendation list display
[0308] Purchase procedure
[0309] Step 1:
[0310] The user selects a recommended work and checks it on the details page.
[0311] Input: Work ID
[0312] Specific operation: The user terminal requests detailed data from the server.
[0313] Output: Work details data
[0314] Step 2:
[0315] The user finds the title they wish to purchase and enters their payment information.
[0316] Input: Work details, payment information
[0317] Specific operation: The user terminal sends payment information to the server.
[0318] Output: Payment information
[0319] Step 3:
[0320] The server processes the payment.
[0321] Input: Payment Information
[0322] Data processing and calculation: The server uses the payment gateway API to verify the payment information.
[0323] Specific operation: The server sends an HTTP request and processes it.
[0324] Output: Payment result
[0325] Step 4:
[0326] The server notifies the user terminal of the success of the purchase and sends sales information and shipping instructions to the creator.
[0327] Input: Payment result
[0328] Specific operation: The server sends a notification to the user and sends sales information to the creator.
[0329] Output: Purchase confirmation and shipping instructions
[0330] (Application example 1)
[0331] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0332] Conventional online art sales systems have the drawback of making it difficult for users to easily find and purchase artworks that suit their tastes, limiting the means by which creators can effectively promote their works to a large number of potential customers, and also lacking a means for users to view artworks in a virtual space as if they were exhibited in a real gallery.
[0333] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0334] In this invention, the server includes: a means for a user to create an account and log in; a means for a creator to submit an artwork and transmit the artwork data to the server; a means for the server to transmit the received artwork data to an AI engine, which analyzes the artwork and extracts its features; a means for the server to generate a profile based on the user's past history and recommend artworks based on the user's preferences; a means for the user to view the recommended artworks through smart glasses and complete a purchase procedure in the virtual space; a means for operation using eye-gaze input or voice commands; and a means for the server to notify the creator of artwork sales and issue shipping instructions. This enables users to efficiently discover and purchase artworks that suit their preferences in the virtual space, and creators to effectively promote their artworks to a wide range of potential customers.
[0335] "User" refers to a consumer who creates an account, browses artworks, and completes a purchase.
[0336] "Creators" refer to creators who submit their own artworks to the platform and engage in sales activities.
[0337] "Account" refers to data including personal identification information created by users and creators to log in to the system.
[0338] "Server" means a computer system that receives, processes, stores, and centrally controls information from users and creators.
[0339] An "AI engine" refers to an artificial intelligence system that analyzes data from artworks and extracts their features.
[0340] "Recommendation" refers to the act of suggesting artworks based on a user's preferences.
[0341] "Smart glasses" refers to a wearable device that allows users to view and interact with artwork in a virtual space.
[0342] "Gaze input" refers to an input method in which a user performs an operation by moving their gaze.
[0343] "Voice command" refers to an instruction to perform an operation by voice.
[0344] "Profile" refers to personal data reflecting preferences generated based on a user's past history.
[0345] "Checkout" refers to the process by which a user selects a recommended artwork and enters payment information to complete the transaction.
[0346] This invention is an AI-based recommendation platform that connects art lovers and creators, allowing users to discover and purchase artworks that suit their tastes and enabling creators to deliver their works to a wide range of users. It also includes a system that enables viewing and purchasing methods in a virtual space using smart glasses.
[0347] System Configuration
[0348] The system of the present invention mainly comprises the following components:
[0349] 1. User device: Smart glasses (e.g., Oculus Quest 2, Microsoft HoloLens 2) that allow users to create an account, log in, view artworks, and make purchases.
[0350] 2. Creator device: A device that allows creators to create accounts, log in, and list their artworks.
[0351] 3. Server: A central computer system (e.g., AWS, Google Cloud) that receives, processes, and stores information from users and creators and communicates with the AI engine.
[0352] 4. AI Engine: An artificial intelligence system (e.g. TensorFlow, PyTorch) that analyzes the artwork data and extracts features.
[0353] 5. Database: A cloud database (e.g., AWS RDS, Google Cloud SQL) that stores user and creator information, artwork data, and feature information.
[0354] User usage process
[0355] 1. Create an account and log in:
[0356] A user creates an account using smart glasses, enters necessary information (such as name, email address, and password) using eye tracking or voice commands, and the server stores this information in a database.
[0357] Log in using your registered email address and password.
[0358] 2. Viewing and recommending artworks:
[0359] After logging in, users can view artworks in a virtual gallery through smart glasses. The AI engine profiles the user's preferences based on their past viewing and purchasing history, and recommends suitable artworks.
[0360] 3. Purchasing artwork:
[0361] Users select their favorite artwork and complete the purchase process using eye tracking or voice commands. Payment information is entered through the smart glasses interface, and the server completes the checkout process.
[0362] Creator usage process
[0363] 1. Create an account and log in:
[0364] Creators also create accounts and log in.
[0365] 2. Submitting artwork:
[0366] When a creator puts up an item for sale, they input an image of the work, its title, description, price, etc. from their device and send it to the server. The AI engine analyzes this data, extracts its features, and stores them in a database.
[0367] Specific examples
[0368] For example, if a user frequently views abstract art, after logging in, the AI engine will prioritize displaying the latest abstract art works in the virtual space, based on their past browsing history. The user can select the work with their eyes, view detailed information, and then complete the purchase process by issuing the voice command "purchase." This entire process is realized through a natural and intuitive interface.
[0369] Prompt Sentence Examples
[0370] "Recommend the latest abstract art to a user who frequently views abstract art. Also, enable the purchase process via voice command and enter payment information securely."
[0371] This will create a system that allows users to enjoy a new art appreciation experience in a virtual space and allows creators to reach more potential customers.
[0372] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0373] Step 1: Account creation and login process
[0374] The user uses the smart glasses and enters the required information (such as name, email address, and password) on the account creation screen using eye gaze or voice commands. The server receives this information and stores it in a database. After saving, the server sends a success notification to the user's device and redirects it to the login page. The user then enters the registered email address and password to log in. The input of this process is the user's personal information, and the output is account authentication and a login session. The server saves the information in the database and executes the authentication process.
[0375] Step 2: Submit your artwork data
[0376] The creator enters information such as an image, title, description, and price of the artwork from the creator device and clicks the "List" button. The server receives this information and stores it in a database. The stored data is sent to an AI engine, which analyzes the image and description to extract features (color, style, theme, etc.). The input to this process is detailed information about the artwork, and the output is feature information. The server manages the storage of data and its transmission to the AI engine, which performs feature extraction.
[0377] Step 3: Recommendation generation
[0378] The server generates a profile based on the user's past browsing and purchase history. The generated profile is sent to the AI engine, which then uses it to recommend artworks that match the user's preferences. The list of recommended artworks is sent to the user's device via the server and displayed on the smart glasses' display. The input to this process is the user's past behavioral data, and the output is a list of recommended artworks. The server aggregates the data and generates the profile, and the AI engine generates the recommendations.
[0379] Step 4: View in the virtual gallery
[0380] The user wears smart glasses and walks around the virtual gallery using eye gaze and gestures. They view the artworks on display, and if they want to see more information, they select the artwork with their eyes and the details page is displayed. The input for this process is a list of recommended artworks, and the output is detailed information. The user's device detects the action using eye gaze tracking and voice recognition, and the server provides detailed data.
[0381] Step 5: Checkout
[0382] When the user selects a title they like and utters the "Purchase" command, they are taken to a payment information input screen through the smart glasses interface. The user then enters payment information using eye contact or voice commands to complete the payment. The server receives the payment information and notifies them of a successful purchase. The input of this process is the payment information, and the output is a notification of a successful purchase. The smart glasses provide the input interface, and the server executes the payment process.
[0383] Step 6: Sales notification and shipping instructions
[0384] Once payment is complete, the server sends a sales notification and shipping instructions to the creator. The creator follows the instructions and ships the work to the user. The input to this process is a successful purchase notification, and the output is a sales notification and shipping instructions. The server sends the notification and manages shipping.
[0385] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0386] The present invention relates to an AI-based recommendation platform for connecting art lovers and creators. The system of the present invention allows users to easily discover and purchase artworks that match their tastes, and also allows creators to distribute their works to a wide range of users. Furthermore, the present invention includes a function for improving recommendation accuracy by combining an emotion engine that recognizes user emotions. The following describes an embodiment of the present invention.
[0387] System Configuration
[0388] The system of the present invention consists of the following major components:
[0389] 1. User device: A device (PC, smartphone, tablet, etc.) that a user uses to create an account, log in, view artworks, check recommendations, and complete purchases.
[0390] 2. Creator device: A device that allows creators to create accounts, log in, and exhibit their artworks.
[0391] 3. Server: A central computer system that receives, processes, and stores information from users and creators. The server also communicates with the AI engine and emotion engine to generate artwork recommendations for users.
[0392] 4. AI Engine: An artificial intelligence system that analyzes data on artworks and extracts their characteristics. Based on the extracted characteristics, it matches them with the user's profile and generates recommendations.
[0393] 5. Emotion Engine: A system that recognizes emotions by analyzing the user's facial expressions, voice, and text data. The recognized emotional data is added to the profile and used when making recommendations.
[0394] User usage process
[0395] 1. Account creation and login: When a user uses the platform for the first time, they create an account. After entering the required information (such as name, email address, and password) from the user's device, the server receives this information and stores it in the database. A success notification is sent to the user's device, and the user is redirected to the login page. Next, the user enters their registered email address and password to log in.
[0396] 2. Viewing and Recommending Artworks: After logging in, users access the artwork viewing page on the platform. The server profiles the user's preferences based on their past browsing and purchase history, and uses an AI engine to generate a list of recommended art works that suit the user. This list of recommended works is displayed on the user's device.
[0397] 3. Emotional Data Collection and Analysis: When a user browses artwork, facial expressions, voice, and text data are sent from the user's device to the emotion engine. The emotion engine analyzes the received data and recognizes the user's emotions. The analysis results are added to the user's profile and reflected in the next recommendation.
[0398] 4. Purchasing an Artwork: When the user selects the artwork they wish to purchase from the recommended artworks and clicks the "Purchase" button on the details page, the server redirects them to a page where they can enter their payment information. The user then enters the necessary payment information and completes the payment process.
[0399] Creator usage process
[0400] 1. Create an account and log in: Creators also create an account on the platform and log in.
[0401] 2. Artwork listing: When a creator wants to list their work, they enter information such as an image, title, description, and price on their device and click the "List" button. The server receives this information and stores it in a database. At the same time, the work data is sent to an AI engine, which analyzes the work and extracts its features.
[0402] Recommendations and the purchase process
[0403] 1. AI analysis: The AI engine analyzes the images and descriptions of artworks submitted by creators and extracts features such as color, style, and theme. This feature information is stored in a database.
[0404] 2. User recommendation: Based on the user's profile, the server compares the characteristic information of the artworks extracted by the AI engine with the user's emotional data to generate a list of recommended artworks that match the user's preferences. This list of recommended artworks is displayed on the user's device, allowing the user to select, view, and purchase artworks that interest them.
[0405] 3. Purchase procedure: When the user enters payment information on the details page of the work they have decided to purchase and completes the payment procedure, the server notifies the creator of the successful purchase. A sales notification and shipping instructions for the work are sent to the creator.
[0406] As a concrete example, consider the case where a user who likes abstract paintings uses this system. After logging in, the user browses abstract paintings recommended based on features extracted by the AI engine from their past browsing history and emotional data, and then purchases one of them. If the purchase is successful, a notification is sent to the creator, and the work is delivered to the user. This entire process is carried out smoothly by the system of the present invention.
[0407] This allows users to easily find and purchase artworks that suit their tastes, and allows creators to promote their works to a large number of potential customers. The combination of the emotion engine further improves the accuracy of recommendations, enriching the user experience.
[0408] The processing flow will be explained below.
[0409] Step 1:
[0410] User device: The user accesses the account creation page, enters the required information such as name, email address, and password, and clicks the "Register" button.
[0411] Step 2:
[0412] Server: Receives the information sent by the user and checks that the input does not overlap with existing data. If there are no duplicates, saves the user's information in the database and sends a notification of successful account creation to the user's device. If there are duplicates, sends an error message.
[0413] Step 3:
[0414] User device: After receiving notification from the server, if the account creation is successful, the user will be redirected to the login page.
[0415] Step 4:
[0416] User device: Access the login page, enter the registered email address and password, and click the "Login" button.
[0417] Step 5:
[0418] Server: Checks the email address and password entered by the user against a database, and if authentication is successful, starts a session and redirects the user to the home page. If authentication fails, sends an error message to the user's terminal.
[0419] Step 6:
[0420] Creator terminal: Creators log in to their account and access the work listing page.
[0421] Step 7:
[0422] Creator's terminal: Enter the necessary information such as the image file, title, description, and price of the work, and click the "List" button.
[0423] Step 8:
[0424] Server: Receives the work data sent by the creator and stores it in a database. After storing it, it sends the work data to the AI engine and requests analysis.
[0425] Step 9:
[0426] AI engine (on the server): Analyzes the images and descriptions of the artwork received, extracts features such as color, style, and theme, and stores the results in a database.
[0427] Step 10:
[0428] Server: When a user accesses an art browsing page, a user profile is generated based on the user's past browsing history and purchase history.
[0429] Step 11:
[0430] Server: The AI engine compares the extracted feature information of the artwork with the user's profile and generates a list of recommended artworks that match the user's preferences.
[0431] Step 12:
[0432] Server: Sends the generated recommendation list to the user terminal.
[0433] Step 13:
[0434] User device: The user receives a list of recommended artworks and clicks on the artwork of interest to view more information.
[0435] Step 14:
[0436] User device: Click the "Purchase" button on the details page of the work you want to purchase.
[0437] Step 15:
[0438] Server: Receives the purchase request and redirects to a page where payment information is entered.
[0439] Step 16:
[0440] User device: Enter payment information (such as credit card information) and click the "Pay" button.
[0441] Step 17:
[0442] Server: Receives payment information and sends it to the payment service to process the payment.
[0443] Step 18:
[0444] Payment Service: Processes the payment information and notifies the server of success or failure.
[0445] Step 19:
[0446] Server: If the payment is successful, a purchase completion message is sent to the user's device and the creator is notified of the sale of the work and shipping instructions. If the payment is unsuccessful, an error message is sent to the user's device.
[0447] Step 20:
[0448] Creator device: Receives purchase notifications and prepares purchased works for shipping.
[0449] Step 21:
[0450] User device: While viewing the artwork, the user's facial expressions, voice, and text data are sent to the emotion engine.
[0451] Step 22:
[0452] Emotion Engine: Analyzes the received data and recognizes the user's emotions. Adds the recognition results to the profile.
[0453] Step 23:
[0454] Server: Generates a recommendation list based on the updated profile and sends it to the user device.
[0455] Step 24:
[0456] User terminal: The updated recommendation list is received and the user selects the next artwork to view.
[0457] Example 2
[0458] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0459] In today's digital art marketplace, it is difficult for users to efficiently discover artworks that match their tastes, and for creators to effectively present their works to a wide range of users. In particular, it is difficult to recommend artworks that accurately reflect users' preferences and emotions, resulting in a poor user experience. Furthermore, for creators, simply listing their works makes it difficult to increase attention and sales.
[0460] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for a user to create an account and log in, a means for a creator to list a work and transmit the data to the server, a means for the server to transmit the received work data to an artificial intelligence engine, which analyzes the data and extracts features, a means for the server to generate a profile based on the user's past history and recommend works based on the user's preferences, a means for the user to view the recommended works and complete a purchase procedure for the product, a means for the server to notify the creator of sales and issue shipping instructions, and a means for the server to transmit user data to an emotion analysis engine, which analyzes the user's emotions and adds the data to the profile. This allows users to easily find and purchase artworks that suit their preferences and emotions, and enables creators to effectively present their works to a wide range of users.
[0461] A "user terminal" is a device (computer, smartphone, tablet, etc.) that a user uses to create an account, log in, view works, and complete purchase procedures.
[0462] "Creator Device" means a device (computer, smartphone, tablet, etc.) that a creator uses to create an account, log in, and submit artwork for sale.
[0463] "Server" means the central computer system that receives, processes, and stores information from users and creators, communicates with the artificial intelligence engine and sentiment analysis engine, and generates recommendations.
[0464] The "artificial intelligence engine" is a system that analyzes data on artworks, extracts their characteristics, and compares them with the user's profile to generate recommendations.
[0465] An "emotion analysis engine" is a system that analyzes a user's facial expressions, voice, and text data to generate emotional information and add that information to the user profile.
[0466] A "profile" is a data set that represents a user's preferences and is generated based on the user's past browsing history, purchase history, and emotional data.
[0467] "Recommendations" are a list of artworks that the artificial intelligence engine recommends based on the user's profile.
[0468] "Artwork data" refers to information about the artworks exhibited by the creators (images, titles, descriptions, prices, etc.).
[0469] The present invention relates to an AI-based recommendation platform for connecting art lovers and art creators. The system is implemented using several major components, including a user terminal, a creator terminal, and a server.
[0470] User terminal
[0471] A user device is a device where a user creates an account, logs in, browses artworks, checks recommendations, and completes purchases. It can be implemented on hardware such as a desktop, laptop, tablet, or smartphone. A user device interfaces with the user through various input devices (e.g., keyboard, mouse, touchscreen) and output devices (e.g., display, speakers).
[0472] Producer's terminal
[0473] The creator terminal is a device for exhibiting artworks and transmitting the data to the server, and like the user terminal, it is implemented on hardware such as desktops, laptops, tablets, and smartphones. The creator enters information such as an image, title, description, and price of the artwork and completes the exhibit procedure.
[0474] server
[0475] The Server is the central processing unit that receives, processes, and stores information from users and creators. The Server includes the following functions:
[0476] 1. Database management - storing user and creator information, artwork data, history data, emotional data, etc.
[0477] 2. Collaboration with AI engine - The received artwork data is sent to the AI engine, which extracts features and generates recommendations.
[0478] 3. Collaboration with sentiment analysis engine - Emotional data sent by the user is sent to the sentiment analysis engine, and the analysis results are added to the profile.
[0479] Artificial Intelligence Engine
[0480] The AI engine is a system that analyzes data on artworks and extracts their characteristics (e.g., color, style, theme). The extracted characteristics are matched with the user's profile to generate a recommendation list.
[0481] Sentiment Analysis Engine
[0482] The emotion analysis engine is a system that analyzes a user's facial expressions, voice, and text data to generate emotional information about the user. The analyzed emotional data is added to the user's profile and used for future recommendations.
[0483] Specific actions
[0484] For example, when a user who likes abstract paintings uses this system, they first create an account and log in. Next, a list of artworks recommended by the AI engine based on their past browsing and purchase history is displayed on the user's device. As the user browses the artworks, their facial expressions and voice are analyzed by the emotion analysis engine, and this data is reflected in the next recommendation. When the user purchases a piece they like, the server processes the payment information and sends a purchase completion notification to the artist.
[0485] Prompt Sentence Examples
[0486] User prompt:
[0487] "Recommend me an art piece"
[0488] "Show me a piece based on my emotions."
[0489] Author prompt:
[0490] I want to exhibit new work.
[0491] "I want to see a feature analysis of my work."
[0492] This allows users to easily discover and purchase artworks that suit their tastes, and allows creators to appeal to a wide range of users. In addition, the combination of a sentiment analysis engine enhances the user experience and improves recommendation accuracy.
[0493] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0494] Step 1: Create an account and log in
[0495] Input: The user enters their name, email address, and password.
[0496] process:
[0497] The user inputs their name, email address, and password from the user terminal.
[0498] The terminal transmits this input information to the server.
[0499] The server stores the received information in a database.
[0500] After saving, the server sends a notification to the terminal that the user has been successfully created.
[0501] Output: The user will see a notification on their device that their account was created successfully and will be redirected to the login page.
[0502] Step 2: Log in
[0503] Input: The registered email address and password are entered by the user.
[0504] process:
[0505] The user inputs an email address and a password from the user terminal.
[0506] The terminal transmits the input information to the server.
[0507] The server checks the database for the relevant user information, and if there is a match, sends a notification of successful login to the terminal.
[0508] Output: The user will see a successful login notification on their device and be redirected to the home page.
[0509] Step 3: View and recommend artworks
[0510] Input: The user's past browsing history and purchase history are input.
[0511] process:
[0512] The user accesses the artwork viewing page.
[0513] The terminal transmits the user's past browsing history and purchase history to the server.
[0514] The server sends the user's profile and history data to the AI engine.
[0515] The AI engine analyzes this data and generates a list of recommended artworks that match the user's preferences.
[0516] The server transmits the generated recommendation list to the terminal.
[0517] Output: A list of recommended artworks is displayed on the user's device.
[0518] Step 4: Collect and analyze sentiment data
[0519] Input: The user's facial expressions, voice, and text data are input.
[0520] process:
[0521] The user browses the artwork.
[0522] The device sends the user's facial expression, voice, and text data to an emotion analysis engine.
[0523] The emotion analysis engine analyzes this data and generates emotion data.
[0524] The generated emotion data is sent to the server and added to the user profile.
[0525] Output: The user's emotional data is added to the profile.
[0526] Step 5: Buy an artwork
[0527] Input: The user enters the artwork information and payment information they have selected.
[0528] process:
[0529] The user selects the title they wish to purchase from the recommendation list.
[0530] The terminal transmits the selection information to the server.
[0531] The server displays a payment information input page on the terminal.
[0532] The user enters payment information (e.g., credit card information).
[0533] The terminal transmits the payment information to the server.
[0534] The server processes the payment and stores the purchase information in a database.
[0535] After saving, the server sends a purchase completion notification to the terminal.
[0536] Output: A purchase completion notification is displayed on the user's device, and a sales notification and shipping instructions are sent to the creator.
[0537] Step 6: List your artwork
[0538] Input: The creator will provide the work image, title, description, and price.
[0539] process:
[0540] The creator inputs the image, title, description, and price of the work from the creator terminal.
[0541] The terminal transmits the input information to the server.
[0542] The server stores the work information in a database.
[0543] At the same time, the server sends the work data to the AI engine, which analyzes its features.
[0544] The analyzed feature information is sent to a server and stored in a database.
[0545] Output: The works submitted by the creators become viewable within the system.
[0546] The above processing steps allow users and creators to smoothly use the system and effectively discover and exhibit artworks.
[0547] (Application example 2)
[0548] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0549] Traditional platforms for viewing and purchasing visual artworks have limited the ability to improve user experience due to the difficulty in recommending artworks based on users' specific emotions. In addition, physical galleries and online platforms lack recommendation systems that instantly reflect users' emotions toward visual artworks, making it difficult for creators to widely and effectively reach customers.
[0550] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for a user to create an account and log in, means for a creator to submit a work of visual artwork and transmit the work data to a central processing unit, means for the central processing unit to transmit the received visual artwork data to an artificial intelligence engine, which analyzes the work and extracts features, means for the central processing unit to generate a profile based on the user's past history and recommend visual artworks based on the user's preferences, means for the user to view the recommended visual artworks and complete a purchase procedure, means for the central processing unit to notify the creator of the sales of the artworks and issue shipping instructions, means for transmitting facial expression, voice, and text data from the user terminal to the emotion engine, means for the emotion engine to analyze the received data and recognize the user's emotions, and means for adding the analysis results to the profile and reflecting them in the next recommendation. This makes it possible to recommend visual artworks that are in line with the user's emotions.
[0551] A "user device" is a device (such as a computer, smartphone, or tablet) used to create an account, log in, view artwork, check recommendations, and complete purchases.
[0552] A "creator device" is a device that allows a creator to create an account, log in, and submit visual artwork.
[0553] "Central Processing Unit" means the central computer system that receives, processes, and stores information from users and creators.
[0554] An "artificial intelligence engine" is an artificial intelligence system that analyzes data from visual artworks and extracts features.
[0555] The "emotion engine" is a system that recognizes emotions by analyzing the user's facial expressions, voice, and text data.
[0556] A "profile" is data that indicates a user's preferences and tendencies and is generated based on the user's past browsing history and purchase history.
[0557] "Recommendation" refers to recommending suitable visual artworks based on a user's profile and emotional data.
[0558] "Smart glasses" are devices worn on the user's head that allow them to view visual artwork in a virtual space.
[0559] A "visual work of art" is a work of art that is intended to be visually appreciated, such as a painting, photograph, or digital art.
[0560] "User emotion" refers to the emotional state recognized by the emotion engine based on facial expressions, voice, and text data when a user views a visual artwork.
[0561] The present invention relates to a system for facilitating the viewing and purchasing of visual artworks, which comprises a user terminal, a creator terminal, a central processing unit, an artificial intelligence engine, an emotion engine, and smart glasses.
[0562] A user terminal is a device that allows a user to create an account, log in, view visual artworks, and complete purchase procedures. This device may include a PC, smartphone, tablet, etc. A creator terminal is a device that allows a creator to exhibit a visual artwork and transmit the artwork data to the central processing unit.
[0563] The central processing unit is a central computer system that receives, processes, and stores information from users and creators. It generates a profile based on the user's past history and recommends visual artworks based on the user's preferences. Furthermore, the central processing unit allows users to send facial expressions, voice, and text data to the emotion engine, which then analyzes this data to recognize the user's emotions.
[0564] The AI engine is a system that analyzes images and descriptions of visual artworks to extract features such as color, style, and theme, which allows it to recommend suitable visual artworks based on the user's profile and emotional data.
[0565] The emotion engine is a system that analyzes facial expressions, voice, and text data sent from the user's device to recognize the user's emotions. The results of this analysis are added to the user's profile and reflected in the next recommendation.
[0566] Smart glasses are devices worn on the user's head that allow them to view visual artworks in a virtual space. The smart glasses' camera captures the user's facial expressions, which are then analyzed by an emotion engine to collect real-time emotional data.
[0567] This will enable the recommendation of visual art works that are in line with the user's emotions, improving the user experience, and allowing creators to effectively promote their works to a large number of potential customers who are interested in visual arts.
[0568] As a concrete example, let's say a user wears smart glasses and visits a virtual art gallery. If the user's profile data indicates a preference for "abstract art" based on their past viewing history, and the user smiles while looking at a particular abstract painting during the session, the emotion engine will recognize this as "joy." Based on this information, the AI engine will recommend abstract paintings that will further enhance the joy.
[0569] Example prompt sentence:
[0570] Build a smart glasses application that recognizes emotions from the user's facial and vocal expressions and recommends visual artworks based on those emotions. Generate a list of recommended visual artworks for a particular emotion and let the user browse through them in a virtual gallery.
[0571] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0572] Step 1:
[0573] The server receives an account creation request from the user's device. The user enters the required information, such as name, email address, and password. This information is stored in a database and a success notification is sent to the user.
[0574] Step 2:
[0575] The server receives a login request from the user's device. When the user enters their registered email address and password, this information is checked against the database, and if authentication is successful, the login process is completed.
[0576] Step 3:
[0577] The server receives requests to exhibit artworks from creators' devices. The creators enter information such as images, titles, descriptions, and prices of their artworks. This data is stored in a database and simultaneously sent to an artificial intelligence engine.
[0578] Step 4:
[0579] An artificial intelligence engine analyzes images and descriptions of artworks submitted by creators, extracting characteristics such as color, style, and theme, and storing this information in a database.
[0580] Step 5:
[0581] The server creates a profile based on the user's past browsing and purchasing history, which reflects the user's preferences and is sent to an artificial intelligence engine to select recommended visual artworks.
[0582] Step 6:
[0583] The user device transmits facial expressions, voice, and text data to the emotion engine in real time, and the emotion engine analyzes this data to identify the user's emotions.
[0584] Step 7:
[0585] The emotion engine adds the analysis results to the profile and reflects them in the next recommendation. The recognized emotion data is stored in a database.
[0586] Step 8:
[0587] The server generates a list of recommended visual artworks based on the user profile and emotion data, and the generated recommendation list is sent to the user terminal, where the user can view the recommended artworks.
[0588] Step 9:
[0589] The user selects the artwork they wish to purchase from the list of recommended visual artworks and clicks the "Purchase" button on the detail page. The server redirects the user to a payment information entry page, where the user enters the necessary payment information to complete the purchase.
[0590] Step 10:
[0591] The server sends a sales notification to the creator and instructs them to ship the work. The creator receives the notification and ships the work to the user, completing the process.
[0592] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0593] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0594] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0595] [Second embodiment]
[0596] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0597] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0598] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0599] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0600] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0601] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0602] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0603] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0604] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0605] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0606] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0607] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0608] The present invention relates to an AI-based recommendation platform for connecting art lovers and creators. The system of the present invention allows users to easily discover and purchase artworks that suit their tastes, and also allows creators to reach a wide audience with their artworks. The following describes an embodiment of the present invention.
[0609] System Configuration
[0610] The system of the present invention consists of the following major components:
[0611] 1. User device: A device (PC, smartphone, tablet, etc.) that a user uses to create an account, log in, view artworks, check recommendations, and complete purchases.
[0612] 2. Creator device: A device that allows creators to create accounts, log in, and exhibit their artworks.
[0613] 3. Server: A central computer system that receives, processes, and stores information from users and creators. The server also communicates with the AI engine to generate artwork recommendations for users.
[0614] 4. AI Engine: An artificial intelligence system that analyzes data on artworks and extracts their characteristics. Based on the extracted characteristics, it matches them with the user's profile and generates recommendations.
[0615] User usage process
[0616] 1. Account creation and login: When a user uses the platform for the first time, they create an account. After entering the required information (such as name, email address, and password) from the user's device, the server receives this information and stores it in the database. A success notification is sent to the user's device, and the user is redirected to the login page. Next, the user enters their registered email address and password to log in.
[0617] 2. Viewing and Recommending Artworks: After logging in, users access the artwork viewing page on the platform. The server profiles the user's preferences based on their past browsing and purchase history, and uses an AI engine to recommend art works that suit the user. The list of recommended works is displayed on the user's device.
[0618] 3. Purchasing an artwork: When the user selects the artwork they wish to purchase from the recommended artworks and clicks the "Purchase" button on the details page, the server redirects them to a page where they can enter their payment information. The user then enters the necessary payment information and completes the payment process.
[0619] Creator usage process
[0620] 1. Create an account and log in: Creators also create an account on the platform and log in.
[0621] 2. Artwork listing: When a creator wants to list their work, they enter information such as an image, title, description, and price on their device and click the "List" button. The server receives this information and stores it in a database. At the same time, the work data is sent to an AI engine, which analyzes the work and extracts its features.
[0622] Recommendations and the purchase process
[0623] 1. AI analysis: The AI engine analyzes the images and descriptions of artworks submitted by creators and extracts features such as color, style, and theme. This feature information is stored in a database.
[0624] 2. Recommendations to users: The server compares the user's profile with the feature information of the works extracted by the AI engine to generate a list of recommended works. This list of recommended works is displayed on the user's device, and the user can select, view, and purchase works that interest them.
[0625] 3. Purchase procedure: When the user enters payment information on the details page of the work they have decided to purchase and completes the payment procedure, the server notifies the creator of the successful purchase. A sales notification and shipping instructions for the work are sent to the creator.
[0626] As a concrete example, consider the case where a user who likes abstract paintings uses this system. After logging in, the user browses abstract paintings recommended based on features extracted by the AI engine from their past browsing history, and then purchases one of them. If the purchase is successful, a notification is sent to the creator, and the work is delivered to the user. This entire process is carried out smoothly by the system of the present invention.
[0627] This allows users to easily find and purchase artwork that suits their tastes, and allows creators to promote their work to a large number of potential customers.
[0628] The processing flow will be explained below.
[0629] Step 1:
[0630] User device: The user accesses the account creation page, enters the required information such as name, email address, and password, and clicks the "Register" button.
[0631] Step 2:
[0632] Server: Receives the information sent by the user and checks that the input does not overlap with existing data. If there are no duplicates, saves the user's information in the database and sends a notification of successful account creation to the user's device. If there are duplicates, sends an error message.
[0633] Step 3:
[0634] User device: After receiving notification from the server, if the account creation is successful, the user will be redirected to the login page.
[0635] Step 4:
[0636] User device: Access the login page, enter the registered email address and password, and click the "Login" button.
[0637] Step 5:
[0638] Server: Checks the email address and password entered by the user against a database, and if authentication is successful, starts a session and redirects the user to the home page. If authentication fails, sends an error message to the user's terminal.
[0639] Step 6:
[0640] Creator terminal: Creators log in to their account and access the work listing page.
[0641] Step 7:
[0642] Creator's terminal: Enter the necessary information such as the image file, title, description, and price of the work, and click the "List" button.
[0643] Step 8:
[0644] Server: Receives the work data sent by the creator and stores it in a database. After storing it, it sends the work data to the AI engine and requests analysis.
[0645] Step 9:
[0646] AI engine (on the server): Analyzes the images and descriptions of the artwork received, extracts features such as color, style, and theme, and stores the results in a database.
[0647] Step 10:
[0648] Server: When a user accesses an art browsing page, a user profile is generated based on the user's past browsing history and purchase history.
[0649] Step 11:
[0650] Server: The AI engine compares the extracted feature information of the artwork with the user's profile and generates a list of recommended artworks that match the user's preferences.
[0651] Step 12:
[0652] Server: Sends the generated recommendation list to the user terminal.
[0653] Step 13:
[0654] User device: The user receives a list of recommended artworks and clicks on the artwork of interest to view more information.
[0655] Step 14:
[0656] User device: Click the "Purchase" button on the details page of the work you want to purchase.
[0657] Step 15:
[0658] Server: Receives the purchase request and redirects to a page where payment information is entered.
[0659] Step 16:
[0660] User device: Enter payment information (such as credit card information) and click the "Pay" button.
[0661] Step 17:
[0662] Server: Receives payment information and sends it to the payment service to process the payment.
[0663] Step 18:
[0664] Payment Service: Processes the payment information and notifies the server of success or failure.
[0665] Step 19:
[0666] Server: If the payment is successful, a purchase completion message is sent to the user's device and the creator is notified of the sale of the work and shipping instructions. If the payment is unsuccessful, an error message is sent to the user's device.
[0667] Step 20:
[0668] Creator device: Receives purchase notifications and prepares purchased works for shipping.
[0669] Example 1
[0670] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0671] In today's art market, it is difficult for art lovers to easily find and purchase works that suit their tastes. It is also difficult for creators to reach a wide audience. In this situation, a system is needed to efficiently connect art lovers and creators.
[0672] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0673] In this invention, the server includes: means for users to create accounts and log in; means for creators to submit artworks and transmit artwork data to a central processing unit; means for the central processing unit to transmit the received artwork data to an artificial intelligence engine, which analyzes the artworks and extracts features; means for the central processing unit to generate a profile based on the user's past history and recommend artworks based on the user's preferences; means for users to view the recommended artworks and complete the product purchase procedure; means for the central processing unit to notify the creator of artwork sales and issue shipping instructions; means for the user terminal to send an HTTP POST request to the server and exchange account information and payment information; and means for the central processing unit to process payments using a payment gateway API and notify the user terminal of the results. This allows users to easily find and purchase artworks that suit their preferences, and allows creators to promote their works to many potential customers.
[0674] A "user device" is a device (such as a computer, smartphone, or tablet) that a user uses to create an account, log in, view artworks, check recommendations, and complete purchases.
[0675] A "creator terminal" is a device that allows creators to create accounts, log in, and exhibit their artworks.
[0676] The "Central Processing Unit" is a central computer system that receives, processes, and stores information from users and creators, communicates with the AI engine, and generates artwork recommendations for users.
[0677] The "artificial intelligence engine" is an artificial intelligence system that analyzes data on artworks and extracts their characteristics. Based on the extracted characteristics, it matches them with the user's profile and generates recommendations.
[0678] "Profiling" refers to analyzing a user's preferences and tastes based on their past browsing history and purchase history, and extracting their characteristics.
[0679] "Recommendation" means that the artificial intelligence engine presents artworks that may be of interest to the user based on the user's profile.
[0680] An "HTTP POST request" is one of the Internet communication protocols used by user devices and creator devices to send data to a server, and is used when sending data to a server.
[0681] "Payment Gateway API" means the program interface of an external payment service provider that is used by the Server to process payments and is used to verify and process payment information.
[0682] The present invention relates to an artificial intelligence (AI)-based recommendation platform for connecting art lovers and creators. To specifically implement the present invention, the following main components and their respective functions are used:
[0683] System Configuration
[0684] This system consists of the following main components:
[0685] 1. User device: A device used by a user to create an account, log in, view artworks, check recommendations, and complete purchases. This includes computers, smartphones, tablets, etc.
[0686] 2. Creator device: This is the device that creators use to create accounts, log in, and list their artworks. This can be a PC, smartphone, tablet, etc.
[0687] 3. Central Processing Unit: A central computer system that receives, processes, and stores information from users and creators. The server is built using frameworks such as Python or Flask.
[0688] 4. Artificial Intelligence Engine: An AI system that analyzes data from artworks and extracts features. Specifically, it uses machine learning libraries such as TensorFlow and PyTorch.
[0689] User usage process
[0690] 1. Create an account and log in:
[0691] When a user first uses the platform, they create an account by entering information such as their name, email address, and password. The information sent from the user's device is sent to the central processing unit via an HTTP POST request. The central processing unit stores the information in a database and returns a success notification to the user's device. The user then logs in in the same way.
[0692] 2. Viewing and recommending artworks:
[0693] After logging in, the user accesses the artwork viewing page. The central processing unit creates a profile based on the user's past browsing and purchase history. The profile information is sent to an artificial intelligence engine, which then recommends artworks based on the user's preferences. The recommendation list is returned to the user's device and displayed.
[0694] 3. Purchasing artwork:
[0695] The user selects the artwork they wish to purchase from the recommended artworks and clicks the "Purchase" button on the details page. The user's device is redirected to a payment information entry page where they enter their payment information. The payment is processed through a central processing unit using a payment gateway API (e.g., Stripe), and the payment result is notified to the user's device. After the purchase is successful, sales information and shipping instructions are sent to the creator.
[0696] Creator usage process
[0697] 1. Create an account and log in:
[0698] Creators also create accounts in the same way as users. Information sent from creator terminals is stored in the central processing unit and can be accessed by logging in.
[0699] 2. Submitting artwork:
[0700] Creators enter an image of their work, a title, a description, and a price, and then click the "List" button. The data sent from the creator's device is stored in the central processing unit and simultaneously sent to an artificial intelligence engine. The AI engine analyzes the data and extracts features such as color, style, and theme.
[0701] Recommendations and the purchase process
[0702] 1. AI analysis:
[0703] The AI engine receives artwork data sent from the creator's device, analyzes the images and descriptions, and extracts features, which are then stored in the central processing unit's database.
[0704] 2. User Recommendations:
[0705] The central processing unit generates a recommendation list based on the user's profile data by comparing it with the feature data generated by the AI engine. The recommendation list is then displayed on the user's device, allowing the user to select and view works that interest them.
[0706] 3. Purchase procedure:
[0707] Once a user selects a work they wish to purchase and enters their payment information on the details page to complete the payment, the central processing unit processes the payment through the payment gateway, and a success notification is sent to the user, along with a sales notification and shipping instructions to the creator.
[0708] Examples of concrete examples and prompts
[0709] As a concrete example, consider the case where a user who likes abstract paintings uses the system. After the user logs in, the AI engine recommends abstract paintings based on features extracted from the user's past browsing history. When the user selects one and purchases it, a notification is sent to the creator, and the work is delivered to the user.
[0710] An example prompt is:
[0711] "Please extract the characteristics of abstract paintings that art lovers like and recommend them appropriately."
[0712] "Suggest the best impressionist paintings for this user based on their past purchases."
[0713] The above is a specific embodiment of the present invention. This system allows users to easily find and purchase artworks that suit their tastes, and allows creators to promote their works to a large number of potential customers.
[0714] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0715] User usage process
[0716] Account creation and login
[0717] Step 1:
[0718] A user visits the account creation page and enters information such as their name, email address, and password.
[0719] Input: User information (name, email address, password)
[0720] Specific operation: The user terminal sends the input data to the server using an HTTP POST request.
[0721] Output: The server holds the received data.
[0722] Step 2:
[0723] The server stores the received user information in a database.
[0724] Input: User information (name, email address, password)
[0725] Data processing and data calculation: The server formats the input data, generates SQL queries, and inserts them into the database.
[0726] Specific operation: The server stores data using a database access library (e.g., SQLAlchemy).
[0727] Output: The server generates a user creation success message.
[0728] Step 3:
[0729] The server notifies the user terminal of the success of the account creation and redirects them to the login page.
[0730] Input: User creation success message
[0731] Specific operation: The server returns a success message to the user device in the HTTP response and performs a redirect using JavaScript.
[0732] Output: The user terminal displays the login page.
[0733] Step 4:
[0734] The user attempts to log in by entering their email address and password.
[0735] Input: Login information (email address, password)
[0736] Specific operation: The user terminal sends login information to the server via an HTTP POST request.
[0737] Output: The server holds the received data.
[0738] Step 5:
[0739] The server checks the received login information against a database and performs authentication.
[0740] Input: Login information (email address, password)
[0741] Data processing and data calculation: The server uses a database query to match the email address and password and generate an authentication result.
[0742] What happens: The server uses a database access library to compare the authentication information.
[0743] Output: Authentication success or failure message
[0744] Step 6:
[0745] If the server is successful in the authentication, it generates session information and returns it to the user terminal.
[0746] Input: Authentication success message
[0747] Specific behavior: The server generates session information using a session manager (e.g., Flask-Session).
[0748] Output: Session information and a success message
[0749] Viewing and recommending artworks
[0750] Step 1:
[0751] The user accesses the artwork viewing page.
[0752] Input: Session information
[0753] Specific operation: The user terminal sends an HTTP GET request to the server, requesting the page to be viewed.
[0754] Output: The server stores the viewed page data.
[0755] Step 2:
[0756] The server profiles the user based on their past browsing and purchasing history.
[0757] Input: User ID (in session information), past browsing history, purchase history
[0758] Data processing and calculation: The server uses database queries to retrieve historical data and generate profiles.
[0759] What happens: The server uses the user ID to perform a database query to retrieve and parse the data.
[0760] Output: User profile data
[0761] Step 3:
[0762] The server sends the profile data to an artificial intelligence engine, instructing it to generate recommendations.
[0763] Input: User profile data
[0764] Specific operation: The server sends the profile data to the AI engine via an HTTP POST request.
[0765] Output: Recommendation request
[0766] Step 4:
[0767] An artificial intelligence engine analyzes profile data and generates a recommendation list.
[0768] Input: User profile data
[0769] Data processing and calculation: The artificial intelligence engine uses machine learning models to analyze input data and generate an optimal recommendation list.
[0770] Specific operation: The artificial intelligence engine runs the model and generates analysis results.
[0771] Output: Recommendation list
[0772] Step 5:
[0773] The server transmits the recommendation list obtained from the artificial intelligence engine to the user terminal.
[0774] Input: Recommendation list
[0775] Specific operation: The server returns the recommendation data to the user device as an HTTP response.
[0776] Output: The user device stores the recommendation list data.
[0777] Step 6:
[0778] The user terminal displays the recommendation list on the screen.
[0779] Input: Recommendation list data
[0780] Specific behavior: The user device dynamically renders the data using JavaScript or a front-end framework.
[0781] Output: Recommendation list display
[0782] Purchase artwork
[0783] Step 1:
[0784] The user selects the artwork they wish to purchase from the recommendation list and displays the details page.
[0785] Input: Work ID
[0786] Specific operation: The user device sends the ID of the selected work to the server via an HTTP GET request, requesting detailed data.
[0787] Output: Work details data
[0788] Step 2:
[0789] The user clicks the "Buy" button and is redirected to a page to enter payment information.
[0790] Input: Work details data
[0791] Specific action: The user device triggers a click event and redirects to a payment information input page.
[0792] Output: Payment information entry page displayed
[0793] Step 3:
[0794] The user enters payment information and clicks the "Pay" button.
[0795] Input: Payment Information
[0796] Specific operation: The user terminal sends payment information to the server via an HTTP POST request.
[0797] Output: Payment information data
[0798] Step 4:
[0799] The server verifies the payment information and processes the payment.
[0800] Input: Payment information data
[0801] Data processing and calculation: The server uses the payment gateway API to send payment information for verification and processing.
[0802] Specific behavior: The server sends an HTTP POST request to the payment gateway API (e.g., Stripe).
[0803] Output: Payment result
[0804] Step 5:
[0805] If the server is successful in the payment, it notifies the user terminal of the success of the purchase and sends sales information and shipping instructions to the creator.
[0806] Input: Payment result
[0807] Specific operation: The server sends a notification to the user's device via an HTTP response, and sends sales information and shipping instructions to the creator using an email API or HTTP request.
[0808] Output: Purchase success notification and sales notification
[0809] Creator usage process
[0810] Account creation and login
[0811] Step 1:
[0812] The creator accesses the account creation page and enters the required information.
[0813] Input: Creator information (name, email address, password)
[0814] Specific operation: The creator device sends the input data to the server via an HTTP POST request.
[0815] Output: The server holds the received data.
[0816] Step 2:
[0817] The server stores the received information in a database.
[0818] Input: Creator information (name, email address, password)
[0819] Data processing and data calculation: The server generates SQL queries to store the input data in the database.
[0820] What happens: The server uses a database access library to store the data.
[0821] Output: Account creation successful message
[0822] Step 3:
[0823] After creating an account, the creator logs in on the login page.
[0824] Input: Login information (email address, password)
[0825] Specific operation: The creator device sends login information to the server via an HTTP POST request.
[0826] Output: Login result
[0827] Artwork exhibit
[0828] Step 1:
[0829] Creators access the listing page for their work and enter an image, title, description, and price.
[0830] Input: Work information (image, title, description, price)
[0831] Specific operation: The creator device sends the input data to the server via an HTTP POST request.
[0832] Output: Work listing information
[0833] Step 2:
[0834] The server stores the received listing information in a database.
[0835] Input: Artwork listing information
[0836] Data processing and data calculation: The server stores the input data using a database query.
[0837] What happens: The server uses a database access library to store the data.
[0838] Output: Save complete message
[0839] Step 3:
[0840] The server sends the listing information to the artificial intelligence engine and instructs it to extract features.
[0841] Input: Artwork listing information
[0842] Specific operation: The server makes an HTTP POST request to the AI engine and sends the work data.
[0843] Output: Feature extraction instructions
[0844] Step 4:
[0845] An artificial intelligence engine analyzes the work and extracts characteristics such as color, style, and theme.
[0846] Input: Work data
[0847] Data processing and calculation: The artificial intelligence engine uses machine learning models to analyze the artwork data and generate feature data.
[0848] What happens: The AI engine runs the model and generates results.
[0849] Output: Artwork feature data
[0850] Recommendations and the purchase process
[0851] AI-powered analysis
[0852] Step 1:
[0853] The artificial intelligence engine receives and analyzes artwork data from creators.
[0854] Input: Work data
[0855] How it works: The AI engine uses image analysis algorithms to extract features such as color, style, and theme.
[0856] Output: Artwork feature data
[0857] Step 2:
[0858] The extracted feature data is stored in a database on the server.
[0859] Input: Artwork characteristics data
[0860] Specific operation: The server stores the feature data using a database access library.
[0861] Output: Database update
[0862] User recommendations
[0863] Step 1:
[0864] The server performs a match based on the user's profile data and the feature data generated by the AI engine.
[0865] Input: User profile data, work feature data
[0866] Data processing and calculation: The server uses a database query to select the best piece of work.
[0867] Specific operation: The server performs matching and generates a recommendation list.
[0868] Output: Recommendation list
[0869] Step 2:
[0870] The server generates a recommendation list and transmits it to the user terminal.
[0871] Input: Recommendation list
[0872] Specific operation: The server sends the data as an HTTP response.
[0873] Output: Recommendation results
[0874] Step 3:
[0875] The user terminal displays the recommendation list.
[0876] Input: Recommendation results
[0877] What it does: Renders the list to the screen using front-end technology.
[0878] Output: Recommendation list display
[0879] Purchase procedure
[0880] Step 1:
[0881] The user selects a recommended work and checks it on the details page.
[0882] Input: Work ID
[0883] Specific operation: The user terminal requests detailed data from the server.
[0884] Output: Work details data
[0885] Step 2:
[0886] The user finds the title they wish to purchase and enters their payment information.
[0887] Input: Work details, payment information
[0888] Specific operation: The user terminal sends payment information to the server.
[0889] Output: Payment information
[0890] Step 3:
[0891] The server processes the payment.
[0892] Input: Payment Information
[0893] Data processing and calculation: The server uses the payment gateway API to verify the payment information.
[0894] Specific operation: The server sends an HTTP request and processes it.
[0895] Output: Payment result
[0896] Step 4:
[0897] The server notifies the user terminal of the success of the purchase and sends sales information and shipping instructions to the creator.
[0898] Input: Payment result
[0899] Specific operation: The server sends a notification to the user and sends sales information to the creator.
[0900] Output: Purchase confirmation and shipping instructions
[0901] (Application example 1)
[0902] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0903] Conventional online art sales systems have the drawback of making it difficult for users to easily find and purchase artworks that suit their tastes, limiting the means by which creators can effectively promote their works to a large number of potential customers, and also lacking a means for users to view artworks in a virtual space as if they were exhibited in a real gallery.
[0904] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0905] In this invention, the server includes: a means for a user to create an account and log in; a means for a creator to submit an artwork and transmit the artwork data to the server; a means for the server to transmit the received artwork data to an AI engine, which analyzes the artwork and extracts its features; a means for the server to generate a profile based on the user's past history and recommend artworks based on the user's preferences; a means for the user to view the recommended artworks through smart glasses and complete a purchase procedure in the virtual space; a means for operation using eye-gaze input or voice commands; and a means for the server to notify the creator of artwork sales and issue shipping instructions. This enables users to efficiently discover and purchase artworks that suit their preferences in the virtual space, and creators to effectively promote their artworks to a wide range of potential customers.
[0906] "User" refers to a consumer who creates an account, browses artworks, and completes a purchase.
[0907] "Creators" refer to creators who submit their own artworks to the platform and engage in sales activities.
[0908] "Account" refers to data including personal identification information created by users and creators to log in to the system.
[0909] "Server" means a computer system that receives, processes, stores, and centrally controls information from users and creators.
[0910] An "AI engine" refers to an artificial intelligence system that analyzes data from artworks and extracts their features.
[0911] "Recommendation" refers to the act of suggesting artworks based on a user's preferences.
[0912] "Smart glasses" refers to a wearable device that allows users to view and interact with artwork in a virtual space.
[0913] "Gaze input" refers to an input method in which a user performs an operation by moving their gaze.
[0914] "Voice command" refers to an instruction to perform an operation by voice.
[0915] "Profile" refers to personal data reflecting preferences generated based on a user's past history.
[0916] "Checkout" refers to the process by which a user selects a recommended artwork and enters payment information to complete the transaction.
[0917] This invention is an AI-based recommendation platform that connects art lovers and creators, allowing users to discover and purchase artworks that suit their tastes and enabling creators to deliver their works to a wide range of users. It also includes a system that enables viewing and purchasing methods in a virtual space using smart glasses.
[0918] System Configuration
[0919] The system of the present invention mainly comprises the following components:
[0920] 1. User device: Smart glasses (e.g., Oculus Quest 2, Microsoft HoloLens 2) that allow users to create an account, log in, view artworks, and make purchases.
[0921] 2. Creator device: A device that allows creators to create accounts, log in, and list their artworks.
[0922] 3. Server: A central computer system (e.g., AWS, Google Cloud) that receives, processes, and stores information from users and creators and communicates with the AI engine.
[0923] 4. AI Engine: An artificial intelligence system (e.g. TensorFlow, PyTorch) that analyzes the artwork data and extracts features.
[0924] 5. Database: A cloud database (e.g., AWS RDS, Google Cloud SQL) that stores user and creator information, artwork data, and feature information.
[0925] User usage process
[0926] 1. Create an account and log in:
[0927] A user creates an account using smart glasses, enters necessary information (such as name, email address, and password) using eye tracking or voice commands, and the server stores this information in a database.
[0928] Log in using your registered email address and password.
[0929] 2. Viewing and recommending artworks:
[0930] After logging in, users can view artworks in a virtual gallery through smart glasses. The AI engine profiles the user's preferences based on their past viewing and purchasing history, and recommends suitable artworks.
[0931] 3. Purchasing artwork:
[0932] Users select their favorite artwork and complete the purchase process using eye tracking or voice commands. Payment information is entered through the smart glasses interface, and the server completes the checkout process.
[0933] Creator usage process
[0934] 1. Create an account and log in:
[0935] Creators also create accounts and log in.
[0936] 2. Submitting artwork:
[0937] When a creator puts up an item for sale, they input an image of the work, its title, description, price, etc. from their device and send it to the server. The AI engine analyzes this data, extracts its features, and stores them in a database.
[0938] Specific examples
[0939] For example, if a user frequently views abstract art, after logging in, the AI engine will prioritize displaying the latest abstract art works in the virtual space, based on their past browsing history. The user can select the work with their eyes, view detailed information, and then complete the purchase process by issuing the voice command "purchase." This entire process is realized through a natural and intuitive interface.
[0940] Prompt Sentence Examples
[0941] "Recommend the latest abstract art to a user who frequently views abstract art. Also, enable the purchase process via voice command and enter payment information securely."
[0942] This will enable users to enjoy a new experience of appreciating art in a virtual space, and create a system that allows creators to reach more potential customers.
[0943] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0944] Step 1: Account creation and login process
[0945] The user uses the smart glasses and enters the required information (such as name, email address, and password) on the account creation screen using eye gaze or voice commands. The server receives this information and stores it in a database. After saving, the server sends a success notification to the user's device and redirects it to the login page. The user then enters the registered email address and password to log in. The input of this process is the user's personal information, and the output is account authentication and a login session. The server saves the information in the database and executes the authentication process.
[0946] Step 2: Submit your artwork data
[0947] The creator enters information such as an image, title, description, and price of the artwork from the creator device and clicks the "List" button. The server receives this information and stores it in a database. The stored data is sent to an AI engine, which analyzes the image and description to extract features (color, style, theme, etc.). The input to this process is detailed information about the artwork, and the output is feature information. The server manages the storage of data and its transmission to the AI engine, which performs feature extraction.
[0948] Step 3: Recommendation generation
[0949] The server generates a profile based on the user's past browsing and purchase history. The generated profile is sent to the AI engine, which then uses it to recommend artworks that match the user's preferences. The list of recommended artworks is sent to the user's device via the server and displayed on the smart glasses' display. The input to this process is the user's past behavioral data, and the output is a list of recommended artworks. The server aggregates the data and generates the profile, and the AI engine generates the recommendations.
[0950] Step 4: View in the virtual gallery
[0951] The user wears smart glasses and walks around the virtual gallery using eye gaze and gestures. They view the artworks on display, and if they want to see more information, they select the artwork with their eyes and the details page is displayed. The input for this process is a list of recommended artworks, and the output is detailed information. The user's device detects the action using eye gaze tracking and voice recognition, and the server provides detailed data.
[0952] Step 5: Checkout
[0953] When the user selects a title they like and utters the "Purchase" command, they are taken to a payment information input screen through the smart glasses interface. The user then enters payment information using eye contact or voice commands to complete the payment. The server receives the payment information and notifies them of a successful purchase. The input of this process is the payment information, and the output is a notification of a successful purchase. The smart glasses provide the input interface, and the server executes the payment process.
[0954] Step 6: Sales notification and shipping instructions
[0955] Once payment is complete, the server sends a sales notification and shipping instructions to the creator. The creator follows the instructions and ships the work to the user. The input to this process is a successful purchase notification, and the output is a sales notification and shipping instructions. The server sends the notification and manages shipping.
[0956] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0957] The present invention relates to an AI-based recommendation platform for connecting art lovers and creators. The system of the present invention allows users to easily discover and purchase artworks that match their tastes, and also allows creators to distribute their works to a wide range of users. Furthermore, the present invention includes a function for improving recommendation accuracy by combining an emotion engine that recognizes user emotions. The following describes an embodiment of the present invention.
[0958] System Configuration
[0959] The system of the present invention consists of the following major components:
[0960] 1. User device: A device (PC, smartphone, tablet, etc.) that a user uses to create an account, log in, view artworks, check recommendations, and complete purchases.
[0961] 2. Creator device: A device that allows creators to create accounts, log in, and exhibit their artworks.
[0962] 3. Server: A central computer system that receives, processes, and stores information from users and creators. The server also communicates with the AI engine and emotion engine to generate artwork recommendations for users.
[0963] 4. AI Engine: An artificial intelligence system that analyzes data on artworks and extracts their characteristics. Based on the extracted characteristics, it matches them with the user's profile and generates recommendations.
[0964] 5. Emotion Engine: A system that recognizes emotions by analyzing the user's facial expressions, voice, and text data. The recognized emotional data is added to the profile and used when making recommendations.
[0965] User usage process
[0966] 1. Account creation and login: When a user uses the platform for the first time, they create an account. After entering the required information (such as name, email address, and password) from the user's device, the server receives this information and stores it in the database. A success notification is sent to the user's device, and the user is redirected to the login page. Next, the user enters their registered email address and password to log in.
[0967] 2. Viewing and Recommending Artworks: After logging in, users access the artwork viewing page on the platform. The server profiles the user's preferences based on their past browsing and purchase history, and uses an AI engine to generate a list of recommended art works that suit the user. This list of recommended works is displayed on the user's device.
[0968] 3. Emotional Data Collection and Analysis: When a user browses artwork, facial expressions, voice, and text data are sent from the user's device to the emotion engine. The emotion engine analyzes the received data and recognizes the user's emotions. The analysis results are added to the user's profile and reflected in the next recommendation.
[0969] 4. Purchasing an Artwork: When the user selects the artwork they wish to purchase from the recommended artworks and clicks the "Purchase" button on the details page, the server redirects them to a page where they can enter their payment information. The user then enters the necessary payment information and completes the payment process.
[0970] Creator usage process
[0971] 1. Create an account and log in: Creators also create an account on the platform and log in.
[0972] 2. Artwork listing: When a creator wants to list their work, they enter information such as an image, title, description, and price on their device and click the "List" button. The server receives this information and stores it in a database. At the same time, the work data is sent to an AI engine, which analyzes the work and extracts its features.
[0973] Recommendations and the purchase process
[0974] 1. AI analysis: The AI engine analyzes the images and descriptions of artworks submitted by creators and extracts features such as color, style, and theme. This feature information is stored in a database.
[0975] 2. User recommendation: Based on the user's profile, the server compares the characteristic information of the artworks extracted by the AI engine with the user's emotional data to generate a list of recommended artworks that match the user's preferences. This list of recommended artworks is displayed on the user's device, allowing the user to select, view, and purchase artworks that interest them.
[0976] 3. Purchase procedure: When the user enters payment information on the details page of the work they have decided to purchase and completes the payment procedure, the server notifies the creator of the successful purchase. A sales notification and shipping instructions for the work are sent to the creator.
[0977] As a concrete example, consider the case where a user who likes abstract paintings uses this system. After logging in, the user browses abstract paintings recommended based on features extracted by the AI engine from their past browsing history and emotional data, and then purchases one of them. If the purchase is successful, a notification is sent to the creator, and the work is delivered to the user. This entire process is carried out smoothly by the system of the present invention.
[0978] This allows users to easily find and purchase artworks that suit their tastes, and allows creators to promote their works to a large number of potential customers. The combination of the emotion engine further improves the accuracy of recommendations, enriching the user experience.
[0979] The processing flow will be explained below.
[0980] Step 1:
[0981] User device: The user accesses the account creation page, enters the required information such as name, email address, and password, and clicks the "Register" button.
[0982] Step 2:
[0983] Server: Receives the information sent by the user and checks that the input does not overlap with existing data. If there are no duplicates, saves the user's information in the database and sends a notification of successful account creation to the user's device. If there are duplicates, sends an error message.
[0984] Step 3:
[0985] User device: After receiving notification from the server, if the account creation is successful, the user will be redirected to the login page.
[0986] Step 4:
[0987] User device: Access the login page, enter the registered email address and password, and click the "Login" button.
[0988] Step 5:
[0989] Server: Checks the email address and password entered by the user against a database, and if authentication is successful, starts a session and redirects the user to the home page. If authentication fails, sends an error message to the user's terminal.
[0990] Step 6:
[0991] Creator terminal: Creators log in to their account and access the work listing page.
[0992] Step 7:
[0993] Creator's terminal: Enter the necessary information such as the image file, title, description, and price of the work, and click the "List" button.
[0994] Step 8:
[0995] Server: Receives the work data sent by the creator and stores it in a database. After storing it, it sends the work data to the AI engine and requests analysis.
[0996] Step 9:
[0997] AI engine (on the server): Analyzes the images and descriptions of the artwork received, extracts features such as color, style, and theme, and stores the results in a database.
[0998] Step 10:
[0999] Server: When a user accesses an art browsing page, a user profile is generated based on the user's past browsing history and purchase history.
[1000] Step 11:
[1001] Server: The AI engine compares the extracted feature information of the artwork with the user's profile and generates a list of recommended artworks that match the user's preferences.
[1002] Step 12:
[1003] Server: Sends the generated recommendation list to the user terminal.
[1004] Step 13:
[1005] User device: The user receives a list of recommended artworks and clicks on the artwork of interest to view more information.
[1006] Step 14:
[1007] User device: Click the "Purchase" button on the details page of the work you want to purchase.
[1008] Step 15:
[1009] Server: Receives the purchase request and redirects to a page where payment information is entered.
[1010] Step 16:
[1011] User device: Enter payment information (such as credit card information) and click the "Pay" button.
[1012] Step 17:
[1013] Server: Receives payment information and sends it to the payment service to process the payment.
[1014] Step 18:
[1015] Payment Service: Processes the payment information and notifies the server of success or failure.
[1016] Step 19:
[1017] Server: If the payment is successful, a purchase completion message is sent to the user's device and the creator is notified of the sale of the work and shipping instructions. If the payment is unsuccessful, an error message is sent to the user's device.
[1018] Step 20:
[1019] Creator device: Receives purchase notifications and prepares purchased works for shipping.
[1020] Step 21:
[1021] User device: While viewing the artwork, the user's facial expressions, voice, and text data are sent to the emotion engine.
[1022] Step 22:
[1023] Emotion Engine: Analyzes the received data and recognizes the user's emotions. Adds the recognition results to the profile.
[1024] Step 23:
[1025] Server: Generates a recommendation list based on the updated profile and sends it to the user device.
[1026] Step 24:
[1027] User terminal: The updated recommendation list is received and the user selects the next artwork to view.
[1028] Example 2
[1029] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1030] In today's digital art marketplace, it is difficult for users to efficiently discover artworks that match their tastes, and for creators to effectively present their works to a wide range of users. In particular, it is difficult to recommend artworks that accurately reflect users' preferences and emotions, resulting in a poor user experience. Furthermore, for creators, simply listing their works makes it difficult to increase attention and sales.
[1031] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for a user to create an account and log in, a means for a creator to list a work and transmit the data to the server, a means for the server to transmit the received work data to an artificial intelligence engine, which analyzes the data and extracts features, a means for the server to generate a profile based on the user's past history and recommend works based on the user's preferences, a means for the user to view the recommended works and complete a purchase procedure for the product, a means for the server to notify the creator of sales and issue shipping instructions, and a means for the server to transmit user data to an emotion analysis engine, which analyzes the user's emotions and adds the data to the profile. This allows users to easily find and purchase artworks that suit their preferences and emotions, and enables creators to effectively present their works to a wide range of users.
[1032] A "user terminal" is a device (computer, smartphone, tablet, etc.) that a user uses to create an account, log in, view works, and complete purchase procedures.
[1033] "Creator Device" means a device (computer, smartphone, tablet, etc.) that a creator uses to create an account, log in, and submit artwork for sale.
[1034] "Server" means the central computer system that receives, processes, and stores information from users and creators, communicates with the artificial intelligence engine and sentiment analysis engine, and generates recommendations.
[1035] The "artificial intelligence engine" is a system that analyzes data on artworks, extracts their characteristics, and compares them with the user's profile to generate recommendations.
[1036] An "emotion analysis engine" is a system that analyzes a user's facial expressions, voice, and text data to generate emotional information and add that information to the user profile.
[1037] A "profile" is a data set that represents a user's preferences and is generated based on the user's past browsing history, purchase history, and emotional data.
[1038] "Recommendations" are a list of artworks that the artificial intelligence engine recommends based on the user's profile.
[1039] "Artwork data" refers to information about the artworks exhibited by the creators (images, titles, descriptions, prices, etc.).
[1040] The present invention relates to an AI-based recommendation platform for connecting art lovers and art creators. The system is implemented using several major components, including a user terminal, a creator terminal, and a server.
[1041] User terminal
[1042] A user device is a device where a user creates an account, logs in, browses artworks, checks recommendations, and completes purchases. It can be implemented on hardware such as a desktop, laptop, tablet, or smartphone. A user device interfaces with the user through various input devices (e.g., keyboard, mouse, touchscreen) and output devices (e.g., display, speakers).
[1043] Producer's terminal
[1044] The creator terminal is a device for exhibiting artworks and transmitting the data to the server, and like the user terminal, it is implemented on hardware such as desktops, laptops, tablets, and smartphones. The creator enters information such as an image, title, description, and price of the artwork and completes the exhibit procedure.
[1045] server
[1046] The Server is the central processing unit that receives, processes, and stores information from users and creators. The Server includes the following functions:
[1047] 1. Database management - storing user and creator information, artwork data, history data, emotional data, etc.
[1048] 2. Collaboration with AI engine - The received artwork data is sent to the AI engine, which extracts features and generates recommendations.
[1049] 3. Collaboration with sentiment analysis engine - Emotional data sent by the user is sent to the sentiment analysis engine, and the analysis results are added to the profile.
[1050] Artificial Intelligence Engine
[1051] The AI engine is a system that analyzes data on artworks and extracts their characteristics (e.g., color, style, theme). The extracted characteristics are matched with the user's profile to generate a recommendation list.
[1052] Sentiment Analysis Engine
[1053] The emotion analysis engine is a system that analyzes a user's facial expressions, voice, and text data to generate emotional information about the user. The analyzed emotional data is added to the user's profile and used for future recommendations.
[1054] Specific actions
[1055] For example, when a user who likes abstract paintings uses this system, they first create an account and log in. Next, a list of artworks recommended by the AI engine based on their past browsing and purchase history is displayed on the user's device. As the user browses the artworks, their facial expressions and voice are analyzed by the emotion analysis engine, and this data is reflected in the next recommendation. When the user purchases a piece they like, the server processes the payment information and sends a purchase completion notification to the artist.
[1056] Prompt Sentence Examples
[1057] User prompt:
[1058] "Recommend me an art piece"
[1059] "Show me a piece based on my emotions."
[1060] Author prompt:
[1061] I want to exhibit new work.
[1062] "I want to see a feature analysis of my work."
[1063] This allows users to easily discover and purchase artworks that suit their tastes, and allows creators to appeal to a wide range of users. In addition, the combination of a sentiment analysis engine enhances the user experience and improves recommendation accuracy.
[1064] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1065] Step 1: Create an account and log in
[1066] Input: The user enters their name, email address, and password.
[1067] process:
[1068] The user inputs their name, email address, and password from the user terminal.
[1069] The terminal transmits this input information to the server.
[1070] The server stores the received information in a database.
[1071] After saving, the server sends a notification to the terminal that the user has been successfully created.
[1072] Output: The user will see a notification on their device that their account was created successfully and will be redirected to the login page.
[1073] Step 2: Log in
[1074] Input: The registered email address and password are entered by the user.
[1075] process:
[1076] The user inputs an email address and a password from the user terminal.
[1077] The terminal transmits the input information to the server.
[1078] The server checks the database for the relevant user information, and if there is a match, sends a notification of successful login to the terminal.
[1079] Output: The user will see a successful login notification on their device and be redirected to the home page.
[1080] Step 3: View and recommend artworks
[1081] Input: The user's past browsing history and purchase history are input.
[1082] process:
[1083] The user accesses the artwork viewing page.
[1084] The terminal transmits the user's past browsing history and purchase history to the server.
[1085] The server sends the user's profile and history data to the AI engine.
[1086] The AI engine analyzes this data and generates a list of recommended artworks that match the user's preferences.
[1087] The server transmits the generated recommendation list to the terminal.
[1088] Output: A list of recommended artworks is displayed on the user's device.
[1089] Step 4: Collect and analyze sentiment data
[1090] Input: The user's facial expressions, voice, and text data are input.
[1091] process:
[1092] The user browses the artwork.
[1093] The device sends the user's facial expression, voice, and text data to an emotion analysis engine.
[1094] The emotion analysis engine analyzes this data and generates emotion data.
[1095] The generated emotion data is sent to the server and added to the user profile.
[1096] Output: The user's emotional data is added to the profile.
[1097] Step 5: Buy an artwork
[1098] Input: The user enters the artwork information and payment information they have selected.
[1099] process:
[1100] The user selects the title they wish to purchase from the recommendation list.
[1101] The terminal transmits the selection information to the server.
[1102] The server displays a payment information input page on the terminal.
[1103] The user enters payment information (e.g., credit card information).
[1104] The terminal transmits the payment information to the server.
[1105] The server processes the payment and stores the purchase information in a database.
[1106] After saving, the server sends a purchase completion notification to the terminal.
[1107] Output: A purchase completion notification is displayed on the user's device, and a sales notification and shipping instructions are sent to the creator.
[1108] Step 6: List your artwork
[1109] Input: The creator will provide the work image, title, description, and price.
[1110] process:
[1111] The creator inputs the image, title, description, and price of the work from the creator terminal.
[1112] The terminal transmits the input information to the server.
[1113] The server stores the work information in a database.
[1114] At the same time, the server sends the work data to the AI engine, which analyzes its features.
[1115] The analyzed feature information is sent to a server and stored in a database.
[1116] Output: The works submitted by the creators become viewable within the system.
[1117] The above processing steps allow users and creators to smoothly use the system and effectively discover and exhibit artworks.
[1118] (Application example 2)
[1119] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1120] Traditional platforms for viewing and purchasing visual artworks have limited the ability to improve user experience due to the difficulty in recommending artworks based on users' specific emotions. In addition, physical galleries and online platforms lack recommendation systems that instantly reflect users' emotions toward visual artworks, making it difficult for creators to widely and effectively reach customers.
[1121] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for a user to create an account and log in, means for a creator to submit a work of visual artwork and transmit the work data to a central processing unit, means for the central processing unit to transmit the received visual artwork data to an artificial intelligence engine, which analyzes the work and extracts features, means for the central processing unit to generate a profile based on the user's past history and recommend visual artworks based on the user's preferences, means for the user to view the recommended visual artworks and complete a purchase procedure, means for the central processing unit to notify the creator of the sales of the artworks and issue shipping instructions, means for transmitting facial expression, voice, and text data from the user terminal to the emotion engine, means for the emotion engine to analyze the received data and recognize the user's emotions, and means for adding the analysis results to the profile and reflecting them in the next recommendation. This makes it possible to recommend visual artworks that are in line with the user's emotions.
[1122] A "user device" is a device (such as a computer, smartphone, or tablet) used to create an account, log in, view artwork, check recommendations, and complete purchases.
[1123] A "creator device" is a device that allows a creator to create an account, log in, and submit visual artwork.
[1124] "Central Processing Unit" means the central computer system that receives, processes, and stores information from users and creators.
[1125] An "artificial intelligence engine" is an artificial intelligence system that analyzes data from visual artworks and extracts features.
[1126] The "emotion engine" is a system that recognizes emotions by analyzing the user's facial expressions, voice, and text data.
[1127] A "profile" is data that indicates a user's preferences and tendencies and is generated based on the user's past browsing history and purchase history.
[1128] "Recommendation" refers to recommending suitable visual artworks based on a user's profile and emotional data.
[1129] "Smart glasses" are devices worn on the user's head that allow them to view visual artwork in a virtual space.
[1130] A "visual work of art" is a work of art that is intended to be visually appreciated, such as a painting, photograph, or digital art.
[1131] "User emotion" refers to the emotional state recognized by the emotion engine based on facial expressions, voice, and text data when a user views a visual artwork.
[1132] The present invention relates to a system for facilitating the viewing and purchasing of visual artworks, which comprises a user terminal, a creator terminal, a central processing unit, an artificial intelligence engine, an emotion engine, and smart glasses.
[1133] A user terminal is a device that allows a user to create an account, log in, view visual artworks, and complete purchase procedures. This device may include a PC, smartphone, tablet, etc. A creator terminal is a device that allows a creator to exhibit a visual artwork and transmit the artwork data to the central processing unit.
[1134] The central processing unit is a central computer system that receives, processes, and stores information from users and creators. It generates a profile based on the user's past history and recommends visual artworks based on the user's preferences. Furthermore, the central processing unit allows users to send facial expressions, voice, and text data to the emotion engine, which then analyzes this data to recognize the user's emotions.
[1135] The AI engine is a system that analyzes images and descriptions of visual artworks to extract features such as color, style, and theme, which allows it to recommend suitable visual artworks based on the user's profile and emotional data.
[1136] The emotion engine is a system that analyzes facial expressions, voice, and text data sent from the user's device to recognize the user's emotions. The results of this analysis are added to the user's profile and reflected in the next recommendation.
[1137] Smart glasses are devices worn on the user's head that allow them to view visual artworks in a virtual space. The smart glasses' camera captures the user's facial expressions, which are then analyzed by an emotion engine to collect real-time emotional data.
[1138] This will enable the recommendation of visual art works that are in line with the user's emotions, improving the user experience, and allowing creators to effectively promote their works to a large number of potential customers who are interested in visual arts.
[1139] As a concrete example, let's say a user wears smart glasses and visits a virtual art gallery. If the user's profile data indicates a preference for "abstract art" based on their past viewing history, and the user smiles while looking at a particular abstract painting during the session, the emotion engine will recognize this as "joy." Based on this information, the AI engine will recommend abstract paintings that will further enhance the joy.
[1140] Example prompt sentence:
[1141] Build a smart glasses application that recognizes emotions from the user's facial and vocal expressions and recommends visual artworks based on those emotions. Generate a list of recommended visual artworks for a particular emotion and let the user browse through them in a virtual gallery.
[1142] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1143] Step 1:
[1144] The server receives an account creation request from the user's device. The user enters the required information, such as name, email address, and password. This information is stored in a database and a success notification is sent to the user.
[1145] Step 2:
[1146] The server receives a login request from the user's device. When the user enters their registered email address and password, this information is checked against the database, and if authentication is successful, the login process is completed.
[1147] Step 3:
[1148] The server receives requests to exhibit artworks from creators' devices. The creators enter information such as images, titles, descriptions, and prices of their artworks. This data is stored in a database and simultaneously sent to an artificial intelligence engine.
[1149] Step 4:
[1150] An artificial intelligence engine analyzes images and descriptions of artworks submitted by creators, extracting characteristics such as color, style, and theme, and storing this information in a database.
[1151] Step 5:
[1152] The server creates a profile based on the user's past browsing and purchasing history, which reflects the user's preferences and is sent to an artificial intelligence engine to select recommended visual artworks.
[1153] Step 6:
[1154] The user device transmits facial expressions, voice, and text data to the emotion engine in real time, and the emotion engine analyzes this data to identify the user's emotions.
[1155] Step 7:
[1156] The emotion engine adds the analysis results to the profile and reflects them in the next recommendation. The recognized emotion data is stored in a database.
[1157] Step 8:
[1158] The server generates a list of recommended visual artworks based on the user profile and emotion data, and the generated recommendation list is sent to the user terminal, where the user can view the recommended artworks.
[1159] Step 9:
[1160] The user selects the artwork they wish to purchase from the list of recommended visual artworks and clicks the "Purchase" button on the detail page. The server redirects the user to a payment information entry page, where the user enters the necessary payment information to complete the purchase.
[1161] Step 10:
[1162] The server sends a sales notification to the creator and instructs them to ship the work. The creator receives the notification and ships the work to the user, completing the process.
[1163] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1164] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1165] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1166] [Third embodiment]
[1167] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1168] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[1169] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1170] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1171] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1172] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1173] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1174] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1175] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1176] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1177] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1178] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1179] The present invention relates to an AI-based recommendation platform for connecting art lovers and creators. The system of the present invention allows users to easily discover and purchase artworks that suit their tastes, and also allows creators to reach a wide audience with their artworks. The following describes an embodiment of the present invention.
[1180] System Configuration
[1181] The system of the present invention consists of the following major components:
[1182] 1. User device: A device (PC, smartphone, tablet, etc.) that a user uses to create an account, log in, view artworks, check recommendations, and complete purchases.
[1183] 2. Creator device: A device that allows creators to create accounts, log in, and exhibit their artworks.
[1184] 3. Server: A central computer system that receives, processes, and stores information from users and creators. The server also communicates with the AI engine to generate artwork recommendations for users.
[1185] 4. AI Engine: An artificial intelligence system that analyzes data on artworks and extracts their characteristics. Based on the extracted characteristics, it matches them with the user's profile and generates recommendations.
[1186] User usage process
[1187] 1. Account creation and login: When a user uses the platform for the first time, they create an account. After entering the required information (such as name, email address, and password) from the user's device, the server receives this information and stores it in the database. A success notification is sent to the user's device, and the user is redirected to the login page. Next, the user enters their registered email address and password to log in.
[1188] 2. Viewing and Recommending Artworks: After logging in, users access the artwork viewing page on the platform. The server profiles the user's preferences based on their past browsing and purchase history, and uses an AI engine to recommend art works that suit the user. The list of recommended works is displayed on the user's device.
[1189] 3. Purchasing an artwork: When the user selects the artwork they wish to purchase from the recommended artworks and clicks the "Purchase" button on the details page, the server redirects them to a page where they can enter their payment information. The user then enters the necessary payment information and completes the payment process.
[1190] Creator usage process
[1191] 1. Create an account and log in: Creators also create an account on the platform and log in.
[1192] 2. Artwork listing: When a creator wants to list their work, they enter information such as an image, title, description, and price on their device and click the "List" button. The server receives this information and stores it in a database. At the same time, the work data is sent to an AI engine, which analyzes the work and extracts its features.
[1193] Recommendations and the purchase process
[1194] 1. AI analysis: The AI engine analyzes the images and descriptions of artworks submitted by creators and extracts features such as color, style, and theme. This feature information is stored in a database.
[1195] 2. Recommendations to users: The server compares the user's profile with the feature information of the works extracted by the AI engine to generate a list of recommended works. This list of recommended works is displayed on the user's device, and the user can select, view, and purchase works that interest them.
[1196] 3. Purchase procedure: When the user enters payment information on the details page of the work they have decided to purchase and completes the payment procedure, the server notifies the creator of the successful purchase. A sales notification and shipping instructions for the work are sent to the creator.
[1197] As a concrete example, consider the case where a user who likes abstract paintings uses this system. After logging in, the user browses abstract paintings recommended based on features extracted by the AI engine from their past browsing history, and then purchases one of them. If the purchase is successful, a notification is sent to the creator, and the work is delivered to the user. This entire process is carried out smoothly by the system of the present invention.
[1198] This allows users to easily find and purchase artwork that suits their tastes, and allows creators to promote their work to a large number of potential customers.
[1199] The processing flow will be explained below.
[1200] Step 1:
[1201] User device: The user accesses the account creation page, enters the required information such as name, email address, and password, and clicks the "Register" button.
[1202] Step 2:
[1203] Server: Receives the information sent by the user and checks that the input does not overlap with existing data. If there are no duplicates, saves the user's information in the database and sends a notification of successful account creation to the user's device. If there are duplicates, sends an error message.
[1204] Step 3:
[1205] User device: After receiving notification from the server, if the account creation is successful, the user will be redirected to the login page.
[1206] Step 4:
[1207] User device: Access the login page, enter the registered email address and password, and click the "Login" button.
[1208] Step 5:
[1209] Server: Checks the email address and password entered by the user against a database, and if authentication is successful, starts a session and redirects the user to the home page. If authentication fails, sends an error message to the user's terminal.
[1210] Step 6:
[1211] Creator terminal: Creators log in to their account and access the work listing page.
[1212] Step 7:
[1213] Creator's terminal: Enter the necessary information such as the image file, title, description, and price of the work, and click the "List" button.
[1214] Step 8:
[1215] Server: Receives the work data sent by the creator and stores it in a database. After storing it, it sends the work data to the AI engine and requests analysis.
[1216] Step 9:
[1217] AI engine (on the server): Analyzes the images and descriptions of the artwork received, extracts features such as color, style, and theme, and stores the results in a database.
[1218] Step 10:
[1219] Server: When a user accesses an art browsing page, a user profile is generated based on the user's past browsing history and purchase history.
[1220] Step 11:
[1221] Server: The AI engine compares the extracted feature information of the artwork with the user's profile and generates a list of recommended artworks that match the user's preferences.
[1222] Step 12:
[1223] Server: Sends the generated recommendation list to the user terminal.
[1224] Step 13:
[1225] User device: The user receives a list of recommended artworks and clicks on the artwork of interest to view more information.
[1226] Step 14:
[1227] User device: Click the "Purchase" button on the details page of the work you want to purchase.
[1228] Step 15:
[1229] Server: Receives the purchase request and redirects to a page where payment information is entered.
[1230] Step 16:
[1231] User device: Enter payment information (such as credit card information) and click the "Pay" button.
[1232] Step 17:
[1233] Server: Receives payment information and sends it to the payment service to process the payment.
[1234] Step 18:
[1235] Payment Service: Processes the payment information and notifies the server of success or failure.
[1236] Step 19:
[1237] Server: If the payment is successful, a purchase completion message is sent to the user's device and the creator is notified of the sale of the work and shipping instructions. If the payment is unsuccessful, an error message is sent to the user's device.
[1238] Step 20:
[1239] Creator device: Receives purchase notifications and prepares purchased works for shipping.
[1240] Example 1
[1241] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1242] In today's art market, it is difficult for art lovers to easily find and purchase works that suit their tastes. It is also difficult for creators to reach a wide audience. In this situation, a system is needed to efficiently connect art lovers and creators.
[1243] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1244] In this invention, the server includes: means for users to create accounts and log in; means for creators to submit artworks and transmit artwork data to a central processing unit; means for the central processing unit to transmit the received artwork data to an artificial intelligence engine, which analyzes the artworks and extracts features; means for the central processing unit to generate a profile based on the user's past history and recommend artworks based on the user's preferences; means for users to view the recommended artworks and complete the product purchase procedure; means for the central processing unit to notify the creator of artwork sales and issue shipping instructions; means for the user terminal to send an HTTP POST request to the server and exchange account information and payment information; and means for the central processing unit to process payments using a payment gateway API and notify the user terminal of the results. This allows users to easily find and purchase artworks that suit their preferences, and allows creators to promote their works to many potential customers.
[1245] A "user device" is a device (such as a computer, smartphone, or tablet) that a user uses to create an account, log in, view artworks, check recommendations, and complete purchases.
[1246] A "creator terminal" is a device that allows creators to create accounts, log in, and exhibit their artworks.
[1247] The "Central Processing Unit" is a central computer system that receives, processes, and stores information from users and creators, communicates with the AI engine, and generates artwork recommendations for users.
[1248] The "artificial intelligence engine" is an artificial intelligence system that analyzes data on artworks and extracts their characteristics. Based on the extracted characteristics, it matches them with the user's profile and generates recommendations.
[1249] "Profiling" refers to analyzing a user's preferences and tastes based on their past browsing history and purchase history, and extracting their characteristics.
[1250] "Recommendation" means that the artificial intelligence engine presents artworks that may be of interest to the user based on the user's profile.
[1251] An "HTTP POST request" is one of the Internet communication protocols used by user devices and creator devices to send data to a server, and is used when sending data to a server.
[1252] "Payment Gateway API" means the program interface of an external payment service provider that is used by the Server to process payments and is used to verify and process payment information.
[1253] The present invention relates to an artificial intelligence (AI)-based recommendation platform for connecting art lovers and creators. To specifically implement the present invention, the following main components and their respective functions are used:
[1254] System Configuration
[1255] This system consists of the following main components:
[1256] 1. User device: A device used by a user to create an account, log in, view artworks, check recommendations, and complete purchases. This includes computers, smartphones, tablets, etc.
[1257] 2. Creator device: This is the device that creators use to create accounts, log in, and list their artworks. This can be a PC, smartphone, tablet, etc.
[1258] 3. Central Processing Unit: A central computer system that receives, processes, and stores information from users and creators. The server is built using frameworks such as Python or Flask.
[1259] 4. Artificial Intelligence Engine: An AI system that analyzes data from artworks and extracts features. Specifically, it uses machine learning libraries such as TensorFlow and PyTorch.
[1260] User usage process
[1261] 1. Create an account and log in:
[1262] When a user first uses the platform, they create an account by entering information such as their name, email address, and password. The information sent from the user's device is sent to the central processing unit via an HTTP POST request. The central processing unit stores the information in a database and returns a success notification to the user's device. The user then logs in in the same way.
[1263] 2. Viewing and recommending artworks:
[1264] After logging in, the user accesses the artwork viewing page. The central processing unit creates a profile based on the user's past browsing and purchase history. The profile information is sent to an artificial intelligence engine, which then recommends artworks based on the user's preferences. The recommendation list is returned to the user's device and displayed.
[1265] 3. Purchasing artwork:
[1266] The user selects the artwork they wish to purchase from the recommended artworks and clicks the "Purchase" button on the details page. The user's device is redirected to a payment information entry page where they enter their payment information. The payment is processed through a central processing unit using a payment gateway API (e.g., Stripe), and the payment result is notified to the user's device. After the purchase is successful, sales information and shipping instructions are sent to the creator.
[1267] Creator usage process
[1268] 1. Create an account and log in:
[1269] Creators also create accounts in the same way as users. Information sent from creator terminals is stored in the central processing unit and can be accessed by logging in.
[1270] 2. Submitting artwork:
[1271] Creators enter an image of their work, a title, a description, and a price, and then click the "List" button. The data sent from the creator's device is stored in the central processing unit and simultaneously sent to an artificial intelligence engine. The AI engine analyzes the data and extracts features such as color, style, and theme.
[1272] Recommendations and the purchase process
[1273] 1. AI analysis:
[1274] The AI engine receives artwork data sent from the creator's device, analyzes the images and descriptions, and extracts features, which are then stored in the central processing unit's database.
[1275] 2. User Recommendations:
[1276] The central processing unit generates a recommendation list based on the user's profile data by comparing it with the feature data generated by the AI engine. The recommendation list is then displayed on the user's device, allowing the user to select and view works that interest them.
[1277] 3. Purchase procedure:
[1278] Once a user selects a work they wish to purchase and enters their payment information on the details page to complete the payment, the central processing unit processes the payment through the payment gateway, and a success notification is sent to the user, along with a sales notification and shipping instructions to the creator.
[1279] Examples of concrete examples and prompts
[1280] As a concrete example, consider the case where a user who likes abstract paintings uses the system. After the user logs in, the AI engine recommends abstract paintings based on features extracted from the user's past browsing history. When the user selects one and purchases it, a notification is sent to the creator, and the work is delivered to the user.
[1281] An example prompt is:
[1282] "Please extract the characteristics of abstract paintings that art lovers like and recommend them appropriately."
[1283] "Suggest the best impressionist paintings for this user based on their past purchases."
[1284] The above is a specific embodiment of the present invention. This system allows users to easily find and purchase artworks that suit their tastes, and allows creators to promote their works to a large number of potential customers.
[1285] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1286] User usage process
[1287] Account creation and login
[1288] Step 1:
[1289] A user visits the account creation page and enters information such as their name, email address, and password.
[1290] Input: User information (name, email address, password)
[1291] Specific operation: The user terminal sends the input data to the server using an HTTP POST request.
[1292] Output: The server holds the received data.
[1293] Step 2:
[1294] The server stores the received user information in a database.
[1295] Input: User information (name, email address, password)
[1296] Data processing and data calculation: The server formats the input data, generates SQL queries, and inserts them into the database.
[1297] Specific operation: The server stores data using a database access library (e.g., SQLAlchemy).
[1298] Output: The server generates a user creation success message.
[1299] Step 3:
[1300] The server notifies the user terminal of the success of the account creation and redirects them to the login page.
[1301] Input: User creation success message
[1302] Specific operation: The server returns a success message to the user device in the HTTP response and performs a redirect using JavaScript.
[1303] Output: The user terminal displays the login page.
[1304] Step 4:
[1305] The user attempts to log in by entering their email address and password.
[1306] Input: Login information (email address, password)
[1307] Specific operation: The user terminal sends login information to the server via an HTTP POST request.
[1308] Output: The server holds the received data.
[1309] Step 5:
[1310] The server checks the received login information against a database and performs authentication.
[1311] Input: Login information (email address, password)
[1312] Data processing and data calculation: The server uses a database query to match the email address and password and generate an authentication result.
[1313] What happens: The server uses a database access library to compare the authentication information.
[1314] Output: Authentication success or failure message
[1315] Step 6:
[1316] If the server is successful in the authentication, it generates session information and returns it to the user terminal.
[1317] Input: Authentication success message
[1318] Specific behavior: The server generates session information using a session manager (e.g., Flask-Session).
[1319] Output: Session information and a success message
[1320] Viewing and recommending artworks
[1321] Step 1:
[1322] The user accesses the artwork viewing page.
[1323] Input: Session information
[1324] Specific operation: The user terminal sends an HTTP GET request to the server, requesting the page to be viewed.
[1325] Output: The server stores the viewed page data.
[1326] Step 2:
[1327] The server profiles the user based on their past browsing and purchasing history.
[1328] Input: User ID (in session information), past browsing history, purchase history
[1329] Data processing and calculation: The server uses database queries to retrieve historical data and generate profiles.
[1330] What happens: The server uses the user ID to perform a database query to retrieve and parse the data.
[1331] Output: User profile data
[1332] Step 3:
[1333] The server sends the profile data to an artificial intelligence engine, instructing it to generate recommendations.
[1334] Input: User profile data
[1335] Specific operation: The server sends the profile data to the AI engine via an HTTP POST request.
[1336] Output: Recommendation request
[1337] Step 4:
[1338] An artificial intelligence engine analyzes profile data and generates a recommendation list.
[1339] Input: User profile data
[1340] Data processing and calculation: The artificial intelligence engine uses machine learning models to analyze input data and generate an optimal recommendation list.
[1341] Specific operation: The artificial intelligence engine runs the model and generates analysis results.
[1342] Output: Recommendation list
[1343] Step 5:
[1344] The server transmits the recommendation list obtained from the artificial intelligence engine to the user terminal.
[1345] Input: Recommendation list
[1346] Specific operation: The server returns the recommendation data to the user device as an HTTP response.
[1347] Output: The user device stores the recommendation list data.
[1348] Step 6:
[1349] The user terminal displays the recommendation list on the screen.
[1350] Input: Recommendation list data
[1351] Specific behavior: The user device dynamically renders the data using JavaScript or a front-end framework.
[1352] Output: Recommendation list display
[1353] Purchase artwork
[1354] Step 1:
[1355] The user selects the artwork they wish to purchase from the recommendation list and displays the details page.
[1356] Input: Work ID
[1357] Specific operation: The user device sends the ID of the selected work to the server via an HTTP GET request, requesting detailed data.
[1358] Output: Work details data
[1359] Step 2:
[1360] The user clicks the "Buy" button and is redirected to a page to enter payment information.
[1361] Input: Work details data
[1362] Specific action: The user device triggers a click event and redirects to a payment information input page.
[1363] Output: Payment information entry page displayed
[1364] Step 3:
[1365] The user enters payment information and clicks the "Pay" button.
[1366] Input: Payment Information
[1367] Specific operation: The user terminal sends payment information to the server via an HTTP POST request.
[1368] Output: Payment information data
[1369] Step 4:
[1370] The server verifies the payment information and processes the payment.
[1371] Input: Payment information data
[1372] Data processing and calculation: The server uses the payment gateway API to send payment information for verification and processing.
[1373] Specific behavior: The server sends an HTTP POST request to the payment gateway API (e.g., Stripe).
[1374] Output: Payment result
[1375] Step 5:
[1376] If the server is successful in the payment, it notifies the user terminal of the success of the purchase and sends sales information and shipping instructions to the creator.
[1377] Input: Payment result
[1378] Specific operation: The server sends a notification to the user's device via an HTTP response, and sends sales information and shipping instructions to the creator using an email API or HTTP request.
[1379] Output: Purchase success notification and sales notification
[1380] Creator usage process
[1381] Account creation and login
[1382] Step 1:
[1383] The creator accesses the account creation page and enters the required information.
[1384] Input: Creator information (name, email address, password)
[1385] Specific operation: The creator device sends the input data to the server via an HTTP POST request.
[1386] Output: The server holds the received data.
[1387] Step 2:
[1388] The server stores the received information in a database.
[1389] Input: Creator information (name, email address, password)
[1390] Data processing and data calculation: The server generates SQL queries to store the input data in the database.
[1391] What happens: The server uses a database access library to store the data.
[1392] Output: Account creation successful message
[1393] Step 3:
[1394] After creating an account, the creator logs in on the login page.
[1395] Input: Login information (email address, password)
[1396] Specific operation: The creator device sends login information to the server via an HTTP POST request.
[1397] Output: Login result
[1398] Artwork exhibit
[1399] Step 1:
[1400] Creators access the listing page for their work and enter an image, title, description, and price.
[1401] Input: Work information (image, title, description, price)
[1402] Specific operation: The creator device sends the input data to the server via an HTTP POST request.
[1403] Output: Work listing information
[1404] Step 2:
[1405] The server stores the received listing information in a database.
[1406] Input: Artwork listing information
[1407] Data processing and data calculation: The server stores the input data using a database query.
[1408] What happens: The server uses a database access library to store the data.
[1409] Output: Save complete message
[1410] Step 3:
[1411] The server sends the listing information to the artificial intelligence engine and instructs it to extract features.
[1412] Input: Artwork listing information
[1413] Specific operation: The server makes an HTTP POST request to the AI engine and sends the work data.
[1414] Output: Feature extraction instructions
[1415] Step 4:
[1416] An artificial intelligence engine analyzes the work and extracts characteristics such as color, style, and theme.
[1417] Input: Work data
[1418] Data processing and calculation: The artificial intelligence engine uses machine learning models to analyze the artwork data and generate feature data.
[1419] What happens: The AI engine runs the model and generates results.
[1420] Output: Artwork feature data
[1421] Recommendations and the purchase process
[1422] AI-powered analysis
[1423] Step 1:
[1424] The artificial intelligence engine receives and analyzes artwork data from creators.
[1425] Input: Work data
[1426] How it works: The AI engine uses image analysis algorithms to extract features such as color, style, and theme.
[1427] Output: Artwork feature data
[1428] Step 2:
[1429] The extracted feature data is stored in a database on the server.
[1430] Input: Artwork characteristics data
[1431] Specific operation: The server stores the feature data using a database access library.
[1432] Output: Database update
[1433] User recommendations
[1434] Step 1:
[1435] The server performs a match based on the user's profile data and the feature data generated by the AI engine.
[1436] Input: User profile data, work feature data
[1437] Data processing and calculation: The server uses a database query to select the best piece of work.
[1438] Specific operation: The server performs matching and generates a recommendation list.
[1439] Output: Recommendation list
[1440] Step 2:
[1441] The server generates a recommendation list and transmits it to the user terminal.
[1442] Input: Recommendation list
[1443] Specific operation: The server sends the data as an HTTP response.
[1444] Output: Recommendation results
[1445] Step 3:
[1446] The user terminal displays the recommendation list.
[1447] Input: Recommendation results
[1448] What it does: Renders the list to the screen using front-end technology.
[1449] Output: Recommendation list display
[1450] Purchase procedure
[1451] Step 1:
[1452] The user selects a recommended work and checks it on the details page.
[1453] Input: Work ID
[1454] Specific operation: The user terminal requests detailed data from the server.
[1455] Output: Work details data
[1456] Step 2:
[1457] The user finds the title they wish to purchase and enters their payment information.
[1458] Input: Work details, payment information
[1459] Specific operation: The user terminal sends payment information to the server.
[1460] Output: Payment information
[1461] Step 3:
[1462] The server processes the payment.
[1463] Input: Payment Information
[1464] Data processing and calculation: The server uses the payment gateway API to verify the payment information.
[1465] Specific operation: The server sends an HTTP request and processes it.
[1466] Output: Payment result
[1467] Step 4:
[1468] The server notifies the user terminal of the success of the purchase and sends sales information and shipping instructions to the creator.
[1469] Input: Payment result
[1470] Specific operation: The server sends a notification to the user and sends sales information to the creator.
[1471] Output: Purchase confirmation and shipping instructions
[1472] (Application example 1)
[1473] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1474] Conventional online art sales systems have the drawback of making it difficult for users to easily find and purchase artworks that suit their tastes, limiting the means by which creators can effectively promote their works to a large number of potential customers, and also lacking a means for users to view artworks in a virtual space as if they were exhibited in a real gallery.
[1475] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1476] In this invention, the server includes: a means for a user to create an account and log in; a means for a creator to submit an artwork and transmit the artwork data to the server; a means for the server to transmit the received artwork data to an AI engine, which analyzes the artwork and extracts its features; a means for the server to generate a profile based on the user's past history and recommend artworks based on the user's preferences; a means for the user to view the recommended artworks through smart glasses and complete a purchase procedure in the virtual space; a means for operation using eye-gaze input or voice commands; and a means for the server to notify the creator of artwork sales and issue shipping instructions. This enables users to efficiently discover and purchase artworks that suit their preferences in the virtual space, and creators to effectively promote their artworks to a wide range of potential customers.
[1477] "User" refers to a consumer who creates an account, browses artworks, and completes a purchase.
[1478] "Creators" refer to creators who submit their own artworks to the platform and engage in sales activities.
[1479] "Account" refers to data including personal identification information created by users and creators to log in to the system.
[1480] "Server" means a computer system that receives, processes, stores, and centrally controls information from users and creators.
[1481] An "AI engine" refers to an artificial intelligence system that analyzes data from artworks and extracts their features.
[1482] "Recommendation" refers to the act of suggesting artworks based on a user's preferences.
[1483] "Smart glasses" refers to a wearable device that allows users to view and interact with artwork in a virtual space.
[1484] "Gaze input" refers to an input method in which a user performs an operation by moving their gaze.
[1485] "Voice command" refers to an instruction to perform an operation by voice.
[1486] "Profile" refers to personal data reflecting preferences generated based on a user's past history.
[1487] "Checkout" refers to the process by which a user selects a recommended artwork and enters payment information to complete the transaction.
[1488] This invention is an AI-based recommendation platform that connects art lovers and creators, allowing users to discover and purchase artworks that suit their tastes and enabling creators to deliver their works to a wide range of users. It also includes a system that enables viewing and purchasing methods in a virtual space using smart glasses.
[1489] System Configuration
[1490] The system of the present invention mainly comprises the following components:
[1491] 1. User device: Smart glasses (e.g., Oculus Quest 2, Microsoft HoloLens 2) that allow users to create an account, log in, view artworks, and make purchases.
[1492] 2. Creator device: A device that allows creators to create accounts, log in, and list their artworks.
[1493] 3. Server: A central computer system (e.g., AWS, Google Cloud) that receives, processes, and stores information from users and creators and communicates with the AI engine.
[1494] 4. AI Engine: An artificial intelligence system (e.g. TensorFlow, PyTorch) that analyzes the artwork data and extracts features.
[1495] 5. Database: A cloud database (e.g., AWS RDS, Google Cloud SQL) that stores user and creator information, artwork data, and feature information.
[1496] User usage process
[1497] 1. Create an account and log in:
[1498] A user creates an account using smart glasses, enters necessary information (such as name, email address, and password) using eye tracking or voice commands, and the server stores this information in a database.
[1499] Log in using your registered email address and password.
[1500] 2. Viewing and recommending artworks:
[1501] After logging in, users can view artworks in a virtual gallery through smart glasses. The AI engine profiles the user's preferences based on their past viewing and purchasing history, and recommends suitable artworks.
[1502] 3. Purchasing artwork:
[1503] Users select their favorite artwork and complete the purchase process using eye tracking or voice commands. Payment information is entered through the smart glasses interface, and the server completes the checkout process.
[1504] Creator usage process
[1505] 1. Create an account and log in:
[1506] Creators also create accounts and log in.
[1507] 2. Submitting artwork:
[1508] When a creator puts up an item for sale, they input an image of the work, its title, description, price, etc. from their device and send it to the server. The AI engine analyzes this data, extracts its features, and stores them in a database.
[1509] Specific examples
[1510] For example, if a user frequently views abstract art, after logging in, the AI engine will prioritize displaying the latest abstract art works in the virtual space, based on their past browsing history. The user can select the work with their eyes, view detailed information, and then complete the purchase process by issuing the voice command "purchase." This entire process is realized through a natural and intuitive interface.
[1511] Prompt Sentence Examples
[1512] "Recommend the latest abstract art to a user who frequently views abstract art. Also, enable the purchase process via voice command and enter payment information securely."
[1513] This will enable users to enjoy a new experience of appreciating art in a virtual space, and create a system that allows creators to reach more potential customers.
[1514] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1515] Step 1: Account creation and login process
[1516] The user uses the smart glasses and enters the required information (such as name, email address, and password) on the account creation screen using eye gaze or voice commands. The server receives this information and stores it in a database. After saving, the server sends a success notification to the user's device and redirects it to the login page. The user then enters the registered email address and password to log in. The input of this process is the user's personal information, and the output is account authentication and a login session. The server saves the information in the database and executes the authentication process.
[1517] Step 2: Submit your artwork data
[1518] The creator enters information such as an image, title, description, and price of the artwork from the creator device and clicks the "List" button. The server receives this information and stores it in a database. The stored data is sent to an AI engine, which analyzes the image and description to extract features (color, style, theme, etc.). The input to this process is detailed information about the artwork, and the output is feature information. The server manages the storage of data and its transmission to the AI engine, which performs feature extraction.
[1519] Step 3: Recommendation generation
[1520] The server generates a profile based on the user's past browsing and purchase history. The generated profile is sent to the AI engine, which then uses it to recommend artworks that match the user's preferences. The list of recommended artworks is sent to the user's device via the server and displayed on the smart glasses' display. The input to this process is the user's past behavioral data, and the output is a list of recommended artworks. The server aggregates the data and generates the profile, and the AI engine generates the recommendations.
[1521] Step 4: View in the virtual gallery
[1522] The user wears smart glasses and walks around the virtual gallery using eye gaze and gestures. They view the artworks on display, and if they want to see more information, they select the artwork with their eyes and the details page is displayed. The input for this process is a list of recommended artworks, and the output is detailed information. The user's device detects the action using eye gaze tracking and voice recognition, and the server provides detailed data.
[1523] Step 5: Checkout
[1524] When the user selects a title they like and utters the "Purchase" command, they are taken to a payment information input screen through the smart glasses interface. The user then enters payment information using eye contact or voice commands to complete the payment. The server receives the payment information and notifies them of a successful purchase. The input of this process is the payment information, and the output is a notification of a successful purchase. The smart glasses provide the input interface, and the server executes the payment process.
[1525] Step 6: Sales notification and shipping instructions
[1526] Once payment is complete, the server sends a sales notification and shipping instructions to the creator. The creator follows the instructions and ships the work to the user. The input to this process is a successful purchase notification, and the output is a sales notification and shipping instructions. The server sends the notification and manages shipping.
[1527] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1528] The present invention relates to an AI-based recommendation platform for connecting art lovers and creators. The system of the present invention allows users to easily discover and purchase artworks that match their tastes, and also allows creators to distribute their works to a wide range of users. Furthermore, the present invention includes a function for improving recommendation accuracy by combining an emotion engine that recognizes user emotions. The following describes an embodiment of the present invention.
[1529] System Configuration
[1530] The system of the present invention consists of the following major components:
[1531] 1. User device: A device (PC, smartphone, tablet, etc.) that a user uses to create an account, log in, view artworks, check recommendations, and complete purchases.
[1532] 2. Creator device: A device that allows creators to create accounts, log in, and exhibit their artworks.
[1533] 3. Server: A central computer system that receives, processes, and stores information from users and creators. The server also communicates with the AI engine and emotion engine to generate artwork recommendations for users.
[1534] 4. AI Engine: An artificial intelligence system that analyzes data on artworks and extracts their characteristics. Based on the extracted characteristics, it matches them with the user's profile and generates recommendations.
[1535] 5. Emotion Engine: A system that recognizes emotions by analyzing the user's facial expressions, voice, and text data. The recognized emotional data is added to the profile and used when making recommendations.
[1536] User usage process
[1537] 1. Account creation and login: When a user uses the platform for the first time, they create an account. After entering the required information (such as name, email address, and password) from the user's device, the server receives this information and stores it in the database. A success notification is sent to the user's device, and the user is redirected to the login page. Next, the user enters their registered email address and password to log in.
[1538] 2. Viewing and Recommending Artworks: After logging in, users access the artwork viewing page on the platform. The server profiles the user's preferences based on their past browsing and purchase history, and uses an AI engine to generate a list of recommended art works that suit the user. This list of recommended works is displayed on the user's device.
[1539] 3. Emotional Data Collection and Analysis: When a user browses artwork, facial expressions, voice, and text data are sent from the user's device to the emotion engine. The emotion engine analyzes the received data and recognizes the user's emotions. The analysis results are added to the user's profile and reflected in the next recommendation.
[1540] 4. Purchasing an Artwork: When the user selects the artwork they wish to purchase from the recommended artworks and clicks the "Purchase" button on the details page, the server redirects them to a page where they can enter their payment information. The user then enters the necessary payment information and completes the payment process.
[1541] Creator usage process
[1542] 1. Create an account and log in: Creators also create an account on the platform and log in.
[1543] 2. Artwork listing: When a creator wants to list their work, they enter information such as an image, title, description, and price on their device and click the "List" button. The server receives this information and stores it in a database. At the same time, the work data is sent to an AI engine, which analyzes the work and extracts its features.
[1544] Recommendations and the purchase process
[1545] 1. AI analysis: The AI engine analyzes the images and descriptions of artworks submitted by creators and extracts features such as color, style, and theme. This feature information is stored in a database.
[1546] 2. User recommendation: Based on the user's profile, the server compares the characteristic information of the artworks extracted by the AI engine with the user's emotional data to generate a list of recommended artworks that match the user's preferences. This list of recommended artworks is displayed on the user's device, allowing the user to select, view, and purchase artworks that interest them.
[1547] 3. Purchase procedure: When the user enters payment information on the details page of the work they have decided to purchase and completes the payment procedure, the server notifies the creator of the successful purchase. A sales notification and shipping instructions for the work are sent to the creator.
[1548] As a concrete example, consider the case where a user who likes abstract paintings uses this system. After logging in, the user browses abstract paintings recommended based on features extracted by the AI engine from their past browsing history and emotional data, and then purchases one of them. If the purchase is successful, a notification is sent to the creator, and the work is delivered to the user. This entire process is carried out smoothly by the system of the present invention.
[1549] This allows users to easily find and purchase artworks that suit their tastes, and allows creators to promote their works to a large number of potential customers. The combination of the emotion engine further improves the accuracy of recommendations, enriching the user experience.
[1550] The processing flow will be explained below.
[1551] Step 1:
[1552] User device: The user accesses the account creation page, enters the required information such as name, email address, and password, and clicks the "Register" button.
[1553] Step 2:
[1554] Server: Receives the information sent by the user and checks that the input does not overlap with existing data. If there are no duplicates, saves the user's information in the database and sends a notification of successful account creation to the user's device. If there are duplicates, sends an error message.
[1555] Step 3:
[1556] User device: After receiving notification from the server, if the account creation is successful, the user will be redirected to the login page.
[1557] Step 4:
[1558] User device: Access the login page, enter the registered email address and password, and click the "Login" button.
[1559] Step 5:
[1560] Server: Checks the email address and password entered by the user against a database, and if authentication is successful, starts a session and redirects the user to the home page. If authentication fails, sends an error message to the user's terminal.
[1561] Step 6:
[1562] Creator terminal: Creators log in to their account and access the work listing page.
[1563] Step 7:
[1564] Creator's terminal: Enter the necessary information such as the image file, title, description, and price of the work, and click the "List" button.
[1565] Step 8:
[1566] Server: Receives the work data sent by the creator and stores it in a database. After storing it, it sends the work data to the AI engine and requests analysis.
[1567] Step 9:
[1568] AI engine (on the server): Analyzes the images and descriptions of the artwork received, extracts features such as color, style, and theme, and stores the results in a database.
[1569] Step 10:
[1570] Server: When a user accesses an art browsing page, a user profile is generated based on the user's past browsing history and purchase history.
[1571] Step 11:
[1572] Server: The AI engine compares the extracted feature information of the artwork with the user's profile and generates a list of recommended artworks that match the user's preferences.
[1573] Step 12:
[1574] Server: Sends the generated recommendation list to the user terminal.
[1575] Step 13:
[1576] User device: The user receives a list of recommended artworks and clicks on the artwork of interest to view more information.
[1577] Step 14:
[1578] User device: Click the "Purchase" button on the details page of the work you want to purchase.
[1579] Step 15:
[1580] Server: Receives the purchase request and redirects to a page where payment information is entered.
[1581] Step 16:
[1582] User device: Enter payment information (such as credit card information) and click the "Pay" button.
[1583] Step 17:
[1584] Server: Receives payment information and sends it to the payment service to process the payment.
[1585] Step 18:
[1586] Payment Service: Processes the payment information and notifies the server of success or failure.
[1587] Step 19:
[1588] Server: If the payment is successful, a purchase completion message is sent to the user's device and the creator is notified of the sale of the work and shipping instructions. If the payment is unsuccessful, an error message is sent to the user's device.
[1589] Step 20:
[1590] Creator device: Receives purchase notifications and prepares purchased works for shipping.
[1591] Step 21:
[1592] User device: While viewing the artwork, the user's facial expressions, voice, and text data are sent to the emotion engine.
[1593] Step 22:
[1594] Emotion Engine: Analyzes the received data and recognizes the user's emotions. Adds the recognition results to the profile.
[1595] Step 23:
[1596] Server: Generates a recommendation list based on the updated profile and sends it to the user device.
[1597] Step 24:
[1598] User terminal: The updated recommendation list is received and the user selects the next artwork to view.
[1599] Example 2
[1600] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1601] In today's digital art marketplace, it is difficult for users to efficiently discover artworks that match their tastes, and for creators to effectively present their works to a wide range of users. In particular, it is difficult to recommend artworks that accurately reflect users' preferences and emotions, resulting in a poor user experience. Furthermore, for creators, simply listing their works makes it difficult to increase attention and sales.
[1602] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for a user to create an account and log in, a means for a creator to list a work and transmit the data to the server, a means for the server to transmit the received work data to an artificial intelligence engine, which analyzes the data and extracts features, a means for the server to generate a profile based on the user's past history and recommend works based on the user's preferences, a means for the user to view the recommended works and complete a purchase procedure for the product, a means for the server to notify the creator of sales and issue shipping instructions, and a means for the server to transmit user data to an emotion analysis engine, which analyzes the user's emotions and adds the data to the profile. This allows users to easily find and purchase artworks that suit their preferences and emotions, and enables creators to effectively present their works to a wide range of users.
[1603] A "user terminal" is a device (computer, smartphone, tablet, etc.) that a user uses to create an account, log in, view works, and complete purchase procedures.
[1604] "Creator Device" means a device (computer, smartphone, tablet, etc.) that a creator uses to create an account, log in, and submit artwork for sale.
[1605] "Server" means the central computer system that receives, processes, and stores information from users and creators, communicates with the artificial intelligence engine and sentiment analysis engine, and generates recommendations.
[1606] The "artificial intelligence engine" is a system that analyzes data on artworks, extracts their characteristics, and compares them with the user's profile to generate recommendations.
[1607] An "emotion analysis engine" is a system that analyzes a user's facial expressions, voice, and text data to generate emotional information and add that information to the user profile.
[1608] A "profile" is a data set that represents a user's preferences and is generated based on the user's past browsing history, purchase history, and emotional data.
[1609] "Recommendations" are a list of artworks that the artificial intelligence engine recommends based on the user's profile.
[1610] "Artwork data" refers to information about the artworks exhibited by the creators (images, titles, descriptions, prices, etc.).
[1611] The present invention relates to an AI-based recommendation platform for connecting art lovers and art creators. The system is implemented using several major components, including a user terminal, a creator terminal, and a server.
[1612] User terminal
[1613] A user device is a device where a user creates an account, logs in, browses artworks, checks recommendations, and completes purchases. It can be implemented on hardware such as a desktop, laptop, tablet, or smartphone. A user device interfaces with the user through various input devices (e.g., keyboard, mouse, touchscreen) and output devices (e.g., display, speakers).
[1614] Producer's terminal
[1615] The creator terminal is a device for exhibiting artworks and transmitting the data to the server, and like the user terminal, it is implemented on hardware such as desktops, laptops, tablets, and smartphones. The creator enters information such as an image, title, description, and price of the artwork and completes the exhibit procedure.
[1616] server
[1617] The Server is the central processing unit that receives, processes, and stores information from users and creators. The Server includes the following functions:
[1618] 1. Database management - storing user and creator information, artwork data, history data, emotional data, etc.
[1619] 2. Collaboration with AI engine - The received artwork data is sent to the AI engine, which extracts features and generates recommendations.
[1620] 3. Collaboration with sentiment analysis engine - Emotional data sent by the user is sent to the sentiment analysis engine, and the analysis results are added to the profile.
[1621] Artificial Intelligence Engine
[1622] The AI engine is a system that analyzes data on artworks and extracts their characteristics (e.g., color, style, theme). The extracted characteristics are matched with the user's profile to generate a recommendation list.
[1623] Sentiment Analysis Engine
[1624] The emotion analysis engine is a system that analyzes a user's facial expressions, voice, and text data to generate emotional information about the user. The analyzed emotional data is added to the user's profile and used for future recommendations.
[1625] Specific actions
[1626] For example, when a user who likes abstract paintings uses this system, they first create an account and log in. Next, a list of artworks recommended by the AI engine based on their past browsing and purchase history is displayed on the user's device. As the user browses the artworks, their facial expressions and voice are analyzed by the emotion analysis engine, and this data is reflected in the next recommendation. When the user purchases a piece they like, the server processes the payment information and sends a purchase completion notification to the artist.
[1627] Prompt Sentence Examples
[1628] User prompt:
[1629] "Recommend me an art piece"
[1630] "Show me a piece based on my emotions."
[1631] Author prompt:
[1632] I want to exhibit new work.
[1633] "I want to see a feature analysis of my work."
[1634] This allows users to easily discover and purchase artworks that suit their tastes, and allows creators to appeal to a wide range of users. In addition, the combination of a sentiment analysis engine enhances the user experience and improves recommendation accuracy.
[1635] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1636] Step 1: Create an account and log in
[1637] Input: The user enters their name, email address, and password.
[1638] process:
[1639] The user inputs their name, email address, and password from the user terminal.
[1640] The terminal transmits this input information to the server.
[1641] The server stores the received information in a database.
[1642] After saving, the server sends a notification to the terminal that the user has been successfully created.
[1643] Output: The user will see a notification on their device that their account was created successfully and will be redirected to the login page.
[1644] Step 2: Log in
[1645] Input: The registered email address and password are entered by the user.
[1646] process:
[1647] The user inputs an email address and a password from the user terminal.
[1648] The terminal transmits the input information to the server.
[1649] The server checks the database for the relevant user information, and if there is a match, sends a notification of successful login to the terminal.
[1650] Output: The user will see a successful login notification on their device and be redirected to the home page.
[1651] Step 3: View and recommend artworks
[1652] Input: The user's past browsing history and purchase history are input.
[1653] process:
[1654] The user accesses the artwork viewing page.
[1655] The terminal transmits the user's past browsing history and purchase history to the server.
[1656] The server sends the user's profile and history data to the AI engine.
[1657] The AI engine analyzes this data and generates a list of recommended artworks that match the user's preferences.
[1658] The server transmits the generated recommendation list to the terminal.
[1659] Output: A list of recommended artworks is displayed on the user's device.
[1660] Step 4: Collect and analyze sentiment data
[1661] Input: The user's facial expressions, voice, and text data are input.
[1662] process:
[1663] The user browses the artwork.
[1664] The device sends the user's facial expression, voice, and text data to an emotion analysis engine.
[1665] The emotion analysis engine analyzes this data and generates emotion data.
[1666] The generated emotion data is sent to the server and added to the user profile.
[1667] Output: The user's emotional data is added to the profile.
[1668] Step 5: Buy an artwork
[1669] Input: The user enters the artwork information and payment information they have selected.
[1670] process:
[1671] The user selects the title they wish to purchase from the recommendation list.
[1672] The terminal transmits the selection information to the server.
[1673] The server displays a payment information input page on the terminal.
[1674] The user enters payment information (e.g., credit card information).
[1675] The terminal transmits the payment information to the server.
[1676] The server processes the payment and stores the purchase information in a database.
[1677] After saving, the server sends a purchase completion notification to the terminal.
[1678] Output: A purchase completion notification is displayed on the user's device, and a sales notification and shipping instructions are sent to the creator.
[1679] Step 6: List your artwork
[1680] Input: The creator will provide the work image, title, description, and price.
[1681] process:
[1682] The creator inputs the image, title, description, and price of the work from the creator terminal.
[1683] The terminal transmits the input information to the server.
[1684] The server stores the work information in a database.
[1685] At the same time, the server sends the work data to the AI engine, which analyzes its features.
[1686] The analyzed feature information is sent to a server and stored in a database.
[1687] Output: The works submitted by the creators become viewable within the system.
[1688] The above processing steps allow users and creators to smoothly use the system and effectively discover and exhibit artworks.
[1689] (Application example 2)
[1690] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1691] Traditional platforms for viewing and purchasing visual artworks have limited the ability to improve user experience due to the difficulty in recommending artworks based on users' specific emotions. In addition, physical galleries and online platforms lack recommendation systems that instantly reflect users' emotions toward visual artworks, making it difficult for creators to widely and effectively reach customers.
[1692] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for a user to create an account and log in, means for a creator to submit a work of visual artwork and transmit the work data to a central processing unit, means for the central processing unit to transmit the received visual artwork data to an artificial intelligence engine, which analyzes the work and extracts features, means for the central processing unit to generate a profile based on the user's past history and recommend visual artworks based on the user's preferences, means for the user to view the recommended visual artworks and complete a purchase procedure, means for the central processing unit to notify the creator of the sales of the artworks and issue shipping instructions, means for transmitting facial expression, voice, and text data from the user terminal to the emotion engine, means for the emotion engine to analyze the received data and recognize the user's emotions, and means for adding the analysis results to the profile and reflecting them in the next recommendation. This makes it possible to recommend visual artworks that are in line with the user's emotions.
[1693] A "user device" is a device (such as a computer, smartphone, or tablet) used to create an account, log in, view artwork, check recommendations, and complete purchases.
[1694] A "creator device" is a device that allows a creator to create an account, log in, and submit visual artwork.
[1695] "Central Processing Unit" means the central computer system that receives, processes, and stores information from users and creators.
[1696] An "artificial intelligence engine" is an artificial intelligence system that analyzes data from visual artworks and extracts features.
[1697] The "emotion engine" is a system that recognizes emotions by analyzing the user's facial expressions, voice, and text data.
[1698] A "profile" is data that indicates a user's preferences and tendencies and is generated based on the user's past browsing history and purchase history.
[1699] "Recommendation" refers to recommending suitable visual artworks based on a user's profile and emotional data.
[1700] "Smart glasses" are devices worn on the user's head that allow them to view visual artwork in a virtual space.
[1701] A "visual work of art" is a work of art that is intended to be visually appreciated, such as a painting, photograph, or digital art.
[1702] "User emotion" refers to the emotional state recognized by the emotion engine based on facial expressions, voice, and text data when a user views a visual artwork.
[1703] The present invention relates to a system for facilitating the viewing and purchasing of visual artworks, which comprises a user terminal, a creator terminal, a central processing unit, an artificial intelligence engine, an emotion engine, and smart glasses.
[1704] A user terminal is a device that allows a user to create an account, log in, view visual artworks, and complete purchase procedures. This device may include a PC, smartphone, tablet, etc. A creator terminal is a device that allows a creator to exhibit a visual artwork and transmit the artwork data to the central processing unit.
[1705] The central processing unit is a central computer system that receives, processes, and stores information from users and creators. It generates a profile based on the user's past history and recommends visual artworks based on the user's preferences. Furthermore, the central processing unit allows users to send facial expressions, voice, and text data to the emotion engine, which then analyzes this data to recognize the user's emotions.
[1706] The AI engine is a system that analyzes images and descriptions of visual artworks to extract features such as color, style, and theme, which allows it to recommend suitable visual artworks based on the user's profile and emotional data.
[1707] The emotion engine is a system that analyzes facial expressions, voice, and text data sent from the user's device to recognize the user's emotions. The results of this analysis are added to the user's profile and reflected in the next recommendation.
[1708] Smart glasses are devices worn on the user's head that allow them to view visual artworks in a virtual space. The smart glasses' camera captures the user's facial expressions, which are then analyzed by an emotion engine to collect real-time emotional data.
[1709] This will enable the recommendation of visual art works that are in line with the user's emotions, improving the user experience, and allowing creators to effectively promote their works to a large number of potential customers who are interested in visual arts.
[1710] As a concrete example, let's say a user wears smart glasses and visits a virtual art gallery. If the user's profile data indicates a preference for "abstract art" based on their past viewing history, and the user smiles while looking at a particular abstract painting during the session, the emotion engine will recognize this as "joy." Based on this information, the AI engine will recommend abstract paintings that will further enhance the joy.
[1711] Example prompt sentence:
[1712] Build a smart glasses application that recognizes emotions from the user's facial and vocal expressions and recommends visual artworks based on those emotions. Generate a list of recommended visual artworks for a particular emotion and let the user browse through them in a virtual gallery.
[1713] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1714] Step 1:
[1715] The server receives an account creation request from the user's device. The user enters the required information, such as name, email address, and password. This information is stored in a database and a success notification is sent to the user.
[1716] Step 2:
[1717] The server receives a login request from the user's device. When the user enters their registered email address and password, this information is checked against the database, and if authentication is successful, the login process is completed.
[1718] Step 3:
[1719] The server receives requests to exhibit artworks from creators' devices. The creators enter information such as images, titles, descriptions, and prices of their artworks. This data is stored in a database and simultaneously sent to an artificial intelligence engine.
[1720] Step 4:
[1721] An artificial intelligence engine analyzes images and descriptions of artworks submitted by creators, extracting characteristics such as color, style, and theme, and storing this information in a database.
[1722] Step 5:
[1723] The server creates a profile based on the user's past browsing and purchasing history, which reflects the user's preferences and is sent to an artificial intelligence engine to select recommended visual artworks.
[1724] Step 6:
[1725] The user device transmits facial expressions, voice, and text data to the emotion engine in real time, and the emotion engine analyzes this data to identify the user's emotions.
[1726] Step 7:
[1727] The emotion engine adds the analysis results to the profile and reflects them in the next recommendation. The recognized emotion data is stored in a database.
[1728] Step 8:
[1729] The server generates a list of recommended visual artworks based on the user profile and emotion data, and the generated recommendation list is sent to the user terminal, where the user can view the recommended artworks.
[1730] Step 9:
[1731] The user selects the artwork they wish to purchase from the list of recommended visual artworks and clicks the "Purchase" button on the detail page. The server redirects the user to a payment information entry page, where the user enters the necessary payment information to complete the purchase.
[1732] Step 10:
[1733] The server sends a sales notification to the creator and instructs them to ship the work. The creator receives the notification and ships the work to the user, completing the process.
[1734] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1735] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1736] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1737] [Fourth embodiment]
[1738] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1739] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1740] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1741] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1742] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1743] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1744] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1745] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1746] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1747] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1748] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1749] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1750] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1751] The present invention relates to an AI-based recommendation platform for connecting art lovers and creators. The system of the present invention allows users to easily discover and purchase artworks that suit their tastes, and also allows creators to reach a wide audience with their artworks. The following describes an embodiment of the present invention.
[1752] System Configuration
[1753] The system of the present invention consists of the following major components:
[1754] 1. User device: A device (PC, smartphone, tablet, etc.) that a user uses to create an account, log in, view artworks, check recommendations, and complete purchases.
[1755] 2. Creator device: A device that allows creators to create accounts, log in, and exhibit their artworks.
[1756] 3. Server: A central computer system that receives, processes, and stores information from users and creators. The server also communicates with the AI engine to generate artwork recommendations for users.
[1757] 4. AI Engine: An artificial intelligence system that analyzes data on artworks and extracts their characteristics. Based on the extracted characteristics, it matches them with the user's profile and generates recommendations.
[1758] User usage process
[1759] 1. Account creation and login: When a user uses the platform for the first time, they create an account. After entering the required information (such as name, email address, and password) from the user's device, the server receives this information and stores it in the database. A success notification is sent to the user's device, and the user is redirected to the login page. Next, the user enters their registered email address and password to log in.
[1760] 2. Viewing and Recommending Artworks: After logging in, users access the artwork viewing page on the platform. The server profiles the user's preferences based on their past browsing and purchase history, and uses an AI engine to recommend art works that suit the user. The list of recommended works is displayed on the user's device.
[1761] 3. Purchasing an artwork: When the user selects the artwork they wish to purchase from the recommended artworks and clicks the "Purchase" button on the details page, the server redirects them to a page where they can enter their payment information. The user then enters the necessary payment information and completes the payment process.
[1762] Creator usage process
[1763] 1. Create an account and log in: Creators also create an account on the platform and log in.
[1764] 2. Artwork listing: When a creator wants to list their work, they enter information such as an image, title, description, and price on their device and click the "List" button. The server receives this information and stores it in a database. At the same time, the work data is sent to an AI engine, which analyzes the work and extracts its features.
[1765] Recommendations and the purchase process
[1766] 1. AI analysis: The AI engine analyzes the images and descriptions of artworks submitted by creators and extracts features such as color, style, and theme. This feature information is stored in a database.
[1767] 2. Recommendations to users: The server compares the user's profile with the feature information of the works extracted by the AI engine to generate a list of recommended works. This list of recommended works is displayed on the user's device, and the user can select, view, and purchase works that interest them.
[1768] 3. Purchase procedure: When the user enters payment information on the details page of the work they have decided to purchase and completes the payment procedure, the server notifies the creator of the successful purchase. A sales notification and shipping instructions for the work are sent to the creator.
[1769] As a concrete example, consider the case where a user who likes abstract paintings uses this system. After logging in, the user browses abstract paintings recommended based on features extracted by the AI engine from their past browsing history, and then purchases one of them. If the purchase is successful, a notification is sent to the creator, and the work is delivered to the user. This entire process is carried out smoothly by the system of the present invention.
[1770] This allows users to easily find and purchase artwork that suits their tastes, and allows creators to promote their work to a large number of potential customers.
[1771] The processing flow will be explained below.
[1772] Step 1:
[1773] User device: The user accesses the account creation page, enters the required information such as name, email address, and password, and clicks the "Register" button.
[1774] Step 2:
[1775] Server: Receives the information sent by the user and checks that the input does not overlap with existing data. If there are no duplicates, saves the user's information in the database and sends a notification of successful account creation to the user's device. If there are duplicates, sends an error message.
[1776] Step 3:
[1777] User device: After receiving notification from the server, if the account creation is successful, the user will be redirected to the login page.
[1778] Step 4:
[1779] User device: Access the login page, enter the registered email address and password, and click the "Login" button.
[1780] Step 5:
[1781] Server: Checks the email address and password entered by the user against a database, and if authentication is successful, starts a session and redirects the user to the home page. If authentication fails, sends an error message to the user's terminal.
[1782] Step 6:
[1783] Creator terminal: Creators log in to their account and access the work listing page.
[1784] Step 7:
[1785] Creator's terminal: Enter the necessary information such as the image file, title, description, and price of the work, and click the "List" button.
[1786] Step 8:
[1787] Server: Receives the work data sent by the creator and stores it in a database. After storing it, it sends the work data to the AI engine and requests analysis.
[1788] Step 9:
[1789] AI engine (on the server): Analyzes the images and descriptions of the artwork received, extracts features such as color, style, and theme, and stores the results in a database.
[1790] Step 10:
[1791] Server: When a user accesses an art browsing page, a user profile is generated based on the user's past browsing history and purchase history.
[1792] Step 11:
[1793] Server: The AI engine compares the extracted feature information of the artwork with the user's profile and generates a list of recommended artworks that match the user's preferences.
[1794] Step 12:
[1795] Server: Sends the generated recommendation list to the user terminal.
[1796] Step 13:
[1797] User device: The user receives a list of recommended artworks and clicks on the artwork of interest to view more information.
[1798] Step 14:
[1799] User device: Click the "Purchase" button on the details page of the work you want to purchase.
[1800] Step 15:
[1801] Server: Receives the purchase request and redirects to a page where payment information is entered.
[1802] Step 16:
[1803] User device: Enter payment information (such as credit card information) and click the "Pay" button.
[1804] Step 17:
[1805] Server: Receives payment information and sends it to the payment service to process the payment.
[1806] Step 18:
[1807] Payment Service: Processes the payment information and notifies the server of success or failure.
[1808] Step 19:
[1809] Server: If the payment is successful, a purchase completion message is sent to the user's device and the creator is notified of the sale of the work and shipping instructions. If the payment is unsuccessful, an error message is sent to the user's device.
[1810] Step 20:
[1811] Creator device: Receives purchase notifications and prepares purchased works for shipping.
[1812] Example 1
[1813] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1814] In today's art market, it is difficult for art lovers to easily find and purchase works that suit their tastes. It is also difficult for creators to reach a wide audience. In this situation, a system is needed to efficiently connect art lovers and creators.
[1815] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1816] In this invention, the server includes: means for users to create accounts and log in; means for creators to submit artworks and transmit artwork data to a central processing unit; means for the central processing unit to transmit the received artwork data to an artificial intelligence engine, which analyzes the artworks and extracts features; means for the central processing unit to generate a profile based on the user's past history and recommend artworks based on the user's preferences; means for users to view the recommended artworks and complete the product purchase procedure; means for the central processing unit to notify the creator of artwork sales and issue shipping instructions; means for the user terminal to send an HTTP POST request to the server and exchange account information and payment information; and means for the central processing unit to process payments using a payment gateway API and notify the user terminal of the results. This allows users to easily find and purchase artworks that suit their preferences, and allows creators to promote their works to many potential customers.
[1817] A "user device" is a device (such as a computer, smartphone, or tablet) that a user uses to create an account, log in, view artworks, check recommendations, and complete purchases.
[1818] A "creator terminal" is a device that allows creators to create accounts, log in, and exhibit their artworks.
[1819] The "Central Processing Unit" is a central computer system that receives, processes, and stores information from users and creators, communicates with the AI engine, and generates artwork recommendations for users.
[1820] The "artificial intelligence engine" is an artificial intelligence system that analyzes data on artworks and extracts their characteristics. Based on the extracted characteristics, it matches them with the user's profile and generates recommendations.
[1821] "Profiling" refers to analyzing a user's preferences and tastes based on their past browsing history and purchase history, and extracting their characteristics.
[1822] "Recommendation" means that the artificial intelligence engine presents artworks that may be of interest to the user based on the user's profile.
[1823] An "HTTP POST request" is one of the Internet communication protocols used by user devices and creator devices to send data to a server, and is used when sending data to a server.
[1824] "Payment Gateway API" means the program interface of an external payment service provider that is used by the Server to process payments and is used to verify and process payment information.
[1825] The present invention relates to an artificial intelligence (AI)-based recommendation platform for connecting art lovers and creators. To specifically implement the present invention, the following main components and their respective functions are used:
[1826] System Configuration
[1827] This system consists of the following main components:
[1828] 1. User device: A device used by a user to create an account, log in, view artworks, check recommendations, and complete purchases. This includes computers, smartphones, tablets, etc.
[1829] 2. Creator device: This is the device that creators use to create accounts, log in, and list their artworks. This can be a PC, smartphone, tablet, etc.
[1830] 3. Central Processing Unit: A central computer system that receives, processes, and stores information from users and creators. The server is built using frameworks such as Python or Flask.
[1831] 4. Artificial Intelligence Engine: An AI system that analyzes data from artworks and extracts features. Specifically, it uses machine learning libraries such as TensorFlow and PyTorch.
[1832] User usage process
[1833] 1. Create an account and log in:
[1834] When a user first uses the platform, they create an account by entering information such as their name, email address, and password. The information sent from the user's device is sent to the central processing unit via an HTTP POST request. The central processing unit stores the information in a database and returns a success notification to the user's device. The user then logs in in the same way.
[1835] 2. Viewing and recommending artworks:
[1836] After logging in, the user accesses the artwork viewing page. The central processing unit creates a profile based on the user's past browsing and purchase history. The profile information is sent to an artificial intelligence engine, which then recommends artworks based on the user's preferences. The recommendation list is returned to the user's device and displayed.
[1837] 3. Purchasing artwork:
[1838] The user selects the artwork they wish to purchase from the recommended artworks and clicks the "Purchase" button on the details page. The user's device is redirected to a payment information entry page where they enter their payment information. The payment is processed through a central processing unit using a payment gateway API (e.g., Stripe), and the payment result is notified to the user's device. After the purchase is successful, sales information and shipping instructions are sent to the creator.
[1839] Creator usage process
[1840] 1. Create an account and log in:
[1841] Creators also create accounts in the same way as users. Information sent from creator terminals is stored in the central processing unit and can be accessed by logging in.
[1842] 2. Submitting artwork:
[1843] Creators enter an image of their work, a title, a description, and a price, and then click the "List" button. The data sent from the creator's device is stored in the central processing unit and simultaneously sent to an artificial intelligence engine. The AI engine analyzes the data and extracts features such as color, style, and theme.
[1844] Recommendations and the purchase process
[1845] 1. AI analysis:
[1846] The AI engine receives artwork data sent from the creator's device, analyzes the images and descriptions, and extracts features, which are then stored in the central processing unit's database.
[1847] 2. User Recommendations:
[1848] The central processing unit generates a recommendation list based on the user's profile data by comparing it with the feature data generated by the AI engine. The recommendation list is then displayed on the user's device, allowing the user to select and view works that interest them.
[1849] 3. Purchase procedure:
[1850] Once a user selects a work they wish to purchase and enters their payment information on the details page to complete the payment, the central processing unit processes the payment through the payment gateway, and a success notification is sent to the user, along with a sales notification and shipping instructions to the creator.
[1851] Examples of concrete examples and prompts
[1852] As a concrete example, consider the case where a user who likes abstract paintings uses the system. After the user logs in, the AI engine recommends abstract paintings based on features extracted from the user's past browsing history. When the user selects one and purchases it, a notification is sent to the creator, and the work is delivered to the user.
[1853] An example prompt is:
[1854] "Please extract the characteristics of abstract paintings that art lovers like and recommend them appropriately."
[1855] "Suggest the best impressionist paintings for this user based on their past purchases."
[1856] The above is a specific embodiment of the present invention. This system allows users to easily find and purchase artworks that suit their tastes, and allows creators to promote their works to a large number of potential customers.
[1857] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1858] User usage process
[1859] Account creation and login
[1860] Step 1:
[1861] A user visits the account creation page and enters information such as their name, email address, and password.
[1862] Input: User information (name, email address, password)
[1863] Specific operation: The user terminal sends the input data to the server using an HTTP POST request.
[1864] Output: The server holds the received data.
[1865] Step 2:
[1866] The server stores the received user information in a database.
[1867] Input: User information (name, email address, password)
[1868] Data processing and data calculation: The server formats the input data, generates SQL queries, and inserts them into the database.
[1869] Specific operation: The server stores data using a database access library (e.g., SQLAlchemy).
[1870] Output: The server generates a user creation success message.
[1871] Step 3:
[1872] The server notifies the user terminal of the success of the account creation and redirects them to the login page.
[1873] Input: User creation success message
[1874] Specific operation: The server returns a success message to the user device in the HTTP response and performs a redirect using JavaScript.
[1875] Output: The user terminal displays the login page.
[1876] Step 4:
[1877] The user attempts to log in by entering their email address and password.
[1878] Input: Login information (email address, password)
[1879] Specific operation: The user terminal sends login information to the server via an HTTP POST request.
[1880] Output: The server holds the received data.
[1881] Step 5:
[1882] The server checks the received login information against a database and performs authentication.
[1883] Input: Login information (email address, password)
[1884] Data processing and data calculation: The server uses a database query to match the email address and password and generate an authentication result.
[1885] What happens: The server uses a database access library to compare the authentication information.
[1886] Output: Authentication success or failure message
[1887] Step 6:
[1888] If the server is successful in the authentication, it generates session information and returns it to the user terminal.
[1889] Input: Authentication success message
[1890] Specific behavior: The server generates session information using a session manager (e.g., Flask-Session).
[1891] Output: Session information and a success message
[1892] Viewing and recommending artworks
[1893] Step 1:
[1894] The user accesses the artwork viewing page.
[1895] Input: Session information
[1896] Specific operation: The user terminal sends an HTTP GET request to the server, requesting the page to be viewed.
[1897] Output: The server stores the viewed page data.
[1898] Step 2:
[1899] The server profiles the user based on their past browsing and purchasing history.
[1900] Input: User ID (in session information), past browsing history, purchase history
[1901] Data processing and calculation: The server uses database queries to retrieve historical data and generate profiles.
[1902] What happens: The server uses the user ID to perform a database query to retrieve and parse the data.
[1903] Output: User profile data
[1904] Step 3:
[1905] The server sends the profile data to an artificial intelligence engine, instructing it to generate recommendations.
[1906] Input: User profile data
[1907] Specific operation: The server sends the profile data to the AI engine via an HTTP POST request.
[1908] Output: Recommendation request
[1909] Step 4:
[1910] An artificial intelligence engine analyzes profile data and generates a recommendation list.
[1911] Input: User profile data
[1912] Data processing and calculation: The artificial intelligence engine uses machine learning models to analyze input data and generate an optimal recommendation list.
[1913] Specific operation: The artificial intelligence engine runs the model and generates analysis results.
[1914] Output: Recommendation list
[1915] Step 5:
[1916] The server transmits the recommendation list obtained from the artificial intelligence engine to the user terminal.
[1917] Input: Recommendation list
[1918] Specific operation: The server returns the recommendation data to the user device as an HTTP response.
[1919] Output: The user device stores the recommendation list data.
[1920] Step 6:
[1921] The user terminal displays the recommendation list on the screen.
[1922] Input: Recommendation list data
[1923] Specific behavior: The user device dynamically renders the data using JavaScript or a front-end framework.
[1924] Output: Recommendation list display
[1925] Purchase artwork
[1926] Step 1:
[1927] The user selects the artwork they wish to purchase from the recommendation list and displays the details page.
[1928] Input: Work ID
[1929] Specific operation: The user device sends the ID of the selected work to the server via an HTTP GET request, requesting detailed data.
[1930] Output: Work details data
[1931] Step 2:
[1932] The user clicks the "Buy" button and is redirected to a page to enter payment information.
[1933] Input: Work details data
[1934] Specific action: The user device triggers a click event and redirects to a payment information input page.
[1935] Output: Payment information entry page displayed
[1936] Step 3:
[1937] The user enters payment information and clicks the "Pay" button.
[1938] Input: Payment Information
[1939] Specific operation: The user terminal sends payment information to the server via an HTTP POST request.
[1940] Output: Payment information data
[1941] Step 4:
[1942] The server verifies the payment information and processes the payment.
[1943] Input: Payment information data
[1944] Data processing and calculation: The server uses the payment gateway API to send payment information for verification and processing.
[1945] Specific behavior: The server sends an HTTP POST request to the payment gateway API (e.g., Stripe).
[1946] Output: Payment result
[1947] Step 5:
[1948] If the server is successful in the payment, it notifies the user terminal of the success of the purchase and sends sales information and shipping instructions to the creator.
[1949] Input: Payment result
[1950] Specific operation: The server sends a notification to the user's device via an HTTP response, and sends sales information and shipping instructions to the creator using an email API or HTTP request.
[1951] Output: Purchase success notification and sales notification
[1952] Creator usage process
[1953] Account creation and login
[1954] Step 1:
[1955] The creator accesses the account creation page and enters the required information.
[1956] Input: Creator information (name, email address, password)
[1957] Specific operation: The creator device sends the input data to the server via an HTTP POST request.
[1958] Output: The server holds the received data.
[1959] Step 2:
[1960] The server stores the received information in a database.
[1961] Input: Creator information (name, email address, password)
[1962] Data processing and data calculation: The server generates SQL queries to store the input data in the database.
[1963] What happens: The server uses a database access library to store the data.
[1964] Output: Account creation successful message
[1965] Step 3:
[1966] After creating an account, the creator logs in on the login page.
[1967] Input: Login information (email address, password)
[1968] Specific operation: The creator device sends login information to the server via an HTTP POST request.
[1969] Output: Login result
[1970] Artwork exhibit
[1971] Step 1:
[1972] Creators access the listing page for their work and enter an image, title, description, and price.
[1973] Input: Work information (image, title, description, price)
[1974] Specific operation: The creator device sends the input data to the server via an HTTP POST request.
[1975] Output: Work listing information
[1976] Step 2:
[1977] The server stores the received listing information in a database.
[1978] Input: Artwork listing information
[1979] Data processing and data calculation: The server stores the input data using a database query.
[1980] What happens: The server uses a database access library to store the data.
[1981] Output: Save complete message
[1982] Step 3:
[1983] The server sends the listing information to the artificial intelligence engine and instructs it to extract features.
[1984] Input: Artwork listing information
[1985] Specific operation: The server makes an HTTP POST request to the AI engine and sends the work data.
[1986] Output: Feature extraction instructions
[1987] Step 4:
[1988] An artificial intelligence engine analyzes the work and extracts characteristics such as color, style, and theme.
[1989] Input: Work data
[1990] Data processing and calculation: The artificial intelligence engine uses machine learning models to analyze the artwork data and generate feature data.
[1991] What happens: The AI engine runs the model and generates results.
[1992] Output: Artwork feature data
[1993] Recommendations and the purchase process
[1994] AI-powered analysis
[1995] Step 1:
[1996] The artificial intelligence engine receives and analyzes artwork data from creators.
[1997] Input: Work data
[1998] How it works: The AI engine uses image analysis algorithms to extract features such as color, style, and theme.
[1999] Output: Artwork feature data
[2000] Step 2:
[2001] The extracted feature data is stored in a database on the server.
[2002] Input: Artwork characteristics data
[2003] Specific operation: The server stores the feature data using a database access library.
[2004] Output: Database update
[2005] User recommendations
[2006] Step 1:
[2007] The server performs a match based on the user's profile data and the feature data generated by the AI engine.
[2008] Input: User profile data, work feature data
[2009] Data processing and calculation: The server uses a database query to select the best piece of work.
[2010] Specific operation: The server performs matching and generates a recommendation list.
[2011] Output: Recommendation list
[2012] Step 2:
[2013] The server generates a recommendation list and transmits it to the user terminal.
[2014] Input: Recommendation list
[2015] Specific operation: The server sends the data as an HTTP response.
[2016] Output: Recommendation results
[2017] Step 3:
[2018] The user terminal displays the recommendation list.
[2019] Input: Recommendation results
[2020] What it does: Renders the list to the screen using front-end technology.
[2021] Output: Recommendation list display
[2022] Purchase procedure
[2023] Step 1:
[2024] The user selects a recommended work and checks it on the details page.
[2025] Input: Work ID
[2026] Specific operation: The user terminal requests detailed data from the server.
[2027] Output: Work details data
[2028] Step 2:
[2029] The user finds the title they wish to purchase and enters their payment information.
[2030] Input: Work details, payment information
[2031] Specific operation: The user terminal sends payment information to the server.
[2032] Output: Payment information
[2033] Step 3:
[2034] The server processes the payment.
[2035] Input: Payment Information
[2036] Data processing and calculation: The server uses the payment gateway API to verify the payment information.
[2037] Specific operation: The server sends an HTTP request and processes it.
[2038] Output: Payment result
[2039] Step 4:
[2040] The server notifies the user terminal of the success of the purchase and sends sales information and shipping instructions to the creator.
[2041] Input: Payment result
[2042] Specific operation: The server sends a notification to the user and sends sales information to the creator.
[2043] Output: Purchase confirmation and shipping instructions
[2044] (Application example 1)
[2045] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2046] Conventional online art sales systems have the drawback of making it difficult for users to easily find and purchase artworks that suit their tastes, limiting the means by which creators can effectively promote their works to a large number of potential customers, and also lacking a means for users to view artworks in a virtual space as if they were exhibited in a real gallery.
[2047] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[2048] In this invention, the server includes: a means for a user to create an account and log in; a means for a creator to submit an artwork and transmit the artwork data to the server; a means for the server to transmit the received artwork data to an AI engine, which analyzes the artwork and extracts its features; a means for the server to generate a profile based on the user's past history and recommend artworks based on the user's preferences; a means for the user to view the recommended artworks through smart glasses and complete a purchase procedure in the virtual space; a means for operation using eye-gaze input or voice commands; and a means for the server to notify the creator of artwork sales and issue shipping instructions. This enables users to efficiently discover and purchase artworks that suit their preferences in the virtual space, and creators to effectively promote their artworks to a wide range of potential customers.
[2049] "User" refers to a consumer who creates an account, browses artworks, and completes a purchase.
[2050] "Creators" refer to creators who submit their own artworks to the platform and engage in sales activities.
[2051] "Account" refers to data including personal identification information created by users and creators to log in to the system.
[2052] "Server" means a computer system that receives, processes, stores, and centrally controls information from users and creators.
[2053] An "AI engine" refers to an artificial intelligence system that analyzes data from artworks and extracts their features.
[2054] "Recommendation" refers to the act of suggesting artworks based on a user's preferences.
[2055] "Smart glasses" refers to a wearable device that allows users to view and interact with artwork in a virtual space.
[2056] "Gaze input" refers to an input method in which a user performs an operation by moving their gaze.
[2057] "Voice command" refers to an instruction to perform an operation by voice.
[2058] "Profile" refers to personal data reflecting preferences generated based on a user's past history.
[2059] "Checkout" refers to the process by which a user selects a recommended artwork and enters payment information to complete the transaction.
[2060] This invention is an AI-based recommendation platform that connects art lovers and creators, allowing users to discover and purchase artworks that suit their tastes and enabling creators to deliver their works to a wide range of users. It also includes a system that enables viewing and purchasing methods in a virtual space using smart glasses.
[2061] System Configuration
[2062] The system of the present invention mainly comprises the following components:
[2063] 1. User device: Smart glasses (e.g., Oculus Quest 2, Microsoft HoloLens 2) that allow users to create an account, log in, view artworks, and make purchases.
[2064] 2. Creator device: A device that allows creators to create accounts, log in, and list their artworks.
[2065] 3. Server: A central computer system (e.g., AWS, Google Cloud) that receives, processes, and stores information from users and creators and communicates with the AI engine.
[2066] 4. AI Engine: An artificial intelligence system (e.g. TensorFlow, PyTorch) that analyzes the artwork data and extracts features.
[2067] 5. Database: A cloud database (e.g., AWS RDS, Google Cloud SQL) that stores user and creator information, artwork data, and feature information.
[2068] User usage process
[2069] 1. Create an account and log in:
[2070] A user creates an account using smart glasses, enters necessary information (such as name, email address, and password) using eye tracking or voice commands, and the server stores this information in a database.
[2071] Log in using your registered email address and password.
[2072] 2. Viewing and recommending artworks:
[2073] After logging in, users can view artworks in a virtual gallery through smart glasses. The AI engine profiles the user's preferences based on their past viewing and purchasing history, and recommends suitable artworks.
[2074] 3. Purchasing artwork:
[2075] Users select their favorite artwork and complete the purchase process using eye tracking or voice commands. Payment information is entered through the smart glasses interface, and the server completes the checkout process.
[2076] Creator usage process
[2077] 1. Create an account and log in:
[2078] Creators also create accounts and log in.
[2079] 2. Submitting artwork:
[2080] When a creator puts up an item for sale, they input an image of the work, its title, description, price, etc. from their device and send it to the server. The AI engine analyzes this data, extracts its features, and stores them in a database.
[2081] Specific examples
[2082] For example, if a user frequently views abstract art, after logging in, the AI engine will prioritize displaying the latest abstract art works in the virtual space, based on their past browsing history. The user can select the work with their eyes, view detailed information, and then complete the purchase process by issuing the voice command "purchase." This entire process is realized through a natural and intuitive interface.
[2083] Prompt Sentence Examples
[2084] "Recommend the latest abstract art to a user who frequently views abstract art. Also, enable the purchase process via voice command and enter payment information securely."
[2085] This will enable users to enjoy a new experience of appreciating art in a virtual space, and create a system that allows creators to reach more potential customers.
[2086] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[2087] Step 1: Account creation and login process
[2088] The user uses the smart glasses and enters the required information (such as name, email address, and password) on the account creation screen using eye gaze or voice commands. The server receives this information and stores it in a database. After saving, the server sends a success notification to the user's device and redirects it to the login page. The user then enters the registered email address and password to log in. The input of this process is the user's personal information, and the output is account authentication and a login session. The server saves the information in the database and executes the authentication process.
[2089] Step 2: Submit your artwork data
[2090] The creator enters information such as an image, title, description, and price of the artwork from the creator device and clicks the "List" button. The server receives this information and stores it in a database. The stored data is sent to an AI engine, which analyzes the image and description to extract features (color, style, theme, etc.). The input to this process is detailed information about the artwork, and the output is feature information. The server manages the storage of data and its transmission to the AI engine, which performs feature extraction.
[2091] Step 3: Recommendation generation
[2092] The server generates a profile based on the user's past browsing and purchase history. The generated profile is sent to the AI engine, which then uses it to recommend artworks that match the user's preferences. The list of recommended artworks is sent to the user's device via the server and displayed on the smart glasses' display. The input to this process is the user's past behavioral data, and the output is a list of recommended artworks. The server aggregates the data and generates the profile, and the AI engine generates the recommendations.
[2093] Step 4: View in the virtual gallery
[2094] The user wears smart glasses and walks around the virtual gallery using eye gaze and gestures. They view the artworks on display, and if they want to see more information, they select the artwork with their eyes and the details page is displayed. The input for this process is a list of recommended artworks, and the output is detailed information. The user's device detects the action using eye gaze tracking and voice recognition, and the server provides detailed data.
[2095] Step 5: Checkout
[2096] When the user selects a title they like and utters the "Purchase" command, they are taken to a payment information input screen through the smart glasses interface. The user then enters payment information using eye contact or voice commands to complete the payment. The server receives the payment information and notifies them of a successful purchase. The input of this process is the payment information, and the output is a notification of a successful purchase. The smart glasses provide the input interface, and the server executes the payment process.
[2097] Step 6: Sales notification and shipping instructions
[2098] Once payment is complete, the server sends a sales notification and shipping instructions to the creator. The creator follows the instructions and ships the work to the user. The input to this process is a successful purchase notification, and the output is a sales notification and shipping instructions. The server sends the notification and manages shipping.
[2099] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[2100] The present invention relates to an AI-based recommendation platform for connecting art lovers and creators. The system of the present invention allows users to easily discover and purchase artworks that match their tastes, and also allows creators to distribute their works to a wide range of users. Furthermore, the present invention includes a function for improving recommendation accuracy by combining an emotion engine that recognizes user emotions. The following describes an embodiment of the present invention.
[2101] System Configuration
[2102] The system of the present invention consists of the following major components:
[2103] 1. User device: A device (PC, smartphone, tablet, etc.) that a user uses to create an account, log in, view artworks, check recommendations, and complete purchases.
[2104] 2. Creator device: A device that allows creators to create accounts, log in, and exhibit their artworks.
[2105] 3. Server: A central computer system that receives, processes, and stores information from users and creators. The server also communicates with the AI engine and emotion engine to generate artwork recommendations for users.
[2106] 4. AI Engine: An artificial intelligence system that analyzes data on artworks and extracts their characteristics. Based on the extracted characteristics, it matches them with the user's profile and generates recommendations.
[2107] 5. Emotion Engine: A system that recognizes emotions by analyzing the user's facial expressions, voice, and text data. The recognized emotional data is added to the profile and used when making recommendations.
[2108] User usage process
[2109] 1. Account creation and login: When a user uses the platform for the first time, they create an account. After entering the required information (such as name, email address, and password) from the user's device, the server receives this information and stores it in the database. A success notification is sent to the user's device, and the user is redirected to the login page. Next, the user enters their registered email address and password to log in.
[2110] 2. Viewing and Recommending Artworks: After logging in, users access the artwork viewing page on the platform. The server profiles the user's preferences based on their past browsing and purchase history, and uses an AI engine to generate a list of recommended art works that suit the user. This list of recommended works is displayed on the user's device.
[2111] 3. Emotional Data Collection and Analysis: When a user browses artwork, facial expressions, voice, and text data are sent from the user's device to the emotion engine. The emotion engine analyzes the received data and recognizes the user's emotions. The analysis results are added to the user's profile and reflected in the next recommendation.
[2112] 4. Purchasing an Artwork: When the user selects the artwork they wish to purchase from the recommended artworks and clicks the "Purchase" button on the details page, the server redirects them to a page where they can enter their payment information. The user then enters the necessary payment information and completes the payment process.
[2113] Creator usage process
[2114] 1. Create an account and log in: Creators also create an account on the platform and log in.
[2115] 2. Artwork listing: When a creator wants to list their work, they enter information such as an image, title, description, and price on their device and click the "List" button. The server receives this information and stores it in a database. At the same time, the work data is sent to an AI engine, which analyzes the work and extracts its features.
[2116] Recommendations and the purchase process
[2117] 1. AI analysis: The AI engine analyzes the images and descriptions of artworks submitted by creators and extracts features such as color, style, and theme. This feature information is stored in a database.
[2118] 2. User recommendation: Based on the user's profile, the server compares the characteristic information of the artworks extracted by the AI engine with the user's emotional data to generate a list of recommended artworks that match the user's preferences. This list of recommended artworks is displayed on the user's device, allowing the user to select, view, and purchase artworks that interest them.
[2119] 3. Purchase procedure: When the user enters payment information on the details page of the work they have decided to purchase and completes the payment procedure, the server notifies the creator of the successful purchase. A sales notification and shipping instructions for the work are sent to the creator.
[2120] As a concrete example, consider the case where a user who likes abstract paintings uses this system. After logging in, the user browses abstract paintings recommended based on features extracted by the AI engine from their past browsing history and emotional data, and then purchases one of them. If the purchase is successful, a notification is sent to the creator, and the work is delivered to the user. This entire process is carried out smoothly by the system of the present invention.
[2121] This allows users to easily find and purchase artworks that suit their tastes, and allows creators to promote their works to a large number of potential customers. The combination of the emotion engine further improves the accuracy of recommendations, enriching the user experience.
[2122] The processing flow will be explained below.
[2123] Step 1:
[2124] User device: The user accesses the account creation page, enters the required information such as name, email address, and password, and clicks the "Register" button.
[2125] Step 2:
[2126] Server: Receives the information sent by the user and checks that the input does not overlap with existing data. If there are no duplicates, saves the user's information in the database and sends a notification of successful account creation to the user's device. If there are duplicates, sends an error message.
[2127] Step 3:
[2128] User device: After receiving notification from the server, if the account creation is successful, the user will be redirected to the login page.
[2129] Step 4:
[2130] User device: Access the login page, enter the registered email address and password, and click the "Login" button.
[2131] Step 5:
[2132] Server: Checks the email address and password entered by the user against a database, and if authentication is successful, starts a session and redirects the user to the home page. If authentication fails, sends an error message to the user's terminal.
[2133] Step 6:
[2134] Creator terminal: Creators log in to their account and access the work listing page.
[2135] Step 7:
[2136] Creator's terminal: Enter the necessary information such as the image file, title, description, and price of the work, and click the "List" button.
[2137] Step 8:
[2138] Server: Receives the work data sent by the creator and stores it in a database. After storing it, it sends the work data to the AI engine and requests analysis.
[2139] Step 9:
[2140] AI engine (on the server): Analyzes the images and descriptions of the artwork received, extracts features such as color, style, and theme, and stores the results in a database.
[2141] Step 10:
[2142] Server: When a user accesses an art browsing page, a user profile is generated based on the user's past browsing history and purchase history.
[2143] Step 11:
[2144] Server: The AI engine compares the extracted feature information of the artwork with the user's profile and generates a list of recommended artworks that match the user's preferences.
[2145] Step 12:
[2146] Server: Sends the generated recommendation list to the user terminal.
[2147] Step 13:
[2148] User device: The user receives a list of recommended artworks and clicks on the artwork of interest to view more information.
[2149] Step 14:
[2150] User device: Click the "Purchase" button on the details page of the work you want to purchase.
[2151] Step 15:
[2152] Server: Receives the purchase request and redirects to a page where payment information is entered.
[2153] Step 16:
[2154] User device: Enter payment information (such as credit card information) and click the "Pay" button.
[2155] Step 17:
[2156] Server: Receives payment information and sends it to the payment service to process the payment.
[2157] Step 18:
[2158] Payment Service: Processes the payment information and notifies the server of success or failure.
[2159] Step 19:
[2160] Server: If the payment is successful, a purchase completion message is sent to the user's device and the creator is notified of the sale of the work and shipping instructions. If the payment is unsuccessful, an error message is sent to the user's device.
[2161] Step 20:
[2162] Creator device: Receives purchase notifications and prepares purchased works for shipping.
[2163] Step 21:
[2164] User device: While viewing the artwork, the user's facial expressions, voice, and text data are sent to the emotion engine.
[2165] Step 22:
[2166] Emotion Engine: Analyzes the received data and recognizes the user's emotions. Adds the recognition results to the profile.
[2167] Step 23:
[2168] Server: Generates a recommendation list based on the updated profile and sends it to the user device.
[2169] Step 24:
[2170] User terminal: The updated recommendation list is received and the user selects the next artwork to view.
[2171] Example 2
[2172] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2173] In today's digital art marketplace, it is difficult for users to efficiently discover artworks that match their tastes, and for creators to effectively present their works to a wide range of users. In particular, it is difficult to recommend artworks that accurately reflect users' preferences and emotions, resulting in a poor user experience. Furthermore, for creators, simply listing their works makes it difficult to increase attention and sales.
[2174] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for a user to create an account and log in, a means for a creator to list a work and transmit the data to the server, a means for the server to transmit the received work data to an artificial intelligence engine, which analyzes the data and extracts features, a means for the server to generate a profile based on the user's past history and recommend works based on the user's preferences, a means for the user to view the recommended works and complete a purchase procedure for the product, a means for the server to notify the creator of sales and issue shipping instructions, and a means for the server to transmit user data to an emotion analysis engine, which analyzes the user's emotions and adds the data to the profile. This allows users to easily find and purchase artworks that suit their preferences and emotions, and enables creators to effectively present their works to a wide range of users.
[2175] A "user terminal" is a device (computer, smartphone, tablet, etc.) that a user uses to create an account, log in, view works, and complete purchase procedures.
[2176] "Creator Device" means a device (computer, smartphone, tablet, etc.) that a creator uses to create an account, log in, and submit artwork for sale.
[2177] "Server" means the central computer system that receives, processes, and stores information from users and creators, communicates with the artificial intelligence engine and sentiment analysis engine, and generates recommendations.
[2178] The "artificial intelligence engine" is a system that analyzes data on artworks, extracts their characteristics, and compares them with the user's profile to generate recommendations.
[2179] An "emotion analysis engine" is a system that analyzes a user's facial expressions, voice, and text data to generate emotional information and add that information to the user profile.
[2180] A "profile" is a data set that represents a user's preferences and is generated based on the user's past browsing history, purchase history, and emotional data.
[2181] "Recommendations" are a list of artworks that the artificial intelligence engine recommends based on the user's profile.
[2182] "Artwork data" refers to information about the artworks exhibited by the creators (images, titles, descriptions, prices, etc.).
[2183] The present invention relates to an AI-based recommendation platform for connecting art lovers and art creators. The system is implemented using several major components, including a user terminal, a creator terminal, and a server.
[2184] User terminal
[2185] A user device is a device where a user creates an account, logs in, browses artworks, checks recommendations, and completes purchases. It can be implemented on hardware such as a desktop, laptop, tablet, or smartphone. A user device interfaces with the user through various input devices (e.g., keyboard, mouse, touchscreen) and output devices (e.g., display, speakers).
[2186] Producer's terminal
[2187] The creator terminal is a device for exhibiting artworks and transmitting the data to the server, and like the user terminal, it is implemented on hardware such as desktops, laptops, tablets, and smartphones. The creator enters information such as an image, title, description, and price of the artwork and completes the exhibit procedure.
[2188] server
[2189] The Server is the central processing unit that receives, processes, and stores information from users and creators. The Server includes the following functions:
[2190] 1. Database management - storing user and creator information, artwork data, history data, emotional data, etc.
[2191] 2. Collaboration with AI engine - The received artwork data is sent to the AI engine, which extracts features and generates recommendations.
[2192] 3. Collaboration with sentiment analysis engine - Emotional data sent by the user is sent to the sentiment analysis engine, and the analysis results are added to the profile.
[2193] Artificial Intelligence Engine
[2194] The AI engine is a system that analyzes data on artworks and extr...
Claims
1. a means for users to create accounts and log in; A means for creators to submit artworks and send the artwork data to a server; The server sends the received art work data to the AI engine, and the AI engine analyzes the work and extracts its features. A server generates a profile based on the user's past history and recommends artworks based on the user's preferences; A means for users to view recommended artworks and complete a purchase process; A system that includes a means for the server to notify creators of sales of their works and provide shipping instructions.
2. 10. The system of claim 1, wherein the AI engine includes means for analyzing images of artworks and descriptions thereof to extract color, style, and theme.
3. The system of claim 1 further comprising means for profiling user preferences based on the user's past browsing and purchasing history.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A