system
An AI-driven system analyzes artworks to identify target audiences and generate promotional strategies, enhancing artist engagement and fundraising efforts.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- SOFTBANK GROUP CORP
- Filing Date
- 2024-12-12
- Publication Date
- 2026-06-24
Smart Images

Figure 2026103567000001_ABST
Abstract
Description
Technical Field
[0001] The technology of the present disclosure relates to a system.
Background Art
[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] Many artists find it difficult to effectively promote their works and find appropriate target audiences. Also, when trying to realize a project with limited funds, it is difficult to effectively design means of raising funds. In addition, there are continuous challenges in promoting communication with fans and maximizing the transmission of the value of works. If these factors are not met, the activities of artists may stagnate and it may become difficult to make a living.
Means for Solving the Problems
[0005] This invention provides a system for analyzing the characteristics of artworks using an artificial intelligence model that analyzes data on artworks, and for proposing optimal promotional strategies. This system includes means for identifying suitable target audiences based on the analysis results and determining the most effective information dissemination platform and timing. It also automatically generates content to facilitate communication with fans and provides a platform for interaction to form fan communities. Furthermore, it supports the planning of crowdfunding projects and generates presentation materials for effective fundraising, thereby analyzing market data, optimizing artwork pricing, and comprehensively supporting artists' activities.
[0006] "Works of art" refer to creative forms of expression such as paintings, sculptures, music, and videos, and are objects that are appreciated visually or aurally.
[0007] "Data analysis" refers to the process of analyzing data based on a specific purpose and extracting useful information from it.
[0008] An "artificial intelligence model" refers to a method in which a computer has a set of algorithms and program structures to automate specific tasks and achieve cognitive behavior similar to that of a human.
[0009] A "promotion strategy" refers to the activities and policies planned to increase awareness of a product or service in the market and to boost sales.
[0010] "Target audience" refers to the group of customers who are expected to receive a particular product or service in marketing activities.
[0011] An "information dissemination platform" refers to digital media, online services, or applications for distributing and sharing content and information.
[0012] "Fan communication" refers to activities that build and strengthen relationships with customers or supporters who are interested in a work or artist, through dialogue and interaction.
[0013] A "crowdfunding project" refers to a plan and activity that raises funds from a large number of people online to achieve a specific purpose or project.
[0014] "Pricing" refers to the process of determining the price at which a product or service is sold in the market. [Brief explanation of the drawing]
[0015] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11]It is a sequence diagram showing the processing flow of the data processing system in Embodiment 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.
Modes for Carrying Out the Invention
[0016] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.
[0017] First, the terms used in the following description will be explained.
[0018] In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.
[0019] In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.
[0020] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.
[0021] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).
[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."
[0023] [First Embodiment]
[0024] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.
[0025] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0026] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0027] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.
[0028] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0030] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.
[0031] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0032] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.
[0033] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0034] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0035] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0036] This invention provides an integrated support system that enables various artists and creators to more effectively promote their works and activities, strengthen relationships with fans, and successfully raise funds. Specific embodiments are described below.
[0037] This system begins with the user uploading their artwork data from their device to the server. This data includes images, descriptions, and related metadata. The server receives this data and uses its built-in artificial intelligence model to analyze the artwork's characteristics in detail. The AI model utilizes machine learning techniques to analyze the artwork's style, theme, and techniques, and stores this information in a digital database.
[0038] Next, the server identifies the target audience for the work based on market databases and past success stories. This analysis allows for the development of an optimal promotional strategy. The server supports effective information dissemination by selecting appropriate social media platforms and determining the timing of posting. Furthermore, an AI generation algorithm automatically generates social media post content and visual content, which are then provided to users.
[0039] Afterward, the user reviews the promotional proposal from their device and edits it as needed. Once editing is complete, the server automatically posts to social media at the scheduled time.
[0040] Furthermore, this system also includes specialized functions for building fan communities. Users can create community rooms and begin interactive interactions with their fans. The server uses AI-based content generation capabilities to automatically generate topics and questions that facilitate interaction, deepening relationships with fans.
[0041] Furthermore, as part of crowdfunding support, users can input details about their new project, and the server will use AI to generate presentation materials for that project. The generated materials will be customized based on a marketing strategy aimed at achieving the fundraising goal.
[0042] As described above, the present invention is a system that integrates various functions to support artists' activities, enabling effective and efficient promotion, fostering interaction with fans, and crowdfunding. Users can intuitively operate these functions through a user-friendly interface accessible via their terminal.
[0043] The following describes the processing flow.
[0044] Step 1:
[0045] Users upload their artwork data to the server via their device. This artwork data includes image files and text data.
[0046] Step 2:
[0047] The server receives the uploaded artwork data and inputs it into its internal artificial intelligence model. The AI model uses machine learning algorithms to analyze the artwork's style, theme, techniques, and other characteristics.
[0048] Step 3:
[0049] Based on the analysis results, the server refers to a market database to identify a suitable target audience for the work. This process takes into account past sales performance of similar works and current market trends.
[0050] Step 4:
[0051] The server builds the optimal promotional strategy based on the target audience. It determines the social media platforms to use and the timing of posts, and creates a draft promotional strategy.
[0052] Step 5:
[0053] The server utilizes AI generation capabilities to automatically generate text and visual content for social media posts and presents them to users.
[0054] Step 6:
[0055] The user reviews the proposed promotional strategy presented by the server via their device. After editing the content as needed, they submit their approval back to the server.
[0056] Step 7:
[0057] The server automatically posts user-approved promotional content to social media at scheduled times.
[0058] Step 8:
[0059] Users interact with fans using the community features on the server. The server uses AI to suggest events and automatically generates content that promotes interaction.
[0060] Step 9:
[0061] When a user launches a new crowdfunding project, they input the project details from their device into the server. The server then uses AI to automatically create presentation materials based on this information.
[0062] Step 10:
[0063] The server provides users with a personalized fundraising plan and runs simulations to help them reach their target amount. Users then use this as a basis to conduct their crowdfunding campaign.
[0064] (Example 1)
[0065] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0066] In the modern era, it is extremely difficult for artists and creators to effectively promote their work, strengthen relationships with interested parties, and raise funds. In particular, effectively disseminating information to the appropriate target groups, forming interest groups, and ensuring the success of funded projects are challenging to achieve with limited resources. Therefore, new technological means are needed to comprehensively address these challenges.
[0067] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0068] In this invention, the server includes means for proposing an appropriate advertising strategy using an information processing device that analyzes data of works of art and analyzes its characteristics; means for identifying suitable target groups based on the analysis results and determining the basis and timing for effective information dissemination; and means for automatically generating information to facilitate communication with interested parties and providing a platform for interaction to form groups of interested parties. This enables creators to maximize the value of their works and achieve their goals effectively and efficiently.
[0069] An "information processing device" is an electronic device used for collecting, analyzing, and processing data, and is a device that has the capability to handle diverse types of information.
[0070] A "work of art" is a creative product expressed visually or aurally, reflecting the sensibilities and ideas of its creator.
[0071] A "marketing strategy" is a planned set of guidelines aimed at making a particular product or service known to many people and promoting its use.
[0072] A "target group" is a group of people who possess specific attributes and are expected to be recipients of a product or service.
[0073] "Information dissemination" refers to activities and methods of widely communicating a specific message or content.
[0074] "Foundation" refers to the systems or networks that serve as the basis for carrying out specific activities or functions.
[0075] "Timing" is a concept that refers to the optimal time or period for performing a particular activity.
[0076] "Interested individuals" are people who have an interest in a particular product, service, or piece of information.
[0077] "Communication" refers to the exchange of information, opinions, and emotions, thereby deepening mutual understanding.
[0078] A "group" is an organization or organization consisting of multiple people who share a common purpose or interest.
[0079] A "place for exchange" is a physical or virtual space established for the purpose of exchanging information and opinions and for facilitating communication.
[0080] This invention is built as an integrated system to support the promotion of works of art. The system is primarily operated around servers, terminals, and users.
[0081] First, the user uploads the artwork data to the server using their device. The data includes images of the artwork, a description, and related metadata, and this process is carried out securely via an internet connection.
[0082] The server is built using Python and employs machine learning libraries such as TENSORFLOW® and PyTorch. Based on the uploaded data, the server uses an AI model to analyze the style, theme, and techniques of the artwork. The analysis results are stored in a digital database and used to develop promotional strategies.
[0083] As a concrete example, if a user wants to announce a new painting project, they input images and a description of the artwork into the system. The server uses AI to analyze the data and identify a target group. This allows the user to receive an appropriate promotional plan.
[0084] Furthermore, the system includes a function to automatically generate conversation content in order to stimulate communication with those who are interested. OpenAI's GPT and other technologies are used for text generation, providing topics and questions that stimulate interest.
[0085] In the funding support process, users enter project details from their devices, and the server uses AI to generate reports that reflect a customized marketing strategy.
[0086] An example of a prompt would be: "Please propose a promotional strategy for a newly released artwork. The target audience is young adults, and the main theme is environmental protection."
[0087] In this way, the system effectively brings out the value of the artwork and broadly supports the creators' activities through diverse forms of assistance.
[0088] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0089] Step 1:
[0090] Users input their artwork data via their device and upload it to the server.
[0091] Specifically, users use their devices to select artwork image files, their descriptions, and metadata, and send them to the server via a dedicated web interface. The input data mainly consists of image files and text information, which are used for analysis in the next step.
[0092] Step 2:
[0093] The server receives the uploaded artwork data and performs analysis using an AI model.
[0094] Based on the received data, the server uses machine learning frameworks such as TensorFlow and PyTorch to identify the style, theme, and techniques of the artwork. The input image data is processed using deep learning technology, and the analyzed feature information is stored in a database. This analysis result forms the basis for formulating the promotion strategy.
[0095] Step 3:
[0096] The server uses the analysis results of the work and the market database to identify the target audience.
[0097] The input consists of analytical features of the work and market trend data, which the AI combines to identify the optimal target audience. The output is a profile of the target audience, which is then used in the design of the next promotion.
[0098] Step 4:
[0099] The server uses AI to generate appropriate advertising strategies based on the identified target audience.
[0100] The input consists of target audience profiles and data from past success stories. An AI model analyzes this data to output information such as the selection of social media platforms and the optimal posting timing. Specifically, scheduling can be performed using tools like Hootsuite or Buffer.
[0101] Step 5:
[0102] The server provides automatically generated SNS post content to the user.
[0103] In this step, OpenAI's generative AI model is used to generate text and select images. Detailed information on the advertising strategy is provided as input, and specific SNS post suggestions are provided as output, which the user can then review and edit on their device.
[0104] Step 6:
[0105] Users use their devices to review the provided social media content, edit it as needed, and then confirm it.
[0106] Users review the provided content and adjust the text and visuals using editing tools. The completed content is then sent to the server and incorporated into the schedule.
[0107] Step 7:
[0108] The server automatically posts confirmed SNS content to SNS at the scheduled time.
[0109] By using APIs such as Hootsuite and Buffer, posts are made at the specified date and time. This ensures that information is disseminated as planned.
[0110] Step 8:
[0111] The server automatically generates and provides interactive content for the fan community to users.
[0112] The input includes data on the target fan and their past interaction history. Using AI, topics and questions that are likely to elicit responses from interested individuals are generated. This output is then presented to the user, stimulating communication.
[0113] Step 9:
[0114] Users use their devices to review the content of interactions, make adjustments as needed, and communicate with those they are interested in.
[0115] Users can use the generated topics to engage in conversations with those who share their interests, thereby strengthening their relationships within the community.
[0116] (Application Example 1)
[0117] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0118] Effective promotion of artworks and creative content is crucial for maximizing the value of the work itself and reaching the right audience. However, many artists and creators lack expertise in advertising and market analysis, making it difficult to develop appropriate strategies. Furthermore, they lack the tools to efficiently and widely promote their work and deepen communication with their audience. To address these challenges, there is a need for the automation of sophisticated advertising strategies based on the characteristics of artworks and market information.
[0119] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0120] This invention includes a server that analyzes data of artworks and uses an artificial intelligence model to analyze their characteristics and proposes an appropriate advertising strategy; a server that identifies suitable target audiences and determines the media and timing for effective information dissemination based on the analysis results; and a server that automatically generates advertising content to facilitate communication between artists and audiences and executes optimized promotions through a user interface. This enables artists and creators to promote their works more effectively and reach their target audiences accurately.
[0121] "Works of art" are visual or expressive content created by an artist, including paintings, photographs, illustrations, and digital art.
[0122] An "artificial intelligence model" is an algorithm or system designed to analyze data based on machine learning and automatically extract and determine specific patterns or insights.
[0123] "Advertising strategy" is a general term for a series of promotional activities planned to effectively raise awareness of a specific product or service among a target audience.
[0124] The "recipient segment" refers to the members of the market targeted by a particular product or service, and is a group of consumers classified based on attributes such as age, gender, and interests.
[0125] "Information dissemination media" refers to the means and platforms used to convey content to consumers, and includes social media, blogs, video platforms, and so on.
[0126] "Timing" refers to the time or period when a particular action or promotion is implemented most effectively, and it is a crucial factor that influences the success rate of advertising and campaigns.
[0127] A "user interface" is the part of a system that allows the user to interact directly with the system. It provides information in a visually easy-to-use format and is a mechanism for receiving commands.
[0128] This invention is a system for automating effective advertising strategies for works of art. The system primarily consists of a server, user terminals, and a user interface.
[0129] Users upload data of their artwork to a server using their own devices. This data includes images, videos, and associated metadata of the artwork. After receiving this data, the server uses an artificial intelligence model running in the cloud to analyze the style, theme, and techniques of the artwork. Specifically, it utilizes models built with machine learning libraries such as TensorFlow and PyTorch to perform a detailed analysis of the data. The features extracted through this analysis are used to propose advertising strategies.
[0130] Next, the server consults a market database to identify the most suitable audience for the work. Based on this, it determines the appropriate medium and timing for disseminating information. This process involves a user interface through an application on the user's smartphone or tablet. The advertising content thus generated is automatically optimized and delivered to the user.
[0131] Furthermore, the generated advertisements include catchphrases and visuals automatically generated by AI. The generating AI model assembles content based on prompts that maximize the unique features of the work. For example, it provides visual styles and descriptions tailored to platforms such as Instagram and Facebook. An example of a prompt used in this process might be, "To effectively promote this character design project, please propose advertising content that emphasizes the emotional aspects of color."
[0132] This system allows users to efficiently reach their target audience with their work and maximize advertising effectiveness without requiring specialized knowledge.
[0133] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0134] Step 1:
[0135] Users upload data (images, videos, metadata) of their artwork to the server using their devices. This data serves as input for subsequent analysis processes.
[0136] Step 2:
[0137] The server passes the received data to an artificial intelligence model in the cloud for analysis. This AI model, built using TensorFlow or PyTorch, employs image recognition and natural language processing techniques to extract features such as the style and theme of the artwork. The analyzed feature information is then processed as output for the next step.
[0138] Step 3:
[0139] The server matches the characteristics of the analyzed work against a market database to identify the optimal audience. This process utilizes demographic data such as the target audience's age, gender, and interests. Information on the identified audience is provided as output.
[0140] Step 4:
[0141] The server determines the appropriate media and timing for information dissemination based on the identified audience. This includes selecting social media and advertising platforms and planning the optimal posting schedule. This output is used as a guide for a specific promotional strategy.
[0142] Step 5:
[0143] The server automatically generates advertising content using a generative AI model. The model includes a process that takes prompt text as input and generates catchphrases and visuals based on it. This output advertising content is then provided to the user for review and editing.
[0144] Step 6:
[0145] Users review the generated advertising content through the terminal interface and edit it as needed. This edited data becomes the final output, which the server automatically posts to the advertising platform at the scheduled time.
[0146] This process allows users to effectively promote their work and reach their appropriate target audience without requiring specialized knowledge.
[0147] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0148] This invention provides a system for recognizing user emotions and utilizing that information in promotional strategies and communication with fans. The system aims to support artists' activities, enabling them to promote themselves more effectively through emotions and deepen their relationships with fans.
[0149] The system begins with the user uploading their artwork data from their device to the server. The server then uses an AI model to analyze the characteristics of the artwork. In addition, an emotion engine analyzes the user's past activity history, text data extracted from social media, and emotional information explicitly stated by the user to recognize the user's emotions.
[0150] The emotion engine incorporates recognized emotional information into the promotion strategy. The server develops the optimal promotion plan based on the topics and styles that users are emotionally interested in. For example, if a user shows a high level of interest in emotionally charged themes, the server automatically generates emotionally resonant social media posts.
[0151] Furthermore, in fan communication, the emotion engine performs natural language processing on interactions with fans, providing content that makes the dialogue deeper and more emotionally rich. Users interact with the fan community through their devices, and the server uses AI to automatically generate topics and questions for further interaction based on feedback from fans.
[0152] In crowdfunding projects, a server evaluates the sentiments of funders and generates presentation materials accordingly. For example, if a funder resonates with the project's vision, a storyline emphasizing that sentiment will be incorporated into the materials.
[0153] As a concrete example, suppose a user launches a new art project. Based on the user's past activities and emotional information, the emotion engine identifies themes that are likely to make the user feel happy. The server then analyzes successful examples of similar projects in the market and builds an optimal target audience and promotional strategy based on these emotions.
[0154] Thus, by incorporating an emotion engine, this invention enables a deeper understanding of user emotions and supports artists' activities with a more personalized approach. Users can maximize the value of their work through promotional strategies and communications that are in harmony with their emotions.
[0155] The following describes the processing flow.
[0156] Step 1:
[0157] Users upload their artwork data and related emotional input information (e.g., emotional states based on text comments or choices) from their device to the server.
[0158] Step 2:
[0159] The server feeds the uploaded artwork data into an artificial intelligence model, which then analyzes the artwork's style, theme, and techniques.
[0160] Step 3:
[0161] The emotion engine installed on the server analyzes emotional information provided by the user and data collected from social media and other sources to recognize the user's current emotional state.
[0162] Step 4:
[0163] The server develops the optimal promotional strategy for the user based on the emotional information recognized by the emotion engine. In doing so, it considers themes that strongly interest the user emotionally and identifies the target audience.
[0164] Step 5:
[0165] The server automatically generates and presents emotion-based promotional social media posts and visual content to users.
[0166] Step 6:
[0167] Users review the promotional proposals presented by the server via their devices and edit or modify them as needed. After the user approves, the server posts the content to the designated social media platform.
[0168] Step 7:
[0169] In terms of communication with fans, the server uses an emotion engine to analyze feedback from fans and automatically generates questions and topics to deepen dialogue within the fan community.
[0170] Step 8:
[0171] Users can utilize communication support functions provided by the server via their devices to engage in real-time interactions with fans.
[0172] Step 9:
[0173] When planning a crowdfunding project, the server uses AI to generate presentation materials that will attract the interest of funders, based on the provided project overview and sentiment information.
[0174] Step 10:
[0175] Users review the server-generated presentation materials and use them to increase their support for the project. They can edit the content as needed to create the final crowdfunding plan.
[0176] (Example 2)
[0177] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0178] In recent years, a diverse range of works have been created in the arts field. However, effectively selling, promoting, and raising funds for these works requires an accurate understanding of consumer sentiment and market trends. Effective communication methods to enhance engagement with users are also crucial. However, addressing these issues individually requires considerable effort and time, placing a significant burden on artists. Therefore, there is a need for solutions that analyze the characteristics of works and automate emotion-based strategies to address these challenges.
[0179] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0180] In this invention, the server includes means for analyzing information on works of art and proposing sales strategies, means for identifying user emotions and constructing strategies, and means for automatically generating content that stimulates dialogue within the user community. This enables artists to efficiently conduct promotions that meet market needs and to automatically provide content that deepens relationships with users.
[0181] A "work of art" refers to a visual or other sensory-oriented work created using creative ideas and techniques.
[0182] "Information" is an organized collection of data, facts, or knowledge that has value or meaning for a particular purpose.
[0183] An "artificial intelligence algorithm" refers to a set of programs and methods that computer systems use to analyze data and perform specific tasks through learning.
[0184] A "sales strategy" refers to a plan or method for distributing a particular product or service to the market and encouraging consumers to purchase it.
[0185] A "consumer segment" refers to a group of people who have an interest in and purchasing power for a particular product or service, and is also known as a target market.
[0186] "Foundation" refers to the basic elements or infrastructure necessary for achieving a specific purpose or activity.
[0187] "Time" refers to a specific timing or period during which a particular activity or event should take place.
[0188] "Content" refers to text or media that contains information or messages related to a specific theme or purpose.
[0189] A "user community" refers to a group or network of people who are interested in and involved with a particular product or service.
[0190] "Opportunity" refers to a situation in which favorable circumstances or conditions are in place to achieve a goal.
[0191] A "funding project" refers to an organized effort to raise the necessary funds for a specific business or purpose.
[0192] "Operational support" refers to providing the assistance and support necessary for the planning, implementation, and management of a specific project or activity.
[0193] "Proposal materials" refer to documents or other media used to explain a specific proposal or idea in detail.
[0194] "Market information" refers to data concerning products, consumer trends, and the competitive environment in a specific market.
[0195] An "emotion engine" refers to a system that uses natural language processing and data analysis techniques to recognize and analyze an individual's emotions and attitudes.
[0196] A "generative AI model" refers to the structure of artificial intelligence that has the ability to learn from large amounts of data and automatically generate new information and content.
[0197] This invention is a system that analyzes the characteristics of works of art and automates promotional and communication methods tailored to consumer emotions. The terminal is responsible for sending data of user-created works of art to the server. The server uses artificial intelligence algorithms such as TensorFlow and PyTorch, which are deep learning frameworks, to analyze the received data. This allows for the analysis of the visual features and concepts of the artwork, and the development of a suitable sales strategy.
[0198] Subsequently, the server uses an emotion engine to collect emotion data from the user's past activities and social media posts, and analyzes the emotions using natural language processing tools such as NLTK and spaCy. This identifies the emotions the user is experiencing, and based on that information, promotional methods are developed.
[0199] Furthermore, the server uses a generative AI model to automatically generate emotion-based content and provide material to facilitate communication with users. In this process, the generative AI model can be guided using prompts. For example, a prompt might be, "Create a social media post based on a theme that will please the user."
[0200] For example, if a user starts a new painting project with an autumn theme, this information is uploaded to the server. The server analyzes the artwork's colors and theme and identifies a target audience based on similar successful examples. As a prompt, the user might be instructed to "Generate a social media post using words that evoke the warmth of autumn," and the AI model would automatically generate content accordingly.
[0201] By leveraging this automatically generated content and sales strategies, users can efficiently appeal to the market and deepen relationships with their customers. In the case of crowdfunding, the server can generate materials that evoke empathy for the project's vision, thereby facilitating fundraising.
[0202] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0203] Step 1:
[0204] Users upload their artwork data from their device to the server. This data is entered and sent to the server. Specifically, the user uses a dedicated application on their device or a web interface to select image files and text data and presses the "Upload" button. This saves the artwork data to the server's storage system.
[0205] Step 2:
[0206] The server receives the uploaded artwork data and passes it as input to a deep learning framework. The server uses TensorFlow or PyTorch to analyze the visual features and concepts of this data. This analysis yields the visual characteristics and themes of the artwork as output. This generates the basic data for a concrete sales strategy.
[0207] Step 3:
[0208] The server receives text data collected from the user's past activity history and social media as input via an emotion engine. The emotion engine uses natural language processing tools (such as NLTK and spaCy) to analyze this data and generate emotion information as output. Specifically, the server uses SNS APIs to collect data and processes it with the emotion engine to identify the user's emotions.
[0209] Step 4:
[0210] The server uses a generative AI model and takes a prompt as input. Based on this prompt, the generative AI model outputs content that corresponds to emotion. Specifically, the server provides the model with a prompt such as "Generate an emotionally moving social media post," and the model automatically generates appropriate post content.
[0211] Step 5:
[0212] The server provides automatically generated content to users, which can then be used for sales strategies or communication with users. Users utilize the generated content and analysis results as output when developing strategies to appeal to the market. Specifically, users review the generated content and then post it on social media or incorporate it into advertising campaigns.
[0213] Step 6:
[0214] In generating crowdfunding materials, the server takes project feedback data as input. Based on the results of analysis by the emotion engine, it outputs proposal materials. Specifically, the server incorporates a storyline that emphasizes the emotions of funders into the proposal and slides. These materials are used in the fundraising presentation.
[0215] (Application Example 2)
[0216] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".
[0217] In contemporary artistic activity, it is difficult for artists to effectively promote their work and build deep connections with their fans. Furthermore, there are insufficient means to accurately understand audience emotions and provide personalized advertising and content accordingly. A system is needed to address these challenges.
[0218] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0219] This invention includes a server that provides means for proposing an appropriate promotional strategy using a machine learning model that analyzes information and characteristics of works of art, means for recognizing users' emotions in real time and generating and displaying relevant advertisements, and means for generating topics and questions using machine learning to stimulate the flow of dialogue within fan groups. This makes it possible to enhance artists' promotional activities, achieve close communication with fans, and personalize information dissemination based on emotions.
[0220] A "work of art" is something that possesses visual or expressive value and is created by an individual creator.
[0221] "Information" refers to data, knowledge, and news related to the subject matter.
[0222] A "machine learning model" is a set of algorithms that automatically learn patterns from data and perform specific tasks.
[0223] "Advertising strategy" refers to the plans and methods used to effectively spread awareness of a particular product or service in the market.
[0224] A "target group" is a collection of people who are classified into a specific market segment as consumers of a product or service.
[0225] A "medium" refers to a means or channel for transmitting information.
[0226] A "user" refers to an individual or group that uses a particular product or service.
[0227] "Emotions" refer to the psychological states of humans, specifically internal feelings such as joy and sadness.
[0228] "Advertising" is an information dissemination activity conducted to make people aware of the existence of a product or service.
[0229] A "fan group" is a group of people who are interested in and support a particular artist or content.
[0230] "The flow of a conversation" refers to the progression of a discussion or the pattern of how a conversation unfolds in human communication.
[0231] "Topic introduction" refers to facilitating communication by indicating a central theme or topic in a dialogue or discussion.
[0232] A "question" is the act of posing a problem to someone for the purpose of gathering information or confirming details.
[0233] The system for carrying out the present invention consists of the following hardware and software. The main hardware used is a user-wearable smart device, particularly smart glasses, which collects the user's facial expressions and voice data using cameras and microphones mounted on them. The server uses TensorFlow as a machine learning framework and implements an emotion recognition model for analyzing the collected data.
[0234] The smart glasses, acting as a device, have the ability to visually display advertisements generated from analysis results through an AR (augmented reality) interface powered by Unity. The server automatically generates relevant advertisements that the user might be interested in, based on sentiment data obtained by a machine learning model and utilizing an algorithm programmed in Python.
[0235] For example, if a user is viewing a particular artwork in a museum, the server recognizes the user's emotions towards that artwork in real time. Based on this emotion data, the server generates advertisements containing information about similar artworks and events, and displays them in augmented reality (AR) on smart glasses. In this way, users can instantly connect their emotional experiences to related event information, increasing their desire to participate.
[0236] By utilizing a generative AI model, it is possible to automatically generate prompt messages based on specific emotions. For example, by inputting the sentence, "When a user is moved by a sculpture, generate an advertisement for the next exhibition related to that sculpture," into the model, it is possible to quickly generate appropriate advertising content. Thus, the present invention is a system that recognizes user emotions in real time and enables promotions tailored to individual needs.
[0237] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0238] Step 1:
[0239] The user wears smart glasses and views works of art in a museum or other location. The camera and microphone of the smart glasses, acting as a terminal, record and collect the user's facial expressions and voice data in real time. This becomes the input data.
[0240] Step 2:
[0241] The device compresses the collected facial expression and voice data and sends it to the server. The server analyzes the received input data using an emotion recognition model based on TensorFlow. This allows it to recognize the user's real-time emotional state as output.
[0242] Step 3:
[0243] The server generates relevant prompt sentences based on the emotion recognition results and uses these prompt sentences as input to the generation AI model. Specifically, it prepares prompt sentences containing keywords and stories to automatically generate advertising content related to works that the user found moving.
[0244] Step 4:
[0245] The generative AI model analyzes the input prompt text and generates advertisements that match the user's emotional state. The resulting advertisement data is then converted back into an AR display format on the server.
[0246] Step 5:
[0247] The server sends the generated advertisement to the device. The smart glasses visually display the advertisement in the user's field of view via an AR interface using Unity. This allows the user to receive information about related events and works in real time.
[0248] This system allows users to instantly receive promotional information tailored to their individual emotions while viewing art.
[0249] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0250] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0251] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.
[0252] [Second Embodiment]
[0253] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.
[0254] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0255] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0256] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.
[0257] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0258] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0259] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0260] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0261] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0262] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0263] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0264] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0265] This invention provides an integrated support system that enables various artists and creators to more effectively promote their works and activities, strengthen relationships with fans, and successfully raise funds. Specific embodiments are described below.
[0266] This system begins with the user uploading their artwork data from their device to the server. This data includes images, descriptions, and related metadata. The server receives this data and uses its built-in artificial intelligence model to analyze the artwork's characteristics in detail. The AI model utilizes machine learning techniques to analyze the artwork's style, theme, and techniques, and stores this information in a digital database.
[0267] Next, the server identifies the target audience for the work based on market databases and past success stories. This analysis allows for the development of an optimal promotional strategy. The server supports effective information dissemination by selecting appropriate social media platforms and determining the timing of posting. Furthermore, an AI generation algorithm automatically generates social media post content and visual content, which are then provided to users.
[0268] Afterward, the user reviews the promotional proposal from their device and edits it as needed. Once editing is complete, the server automatically posts to social media at the scheduled time.
[0269] Furthermore, this system also includes specialized functions for building fan communities. Users can create community rooms and begin interactive interactions with their fans. The server uses AI-based content generation capabilities to automatically generate topics and questions that facilitate interaction, deepening relationships with fans.
[0270] Furthermore, as part of crowdfunding support, users can input details about their new project, and the server will use AI to generate presentation materials for that project. The generated materials will be customized based on a marketing strategy aimed at achieving the fundraising goal.
[0271] As described above, the present invention is a system that integrates various functions to support artists' activities, enabling effective and efficient promotion, fostering interaction with fans, and crowdfunding. Users can intuitively operate these functions through a user-friendly interface accessible via their terminal.
[0272] The following describes the processing flow.
[0273] Step 1:
[0274] Users upload their artwork data to the server via their device. This artwork data includes image files and text data.
[0275] Step 2:
[0276] The server receives the uploaded artwork data and inputs it into its internal artificial intelligence model. The AI model uses machine learning algorithms to analyze the artwork's style, theme, techniques, and other characteristics.
[0277] Step 3:
[0278] Based on the analysis results, the server refers to a market database to identify a suitable target audience for the work. This process takes into account past sales performance of similar works and current market trends.
[0279] Step 4:
[0280] The server builds the optimal promotional strategy based on the target audience. It determines the social media platforms to use and the timing of posts, and creates a draft promotional strategy.
[0281] Step 5:
[0282] The server utilizes AI generation capabilities to automatically generate text and visual content for social media posts and presents them to users.
[0283] Step 6:
[0284] The user checks the promotion strategy plan presented by the server through the terminal. After editing the content as needed, the user returns the approval to the server.
[0285] Step 7:
[0286] The server automatically posts the approved promotion content on the SNS at the set timing.
[0287] Step 8:
[0288] The user uses the community function on the server to communicate with fans. The server uses AI to propose events and automatically generate content to promote communication.
[0289] Step 9:
[0290] When the user starts a new crowdfunding project, the user inputs the project details from the terminal to the server. Based on this, the server automatically creates presentation materials using AI.
[0291] Step 10:
[0292] The server provides the user with a unique financing plan and conducts a simulation to achieve the target amount. Based on this, the user conducts crowdfunding.
[0293] (Example 1)
[0294] Next, Example 1 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart glasses 214 are referred to as the "terminal".
[0295] In the modern era, it is extremely difficult for artists and creators to effectively promote their work, strengthen relationships with interested parties, and raise funds. In particular, effectively disseminating information to the appropriate target groups, forming interest groups, and ensuring the success of funded projects are challenging to achieve with limited resources. Therefore, new technological means are needed to comprehensively address these challenges.
[0296] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0297] In this invention, the server includes means for proposing an appropriate advertising strategy using an information processing device that analyzes data of works of art and analyzes its characteristics; means for identifying suitable target groups based on the analysis results and determining the basis and timing for effective information dissemination; and means for automatically generating information to facilitate communication with interested parties and providing a platform for interaction to form groups of interested parties. This enables creators to maximize the value of their works and achieve their goals effectively and efficiently.
[0298] An "information processing device" is an electronic device used for collecting, analyzing, and processing data, and is a device that has the capability to handle diverse types of information.
[0299] A "work of art" is a creative product expressed visually or aurally, reflecting the sensibilities and ideas of its creator.
[0300] A "marketing strategy" is a planned set of guidelines aimed at making a particular product or service known to many people and promoting its use.
[0301] A "target group" is a group of people who possess specific attributes and are expected to be recipients of a product or service.
[0302] "Information dissemination" refers to activities and methods of widely communicating a specific message or content.
[0303] "Base" refers to a system or network that serves as a foundation for specific activities or functions to be carried out.
[0304] "Timing" is a concept that refers to the optimal period or time to carry out a specific activity.
[0305] "Those with interest" refers to people who are interested in specific products, services, or information.
[0306] "Communication" refers to the exchange of information, opinions, and emotions, thereby deepening mutual understanding.
[0307] "Group" refers to an organization or group consisting of multiple people with common goals or interests.
[0308] "Place for communication" is a physical or virtual space provided for the exchange of information and opinions and for communication.
[0309] This invention is constructed as an integrated system to support the promotion of artworks. The system is mainly operated centering around servers, terminals, and users.
[0310] First, the user uploads the data of the work to the server using the terminal. The data includes the image of the work, the description text, and related metadata, and this process is carried out securely via an Internet connection.
[0311] The server is constructed using Python and uses TensorFlow or PyTorch as machine learning libraries. Based on the uploaded data, the server uses an AI model to analyze the style, theme, and techniques of the work. The analysis results are saved in a digital database and utilized for formulating promotional strategies.
[0312] As a concrete example, if a user wants to announce a new painting project, they input images and a description of the artwork into the system. The server uses AI to analyze the data and identify a target group. This allows the user to receive an appropriate promotional plan.
[0313] Furthermore, the system includes a function to automatically generate conversation content in order to stimulate communication with those who are interested. OpenAI's GPT and other technologies are used for text generation, providing topics and questions that will stimulate interest.
[0314] In the funding support process, users enter project details from their devices, and the server uses AI to generate reports that reflect a customized marketing strategy.
[0315] An example of a prompt would be: "Please propose a promotional strategy for a newly released artwork. The target audience is young adults, and the main theme is environmental protection."
[0316] In this way, the system effectively brings out the value of the artwork and broadly supports the creators' activities through diverse forms of assistance.
[0317] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0318] Step 1:
[0319] Users input their artwork data via their device and upload it to the server.
[0320] Specifically, users use their devices to select artwork image files, their descriptions, and metadata, and send them to the server via a dedicated web interface. The input data mainly consists of image files and text information, which are used for analysis in the next step.
[0321] Step 2:
[0322] The server receives the uploaded artwork data and performs analysis using an AI model.
[0323] Based on the received data, the server uses machine learning frameworks such as TensorFlow and PyTorch to identify the style, theme, and techniques of the artwork. The input image data is processed using deep learning technology, and the analyzed feature information is stored in a database. This analysis result forms the basis for formulating the promotion strategy.
[0324] Step 3:
[0325] The server uses the analysis results of the work and the market database to identify the target audience.
[0326] The input consists of analytical features of the work and market trend data, which the AI combines to identify the optimal target audience. The output is a profile of the target audience, which is then used in the design of the next promotion.
[0327] Step 4:
[0328] The server uses AI to generate appropriate advertising strategies based on the identified target audience.
[0329] The input consists of target audience profiles and data from past success stories. An AI model analyzes this data to output information such as the selection of social media platforms and the optimal posting timing. Specifically, scheduling can be performed using tools like Hootsuite or Buffer.
[0330] Step 5:
[0331] The server provides automatically generated SNS post content to the user.
[0332] In this step, OpenAI's generative AI model is used to generate text and select images. Detailed information on the advertising strategy is provided as input, and specific SNS post suggestions are provided as output, which the user can then review and edit on their device.
[0333] Step 6:
[0334] Users use their devices to review the provided social media content, edit it as needed, and then confirm it.
[0335] Users review the provided content and adjust the text and visuals using editing tools. The completed content is then sent to the server and incorporated into the schedule.
[0336] Step 7:
[0337] The server automatically posts confirmed SNS content to SNS at the scheduled time.
[0338] By using APIs such as Hootsuite and Buffer, posts are made at the specified date and time. This ensures that information is disseminated as planned.
[0339] Step 8:
[0340] The server automatically generates and provides interactive content for the fan community to users.
[0341] The input includes data on the target fan and their past interaction history. Using AI, topics and questions that are likely to elicit responses from interested individuals are generated. This output is then presented to the user, stimulating communication.
[0342] Step 9:
[0343] Users use their devices to review the content of interactions, make adjustments as needed, and communicate with those they are interested in.
[0344] Users can use the generated topics to engage in conversations with those who share their interests, thereby strengthening their relationships within the community.
[0345] (Application Example 1)
[0346] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0347] Effective promotion of artworks and creative content is crucial for maximizing the value of the work itself and reaching the right audience. However, many artists and creators lack expertise in advertising and market analysis, making it difficult to develop appropriate strategies. Furthermore, they lack the tools to efficiently and widely promote their work and deepen communication with their audience. To address these challenges, there is a need for the automation of sophisticated advertising strategies based on the characteristics of artworks and market information.
[0348] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0349] This invention includes a server that analyzes data of artworks and uses an artificial intelligence model to analyze their characteristics and proposes an appropriate advertising strategy; a server that identifies suitable target audiences and determines the media and timing for effective information dissemination based on the analysis results; and a server that automatically generates advertising content to facilitate communication between artists and audiences and executes optimized promotions through a user interface. This enables artists and creators to promote their works more effectively and reach their target audiences accurately.
[0350] "Works of art" are visual or expressive content created by an artist, including paintings, photographs, illustrations, and digital art.
[0351] An "artificial intelligence model" is an algorithm or system designed to analyze data based on machine learning and automatically extract and determine specific patterns or insights.
[0352] "Advertising strategy" is a general term for a series of promotional activities planned to effectively raise awareness of a specific product or service among a target audience.
[0353] The "recipient segment" refers to the members of the market targeted by a particular product or service, and is a group of consumers classified based on attributes such as age, gender, and interests.
[0354] "Information dissemination media" refers to the means and platforms used to convey content to consumers, and includes social media, blogs, video platforms, and so on.
[0355] "Timing" refers to the time or period when a particular action or promotion is implemented most effectively, and it is a crucial factor that influences the success rate of advertising and campaigns.
[0356] A "user interface" is the part of a system that allows the user to interact directly with the system. It provides information in a visually easy-to-use format and is a mechanism for receiving commands.
[0357] This invention is a system for automating effective advertising strategies for works of art. The system primarily consists of a server, user terminals, and a user interface.
[0358] Users upload data of their artwork to a server using their own devices. This data includes images, videos, and associated metadata of the artwork. After receiving this data, the server uses an artificial intelligence model running in the cloud to analyze the style, theme, and techniques of the artwork. Specifically, it utilizes models built with machine learning libraries such as TensorFlow and PyTorch to perform a detailed analysis of the data. The features extracted through this analysis are used to propose advertising strategies.
[0359] Next, the server consults a market database to identify the most suitable audience for the work. Based on this, it determines the appropriate medium and timing for disseminating information. This process involves a user interface through an application on the user's smartphone or tablet. The advertising content thus generated is automatically optimized and delivered to the user.
[0360] Furthermore, the generated advertisements include catchphrases and visuals automatically generated by AI. The generating AI model assembles content based on prompts that maximize the unique features of the work. For example, it provides visual styles and descriptions tailored to platforms such as Instagram and Facebook. An example of a prompt used in this process might be, "To effectively promote this character design project, please propose advertising content that emphasizes the emotional aspects of color."
[0361] This system allows users to efficiently reach their target audience with their work and maximize advertising effectiveness without requiring specialized knowledge.
[0362] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0363] Step 1:
[0364] Users upload data (images, videos, metadata) of their artwork to the server using their devices. This data serves as input for subsequent analysis processes.
[0365] Step 2:
[0366] The server passes the received data to an artificial intelligence model in the cloud for analysis. This AI model, built using TensorFlow or PyTorch, employs image recognition and natural language processing techniques to extract features such as the style and theme of the artwork. The analyzed feature information is then processed as output for the next step.
[0367] Step 3:
[0368] The server matches the characteristics of the analyzed work against a market database to identify the optimal audience. This process utilizes demographic data such as the target audience's age, gender, and interests. Information on the identified audience is provided as output.
[0369] Step 4:
[0370] The server determines the appropriate media and timing for information dissemination based on the identified audience. This includes selecting social media and advertising platforms and planning the optimal posting schedule. This output is used as a guide for a specific promotional strategy.
[0371] Step 5:
[0372] The server automatically generates advertising content using a generative AI model. The model includes a process that takes prompt text as input and generates catchphrases and visuals based on it. This output advertising content is then provided to the user for review and editing.
[0373] Step 6:
[0374] Users review the generated advertising content through the terminal interface and edit it as needed. This edited data becomes the final output, which the server automatically posts to the advertising platform at the scheduled time.
[0375] This process allows users to effectively promote their work and reach their appropriate target audience without requiring specialized knowledge.
[0376] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0377] This invention provides a system for recognizing user emotions and utilizing that information in promotional strategies and communication with fans. The system aims to support artists' activities, enabling them to promote themselves more effectively through emotions and deepen their relationships with fans.
[0378] The system begins with the user uploading their artwork data from their device to the server. The server then uses an AI model to analyze the characteristics of the artwork. In addition, an emotion engine analyzes the user's past activity history, text data extracted from social media, and emotional information explicitly stated by the user to recognize the user's emotions.
[0379] The emotion engine incorporates recognized emotional information into the promotion strategy. The server develops the optimal promotion plan based on the topics and styles that users are emotionally interested in. For example, if a user shows a high level of interest in emotionally charged themes, the server automatically generates emotionally resonant social media posts.
[0380] Furthermore, in fan communication, the emotion engine performs natural language processing on interactions with fans, providing content that makes the dialogue deeper and more emotionally rich. Users interact with the fan community through their devices, and the server uses AI to automatically generate topics and questions for further interaction based on feedback from fans.
[0381] In crowdfunding projects, a server evaluates the sentiments of funders and generates presentation materials accordingly. For example, if a funder resonates with the project's vision, a storyline emphasizing that sentiment will be incorporated into the materials.
[0382] As a concrete example, suppose a user launches a new art project. Based on the user's past activities and emotional information, the emotion engine identifies themes that are likely to make the user feel happy. The server then analyzes successful examples of similar projects in the market and builds an optimal target audience and promotional strategy based on these emotions.
[0383] Thus, by incorporating an emotion engine, this invention enables a deeper understanding of user emotions and supports artists' activities with a more personalized approach. Users can maximize the value of their work through promotional strategies and communications that are in harmony with their emotions.
[0384] The following describes the processing flow.
[0385] Step 1:
[0386] Users upload their artwork data and related emotional input information (e.g., emotional states based on text comments or choices) from their device to the server.
[0387] Step 2:
[0388] The server feeds the uploaded artwork data into an artificial intelligence model, which then analyzes the artwork's style, theme, and techniques.
[0389] Step 3:
[0390] The emotion engine installed on the server analyzes emotional information provided by the user and data collected from social media and other sources to recognize the user's current emotional state.
[0391] Step 4:
[0392] The server develops the optimal promotional strategy for the user based on the emotional information recognized by the emotion engine. In doing so, it considers themes that strongly interest the user emotionally and identifies the target audience.
[0393] Step 5:
[0394] The server automatically generates and presents emotion-based promotional social media posts and visual content to users.
[0395] Step 6:
[0396] Users review the promotional proposals presented by the server via their devices and edit or modify them as needed. After the user approves, the server posts the content to the designated social media platform.
[0397] Step 7:
[0398] In terms of communication with fans, the server uses an emotion engine to analyze feedback from fans and automatically generates questions and topics to deepen dialogue within the fan community.
[0399] Step 8:
[0400] Users can utilize communication support functions provided by the server via their devices to engage in real-time interactions with fans.
[0401] Step 9:
[0402] When planning a crowdfunding project, the server uses AI to generate presentation materials that will attract the interest of funders, based on the provided project overview and sentiment information.
[0403] Step 10:
[0404] Users review the server-generated presentation materials and use them to increase their support for the project. They can edit the content as needed to create the final crowdfunding plan.
[0405] (Example 2)
[0406] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0407] In recent years, a diverse range of works have been created in the arts field. However, effectively selling, promoting, and raising funds for these works requires an accurate understanding of consumer sentiment and market trends. Effective communication methods to enhance engagement with users are also crucial. However, addressing these issues individually requires considerable effort and time, placing a significant burden on artists. Therefore, there is a need for solutions that analyze the characteristics of works and automate emotion-based strategies to address these challenges.
[0408] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0409] In this invention, the server includes means for analyzing information on works of art and proposing sales strategies, means for identifying user emotions and constructing strategies, and means for automatically generating content that stimulates dialogue within the user community. This enables artists to efficiently conduct promotions that meet market needs and to automatically provide content that deepens relationships with users.
[0410] A "work of art" refers to a visual or other sensory-oriented work created using creative ideas and techniques.
[0411] "Information" is an organized collection of data, facts, or knowledge that has value or meaning for a particular purpose.
[0412] An "artificial intelligence algorithm" refers to a set of programs and methods that computer systems use to analyze data and perform specific tasks through learning.
[0413] A "sales strategy" refers to a plan or method for distributing a particular product or service to the market and encouraging consumers to purchase it.
[0414] A "consumer segment" refers to a group of people who have an interest in and purchasing power for a particular product or service, and is also known as a target market.
[0415] "Foundation" refers to the basic elements or infrastructure necessary for achieving a specific purpose or activity.
[0416] "Time" refers to a specific timing or period during which a particular activity or event should take place.
[0417] "Content" refers to text or media that contains information or messages related to a specific theme or purpose.
[0418] A "user community" refers to a group or network of people who are interested in and involved with a particular product or service.
[0419] "Opportunity" refers to a situation in which favorable circumstances or conditions are in place to achieve a goal.
[0420] A "funding project" refers to an organized effort to raise the necessary funds for a specific business or purpose.
[0421] "Operational support" refers to providing the assistance and support necessary for the planning, implementation, and management of a specific project or activity.
[0422] "Proposal materials" refer to documents or other media used to explain a specific proposal or idea in detail.
[0423] "Market information" refers to data concerning products, consumer trends, and the competitive environment in a specific market.
[0424] An "emotion engine" refers to a system that uses natural language processing and data analysis techniques to recognize and analyze an individual's emotions and attitudes.
[0425] A "generative AI model" refers to the structure of artificial intelligence that has the ability to learn from large amounts of data and automatically generate new information and content.
[0426] This invention is a system that analyzes the characteristics of works of art and automates promotional and communication methods tailored to consumer emotions. The terminal is responsible for sending data of user-created works of art to the server. The server uses artificial intelligence algorithms such as TensorFlow and PyTorch, which are deep learning frameworks, to analyze the received data. This allows for the analysis of the visual features and concepts of the artwork, and the development of a suitable sales strategy.
[0427] Subsequently, the server uses an emotion engine to collect emotion data from the user's past activities and social media posts, and analyzes the emotions using natural language processing tools such as NLTK and spaCy. This identifies the emotions the user is experiencing, and based on that information, promotional methods are developed.
[0428] Furthermore, the server uses a generative AI model to automatically generate emotion-based content and provide material to facilitate communication with users. In this process, the generative AI model can be guided using prompts. For example, a prompt might be, "Create a social media post based on a theme that will please the user."
[0429] For example, if a user starts a new painting project with an autumn theme, this information is uploaded to the server. The server analyzes the artwork's colors and theme and identifies a target audience based on similar successful examples. As a prompt, the user might be instructed to "Generate a social media post using words that evoke the warmth of autumn," and the AI model would automatically generate content accordingly.
[0430] By leveraging this automatically generated content and sales strategies, users can efficiently appeal to the market and deepen relationships with their customers. In the case of crowdfunding, the server can generate materials that evoke empathy for the project's vision, thereby facilitating fundraising.
[0431] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0432] Step 1:
[0433] Users upload their artwork data from their device to the server. This data is entered and sent to the server. Specifically, the user uses a dedicated application on their device or a web interface to select image files and text data and presses the "Upload" button. This saves the artwork data to the server's storage system.
[0434] Step 2:
[0435] The server receives the uploaded artwork data and passes it as input to a deep learning framework. The server uses TensorFlow or PyTorch to analyze the visual features and concepts of this data. This analysis yields the visual characteristics and themes of the artwork as output. This generates the basic data for a concrete sales strategy.
[0436] Step 3:
[0437] The server receives text data collected from the user's past activity history and social media as input via an emotion engine. The emotion engine uses natural language processing tools (such as NLTK and spaCy) to analyze this data and generate emotion information as output. Specifically, the server uses SNS APIs to collect data and processes it with the emotion engine to identify the user's emotions.
[0438] Step 4:
[0439] The server uses a generative AI model and takes a prompt as input. Based on this prompt, the generative AI model outputs content that corresponds to emotion. Specifically, the server provides the model with a prompt such as "Generate an emotionally moving social media post," and the model automatically generates appropriate post content.
[0440] Step 5:
[0441] The server provides automatically generated content to users, which can then be used for sales strategies or communication with users. Users utilize the generated content and analysis results as output when developing strategies to appeal to the market. Specifically, users review the generated content and then post it on social media or incorporate it into advertising campaigns.
[0442] Step 6:
[0443] In generating crowdfunding materials, the server takes project feedback data as input. Based on the results of analysis by the emotion engine, it outputs proposal materials. Specifically, the server incorporates a storyline that emphasizes the emotions of funders into the proposal and slides. These materials are used in the fundraising presentation.
[0444] (Application Example 2)
[0445] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0446] In contemporary artistic activity, it is difficult for artists to effectively promote their work and build deep connections with their fans. Furthermore, there are insufficient means to accurately understand audience emotions and provide personalized advertising and content accordingly. A system is needed to address these challenges.
[0447] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0448] This invention includes a server that provides means for proposing an appropriate promotional strategy using a machine learning model that analyzes information and characteristics of works of art, means for recognizing users' emotions in real time and generating and displaying relevant advertisements, and means for generating topics and questions using machine learning to stimulate the flow of dialogue within fan groups. This makes it possible to enhance artists' promotional activities, achieve close communication with fans, and personalize information dissemination based on emotions.
[0449] A "work of art" is something that possesses visual or expressive value and is created by an individual creator.
[0450] "Information" refers to data, knowledge, and news related to the subject matter.
[0451] A "machine learning model" is a set of algorithms that automatically learn patterns from data and perform specific tasks.
[0452] "Advertising strategy" refers to the plans and methods used to effectively spread awareness of a particular product or service in the market.
[0453] A "target group" is a collection of people who are classified into a specific market segment as consumers of a product or service.
[0454] A "medium" refers to a means or channel for transmitting information.
[0455] A "user" refers to an individual or group that uses a particular product or service.
[0456] "Emotions" refer to the psychological states of humans, specifically internal feelings such as joy and sadness.
[0457] "Advertising" is an information dissemination activity conducted to make people aware of the existence of a product or service.
[0458] A "fan group" is a group of people who are interested in and support a particular artist or content.
[0459] "The flow of a conversation" refers to the progression of a discussion or the pattern of how a conversation unfolds in human communication.
[0460] "Topic introduction" refers to facilitating communication by indicating a central theme or topic in a dialogue or discussion.
[0461] A "question" is the act of posing a problem to someone for the purpose of gathering information or confirming details.
[0462] The system for carrying out the present invention consists of the following hardware and software. The main hardware used is a user-wearable smart device, particularly smart glasses, which collects the user's facial expressions and voice data using cameras and microphones mounted on them. The server uses TensorFlow as a machine learning framework and implements an emotion recognition model for analyzing the collected data.
[0463] The smart glasses, acting as a device, have the ability to visually display advertisements generated from analysis results through an AR (augmented reality) interface powered by Unity. The server automatically generates relevant advertisements that the user might be interested in, based on sentiment data obtained by a machine learning model and utilizing an algorithm programmed in Python.
[0464] For example, if a user is viewing a particular artwork in a museum, the server recognizes the user's emotions towards that artwork in real time. Based on this emotion data, the server generates advertisements containing information about similar artworks and events, and displays them in augmented reality (AR) on smart glasses. In this way, users can instantly connect their emotional experiences to related event information, increasing their desire to participate.
[0465] By utilizing a generative AI model, it is possible to automatically generate prompt messages based on specific emotions. For example, by inputting the sentence, "When a user is moved by a sculpture, generate an advertisement for the next exhibition related to that sculpture," into the model, it is possible to quickly generate appropriate advertising content. Thus, the present invention is a system that recognizes user emotions in real time and enables promotions tailored to individual needs.
[0466] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0467] Step 1:
[0468] The user wears smart glasses and views works of art in a museum or other location. The camera and microphone of the smart glasses, acting as a terminal, record and collect the user's facial expressions and voice data in real time. This becomes the input data.
[0469] Step 2:
[0470] The device compresses the collected facial expression and voice data and sends it to the server. The server analyzes the received input data using an emotion recognition model based on TensorFlow. This allows it to recognize the user's real-time emotional state as output.
[0471] Step 3:
[0472] The server generates relevant prompt sentences based on the emotion recognition results and uses these prompt sentences as input to the generation AI model. Specifically, it prepares prompt sentences containing keywords and stories to automatically generate advertising content related to works that the user found moving.
[0473] Step 4:
[0474] The generative AI model analyzes the input prompt text and generates advertisements that match the user's emotional state. The resulting advertisement data is then converted back into an AR display format on the server.
[0475] Step 5:
[0476] The server sends the generated advertisement to the device. The smart glasses visually display the advertisement in the user's field of view via an AR interface using Unity. This allows the user to receive information about related events and works in real time.
[0477] This system allows users to instantly receive promotional information tailored to their individual emotions while viewing art.
[0478] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0479] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0480] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.
[0481] [Third Embodiment]
[0482] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.
[0483] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[0484] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0485] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.
[0486] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0487] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0488] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0489] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0490] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0491] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0492] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0493] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".
[0494] This invention provides an integrated support system that enables various artists and creators to more effectively promote their works and activities, strengthen relationships with fans, and successfully raise funds. Specific embodiments are described below.
[0495] This system begins with the user uploading their artwork data from their device to the server. This data includes images, descriptions, and related metadata. The server receives this data and uses its built-in artificial intelligence model to analyze the artwork's characteristics in detail. The AI model utilizes machine learning techniques to analyze the artwork's style, theme, and techniques, and stores this information in a digital database.
[0496] Next, the server identifies the target audience for the work based on market databases and past success stories. This analysis allows for the development of an optimal promotional strategy. The server supports effective information dissemination by selecting appropriate social media platforms and determining the timing of posting. Furthermore, an AI generation algorithm automatically generates social media post content and visual content, which are then provided to users.
[0497] Afterward, the user reviews the promotional proposal from their device and edits it as needed. Once editing is complete, the server automatically posts to social media at the scheduled time.
[0498] Furthermore, this system also includes specialized functions for building fan communities. Users can create community rooms and begin interactive interactions with their fans. The server uses AI-based content generation capabilities to automatically generate topics and questions that facilitate interaction, deepening relationships with fans.
[0499] Furthermore, as part of crowdfunding support, users can input details about their new project, and the server will use AI to generate presentation materials for that project. The generated materials will be customized based on a marketing strategy aimed at achieving the fundraising goal.
[0500] As described above, the present invention is a system that integrates various functions to support artists' activities, enabling effective and efficient promotion, fostering interaction with fans, and crowdfunding. Users can intuitively operate these functions through a user-friendly interface accessible via their terminal.
[0501] The following describes the processing flow.
[0502] Step 1:
[0503] Users upload their artwork data to the server via their device. This artwork data includes image files and text data.
[0504] Step 2:
[0505] The server receives the uploaded artwork data and inputs it into its internal artificial intelligence model. The AI model uses machine learning algorithms to analyze the artwork's style, theme, techniques, and other characteristics.
[0506] Step 3:
[0507] Based on the analysis results, the server refers to a market database to identify a suitable target audience for the work. This process takes into account past sales performance of similar works and current market trends.
[0508] Step 4:
[0509] The server builds the optimal promotional strategy based on the target audience. It determines the social media platforms to use and the timing of posts, and creates a draft promotional strategy.
[0510] Step 5:
[0511] The server utilizes AI generation capabilities to automatically generate text and visual content for social media posts and presents them to users.
[0512] Step 6:
[0513] The user reviews the proposed promotional strategy presented by the server via their device. After editing the content as needed, they submit their approval back to the server.
[0514] Step 7:
[0515] The server automatically posts user-approved promotional content to social media at scheduled times.
[0516] Step 8:
[0517] Users interact with fans using the community features on the server. The server uses AI to suggest events and automatically generates content that promotes interaction.
[0518] Step 9:
[0519] When a user launches a new crowdfunding project, they input the project details from their device into the server. The server then uses AI to automatically create presentation materials based on this information.
[0520] Step 10:
[0521] The server provides users with a personalized fundraising plan and runs simulations to help them reach their target amount. Users then use this as a basis to conduct their crowdfunding campaign.
[0522] (Example 1)
[0523] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0524] In the modern era, it is extremely difficult for artists and creators to effectively promote their work, strengthen relationships with interested parties, and raise funds. In particular, effectively disseminating information to the appropriate target groups, forming interest groups, and ensuring the success of funded projects are challenging to achieve with limited resources. Therefore, new technological means are needed to comprehensively address these challenges.
[0525] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0526] In this invention, the server includes means for proposing an appropriate advertising strategy using an information processing device that analyzes data of works of art and analyzes its characteristics; means for identifying suitable target groups based on the analysis results and determining the basis and timing for effective information dissemination; and means for automatically generating information to facilitate communication with interested parties and providing a platform for interaction to form groups of interested parties. This enables creators to maximize the value of their works and achieve their goals effectively and efficiently.
[0527] An "information processing device" is an electronic device used for collecting, analyzing, and processing data, and is a device that has the capability to handle diverse types of information.
[0528] A "work of art" is a creative product expressed visually or aurally, reflecting the sensibilities and ideas of its creator.
[0529] A "marketing strategy" is a planned set of guidelines aimed at making a particular product or service known to many people and promoting its use.
[0530] A "target group" is a group of people who possess specific attributes and are expected to be recipients of a product or service.
[0531] "Information dissemination" refers to activities and methods of widely communicating a specific message or content.
[0532] "Foundation" refers to the systems or networks that serve as the basis for carrying out specific activities or functions.
[0533] "Timing" is a concept that refers to the optimal time or period for performing a particular activity.
[0534] "Interested individuals" are people who have an interest in a particular product, service, or piece of information.
[0535] "Communication" refers to the exchange of information, opinions, and emotions, thereby deepening mutual understanding.
[0536] A "group" is an organization or organization consisting of multiple people who share a common purpose or interest.
[0537] A "place for exchange" is a physical or virtual space established for the purpose of exchanging information and opinions and for facilitating communication.
[0538] This invention is built as an integrated system to support the promotion of works of art. The system is primarily operated around servers, terminals, and users.
[0539] First, the user uploads the artwork data to the server using their device. The data includes images of the artwork, a description, and related metadata, and this process is carried out securely via an internet connection.
[0540] The server is built using Python and employs machine learning libraries such as TensorFlow and PyTorch. Based on the uploaded data, the server uses an AI model to analyze the style, theme, and techniques of the artwork. The analysis results are stored in a digital database and used to develop promotional strategies.
[0541] As a concrete example, if a user wants to announce a new painting project, they input images and a description of the artwork into the system. The server uses AI to analyze the data and identify a target group. This allows the user to receive an appropriate promotional plan.
[0542] Furthermore, the system includes a function to automatically generate conversation content in order to stimulate communication with those who are interested. OpenAI's GPT and other technologies are used for text generation, providing topics and questions that will stimulate interest.
[0543] In the funding support process, users enter project details from their devices, and the server uses AI to generate reports that reflect a customized marketing strategy.
[0544] An example of a prompt would be: "Please propose a promotional strategy for a newly released artwork. The target audience is young adults, and the main theme is environmental protection."
[0545] In this way, the system effectively brings out the value of the artwork and broadly supports the creators' activities through diverse forms of assistance.
[0546] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0547] Step 1:
[0548] Users input their artwork data via their device and upload it to the server.
[0549] Specifically, users use their devices to select artwork image files, their descriptions, and metadata, and send them to the server via a dedicated web interface. The input data mainly consists of image files and text information, which are used for analysis in the next step.
[0550] Step 2:
[0551] The server receives the uploaded artwork data and performs analysis using an AI model.
[0552] Based on the received data, the server uses machine learning frameworks such as TensorFlow and PyTorch to identify the style, theme, and techniques of the artwork. The input image data is processed using deep learning technology, and the analyzed feature information is stored in a database. This analysis result forms the basis for formulating the promotion strategy.
[0553] Step 3:
[0554] The server uses the analysis results of the work and the market database to identify the target audience.
[0555] The input consists of analytical features of the work and market trend data, which the AI combines to identify the optimal target audience. The output is a profile of the target audience, which is then used in the design of the next promotion.
[0556] Step 4:
[0557] The server uses AI to generate appropriate advertising strategies based on the identified target audience.
[0558] The input consists of target audience profiles and data from past success stories. An AI model analyzes this data to output information such as the selection of social media platforms and the optimal posting timing. Specifically, scheduling can be performed using tools like Hootsuite or Buffer.
[0559] Step 5:
[0560] The server provides automatically generated SNS post content to the user.
[0561] In this step, OpenAI's generative AI model is used to generate text and select images. Detailed information on the advertising strategy is provided as input, and specific SNS post suggestions are provided as output, which the user can then review and edit on their device.
[0562] Step 6:
[0563] Users use their devices to review the provided social media content, edit it as needed, and then confirm it.
[0564] Users review the provided content and adjust the text and visuals using editing tools. The completed content is then sent to the server and incorporated into the schedule.
[0565] Step 7:
[0566] The server automatically posts confirmed SNS content to SNS at the scheduled time.
[0567] By using APIs such as Hootsuite and Buffer, posts are made at the specified date and time. This ensures that information is disseminated as planned.
[0568] Step 8:
[0569] The server automatically generates and provides interactive content for the fan community to users.
[0570] The input includes data on the target fan and their past interaction history. Using AI, topics and questions that are likely to elicit responses from interested individuals are generated. This output is then presented to the user, stimulating communication.
[0571] Step 9:
[0572] Users use their devices to review the content of interactions, make adjustments as needed, and communicate with those they are interested in.
[0573] Users can use the generated topics to engage in conversations with those who share their interests, thereby strengthening their relationships within the community.
[0574] (Application Example 1)
[0575] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0576] Effective promotion of artworks and creative content is crucial for maximizing the value of the work itself and reaching the right audience. However, many artists and creators lack expertise in advertising and market analysis, making it difficult to develop appropriate strategies. Furthermore, they lack the tools to efficiently and widely promote their work and deepen communication with their audience. To address these challenges, there is a need for the automation of sophisticated advertising strategies based on the characteristics of artworks and market information.
[0577] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0578] This invention includes a server that analyzes data of artworks and uses an artificial intelligence model to analyze their characteristics and proposes an appropriate advertising strategy; a server that identifies suitable target audiences and determines the media and timing for effective information dissemination based on the analysis results; and a server that automatically generates advertising content to facilitate communication between artists and audiences and executes optimized promotions through a user interface. This enables artists and creators to promote their works more effectively and reach their target audiences accurately.
[0579] "Works of art" are visual or expressive content created by an artist, including paintings, photographs, illustrations, and digital art.
[0580] An "artificial intelligence model" is an algorithm or system designed to analyze data based on machine learning and automatically extract and determine specific patterns or insights.
[0581] "Advertising strategy" is a general term for a series of promotional activities planned to effectively raise awareness of a specific product or service among a target audience.
[0582] The "recipient segment" refers to the members of the market targeted by a particular product or service, and is a group of consumers classified based on attributes such as age, gender, and interests.
[0583] "Information dissemination media" refers to the means and platforms used to convey content to consumers, and includes social media, blogs, video platforms, and so on.
[0584] "Timing" refers to the time or period when a particular action or promotion is implemented most effectively, and it is a crucial factor that influences the success rate of advertising and campaigns.
[0585] A "user interface" is the part of a system that allows the user to interact directly with the system. It provides information in a visually easy-to-use format and is a mechanism for receiving commands.
[0586] This invention is a system for automating effective advertising strategies for works of art. The system primarily consists of a server, user terminals, and a user interface.
[0587] Users upload data of their artwork to a server using their own devices. This data includes images, videos, and associated metadata of the artwork. After receiving this data, the server uses an artificial intelligence model running in the cloud to analyze the style, theme, and techniques of the artwork. Specifically, it utilizes models built with machine learning libraries such as TensorFlow and PyTorch to perform a detailed analysis of the data. The features extracted through this analysis are used to propose advertising strategies.
[0588] Next, the server consults a market database to identify the most suitable audience for the work. Based on this, it determines the appropriate medium and timing for disseminating information. This process involves a user interface through an application on the user's smartphone or tablet. The advertising content thus generated is automatically optimized and delivered to the user.
[0589] Furthermore, the generated advertisements include catchphrases and visuals automatically generated by AI. The generating AI model assembles content based on prompts that maximize the unique features of the work. For example, it provides visual styles and descriptions tailored to platforms such as Instagram and Facebook. An example of a prompt used in this process might be, "To effectively promote this character design project, please propose advertising content that emphasizes the emotional aspects of color."
[0590] This system allows users to efficiently reach their target audience with their work and maximize advertising effectiveness without requiring specialized knowledge.
[0591] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0592] Step 1:
[0593] Users upload data (images, videos, metadata) of their artwork to the server using their devices. This data serves as input for subsequent analysis processes.
[0594] Step 2:
[0595] The server passes the received data to an artificial intelligence model in the cloud for analysis. This AI model, built using TensorFlow or PyTorch, employs image recognition and natural language processing techniques to extract features such as the style and theme of the artwork. The analyzed feature information is then processed as output for the next step.
[0596] Step 3:
[0597] The server matches the characteristics of the analyzed work against a market database to identify the optimal audience. This process utilizes demographic data such as the target audience's age, gender, and interests. Information on the identified audience is provided as output.
[0598] Step 4:
[0599] The server determines the appropriate media and timing for information dissemination based on the identified audience. This includes selecting social media and advertising platforms and planning the optimal posting schedule. This output is used as a guide for a specific promotional strategy.
[0600] Step 5:
[0601] The server automatically generates advertising content using a generative AI model. The model includes a process that takes prompt text as input and generates catchphrases and visuals based on it. This output advertising content is then provided to the user for review and editing.
[0602] Step 6:
[0603] Users review the generated advertising content through the terminal interface and edit it as needed. This edited data becomes the final output, which the server automatically posts to the advertising platform at the scheduled time.
[0604] This process allows users to effectively promote their work and reach their appropriate target audience without requiring specialized knowledge.
[0605] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0606] This invention provides a system for recognizing user emotions and utilizing that information in promotional strategies and communication with fans. The system aims to support artists' activities, enabling them to promote themselves more effectively through emotions and deepen their relationships with fans.
[0607] The system begins with the user uploading their artwork data from their device to the server. The server then uses an AI model to analyze the characteristics of the artwork. In addition, an emotion engine analyzes the user's past activity history, text data extracted from social media, and emotional information explicitly stated by the user to recognize the user's emotions.
[0608] The emotion engine incorporates recognized emotional information into the promotion strategy. The server develops the optimal promotion plan based on the topics and styles that users are emotionally interested in. For example, if a user shows a high level of interest in emotionally charged themes, the server automatically generates emotionally resonant social media posts.
[0609] Furthermore, in fan communication, the emotion engine performs natural language processing on interactions with fans, providing content that makes the dialogue deeper and more emotionally rich. Users interact with the fan community through their devices, and the server uses AI to automatically generate topics and questions for further interaction based on feedback from fans.
[0610] In crowdfunding projects, a server evaluates the sentiments of funders and generates presentation materials accordingly. For example, if a funder resonates with the project's vision, a storyline emphasizing that sentiment will be incorporated into the materials.
[0611] As a concrete example, suppose a user launches a new art project. Based on the user's past activities and emotional information, the emotion engine identifies themes that are likely to make the user feel happy. The server then analyzes successful examples of similar projects in the market and builds an optimal target audience and promotional strategy based on these emotions.
[0612] Thus, by incorporating an emotion engine, this invention enables a deeper understanding of user emotions and supports artists' activities with a more personalized approach. Users can maximize the value of their work through promotional strategies and communications that are in harmony with their emotions.
[0613] The following describes the processing flow.
[0614] Step 1:
[0615] Users upload their artwork data and related emotional input information (e.g., emotional states based on text comments or choices) from their device to the server.
[0616] Step 2:
[0617] The server feeds the uploaded artwork data into an artificial intelligence model, which then analyzes the artwork's style, theme, and techniques.
[0618] Step 3:
[0619] The emotion engine installed on the server analyzes emotional information provided by the user and data collected from social media and other sources to recognize the user's current emotional state.
[0620] Step 4:
[0621] The server develops the optimal promotional strategy for the user based on the emotional information recognized by the emotion engine. In doing so, it considers themes that strongly interest the user emotionally and identifies the target audience.
[0622] Step 5:
[0623] The server automatically generates and presents emotion-based promotional social media posts and visual content to users.
[0624] Step 6:
[0625] Users review the promotional proposals presented by the server via their devices and edit or modify them as needed. After the user approves, the server posts the content to the designated social media platform.
[0626] Step 7:
[0627] In terms of communication with fans, the server uses an emotion engine to analyze feedback from fans and automatically generates questions and topics to deepen dialogue within the fan community.
[0628] Step 8:
[0629] Users can utilize communication support functions provided by the server via their devices to engage in real-time interactions with fans.
[0630] Step 9:
[0631] When planning a crowdfunding project, the server uses AI to generate presentation materials that will attract the interest of funders, based on the provided project overview and sentiment information.
[0632] Step 10:
[0633] Users review the server-generated presentation materials and use them to increase their support for the project. They can edit the content as needed to create the final crowdfunding plan.
[0634] (Example 2)
[0635] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0636] In recent years, a diverse range of works have been created in the arts field. However, effectively selling, promoting, and raising funds for these works requires an accurate understanding of consumer sentiment and market trends. Effective communication methods to enhance engagement with users are also crucial. However, addressing these issues individually requires considerable effort and time, placing a significant burden on artists. Therefore, there is a need for solutions that analyze the characteristics of works and automate emotion-based strategies to address these challenges.
[0637] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0638] In this invention, the server includes means for analyzing information on works of art and proposing sales strategies, means for identifying user emotions and constructing strategies, and means for automatically generating content that stimulates dialogue within the user community. This enables artists to efficiently conduct promotions that meet market needs and to automatically provide content that deepens relationships with users.
[0639] A "work of art" refers to a visual or other sensory-oriented work created using creative ideas and techniques.
[0640] "Information" is an organized collection of data, facts, or knowledge that has value or meaning for a particular purpose.
[0641] An "artificial intelligence algorithm" refers to a set of programs and methods that computer systems use to analyze data and perform specific tasks through learning.
[0642] A "sales strategy" refers to a plan or method for distributing a particular product or service to the market and encouraging consumers to purchase it.
[0643] A "consumer segment" refers to a group of people who have an interest in and purchasing power for a particular product or service, and is also known as a target market.
[0644] "Foundation" refers to the basic elements or infrastructure necessary for achieving a specific purpose or activity.
[0645] "Time" refers to a specific timing or period during which a particular activity or event should take place.
[0646] "Content" refers to text or media that contains information or messages related to a specific theme or purpose.
[0647] A "user community" refers to a group or network of people who are interested in and involved with a particular product or service.
[0648] "Opportunity" refers to a situation in which favorable circumstances or conditions are in place to achieve a goal.
[0649] A "funding project" refers to an organized effort to raise the necessary funds for a specific business or purpose.
[0650] "Operational support" refers to providing the assistance and support necessary for the planning, implementation, and management of a specific project or activity.
[0651] "Proposal materials" refer to documents or other media used to explain a specific proposal or idea in detail.
[0652] "Market information" refers to data concerning products, consumer trends, and the competitive environment in a specific market.
[0653] An "emotion engine" refers to a system that uses natural language processing and data analysis techniques to recognize and analyze an individual's emotions and attitudes.
[0654] A "generative AI model" refers to the structure of artificial intelligence that has the ability to learn from large amounts of data and automatically generate new information and content.
[0655] This invention is a system that analyzes the characteristics of works of art and automates promotional and communication methods tailored to consumer emotions. The terminal is responsible for sending data of user-created works of art to the server. The server uses artificial intelligence algorithms such as TensorFlow and PyTorch, which are deep learning frameworks, to analyze the received data. This allows for the analysis of the visual features and concepts of the artwork, and the development of a suitable sales strategy.
[0656] Subsequently, the server uses an emotion engine to collect emotion data from the user's past activities and social media posts, and analyzes the emotions using natural language processing tools such as NLTK and spaCy. This identifies the emotions the user is experiencing, and based on that information, promotional methods are developed.
[0657] Furthermore, the server uses a generative AI model to automatically generate emotion-based content and provide material to facilitate communication with users. In this process, the generative AI model can be guided using prompts. For example, a prompt might be, "Create a social media post based on a theme that will please the user."
[0658] For example, if a user starts a new painting project with an autumn theme, this information is uploaded to the server. The server analyzes the artwork's colors and theme and identifies a target audience based on similar successful examples. As a prompt, the user might be instructed to "Generate a social media post using words that evoke the warmth of autumn," and the AI model would automatically generate content accordingly.
[0659] By leveraging this automatically generated content and sales strategies, users can efficiently appeal to the market and deepen relationships with their customers. In the case of crowdfunding, the server can generate materials that evoke empathy for the project's vision, thereby facilitating fundraising.
[0660] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0661] Step 1:
[0662] Users upload their artwork data from their device to the server. This data is entered and sent to the server. Specifically, the user uses a dedicated application on their device or a web interface to select image files and text data and presses the "Upload" button. This saves the artwork data to the server's storage system.
[0663] Step 2:
[0664] The server receives the uploaded artwork data and passes it as input to a deep learning framework. The server uses TensorFlow or PyTorch to analyze the visual features and concepts of this data. This analysis yields the visual characteristics and themes of the artwork as output. This generates the basic data for a concrete sales strategy.
[0665] Step 3:
[0666] The server receives text data collected from the user's past activity history and social media as input via an emotion engine. The emotion engine uses natural language processing tools (such as NLTK and spaCy) to analyze this data and generate emotion information as output. Specifically, the server uses SNS APIs to collect data and processes it with the emotion engine to identify the user's emotions.
[0667] Step 4:
[0668] The server uses a generative AI model and takes a prompt as input. Based on this prompt, the generative AI model outputs content that corresponds to emotion. Specifically, the server provides the model with a prompt such as "Generate an emotionally moving social media post," and the model automatically generates appropriate post content.
[0669] Step 5:
[0670] The server provides automatically generated content to users, which can then be used for sales strategies or communication with users. Users utilize the generated content and analysis results as output when developing strategies to appeal to the market. Specifically, users review the generated content and then post it on social media or incorporate it into advertising campaigns.
[0671] Step 6:
[0672] In generating crowdfunding materials, the server takes project feedback data as input. Based on the results of analysis by the emotion engine, it outputs proposal materials. Specifically, the server incorporates a storyline that emphasizes the emotions of funders into the proposal and slides. These materials are used in the fundraising presentation.
[0673] (Application Example 2)
[0674] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0675] In contemporary artistic activity, it is difficult for artists to effectively promote their work and build deep connections with their fans. Furthermore, there are insufficient means to accurately understand audience emotions and provide personalized advertising and content accordingly. A system is needed to address these challenges.
[0676] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0677] This invention includes a server that provides means for proposing an appropriate promotional strategy using a machine learning model that analyzes information and characteristics of works of art, means for recognizing users' emotions in real time and generating and displaying relevant advertisements, and means for generating topics and questions using machine learning to stimulate the flow of dialogue within fan groups. This makes it possible to enhance artists' promotional activities, achieve close communication with fans, and personalize information dissemination based on emotions.
[0678] A "work of art" is something that possesses visual or expressive value and is created by an individual creator.
[0679] "Information" refers to data, knowledge, and news related to the subject matter.
[0680] A "machine learning model" is a set of algorithms that automatically learn patterns from data and perform specific tasks.
[0681] "Advertising strategy" refers to the plans and methods used to effectively spread awareness of a particular product or service in the market.
[0682] A "target group" is a collection of people who are classified into a specific market segment as consumers of a product or service.
[0683] A "medium" refers to a means or channel for transmitting information.
[0684] A "user" refers to an individual or group that uses a particular product or service.
[0685] "Emotions" refer to the psychological states of humans, specifically internal feelings such as joy and sadness.
[0686] "Advertising" is an information dissemination activity conducted to make people aware of the existence of a product or service.
[0687] A "fan group" is a group of people who are interested in and support a particular artist or content.
[0688] "The flow of a conversation" refers to the progression of a discussion or the pattern of how a conversation unfolds in human communication.
[0689] "Topic introduction" refers to facilitating communication by indicating a central theme or topic in a dialogue or discussion.
[0690] A "question" is the act of posing a problem to someone for the purpose of gathering information or confirming details.
[0691] The system for carrying out the present invention consists of the following hardware and software. The main hardware used is a user-wearable smart device, particularly smart glasses, which collects the user's facial expressions and voice data using cameras and microphones mounted on them. The server uses TensorFlow as a machine learning framework and implements an emotion recognition model for analyzing the collected data.
[0692] The smart glasses, acting as a device, have the ability to visually display advertisements generated from analysis results through an AR (augmented reality) interface powered by Unity. The server automatically generates relevant advertisements that the user might be interested in, based on sentiment data obtained by a machine learning model and utilizing an algorithm programmed in Python.
[0693] For example, if a user is viewing a particular artwork in a museum, the server recognizes the user's emotions towards that artwork in real time. Based on this emotion data, the server generates advertisements containing information about similar artworks and events, and displays them in augmented reality (AR) on smart glasses. In this way, users can instantly connect their emotional experiences to related event information, increasing their desire to participate.
[0694] By utilizing a generative AI model, it is possible to automatically generate prompt messages based on specific emotions. For example, by inputting the sentence, "When a user is moved by a sculpture, generate an advertisement for the next exhibition related to that sculpture," into the model, it is possible to quickly generate appropriate advertising content. Thus, the present invention is a system that recognizes user emotions in real time and enables promotions tailored to individual needs.
[0695] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0696] Step 1:
[0697] The user wears smart glasses and views works of art in a museum or other location. The camera and microphone of the smart glasses, acting as a terminal, record and collect the user's facial expressions and voice data in real time. This becomes the input data.
[0698] Step 2:
[0699] The device compresses the collected facial expression and voice data and sends it to the server. The server analyzes the received input data using an emotion recognition model based on TensorFlow. This allows it to recognize the user's real-time emotional state as output.
[0700] Step 3:
[0701] The server generates relevant prompt sentences based on the emotion recognition results and uses these prompt sentences as input to the generation AI model. Specifically, it prepares prompt sentences containing keywords and stories to automatically generate advertising content related to works that the user found moving.
[0702] Step 4:
[0703] The generative AI model analyzes the input prompt text and generates advertisements that match the user's emotional state. The resulting advertisement data is then converted back into an AR display format on the server.
[0704] Step 5:
[0705] The server sends the generated advertisement to the device. The smart glasses visually display the advertisement in the user's field of view via an AR interface using Unity. This allows the user to receive information about related events and works in real time.
[0706] This system allows users to instantly receive promotional information tailored to their individual emotions while viewing art.
[0707] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0708] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0709] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.
[0710] [Fourth Embodiment]
[0711] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.
[0712] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[0713] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0714] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.
[0715] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0716] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0717] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0718] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.
[0719] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0720] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0721] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0722] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0723] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0724] This invention provides an integrated support system that enables various artists and creators to more effectively promote their works and activities, strengthen relationships with fans, and successfully raise funds. Specific embodiments are described below.
[0725] This system begins with the user uploading their artwork data from their device to the server. This data includes images, descriptions, and related metadata. The server receives this data and uses its built-in artificial intelligence model to analyze the artwork's characteristics in detail. The AI model utilizes machine learning techniques to analyze the artwork's style, theme, and techniques, and stores this information in a digital database.
[0726] Next, the server identifies the target audience for the work based on market databases and past success stories. This analysis allows for the development of an optimal promotional strategy. The server supports effective information dissemination by selecting appropriate social media platforms and determining the timing of posting. Furthermore, an AI generation algorithm automatically generates social media post content and visual content, which are then provided to users.
[0727] Afterward, the user reviews the promotional proposal from their device and edits it as needed. Once editing is complete, the server automatically posts to social media at the scheduled time.
[0728] Furthermore, this system also includes specialized functions for building fan communities. Users can create community rooms and begin interactive interactions with their fans. The server uses AI-based content generation capabilities to automatically generate topics and questions that facilitate interaction, deepening relationships with fans.
[0729] Furthermore, as part of crowdfunding support, users can input details about their new project, and the server will use AI to generate presentation materials for that project. The generated materials will be customized based on a marketing strategy aimed at achieving the fundraising goal.
[0730] As described above, the present invention is a system that integrates various functions to support artists' activities, enabling effective and efficient promotion, fostering interaction with fans, and crowdfunding. Users can intuitively operate these functions through a user-friendly interface accessible via their terminal.
[0731] The following describes the processing flow.
[0732] Step 1:
[0733] Users upload their artwork data to the server via their device. This artwork data includes image files and text data.
[0734] Step 2:
[0735] The server receives the uploaded artwork data and inputs it into its internal artificial intelligence model. The AI model uses machine learning algorithms to analyze the artwork's style, theme, techniques, and other characteristics.
[0736] Step 3:
[0737] Based on the analysis results, the server refers to a market database to identify a suitable target audience for the work. This process takes into account past sales performance of similar works and current market trends.
[0738] Step 4:
[0739] The server builds the optimal promotional strategy based on the target audience. It determines the social media platforms to use and the timing of posts, and creates a draft promotional strategy.
[0740] Step 5:
[0741] The server utilizes AI generation capabilities to automatically generate text and visual content for social media posts and presents them to users.
[0742] Step 6:
[0743] The user reviews the proposed promotional strategy presented by the server via their device. After editing the content as needed, they submit their approval back to the server.
[0744] Step 7:
[0745] The server automatically posts user-approved promotional content to social media at scheduled times.
[0746] Step 8:
[0747] Users interact with fans using the community features on the server. The server uses AI to suggest events and automatically generates content that promotes interaction.
[0748] Step 9:
[0749] When a user launches a new crowdfunding project, they input the project details from their device into the server. The server then uses AI to automatically create presentation materials based on this information.
[0750] Step 10:
[0751] The server provides users with a personalized fundraising plan and runs simulations to help them reach their target amount. Users then use this as a basis to conduct their crowdfunding campaign.
[0752] (Example 1)
[0753] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0754] In the modern era, it is extremely difficult for artists and creators to effectively promote their work, strengthen relationships with interested parties, and raise funds. In particular, effectively disseminating information to the appropriate target groups, forming interest groups, and ensuring the success of funded projects are challenging to achieve with limited resources. Therefore, new technological means are needed to comprehensively address these challenges.
[0755] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0756] In this invention, the server includes means for proposing an appropriate advertising strategy using an information processing device that analyzes data of works of art and analyzes its characteristics; means for identifying suitable target groups based on the analysis results and determining the basis and timing for effective information dissemination; and means for automatically generating information to facilitate communication with interested parties and providing a platform for interaction to form groups of interested parties. This enables creators to maximize the value of their works and achieve their goals effectively and efficiently.
[0757] An "information processing device" is an electronic device used for collecting, analyzing, and processing data, and is a device that has the capability to handle diverse types of information.
[0758] A "work of art" is a creative product expressed visually or aurally, reflecting the sensibilities and ideas of its creator.
[0759] A "marketing strategy" is a planned set of guidelines aimed at making a particular product or service known to many people and promoting its use.
[0760] A "target group" is a group of people who possess specific attributes and are expected to be recipients of a product or service.
[0761] "Information dissemination" refers to activities and methods of widely communicating a specific message or content.
[0762] "Foundation" refers to the systems or networks that serve as the basis for carrying out specific activities or functions.
[0763] "Timing" is a concept that refers to the optimal time or period for performing a particular activity.
[0764] "Interested individuals" are people who have an interest in a particular product, service, or piece of information.
[0765] "Communication" refers to the exchange of information, opinions, and emotions, thereby deepening mutual understanding.
[0766] A "group" is an organization or organization consisting of multiple people who share a common purpose or interest.
[0767] A "place for exchange" is a physical or virtual space established for the purpose of exchanging information and opinions and for facilitating communication.
[0768] This invention is built as an integrated system to support the promotion of works of art. The system is primarily operated around servers, terminals, and users.
[0769] First, the user uploads the artwork data to the server using their device. The data includes images of the artwork, a description, and related metadata, and this process is carried out securely via an internet connection.
[0770] The server is built using Python and employs machine learning libraries such as TensorFlow and PyTorch. Based on the uploaded data, the server uses an AI model to analyze the style, theme, and techniques of the artwork. The analysis results are stored in a digital database and used to develop promotional strategies.
[0771] As a concrete example, if a user wants to announce a new painting project, they input images and a description of the artwork into the system. The server uses AI to analyze the data and identify a target group. This allows the user to receive an appropriate promotional plan.
[0772] Furthermore, the system includes a function to automatically generate conversation content in order to stimulate communication with those who are interested. OpenAI's GPT and other technologies are used for text generation, providing topics and questions that will stimulate interest.
[0773] In the funding support process, users enter project details from their devices, and the server uses AI to generate reports that reflect a customized marketing strategy.
[0774] An example of a prompt would be: "Please propose a promotional strategy for a newly released artwork. The target audience is young adults, and the main theme is environmental protection."
[0775] In this way, the system effectively brings out the value of the artwork and broadly supports the creators' activities through diverse forms of assistance.
[0776] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0777] Step 1:
[0778] Users input their artwork data via their device and upload it to the server.
[0779] Specifically, users use their devices to select artwork image files, their descriptions, and metadata, and send them to the server via a dedicated web interface. The input data mainly consists of image files and text information, which are used for analysis in the next step.
[0780] Step 2:
[0781] The server receives the uploaded artwork data and performs analysis using an AI model.
[0782] Based on the received data, the server uses machine learning frameworks such as TensorFlow and PyTorch to identify the style, theme, and techniques of the artwork. The input image data is processed using deep learning technology, and the analyzed feature information is stored in a database. This analysis result forms the basis for formulating the promotion strategy.
[0783] Step 3:
[0784] The server uses the analysis results of the work and the market database to identify the target audience.
[0785] The input consists of analytical features of the work and market trend data, which the AI combines to identify the optimal target audience. The output is a profile of the target audience, which is then used in the design of the next promotion.
[0786] Step 4:
[0787] The server uses AI to generate appropriate advertising strategies based on the identified target audience.
[0788] The input consists of target audience profiles and data from past success stories. An AI model analyzes this data to output information such as the selection of social media platforms and the optimal posting timing. Specifically, scheduling can be performed using tools like Hootsuite or Buffer.
[0789] Step 5:
[0790] The server provides automatically generated SNS post content to the user.
[0791] In this step, OpenAI's generative AI model is used to generate text and select images. Detailed information on the advertising strategy is provided as input, and specific SNS post suggestions are provided as output, which the user can then review and edit on their device.
[0792] Step 6:
[0793] Users use their devices to review the provided social media content, edit it as needed, and then confirm it.
[0794] Users review the provided content and adjust the text and visuals using editing tools. The completed content is then sent to the server and incorporated into the schedule.
[0795] Step 7:
[0796] The server automatically posts confirmed SNS content to SNS at the scheduled time.
[0797] By using APIs such as Hootsuite and Buffer, posts are made at the specified date and time. This ensures that information is disseminated as planned.
[0798] Step 8:
[0799] The server automatically generates and provides interactive content for the fan community to users.
[0800] The input includes data on the target fan and their past interaction history. Using AI, topics and questions that are likely to elicit responses from interested individuals are generated. This output is then presented to the user, stimulating communication.
[0801] Step 9:
[0802] Users use their devices to review the content of interactions, make adjustments as needed, and communicate with those they are interested in.
[0803] Users can use the generated topics to engage in conversations with those who share their interests, thereby strengthening their relationships within the community.
[0804] (Application Example 1)
[0805] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0806] Effective promotion of artworks and creative content is crucial for maximizing the value of the work itself and reaching the right audience. However, many artists and creators lack expertise in advertising and market analysis, making it difficult to develop appropriate strategies. Furthermore, they lack the tools to efficiently and widely promote their work and deepen communication with their audience. To address these challenges, there is a need for the automation of sophisticated advertising strategies based on the characteristics of artworks and market information.
[0807] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0808] This invention includes a server that analyzes data of artworks and uses an artificial intelligence model to analyze their characteristics and proposes an appropriate advertising strategy; a server that identifies suitable target audiences and determines the media and timing for effective information dissemination based on the analysis results; and a server that automatically generates advertising content to facilitate communication between artists and audiences and executes optimized promotions through a user interface. This enables artists and creators to promote their works more effectively and reach their target audiences accurately.
[0809] "Works of art" are visual or expressive content created by an artist, including paintings, photographs, illustrations, and digital art.
[0810] An "artificial intelligence model" is an algorithm or system designed to analyze data based on machine learning and automatically extract and determine specific patterns or insights.
[0811] "Advertising strategy" is a general term for a series of promotional activities planned to effectively raise awareness of a specific product or service among a target audience.
[0812] The "recipient segment" refers to the members of the market targeted by a particular product or service, and is a group of consumers classified based on attributes such as age, gender, and interests.
[0813] "Information dissemination media" refers to the means and platforms used to convey content to consumers, and includes social media, blogs, video platforms, and so on.
[0814] "Timing" refers to the time or period when a particular action or promotion is implemented most effectively, and it is a crucial factor that influences the success rate of advertising and campaigns.
[0815] A "user interface" is the part of a system that allows the user to interact directly with the system. It provides information in a visually easy-to-use format and is a mechanism for receiving commands.
[0816] This invention is a system for automating effective advertising strategies for works of art. The system primarily consists of a server, user terminals, and a user interface.
[0817] Users upload data of their artwork to a server using their own devices. This data includes images, videos, and associated metadata of the artwork. After receiving this data, the server uses an artificial intelligence model running in the cloud to analyze the style, theme, and techniques of the artwork. Specifically, it utilizes models built with machine learning libraries such as TensorFlow and PyTorch to perform a detailed analysis of the data. The features extracted through this analysis are used to propose advertising strategies.
[0818] Next, the server consults a market database to identify the most suitable audience for the work. Based on this, it determines the appropriate medium and timing for disseminating information. This process involves a user interface through an application on the user's smartphone or tablet. The advertising content thus generated is automatically optimized and delivered to the user.
[0819] Furthermore, the generated advertisements include catchphrases and visuals automatically generated by AI. The generating AI model assembles content based on prompts that maximize the unique features of the work. For example, it provides visual styles and descriptions tailored to platforms such as Instagram and Facebook. An example of a prompt used in this process might be, "To effectively promote this character design project, please propose advertising content that emphasizes the emotional aspects of color."
[0820] This system allows users to efficiently reach their target audience with their work and maximize advertising effectiveness without requiring specialized knowledge.
[0821] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0822] Step 1:
[0823] Users upload data (images, videos, metadata) of their artwork to the server using their devices. This data serves as input for subsequent analysis processes.
[0824] Step 2:
[0825] The server passes the received data to an artificial intelligence model in the cloud for analysis. This AI model, built using TensorFlow or PyTorch, employs image recognition and natural language processing techniques to extract features such as the style and theme of the artwork. The analyzed feature information is then processed as output for the next step.
[0826] Step 3:
[0827] The server matches the characteristics of the analyzed work against a market database to identify the optimal audience. This process utilizes demographic data such as the target audience's age, gender, and interests. Information on the identified audience is provided as output.
[0828] Step 4:
[0829] The server determines the appropriate media and timing for information dissemination based on the identified audience. This includes selecting social media and advertising platforms and planning the optimal posting schedule. This output is used as a guide for a specific promotional strategy.
[0830] Step 5:
[0831] The server automatically generates advertising content using a generative AI model. The model includes a process that takes prompt text as input and generates catchphrases and visuals based on it. This output advertising content is then provided to the user for review and editing.
[0832] Step 6:
[0833] Users review the generated advertising content through the terminal interface and edit it as needed. This edited data becomes the final output, which the server automatically posts to the advertising platform at the scheduled time.
[0834] This process allows users to effectively promote their work and reach their appropriate target audience without requiring specialized knowledge.
[0835] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0836] This invention provides a system for recognizing user emotions and utilizing that information in promotional strategies and communication with fans. The system aims to support artists' activities, enabling them to promote themselves more effectively through emotions and deepen their relationships with fans.
[0837] The system begins with the user uploading their artwork data from their device to the server. The server then uses an AI model to analyze the characteristics of the artwork. In addition, an emotion engine analyzes the user's past activity history, text data extracted from social media, and emotional information explicitly stated by the user to recognize the user's emotions.
[0838] The emotion engine incorporates recognized emotional information into the promotion strategy. The server develops the optimal promotion plan based on the topics and styles that users are emotionally interested in. For example, if a user shows a high level of interest in emotionally charged themes, the server automatically generates emotionally resonant social media posts.
[0839] Furthermore, in fan communication, the emotion engine performs natural language processing on interactions with fans, providing content that makes the dialogue deeper and more emotionally rich. Users interact with the fan community through their devices, and the server uses AI to automatically generate topics and questions for further interaction based on feedback from fans.
[0840] In crowdfunding projects, a server evaluates the sentiments of funders and generates presentation materials accordingly. For example, if a funder resonates with the project's vision, a storyline emphasizing that sentiment will be incorporated into the materials.
[0841] As a concrete example, suppose a user launches a new art project. Based on the user's past activities and emotional information, the emotion engine identifies themes that are likely to make the user feel happy. The server then analyzes successful examples of similar projects in the market and builds an optimal target audience and promotional strategy based on these emotions.
[0842] Thus, by incorporating an emotion engine, this invention enables a deeper understanding of user emotions and supports artists' activities with a more personalized approach. Users can maximize the value of their work through promotional strategies and communications that are in harmony with their emotions.
[0843] The following describes the processing flow.
[0844] Step 1:
[0845] Users upload their artwork data and related emotional input information (e.g., emotional states based on text comments or choices) from their device to the server.
[0846] Step 2:
[0847] The server feeds the uploaded artwork data into an artificial intelligence model, which then analyzes the artwork's style, theme, and techniques.
[0848] Step 3:
[0849] The emotion engine installed on the server analyzes emotional information provided by the user and data collected from social media and other sources to recognize the user's current emotional state.
[0850] Step 4:
[0851] The server develops the optimal promotional strategy for the user based on the emotional information recognized by the emotion engine. In doing so, it considers themes that strongly interest the user emotionally and identifies the target audience.
[0852] Step 5:
[0853] The server automatically generates and presents emotion-based promotional social media posts and visual content to users.
[0854] Step 6:
[0855] Users review the promotional proposals presented by the server via their devices and edit or modify them as needed. After the user approves, the server posts the content to the designated social media platform.
[0856] Step 7:
[0857] In terms of communication with fans, the server uses an emotion engine to analyze feedback from fans and automatically generates questions and topics to deepen dialogue within the fan community.
[0858] Step 8:
[0859] Users can utilize communication support functions provided by the server via their devices to engage in real-time interactions with fans.
[0860] Step 9:
[0861] When planning a crowdfunding project, the server uses AI to generate presentation materials that will attract the interest of funders, based on the provided project overview and sentiment information.
[0862] Step 10:
[0863] Users review the server-generated presentation materials and use them to increase their support for the project. They can edit the content as needed to create the final crowdfunding plan.
[0864] (Example 2)
[0865] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0866] In recent years, a diverse range of works have been created in the arts field. However, effectively selling, promoting, and raising funds for these works requires an accurate understanding of consumer sentiment and market trends. Effective communication methods to enhance engagement with users are also crucial. However, addressing these issues individually requires considerable effort and time, placing a significant burden on artists. Therefore, there is a need for solutions that analyze the characteristics of works and automate emotion-based strategies to address these challenges.
[0867] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0868] In this invention, the server includes means for analyzing information on works of art and proposing sales strategies, means for identifying user emotions and constructing strategies, and means for automatically generating content that stimulates dialogue within the user community. This enables artists to efficiently conduct promotions that meet market needs and to automatically provide content that deepens relationships with users.
[0869] A "work of art" refers to a visual or other sensory-oriented work created using creative ideas and techniques.
[0870] "Information" is an organized collection of data, facts, or knowledge that has value or meaning for a particular purpose.
[0871] An "artificial intelligence algorithm" refers to a set of programs and methods that computer systems use to analyze data and perform specific tasks through learning.
[0872] A "sales strategy" refers to a plan or method for distributing a particular product or service to the market and encouraging consumers to purchase it.
[0873] A "consumer segment" refers to a group of people who have an interest in and purchasing power for a particular product or service, and is also known as a target market.
[0874] "Foundation" refers to the basic elements or infrastructure necessary for achieving a specific purpose or activity.
[0875] "Time" refers to a specific timing or period during which a particular activity or event should take place.
[0876] "Content" refers to text or media that contains information or messages related to a specific theme or purpose.
[0877] A "user community" refers to a group or network of people who are interested in and involved with a particular product or service.
[0878] "Opportunity" refers to a situation in which favorable circumstances or conditions are in place to achieve a goal.
[0879] A "funding project" refers to an organized effort to raise the necessary funds for a specific business or purpose.
[0880] "Operational support" refers to providing the assistance and support necessary for the planning, implementation, and management of a specific project or activity.
[0881] "Proposal materials" refer to documents or other media used to explain a specific proposal or idea in detail.
[0882] "Market information" refers to data concerning products, consumer trends, and the competitive environment in a specific market.
[0883] An "emotion engine" refers to a system that uses natural language processing and data analysis techniques to recognize and analyze an individual's emotions and attitudes.
[0884] A "generative AI model" refers to the structure of artificial intelligence that has the ability to learn from large amounts of data and automatically generate new information and content.
[0885] This invention is a system that analyzes the characteristics of works of art and automates promotional and communication methods tailored to consumer emotions. The terminal is responsible for sending data of user-created works of art to the server. The server uses artificial intelligence algorithms such as TensorFlow and PyTorch, which are deep learning frameworks, to analyze the received data. This allows for the analysis of the visual features and concepts of the artwork, and the development of a suitable sales strategy.
[0886] Subsequently, the server uses an emotion engine to collect emotion data from the user's past activities and social media posts, and analyzes the emotions using natural language processing tools such as NLTK and spaCy. This identifies the emotions the user is experiencing, and based on that information, promotional methods are developed.
[0887] Furthermore, the server uses a generative AI model to automatically generate emotion-based content and provide material to facilitate communication with users. In this process, the generative AI model can be guided using prompts. For example, a prompt might be, "Create a social media post based on a theme that will please the user."
[0888] For example, if a user starts a new painting project with an autumn theme, this information is uploaded to the server. The server analyzes the artwork's colors and theme and identifies a target audience based on similar successful examples. As a prompt, the user might be instructed to "Generate a social media post using words that evoke the warmth of autumn," and the AI model would automatically generate content accordingly.
[0889] By leveraging this automatically generated content and sales strategies, users can efficiently appeal to the market and deepen relationships with their customers. In the case of crowdfunding, the server can generate materials that evoke empathy for the project's vision, thereby facilitating fundraising.
[0890] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0891] Step 1:
[0892] Users upload their artwork data from their device to the server. This data is entered and sent to the server. Specifically, the user uses a dedicated application on their device or a web interface to select image files and text data and presses the "Upload" button. This saves the artwork data to the server's storage system.
[0893] Step 2:
[0894] The server receives the uploaded artwork data and passes it as input to a deep learning framework. The server uses TensorFlow or PyTorch to analyze the visual features and concepts of this data. This analysis yields the visual characteristics and themes of the artwork as output. This generates the basic data for a concrete sales strategy.
[0895] Step 3:
[0896] The server receives text data collected from the user's past activity history and social media as input via an emotion engine. The emotion engine uses natural language processing tools (such as NLTK and spaCy) to analyze this data and generate emotion information as output. Specifically, the server uses SNS APIs to collect data and processes it with the emotion engine to identify the user's emotions.
[0897] Step 4:
[0898] The server uses a generative AI model and takes a prompt as input. Based on this prompt, the generative AI model outputs content that corresponds to emotion. Specifically, the server provides the model with a prompt such as "Generate an emotionally moving social media post," and the model automatically generates appropriate post content.
[0899] Step 5:
[0900] The server provides automatically generated content to users, which can then be used for sales strategies or communication with users. Users utilize the generated content and analysis results as output when developing strategies to appeal to the market. Specifically, users review the generated content and then post it on social media or incorporate it into advertising campaigns.
[0901] Step 6:
[0902] In generating crowdfunding materials, the server takes project feedback data as input. Based on the results of analysis by the emotion engine, it outputs proposal materials. Specifically, the server incorporates a storyline that emphasizes the emotions of funders into the proposal and slides. These materials are used in the fundraising presentation.
[0903] (Application Example 2)
[0904] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0905] In contemporary artistic activity, it is difficult for artists to effectively promote their work and build deep connections with their fans. Furthermore, there are insufficient means to accurately understand audience emotions and provide personalized advertising and content accordingly. A system is needed to address these challenges.
[0906] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0907] This invention includes a server that provides means for proposing an appropriate promotional strategy using a machine learning model that analyzes information and characteristics of works of art, means for recognizing users' emotions in real time and generating and displaying relevant advertisements, and means for generating topics and questions using machine learning to stimulate the flow of dialogue within fan groups. This makes it possible to enhance artists' promotional activities, achieve close communication with fans, and personalize information dissemination based on emotions.
[0908] A "work of art" is something that possesses visual or expressive value and is created by an individual creator.
[0909] "Information" refers to data, knowledge, and news related to the subject matter.
[0910] A "machine learning model" is a set of algorithms that automatically learn patterns from data and perform specific tasks.
[0911] "Advertising strategy" refers to the plans and methods used to effectively spread awareness of a particular product or service in the market.
[0912] A "target group" is a collection of people who are classified into a specific market segment as consumers of a product or service.
[0913] A "medium" refers to a means or channel for transmitting information.
[0914] A "user" refers to an individual or group that uses a particular product or service.
[0915] "Emotions" refer to the psychological states of humans, specifically internal feelings such as joy and sadness.
[0916] "Advertising" is an information dissemination activity conducted to make people aware of the existence of a product or service.
[0917] A "fan group" is a group of people who are interested in and support a particular artist or content.
[0918] "The flow of a conversation" refers to the progression of a discussion or the pattern of how a conversation unfolds in human communication.
[0919] "Topic introduction" refers to facilitating communication by indicating a central theme or topic in a dialogue or discussion.
[0920] A "question" is the act of posing a problem to someone for the purpose of gathering information or confirming details.
[0921] The system for carrying out the present invention consists of the following hardware and software. The main hardware used is a user-wearable smart device, particularly smart glasses, which collects the user's facial expressions and voice data using cameras and microphones mounted on them. The server uses TensorFlow as a machine learning framework and implements an emotion recognition model for analyzing the collected data.
[0922] The smart glasses, acting as a device, have the ability to visually display advertisements generated from analysis results through an AR (augmented reality) interface powered by Unity. The server automatically generates relevant advertisements that the user might be interested in, based on sentiment data obtained by a machine learning model and utilizing an algorithm programmed in Python.
[0923] For example, if a user is viewing a particular artwork in a museum, the server recognizes the user's emotions towards that artwork in real time. Based on this emotion data, the server generates advertisements containing information about similar artworks and events, and displays them in augmented reality (AR) on smart glasses. In this way, users can instantly connect their emotional experiences to related event information, increasing their desire to participate.
[0924] By utilizing a generative AI model, it is possible to automatically generate prompt messages based on specific emotions. For example, by inputting the sentence, "When a user is moved by a sculpture, generate an advertisement for the next exhibition related to that sculpture," into the model, it is possible to quickly generate appropriate advertising content. Thus, the present invention is a system that recognizes user emotions in real time and enables promotions tailored to individual needs.
[0925] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0926] Step 1:
[0927] The user wears smart glasses and views works of art in a museum or other location. The camera and microphone of the smart glasses, acting as a terminal, record and collect the user's facial expressions and voice data in real time. This becomes the input data.
[0928] Step 2:
[0929] The device compresses the collected facial expression and voice data and sends it to the server. The server analyzes the received input data using an emotion recognition model based on TensorFlow. This allows it to recognize the user's real-time emotional state as output.
[0930] Step 3:
[0931] The server generates relevant prompt sentences based on the emotion recognition results and uses these prompt sentences as input to the generation AI model. Specifically, it prepares prompt sentences containing keywords and stories to automatically generate advertising content related to works that the user found moving.
[0932] Step 4:
[0933] The generative AI model analyzes the input prompt text and generates advertisements that match the user's emotional state. The resulting advertisement data is then converted back into an AR display format on the server.
[0934] Step 5:
[0935] The server sends the generated advertisement to the device. The smart glasses visually display the advertisement in the user's field of view via an AR interface using Unity. This allows the user to receive information about related events and works in real time.
[0936] This system allows users to instantly receive promotional information tailored to their individual emotions while viewing art.
[0937] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0938] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0939] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.
[0940] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[0941] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.
[0942] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.
[0943] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.
[0944] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.
[0945] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."
[0946] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.
[0947] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.
[0948] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.
[0949] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.
[0950] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[0951] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.
[0952] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.
[0953] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.
[0954] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.
[0955] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.
[0956] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.
[0957] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.
[0958] The following is further disclosed regarding the embodiments described above.
[0959] (Claim 1)
[0960] A means of proposing an appropriate promotional strategy using an artificial intelligence model that analyzes data on works of art and analyzes their characteristics,
[0961] Based on the analysis results, we will identify suitable target groups and determine effective information dissemination platforms and timings.
[0962] A means of automatically generating content to promote communication with fans and providing a platform for interaction to form a fan community,
[0963] A means of supporting the planning of crowdfunding projects and generating presentation materials for effective fundraising,
[0964] A means of analyzing market data and optimizing the pricing of works,
[0965] A system that includes this.
[0966] (Claim 2)
[0967] The system according to claim 1, comprising means for receiving artwork data from users and automatically analyzing it using artificial intelligence for appropriate promotion.
[0968] (Claim 3)
[0969] The system according to claim 1, comprising means using artificial intelligence to automatically generate topics and questions for revitalizing the flow of dialogue within a fan community.
[0970] "Example 1"
[0971] (Claim 1)
[0972] A means of proposing an appropriate advertising strategy using an information processing device that analyzes data on works of art and analyzes their characteristics,
[0973] Based on the analysis results, a means to identify suitable target groups and determine the foundation and timing for effective information dissemination,
[0974] A means of automatically generating information to facilitate communication with interested individuals and providing a platform for interaction to form groups of interested individuals,
[0975] A means to support the planning of funding projects and generate reports for effective fundraising,
[0976] A means of analyzing past information and optimizing the value setting of a work,
[0977] A system that includes this.
[0978] (Claim 2)
[0979] The system according to claim 1, comprising means for receiving artwork data from users and automatically analyzing it using an information processing device, for the purpose of appropriate promotion.
[0980] (Claim 3)
[0981] The system according to claim 1, comprising means using an information processing device that automatically generates topics and questions to stimulate the flow of dialogue among a group of interested individuals.
[0982] "Application Example 1"
[0983] (Claim 1)
[0984] A method for proposing appropriate advertising strategies using an artificial intelligence model that analyzes data on works of art and analyzes their characteristics,
[0985] Based on the analysis results, a means to identify suitable recipient groups and determine the appropriate media and timing for effective information dissemination,
[0986] A means of automatically generating advertising content to facilitate communication between artists and audiences, and executing optimized promotions through a user interface,
[0987] A means of analyzing market information to generate advertising visuals and descriptive text that improve awareness of works of art,
[0988] A system that includes this.
[0989] (Claim 2)
[0990] The system according to claim 1, comprising means for receiving artwork data from users using a smartphone and automatically analyzing it using artificial intelligence.
[0991] (Claim 3)
[0992] The system according to claim 1, comprising means for automatically generating catchphrases and visuals for an advertising campaign using a generative AI model.
[0993] "Example 2 of combining an emotion engine"
[0994] (Claim 1)
[0995] A means of proposing an appropriate sales strategy using an artificial intelligence algorithm that analyzes information about works of art and analyzes their characteristics,
[0996] Based on the analysis results, we will identify suitable consumer segments and determine the basis and timing for effective information sharing.
[0997] A means of automatically generating content to facilitate communication with users and providing opportunities for interaction to form a user community,
[0998] A means of generating proposal documents to support the operation of funding projects and to effectively raise funds,
[0999] A means of analyzing market information and optimizing the pricing of works,
[1000] A means of identifying users' emotions using an emotion engine and building strategies based on that,
[1001] A method for automatically generating emotion-based content by utilizing a generation AI model with prompts,
[1002] A system that includes this.
[1003] (Claim 2)
[1004] The system according to claim 1, comprising means for receiving artwork information from users and automatically analyzing it using artificial intelligence for appropriate sales.
[1005] (Claim 3)
[1006] The system according to claim 1, comprising means using artificial intelligence to automatically generate topics and questions for revitalizing the flow of dialogue in user society.
[1007] "Application example 2 when combining with an emotional engine"
[1008] (Claim 1)
[1009] A method for proposing appropriate advertising strategies using machine learning models that analyze information about works of art and analyze their characteristics,
[1010] Based on the analysis results, a means to identify a suitable target group and determine the effective media and timing for information dissemination,
[1011] A means for recognizing user emotions in real time and generating and displaying relevant advertisements based on those emotions,
[1012] A means of generating content to promote interaction with fans and providing a platform for interaction to form a fan community,
[1013] A means to support the planning of fundraising projects and generate materials for effective fundraising,
[1014] A means of analyzing market information and optimizing the pricing of works,
[1015] A system that includes this.
[1016] (Claim 2)
[1017] The system according to claim 1, comprising means for recognizing the user's emotions and displaying relevant advertisements on the user's device.
[1018] (Claim 3)
[1019] The system according to claim 1, comprising means of using machine learning to generate topics and questions for activating the flow of dialogue within a group of fans. [Explanation of symbols]
[1020] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>
Claims
1. A method for proposing appropriate advertising strategies using an artificial intelligence model that analyzes data on works of art and analyzes their characteristics, Based on the analysis results, a means to identify suitable recipient groups and determine the appropriate media and timing for effective information dissemination, A means of automatically generating advertising content to facilitate communication between artists and audiences, and executing optimized promotions through a user interface, A means of analyzing market information to generate advertising visuals and descriptive text that improve awareness of works of art, A system that includes this.
2. The system according to claim 1, comprising means for receiving artwork data from users using a smartphone and automatically analyzing it using artificial intelligence.
3. The system according to claim 1, comprising means for automatically generating catchphrases and visuals for an advertising campaign using a generative AI model.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A