system

Abstract

Provide a system. A means for company personnel to register promotion proposals; A way for users to add a company's account as a friend and create a personal profile; means for matching the promotion proposal with the user's profile and delivering an optimized promotion to the user; A means for an advertiser to send advertisements to premium members, and for premium members to earn rewards by viewing the advertisements; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Current marketing methods require companies to take the time and effort of registering promotion ideas, and it is difficult to deliver promotions that are individually optimized for each user. This makes it difficult to implement effective promotions, resulting in a decline in marketing effectiveness. Furthermore, general marketing systems do not incorporate mechanisms for delivering advertisements to premium members and earning rewards for viewing them. This creates the issue of a lack of motivation to keep users interested and actively watch advertisements. [Means for solving the problem]

[0005] To solve the above problems, the present invention provides the following means: A means is provided for company personnel to easily register promotion proposals, and a means is provided for users to register as friends on the company's account and automatically create individual profiles. Furthermore, a system is provided that includes a means for matching registered promotion proposals with user profiles and automatically delivering promotions optimized for users. Additionally, a means is provided for advertisers to send advertisements directly to premium members, who can earn rewards by viewing those advertisements, thereby attracting user interest and encouraging active viewing of advertisements. In this way, efficient and effective marketing activities can be realized, enhancing the marketing effectiveness of companies and providing valuable services to users.

[0006] "Person in Charge" refers to an employee within a company who is responsible for marketing and promotional activities.

[0007] "Promotion plan" refers to the details of a plan for a campaign, advertisement, etc. that a company will implement to promote sales.

[0008] "Users" are individuals or consumers who register as friends on a company's official account and use the service.

[0009] A "profile" is a data set that aggregates personal information about a user, such as gender, age, interests, and purchase history.

[0010] "Matching" refers to the process of delivering the most suitable promotion to a specific user based on the promotion proposal registered by the company and the user's profile.

[0011] An "optimized promotion" is a promotion that is customized to best suit a user based on that user's profile information.

[0012] "Advertiser" means a company or individual that posts advertisements and delivers them to users for the purpose of promoting their own products or services.

[0013] "Premium Membership" means a paid or special membership that entitles you to additional benefits or rewards for certain Services.

[0014] "Advertisement" means a media message intended to convey information about a product, service, campaign, etc. to users.

[0015] "Viewing" refers to the action of a user viewing a delivered advertisement for a certain period of time.

[0016] A "reward" is an incentive, points, or monetary benefit given to a user for viewing an advertisement. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] This invention is a system that allows company personnel to easily register promotion ideas and deliver optimized promotions to users. In addition, premium members can earn rewards by viewing advertisements. An embodiment of this system will be described.

[0039] System Configuration

[0040] 1. Server

[0041] The server is the core system that registers promotion ideas, manages the database, analyzes user profiles, matches promotions with advertisements, and distributes them.

[0042] 2. Terminal

[0043] The terminal is a device (such as a smartphone or PC) that acts as an interface between the company's representative and the user. This allows the representative to register promotion ideas, and the user to add friends and watch advertisements.

[0044] 3. Users

[0045] Users are consumers who add a company's official account as a friend and create individual profiles. In particular, premium members can watch advertisements and earn rewards.

[0046] Program processing

[0047] 1. Promotion proposal registration

[0048] The terminal provides a screen for the company's representative to input details of the promotion proposal. When the representative inputs the promotion proposal and presses the send button, the data is sent to the server.

[0049] The server analyzes the received promotion data and stores it in a database.

[0050] 2. User data collection and profiling

[0051] When a user adds a company's official account as a friend, the device prompts them to enter basic data (gender, age, interests).

[0052] The device sends the collected data to a server, which then creates a user profile based on that data.

[0053] 3. Promotion Matching and Delivery

[0054] The server matches registered promotion ideas with user profiles. For example, a summer sale campaign aimed at women in their 20s matches a profile of a 20-year-old woman.

[0055] When a match is made, the server delivers the promotion to the user's device, and the device displays a notification to the user.

[0056] 4. Delivery of advertisements to premium members and rewards

[0057] The server checks the activity status of premium members and delivers advertisements from advertisers to active premium members.

[0058] When a user views an advertisement, the terminal sends a viewing completion signal to the server, which then confirms the signal.

[0059] The server calculates the reward based on the viewing completion information and adds the reward information to the user profile.

[0060] Specific examples

[0061] 1. Example of promotion proposal registration

[0062] A company representative registers a summer sales campaign, for example, by entering information such as "Summer sale, July 1st to July 31st, for women in their 20s, discount coupon" into the terminal.

[0063] This data is sent to a server and stored in a database.

[0064] 2. Example of a User Profile

[0065] A 20-year-old female user adds a friend and lists "fashion" and "beauty" as her interests.

[0066] The server uses this information to generate a user profile.

[0067] 3. Examples of promotional distribution

[0068] The server matches the "Summer Sale Campaign" to this user.

[0069] The device will send the user a "Summer Sale Announcement" notification and display details within the app.

[0070] 4. Examples of Ad Viewing and Rewards

[0071] A 20-year-old female premium member watches an advertisement for a new cosmetic product.

[0072] The server checks the viewing completion information and awards reward points to the user.

[0073] In this way, businesses can efficiently promote themselves, users can receive information that matches their interests, and enjoy the benefits of premium membership.

[0074] The processing flow will be explained below.

[0075] Step 1: Submit your promotion proposal

[0076] The terminal displays a login screen to the company's personnel and prompts them to enter their authentication information.

[0077] The terminal transmits the entered authentication information to the server.

[0078] The server verifies the credentials and allows the agent to log in.

[0079] The device displays a form that asks the person in charge to enter details of the promotion proposal (campaign name, period, target audience, content).

[0080] The person in charge enters the details of the promotion proposal and presses the send button.

[0081] The terminal transmits the input promotion proposal data to the server.

[0082] The server checks the received promotion data and stores it in a database.

[0083] The server notifies the terminal that saving to the database is complete.

[0084] Step 2: Collecting user data and creating profiles

[0085] A user adds a company's official account as a friend.

[0086] The device displays a form that asks the user to enter basic information (gender, age, interests).

[0087] The user enters basic information and presses the submit button.

[0088] The terminal sends the entered basic information to the server.

[0089] The server analyzes the received user data and creates a user profile.

[0090] The server stores the created user profile in a database.

[0091] The server notifies the terminal that the user profile has been saved.

[0092] Step 3: Promotion Matching and Delivery

[0093] The server performs a matching process to match promotion offers with user profiles.

[0094] The server selects users who meet the criteria of the target audience.

[0095] The server creates a promotion distribution list for the selected users.

[0096] The server sends the promotion proposal to the selected users.

[0097] The terminal displays the promotion notification to the user and provides a screen for displaying more information.

[0098] Step 4: Delivering ads to premium members and rewarding them

[0099] The server periodically checks the activity status of premium members.

[0100] Advertisers register details of their advertising campaigns with the server.

[0101] The server matches the premium member's profile with the advertiser's targeting criteria.

[0102] The server creates an advertisement distribution list for premium members who match the target.

[0103] The server distributes advertisements to selected premium members.

[0104] The device will display a notification to the premium member that they have viewed an ad and provide a link to the ad's details page.

[0105] The user watches the advertisement and presses the "Complete viewing" button.

[0106] The terminal transmits a viewing completion signal to the server.

[0107] The server checks the advertisement viewing completion information and gives a reward to the premium member's account.

[0108] The server notifies the terminal that the reward has been granted.

[0109] Example 1

[0110] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0111] Today's businesses need to effectively promote their target users and increase user engagement, but traditional methods involve uniform distribution of promotions and advertisements, making it difficult to optimize for each individual user. Furthermore, managing the rewards that premium members receive for viewing advertisements is also time-consuming. There is a need to solve these issues and provide a system that is convenient for both businesses and users.

[0112] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0113] In this invention, the server includes: a means for a company representative to register promotion proposals; a means for a user to register a company account as a friend and create an individual profile by entering basic data; a means for transmitting detailed information about the promotion proposals and for the server to analyze the data and store it in a database; a means for the server to match the promotion proposals with user profiles, deliver the matched promotions to the user terminal and display a notification; and a means for an advertiser to send advertisements to premium members, and for the server to calculate rewards when premium members view the advertisements and add reward information to the profile. This makes it possible to individually optimize and deliver company promotion proposals to target users and automatically manage rewards for viewing advertisements for premium members.

[0114] "Company representative" refers to a person in a company who is responsible for creating and managing promotion proposals.

[0115] "Promotion Proposal" means detailed information about a plan or campaign aimed at promoting a product or service.

[0116] "Friend registration" refers to the act of a user following an official account, enabling two-way communication.

[0117] "Basic data" refers to individual information about a user, such as their gender, age, and interests.

[0118] An "individual profile" is individual characteristic information based on a user's basic data and behavioral history.

[0119] "Server" means a computer system that stores, analyzes data, and matches promotional offers with user profiles.

[0120] A "database" is an information collection system for storing and managing promotional ideas and user profile data.

[0121] "Matching" refers to the process of matching promotion ideas with user profiles.

[0122] "User terminal" refers to the interface device used by the user (e.g., smartphone, personal computer).

[0123] "Notification" means a message sent to a User to inform them of promotional information.

[0124] "Advertiser" means an individual or entity that pays compensation to advertise a product or service.

[0125] A "premium membership" is a paid membership that allows you to enjoy more benefits and additional features than regular users.

[0126] "Ad viewing" means the act of a user visually or audibly viewing the transmitted advertising content.

[0127] "Rewards" refer to points or benefits provided based on user actions such as watching advertisements.

[0128] This invention is a system that allows company personnel to easily register promotion ideas and deliver optimized promotions to users. In addition, premium members can earn rewards by viewing advertisements. The following describes in detail the embodiments for implementing this system.

[0129] System Configuration

[0130] 1. Server

[0131] Role: The server is the core system that registers promotion ideas, manages the database, analyzes user profiles, matches promotions and advertisements, and distributes them.

[0132] Software used: MySQL (registered trademark) (database management), Python (data analysis), HTTP server (request processing)

[0133] 2. Terminal

[0134] Role: A terminal is a device (e.g., smartphone, PC) that acts as an interface between company personnel and users.

[0135] Software used: Web browser (interface provided), HTTP client (data transmission)

[0136] 3. Users

[0137] Role: Users are consumers who add a company's official account as a friend and create a personalized profile. Premium members, in particular, can watch ads and earn rewards.

[0138] Program processing

[0139] Promotion proposal registration

[0140] Company representative actions: The company representative enters details of the promotion proposal on the terminal.

[0141] Server processing: The device sends the entered promotion proposal to the server via an HTTP POST request, and the server analyzes this data and stores it in a database.

[0142] Example: A company representative inputs a promotional idea such as "Summer sale, July 1st to July 31st, for women in their 20s, discount coupon" into a terminal and sends it.

[0143] User Data Collection and Profiling

[0144] User behavior: A user adds a company's official account as a friend and enters basic data (gender, age, interests).

[0145] Server processing: The device sends the collected data to the server via an HTTP POST request, and the server creates a user profile based on that data and stores it in a database.

[0146] Example: A 20-year-old female user registers as a friend and enters her gender, age, and interests in "fashion" and "beauty."

[0147] Promotion Matching and Delivery

[0148] Server process: The server matches the promotion proposal with the user profile. If the conditions are met, the promotion is sent to the user's device and a notification is displayed.

[0149] Example: The server matches a "Summer Sale Campaign" to a 20-year-old female user, and the device displays a notification as a "Summer Sale Announcement."

[0150] Delivery of advertisements and rewards for premium members

[0151] Server processing: The server checks the activity status of the premium member and sends advertisements. When the user watches the advertisement, it sends a completion signal to the server, calculates the reward, and adds the reward information to the user profile.

[0152] Example: A 20-year-old female premium member watches an advertisement for a new cosmetic product, a viewing completion signal is sent to the server, and reward points are added to her profile.

[0153] Prompt Sentence Examples

[0154] Below are some example prompts that the system uses in its generative AI model:

[0155] "Please enter the details of your promotion idea. Example: Summer sale, July 1st to July 31st, for women in their 20s, discount coupon."

[0156] "Please enter your basic information. For example: Gender: Female, Age: 20, Interests: Fashion, Beauty"

[0157] In this way, companies can efficiently promote themselves, users can receive information that matches their interests, and enjoy the benefits of being a premium member.

[0158] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0159] Specific steps of the program's processing

[0160] Step 1: Enter your promotion idea

[0161] Company representative actions: The company representative enters details of the promotion proposal on the terminal.

[0162] Input: Promotion name, start date, end date, target user, and promotion details

[0163] What happens: The terminal displays the details entered based on the form, and the agent fills in these details. Once the agent has finished entering the information, he clicks the submit button.

[0164] Output: Promotion data collected by the device

[0165] Step 2: Submit and save your promotion proposal

[0166] Device action: The device sends a promotion proposal to the server.

[0167] Input: Promotion data collected in step 1

[0168] Specific operation: The device makes an HTTP POST request and sends the promotion data to the server.

[0169] Output: Promotion data received by the server

[0170] Step 3: Analyze and save promotion ideas

[0171] Server Actions: The server analyzes the promotion data received and stores it in a database.

[0172] Input: Promotion data received in step 2

[0173] What happens: The server parses the data using a data parsing script (e.g. Python) and converts it into an appropriate format. It then stores the parsed data in a database (e.g. MySQL).

[0174] Output: Promotion data stored in a database

[0175] Step 4: Add users as friends and enter basic data

[0176] User behavior: A user adds a company's official account as a friend and enters basic data (gender, age, interests).

[0177] Input: User's gender, age, interests

[0178] What happens: The device displays a friend registration button, and when the user clicks it, a basic data entry form appears. The user fills in the information in each field and clicks the submit button.

[0179] Output: User data collected by the device

[0180] Step 5: Submitting user data and creating a profile

[0181] Device action: The device sends user data to the server.

[0182] Input: User data collected in step 4

[0183] Specific operation: The device makes an HTTP POST request and sends user data to the server, which receives and analyzes the data.

[0184] Output: Server generates profile data

[0185] Step 6: Save your profile data

[0186] Server actions: The server creates a profile based on the analyzed user data and stores it in a database.

[0187] Input: Profile data generated in step 5

[0188] Specific operation: The server analyzes user data, generates a profile, and stores the profile in a database.

[0189] Output: User profile stored in the database

[0190] Step 7: Matching promotions to user profiles

[0191] Server Action: The server matches promotion ideas with user profiles.

[0192] Input: Promotion ideas and user profiles stored in the database

[0193] What happens: The server runs an SQL query to find user profiles that match the promotion offer.

[0194] Output: Matching result data

[0195] Step 8: Promotion Delivery and Notification

[0196] Server Action: The server delivers the matched promotion to the user device.

[0197] Input: Matching result data generated in step 7

[0198] Specific operation: The server generates a notification message and sends it to the device via an HTTP PUSH request. The device displays the push notification.

[0199] Output: Notification message displayed on the terminal

[0200] Step 9: Check your Premium Membership Activity

[0201] Server Action: The server checks the activity status of premium members.

[0202] Input: Premium member data stored in the database

[0203] What it does: The server periodically checks the database to generate a list of active premium members.

[0204] Output: Active members list

[0205] Step 10: Serving Ads

[0206] Server Action: The server delivers ads to active premium members.

[0207] Input: Active Member List generated in Step 9

[0208] Specific operation: The server retrieves advertising content from the advertising database and sends it to the device via an HTTP PUSH request.

[0209] Output: Ad displayed on device

[0210] Step 11: Record your ad views and rewards

[0211] User action: The user watches the ad and sends a completion signal to the server.

[0212] Input: Information about the ad the user watched

[0213] Specific operation: When the user clicks the "Complete" button on the device, the completion information is sent to the server via an HTTP POST request. The server analyzes the completion data, calculates the reward, and adds it to the user's profile.

[0214] Output: Added reward information

[0215] (Application example 1)

[0216] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0217] Conventional promotion systems lack real-time and interactivity in the means of appropriately matching and delivering promotions registered by company personnel to users. Additionally, incentives for premium members who earn rewards by viewing advertisements are limited, making it difficult to deliver advertisements that effectively match users' interests.

[0218] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0219] In this invention, the server includes a means for a company representative to register promotion proposals, a means for a user to register a company account as a friend and create an individual profile, a means for matching the promotion proposals with the user profile and delivering promotions optimized for the user, a means for an advertiser to send advertisements to premium members and for premium members to earn rewards by viewing the advertisements, a means for displaying the optimized advertisements on the smart device in real time, and a means for displaying detailed information through the smart device in response to user operations, thereby enabling advertisement delivery that is both real-time and interactive.

[0220] "Company Representative" means an individual or group of individuals within a Company who are responsible for organizing and registering a Promotion.

[0221] A "Promotion Proposal" is detailed information about a campaign that a company plans and registers to promote a particular product or service.

[0222] A "user" is a consumer who adds a company's account as a friend, creates a personal profile, and receives its promotions and advertisements.

[0223] A "profile" is an individual data set created based on a user's basic information, interests, and behavioral data.

[0224] "Matching" is the process of comparing registered promotion proposals with a user's profile and selecting an appropriate promotion based on matching factors.

[0225] A "premium member" is a user who, unlike a regular user, has the privilege of earning rewards by watching certain advertisements.

[0226] A "smart device" is an electronic device that can communicate and process information when worn or used by a user, and includes smart glasses and smartphones.

[0227] "Real-time" is a temporal concept that indicates near-instant processing or delivery without delay.

[0228] "Operation" means input or instruction given by a user using a device, including, for example, tapping, swiping, or eye movement.

[0229] This invention is a system that uses smart devices to deliver corporate promotional ideas to users in real time, providing an interactive advertising experience.

[0230] System Configuration

[0231] 1. Server

[0232] Hardware and software: The server uses a database management system (e.g., MySQL) and a program execution environment (e.g., Python). The server receives promotion proposals registered by company personnel, stores the data in a database, and manages them. It also analyzes user profiles and is responsible for matching and delivering promotions and advertisements.

[0233] 2. Terminal

[0234] Hardware and software: The device is the interface with the user (e.g., smart glasses, smartphone, PC). The device has the smart glasses SDK (e.g., Google® Glass® API) and a mobile app installed, where company representatives input promotion ideas and users register as friends and watch ads.

[0235] Program Processing

[0236] 1. Promotion proposal registration

[0237] Server: The server receives the promotion proposal data sent by the company representative and stores it in a database.

[0238] Terminal: The terminal provides a screen where company personnel can enter details of their promotion proposal.

[0239] 2. User data collection and profiling

[0240] Terminal: The terminal provides the user with an input screen where they can enter basic data (gender, age, interests).

[0241] Server: The server receives user data sent from the device and creates a user profile based on that data.

[0242] 3. Promotion Matching and Delivery

[0243] Server: The server matches registered promotion ideas with user profiles and selects appropriate promotions.

[0244] Terminal: The terminal delivers ads optimized for the user's smart device in real time, allowing the user to interact with the ads through the device.

[0245] 4. Delivery of advertisements to premium members and rewards

[0246] Server: The server checks the activity status of premium members, delivers ads to active premium members, and verifies the completion of ad viewing and awards reward points to users.

[0247] Device: When a user watches an ad, it sends a viewing completion signal to the server and checks the status of reward points awarded.

[0248] Specific examples

[0249] 1. Example of promotion proposal registration

[0250] Company representative: Register a promotional proposal that reads, "Autumn / Winter collection on sale from October 1st to October 31st, aimed at women in their 20s."

[0251] Server: Stores this information in a database.

[0252] 2. Example of a User Profile

[0253] User: A 25-year-old woman who is interested in fashion adds the user as a friend.

[0254] Server: Generates a user profile based on this input information.

[0255] 3. Examples of promotional distribution

[0256] Server: Matches registered Fall / Winter collection promotions to the appropriate user profile.

[0257] Device: Smart glasses display "Autumn / Winter Collection Now On Sale!" and display advertisement details based on eye and head movements.

[0258] 4. Examples of Ad Viewing and Rewards

[0259] User: Habit, a 25-year-old female premium member watches an advertisement for a new cosmetic product.

[0260] Server: Checks the viewing completion information and awards reward points.

[0261] Prompt Sentence Examples

[0262] "Generate the best promotional text to send to a 25-year-old female user who is interested in fashion, offering a 10% discount on new gloves."

[0263] Such a system allows businesses to carry out effective promotional activities, allows users to interactively experience advertisements tailored to their interests, and allows them to receive rewards.

[0264] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0265] Step 1:

[0266] [Register promotion proposal]

[0267] Input: A company representative inputs a promotion proposal (e.g., "Fall / Winter collection release, October 1st to October 31st, for women in their 20s")

[0268] Operation: The terminal provides an interface that allows company personnel to input details of promotion proposals and transmits the input data to a server.

[0269] Output: The server receives the promotion proposals and stores them in a database.

[0270] Data processing / calculation: The content of the promotion proposal is analyzed and stored in the database in an appropriate format.

[0271] Step 2:

[0272] [User Data Collection and Profiling]

[0273] Input: User basic data (gender, age, interests)

[0274] How it works: The device provides the user with an interface for registering friends and prompts them to enter basic information.

[0275] Output: Basic data is sent to the server and a user profile is created.

[0276] Data processing / calculation: Based on the entered user data, the server organizes and saves the user profile in a format suitable for storing in the database.

[0277] Step 3:

[0278] [Promotion Matching and Delivery]

[0279] Input: Promotion idea and user profile

[0280] How it works: The server retrieves promotion ideas and user profiles from the database and performs matching using the corresponding algorithm.

[0281] Output: Matched promotions are sent to the user's device.

[0282] Data processing / calculation: The server selects the most suitable promotions based on the user profile interests and past behavioral data, and delivers this information to the user's smart device in real time.

[0283] Step 4:

[0284] [Real-time ad display and interaction]

[0285] Input: Matched promotion data

[0286] How it works: The device displays ads in real time on smart glasses or smartphones and accepts user interaction. Users can view the details of the ads through the device.

[0287] Output: The ad content is displayed to the user, and further details are displayed based on the user's actions.

[0288] Data processing / calculation: Data is updated in real time to display detailed information in response to user input.

[0289] Step 5:

[0290] [Premium member activity check, ad delivery, and rewards]

[0291] Input: Premium member status data, ad viewing data

[0292] How it works: The server checks the activity status of premium members and delivers ads to active members. When a user watches an ad, the completion data is sent to the server, which calculates the reward and reflects it in the profile.

[0293] Output: Reward information added to premium member profile.

[0294] Data processing / calculation: The server calculates rewards based on the viewing completion data and reflects them as reward points in the user profile.

[0295] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0296] This invention achieves a higher level of personalization by combining an emotion engine with a system that allows company personnel to easily register promotion ideas and deliver optimized promotions to users. In addition, premium members can earn rewards by viewing advertisements. A specific embodiment of this system will now be described.

[0297] System Configuration

[0298] 1. Server

[0299] The server plays a central role in registering promotion ideas, managing the database, analyzing user profiles, matching and delivering promotions and advertisements, and processing emotional data using an emotion engine.

[0300] 2. Terminal

[0301] The terminal is an interface between company representatives and users. Representatives use the terminal to register promotion ideas, and users register friends, watch advertisements, and provide emotional data.

[0302] 3. Users

[0303] Users are individuals who add a company's official account as a friend and receive promotional information and advertisements. In particular, premium members can earn rewards by watching advertisements.

[0304] 4. Emotion Engine

[0305] The emotion engine is a component that analyzes the user's facial expressions, tone of voice, and text emotions to collect real-time emotional data from the user.

[0306] Program processing

[0307] 1. Promotion proposal registration

[0308] The terminal displays a login screen to the company representative and asks them to enter their authentication information. After the representative logs in, they are provided with a form to enter details of the promotion proposal (campaign name, period, target audience, content).

[0309] The person in charge enters a promotion proposal and presses the send button. The terminal sends the entered promotion proposal data to the server, which then stores the data in a database.

[0310] 2. User data collection and profiling

[0311] When a user registers as a friend on a company's official account, the device displays a form for entering basic information (gender, age, interests, etc.) Once the user enters the information and presses the submit button, the device sends the data to the server.

[0312] The server analyzes the user data, creates a user profile, and stores it in a database.

[0313] 3. Promotion Matching and Delivery

[0314] The server performs a matching process to match the promotion proposal with user profiles, selects users who meet the matching criteria, and creates a promotion distribution list for the selected users.

[0315] The server will distribute the promotion proposal to the selected users, and the device will display a notification to the users, allowing them to check the details.

[0316] 4. Delivery of advertisements to premium members and rewards

[0317] The server periodically checks the activity status of premium members. Advertisers register details of their advertising campaigns with the server, and the server selects premium members who meet the targeting criteria and creates an advertising distribution list.

[0318] The server distributes advertisements to the selected premium members, and the terminal displays a notice of advertisement viewing to the premium members and provides a link to a detailed page.

[0319] The user watches the ad and notifies the server that they have completed watching. The server then verifies the completion information and credits the reward to the user's account.

[0320] 5. Leveraging Emotional Engines

[0321] The emotion engine recognizes emotions from users' facial expressions, tone of voice, and text. Emotional data is reflected in user profiles and used to match promotions and advertisements.

[0322] For example, if a user looks happy while viewing a promotion, that emotional data is sent to the server and used to improve the accuracy of the next promotion or advertisement.

[0323] Specific examples

[0324] 1. Example of promotion proposal registration

[0325] The person in charge registers a summer sale campaign, for example, "Summer sale, July 1st to July 31st, for women in their 20s, discount coupon," and enters details into the terminal and submits them.

[0326] This data is sent to a server and stored in a database.

[0327] 2. Example of a User Profile

[0328] A 20-year-old female user adds a friend and lists "fashion" and "beauty" as her interests. The emotion engine analyzes the user's facial expressions and detects smiles.

[0329] The server uses this information to generate a user profile and stores it in a database.

[0330] 3. Examples of promotional distribution

[0331] The server matches the "Summer Sale Campaign" with the profile of a 20-year-old female user, taking into account emotional data that indicates the user looks happy.

[0332] The device will send the user a "Summer Sale Announcement" notification and display more information within the app.

[0333] 4. Examples of Ad Viewing and Rewards

[0334] A 20-year-old female premium member watches an advertisement for a new cosmetic product. The emotion engine detects the user's emotions (e.g., excitement, interest) while watching the advertisement.

[0335] The server calculates reward points based on viewing completion information and emotional data and awards them to the user.

[0336] In this way, companies can run effective promotions and users can receive information and rewards that match their interests. By combining this with an emotion engine, a more personalized experience can be provided.

[0337] The processing flow will be explained below.

[0338] Step 1: Submit your promotion proposal

[0339] The terminal displays a login screen to the company's personnel and prompts them to enter their authentication information.

[0340] The terminal transmits the entered authentication information to the server.

[0341] The server verifies the credentials and allows the agent to log in.

[0342] The device displays a form that asks the person in charge to enter details of the promotion proposal (campaign name, period, target audience, content).

[0343] The person in charge enters the details of the promotion proposal and presses the send button.

[0344] The terminal transmits the input promotion proposal data to the server.

[0345] The server checks the received promotion data and stores it in a database.

[0346] The server notifies the terminal that saving to the database is complete.

[0347] Step 2: Add friends and collect basic information

[0348] A user adds a company's official account as a friend.

[0349] The device displays a form that asks the user to enter basic information (gender, age, interests).

[0350] The user enters basic information and presses the submit button.

[0351] The terminal sends the entered basic information to the server.

[0352] The server analyzes the received user data and creates a user profile.

[0353] The server stores the created user profile in a database.

[0354] The server notifies the terminal that the user profile has been saved.

[0355] Step 3: Collect user sentiment data

[0356] The device captures the user's facial expressions and tone of voice in real time.

[0357] The emotion engine analyzes the captured facial expressions and tone of voice to generate emotional data for the user.

[0358] The terminal transmits the generated emotion data to the server.

[0359] The server analyzes the emotional data and adds or updates it to the user profile.

[0360] Step 4: Matching promotions with user profiles

[0361] The server performs a matching process that matches promotion proposals with user profiles and emotion data.

[0362] The server filters the best users based on the target audience criteria and sentiment data.

[0363] The server generates an optimal user list and delivers promotions to the target users.

[0364] Step 5: Serving your promotion

[0365] The server sends the promotion proposal to the selected users.

[0366] The device will display a promotional notification to the user and provide a screen where they can view more information.

[0367] Step 6: Delivering ads to premium members and rewarding them

[0368] The server periodically checks the activity status of premium members.

[0369] Advertisers register details of their advertising campaigns with the server.

[0370] The server compares the profiles and emotion data of the premium members and selects premium members who meet the target conditions.

[0371] The server distributes advertisements to selected premium members.

[0372] The device will display a notification to premium members that they have watched an ad and provide a link to a page with more details.

[0373] The user watches the advertisement and presses the "Complete viewing" button.

[0374] The terminal transmits a viewing completion signal to the server.

[0375] The server checks the advertisement viewing completion information and gives a reward to the premium member's account.

[0376] The server notifies the terminal that the reward has been granted.

[0377] Through this process, companies can efficiently promote themselves, and users can receive information and rewards based on their interests and emotions.

[0378] Example 2

[0379] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0380] Conventional promotion systems not only required a lot of work to match promotion ideas registered by company representatives with user profiles, but the results were often not properly optimized for users. Furthermore, systems that allow premium members to earn rewards by viewing advertisements lacked personalization that took user emotions into account. Therefore, there was a need for more accurate and personalized promotions and ad delivery.

[0381] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for a company representative to register a promotion proposal, a means for a user to register a company account as a friend and create an individual profile, a means for matching the promotion proposal with the user's profile and delivering an optimized promotion to the user, a means for an advertiser to send advertisements to premium members and for the premium members to earn rewards by viewing the advertisements, and a means for collecting user emotion data using an emotion analysis engine and reflecting the data in the profile. This enables personalized promotions and advertisement delivery based on the user's emotions and interests.

[0382] "Company Representative" means the employee responsible for registering promotion proposals and managing the implementation of the campaign.

[0383] A "user" is an individual who adds a company's account as a friend and receives promotional information and advertisements.

[0384] A "promotion proposal" is a proposal that includes details of a campaign to be implemented by a company (campaign name, period, target audience, content).

[0385] A "profile" is individual data that compiles a user's basic information, behavioral data, and interests.

[0386] "Matching" is the process of matching promotion ideas with user profiles and selecting appropriate promotions.

[0387] "Advertiser" means a company that provides advertisements to premium members.

[0388] "Premium members" are special users who can earn rewards by watching advertisements.

[0389] An "emotion analysis engine" is a system that analyzes a user's emotions from facial expressions, tone of voice, and text, and collects data.

[0390] "Rewards" are points and benefits that premium members can earn by watching advertisements.

[0391] "Database" means a system for storing information such as promotion ideas and user profiles.

[0392] This invention achieves a higher level of personalization by combining a sentiment analysis engine with a system that allows company personnel to easily register promotion ideas and deliver optimized promotions to users. In addition, premium members can earn rewards by viewing advertisements. Specific embodiments for implementing this invention are described below.

[0393] System Configuration

[0394] 1. Server

[0395] The server plays a central role in registering promotion ideas, managing the database, analyzing user profiles, matching and delivering promotions and advertisements, and processing emotional data using an emotion analysis engine.

[0396] 2. Terminal

[0397] The terminal is an interface between company representatives and users. Representatives use the terminal to register promotion ideas, and users register friends, watch advertisements, and provide emotional data.

[0398] 3. Sentiment Analysis Engine

[0399] The sentiment analysis engine is a component that analyzes the user's facial expressions, tone of voice, and text sentiment to collect real-time emotional data of the user.

[0400] Program processing

[0401] 1. Promotion proposal registration

[0402] The terminal displays a login screen to the company representative and asks them to enter their authentication information. After the representative logs in, they are provided with a form to enter details of the promotion proposal (campaign name, period, target audience, content).

[0403] When the person in charge inputs a promotion proposal and presses the send button, the terminal transmits the input promotion proposal data to the server, which then stores the data in a database.

[0404] 2. User data collection and profiling

[0405] When a user registers as a friend on a company's official account, the device displays a form for entering basic information (gender, age, interests, etc.) Once the user enters the information and presses the submit button, the device sends the data to the server.

[0406] The server analyzes the user data, creates a user profile, and stores it in a database.

[0407] 3. Promotion Matching and Delivery

[0408] The server performs a matching process to match the promotion proposal with user profiles, selects users who meet the matching criteria, and creates a promotion distribution list for the selected users.

[0409] The server will distribute the promotion proposal to the selected users, and the device will display a notification to the users, allowing them to check the details.

[0410] 4. Delivery of advertisements to premium members and rewards

[0411] The server periodically checks the activity status of premium members. Advertisers register details of their advertising campaigns with the server, and the server selects premium members who meet the targeting criteria and creates an advertising distribution list.

[0412] The server distributes advertisements to the selected premium members, and the terminal displays a notice of advertisement viewing to the premium members and provides a link to a detailed page.

[0413] The user watches the ad and notifies the server that they have completed watching. The server then verifies the completion information and credits the reward to the user's account.

[0414] 5. Utilizing sentiment analysis engines

[0415] The emotion analysis engine recognizes emotions from users' facial expressions, tone of voice, and text. Emotional data is reflected in user profiles and used to match promotions and advertisements.

[0416] For example, if a user looks happy while viewing a promotion, that emotional data is sent to the server and used to improve the accuracy of the next promotion or advertisement.

[0417] Specific examples

[0418] 1. Example of promotion proposal registration

[0419] The person in charge registers a summer sale campaign, for example, "Summer sale, July 1st to July 31st, for women in their 20s, discount coupon," and enters details into the terminal and submits them.

[0420] This data is sent to a server and stored in a database.

[0421] 2. Example of a User Profile

[0422] A 20-year-old female user registers as a friend and lists "fashion" and "beauty" as her interests. The emotion analysis engine analyzes the user's facial expressions and detects smiles.

[0423] The server uses this information to generate a user profile and stores it in a database.

[0424] 3. Examples of promotional distribution

[0425] The server matches the "Summer Sale Campaign" with the profile of a 20-year-old female user, taking into account emotional data that indicates the user looks happy.

[0426] The device will send the user a "Summer Sale Announcement" notification and display more information within the app.

[0427] 4. Examples of Ad Viewing and Rewards

[0428] A 20-year-old female premium member watches an advertisement for a new cosmetic product. The emotion analysis engine detects the user's emotions (e.g., excitement, interest) while watching.

[0429] The server calculates reward points based on viewing completion information and emotional data and awards them to the user.

[0430] Example prompts for generative AI models

[0431] "Female, 20 years old, interests: fashion and beauty. Emotion analysis engine analysis: smiling. Please send me recommended promotion ideas."

[0432] In this way, companies can run effective promotions and users can receive information and rewards that match their interests. By combining it with a sentiment analysis engine, a more personalized experience can be provided.

[0433] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0434] Step 1: Personnel authentication

[0435] The terminal displays a login screen to the company's personnel. When the personnel enters their username and password and presses the send button, the terminal sends the authentication information to the server. The server verifies the authentication information, and if authentication is successful, grants the personnel access permission.

[0436] Input: Username and password of the person in charge

[0437] Data processing: The server verifies the authentication information and obtains the ID of the person in charge

[0438] Output: Authentication result (success or failure), display of the dashboard for the person in charge if authentication is successful

[0439] Specific operation: When the person in charge presses the login button, the message "Sending authentication information to the server..." is displayed. After the server verifies the authentication information, the person in charge dashboard is displayed.

[0440] Step 2: Enter and submit your promotion proposal

[0441] The terminal displays a form for the person in charge to enter details of the promotion proposal (campaign name, period, target audience, content). When the person in charge enters the details and presses the submit button, the terminal sends the entered data to the server. The server receives the data and stores it in a database.

[0442] Input: Promotion details (campaign name, period, target audience, content)

[0443] Data processing: The server assigns a unique ID to the promotion proposal and stores it in the database.

[0444] Output: Promotion proposal registration results

[0445] Specific operation: After completing the input, press the send button and the message "Promotion proposal has been sent" will be displayed. After the server has saved the data to the database, the message "Registration completed" will be displayed.

[0446] Step 3: Add friends and enter basic information

[0447] When a user registers as a friend on a company's official account, the device displays a form for the user to enter basic information (gender, age, interests). After the user enters the information and presses the submit button, the device sends the data to the server.

[0448] Input: User's basic information (gender, age, interests)

[0449] Data processing: The server analyzes the user's basic information and stores it in a database

[0450] Output: User information registration result

[0451] Specific behavior: When the user submits the form, the message "Basic information has been submitted" is displayed. After the server saves the data to the database, the user is notified that "Registration is complete."

[0452] Step 4: Send user data

[0453] The device sends the user's basic information to the server, which analyzes the received data to generate a user profile and saves it in a database.

[0454] Input: Basic information transmission request

[0455] Data processing: The server analyzes the information and generates a user profile

[0456] Output: User profile saved

[0457] Specific behavior: "User data received" is recorded in the server log. After the user profile is generated, "User profile generated" is recorded in the server log.

[0458] Step 5: Matching promotions to user profiles

[0459] The server matches the promotion proposal with user profiles stored in the database, selects users who meet the matching criteria, and creates a promotion distribution list.

[0460] Input: Promotion proposals and user profile database

[0461] Data processing: The server runs a matching algorithm and generates a distribution list

[0462] Output: Promotion distribution list

[0463] Specific behavior: "Matching promotions with user profile..." is displayed, and after the match is complete, "Matching results generated" is recorded in the server log.

[0464] Step 6: Sending and displaying notifications

[0465] The server notifies selected users of the promotion proposal based on the promotion distribution list, and the device displays the notification to the user and provides detailed information.

[0466] Input: Promotional Distribution List

[0467] Data processing: The server generates a notification message and sends it to each device.

[0468] Output: A notification is displayed on the user's device

[0469] What it does: A notification will appear on your device saying "There's a new promotion" and a link to the details page.

[0470] Step 7: Selecting Premium Members

[0471] The server periodically checks the activity status of premium members and selects premium members who meet the target conditions of the advertising campaign.

[0472] Input: Premium member activity data

[0473] Data processing: The server analyzes the activity data and selects targets based on the conditions.

[0474] Output: Premium Member List

[0475] Specific operation: "Selecting premium members..." is displayed, and after the selection is complete, "The list of selected premium members has been generated" is recorded in the server log.

[0476] Step 8: Create a list of ad serving

[0477] The server creates an ad distribution list, which includes selected premium members.

[0478] Input: Ad campaign data and premium membership list

[0479] Data processing: The server generates an ad distribution list and saves it in the database

[0480] Output: Ad delivery list

[0481] Specific behavior: "Ad delivery list created" is recorded in the log.

[0482] Step 9: Ad serving and notification

[0483] The server delivers the advertisement to the selected premium member, and the device displays a notification to the premium member requesting to view the advertisement and provides a link to a page with more details.

[0484] Input: Ad delivery list

[0485] Data processing: The server generates advertising delivery messages and sends them to each device.

[0486] Output: A notification will be displayed on the premium member's device.

[0487] Specific behavior: "There is a new ad" will be displayed in the notification bar, along with a link to the details page.

[0488] Step 10: Notification of ad completion and reward

[0489] The user watches the ad and sends a notification of completion to the server, which then verifies the completion and credits the reward to the user's account.

[0490] Input: Ad viewing completion notification

[0491] Data processing: The server checks the viewing completion data and calculates reward points

[0492] Output: Reward credited to user account

[0493] Specific operation: "Viewing completed. Reward points will be awarded" will be displayed on the device.

[0494] Step 11: Collect emotion data

[0495] The emotion analysis engine collects emotional data from the user's facial expressions, tone of voice, and text, and sends this data to the server in real time.

[0496] Input: User's emotional expression data

[0497] Data processing: The emotion analysis engine analyzes the data and determines the emotional state

[0498] Output: Sentiment analysis result data

[0499] Specific operation: "Analyzing emotion data..." is displayed, and after analysis, "Emotion data sent" is displayed.

[0500] Step 12: Reflecting and utilizing emotional data

[0501] The server reflects the emotional data in the user profile and uses it to match promotions and advertisements. For example, if a user looks happy while viewing a promotion, that data can be used to deliver the next promotion or advertisement.

[0502] Input: Sentiment analysis data

[0503] Data processing: The server adds emotional data to the user profile and reflects it in the matching algorithm.

[0504] Output: Updated user profile and improved matching results

[0505] Specific operation: "Emotion data saved" is recorded in the log and will be used effectively for the next delivery.

[0506] (Application example 2)

[0507] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0508] Existing promotion systems generally involve a company representative registering promotion ideas and users receiving them, making it difficult to deliver optimal ads that take into account the user's real-time emotional state. Furthermore, because ads are not displayed based on user emotions, a personalized user experience is not provided, limiting the effectiveness of advertising. As a result, it is difficult for companies to conduct more effective promotions, and users often end up viewing ads that do not interest them.

[0509] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a company representative to register promotion proposals, a means for a user to register a company account as a friend and create an individual profile, a means for matching the promotion proposals with the user profile and delivering optimized promotions to the user, a means for an advertiser to send advertisements to premium members and for the premium members to earn rewards by viewing the advertisements, and a means for analyzing user emotions in real time and displaying advertisements based on the analysis results. This enables optimal advertisement delivery that takes into account the user's real-time emotional state, allowing companies to carry out more effective promotions and users to view more interesting advertisements.

[0510] The "means for company personnel to register promotion proposals" refers to an interface and tools that allow company marketing personnel to input and register new promotions and advertising campaigns into the system.

[0511] "Means for users to add a company's account as a friend and create a unique profile" refers to the process and tools by which users can register in the system, enter the individual information required to receive the company's advertising and promotions, and create their own unique profile.

[0512] "Means for matching the promotion proposals with the user's profile and delivering optimized promotions to the user" refers to an algorithm and system for comparing registered promotion proposals with the user's profile information and delivering the most suitable promotions to the user.

[0513] "Means for advertisers to send advertisements to premium members, who then receive rewards by viewing the advertisements" refers to a system in which advertisements are sent to specific user ranks (premium members), and those users can receive reward points or other incentives by viewing the advertisements.

[0514] "Means for analyzing user emotions in real time and displaying advertisements based on the analysis results" refers to a system and algorithm that uses devices such as cameras and microphones to analyze emotions from users' facial expressions, tone of voice, text, etc., and selects and displays the most appropriate advertisements in real time based on that data.

[0515] System Overview

[0516] This invention is a system that allows company personnel to easily register promotional ideas and delivers optimized advertisements to users using an emotion engine. Users can earn rewards by viewing advertisements as premium members. Specific embodiments of this system are described below.

[0517] Hardware and software used

[0518] Hardware: Smart glasses, camera, microphone, server terminal

[0519] Software: Sentiment analysis engine, promotion matching algorithm, ad distribution server

[0520] Technologies used: Open source libraries (e.g., OpenCV), HTTP request libraries (e.g., requests)

[0521] System configuration

[0522] 1. Server

[0523] The server registers promotion ideas, manages the database, analyzes user profiles, matches and delivers promotions and advertisements, and processes emotional data using an emotion analysis engine.

[0524] 2. Terminal

[0525] The terminal is an interface between company representatives and users. Company representatives use the terminal to register promotion ideas, and users register friends, watch advertisements, and provide emotional data.

[0526] 3. Users

[0527] Users are individuals who add a company's official account as a friend and receive promotional information and advertisements. In particular, premium members can earn rewards by watching advertisements.

[0528] 4. Emotion Engine

[0529] The emotion engine analyzes the user's facial expressions, tone of voice, and text sentiment to collect real-time emotional data.

[0530] Program processing

[0531] The server uses the emotion engine to analyze the user's emotions in real time and delivers the most suitable advertisements to the user based on the analysis results, which includes the following steps:

[0532] Data capture: Smart glasses or a camera capture the user's facial expressions, and a microphone captures the tone of voice.

[0533] Sentiment analysis: The captured data is sent to an emotion engine for real-time emotion analysis.

[0534] Promotion Matching: Matching with the best promotion ideas based on sentiment data and user profiles.

[0535] Advertisement delivery: Displaying matched promotions on the user's smart glasses.

[0536] Specific examples

[0537] Registration of promotion proposal: A company representative registers, for example, a "Summer Sale Campaign." Details include the campaign name, period, target audience, content, etc.

[0538] Creating a user profile: A 20-year-old female user adds a friend and states that she is interested in "fashion" and "beauty." The emotion engine analyzes her facial expressions and detects smiles.

[0539] Advertisement delivery: Based on the emotional data, the server determines that the "Summer Sale Campaign" is most suitable for female users in their 20s and displays the advertisement on the smart glasses.

[0540] Prompt Sentence Examples

[0541] Demonstrate a program that analyzes a user's facial expressions in real time and displays the most appropriate advertisement on smart glasses based on the emotional data. If the user is enjoying themselves, display a trailer advertisement for a new movie. The APIs used include an emotion analysis engine (Emotion API) and an advertisement server.

[0542] This provides a personalized advertising experience that takes into account users' real-time emotions, allowing businesses to run more effective promotions and users to receive ads based on their interests.

[0543] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0544] Step 1:

[0545] A company representative registers a promotion proposal. Using a terminal, the company representative enters the details of the promotion proposal (campaign name, period, target audience, content). The entered promotion proposal data is sent to the server, which stores this data in a database. The input is the detailed information of the promotion proposal, and the output is the promotion proposal stored in the database.

[0546] Step 2:

[0547] A user adds a friend to a company's account. The user uses their device to enter basic information (gender, age, interests). This information is sent to a server, which analyzes the user data and creates an individual user profile. The input is the user's basic information, and the output is the user profile stored in a database.

[0548] Step 3:

[0549] Emotion data capture. Smart glasses or a camera capture the user's facial expressions, and a microphone captures the tone of voice. These data are transmitted from the device to the server in real time. The input is the user's facial image and voice data, and the output is the raw data used for emotion analysis.

[0550] Step 4:

[0551] Emotion analysis. The server uses an emotion analysis engine to analyze the captured data (facial expression images and voice data) and generate real-time emotional data of the user. The input is facial expression images and voice data, and the output is the analyzed emotional data. Specifically, the emotion analysis engine analyzes the image and voice data and identifies the user's emotional state, such as "happiness" or "excitement."

[0552] Step 5:

[0553] Promotion Matching: The server matches optimal promotion suggestions to users based on the generated emotion data and user profile. The input is emotion data and user profile, and the output is optimal promotion suggestions. Specifically, the server matches the promotion suggestion database with the user profile database and selects promotions that match the user's current emotional state.

[0554] Step 6:

[0555] Advertisement delivery. Once the optimal promotional plan is determined, the server displays the promotion on the smart glasses. The input is the optimal promotional plan, and the output is the advertisement displayed to the user. Specifically, the server sends the selected promotional data to the smart glasses and displays it in real time so that the user can view the advertisement directly.

[0556] Step 7:

[0557] Reward allocation. When a user watches an ad, the smart glasses or device sends a completion notification to the server. The server verifies the completion information and allocates rewards to the premium member user's account. The input is the ad completion notification, and the output is the reward points allocated to the user's account. Specifically, the server updates the reward management system after receiving the completion notification and adds points to the premium member's account.

[0558] This allows businesses to run effective promotions, users to receive optimal ads based on emotional data in real time, and premium members can earn rewards by watching ads, improving the user experience.

[0559] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0560] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0561] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0562] [Second embodiment]

[0563] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0564] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0565] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0566] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0567] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0568] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0569] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0570] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0571] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0572] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0573] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0574] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0575] This invention is a system that allows company personnel to easily register promotion ideas and deliver optimized promotions to users. In addition, premium members can earn rewards by viewing advertisements. An embodiment of this system will be described.

[0576] System Configuration

[0577] 1. Server

[0578] The server is the core system that registers promotion ideas, manages the database, analyzes user profiles, matches promotions with advertisements, and distributes them.

[0579] 2. Terminal

[0580] The terminal is a device (such as a smartphone or PC) that acts as an interface between company personnel and users. Through this, personnel register promotion ideas, and users register friends and watch advertisements.

[0581] 3. Users

[0582] Users are consumers who add a company's official account as a friend and create individual profiles. In particular, premium members can watch advertisements and earn rewards.

[0583] Program processing

[0584] 1. Promotion proposal registration

[0585] The terminal provides a screen for the company's representative to input details of the promotion proposal. When the representative inputs the promotion proposal and presses the send button, the data is sent to the server.

[0586] The server analyzes the received promotion data and stores it in a database.

[0587] 2. User data collection and profiling

[0588] When a user adds a company's official account as a friend, the device prompts them to enter basic data (gender, age, interests).

[0589] The device sends the collected data to a server, which then creates a user profile based on that data.

[0590] 3. Promotion Matching and Delivery

[0591] The server matches registered promotion ideas with user profiles. For example, a summer sale campaign aimed at women in their 20s matches a profile of a 20-year-old woman.

[0592] When a match is made, the server delivers the promotion to the user's device, and the device displays a notification to the user.

[0593] 4. Delivery of advertisements to premium members and rewards

[0594] The server checks the activity status of premium members and delivers advertisements from advertisers to active premium members.

[0595] When a user views an advertisement, the terminal sends a viewing completion signal to the server, which then confirms the signal.

[0596] The server calculates the reward based on the viewing completion information and adds the reward information to the user profile.

[0597] Specific examples

[0598] 1. Example of promotion proposal registration

[0599] A company representative registers a summer sales campaign, for example, by entering information such as "Summer sale, July 1st to July 31st, for women in their 20s, discount coupon" into the terminal.

[0600] This data is sent to a server and stored in a database.

[0601] 2. Example of a User Profile

[0602] A 20-year-old female user adds a friend and lists "fashion" and "beauty" as her interests.

[0603] The server uses this information to generate a user profile.

[0604] 3. Examples of promotional distribution

[0605] The server matches the "Summer Sale Campaign" to this user.

[0606] The device will send the user a "Summer Sale Announcement" notification and display details within the app.

[0607] 4. Examples of Ad Viewing and Rewards

[0608] A 20-year-old female premium member watches an advertisement for a new cosmetic product.

[0609] The server checks the viewing completion information and awards reward points to the user.

[0610] In this way, businesses can efficiently promote themselves, users can receive information that matches their interests, and enjoy the benefits of premium membership.

[0611] The processing flow will be explained below.

[0612] Step 1: Submit your promotion proposal

[0613] The terminal displays a login screen to the company's personnel and prompts them to enter their authentication information.

[0614] The terminal transmits the entered authentication information to the server.

[0615] The server verifies the credentials and allows the agent to log in.

[0616] The device displays a form that asks the person in charge to enter details of the promotion proposal (campaign name, period, target audience, content).

[0617] The person in charge enters the details of the promotion proposal and presses the send button.

[0618] The terminal transmits the input promotion proposal data to the server.

[0619] The server checks the received promotion data and stores it in a database.

[0620] The server notifies the terminal that saving to the database is complete.

[0621] Step 2: Collecting user data and creating profiles

[0622] A user adds a company's official account as a friend.

[0623] The device displays a form that asks the user to enter basic information (gender, age, interests).

[0624] The user enters basic information and presses the submit button.

[0625] The terminal sends the entered basic information to the server.

[0626] The server analyzes the received user data and creates a user profile.

[0627] The server stores the created user profile in a database.

[0628] The server notifies the terminal that the user profile has been saved.

[0629] Step 3: Promotion Matching and Delivery

[0630] The server performs a matching process to match promotion offers with user profiles.

[0631] The server selects users who meet the criteria of the target audience.

[0632] The server creates a promotion distribution list for the selected users.

[0633] The server sends the promotion proposal to the selected users.

[0634] The terminal displays the promotion notification to the user and provides a screen for displaying more information.

[0635] Step 4: Delivering ads to premium members and rewarding them

[0636] The server periodically checks the activity status of premium members.

[0637] Advertisers register details of their advertising campaigns with the server.

[0638] The server matches the premium member's profile with the advertiser's targeting criteria.

[0639] The server creates an advertisement distribution list for premium members who match the target.

[0640] The server distributes advertisements to selected premium members.

[0641] The device will display a notification to the premium member that they have viewed an ad and provide a link to the ad's details page.

[0642] The user watches the advertisement and presses the "Complete viewing" button.

[0643] The terminal transmits a viewing completion signal to the server.

[0644] The server checks the advertisement viewing completion information and gives a reward to the premium member's account.

[0645] The server notifies the terminal that the reward has been granted.

[0646] Example 1

[0647] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0648] Today's businesses need to effectively promote their target users and increase user engagement, but traditional methods involve uniform distribution of promotions and advertisements, making it difficult to optimize for each individual user. Furthermore, managing the rewards that premium members receive for viewing advertisements is also time-consuming. There is a need to solve these issues and provide a system that is convenient for both businesses and users.

[0649] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0650] In this invention, the server includes: a means for a company representative to register promotion proposals; a means for a user to register a company account as a friend and create an individual profile by entering basic data; a means for transmitting detailed information about the promotion proposals and for the server to analyze the data and store it in a database; a means for the server to match the promotion proposals with user profiles, deliver the matched promotions to the user terminal and display a notification; and a means for an advertiser to send advertisements to premium members, and for the server to calculate rewards when premium members view the advertisements and add reward information to the profile. This makes it possible to individually optimize and deliver company promotion proposals to target users and automatically manage rewards for viewing advertisements for premium members.

[0651] "Company representative" refers to a person in a company who is responsible for creating and managing promotion proposals.

[0652] "Promotion Proposal" means detailed information about a plan or campaign aimed at promoting a product or service.

[0653] "Friend registration" refers to the act of a user following an official account, enabling two-way communication.

[0654] "Basic data" refers to individual information about a user, such as their gender, age, and interests.

[0655] An "individual profile" is individual characteristic information based on a user's basic data and behavioral history.

[0656] "Server" means a computer system that stores, analyzes data, and matches promotional offers with user profiles.

[0657] A "database" is an information collection system for storing and managing promotional ideas and user profile data.

[0658] "Matching" refers to the process of matching promotion ideas with user profiles.

[0659] "User terminal" refers to the interface device used by the user (e.g., smartphone, personal computer).

[0660] "Notification" means a message sent to a User to inform them of promotional information.

[0661] "Advertiser" means an individual or entity that pays compensation to advertise a product or service.

[0662] A "premium membership" is a paid membership that allows you to enjoy more benefits and additional features than regular users.

[0663] "Ad viewing" means the act of a user visually or audibly viewing the transmitted advertising content.

[0664] "Rewards" refer to points or benefits provided based on user actions such as watching advertisements.

[0665] This invention is a system that allows company personnel to easily register promotion ideas and deliver optimized promotions to users. In addition, premium members can earn rewards by viewing advertisements. The following describes in detail the embodiments for implementing this system.

[0666] System Configuration

[0667] 1. Server

[0668] Role: The server is the core system that registers promotion ideas, manages the database, analyzes user profiles, matches promotions and advertisements, and distributes them.

[0669] Software used: MySQL (database management), Python (data analysis), HTTP server (request processing)

[0670] 2. Terminal

[0671] Role: A terminal is a device (e.g., smartphone, PC) that acts as an interface between company personnel and users.

[0672] Software used: Web browser (interface provided), HTTP client (data transmission)

[0673] 3. Users

[0674] Role: Users are consumers who add a company's official account as a friend and create a personalized profile. Premium members, in particular, can watch ads and earn rewards.

[0675] Program processing

[0676] Promotion proposal registration

[0677] Company representative actions: The company representative enters details of the promotion proposal on the terminal.

[0678] Server processing: The device sends the entered promotion proposal to the server via an HTTP POST request, and the server analyzes this data and stores it in a database.

[0679] Example: A company representative inputs a promotional idea such as "Summer sale, July 1st to July 31st, for women in their 20s, discount coupon" into a terminal and sends it.

[0680] User Data Collection and Profiling

[0681] User behavior: A user adds a company's official account as a friend and enters basic data (gender, age, interests).

[0682] Server processing: The device sends the collected data to the server via an HTTP POST request, and the server creates a user profile based on that data and stores it in a database.

[0683] Example: A 20-year-old female user registers as a friend and enters her gender, age, and interests in "fashion" and "beauty."

[0684] Promotion Matching and Delivery

[0685] Server process: The server matches the promotion proposal with the user profile. If the conditions are met, the promotion is sent to the user's device and a notification is displayed.

[0686] Example: The server matches a "Summer Sale Campaign" to a 20-year-old female user, and the device displays a notification as a "Summer Sale Announcement."

[0687] Delivery of advertisements and rewards for premium members

[0688] Server processing: The server checks the activity status of the premium member and sends advertisements. When the user watches the advertisement, it sends a completion signal to the server, calculates the reward, and adds the reward information to the user profile.

[0689] Example: A 20-year-old female premium member watches an advertisement for a new cosmetic product, a viewing completion signal is sent to the server, and reward points are added to her profile.

[0690] Prompt Sentence Examples

[0691] Below are some example prompts that the system uses in its generative AI model:

[0692] "Please enter the details of your promotion idea. Example: Summer sale, July 1st to July 31st, for women in their 20s, discount coupon."

[0693] "Please enter your basic information. For example: Gender: Female, Age: 20, Interests: Fashion, Beauty"

[0694] In this way, companies can efficiently promote themselves, users can receive information that matches their interests, and enjoy the benefits of being a premium member.

[0695] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0696] Specific steps of the program's processing

[0697] Step 1: Enter your promotion idea

[0698] Company representative actions: The company representative enters details of the promotion proposal on the terminal.

[0699] Input: Promotion name, start date, end date, target user, and promotion details

[0700] What happens: The terminal displays the details entered based on the form, and the agent fills in these details. Once the agent has finished entering the information, he clicks the submit button.

[0701] Output: Promotion data collected by the device

[0702] Step 2: Submit and save your promotion proposal

[0703] Device action: The device sends a promotion proposal to the server.

[0704] Input: Promotion data collected in step 1

[0705] Specific operation: The device makes an HTTP POST request and sends the promotion data to the server.

[0706] Output: Promotion data received by the server

[0707] Step 3: Analyze and save promotion ideas

[0708] Server Actions: The server analyzes the promotion data received and stores it in a database.

[0709] Input: Promotion data received in step 2

[0710] What happens: The server parses the data using a data parsing script (e.g. Python) and converts it into an appropriate format. It then stores the parsed data in a database (e.g. MySQL).

[0711] Output: Promotion data stored in a database

[0712] Step 4: Add users as friends and enter basic data

[0713] User behavior: A user adds a company's official account as a friend and enters basic data (gender, age, interests).

[0714] Input: User's gender, age, interests

[0715] What happens: The device displays a friend registration button, and when the user clicks it, a basic data entry form appears. The user fills in the information in each field and clicks the submit button.

[0716] Output: User data collected by the device

[0717] Step 5: Submitting user data and creating a profile

[0718] Device action: The device sends user data to the server.

[0719] Input: User data collected in step 4

[0720] Specific operation: The device makes an HTTP POST request and sends user data to the server, which receives and analyzes the data.

[0721] Output: Server generates profile data

[0722] Step 6: Save your profile data

[0723] Server actions: The server creates a profile based on the analyzed user data and stores it in a database.

[0724] Input: Profile data generated in step 5

[0725] Specific operation: The server analyzes user data, generates a profile, and stores the profile in a database.

[0726] Output: User profile stored in the database

[0727] Step 7: Matching promotions to user profiles

[0728] Server Action: The server matches promotion ideas with user profiles.

[0729] Input: Promotion ideas and user profiles stored in the database

[0730] What happens: The server runs an SQL query to find user profiles that match the promotion offer.

[0731] Output: Matching result data

[0732] Step 8: Promotion Delivery and Notification

[0733] Server Action: The server delivers the matched promotion to the user device.

[0734] Input: Matching result data generated in step 7

[0735] Specific operation: The server generates a notification message and sends it to the device via an HTTP PUSH request. The device displays the push notification.

[0736] Output: Notification message displayed on the terminal

[0737] Step 9: Check your Premium Membership Activity

[0738] Server Action: The server checks the activity status of premium members.

[0739] Input: Premium member data stored in the database

[0740] What it does: The server periodically checks the database to generate a list of active premium members.

[0741] Output: Active members list

[0742] Step 10: Serving Ads

[0743] Server Action: The server delivers ads to active premium members.

[0744] Input: Active Member List generated in Step 9

[0745] Specific operation: The server retrieves advertising content from the advertising database and sends it to the device via an HTTP PUSH request.

[0746] Output: Ad displayed on device

[0747] Step 11: Record your ad views and rewards

[0748] User action: The user watches the ad and sends a completion signal to the server.

[0749] Input: Information about the ad the user watched

[0750] Specific operation: When the user clicks the "Complete" button on the device, the completion information is sent to the server via an HTTP POST request. The server analyzes the completion data, calculates the reward, and adds it to the user's profile.

[0751] Output: Added reward information

[0752] (Application example 1)

[0753] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0754] Conventional promotion systems lack real-time and interactivity in the means of appropriately matching and delivering promotions registered by company personnel to users. Additionally, incentives for premium members who earn rewards by viewing advertisements are limited, making it difficult to deliver advertisements that effectively match users' interests.

[0755] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0756] In this invention, the server includes a means for a company representative to register promotion proposals, a means for a user to register a company account as a friend and create an individual profile, a means for matching the promotion proposals with the user profile and delivering promotions optimized for the user, a means for an advertiser to send advertisements to premium members and for premium members to earn rewards by viewing the advertisements, a means for displaying the optimized advertisements on the smart device in real time, and a means for displaying detailed information through the smart device in response to user operations, thereby enabling advertisement delivery that is both real-time and interactive.

[0757] "Company Representative" means an individual or group of individuals within a Company who are responsible for organizing and registering a Promotion.

[0758] A "Promotion Proposal" is detailed information about a campaign that a company plans and registers to promote a particular product or service.

[0759] A "user" is a consumer who adds a company's account as a friend, creates a personal profile, and receives its promotions and advertisements.

[0760] A "profile" is an individual data set created based on a user's basic information, interests, and behavioral data.

[0761] "Matching" is the process of comparing registered promotion proposals with a user's profile and selecting an appropriate promotion based on matching factors.

[0762] A "premium member" is a user who, unlike a regular user, has the privilege of earning rewards by watching certain advertisements.

[0763] A "smart device" is an electronic device that can communicate and process information when worn or used by a user, and includes smart glasses and smartphones.

[0764] "Real-time" is a temporal concept that indicates near-instant processing or delivery without delay.

[0765] "Operation" means input or instruction given by a user using a device, including, for example, tapping, swiping, or eye movement.

[0766] This invention is a system that uses smart devices to deliver corporate promotional ideas to users in real time, providing an interactive advertising experience.

[0767] System Configuration

[0768] 1. Server

[0769] Hardware and software: The server uses a database management system (e.g., MySQL) and a program execution environment (e.g., Python). The server receives promotion proposals registered by company personnel, stores the data in a database, and manages them. It also analyzes user profiles and is responsible for matching and delivering promotions and advertisements.

[0770] 2. Terminal

[0771] Hardware and software: The device is the interface with the user (e.g., smart glasses, smartphone, PC). The device has the smart glasses SDK (e.g., Google Glass API) and mobile app installed, where company representatives input promotion ideas and users can add friends and watch ads.

[0772] Program Processing

[0773] 1. Promotion proposal registration

[0774] Server: The server receives the promotion proposal data sent by the company representative and stores it in a database.

[0775] Terminal: The terminal provides a screen where company personnel can enter details of their promotion proposal.

[0776] 2. User data collection and profiling

[0777] Terminal: The terminal provides the user with an input screen where they can enter basic data (gender, age, interests).

[0778] Server: The server receives user data sent from the device and creates a user profile based on that data.

[0779] 3. Promotion Matching and Delivery

[0780] Server: The server matches registered promotion ideas with user profiles and selects appropriate promotions.

[0781] Terminal: The terminal delivers ads optimized for the user's smart device in real time, allowing the user to interact with the ads through the device.

[0782] 4. Delivery of advertisements to premium members and rewards

[0783] Server: The server checks the activity status of premium members, delivers ads to active premium members, and verifies the completion of ad viewing and awards reward points to users.

[0784] Device: When a user watches an ad, it sends a viewing completion signal to the server and checks the status of reward points awarded.

[0785] Specific examples

[0786] 1. Example of promotion proposal registration

[0787] Company representative: Register a promotional proposal that reads, "Autumn / Winter collection on sale from October 1st to October 31st, aimed at women in their 20s."

[0788] Server: Stores this information in a database.

[0789] 2. Example of a User Profile

[0790] User: A 25-year-old woman who is interested in fashion adds the user as a friend.

[0791] Server: Generates a user profile based on this input information.

[0792] 3. Examples of promotional distribution

[0793] Server: Matches registered Fall / Winter collection promotions to the appropriate user profile.

[0794] Device: Smart glasses display "Autumn / Winter Collection Now On Sale!" and display advertisement details based on eye and head movements.

[0795] 4. Examples of Ad Viewing and Rewards

[0796] User: Habit, a 25-year-old female premium member watches an advertisement for a new cosmetic product.

[0797] Server: Checks the viewing completion information and awards reward points.

[0798] Prompt Sentence Examples

[0799] "Generate the best promotional text to send to a 25-year-old female user who is interested in fashion, offering a 10% discount on new gloves."

[0800] Such a system allows businesses to carry out effective promotional activities, allows users to interactively experience advertisements tailored to their interests, and allows them to receive rewards.

[0801] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0802] Step 1:

[0803] [Register promotion proposal]

[0804] Input: A company representative inputs a promotion proposal (e.g., "Fall / Winter collection release, October 1st to October 31st, for women in their 20s")

[0805] Operation: The terminal provides an interface that allows company personnel to input details of promotion proposals and transmits the input data to a server.

[0806] Output: The server receives the promotion proposals and stores them in a database.

[0807] Data processing / calculation: The content of the promotion proposal is analyzed and stored in the database in an appropriate format.

[0808] Step 2:

[0809] [User Data Collection and Profiling]

[0810] Input: User basic data (gender, age, interests)

[0811] How it works: The device provides the user with an interface for registering friends and prompts them to enter basic information.

[0812] Output: Basic data is sent to the server and a user profile is created.

[0813] Data processing / calculation: Based on the entered user data, the server organizes and saves the user profile in a format suitable for storing in the database.

[0814] Step 3:

[0815] [Promotion Matching and Delivery]

[0816] Input: Promotion idea and user profile

[0817] How it works: The server retrieves promotion ideas and user profiles from the database and performs matching using the corresponding algorithm.

[0818] Output: Matched promotions are sent to the user's device.

[0819] Data processing / calculation: The server selects the most suitable promotions based on the user profile interests and past behavioral data, and delivers this information to the user's smart device in real time.

[0820] Step 4:

[0821] [Real-time ad display and interaction]

[0822] Input: Matched promotion data

[0823] How it works: The device displays ads in real time on smart glasses or smartphones and accepts user interaction. Users can view the details of the ads through the device.

[0824] Output: The ad content is displayed to the user, and further details are displayed based on the user's actions.

[0825] Data processing / calculation: Data is updated in real time to display detailed information in response to user input.

[0826] Step 5:

[0827] [Premium member activity check, ad delivery, and rewards]

[0828] Input: Premium member status data, ad viewing data

[0829] How it works: The server checks the activity status of premium members and delivers ads to active members. When a user watches an ad, the completion data is sent to the server, which calculates the reward and reflects it in the profile.

[0830] Output: Reward information added to premium member profile.

[0831] Data processing / calculation: The server calculates rewards based on the viewing completion data and reflects them as reward points in the user profile.

[0832] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0833] This invention achieves a higher level of personalization by combining an emotion engine with a system that allows company personnel to easily register promotion ideas and deliver optimized promotions to users. In addition, premium members can earn rewards by viewing advertisements. A specific embodiment of this system will now be described.

[0834] System Configuration

[0835] 1. Server

[0836] The server plays a central role in registering promotion ideas, managing the database, analyzing user profiles, matching and delivering promotions and advertisements, and processing emotional data using an emotion engine.

[0837] 2. Terminal

[0838] The terminal is an interface between company representatives and users. Representatives use the terminal to register promotion ideas, and users register friends, watch advertisements, and provide emotional data.

[0839] 3. Users

[0840] Users are individuals who add a company's official account as a friend and receive promotional information and advertisements. In particular, premium members can earn rewards by watching advertisements.

[0841] 4. Emotion Engine

[0842] The emotion engine is a component that analyzes the user's facial expressions, tone of voice, and text emotions to collect real-time emotional data from the user.

[0843] Program processing

[0844] 1. Promotion proposal registration

[0845] The terminal displays a login screen to the company representative and asks them to enter their authentication information. After the representative logs in, they are provided with a form to enter details of the promotion proposal (campaign name, period, target audience, content).

[0846] The person in charge enters a promotion proposal and presses the send button. The terminal sends the entered promotion proposal data to the server, which then stores the data in a database.

[0847] 2. User data collection and profiling

[0848] When a user registers as a friend on a company's official account, the device displays a form for entering basic information (gender, age, interests, etc.) Once the user enters the information and presses the submit button, the device sends the data to the server.

[0849] The server analyzes the user data, creates a user profile, and stores it in a database.

[0850] 3. Promotion Matching and Delivery

[0851] The server performs a matching process to match the promotion proposal with user profiles, selects users who meet the matching criteria, and creates a promotion distribution list for the selected users.

[0852] The server will distribute the promotion proposal to the selected users, and the device will display a notification to the users, allowing them to check the details.

[0853] 4. Delivery of advertisements to premium members and rewards

[0854] The server periodically checks the activity status of premium members. Advertisers register details of their advertising campaigns with the server, and the server selects premium members who meet the targeting criteria and creates an advertising distribution list.

[0855] The server distributes advertisements to the selected premium members, and the terminal displays a notice of advertisement viewing to the premium members and provides a link to a detailed page.

[0856] The user watches the ad and notifies the server that they have completed watching. The server then verifies the completion information and credits the reward to the user's account.

[0857] 5. Leveraging Emotional Engines

[0858] The emotion engine recognizes emotions from users' facial expressions, tone of voice, and text. Emotional data is reflected in user profiles and used to match promotions and advertisements.

[0859] For example, if a user looks happy while viewing a promotion, that emotional data is sent to the server and used to improve the accuracy of the next promotion or advertisement.

[0860] Specific examples

[0861] 1. Example of promotion proposal registration

[0862] The person in charge registers a summer sale campaign, for example, "Summer sale, July 1st to July 31st, for women in their 20s, discount coupon," and enters details into the terminal and submits them.

[0863] This data is sent to a server and stored in a database.

[0864] 2. Example of a User Profile

[0865] A 20-year-old female user adds a friend and lists "fashion" and "beauty" as her interests. The emotion engine analyzes the user's facial expressions and detects smiles.

[0866] The server uses this information to generate a user profile and stores it in a database.

[0867] 3. Examples of promotional distribution

[0868] The server matches the "Summer Sale Campaign" with the profile of a 20-year-old female user, taking into account emotional data that indicates the user looks happy.

[0869] The device will send the user a "Summer Sale Announcement" notification and display more information within the app.

[0870] 4. Examples of Ad Viewing and Rewards

[0871] A 20-year-old female premium member watches an advertisement for a new cosmetic product. The emotion engine detects the user's emotions (e.g., excitement, interest) while watching the advertisement.

[0872] The server calculates reward points based on viewing completion information and emotional data and awards them to the user.

[0873] In this way, companies can run effective promotions and users can receive information and rewards that match their interests. By combining this with an emotion engine, a more personalized experience can be provided.

[0874] The processing flow will be explained below.

[0875] Step 1: Submit your promotion proposal

[0876] The terminal displays a login screen to the company's personnel and prompts them to enter their authentication information.

[0877] The terminal transmits the entered authentication information to the server.

[0878] The server verifies the credentials and allows the agent to log in.

[0879] The device displays a form that asks the person in charge to enter details of the promotion proposal (campaign name, period, target audience, content).

[0880] The person in charge enters the details of the promotion proposal and presses the send button.

[0881] The terminal transmits the input promotion proposal data to the server.

[0882] The server checks the received promotion data and stores it in a database.

[0883] The server notifies the terminal that saving to the database is complete.

[0884] Step 2: Add friends and collect basic information

[0885] A user adds a company's official account as a friend.

[0886] The device displays a form that asks the user to enter basic information (gender, age, interests).

[0887] The user enters basic information and presses the submit button.

[0888] The terminal sends the entered basic information to the server.

[0889] The server analyzes the received user data and creates a user profile.

[0890] The server stores the created user profile in a database.

[0891] The server notifies the terminal that the user profile has been saved.

[0892] Step 3: Collect user sentiment data

[0893] The device captures the user's facial expressions and tone of voice in real time.

[0894] The emotion engine analyzes the captured facial expressions and tone of voice to generate emotional data for the user.

[0895] The terminal transmits the generated emotion data to the server.

[0896] The server analyzes the emotional data and adds or updates it to the user profile.

[0897] Step 4: Matching promotions with user profiles

[0898] The server performs a matching process that matches promotion proposals with user profiles and emotion data.

[0899] The server filters the best users based on the target audience criteria and sentiment data.

[0900] The server generates an optimal user list and delivers promotions to the target users.

[0901] Step 5: Serving your promotion

[0902] The server sends the promotion proposal to the selected users.

[0903] The device will display a promotional notification to the user and provide a screen where they can view more information.

[0904] Step 6: Delivering ads to premium members and rewarding them

[0905] The server periodically checks the activity status of premium members.

[0906] Advertisers register details of their advertising campaigns with the server.

[0907] The server compares the profiles and emotion data of the premium members and selects premium members who meet the target conditions.

[0908] The server distributes advertisements to selected premium members.

[0909] The device will display a notification to premium members that they have watched an ad and provide a link to a page with more details.

[0910] The user watches the advertisement and presses the "Complete viewing" button.

[0911] The terminal transmits a viewing completion signal to the server.

[0912] The server checks the advertisement viewing completion information and gives a reward to the premium member's account.

[0913] The server notifies the terminal that the reward has been granted.

[0914] Through this process, companies can efficiently promote themselves, and users can receive information and rewards based on their interests and emotions.

[0915] Example 2

[0916] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0917] Conventional promotion systems not only required a lot of work to match promotion ideas registered by company representatives with user profiles, but the results were often not properly optimized for users. Furthermore, systems that allow premium members to earn rewards by viewing advertisements lacked personalization that took user emotions into account. Therefore, there was a need for more accurate and personalized promotions and ad delivery.

[0918] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for a company representative to register a promotion proposal, a means for a user to register a company account as a friend and create an individual profile, a means for matching the promotion proposal with the user's profile and delivering an optimized promotion to the user, a means for an advertiser to send advertisements to premium members and for the premium members to earn rewards by viewing the advertisements, and a means for collecting user emotion data using an emotion analysis engine and reflecting the data in the profile. This enables personalized promotions and advertisement delivery based on the user's emotions and interests.

[0919] "Company Representative" means the employee responsible for registering promotion proposals and managing the implementation of the campaign.

[0920] A "user" is an individual who adds a company's account as a friend and receives promotional information and advertisements.

[0921] A "promotion proposal" is a proposal that includes details of a campaign to be implemented by a company (campaign name, period, target audience, content).

[0922] A "profile" is individual data that compiles a user's basic information, behavioral data, and interests.

[0923] "Matching" is the process of matching promotion ideas with user profiles and selecting appropriate promotions.

[0924] "Advertiser" means a company that provides advertisements to premium members.

[0925] "Premium members" are special users who can earn rewards by watching advertisements.

[0926] An "emotion analysis engine" is a system that analyzes a user's emotions from facial expressions, tone of voice, and text, and collects data.

[0927] "Rewards" are points and benefits that premium members can earn by watching advertisements.

[0928] "Database" means a system for storing information such as promotion ideas and user profiles.

[0929] This invention achieves a higher level of personalization by combining a sentiment analysis engine with a system that allows company personnel to easily register promotion ideas and deliver optimized promotions to users. In addition, premium members can earn rewards by viewing advertisements. Specific embodiments for implementing this invention are described below.

[0930] System Configuration

[0931] 1. Server

[0932] The server plays a central role in registering promotion ideas, managing the database, analyzing user profiles, matching and delivering promotions and advertisements, and processing emotional data using an emotion analysis engine.

[0933] 2. Terminal

[0934] The terminal is an interface between company representatives and users. Representatives use the terminal to register promotion ideas, and users register friends, watch advertisements, and provide emotional data.

[0935] 3. Sentiment Analysis Engine

[0936] The sentiment analysis engine is a component that analyzes the user's facial expressions, tone of voice, and text sentiment to collect real-time emotional data of the user.

[0937] Program processing

[0938] 1. Promotion proposal registration

[0939] The terminal displays a login screen to the company representative and asks them to enter their authentication information. After the representative logs in, they are provided with a form to enter details of the promotion proposal (campaign name, period, target audience, content).

[0940] When the person in charge inputs a promotion proposal and presses the send button, the terminal transmits the input promotion proposal data to the server, which then stores the data in a database.

[0941] 2. User data collection and profiling

[0942] When a user registers as a friend on a company's official account, the device displays a form for entering basic information (gender, age, interests, etc.) Once the user enters the information and presses the submit button, the device sends the data to the server.

[0943] The server analyzes the user data, creates a user profile, and stores it in a database.

[0944] 3. Promotion Matching and Delivery

[0945] The server performs a matching process to match the promotion proposal with user profiles, selects users who meet the matching criteria, and creates a promotion distribution list for the selected users.

[0946] The server will distribute the promotion proposal to the selected users, and the device will display a notification to the users, allowing them to check the details.

[0947] 4. Delivery of advertisements to premium members and rewards

[0948] The server periodically checks the activity status of premium members. Advertisers register details of their advertising campaigns with the server, and the server selects premium members who meet the targeting criteria and creates an advertising distribution list.

[0949] The server distributes advertisements to the selected premium members, and the terminal displays a notice of advertisement viewing to the premium members and provides a link to a detailed page.

[0950] The user watches the ad and notifies the server that they have completed watching. The server then verifies the completion information and credits the reward to the user's account.

[0951] 5. Utilizing sentiment analysis engines

[0952] The emotion analysis engine recognizes emotions from users' facial expressions, tone of voice, and text. Emotional data is reflected in user profiles and used to match promotions and advertisements.

[0953] For example, if a user looks happy while viewing a promotion, that emotional data is sent to the server and used to improve the accuracy of the next promotion or advertisement.

[0954] Specific examples

[0955] 1. Example of promotion proposal registration

[0956] The person in charge registers a summer sale campaign, for example, "Summer sale, July 1st to July 31st, for women in their 20s, discount coupon," and enters details into the terminal and submits them.

[0957] This data is sent to a server and stored in a database.

[0958] 2. Example of a User Profile

[0959] A 20-year-old female user registers as a friend and lists "fashion" and "beauty" as her interests. The emotion analysis engine analyzes the user's facial expressions and detects smiles.

[0960] The server uses this information to generate a user profile and stores it in a database.

[0961] 3. Examples of promotional distribution

[0962] The server matches the "Summer Sale Campaign" with the profile of a 20-year-old female user, taking into account emotional data that indicates the user looks happy.

[0963] The device will send the user a "Summer Sale Announcement" notification and display more information within the app.

[0964] 4. Examples of Ad Viewing and Rewards

[0965] A 20-year-old female premium member watches an advertisement for a new cosmetic product. The emotion analysis engine detects the user's emotions (e.g., excitement, interest) while watching.

[0966] The server calculates reward points based on viewing completion information and emotional data and awards them to the user.

[0967] Example prompts for generative AI models

[0968] "Female, 20 years old, interests: fashion and beauty. Emotion analysis engine analysis: smiling. Please send me recommended promotion ideas."

[0969] In this way, companies can run effective promotions and users can receive information and rewards that match their interests. By combining it with a sentiment analysis engine, a more personalized experience can be provided.

[0970] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0971] Step 1: Personnel authentication

[0972] The terminal displays a login screen to the company's personnel. When the personnel enters their username and password and presses the send button, the terminal sends the authentication information to the server. The server verifies the authentication information, and if authentication is successful, grants the personnel access permission.

[0973] Input: Username and password of the person in charge

[0974] Data processing: The server verifies the authentication information and obtains the ID of the person in charge

[0975] Output: Authentication result (success or failure), display of the dashboard for the person in charge if authentication is successful

[0976] Specific operation: When the person in charge presses the login button, the message "Sending authentication information to the server..." is displayed. After the server verifies the authentication information, the person in charge dashboard is displayed.

[0977] Step 2: Enter and submit your promotion proposal

[0978] The terminal displays a form for the person in charge to enter details of the promotion proposal (campaign name, period, target audience, content). When the person in charge enters the details and presses the submit button, the terminal sends the entered data to the server. The server receives the data and stores it in a database.

[0979] Input: Promotion details (campaign name, period, target audience, content)

[0980] Data processing: The server assigns a unique ID to the promotion proposal and stores it in the database.

[0981] Output: Promotion proposal registration results

[0982] Specific operation: After completing the input, press the send button and the message "Promotion proposal has been sent" will be displayed. After the server has saved the data to the database, the message "Registration completed" will be displayed.

[0983] Step 3: Add friends and enter basic information

[0984] When a user registers as a friend on a company's official account, the device displays a form for the user to enter basic information (gender, age, interests). After the user enters the information and presses the submit button, the device sends the data to the server.

[0985] Input: User's basic information (gender, age, interests)

[0986] Data processing: The server analyzes the user's basic information and stores it in a database

[0987] Output: User information registration result

[0988] Specific behavior: When the user submits the form, the message "Basic information has been submitted" is displayed. After the server saves the data to the database, the user is notified that "Registration is complete."

[0989] Step 4: Send user data

[0990] The device sends the user's basic information to the server, which analyzes the received data to generate a user profile and saves it in a database.

[0991] Input: Basic information transmission request

[0992] Data processing: The server analyzes the information and generates a user profile

[0993] Output: User profile saved

[0994] Specific behavior: "User data received" is recorded in the server log. After the user profile is generated, "User profile generated" is recorded in the server log.

[0995] Step 5: Matching promotions to user profiles

[0996] The server matches the promotion proposal with user profiles stored in the database, selects users who meet the matching criteria, and creates a promotion distribution list.

[0997] Input: Promotion proposals and user profile database

[0998] Data processing: The server runs a matching algorithm and generates a distribution list

[0999] Output: Promotion distribution list

[1000] Specific behavior: "Matching promotions with user profile..." is displayed, and after the match is complete, "Matching results generated" is recorded in the server log.

[1001] Step 6: Sending and displaying notifications

[1002] The server notifies selected users of the promotion proposal based on the promotion distribution list, and the device displays the notification to the user and provides detailed information.

[1003] Input: Promotional Distribution List

[1004] Data processing: The server generates a notification message and sends it to each device.

[1005] Output: A notification is displayed on the user's device

[1006] What it does: A notification will appear on your device saying "There's a new promotion" and a link to the details page.

[1007] Step 7: Selecting Premium Members

[1008] The server periodically checks the activity status of premium members and selects premium members who meet the target conditions of the advertising campaign.

[1009] Input: Premium member activity data

[1010] Data processing: The server analyzes the activity data and selects targets based on the conditions.

[1011] Output: Premium Member List

[1012] Specific operation: "Selecting premium members..." is displayed, and after the selection is complete, "The list of selected premium members has been generated" is recorded in the server log.

[1013] Step 8: Create a list of ad serving

[1014] The server creates an ad distribution list, which includes selected premium members.

[1015] Input: Ad campaign data and premium membership list

[1016] Data processing: The server generates an ad distribution list and saves it in the database

[1017] Output: Ad delivery list

[1018] Specific behavior: "Ad delivery list created" is recorded in the log.

[1019] Step 9: Ad serving and notification

[1020] The server delivers the advertisement to the selected premium member, and the device displays a notification to the premium member requesting to view the advertisement and provides a link to a page with more details.

[1021] Input: Ad delivery list

[1022] Data processing: The server generates advertising delivery messages and sends them to each device.

[1023] Output: A notification will be displayed on the premium member's device.

[1024] Specific behavior: "There is a new ad" will be displayed in the notification bar, along with a link to the details page.

[1025] Step 10: Notification of ad completion and reward

[1026] The user watches the ad and sends a notification of completion to the server, which then verifies the completion and credits the reward to the user's account.

[1027] Input: Ad viewing completion notification

[1028] Data processing: The server checks the viewing completion data and calculates reward points

[1029] Output: Reward credited to user account

[1030] Specific operation: "Viewing completed. Reward points will be awarded" will be displayed on the device.

[1031] Step 11: Collect emotion data

[1032] The emotion analysis engine collects emotional data from the user's facial expressions, tone of voice, and text, and sends this data to the server in real time.

[1033] Input: User's emotional expression data

[1034] Data processing: The emotion analysis engine analyzes the data and determines the emotional state

[1035] Output: Sentiment analysis result data

[1036] Specific operation: "Analyzing emotion data..." is displayed, and after analysis, "Emotion data sent" is displayed.

[1037] Step 12: Reflecting and utilizing emotional data

[1038] The server reflects the emotional data in the user profile and uses it to match promotions and advertisements. For example, if a user looks happy while viewing a promotion, that data can be used to deliver the next promotion or advertisement.

[1039] Input: Sentiment analysis data

[1040] Data processing: The server adds emotional data to the user profile and reflects it in the matching algorithm.

[1041] Output: Updated user profile and improved matching results

[1042] Specific operation: "Emotion data saved" is recorded in the log and will be used effectively for the next delivery.

[1043] (Application example 2)

[1044] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1045] Existing promotion systems generally involve a company representative registering promotion ideas and users receiving them, making it difficult to deliver optimal ads that take into account the user's real-time emotional state. Furthermore, because ads are not displayed based on user emotions, a personalized user experience is not provided, limiting the effectiveness of advertising. As a result, it is difficult for companies to conduct more effective promotions, and users often end up viewing ads that do not interest them.

[1046] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a company representative to register promotion proposals, a means for a user to register a company account as a friend and create an individual profile, a means for matching the promotion proposals with the user profile and delivering optimized promotions to the user, a means for an advertiser to send advertisements to premium members and for the premium members to earn rewards by viewing the advertisements, and a means for analyzing user emotions in real time and displaying advertisements based on the analysis results. This enables optimal advertisement delivery that takes into account the user's real-time emotional state, allowing companies to carry out more effective promotions and users to view more interesting advertisements.

[1047] The "means for company personnel to register promotion proposals" refers to an interface and tools that allow company marketing personnel to input and register new promotions and advertising campaigns into the system.

[1048] "Means for users to add a company's account as a friend and create a unique profile" refers to the process and tools by which users can register in the system, enter the individual information required to receive the company's advertising and promotions, and create their own unique profile.

[1049] "Means for matching the promotion proposals with the user's profile and delivering optimized promotions to the user" refers to an algorithm and system for comparing registered promotion proposals with the user's profile information and delivering the most suitable promotions to the user.

[1050] "Means for advertisers to send advertisements to premium members, who then receive rewards by viewing the advertisements" refers to a system in which advertisements are sent to specific user ranks (premium members), and those users can receive reward points or other incentives by viewing the advertisements.

[1051] "Means for analyzing user emotions in real time and displaying advertisements based on the analysis results" refers to a system and algorithm that uses devices such as cameras and microphones to analyze emotions from users' facial expressions, tone of voice, text, etc., and selects and displays the most appropriate advertisements in real time based on that data.

[1052] System Overview

[1053] This invention is a system that allows company personnel to easily register promotional ideas and delivers optimized advertisements to users using an emotion engine. Users can earn rewards by viewing advertisements as premium members. Specific embodiments of this system are described below.

[1054] Hardware and software used

[1055] Hardware: Smart glasses, camera, microphone, server terminal

[1056] Software: Sentiment analysis engine, promotion matching algorithm, ad distribution server

[1057] Technologies used: Open source libraries (e.g., OpenCV), HTTP request libraries (e.g., requests)

[1058] System configuration

[1059] 1. Server

[1060] The server registers promotion ideas, manages the database, analyzes user profiles, matches and delivers promotions and advertisements, and processes emotional data using an emotion analysis engine.

[1061] 2. Terminal

[1062] The terminal is an interface between company representatives and users. Company representatives use the terminal to register promotion ideas, and users register friends, watch advertisements, and provide emotional data.

[1063] 3. Users

[1064] Users are individuals who add a company's official account as a friend and receive promotional information and advertisements. In particular, premium members can earn rewards by watching advertisements.

[1065] 4. Emotion Engine

[1066] The emotion engine analyzes the user's facial expressions, tone of voice, and text sentiment to collect real-time emotional data.

[1067] Program processing

[1068] The server uses the emotion engine to analyze the user's emotions in real time and delivers the most suitable advertisements to the user based on the analysis results, which includes the following steps:

[1069] Data capture: Smart glasses or a camera capture the user's facial expressions, and a microphone captures the tone of voice.

[1070] Sentiment analysis: The captured data is sent to an emotion engine for real-time emotion analysis.

[1071] Promotion Matching: Matching with the best promotion ideas based on sentiment data and user profiles.

[1072] Advertisement delivery: Displaying matched promotions on the user's smart glasses.

[1073] Specific examples

[1074] Registration of promotion proposal: A company representative registers, for example, a "Summer Sale Campaign." Details include the campaign name, period, target audience, content, etc.

[1075] Creating a user profile: A 20-year-old female user adds a friend and states that she is interested in "fashion" and "beauty." The emotion engine analyzes her facial expressions and detects smiles.

[1076] Advertisement delivery: Based on the emotional data, the server determines that the "Summer Sale Campaign" is most suitable for female users in their 20s and displays the advertisement on the smart glasses.

[1077] Prompt Sentence Examples

[1078] Demonstrate a program that analyzes a user's facial expressions in real time and displays the most appropriate advertisement on smart glasses based on the emotional data. If the user is enjoying themselves, display a trailer advertisement for a new movie. The APIs used include an emotion analysis engine (Emotion API) and an advertisement server.

[1079] This provides a personalized advertising experience that takes into account users' real-time emotions, allowing businesses to run more effective promotions and users to receive ads based on their interests.

[1080] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1081] Step 1:

[1082] A company representative registers a promotion proposal. Using a terminal, the company representative enters the details of the promotion proposal (campaign name, period, target audience, content). The entered promotion proposal data is sent to the server, which stores this data in a database. The input is the detailed information of the promotion proposal, and the output is the promotion proposal stored in the database.

[1083] Step 2:

[1084] A user adds a friend to a company's account. The user uses their device to enter basic information (gender, age, interests). This information is sent to a server, which analyzes the user data and creates an individual user profile. The input is the user's basic information, and the output is the user profile stored in a database.

[1085] Step 3:

[1086] Emotion data capture. Smart glasses or a camera capture the user's facial expressions, and a microphone captures the tone of voice. These data are transmitted from the device to the server in real time. The input is the user's facial image and voice data, and the output is the raw data used for emotion analysis.

[1087] Step 4:

[1088] Emotion analysis. The server uses an emotion analysis engine to analyze the captured data (facial expression images and voice data) and generate real-time emotional data of the user. The input is facial expression images and voice data, and the output is the analyzed emotional data. Specifically, the emotion analysis engine analyzes the image and voice data and identifies the user's emotional state, such as "happiness" or "excitement."

[1089] Step 5:

[1090] Promotion Matching: The server matches optimal promotion suggestions to users based on the generated emotion data and user profile. The input is emotion data and user profile, and the output is optimal promotion suggestions. Specifically, the server matches the promotion suggestion database with the user profile database and selects promotions that match the user's current emotional state.

[1091] Step 6:

[1092] Advertisement delivery. Once the optimal promotional plan is determined, the server displays the promotion on the smart glasses. The input is the optimal promotional plan, and the output is the advertisement displayed to the user. Specifically, the server sends the selected promotional data to the smart glasses and displays it in real time so that the user can view the advertisement directly.

[1093] Step 7:

[1094] Reward allocation. When a user watches an ad, the smart glasses or device sends a completion notification to the server. The server verifies the completion information and allocates rewards to the premium member user's account. The input is the ad completion notification, and the output is the reward points allocated to the user's account. Specifically, the server updates the reward management system after receiving the completion notification and adds points to the premium member's account.

[1095] This allows businesses to run effective promotions, users to receive optimal ads based on emotional data in real time, and premium members can earn rewards by watching ads, improving the user experience.

[1096] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1097] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1098] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1099] [Third embodiment]

[1100] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1101] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1102] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1103] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1104] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1105] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1106] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1107] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1108] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1109] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1110] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1111] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1112] This invention is a system that allows company personnel to easily register promotion ideas and deliver optimized promotions to users. In addition, premium members can earn rewards by viewing advertisements. An embodiment of this system will be described.

[1113] System Configuration

[1114] 1. Server

[1115] The server is the core system that registers promotion ideas, manages the database, analyzes user profiles, matches promotions with advertisements, and distributes them.

[1116] 2. Terminal

[1117] The terminal is a device (such as a smartphone or PC) that acts as an interface between the company's representative and the user. This allows the representative to register promotion ideas, and the user to add friends and watch advertisements.

[1118] 3. Users

[1119] Users are consumers who add a company's official account as a friend and create individual profiles. In particular, premium members can watch advertisements and earn rewards.

[1120] Program processing

[1121] 1. Promotion proposal registration

[1122] The terminal provides a screen for the company's representative to input details of the promotion proposal. When the representative inputs the promotion proposal and presses the send button, the data is sent to the server.

[1123] The server analyzes the received promotion data and stores it in a database.

[1124] 2. User data collection and profiling

[1125] When a user adds a company's official account as a friend, the device prompts them to enter basic data (gender, age, interests).

[1126] The device sends the collected data to a server, which then creates a user profile based on that data.

[1127] 3. Promotion Matching and Delivery

[1128] The server matches registered promotion ideas with user profiles. For example, a summer sale campaign aimed at women in their 20s matches a profile of a 20-year-old woman.

[1129] When a match is made, the server delivers the promotion to the user's device, and the device displays a notification to the user.

[1130] 4. Delivery of advertisements to premium members and rewards

[1131] The server checks the activity status of premium members and delivers advertisements from advertisers to active premium members.

[1132] When a user views an advertisement, the terminal sends a viewing completion signal to the server, which then confirms the signal.

[1133] The server calculates the reward based on the viewing completion information and adds the reward information to the user profile.

[1134] Specific examples

[1135] 1. Example of promotion proposal registration

[1136] A company representative registers a summer sales campaign, for example, by entering information such as "Summer sale, July 1st to July 31st, for women in their 20s, discount coupon" into the terminal.

[1137] This data is sent to a server and stored in a database.

[1138] 2. Example of a User Profile

[1139] A 20-year-old female user adds a friend and lists "fashion" and "beauty" as her interests.

[1140] The server uses this information to generate a user profile.

[1141] 3. Examples of promotional distribution

[1142] The server matches the "Summer Sale Campaign" to this user.

[1143] The device will send the user a "Summer Sale Announcement" notification and display details within the app.

[1144] 4. Examples of Ad Viewing and Rewards

[1145] A 20-year-old female premium member watches an advertisement for a new cosmetic product.

[1146] The server checks the viewing completion information and awards reward points to the user.

[1147] In this way, businesses can efficiently promote themselves, users can receive information that matches their interests, and enjoy the benefits of premium membership.

[1148] The processing flow will be explained below.

[1149] Step 1: Submit your promotion proposal

[1150] The terminal displays a login screen to the company's personnel and prompts them to enter their authentication information.

[1151] The terminal transmits the entered authentication information to the server.

[1152] The server verifies the credentials and allows the agent to log in.

[1153] The device displays a form that asks the person in charge to enter details of the promotion proposal (campaign name, period, target audience, content).

[1154] The person in charge enters the details of the promotion proposal and presses the send button.

[1155] The terminal transmits the input promotion proposal data to the server.

[1156] The server checks the received promotion data and stores it in a database.

[1157] The server notifies the terminal that saving to the database is complete.

[1158] Step 2: Collecting user data and creating profiles

[1159] A user adds a company's official account as a friend.

[1160] The device displays a form that asks the user to enter basic information (gender, age, interests).

[1161] The user enters basic information and presses the submit button.

[1162] The terminal sends the entered basic information to the server.

[1163] The server analyzes the received user data and creates a user profile.

[1164] The server stores the created user profile in a database.

[1165] The server notifies the terminal that the user profile has been saved.

[1166] Step 3: Promotion Matching and Delivery

[1167] The server performs a matching process to match promotion offers with user profiles.

[1168] The server selects users who meet the criteria of the target audience.

[1169] The server creates a promotion distribution list for the selected users.

[1170] The server sends the promotion proposal to the selected users.

[1171] The terminal displays the promotion notification to the user and provides a screen for displaying more information.

[1172] Step 4: Delivering ads to premium members and rewarding them

[1173] The server periodically checks the activity status of premium members.

[1174] Advertisers register details of their advertising campaigns with the server.

[1175] The server matches the premium member's profile with the advertiser's targeting criteria.

[1176] The server creates an advertisement distribution list for premium members who match the target.

[1177] The server distributes advertisements to selected premium members.

[1178] The device will display a notification to the premium member that they have viewed an ad and provide a link to the ad's details page.

[1179] The user watches the advertisement and presses the "Complete viewing" button.

[1180] The terminal transmits a viewing completion signal to the server.

[1181] The server checks the advertisement viewing completion information and gives a reward to the premium member's account.

[1182] The server notifies the terminal that the reward has been granted.

[1183] Example 1

[1184] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1185] Today's businesses need to effectively promote their target users and increase user engagement, but traditional methods involve uniform distribution of promotions and advertisements, making it difficult to optimize for each individual user. Furthermore, managing the rewards that premium members receive for viewing advertisements is also time-consuming. There is a need to solve these issues and provide a system that is convenient for both businesses and users.

[1186] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1187] In this invention, the server includes: a means for a company representative to register promotion proposals; a means for a user to register a company account as a friend and create an individual profile by entering basic data; a means for transmitting detailed information about the promotion proposals and for the server to analyze the data and store it in a database; a means for the server to match the promotion proposals with user profiles, deliver the matched promotions to the user terminal and display a notification; and a means for an advertiser to send advertisements to premium members, and for the server to calculate rewards when premium members view the advertisements and add reward information to the profile. This makes it possible to individually optimize and deliver company promotion proposals to target users and automatically manage rewards for viewing advertisements for premium members.

[1188] "Company representative" refers to a person in a company who is responsible for creating and managing promotion proposals.

[1189] "Promotion Proposal" means detailed information about a plan or campaign aimed at promoting a product or service.

[1190] "Friend registration" refers to the act of a user following an official account, enabling two-way communication.

[1191] "Basic data" refers to individual information about a user, such as their gender, age, and interests.

[1192] An "individual profile" is individual characteristic information based on a user's basic data and behavioral history.

[1193] "Server" means a computer system that stores, analyzes data, and matches promotional offers with user profiles.

[1194] A "database" is an information collection system for storing and managing promotional ideas and user profile data.

[1195] "Matching" refers to the process of matching promotion ideas with user profiles.

[1196] "User terminal" refers to the interface device used by the user (e.g., smartphone, personal computer).

[1197] "Notification" means a message sent to a User to inform them of promotional information.

[1198] "Advertiser" means an individual or entity that pays compensation to advertise a product or service.

[1199] A "premium membership" is a paid membership that allows you to enjoy more benefits and additional features than regular users.

[1200] "Ad viewing" means the act of a user visually or audibly viewing the transmitted advertising content.

[1201] "Rewards" refer to points or benefits provided based on user actions such as watching advertisements.

[1202] This invention is a system that allows company personnel to easily register promotion ideas and deliver optimized promotions to users. In addition, premium members can earn rewards by viewing advertisements. The following describes in detail the embodiments for implementing this system.

[1203] System Configuration

[1204] 1. Server

[1205] Role: The server is the core system that registers promotion ideas, manages the database, analyzes user profiles, matches promotions and advertisements, and distributes them.

[1206] Software used: MySQL (database management), Python (data analysis), HTTP server (request processing)

[1207] 2. Terminal

[1208] Role: A terminal is a device (e.g., smartphone, PC) that acts as an interface between company personnel and users.

[1209] Software used: Web browser (interface provided), HTTP client (data transmission)

[1210] 3. Users

[1211] Role: Users are consumers who add a company's official account as a friend and create a personalized profile. Premium members, in particular, can watch ads and earn rewards.

[1212] Program processing

[1213] Promotion proposal registration

[1214] Company representative actions: The company representative enters details of the promotion proposal on the terminal.

[1215] Server processing: The device sends the entered promotion proposal to the server via an HTTP POST request, and the server analyzes this data and stores it in a database.

[1216] Example: A company representative inputs a promotional idea such as "Summer sale, July 1st to July 31st, for women in their 20s, discount coupon" into a terminal and sends it.

[1217] User Data Collection and Profiling

[1218] User behavior: A user adds a company's official account as a friend and enters basic data (gender, age, interests).

[1219] Server processing: The device sends the collected data to the server via an HTTP POST request, and the server creates a user profile based on that data and stores it in a database.

[1220] Example: A 20-year-old female user registers as a friend and enters her gender, age, and interests in "fashion" and "beauty."

[1221] Promotion Matching and Delivery

[1222] Server process: The server matches the promotion proposal with the user profile. If the conditions are met, the promotion is sent to the user's device and a notification is displayed.

[1223] Example: The server matches a "Summer Sale Campaign" to a 20-year-old female user, and the device displays a notification as a "Summer Sale Announcement."

[1224] Delivery of advertisements and rewards for premium members

[1225] Server processing: The server checks the activity status of the premium member and sends advertisements. When the user watches the advertisement, it sends a completion signal to the server, calculates the reward, and adds the reward information to the user profile.

[1226] Example: A 20-year-old female premium member watches an advertisement for a new cosmetic product, a viewing completion signal is sent to the server, and reward points are added to her profile.

[1227] Prompt Sentence Examples

[1228] Below are some example prompts that the system uses in its generative AI model:

[1229] "Please enter the details of your promotion idea. Example: Summer sale, July 1st to July 31st, for women in their 20s, discount coupon."

[1230] "Please enter your basic information. For example: Gender: Female, Age: 20, Interests: Fashion, Beauty"

[1231] In this way, companies can efficiently promote themselves, users can receive information that matches their interests, and enjoy the benefits of being a premium member.

[1232] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1233] Specific steps of the program's processing

[1234] Step 1: Enter your promotion idea

[1235] Company representative actions: The company representative enters details of the promotion proposal on the terminal.

[1236] Input: Promotion name, start date, end date, target user, and promotion details

[1237] What happens: The terminal displays the details entered based on the form, and the agent fills in these details. Once the agent has finished entering the information, he clicks the submit button.

[1238] Output: Promotion data collected by the device

[1239] Step 2: Submit and save your promotion proposal

[1240] Device action: The device sends a promotion proposal to the server.

[1241] Input: Promotion data collected in step 1

[1242] Specific operation: The device makes an HTTP POST request and sends the promotion data to the server.

[1243] Output: Promotion data received by the server

[1244] Step 3: Analyze and save promotion ideas

[1245] Server Actions: The server analyzes the promotion data received and stores it in a database.

[1246] Input: Promotion data received in step 2

[1247] What happens: The server parses the data using a data parsing script (e.g. Python) and converts it into an appropriate format. It then stores the parsed data in a database (e.g. MySQL).

[1248] Output: Promotion data stored in a database

[1249] Step 4: Add users as friends and enter basic data

[1250] User behavior: A user adds a company's official account as a friend and enters basic data (gender, age, interests).

[1251] Input: User's gender, age, interests

[1252] What happens: The device displays a friend registration button, and when the user clicks it, a basic data entry form appears. The user fills in the information in each field and clicks the submit button.

[1253] Output: User data collected by the device

[1254] Step 5: Submitting user data and creating a profile

[1255] Device action: The device sends user data to the server.

[1256] Input: User data collected in step 4

[1257] Specific operation: The device makes an HTTP POST request and sends user data to the server, which receives and analyzes the data.

[1258] Output: Server generates profile data

[1259] Step 6: Save your profile data

[1260] Server actions: The server creates a profile based on the analyzed user data and stores it in a database.

[1261] Input: Profile data generated in step 5

[1262] Specific operation: The server analyzes user data, generates a profile, and stores the profile in a database.

[1263] Output: User profile stored in the database

[1264] Step 7: Matching promotions to user profiles

[1265] Server Action: The server matches promotion ideas with user profiles.

[1266] Input: Promotion ideas and user profiles stored in the database

[1267] What happens: The server runs an SQL query to find user profiles that match the promotion offer.

[1268] Output: Matching result data

[1269] Step 8: Promotion Delivery and Notification

[1270] Server Action: The server delivers the matched promotion to the user device.

[1271] Input: Matching result data generated in step 7

[1272] Specific operation: The server generates a notification message and sends it to the device via an HTTP PUSH request. The device displays the push notification.

[1273] Output: Notification message displayed on the terminal

[1274] Step 9: Check your Premium Membership Activity

[1275] Server Action: The server checks the activity status of premium members.

[1276] Input: Premium member data stored in the database

[1277] What it does: The server periodically checks the database to generate a list of active premium members.

[1278] Output: Active members list

[1279] Step 10: Serving Ads

[1280] Server Action: The server delivers ads to active premium members.

[1281] Input: Active Member List generated in Step 9

[1282] Specific operation: The server retrieves advertising content from the advertising database and sends it to the device via an HTTP PUSH request.

[1283] Output: Ad displayed on device

[1284] Step 11: Record your ad views and rewards

[1285] User action: The user watches the ad and sends a completion signal to the server.

[1286] Input: Information about the ad the user watched

[1287] Specific operation: When the user clicks the "Complete" button on the device, the completion information is sent to the server via an HTTP POST request. The server analyzes the completion data, calculates the reward, and adds it to the user's profile.

[1288] Output: Added reward information

[1289] (Application example 1)

[1290] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1291] Conventional promotion systems lack real-time and interactivity in the means of appropriately matching and delivering promotions registered by company personnel to users. Additionally, incentives for premium members who earn rewards by viewing advertisements are limited, making it difficult to deliver advertisements that effectively match users' interests.

[1292] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1293] In this invention, the server includes a means for a company representative to register promotion proposals, a means for a user to register a company account as a friend and create an individual profile, a means for matching the promotion proposals with the user profile and delivering promotions optimized for the user, a means for an advertiser to send advertisements to premium members and for premium members to earn rewards by viewing the advertisements, a means for displaying the optimized advertisements on the smart device in real time, and a means for displaying detailed information through the smart device in response to user operations, thereby enabling advertisement delivery that is both real-time and interactive.

[1294] "Company Representative" means an individual or group of individuals within a Company who are responsible for organizing and registering a Promotion.

[1295] A "Promotion Proposal" is detailed information about a campaign that a company plans and registers to promote a particular product or service.

[1296] A "user" is a consumer who adds a company's account as a friend, creates a personal profile, and receives its promotions and advertisements.

[1297] A "profile" is an individual data set created based on a user's basic information, interests, and behavioral data.

[1298] "Matching" is the process of comparing registered promotion proposals with a user's profile and selecting an appropriate promotion based on matching factors.

[1299] A "premium member" is a user who, unlike a regular user, has the privilege of earning rewards by watching certain advertisements.

[1300] A "smart device" is an electronic device that can communicate and process information when worn or used by a user, and includes smart glasses and smartphones.

[1301] "Real-time" is a temporal concept that indicates near-instant processing or delivery without delay.

[1302] "Operation" means input or instruction given by a user using a device, including, for example, tapping, swiping, or eye movement.

[1303] This invention is a system that uses smart devices to deliver corporate promotional ideas to users in real time, providing an interactive advertising experience.

[1304] System Configuration

[1305] 1. Server

[1306] Hardware and software: The server uses a database management system (e.g., MySQL) and a program execution environment (e.g., Python). The server receives promotion proposals registered by company personnel, stores the data in a database, and manages them. It also analyzes user profiles and is responsible for matching and delivering promotions and advertisements.

[1307] 2. Terminal

[1308] Hardware and software: The device is the interface with the user (e.g., smart glasses, smartphone, PC). The device has the smart glasses SDK (e.g., Google Glass API) and mobile app installed, where company representatives input promotion ideas and users can add friends and watch ads.

[1309] Program Processing

[1310] 1. Promotion proposal registration

[1311] Server: The server receives the promotion proposal data sent by the company representative and stores it in a database.

[1312] Terminal: The terminal provides a screen where company personnel can enter details of their promotion proposal.

[1313] 2. User data collection and profiling

[1314] Terminal: The terminal provides the user with an input screen where they can enter basic data (gender, age, interests).

[1315] Server: The server receives user data sent from the device and creates a user profile based on that data.

[1316] 3. Promotion Matching and Delivery

[1317] Server: The server matches registered promotion ideas with user profiles and selects appropriate promotions.

[1318] Terminal: The terminal delivers ads optimized for the user's smart device in real time, allowing the user to interact with the ads through the device.

[1319] 4. Delivery of advertisements to premium members and rewards

[1320] Server: The server checks the activity status of premium members, delivers ads to active premium members, and verifies the completion of ad viewing and awards reward points to users.

[1321] Device: When a user watches an ad, it sends a viewing completion signal to the server and checks the status of reward points awarded.

[1322] Specific examples

[1323] 1. Example of promotion proposal registration

[1324] Company representative: Register a promotional proposal that reads, "Autumn / Winter collection on sale from October 1st to October 31st, aimed at women in their 20s."

[1325] Server: Stores this information in a database.

[1326] 2. Example of a User Profile

[1327] User: A 25-year-old woman who is interested in fashion adds the user as a friend.

[1328] Server: Generates a user profile based on this input information.

[1329] 3. Examples of promotional distribution

[1330] Server: Matches registered Fall / Winter collection promotions to the appropriate user profile.

[1331] Device: Smart glasses display "Autumn / Winter Collection Now On Sale!" and display advertisement details based on eye and head movements.

[1332] 4. Examples of Ad Viewing and Rewards

[1333] User: Habit, a 25-year-old female premium member watches an advertisement for a new cosmetic product.

[1334] Server: Checks the viewing completion information and awards reward points.

[1335] Prompt Sentence Examples

[1336] "Generate the best promotional text to send to a 25-year-old female user who is interested in fashion, offering a 10% discount on new gloves."

[1337] Such a system allows businesses to carry out effective promotional activities, allows users to interactively experience advertisements tailored to their interests, and allows them to receive rewards.

[1338] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1339] Step 1:

[1340] [Register promotion proposal]

[1341] Input: A company representative inputs a promotion proposal (e.g., "Fall / Winter collection release, October 1st to October 31st, for women in their 20s")

[1342] Operation: The terminal provides an interface that allows company personnel to input details of promotion proposals and transmits the input data to a server.

[1343] Output: The server receives the promotion proposals and stores them in a database.

[1344] Data processing / calculation: The content of the promotion proposal is analyzed and stored in the database in an appropriate format.

[1345] Step 2:

[1346] [User Data Collection and Profiling]

[1347] Input: User basic data (gender, age, interests)

[1348] How it works: The device provides the user with an interface for registering friends and prompts them to enter basic information.

[1349] Output: Basic data is sent to the server and a user profile is created.

[1350] Data processing / calculation: Based on the entered user data, the server organizes and saves the user profile in a format suitable for storing in the database.

[1351] Step 3:

[1352] [Promotion Matching and Delivery]

[1353] Input: Promotion idea and user profile

[1354] How it works: The server retrieves promotion ideas and user profiles from the database and performs matching using the corresponding algorithm.

[1355] Output: Matched promotions are sent to the user's device.

[1356] Data processing / calculation: The server selects the most suitable promotions based on the user profile interests and past behavioral data, and delivers this information to the user's smart device in real time.

[1357] Step 4:

[1358] [Real-time ad display and interaction]

[1359] Input: Matched promotion data

[1360] How it works: The device displays ads in real time on smart glasses or smartphones and accepts user interaction. Users can view the details of the ads through the device.

[1361] Output: The ad content is displayed to the user, and further details are displayed based on the user's actions.

[1362] Data processing / calculation: Data is updated in real time to display detailed information in response to user input.

[1363] Step 5:

[1364] [Premium member activity check, ad delivery, and rewards]

[1365] Input: Premium member status data, ad viewing data

[1366] How it works: The server checks the activity status of premium members and delivers ads to active members. When a user watches an ad, the completion data is sent to the server, which calculates the reward and reflects it in the profile.

[1367] Output: Reward information added to premium member profile.

[1368] Data processing / calculation: The server calculates rewards based on the viewing completion data and reflects them as reward points in the user profile.

[1369] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1370] This invention achieves a higher level of personalization by combining an emotion engine with a system that allows company personnel to easily register promotion ideas and deliver optimized promotions to users. In addition, premium members can earn rewards by viewing advertisements. A specific embodiment of this system will now be described.

[1371] System Configuration

[1372] 1. Server

[1373] The server plays a central role in registering promotion ideas, managing the database, analyzing user profiles, matching and delivering promotions and advertisements, and processing emotional data using an emotion engine.

[1374] 2. Terminal

[1375] The terminal is an interface between company representatives and users. Representatives use the terminal to register promotion ideas, and users register friends, watch advertisements, and provide emotional data.

[1376] 3. Users

[1377] Users are individuals who add a company's official account as a friend and receive promotional information and advertisements. In particular, premium members can earn rewards by watching advertisements.

[1378] 4. Emotion Engine

[1379] The emotion engine is a component that analyzes the user's facial expressions, tone of voice, and text emotions to collect real-time emotional data from the user.

[1380] Program processing

[1381] 1. Promotion proposal registration

[1382] The terminal displays a login screen to the company representative and asks them to enter their authentication information. After the representative logs in, they are provided with a form to enter details of the promotion proposal (campaign name, period, target audience, content).

[1383] The person in charge enters a promotion proposal and presses the send button. The terminal sends the entered promotion proposal data to the server, which then stores the data in a database.

[1384] 2. User data collection and profiling

[1385] When a user registers as a friend on a company's official account, the device displays a form for entering basic information (gender, age, interests, etc.) Once the user enters the information and presses the submit button, the device sends the data to the server.

[1386] The server analyzes the user data, creates a user profile, and stores it in a database.

[1387] 3. Promotion Matching and Delivery

[1388] The server performs a matching process to match the promotion proposal with user profiles, selects users who meet the matching criteria, and creates a promotion distribution list for the selected users.

[1389] The server will distribute the promotion proposal to the selected users, and the device will display a notification to the users, allowing them to check the details.

[1390] 4. Delivery of advertisements to premium members and rewards

[1391] The server periodically checks the activity status of premium members. Advertisers register details of their advertising campaigns with the server, and the server selects premium members who meet the targeting criteria and creates an advertising distribution list.

[1392] The server distributes advertisements to the selected premium members, and the terminal displays a notice of advertisement viewing to the premium members and provides a link to a detailed page.

[1393] The user watches the ad and notifies the server that they have completed watching. The server then verifies the completion information and credits the reward to the user's account.

[1394] 5. Leveraging Emotional Engines

[1395] The emotion engine recognizes emotions from users' facial expressions, tone of voice, and text. Emotional data is reflected in user profiles and used to match promotions and advertisements.

[1396] For example, if a user looks happy while viewing a promotion, that emotional data is sent to the server and used to improve the accuracy of the next promotion or advertisement.

[1397] Specific examples

[1398] 1. Example of promotion proposal registration

[1399] The person in charge registers a summer sale campaign, for example, "Summer sale, July 1st to July 31st, for women in their 20s, discount coupon," and enters details into the terminal and submits them.

[1400] This data is sent to a server and stored in a database.

[1401] 2. Example of a User Profile

[1402] A 20-year-old female user adds a friend and lists "fashion" and "beauty" as her interests. The emotion engine analyzes the user's facial expressions and detects smiles.

[1403] The server uses this information to generate a user profile and stores it in a database.

[1404] 3. Examples of promotional distribution

[1405] The server matches the "Summer Sale Campaign" with the profile of a 20-year-old female user, taking into account emotional data that indicates the user looks happy.

[1406] The device will send the user a "Summer Sale Announcement" notification and display more information within the app.

[1407] 4. Examples of Ad Viewing and Rewards

[1408] A 20-year-old female premium member watches an advertisement for a new cosmetic product. The emotion engine detects the user's emotions (e.g., excitement, interest) while watching the advertisement.

[1409] The server calculates reward points based on viewing completion information and emotional data and awards them to the user.

[1410] In this way, companies can run effective promotions and users can receive information and rewards that match their interests. By combining this with an emotion engine, a more personalized experience can be provided.

[1411] The processing flow will be explained below.

[1412] Step 1: Submit your promotion proposal

[1413] The terminal displays a login screen to the company's personnel and prompts them to enter their authentication information.

[1414] The terminal transmits the entered authentication information to the server.

[1415] The server verifies the credentials and allows the agent to log in.

[1416] The device displays a form that asks the person in charge to enter details of the promotion proposal (campaign name, period, target audience, content).

[1417] The person in charge enters the details of the promotion proposal and presses the send button.

[1418] The terminal transmits the input promotion proposal data to the server.

[1419] The server checks the received promotion data and stores it in a database.

[1420] The server notifies the terminal that saving to the database is complete.

[1421] Step 2: Add friends and collect basic information

[1422] A user adds a company's official account as a friend.

[1423] The device displays a form that asks the user to enter basic information (gender, age, interests).

[1424] The user enters basic information and presses the submit button.

[1425] The terminal sends the entered basic information to the server.

[1426] The server analyzes the received user data and creates a user profile.

[1427] The server stores the created user profile in a database.

[1428] The server notifies the terminal that the user profile has been saved.

[1429] Step 3: Collect user sentiment data

[1430] The device captures the user's facial expressions and tone of voice in real time.

[1431] The emotion engine analyzes the captured facial expressions and tone of voice to generate emotional data for the user.

[1432] The terminal transmits the generated emotion data to the server.

[1433] The server analyzes the emotional data and adds or updates it to the user profile.

[1434] Step 4: Matching promotions with user profiles

[1435] The server performs a matching process that matches promotion proposals with user profiles and emotion data.

[1436] The server filters the best users based on the target audience criteria and sentiment data.

[1437] The server generates an optimal user list and delivers promotions to the target users.

[1438] Step 5: Serving your promotion

[1439] The server sends the promotion proposal to the selected users.

[1440] The device will display a promotional notification to the user and provide a screen where they can view more information.

[1441] Step 6: Delivering ads to premium members and rewarding them

[1442] The server periodically checks the activity status of premium members.

[1443] Advertisers register details of their advertising campaigns with the server.

[1444] The server compares the profiles and emotion data of the premium members and selects premium members who meet the target conditions.

[1445] The server distributes advertisements to selected premium members.

[1446] The device will display a notification to premium members that they have watched an ad and provide a link to a page with more details.

[1447] The user watches the advertisement and presses the "Complete viewing" button.

[1448] The terminal transmits a viewing completion signal to the server.

[1449] The server checks the advertisement viewing completion information and gives a reward to the premium member's account.

[1450] The server notifies the terminal that the reward has been granted.

[1451] Through this process, companies can efficiently promote themselves, and users can receive information and rewards based on their interests and emotions.

[1452] Example 2

[1453] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1454] Conventional promotion systems not only required a lot of work to match promotion ideas registered by company representatives with user profiles, but the results were often not properly optimized for users. Furthermore, systems that allow premium members to earn rewards by viewing advertisements lacked personalization that took user emotions into account. Therefore, there was a need for more accurate and personalized promotions and ad delivery.

[1455] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for a company representative to register a promotion proposal, a means for a user to register a company account as a friend and create an individual profile, a means for matching the promotion proposal with the user's profile and delivering an optimized promotion to the user, a means for an advertiser to send advertisements to premium members and for the premium members to earn rewards by viewing the advertisements, and a means for collecting user emotion data using an emotion analysis engine and reflecting the data in the profile. This enables personalized promotions and advertisement delivery based on the user's emotions and interests.

[1456] "Company Representative" means the employee responsible for registering promotion proposals and managing the implementation of the campaign.

[1457] A "user" is an individual who adds a company's account as a friend and receives promotional information and advertisements.

[1458] A "promotion proposal" is a proposal that includes details of a campaign to be implemented by a company (campaign name, period, target audience, content).

[1459] A "profile" is individual data that compiles a user's basic information, behavioral data, and interests.

[1460] "Matching" is the process of matching promotion ideas with user profiles and selecting appropriate promotions.

[1461] "Advertiser" means a company that provides advertisements to premium members.

[1462] "Premium members" are special users who can earn rewards by watching advertisements.

[1463] An "emotion analysis engine" is a system that analyzes a user's emotions from facial expressions, tone of voice, and text, and collects data.

[1464] "Rewards" are points and benefits that premium members can earn by watching advertisements.

[1465] "Database" means a system for storing information such as promotion ideas and user profiles.

[1466] This invention achieves a higher level of personalization by combining a sentiment analysis engine with a system that allows company personnel to easily register promotion ideas and deliver optimized promotions to users. In addition, premium members can earn rewards by viewing advertisements. Specific embodiments for implementing this invention are described below.

[1467] System Configuration

[1468] 1. Server

[1469] The server plays a central role in registering promotion ideas, managing the database, analyzing user profiles, matching and delivering promotions and advertisements, and processing emotional data using an emotion analysis engine.

[1470] 2. Terminal

[1471] The terminal is an interface between company representatives and users. Representatives use the terminal to register promotion ideas, and users register friends, watch advertisements, and provide emotional data.

[1472] 3. Sentiment Analysis Engine

[1473] The sentiment analysis engine is a component that analyzes the user's facial expressions, tone of voice, and text sentiment to collect real-time emotional data of the user.

[1474] Program processing

[1475] 1. Promotion proposal registration

[1476] The terminal displays a login screen to the company representative and asks them to enter their authentication information. After the representative logs in, they are provided with a form to enter details of the promotion proposal (campaign name, period, target audience, content).

[1477] When the person in charge inputs a promotion proposal and presses the send button, the terminal transmits the input promotion proposal data to the server, which then stores the data in a database.

[1478] 2. User data collection and profiling

[1479] When a user registers as a friend on a company's official account, the device displays a form for entering basic information (gender, age, interests, etc.) Once the user enters the information and presses the submit button, the device sends the data to the server.

[1480] The server analyzes the user data, creates a user profile, and stores it in a database.

[1481] 3. Promotion Matching and Delivery

[1482] The server performs a matching process to match the promotion proposal with user profiles, selects users who meet the matching criteria, and creates a promotion distribution list for the selected users.

[1483] The server will distribute the promotion proposal to the selected users, and the device will display a notification to the users, allowing them to check the details.

[1484] 4. Delivery of advertisements to premium members and rewards

[1485] The server periodically checks the activity status of premium members. Advertisers register details of their advertising campaigns with the server, and the server selects premium members who meet the targeting criteria and creates an advertising distribution list.

[1486] The server distributes advertisements to the selected premium members, and the terminal displays a notice of advertisement viewing to the premium members and provides a link to a detailed page.

[1487] The user watches the ad and notifies the server that they have completed watching. The server then verifies the completion information and credits the reward to the user's account.

[1488] 5. Utilizing sentiment analysis engines

[1489] The emotion analysis engine recognizes emotions from users' facial expressions, tone of voice, and text. Emotional data is reflected in user profiles and used to match promotions and advertisements.

[1490] For example, if a user looks happy while viewing a promotion, that emotional data is sent to the server and used to improve the accuracy of the next promotion or advertisement.

[1491] Specific examples

[1492] 1. Example of promotion proposal registration

[1493] The person in charge registers a summer sale campaign, for example, "Summer sale, July 1st to July 31st, for women in their 20s, discount coupon," and enters details into the terminal and submits them.

[1494] This data is sent to a server and stored in a database.

[1495] 2. Example of a User Profile

[1496] A 20-year-old female user registers as a friend and lists "fashion" and "beauty" as her interests. The emotion analysis engine analyzes the user's facial expressions and detects smiles.

[1497] The server uses this information to generate a user profile and stores it in a database.

[1498] 3. Examples of promotional distribution

[1499] The server matches the "Summer Sale Campaign" with the profile of a 20-year-old female user, taking into account emotional data that indicates the user looks happy.

[1500] The device will send the user a "Summer Sale Announcement" notification and display more information within the app.

[1501] 4. Examples of Ad Viewing and Rewards

[1502] A 20-year-old female premium member watches an advertisement for a new cosmetic product. The emotion analysis engine detects the user's emotions (e.g., excitement, interest) while watching.

[1503] The server calculates reward points based on viewing completion information and emotional data and awards them to the user.

[1504] Example prompts for generative AI models

[1505] "Female, 20 years old, interests: fashion and beauty. Emotion analysis engine analysis: smiling. Please send me recommended promotion ideas."

[1506] In this way, companies can run effective promotions and users can receive information and rewards that match their interests. By combining it with a sentiment analysis engine, a more personalized experience can be provided.

[1507] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1508] Step 1: Personnel authentication

[1509] The terminal displays a login screen to the company's personnel. When the personnel enters their username and password and presses the send button, the terminal sends the authentication information to the server. The server verifies the authentication information, and if authentication is successful, grants the personnel access permission.

[1510] Input: Username and password of the person in charge

[1511] Data processing: The server verifies the authentication information and obtains the ID of the person in charge

[1512] Output: Authentication result (success or failure), display of the dashboard for the person in charge if authentication is successful

[1513] Specific operation: When the person in charge presses the login button, the message "Sending authentication information to the server..." is displayed. After the server verifies the authentication information, the person in charge dashboard is displayed.

[1514] Step 2: Enter and submit your promotion proposal

[1515] The terminal displays a form for the person in charge to enter details of the promotion proposal (campaign name, period, target audience, content). When the person in charge enters the details and presses the submit button, the terminal sends the entered data to the server. The server receives the data and stores it in a database.

[1516] Input: Promotion details (campaign name, period, target audience, content)

[1517] Data processing: The server assigns a unique ID to the promotion proposal and stores it in the database.

[1518] Output: Promotion proposal registration results

[1519] Specific operation: After completing the input, press the send button and the message "Promotion proposal has been sent" will be displayed. After the server has saved the data to the database, the message "Registration completed" will be displayed.

[1520] Step 3: Add friends and enter basic information

[1521] When a user registers as a friend on a company's official account, the device displays a form for the user to enter basic information (gender, age, interests). After the user enters the information and presses the submit button, the device sends the data to the server.

[1522] Input: User's basic information (gender, age, interests)

[1523] Data processing: The server analyzes the user's basic information and stores it in a database

[1524] Output: User information registration result

[1525] Specific behavior: When the user submits the form, the message "Basic information has been submitted" is displayed. After the server saves the data to the database, the user is notified that "Registration is complete."

[1526] Step 4: Send user data

[1527] The device sends the user's basic information to the server, which analyzes the received data to generate a user profile and saves it in a database.

[1528] Input: Basic information transmission request

[1529] Data processing: The server analyzes the information and generates a user profile

[1530] Output: User profile saved

[1531] Specific behavior: "User data received" is recorded in the server log. After the user profile is generated, "User profile generated" is recorded in the server log.

[1532] Step 5: Matching promotions to user profiles

[1533] The server matches the promotion proposal with user profiles stored in the database, selects users who meet the matching criteria, and creates a promotion distribution list.

[1534] Input: Promotion proposals and user profile database

[1535] Data processing: The server runs a matching algorithm and generates a distribution list

[1536] Output: Promotion distribution list

[1537] Specific behavior: "Matching promotions with user profile..." is displayed, and after the match is complete, "Matching results generated" is recorded in the server log.

[1538] Step 6: Sending and displaying notifications

[1539] The server notifies selected users of the promotion proposal based on the promotion distribution list, and the device displays the notification to the user and provides detailed information.

[1540] Input: Promotional Distribution List

[1541] Data processing: The server generates a notification message and sends it to each device.

[1542] Output: A notification is displayed on the user's device

[1543] What it does: A notification will appear on your device saying "There's a new promotion" and a link to the details page.

[1544] Step 7: Selecting Premium Members

[1545] The server periodically checks the activity status of premium members and selects premium members who meet the target conditions of the advertising campaign.

[1546] Input: Premium member activity data

[1547] Data processing: The server analyzes the activity data and selects targets based on the conditions.

[1548] Output: Premium Member List

[1549] Specific operation: "Selecting premium members..." is displayed, and after the selection is complete, "The list of selected premium members has been generated" is recorded in the server log.

[1550] Step 8: Create a list of ad serving

[1551] The server creates an ad distribution list, which includes selected premium members.

[1552] Input: Ad campaign data and premium membership list

[1553] Data processing: The server generates an ad distribution list and saves it in the database

[1554] Output: Ad delivery list

[1555] Specific behavior: "Ad delivery list created" is recorded in the log.

[1556] Step 9: Ad serving and notification

[1557] The server delivers the advertisement to the selected premium member, and the device displays a notification to the premium member requesting to view the advertisement and provides a link to a page with more details.

[1558] Input: Ad delivery list

[1559] Data processing: The server generates advertising delivery messages and sends them to each device.

[1560] Output: A notification will be displayed on the premium member's device.

[1561] Specific behavior: "There is a new ad" will be displayed in the notification bar, along with a link to the details page.

[1562] Step 10: Notification of ad completion and reward

[1563] The user watches the ad and sends a notification of completion to the server, which then verifies the completion and credits the reward to the user's account.

[1564] Input: Ad viewing completion notification

[1565] Data processing: The server checks the viewing completion data and calculates reward points

[1566] Output: Reward credited to user account

[1567] Specific operation: "Viewing completed. Reward points will be awarded" will be displayed on the device.

[1568] Step 11: Collect emotion data

[1569] The emotion analysis engine collects emotional data from the user's facial expressions, tone of voice, and text, and sends this data to the server in real time.

[1570] Input: User's emotional expression data

[1571] Data processing: The emotion analysis engine analyzes the data and determines the emotional state

[1572] Output: Sentiment analysis result data

[1573] Specific operation: "Analyzing emotion data..." is displayed, and after analysis, "Emotion data sent" is displayed.

[1574] Step 12: Reflecting and utilizing emotional data

[1575] The server reflects the emotional data in the user profile and uses it to match promotions and advertisements. For example, if a user looks happy while viewing a promotion, that data can be used to deliver the next promotion or advertisement.

[1576] Input: Sentiment analysis data

[1577] Data processing: The server adds emotional data to the user profile and reflects it in the matching algorithm.

[1578] Output: Updated user profile and improved matching results

[1579] Specific operation: "Emotion data saved" is recorded in the log and will be used effectively for the next delivery.

[1580] (Application example 2)

[1581] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1582] Existing promotion systems generally involve a company representative registering promotion ideas and users receiving them, making it difficult to deliver optimal ads that take into account the user's real-time emotional state. Furthermore, because ads are not displayed based on user emotions, a personalized user experience is not provided, limiting the effectiveness of advertising. As a result, it is difficult for companies to conduct more effective promotions, and users often end up viewing ads that do not interest them.

[1583] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a company representative to register promotion proposals, a means for a user to register a company account as a friend and create an individual profile, a means for matching the promotion proposals with the user profile and delivering optimized promotions to the user, a means for an advertiser to send advertisements to premium members and for the premium members to earn rewards by viewing the advertisements, and a means for analyzing user emotions in real time and displaying advertisements based on the analysis results. This enables optimal advertisement delivery that takes into account the user's real-time emotional state, allowing companies to carry out more effective promotions and users to view more interesting advertisements.

[1584] The "means for company personnel to register promotion proposals" refers to an interface and tools that allow company marketing personnel to input and register new promotions and advertising campaigns into the system.

[1585] "Means for users to add a company's account as a friend and create a unique profile" refers to the process and tools by which users can register in the system, enter the individual information required to receive the company's advertising and promotions, and create their own unique profile.

[1586] "Means for matching the promotion proposals with the user's profile and delivering optimized promotions to the user" refers to an algorithm and system for comparing registered promotion proposals with the user's profile information and delivering the most suitable promotions to the user.

[1587] "Means for advertisers to send advertisements to premium members, who then receive rewards by viewing the advertisements" refers to a system in which advertisements are sent to specific user ranks (premium members), and those users can receive reward points or other incentives by viewing the advertisements.

[1588] "Means for analyzing user emotions in real time and displaying advertisements based on the analysis results" refers to a system and algorithm that uses devices such as cameras and microphones to analyze emotions from users' facial expressions, tone of voice, text, etc., and selects and displays the most appropriate advertisements in real time based on that data.

[1589] System Overview

[1590] This invention is a system that allows company personnel to easily register promotional ideas and delivers optimized advertisements to users using an emotion engine. Users can earn rewards by viewing advertisements as premium members. Specific embodiments of this system are described below.

[1591] Hardware and software used

[1592] Hardware: Smart glasses, camera, microphone, server terminal

[1593] Software: Sentiment analysis engine, promotion matching algorithm, ad distribution server

[1594] Technologies used: Open source libraries (e.g., OpenCV), HTTP request libraries (e.g., requests)

[1595] System configuration

[1596] 1. Server

[1597] The server registers promotion ideas, manages the database, analyzes user profiles, matches and delivers promotions and advertisements, and processes emotional data using an emotion analysis engine.

[1598] 2. Terminal

[1599] The terminal is an interface between company representatives and users. Company representatives use the terminal to register promotion ideas, and users register friends, watch advertisements, and provide emotional data.

[1600] 3. Users

[1601] Users are individuals who add a company's official account as a friend and receive promotional information and advertisements. In particular, premium members can earn rewards by watching advertisements.

[1602] 4. Emotion Engine

[1603] The emotion engine analyzes the user's facial expressions, tone of voice, and text sentiment to collect real-time emotional data.

[1604] Program processing

[1605] The server uses the emotion engine to analyze the user's emotions in real time and delivers the most suitable advertisements to the user based on the analysis results, which includes the following steps:

[1606] Data capture: Smart glasses or a camera capture the user's facial expressions, and a microphone captures the tone of voice.

[1607] Sentiment analysis: The captured data is sent to an emotion engine for real-time emotion analysis.

[1608] Promotion Matching: Matching with the best promotion ideas based on sentiment data and user profiles.

[1609] Advertisement delivery: Displaying matched promotions on the user's smart glasses.

[1610] Specific examples

[1611] Registration of promotion proposal: A company representative registers, for example, a "Summer Sale Campaign." Details include the campaign name, period, target audience, content, etc.

[1612] Creating a user profile: A 20-year-old female user adds a friend and states that she is interested in "fashion" and "beauty." The emotion engine analyzes her facial expressions and detects smiles.

[1613] Advertisement delivery: Based on the emotional data, the server determines that the "Summer Sale Campaign" is most suitable for female users in their 20s and displays the advertisement on the smart glasses.

[1614] Prompt Sentence Examples

[1615] Demonstrate a program that analyzes a user's facial expressions in real time and displays the most appropriate advertisement on smart glasses based on the emotional data. If the user is enjoying themselves, display a trailer advertisement for a new movie. The APIs used include an emotion analysis engine (Emotion API) and an advertisement server.

[1616] This provides a personalized advertising experience that takes into account users' real-time emotions, allowing businesses to run more effective promotions and users to receive ads based on their interests.

[1617] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1618] Step 1:

[1619] A company representative registers a promotion proposal. Using a terminal, the company representative enters the details of the promotion proposal (campaign name, period, target audience, content). The entered promotion proposal data is sent to the server, which stores this data in a database. The input is the detailed information of the promotion proposal, and the output is the promotion proposal stored in the database.

[1620] Step 2:

[1621] A user adds a friend to a company's account. The user uses their device to enter basic information (gender, age, interests). This information is sent to a server, which analyzes the user data and creates an individual user profile. The input is the user's basic information, and the output is the user profile stored in a database.

[1622] Step 3:

[1623] Emotion data capture. Smart glasses or a camera capture the user's facial expressions, and a microphone captures the tone of voice. These data are transmitted from the device to the server in real time. The input is the user's facial image and voice data, and the output is the raw data used for emotion analysis.

[1624] Step 4:

[1625] Emotion analysis. The server uses an emotion analysis engine to analyze the captured data (facial expression images and voice data) and generate real-time emotional data of the user. The input is facial expression images and voice data, and the output is the analyzed emotional data. Specifically, the emotion analysis engine analyzes the image and voice data and identifies the user's emotional state, such as "happiness" or "excitement."

[1626] Step 5:

[1627] Promotion Matching: The server matches optimal promotion suggestions to users based on the generated emotion data and user profile. The input is emotion data and user profile, and the output is optimal promotion suggestions. Specifically, the server matches the promotion suggestion database with the user profile database and selects promotions that match the user's current emotional state.

[1628] Step 6:

[1629] Advertisement delivery. Once the optimal promotional plan is determined, the server displays the promotion on the smart glasses. The input is the optimal promotional plan, and the output is the advertisement displayed to the user. Specifically, the server sends the selected promotional data to the smart glasses and displays it in real time so that the user can view the advertisement directly.

[1630] Step 7:

[1631] Reward allocation. When a user watches an ad, the smart glasses or device sends a completion notification to the server. The server verifies the completion information and allocates rewards to the premium member user's account. The input is the ad completion notification, and the output is the reward points allocated to the user's account. Specifically, the server updates the reward management system after receiving the completion notification and adds points to the premium member's account.

[1632] This allows businesses to run effective promotions, users to receive optimal ads based on emotional data in real time, and premium members can earn rewards by watching ads, improving the user experience.

[1633] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1634] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1635] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1636] [Fourth embodiment]

[1637] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1638] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1639] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1640] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1641] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1642] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1643] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1644] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1645] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1646] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1647] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1648] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1649] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1650] This invention is a system that allows company personnel to easily register promotion ideas and deliver optimized promotions to users. In addition, premium members can earn rewards by viewing advertisements. An embodiment of this system will be described.

[1651] System Configuration

[1652] 1. Server

[1653] The server is the core system that registers promotion ideas, manages the database, analyzes user profiles, matches promotions with advertisements, and distributes them.

[1654] 2. Terminal

[1655] The terminal is a device (such as a smartphone or PC) that acts as an interface between the company's representative and the user. This allows the representative to register promotion ideas, and the user to add friends and watch advertisements.

[1656] 3. Users

[1657] Users are consumers who add a company's official account as a friend and create individual profiles. In particular, premium members can watch advertisements and earn rewards.

[1658] Program processing

[1659] 1. Promotion proposal registration

[1660] The terminal provides a screen for the company's representative to input details of the promotion proposal. When the representative inputs the promotion proposal and presses the send button, the data is sent to the server.

[1661] The server analyzes the received promotion data and stores it in a database.

[1662] 2. User data collection and profiling

[1663] When a user adds a company's official account as a friend, the device prompts them to enter basic data (gender, age, interests).

[1664] The device sends the collected data to a server, which then creates a user profile based on that data.

[1665] 3. Promotion Matching and Delivery

[1666] The server matches registered promotion ideas with user profiles. For example, a summer sale campaign aimed at women in their 20s matches a profile of a 20-year-old woman.

[1667] When a match is made, the server delivers the promotion to the user's device, and the device displays a notification to the user.

[1668] 4. Delivery of advertisements to premium members and rewards

[1669] The server checks the activity status of premium members and delivers advertisements from advertisers to active premium members.

[1670] When a user views an advertisement, the terminal sends a viewing completion signal to the server, which then confirms the signal.

[1671] The server calculates the reward based on the viewing completion information and adds the reward information to the user profile.

[1672] Specific examples

[1673] 1. Example of promotion proposal registration

[1674] A company representative registers a summer sales campaign, for example, by entering information such as "Summer sale, July 1st to July 31st, for women in their 20s, discount coupon" into the terminal.

[1675] This data is sent to a server and stored in a database.

[1676] 2. Example of a User Profile

[1677] A 20-year-old female user adds a friend and lists "fashion" and "beauty" as her interests.

[1678] The server uses this information to generate a user profile.

[1679] 3. Examples of promotional distribution

[1680] The server matches the "Summer Sale Campaign" to this user.

[1681] The device will send the user a "Summer Sale Announcement" notification and display details within the app.

[1682] 4. Examples of Ad Viewing and Rewards

[1683] A 20-year-old female premium member watches an advertisement for a new cosmetic product.

[1684] The server checks the viewing completion information and awards reward points to the user.

[1685] In this way, businesses can efficiently promote themselves, users can receive information that matches their interests, and enjoy the benefits of premium membership.

[1686] The processing flow will be explained below.

[1687] Step 1: Submit your promotion proposal

[1688] The terminal displays a login screen to the company's personnel and prompts them to enter their authentication information.

[1689] The terminal transmits the entered authentication information to the server.

[1690] The server verifies the credentials and allows the agent to log in.

[1691] The device displays a form that asks the person in charge to enter details of the promotion proposal (campaign name, period, target audience, content).

[1692] The person in charge enters the details of the promotion proposal and presses the send button.

[1693] The terminal transmits the input promotion proposal data to the server.

[1694] The server checks the received promotion data and stores it in a database.

[1695] The server notifies the terminal that saving to the database is complete.

[1696] Step 2: Collecting user data and creating profiles

[1697] A user adds a company's official account as a friend.

[1698] The device displays a form that asks the user to enter basic information (gender, age, interests).

[1699] The user enters basic information and presses the submit button.

[1700] The terminal sends the entered basic information to the server.

[1701] The server analyzes the received user data and creates a user profile.

[1702] The server stores the created user profile in a database.

[1703] The server notifies the terminal that the user profile has been saved.

[1704] Step 3: Promotion Matching and Delivery

[1705] The server performs a matching process to match promotion offers with user profiles.

[1706] The server selects users who meet the criteria of the target audience.

[1707] The server creates a promotion distribution list for the selected users.

[1708] The server sends the promotion proposal to the selected users.

[1709] The terminal displays the promotion notification to the user and provides a screen for displaying more information.

[1710] Step 4: Delivering ads to premium members and rewarding them

[1711] The server periodically checks the activity status of premium members.

[1712] Advertisers register details of their advertising campaigns with the server.

[1713] The server matches the premium member's profile with the advertiser's targeting criteria.

[1714] The server creates an advertisement distribution list for premium members who match the target.

[1715] The server distributes advertisements to selected premium members.

[1716] The device will display a notification to the premium member that they have viewed an ad and provide a link to the ad's details page.

[1717] The user watches the advertisement and presses the "Complete viewing" button.

[1718] The terminal transmits a viewing completion signal to the server.

[1719] The server checks the advertisement viewing completion information and gives a reward to the premium member's account.

[1720] The server notifies the terminal that the reward has been granted.

[1721] Example 1

[1722] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1723] Today's businesses need to effectively promote their target users and increase user engagement, but traditional methods involve uniform distribution of promotions and advertisements, making it difficult to optimize for each individual user. Furthermore, managing the rewards that premium members receive for viewing advertisements is also time-consuming. There is a need to solve these issues and provide a system that is convenient for both businesses and users.

[1724] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1725] In this invention, the server includes: a means for a company representative to register promotion proposals; a means for a user to register a company account as a friend and create an individual profile by entering basic data; a means for transmitting detailed information about the promotion proposals and for the server to analyze the data and store it in a database; a means for the server to match the promotion proposals with user profiles, deliver the matched promotions to the user terminal and display a notification; and a means for an advertiser to send advertisements to premium members, and for the server to calculate rewards when premium members view the advertisements and add reward information to the profile. This makes it possible to individually optimize and deliver company promotion proposals to target users and automatically manage rewards for viewing advertisements for premium members.

[1726] "Company representative" refers to a person in a company who is responsible for creating and managing promotion proposals.

[1727] "Promotion Proposal" means detailed information about a plan or campaign aimed at promoting a product or service.

[1728] "Friend registration" refers to the act of a user following an official account, enabling two-way communication.

[1729] "Basic data" refers to individual information about a user, such as their gender, age, and interests.

[1730] An "individual profile" is individual characteristic information based on a user's basic data and behavioral history.

[1731] "Server" means a computer system that stores, analyzes data, and matches promotional offers with user profiles.

[1732] A "database" is an information collection system for storing and managing promotional ideas and user profile data.

[1733] "Matching" refers to the process of matching promotion ideas with user profiles.

[1734] "User terminal" refers to the interface device used by the user (e.g., smartphone, personal computer).

[1735] "Notification" means a message sent to a User to inform them of promotional information.

[1736] "Advertiser" means an individual or entity that pays compensation to advertise a product or service.

[1737] A "premium membership" is a paid membership that allows you to enjoy more benefits and additional features than regular users.

[1738] "Ad viewing" means the act of a user visually or audibly viewing the transmitted advertising content.

[1739] "Rewards" refer to points or benefits provided based on user actions such as watching advertisements.

[1740] This invention is a system that allows company personnel to easily register promotion ideas and deliver optimized promotions to users. In addition, premium members can earn rewards by viewing advertisements. The following describes in detail the embodiments for implementing this system.

[1741] System Configuration

[1742] 1. Server

[1743] Role: The server is the core system that registers promotion ideas, manages the database, analyzes user profiles, matches promotions and advertisements, and distributes them.

[1744] Software used: MySQL (database management), Python (data analysis), HTTP server (request processing)

[1745] 2. Terminal

[1746] Role: A terminal is a device (e.g., smartphone, PC) that acts as an interface between company personnel and users.

[1747] Software used: Web browser (interface provided), HTTP client (data transmission)

[1748] 3. Users

[1749] Role: Users are consumers who add a company's official account as a friend and create a personalized profile. Premium members, in particular, can watch ads and earn rewards.

[1750] Program processing

[1751] Promotion proposal registration

[1752] Company representative actions: The company representative enters details of the promotion proposal on the terminal.

[1753] Server processing: The device sends the entered promotion proposal to the server via an HTTP POST request, and the server analyzes this data and stores it in a database.

[1754] Example: A company representative inputs a promotional idea such as "Summer sale, July 1st to July 31st, for women in their 20s, discount coupon" into a terminal and sends it.

[1755] User Data Collection and Profiling

[1756] User behavior: A user adds a company's official account as a friend and enters basic data (gender, age, interests).

[1757] Server processing: The device sends the collected data to the server via an HTTP POST request, and the server creates a user profile based on that data and stores it in a database.

[1758] Example: A 20-year-old female user registers as a friend and enters her gender, age, and interests in "fashion" and "beauty."

[1759] Promotion Matching and Delivery

[1760] Server process: The server matches the promotion proposal with the user profile. If the conditions are met, the promotion is sent to the user's device and a notification is displayed.

[1761] Example: The server matches a "Summer Sale Campaign" to a 20-year-old female user, and the device displays a notification as a "Summer Sale Announcement."

[1762] Delivery of advertisements and rewards for premium members

[1763] Server processing: The server checks the activity status of the premium member and sends advertisements. When the user watches the advertisement, it sends a completion signal to the server, calculates the reward, and adds the reward information to the user profile.

[1764] Example: A 20-year-old female premium member watches an advertisement for a new cosmetic product, a viewing completion signal is sent to the server, and reward points are added to her profile.

[1765] Prompt Sentence Examples

[1766] Below are some example prompts that the system uses in its generative AI model:

[1767] "Please enter the details of your promotion idea. Example: Summer sale, July 1st to July 31st, for women in their 20s, discount coupon."

[1768] "Please enter your basic information. For example: Gender: Female, Age: 20, Interests: Fashion, Beauty"

[1769] In this way, companies can efficiently promote themselves, users can receive information that matches their interests, and enjoy the benefits of being a premium member.

[1770] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1771] Specific steps of the program's processing

[1772] Step 1: Enter your promotion idea

[1773] Company representative actions: The company representative enters details of the promotion proposal on the terminal.

[1774] Input: Promotion name, start date, end date, target user, and promotion details

[1775] What happens: The terminal displays the details entered based on the form, and the agent fills in these details. Once the agent has finished entering the information, he clicks the submit button.

[1776] Output: Promotion data collected by the device

[1777] Step 2: Submit and save your promotion proposal

[1778] Device action: The device sends a promotion proposal to the server.

[1779] Input: Promotion data collected in step 1

[1780] Specific operation: The device makes an HTTP POST request and sends the promotion data to the server.

[1781] Output: Promotion data received by the server

[1782] Step 3: Analyze and save promotion ideas

[1783] Server Actions: The server analyzes the promotion data received and stores it in a database.

[1784] Input: Promotion data received in step 2

[1785] What happens: The server parses the data using a data parsing script (e.g. Python) and converts it into an appropriate format. It then stores the parsed data in a database (e.g. MySQL).

[1786] Output: Promotion data stored in a database

[1787] Step 4: Add users as friends and enter basic data

[1788] User behavior: A user adds a company's official account as a friend and enters basic data (gender, age, interests).

[1789] Input: User's gender, age, interests

[1790] What happens: The device displays a friend registration button, and when the user clicks it, a basic data entry form appears. The user fills in the information in each field and clicks the submit button.

[1791] Output: User data collected by the device

[1792] Step 5: Submitting user data and creating a profile

[1793] Device action: The device sends user data to the server.

[1794] Input: User data collected in step 4

[1795] Specific operation: The device makes an HTTP POST request and sends user data to the server, which receives and analyzes the data.

[1796] Output: Server generates profile data

[1797] Step 6: Save your profile data

[1798] Server actions: The server creates a profile based on the analyzed user data and stores it in a database.

[1799] Input: Profile data generated in step 5

[1800] Specific operation: The server analyzes user data, generates a profile, and stores the profile in a database.

[1801] Output: User profile stored in the database

[1802] Step 7: Matching promotions to user profiles

[1803] Server Action: The server matches promotion ideas with user profiles.

[1804] Input: Promotion ideas and user profiles stored in the database

[1805] What happens: The server runs an SQL query to find user profiles that match the promotion offer.

[1806] Output: Matching result data

[1807] Step 8: Promotion Delivery and Notification

[1808] Server Action: The server delivers the matched promotion to the user device.

[1809] Input: Matching result data generated in step 7

[1810] Specific operation: The server generates a notification message and sends it to the device via an HTTP PUSH request. The device displays the push notification.

[1811] Output: Notification message displayed on the terminal

[1812] Step 9: Check your Premium Membership Activity

[1813] Server Action: The server checks the activity status of premium members.

[1814] Input: Premium member data stored in the database

[1815] What it does: The server periodically checks the database to generate a list of active premium members.

[1816] Output: Active members list

[1817] Step 10: Serving Ads

[1818] Server Action: The server delivers ads to active premium members.

[1819] Input: Active Member List generated in Step 9

[1820] Specific operation: The server retrieves advertising content from the advertising database and sends it to the device via an HTTP PUSH request.

[1821] Output: Ad displayed on device

[1822] Step 11: Record your ad views and rewards

[1823] User action: The user watches the ad and sends a completion signal to the server.

[1824] Input: Information about the ad the user watched

[1825] Specific operation: When the user clicks the "Complete" button on the device, the completion information is sent to the server via an HTTP POST request. The server analyzes the completion data, calculates the reward, and adds it to the user's profile.

[1826] Output: Added reward information

[1827] (Application example 1)

[1828] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1829] Conventional promotion systems lack real-time and interactivity in the means of appropriately matching and delivering promotions registered by company personnel to users. Additionally, incentives for premium members who earn rewards by viewing advertisements are limited, making it difficult to deliver advertisements that effectively match users' interests.

[1830] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1831] In this invention, the server includes a means for a company representative to register promotion proposals, a means for a user to register a company account as a friend and create an individual profile, a means for matching the promotion proposals with the user profile and delivering promotions optimized for the user, a means for an advertiser to send advertisements to premium members and for premium members to earn rewards by viewing the advertisements, a means for displaying the optimized advertisements on the smart device in real time, and a means for displaying detailed information through the smart device in response to user operations, thereby enabling advertisement delivery that is both real-time and interactive.

[1832] "Company Representative" means an individual or group of individuals within a Company who are responsible for organizing and registering a Promotion.

[1833] A "Promotion Proposal" is detailed information about a campaign that a company plans and registers to promote a particular product or service.

[1834] A "user" is a consumer who adds a company's account as a friend, creates a personal profile, and receives its promotions and advertisements.

[1835] A "profile" is an individual data set created based on a user's basic information, interests, and behavioral data.

[1836] "Matching" is the process of comparing registered promotion proposals with a user's profile and selecting an appropriate promotion based on matching factors.

[1837] A "premium member" is a user who, unlike a regular user, has the privilege of earning rewards by watching certain advertisements.

[1838] A "smart device" is an electronic device that can communicate and process information when worn or used by a user, and includes smart glasses and smartphones.

[1839] "Real-time" is a temporal concept that indicates near-instant processing or delivery without delay.

[1840] "Operation" means input or instruction given by a user using a device, including, for example, tapping, swiping, or eye movement.

[1841] This invention is a system that uses smart devices to deliver corporate promotional ideas to users in real time, providing an interactive advertising experience.

[1842] System Configuration

[1843] 1. Server

[1844] Hardware and software: The server uses a database management system (e.g., MySQL) and a program execution environment (e.g., Python). The server receives promotion proposals registered by company personnel, stores the data in a database, and manages them. It also analyzes user profiles and is responsible for matching and delivering promotions and advertisements.

[1845] 2. Terminal

[1846] Hardware and software: The device is the interface with the user (e.g., smart glasses, smartphone, PC). The device has the smart glasses SDK (e.g., Google Glass API) and mobile app installed, where company representatives input promotion ideas and users can add friends and watch ads.

[1847] Program Processing

[1848] 1. Promotion proposal registration

[1849] Server: The server receives the promotion proposal data sent by the company representative and stores it in a database.

[1850] Terminal: The terminal provides a screen where company personnel can enter details of their promotion proposal.

[1851] 2. User data collection and profiling

[1852] Terminal: The terminal provides the user with an input screen where they can enter basic data (gender, age, interests).

[1853] Server: The server receives user data sent from the device and creates a user profile based on that data.

[1854] 3. Promotion Matching and Delivery

[1855] Server: The server matches registered promotion ideas with user profiles and selects appropriate promotions.

[1856] Terminal: The terminal delivers ads optimized for the user's smart device in real time, allowing the user to interact with the ads through the device.

[1857] 4. Delivery of advertisements to premium members and rewards

[1858] Server: The server checks the activity status of premium members, delivers ads to active premium members, and verifies the completion of ad viewing and awards reward points to users.

[1859] Device: When a user watches an ad, it sends a viewing completion signal to the server and checks the status of reward points awarded.

[1860] Specific examples

[1861] 1. Example of promotion proposal registration

[1862] Company representative: Register a promotional proposal that reads, "Autumn / Winter collection on sale from October 1st to October 31st, aimed at women in their 20s."

[1863] Server: Stores this information in a database.

[1864] 2. Example of a User Profile

[1865] User: A 25-year-old woman who is interested in fashion adds the user as a friend.

[1866] Server: Generates a user profile based on this input information.

[1867] 3. Examples of promotional distribution

[1868] Server: Matches registered Fall / Winter collection promotions to the appropriate user profile.

[1869] Device: Smart glasses display "Autumn / Winter Collection Now On Sale!" and display advertisement details based on eye and head movements.

[1870] 4. Examples of Ad Viewing and Rewards

[1871] User: Habit, a 25-year-old female premium member watches an advertisement for a new cosmetic product.

[1872] Server: Checks the viewing completion information and awards reward points.

[1873] Prompt Sentence Examples

[1874] "Generate the best promotional text to send to a 25-year-old female user who is interested in fashion, offering a 10% discount on new gloves."

[1875] Such a system allows businesses to carry out effective promotional activities, allows users to interactively experience advertisements tailored to their interests, and allows them to receive rewards.

[1876] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1877] Step 1:

[1878] [Register promotion proposal]

[1879] Input: A company representative inputs a promotion proposal (e.g., "Fall / Winter collection release, October 1st to October 31st, for women in their 20s")

[1880] Operation: The terminal provides an interface that allows company personnel to input details of promotion proposals and transmits the input data to a server.

[1881] Output: The server receives the promotion proposals and stores them in a database.

[1882] Data processing / calculation: The content of the promotion proposal is analyzed and stored in the database in an appropriate format.

[1883] Step 2:

[1884] [User Data Collection and Profiling]

[1885] Input: User basic data (gender, age, interests)

[1886] How it works: The device provides the user with an interface for registering friends and prompts them to enter basic information.

[1887] Output: Basic data is sent to the server and a user profile is created.

[1888] Data processing / calculation: Based on the entered user data, the server organizes and saves the user profile in a format suitable for storing in the database.

[1889] Step 3:

[1890] [Promotion Matching and Delivery]

[1891] Input: Promotion idea and user profile

[1892] How it works: The server retrieves promotion ideas and user profiles from the database and performs matching using the corresponding algorithm.

[1893] Output: Matched promotions are sent to the user's device.

[1894] Data processing / calculation: The server selects the most suitable promotions based on the user profile interests and past behavioral data, and delivers this information to the user's smart device in real time.

[1895] Step 4:

[1896] [Real-time ad display and interaction]

[1897] Input: Matched promotion data

[1898] How it works: The device displays ads in real time on smart glasses or smartphones and accepts user interaction. Users can view the details of the ads through the device.

[1899] Output: The ad content is displayed to the user, and further details are displayed based on the user's actions.

[1900] Data processing / calculation: Data is updated in real time to display detailed information in response to user input.

[1901] Step 5:

[1902] [Premium member activity check, ad delivery, and rewards]

[1903] Input: Premium member status data, ad viewing data

[1904] How it works: The server checks the activity status of premium members and delivers ads to active members. When a user watches an ad, the completion data is sent to the server, which calculates the reward and reflects it in the profile.

[1905] Output: Reward information added to premium member profile.

[1906] Data processing / calculation: The server calculates rewards based on the viewing completion data and reflects them as reward points in the user profile.

[1907] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1908] This invention achieves a higher level of personalization by combining an emotion engine with a system that allows company personnel to easily register promotion ideas and deliver optimized promotions to users. In addition, premium members can earn rewards by viewing advertisements. A specific embodiment of this system will now be described.

[1909] System Configuration

[1910] 1. Server

[1911] The server plays a central role in registering promotion ideas, managing the database, analyzing user profiles, matching and delivering promotions and advertisements, and processing emotional data using an emotion engine.

[1912] 2. Terminal

[1913] The terminal is an interface between company representatives and users. Representatives use the terminal to register promotion ideas, and users register friends, watch advertisements, and provide emotional data.

[1914] 3. Users

[1915] Users are individuals who add a company's official account as a friend and receive promotional information and advertisements. In particular, premium members can earn rewards by watching advertisements.

[1916] 4. Emotion Engine

[1917] The emotion engine is a component that analyzes the user's facial expressions, tone of voice, and text emotions to collect real-time emotional data from the user.

[1918] Program processing

[1919] 1. Promotion proposal registration

[1920] The terminal displays a login screen to the company representative and asks them to enter their authentication information. After the representative logs in, they are provided with a form to enter details of the promotion proposal (campaign name, period, target audience, content).

[1921] The person in charge enters a promotion proposal and presses the send button. The terminal sends the entered promotion proposal data to the server, which then stores the data in a database.

[1922] 2. User data collection and profiling

[1923] When a user registers as a friend on a company's official account, the device displays a form for entering basic information (gender, age, interests, etc.) Once the user enters the information and presses the submit button, the device sends the data to the server.

[1924] The server analyzes the user data, creates a user profile, and stores it in a database.

[1925] 3. Promotion Matching and Delivery

[1926] The server performs a matching process to match the promotion proposal with user profiles, selects users who meet the matching criteria, and creates a promotion distribution list for the selected users.

[1927] The server will distribute the promotion proposal to the selected users, and the device will display a notification to the users, allowing them to check the details.

[1928] 4. Delivery of advertisements to premium members and rewards

[1929] The server periodically checks the activity status of premium members. Advertisers register details of their advertising campaigns with the server, and the server selects premium members who meet the targeting criteria and creates an advertising distribution list.

[1930] The server distributes advertisements to the selected premium members, and the terminal displays a notice of advertisement viewing to the premium members and provides a link to a detailed page.

[1931] The user watches the ad and notifies the server that they have completed watching. The server then verifies the completion information and credits the reward to the user's account.

[1932] 5. Leveraging Emotional Engines

[1933] The emotion engine recognizes emotions from users' facial expressions, tone of voice, and text. Emotional data is reflected in user profiles and used to match promotions and advertisements.

[1934] For example, if a user looks happy while viewing a promotion, that emotional data is sent to the server and used to improve the accuracy of the next promotion or advertisement.

[1935] Specific examples

[1936] 1. Example of promotion proposal registration

[1937] The person in charge registers a summer sale campaign, for example, "Summer sale, July 1st to July 31st, for women in their 20s, discount coupon," and enters details into the terminal and submits them.

[1938] This data is sent to a server and stored in a database.

[1939] 2. Example of a User Profile

[1940] A 20-year-old female user adds a friend and lists "fashion" and "beauty" as her interests. The emotion engine analyzes the user's facial expressions and detects smiles.

[1941] The server uses this information to generate a user profile and stores it in a database.

[1942] 3. Examples of promotional distribution

[1943] The server matches the "Summer Sale Campaign" with the profile of a 20-year-old female user, taking into account emotional data that indicates the user looks happy.

[1944] The device will send the user a "Summer Sale Announcement" notification and display more information within the app.

[1945] 4. Examples of Ad Viewing and Rewards

[1946] A 20-year-old female premium member watches an advertisement for a new cosmetic product. The emotion engine detects the user's emotions (e.g., excitement, interest) while watching the advertisement.

[1947] The server calculates reward points based on viewing completion information and emotional data and awards them to the user.

[1948] In this way, companies can run effective promotions and users can receive information and rewards that match their interests. By combining this with an emotion engine, a more personalized experience can be provided.

[1949] The processing flow will be explained below.

[1950] Step 1: Submit your promotion proposal

[1951] The terminal displays a login screen to the company's personnel and prompts them to enter their authentication information.

[1952] The terminal transmits the entered authentication information to the server.

[1953] The server verifies the credentials and allows the agent to log in.

[1954] The device displays a form that asks the person in charge to enter details of the promotion proposal (campaign name, period, target audience, content).

[1955] The person in charge enters the details of the promotion proposal and presses the send button.

[1956] The terminal transmits the input promotion proposal data to the server.

[1957] The server checks the received promotion data and stores it in a database.

[1958] The server notifies the terminal that saving to the database is complete.

[1959] Step 2: Add friends and collect basic information

[1960] A user adds a company's official account as a friend.

[1961] The device displays a form that asks the user to enter basic information (gender, age, interests).

[1962] The user enters basic information and presses the submit button.

[1963] The terminal sends the entered basic information to the server.

[1964] The server analyzes the received user data and creates a user profile.

[1965] The server stores the created user profile in a database.

[1966] The server notifies the terminal that the user profile has been saved.

[1967] Step 3: Collect user sentiment data

[1968] The device captures the user's facial expressions and tone of voice in real time.

[1969] The emotion engine analyzes the captured facial expressions and tone of voice to generate emotional data for the user.

[1970] The terminal transmits the generated emotion data to the server.

[1971] The server analyzes the emotional data and adds or updates it to the user profile.

[1972] Step 4: Matching promotions with user profiles

[1973] The server performs a matching process that matches promotion proposals with user profiles and emotion data.

[1974] The server filters the best users based on the target audience criteria and sentiment data.

[1975] The server generates an optimal user list and delivers promotions to the target users.

[1976] Step 5: Serving your promotion

[1977] The server sends the promotion proposal to the selected users.

[1978] The device will display a promotional notification to the user and provide a screen where they can view more information.

[1979] Step 6: Delivering ads to premium members and rewarding them

[1980] The server periodically checks the activity status of premium members.

[1981] Advertisers register details of their advertising campaigns with the server.

[1982] The server compares the profiles and emotion data of the premium members and selects premium members who meet the target conditions.

[1983] The server distributes advertisements to selected premium members.

[1984] The device will display a notification to premium members that they have watched an ad and provide a link to a page with more details.

[1985] The user watches the advertisement and presses the "Complete viewing" button.

[1986] The terminal transmits a viewing completion signal to the server.

[1987] The server checks the advertisement viewing completion information and gives a reward to the premium member's account.

[1988] The server notifies the terminal that the reward has been granted.

[1989] Through this process, companies can efficiently promote themselves, and users can receive information and rewards based on their interests and emotions.

[1990] Example 2

[1991] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1992] Conventional promotion systems not only required a lot of work to match promotion ideas registered by company representatives with user profiles, but the results were often not properly optimized for users. Furthermore, systems that allow premium members to earn rewards by viewing advertisements lacked personalization that took user emotions into account. Therefore, there was a need for more accurate and personalized promotions and ad delivery.

[1993] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for a company representative to register a promotion proposal, a means for a user to register a company account as a friend and create an individual profile, a means for matching the promotion proposal with the user's profile and delivering an optimized promotion to the user, a means for an advertiser to send advertisements to premium members and for the premium members to earn rewards by viewing the advertisements, and a means for collecting user emotion data using an emotion analysis engine and reflecting the data in the profile. This enables personalized promotions and advertisement delivery based on the user's emotions and interests.

[1994] "Company Representative" means the employee responsible for registering promotion proposals and managing the implementation of the campaign.

[1995] A "user" is an individual who adds a company's account as a friend and receives promotional information and advertisements.

[1996] A "promotion proposal" is a proposal that includes details of a campaign to be implemented by a company (campaign name, period, target audience, content).

[1997] A "profile" is individual data that compiles a user's basic information, behavioral data, and interests.

[1998] "Matching" is the process of matching promotion ideas with user profiles and selecting appropriate promotions.

[1999] "Advertiser" means a company that provides advertisements to premium members.

[2000] "Premium members" are special users who can earn rewards by watching advertisements.

[2001] An "emotion analysis engine" is a system that analyzes a user's emotions from facial expressions, tone of voice, and text, and collects data.

[2002] "Rewards" are points and benefits that premium members can earn by watching advertisements.

[2003] "Database" means a system for storing information such as promotion ideas and user profiles.

[2004] This invention achieves a higher level of personalization by combining a sentiment analysis engine with a system that allows company personnel to easily register promotion ideas and deliver optimized promotions to users. In addition, premium members can earn rewards by viewing advertisements. Specific embodiments for implementing this invention are described below.

[2005] System Configuration

[2006] 1. Server

[2007] The server plays a central role in registering promotion ideas, managing the database, analyzing user profiles, matching and delivering promotions and advertisements, and processing emotional data using an emotion analysis engine.

[2008] 2. Terminal

[2009] The terminal is an interface between company representatives and users. Representatives use the terminal to register promotion ideas, and users register friends, watch advertisements, and provide emotional data.

[2010] 3. Sentiment Analysis Engine

[2011] The sentiment analysis engine is a component that analyzes the user's facial expressions, tone of voice, and text sentiment to collect real-time emotional data of the user.

[2012] Program processing

[2013] 1. Promotion proposal registration

[2014] The terminal displays a login screen to the company representative and asks them to enter their authentication information. After the representative logs in, they are provided with a form to enter details of the promotion proposal (campaign name, period, target audience, content).

[2015] When the person in charge inputs a promotion proposal and presses the send button, the terminal transmits the input promotion proposal data to the server, which then stores the data in a database.

[2016] 2. User data collection and profiling

[2017] When a user registers as a friend on a company's official account, the device displays a form for entering basic information (gender, age, interests, etc.) Once the user enters the information and presses the submit button, the device sends the data to the server.

[2018] The server analyzes the user data, creates a user profile, and stores it in a database.

[2019] 3. Promotion Matching and Delivery

[2020] The server performs a matching process to match the promotion proposal with user profiles, selects users who meet the matching criteria, and creates a promotion distribution list for the selected users.

[2021] The server will distribute the promotion proposal to the selected users, and the device will display a notification to the users, allowing them to check the details.

[2022] 4. Delivery of advertisements to premium members and rewards

[2023] The server periodically checks the activity status of premium members. Advertisers register details of their advertising campaigns with the server, and the server selects premium members who meet the targeting criteria and creates an advertising distribution list.

[2024] The server distributes advertisements to the selected premium members, and the terminal displays a notice of advertisement viewing to the premium members and provides a link to a detailed page.

[2025] The user watches the ad and notifies the server that they have completed watching. The server then verifies the completion information and credits the reward to the user's account.

[2026] 5. Utilizing sentiment analysis engines

[2027] The emotion analysis engine recognizes emotions from users' facial expressions, tone of voice, and text. Emotional data is reflected in user profiles and used to match promotions and advertisements.

[2028] For example, if a user looks happy while viewing a promotion, that emotional data is sent to the server and used to improve the accuracy of the next promotion or advertisement.

[2029] Specific examples

[2030] 1. Example of promotion proposal registration

[2031] The person in charge registers a summer sale campaign, for example, "Summer sale, July 1st to July 31st, for women in their 20s, discount coupon," and enters details into the terminal and submits them.

[2032] This data is sent to a server and stored in a database.

[2033] 2. Example of a User Profile

[2034] A 20-year-old female user registers as a friend and lists "fashion" and "beauty" as her interests. The emotion analysis engine analyzes the user's facial expressions and detects smiles.

[2035] The server uses this information to generate a user profile and stores it in a database.

[2036] 3. Examples of promotional distribution

[2037] The server matches the "Summer Sale Campaign" with the profile of a 20-year-old female user, taking into account emotional data that indicates the user looks happy.

[2038] The device will send the user a "Summer Sale Announcement" notification and display more information within the app.

[2039] 4. Examples of Ad Viewing and Rewards

[2040] A 20-year-old female premium member watches an advertisement for a new cosmetic product. The emotion analysis engine detects the user's emotions (e.g., excitement, interest) while watching.

[2041] The server calculates reward points based on viewing completion information and emotional data and awards them to the user.

[2042] Example prompts for generative AI models

[2043] "Female, 20 years old, interests: fashion and beauty. Emotion analysis engine analysis: smiling. Please send me recommended promotion ideas."

[2044] In this way, companies can run effective promotions and users can receive information and rewards that match their interests. By combining it with a sentiment analysis engine, a more personalized experience can be provided.

[2045] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2046] Step 1: Personnel authentication

[2047] The terminal displays a login screen to the company's personnel. When the personnel enters their username and password and presses the send button, the terminal sends the authentication information to the server. The server verifies the authentication information, and if authentication is successful, grants the personnel access permission.

[2048] Input: Username and password of the person in charge

[2049] Data processing: The server verifies the authentication information and obtains the ID of the person in charge

[2050] Output: Authentication result (success or failure), display of the dashboard for the person in charge if authentication is successful

[2051] Specific operation: When the person in charge presses the login button, the message "Sending authentication information to the server..." is displayed. After the server verifies the authentication information, the person in charge dashboard is displayed.

[2052] Step 2: Enter and submit your promotion proposal

[2053] The terminal displays a form for the person in charge to enter details of the promotion proposal (campaign name, period, target audience, content). When the person in charge enters the details and presses the submit button, the terminal sends the entered data to the server. The server receives the data and stores it in a database.

[2054] Input: Promotion details (campaign name, period, target audience, content)

[2055] Data processing: The server assigns a unique ID to the promotion proposal and stores it in the database.

[2056] Output: Promotion proposal registration results

[2057] Specific operation: After completing the input, press the send button and the message "Promotion proposal has been sent" will be displayed. After the server has saved the data to the database, the message "Registration completed" will be displayed.

[2058] Step 3: Add friends and enter basic information

[2059] When a user registers as a friend on a company's official account, the device displays a form for the user to enter basic information (gender, age, interests). After the user enters the information and presses the submit button, the device sends the data to the server.

[2060] Input: User's basic information (gender, age, interests)

[2061] Data processing: The server analyzes the user's basic information and stores it in a database

[2062] Output: User information registration result

[2063] Specific behavior: When the user submits the form, the message "Basic information has been submitted" is displayed. After the server saves the data to the database, the user is notified that "Registration is complete."

[2064] Step 4: Send user data

[2065] The device sends the user's basic information to the server, which analyzes the received data to generate a user profile and saves it in a database.

[2066] Input: Basic information transmission request

[2067] Data processing: The server analyzes the information and generates a user profile

[2068] Output: User profile saved

[2069] Specific behavior: "User data received" is recorded in the server log. After the user profile is generated, "User profile generated" is recorded in the server log.

[2070] Step 5: Matching promotions to user profiles

[2071] The server matches the promotion proposal with user profiles stored in the database, selects users who meet the matching criteria, and creates a promotion distribution list.

[2072] Input: Promotion proposals and user profile database

[2073] Data processing: The server runs a matching algorithm and generates a distribution list

[2074] Output: Promotion distribution list

[2075] Specific behavior: "Matching promotions with user profile..." is displayed, and after the match is complete, "Matching results generated" is recorded in the server log.

[2076] Step 6: Sending and displaying notifications

[2077] The server notifies selected users of the promotion proposal based on the promotion distribution list, and the device displays the notification to the user and provides detailed information.

[2078] Input: Promotional Distribution List

[2079] Data processing: The server generates a notification message and sends it to each device.

[2080] Output: A notification is displayed on the user's device

[2081] What it does: A notification will appear on your device saying "There's a new promotion" and a link to the details page.

[2082] Step 7: Selecting Premium Members

[2083] The server periodically checks the activity status of premium members and selects premium members who meet the target conditions of the advertising campaign.

[2084] Input: Premium member activity data

[2085] Data processing: The server analyzes the activity data and selects targets based on the conditions.

[2086] Output: Premium Member List

[2087] Specific operation: "Selecting premium members..." is displayed, and after the selection is complete, "The list of selected premium members has been generated" is recorded in the server log.

[2088] Step 8: Create a list of ad serving

[2089] The server creates an ad distribution list, which includes selected premium members.

[2090] Input: Ad campaign data and premium membership list

[2091] Data processing: The server generates an ad distribution list and saves it in the database

[2092] Output: Ad delivery list

[2093] Specific behavior: "Ad delivery list created" is recorded in the log.

[2094] Step 9: Ad serving and notification

[2095] The server delivers the advertisement to the selected premium member, and the device displays a notification to the premium member requesting to view the advertisement and provides a link to a page with more details.

[2096] Input: Ad delivery list

[2097] Data processing: The server generates advertising delivery messages and sends them to each device.

[2098] Output: A notification will be displayed on the premium member's device.

[2099] Specific behavior: "There is a new ad" will be displayed in the notification bar, along with a link to the details page.

[2100] Step 10: Notification of ad completion and reward

[2101] The user watches the ad and sends a notification of completion to the server, which then verifies the completion and credits the reward to the user's account.

[2102] Input: Ad viewing completion notification

[2103] Data processing: The server checks the viewing completion data and calculates reward points

[2104] Output: Reward credited to user account

[2105] Specific operation: "Viewing completed. Reward points will be awarded" will be displayed on the device.

[2106] Step 11: Collect emotion data

[2107] The emotion analysis engine collects emotional data from the user's facial expressions, tone of voice, and text, and sends this data to the server in real time.

[2108] Input: User's emotional expression data

[2109] Data processing: The emotion analysis engine analyzes the data and determines the emotional state

[2110] Output: Sentiment analysis result data

[2111] Specific operation: "Analyzing emotion data..." is displayed, and after analysis, "Emotion data sent" is displayed.

[2112] Step 12: Reflecting and utilizing emotional data

[2113] The server reflects the emotional data in the user profile and uses it to match promotions and advertisements. For example, if a user looks happy while viewing a promotion, that data can be used to deliver the next promotion or advertisement.

[2114] Input: Sentiment analysis data

[2115] Data processing: The server adds emotional data to the user profile and reflects it in the matching algorithm.

[2116] Output: Updated user profile and improved matching results

[2117] Specific operation: "Emotion data saved" is recorded in the log and will be used effectively for the next delivery.

[2118] (Application example 2)

[2119] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2120] Existing promotion systems generally involve a company representative registering promotion ideas and users receiving them, making it difficult to deliver optimal ads that take into account the user's real-time emotional state. Furthermore, because ads are not displayed based on user emotions, a personalized user experience is not provided, limiting the effectiveness of advertising. As a result, it is difficult for companies to conduct more effective promotions, and users often end up viewing ads that do not interest them.

[2121] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a company representative to register promotion proposals, a means for a user to register a company account as a friend and create an individual profile, a means for matching the promotion proposals with the user profile and delivering optimized promotions to the user, a means for an advertiser to send advertisements to premium members and for the premium members to earn rewards by viewing the advertisements, and a means for analyzing user emotions in real time and displaying advertisements based on the analysis results. This enables optimal advertisement delivery that takes into account the user's real-time emotional state, allowing companies to carry out more effective promotions and users to view more interesting advertisements.

[2122] The "means for company personnel to register promotion proposals" refers to an interface and tools that allow company marketing personnel to input and register new promotions and advertising campaigns into the system.

[2123] "Means for users to add a company's account as a friend and create a unique profile" refers to the process and tools by which users can register in the system, enter the individual information required to receive the company's advertising and promotions, and create their own unique profile.

[2124] "Means for matching the promotion proposals with the user's profile and delivering optimized promotions to the user" refers to an algorithm and system for comparing registered promotion proposals with the user's profile information and delivering the most suitable promotions to the user.

[2125] "Means for advertisers to send advertisements to premium members, who then receive rewards by viewing the advertisements" refers to a system in which advertisements are sent to specific user ranks (premium members), and those users can receive reward points or other incentives by viewing the advertisements.

[2126] "Means for analyzing user emotions in real time and displaying advertisements based on the analysis results" refers to a system and algorithm that uses devices such as cameras and microphones to analyze emotions from users' facial expressions, tone of voice, text, etc., and selects and displays the most appropriate advertisements in real time based on that data.

[2127] System Overview

[2128] This invention is a system that allows company personnel to easily register promotional ideas and delivers optimized advertisements to users using an emotion engine. Users can earn rewards by viewing advertisements as premium members. Specific embodiments of this system are described below.

[2129] Hardware and software used

[2130] Hardware: Smart glasses, camera, microphone, server terminal

[2131] Software: Sentiment analysis engine, promotion matching algorithm, ad distribution server

[2132] Technologies used: Open source libraries (e.g., OpenCV), HTTP request libraries (e.g., requests)

[2133] System configuration

[2134] 1. Server

[2135] The server registers promotion ideas, manages the database, analyzes user profiles, matches and delivers promotions and advertisements, and processes emotional data using an emotion analysis engine.

[2136] 2. Terminal

[2137] The terminal is an interface between company representatives and users. Company representatives use the terminal to register promotion ideas, and users register friends, watch advertisements, and provide emotional data.

[2138] 3. Users

[2139] Users are individuals who add a company's official account as a friend and receive promotional information and advertisements. In particular, premium members can earn rewards by watching advertisements.

[2140] 4. Emotion Engine

[2141] The emotion engine analyzes the user's facial expressions, tone of voice, and text sentiment to collect real-time emotional data.

[2142] Program processing

[2143] The server uses the emotion engine to analyze the user's emotions in real time and delivers the most suitable advertisements to the user based on the analysis results, which includes the following steps:

[2144] Data capture: Smart glasses or a camera capture the user's facial expressions, and a microphone captures the tone of voice.

[2145] Sentiment analysis: The captured data is sent to an emotion engine for real-time emotion analysis.

[2146] Promotion Matching: Matching with the best promotion ideas based on sentiment data and user profiles.

[2147] Advertisement delivery: Displaying matched promotions on the user's smart glasses.

[2148] Specific examples

[2149] Registration of promotion proposal: A company representative registers, for example, a "Summer Sale Campaign." Details include the campaign name, period, target audience, content, etc.

[2150] Creating a user profile: A 20-year-old female user adds a friend and states that she is interested in "fashion" and "beauty." The emotion engine analyzes her facial expressions and detects smiles.

[2151] Advertisement delivery: Based on the emotional data, the server determines that the "Summer Sale Campaign" is most suitable for female users in their 20s and displays the advertisement on the smart glasses.

[2152] Prompt Sentence Examples

[2153] Demonstrate a program that analyzes a user's facial expressions in real time and displays the most appropriate advertisement on smart glasses based on the emotional data. If the user is enjoying themselves, display a trailer advertisement for a new movie. The APIs used include an emotion analysis engine (Emotion API) and an advertisement server.

[2154] This provides a personalized advertising experience that takes into account users' real-time emotions, allowing businesses to run more effective promotions and users to receive ads based on their interests.

[2155] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2156] Step 1:

[2157] A company representative registers a promotion proposal. Using a terminal, the company representative enters the details of the promotion proposal (campaign name, period, target audience, content). The entered promotion proposal data is sent to the server, which stores this data in a database. The input is the detailed information of the promotion proposal, and the output is the promotion proposal stored in the database.

[2158] Step 2:

[2159] A user adds a friend to a company's account. The user uses their device to enter basic information (gender, age, interests). This information is sent to a server, which analyzes the user data and creates an individual user profile. The input is the user's basic information, and the output is the user profile stored in a database.

[2160] Step 3:

[2161] Emotion data capture. Smart glasses or a camera capture the user's facial expressions, and a microphone captures the tone of voice. These data are transmitted from the device to the server in real time. The input is the user's facial image and voice data, and the output is the raw data used for emotion analysis.

[2162] Step 4:

[2163] Emotion analysis. The server uses an emotion analysis engine to analyze the captured data (facial expression images and voice data) and generate real-time emotional data of the user. The input is facial expression images and voice data, and the output is the analyzed emotional data. Specifically, the emotion analysis engine analyzes the image and voice data and identifies the user's emotional state, such as "happiness" or "excitement."

[2164] Step 5:

[2165] Promotion Matching: The server matches optimal promotion suggestions to users based on the generated emotion data and user profile. The input is emotion data and user profile, and the output is optimal promotion suggestions. Specifically, the server matches the promotion suggestion database with the user profile database and selects promotions that match the user's current emotional state.

[2166] Step 6:

[2167] Advertisement delivery. Once the optimal promotional plan is determined, the server displays the promotion on the smart glasses. The input is the optimal promotional plan, and the output is the advertisement displayed to the user. Specifically, the server sends the selected promotional data to the smart glasses and displays it in real time so that the user can view the advertisement directly.

[2168] Step 7:

[2169] Reward allocation. When a user watches an ad, the smart glasses or device sends a completion notification to the server. The server verifies the completion information and allocates rewards to the premium member user's account. The input is the ad completion notification, and the output is the reward points allocated to the user's account. Specifically, the server updates the reward management system after receiving the completion notification and adds points to the premium member's account.

[2170] This allows businesses to run effective promotions, users to receive optimal ads based on emotional data in real time, and premium members can earn rewards by watching ads, improving the user experience.

[2171] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2172] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2173] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2174] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2175] FIG. 9 illustrates an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and behaviors arising from a state of mind are arranged on the outer edges of ...

Claims

1. A means for company representatives to register promotion proposals, A way for users to add a company's account as a friend and create a personal profile; means for matching the promotion proposal with the user's profile and delivering an optimized promotion to the user; A means for an advertiser to send advertisements to premium members, and for premium members to earn rewards by viewing the advertisements; A system including:

2. 2. The system of claim 1, further comprising means for verifying the active status of premium members and delivering advertisements only to active premium members.

3. 10. The system of claim 1, further comprising means for analyzing user interests and past behavioral data and automatically updating the profile.

Images