System
The system helps users visualize and achieve their goals by interacting with their future selves and inserting relevant advertisements, addressing the lack of effective goal support and monetization in existing systems.
Patent Information
- Application Number
- JP2024133686
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-08
- Publication Date
- 2026-02-20
AI Technical Summary
Existing systems lack tools and methods to support goal achievement, leading to difficulty in making goals concrete and maintaining motivation, and they also fail to effectively monetize through advertising.
A system that allows users to input goals and dreams, analyze them to generate scenarios, create future diaries, interact with their future selves, and insert relevant corporate advertisements, thereby visualizing goal achievement and generating advertising revenue.
Users can clearly understand the goal-achievement process, maintain motivation, and companies can earn revenue through targeted advertising, enhancing user engagement and marketing effectiveness.
Smart Images

Figure 2026030702000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Having goals and dreams is important for many people, but it is difficult to make them concrete and take continuous action to achieve them. In particular, the lack of tools and methods to support goal achievement makes it difficult to stay motivated, and as a result, many people end up not achieving their goals. Another challenge is the lack of a business model that generates revenue through advertising. [Means for solving the problem]
[0005] The present invention provides a system that includes a means for a user to input their goals and dreams, a means for analyzing the input goals and dreams and generating a scenario for achieving the goal, a means for creating a future diary based on the generated scenario, a means for the user to access the future diary and interact with their future self, and a means for inserting corporate advertisements related to the goal-achievement process. This allows the user to concretely understand the process of achieving their goal through interaction with their future self and increase their motivation. Furthermore, by effectively inserting corporate advertisements, a new marketing channel for generating advertising revenue can be created.
[0006] "Goals and dreams" are specific objectives and hopes that users wish to achieve in the future.
[0007] "Input means" refers to the interface or device that allows users to communicate their goals and dreams to the system.
[0008] "Means of analysis" refers to the algorithms and functions that analyze and understand the input data and derive appropriate results.
[0009] "Scenario generation means" refers to methods and techniques for predicting and constructing the processes and steps for achieving goals based on analyzed data.
[0010] A "means for creating a future diary" is a method or function that generates a document or record that specifically describes a future situation in which a goal has been achieved.
[0011] "Means of access" refers to the methods or interfaces that users use to connect to and use information within a system.
[0012] "Means of interaction" refers to the functions and technologies that allow users to have two-way communication with the system.
[0013] A "corporate advertising insertion method" is a method or algorithm for displaying ads relevant to the goal-achievement process at the appropriate time.
[0014] "System" refers to a collection of devices and software that integrates the above means. [Brief explanation of the drawings]
[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0017] First, the terms used in the following description will be explained.
[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0023] [First embodiment]
[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0036] ---
[0037] The system of the present invention provides a means for users to input their goals and dreams and generate a diary of the future when those goals have been achieved. Users can also interact with their future selves and learn about the process leading to goal achievement. Furthermore, by inserting corporate advertisements into the goal achievement process, advertising revenue can be earned.
[0038] The system program processes in the following steps:
[0039] User enters goal
[0040] 1. User inputs goal
[0041] The user inputs their goal, such as "to complete a full marathon within three years," via a device such as a smartphone or computer.
[0042] 2. Send your goal data
[0043] The terminal transmits the input target data to the server.
[0044] The server analyzes the received target data and stores it in the user's database.
[0045] Making goals concrete
[0046] 1. Goal analysis
[0047] The server analyzes the goal data and collects related information, such as past user data and the typical process of completing a full marathon.
[0048] 2. Goal achievement scenario generation
[0049] The server uses an AI engine to simulate the process of achieving a goal and generate a specific training plan and steps, taking into account past success stories and expert guidelines.
[0050] Future diary generation
[0051] 1. Initializing the Future Diary
[0052] The server creates a template for a future diary entry based on the goal achievement scenario generated by the AI engine.
[0053] 2. Creating diary content
[0054] The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific situation, emotions, and sense of accomplishment of that day.
[0055] Dialogue with your future self
[0056] 1. Providing a conversational interface
[0057] The device provides the user with a future diary and displays an interface for interacting with their future self.
[0058] 2. Accepting questions
[0059] The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[0060] The server receives and analyzes the query data.
[0061] 3. AI response generation
[0062] The server generates future-self responses based on the questions it receives, based on simulated goal-funneling processes and user data.
[0063] The server sends the generated response to the terminal.
[0064] 4. Viewing Dialogues
[0065] The device will then display the user's response from their future self.
[0066] Corporate advertising inserts
[0067] 1. Selection of advertising data
[0068] The server selects ads for businesses that fit the user's goal-building process, such as ads for workout wear or fitness apps.
[0069] 2. Ad Insertion
[0070] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[0071] Providing information to users
[0072] 1. Information Integration
[0073] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[0074] 2. Information display
[0075] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[0076] Specific examples
[0077] For example, if a user inputs a goal such as "Complete a full marathon within three years," the server analyzes that goal and generates a specific training plan based on the user's current fitness level and past data. Based on this generated scenario, a future diary entry is created in which the user has completed the full marathon. The user can read this future diary entry and ask their future self a question, such as, "What was particularly difficult on the way to completing the race?" The server generates an answer to this question based on past data and simulation results and sends it to the device. In addition, corporate advertisements related to training are inserted at appropriate points, allowing the user to view effective advertisements while obtaining the necessary information.
[0078] This allows users to visualize their goals more clearly and understand the process to achieve them, while also enabling companies to deliver advertisements at the right time, resulting in effective marketing.
[0079] The processing flow will be explained below.
[0080] ---
[0081] Step 1:
[0082] Users input their goals and dreams (e.g., "to complete a full marathon within three years") via a device such as a smartphone or computer.
[0083] Step 2:
[0084] The terminal transmits the input target data to the server.
[0085] Step 3:
[0086] The server analyzes the received target data and stores it in the user's database.
[0087] Step 4:
[0088] The server analyzes the goal data and collects related information (such as past user data and the process of completing a typical full marathon).
[0089] Step 5:
[0090] The server uses an AI engine to simulate the process of achieving a goal and generate a specific training plan and steps, taking into account past success stories and expert guidelines.
[0091] Step 6:
[0092] The server creates a template for a future diary entry based on the goal achievement scenario generated by the AI engine.
[0093] Step 7:
[0094] The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific situation, emotions, and sense of accomplishment of that day.
[0095] Step 8:
[0096] The device provides the user with a future diary and displays an interface for interacting with their future self.
[0097] Step 9:
[0098] The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[0099] The server receives and analyzes the query data.
[0100] Step 10:
[0101] The server generates future-self responses based on the questions it receives, based on simulated goal-funneling processes and user data.
[0102] Step 11:
[0103] The server sends the generated response to the terminal.
[0104] Step 12:
[0105] The device will then display the user's response from their future self.
[0106] Step 13:
[0107] The server selects ads for businesses that fit the user's goal-building process, such as ads for workout wear or fitness apps.
[0108] Step 14:
[0109] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[0110] Step 15:
[0111] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[0112] Step 16:
[0113] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[0114] ---
[0115] Through these steps, users can understand the specific process of achieving their goals, be motivated through dialogue with their future selves, and easily create plans to achieve their goals. Furthermore, companies can earn revenue through effective advertising.
[0116] Example 1
[0117] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0118] In conventional goal achievement support systems, users simply input their goals, but the specific process of achieving them and their progress are not visualized well. Furthermore, opportunities for users to receive specific feedback on their goals are limited, making it difficult to maintain motivation. Furthermore, methods for monetizing through advertising insertion are also limited. This resulted in low user goal achievement rates and made effective marketing difficult to achieve.
[0119] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0120] In this invention, the server includes means for a user to input goals and dreams, means for analyzing the input goals and dreams and generating a scenario for achieving the goal, means for creating a future diary based on the generated scenario, means for the user to access the future diary and interact with their future self, means for inserting advertisements related to the goal-achievement process, means for accepting and analyzing the user's questions and generating responses from the future self, and means for integrating and providing the future diary, the content of the interaction, and advertisements to the user. This allows the user to visualize the specific goal-achievement process, receive feedback, and maintain motivation, and also makes it possible to deliver advertisements at appropriate times.
[0121] A "user" is someone who has goals and dreams and receives support from this system to achieve them.
[0122] "Goals and dreams" refers to the specific goals and future visions that users want to achieve.
[0123] "Means" refers to the method or device used by the system to achieve a particular function.
[0124] "Analysis" refers to the act of understanding the content of the entered goals and dreams and collecting and processing information based on that.
[0125] A "scenario" is a detailed plan that outlines the process and steps a user will take to achieve their goal.
[0126] A "future diary" is a document that details future events or situations in which a user achieves a goal.
[0127] "Dialogue" refers to two-way communication between the user and the system (future self).
[0128] "Advertising" refers to marketing content that informs users about products and services offered by companies.
[0129] "Response" refers to the answer provided by the system to a user's question.
[0130] "Integration" refers to the act of bringing together and organizing different information or content.
[0131] MODE FOR CARRYING OUT THE INVENTION
[0132] The system of the present invention allows users to input their goals and dreams and generate a diary of the future when those goals have been achieved. Users can also interact with their future selves and understand the process leading up to achieving their goals. Furthermore, advertising revenue can be earned by inserting advertisements related to the process of achieving the goals.
[0133] The processing of this system is realized by the various hardware and software components shown below.
[0134] Hardware and software used
[0135] Device: A smartphone or computer is used as an input device for users to enter their goals and dreams.
[0136] Server: A computer system equipped with a processor and storage is used to analyze data, generate scenarios, create future diaries, generate dialogue responses, and insert advertisements.
[0137] Generative AI models: Use AI models that specialize in natural language processing and generation, specifically applying techniques such as GPT-3 and its successors.
[0138] Database: We use a database management system to store and manage your fitness data, success story data, and advertising data.
[0139] Program processing flow
[0140] 1. User goal input
[0141] Users input their goal, such as "to complete a full marathon within three years," using a device such as a smartphone or computer.
[0142] The terminal transmits the input target data to the server.
[0143] 2. Target data analysis and scenario generation
[0144] The server analyzes the received goal data and collects related information, including past user data and information about the process of completing a typical full marathon.
[0145] The server uses a generative AI model to generate a scenario for achieving the goal and creates a specific training plan and steps.
[0146] 3. Create a diary of the future
[0147] The server initializes a template for the future diary based on the generated scenario.
[0148] The server uses the template to generate future diary entries for specific events (e.g., the day a full marathon is completed), describing the details of the situation, including emotions and a sense of accomplishment.
[0149] 4. Talk to your future self
[0150] The device displays the future diary and provides the user with an interface for interacting with their future self.
[0151] The user enters a question such as "What was particularly difficult about completing the race?" and the device sends the question to the server.
[0152] The server analyzes the question and uses a generative AI model to generate a response from your future self, which is then sent to the device.
[0153] The terminal displays the response to the user.
[0154] 5. Corporate advertising
[0155] The server selects ads that fit the user's goal funnel, such as ads for sportswear or fitness apps.
[0156] The server inserts advertisements into goal-achievement scenarios and interactive interfaces at appropriate times.
[0157] 6. Integration and provision of information
[0158] The server integrates the generated future diary, the content of the conversation with the future self, and advertisements, and transmits them to the terminal.
[0159] The device displays integrated information to the user in one place.
[0160] Specific examples
[0161] For example, if a user inputs a goal such as "to complete a full marathon within three years," the server analyzes the goal and generates a specific training plan based on the user's current fitness level and past data. Based on this generated scenario, a future diary entry is created in which the user has completed the full marathon. The user can read this future diary entry and ask their future self, "What was particularly difficult on the way to completing the race?" The server generates an answer to this question based on past data and simulation results and sends it to the device. In addition, corporate advertisements related to training are inserted at appropriate points, allowing the user to view effective advertisements while obtaining the necessary information.
[0162] Prompt Sentence Examples
[0163] An example of a prompt sentence to be input to the generative AI model is shown below.
[0164] prompt:
[0165] "Please tell us your specific training plan for completing a full marathon within three years. Also, please write a future diary entry, including your situation and emotions on the day you complete the race."
[0166] This allows users to visualize their goals more clearly and understand the process to achieve them, while also enabling companies to deliver advertisements at the right time, resulting in effective marketing.
[0167] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0168] Step 1:
[0169] User enters goal
[0170] Users input their goal, such as "to complete a full marathon within three years," via a device such as a smartphone or computer.
[0171] Input: Users enter their goals and dreams in text format.
[0172] Output: The terminal saves the input target data and prepares it for transmission to the server.
[0173] Step 2:
[0174] Send goal data
[0175] The terminal transmits the target data entered by the user to the server.
[0176] Input: The goal data entered by the user.
[0177] Data processing: The terminal converts the data format appropriately so that it can be sent.
[0178] Output: The target data sent to the server.
[0179] Step 3:
[0180] Analyzing goal data
[0181] The server analyzes the transmitted target data and collects relevant information.
[0182] Input: The target data received by the server.
[0183] Data processing: Past user data and the general process of completing a full marathon are referenced and analyzed.
[0184] Output: The analysis results in the user's current fitness level and related data.
[0185] Step 4:
[0186] Generate a Goal-achieving Scenarios
[0187] The server uses an AI engine to simulate the process of achieving goals and generate specific training plans and steps.
[0188] Input: Parsed target data.
[0189] Data calculation: The generative AI model performs simulations based on past success stories and expert guidelines.
[0190] Output: A goal achievement scenario with specific training plans and steps.
[0191] Step 5:
[0192] Initialize the future diary
[0193] The server creates a template for a future diary entry based on the goal achievement scenario generated by the AI engine.
[0194] Input: Goal achievement scenario.
[0195] Data processing: Build the framework for the future diary and input the necessary data into the template.
[0196] Output: A template for your future diary.
[0197] Step 6:
[0198] Create diary content
[0199] The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific situation, emotions, and sense of accomplishment of that day.
[0200] Input: Future diary template and goal achievement scenario.
[0201] Data processing: Generative AI models generate specific situations and emotions.
[0202] Output: Future diary entry.
[0203] Step 7:
[0204] Providing a conversational interface
[0205] The device provides the user with a future diary and displays an interface for interacting with their future self.
[0206] Enter: Future diary entry.
[0207] Data processing: Convert the future diary into a format that can be displayed on the interface.
[0208] Output: Future diary displayed to the user.
[0209] Step 8:
[0210] Accepting user questions
[0211] The terminal accepts questions from the user and sends them to the server.
[0212] Input: The question entered by the user.
[0213] Output: The query data sent to the server.
[0214] Step 9:
[0215] Generate an AI response
[0216] The server analyzes the question data received from the user and generates a response from the future self.
[0217] Input: Question data.
[0218] Data calculation: The generative AI model generates a response based on past data and simulation results.
[0219] Output: Your response as your future self.
[0220] Step 10:
[0221] View dialogue responses
[0222] The device will then display the user's response from their future self.
[0223] Input: Your response as your future self.
[0224] Data processing: Converting the response into a format that can be displayed to the user.
[0225] Output: The interaction response displayed to the user.
[0226] Step 11:
[0227] Select advertising data
[0228] The server selects ads that fit the user's goal process.
[0229] Input: User goal data and goal achievement scenario.
[0230] Data processing: Extracting appropriate advertisements from the advertisement database.
[0231] Output: Selected advertising data.
[0232] Step 12:
[0233] Insert ads
[0234] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[0235] Input: Selected advertising data.
[0236] Data processing: Optimizing the display position and format of advertisements.
[0237] Output: The inserted ad.
[0238] Step 13:
[0239] Integrate information
[0240] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[0241] Input: Future diary, dialogue, advertisements.
[0242] Data processing: Integrate all content into one package.
[0243] Output: Consolidated information.
[0244] Step 14:
[0245] View information
[0246] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[0247] Input: Consolidated information.
[0248] Data processing: Organize and display information in an easy-to-read format.
[0249] Output: The consolidated information displayed to the user.
[0250] (Application example 1)
[0251] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0252] Conventional goal achievement support systems have difficulty in helping users visualize their goals and effectively support the process of achieving them. Additionally, they lack a means to effectively insert advertisements related to the goal achievement process at the right time, resulting in insufficient marketing effectiveness.
[0253] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0254] In this invention, the server includes: a means for a user to input goals and dreams; a means for analyzing the input goals and dreams and generating a scenario for achieving the goal; a means for creating a future diary based on the generated scenario; a means for the user to access the future diary and interact with their future self; a means for inserting advertisements related to the goal achievement process; a means for generating new diary entries at each step of the goal achievement process according to the user's current progress and situation; and a means for dynamically displaying advertisements related to the generated diary entries. This makes it easier for the user to concretely visualize the goal achievement process, and by appropriately and effectively inserting related advertisements, it is possible to enhance marketing effectiveness.
[0255] A "user" is an individual who uses the system to input their goals and dreams.
[0256] "Goals and dreams" refers to the specific achievements and desires that users wish to achieve.
[0257] A "means for inputting goals and dreams" is a device or application with a user interface that allows a user to input goals and dreams into the system.
[0258] A "means for generating a scenario for achieving a goal" is a method or algorithm that analyzes input goals or dreams and creates a specific plan for the process leading to the achievement of those goals.
[0259] The "means for creating a future diary" is a system that automatically generates a diary that records the user's future achievement status and emotions based on the generated goal achievement scenario.
[0260] The "means for interacting with your future self" refers to an interface and algorithms that allow users to engage in virtual interactions with their future selves through the generated future diary.
[0261] An "ad insertion vehicle" is a mechanism for inserting funnel-relevant ads into the system at the appropriate time.
[0262] The "means for generating new diary entries" is a system for dynamically generating new diary entries according to the user's current progress and situation.
[0263] The "means for dynamically displaying advertisements" is a mechanism for displaying related advertisements in real time in response to the generated diary entries and the user's progress.
[0264] The system of the present invention provides a means for users to input their goals and dreams and generate a diary of the future when those goals have been achieved. Users can also interact with their future selves and learn about the process leading up to goal achievement. Furthermore, advertising revenue can be earned by dynamically inserting advertisements into the goal achievement process.
[0265] Building the user interface
[0266] Technology used: Swift (iOS), Kotlin (Android)
[0267] We will create a screen with a text field and a submit button for users to enter their goals. The user will enter their goals and dreams into the device, and the system will receive that data. For example, the user might enter, "I want to complete a full marathon within three years."
[0268] Goal input function
[0269] Technologies used: Swift (iOS), Kotlin (Android)
[0270] It receives the goal data entered by the user and sends it to the server, which analyzes the received goal data and stores it in the user's database.
[0271] Communicating with the Server
[0272] Technology used: REST API, Firebase
[0273] The server analyzes the goal data and stores it in a database to generate a scenario for achieving the goal. At this time, it references the user's past data and general goal achievement process to generate a specific plan and steps.
[0274] Target analysis and scenario generation
[0275] Technology used: Python, TensorFlow
[0276] The server uses an AI engine to analyze the goal data and generate a scenario for achieving the goal, for example, by referring to past success stories and expert guidelines to create specific steps and plans tailored to the user.
[0277] Future diary generation
[0278] Technology used: GPT-4 (natural language generation model)
[0279] The server creates a template for the future diary based on the scenario generated by the AI engine. It generates diary entries for specific events, describing the specific situation and emotions of that day. For example, for a goal such as "the user will complete a full marathon within three years," it uses the following prompts:
[0280] Prompt statement:
[0281] "The user has a goal of completing a full marathon within three years. Imagine a day two years from now and describe the efforts and progress they've made toward achieving that goal."
[0282] Example output:
[0283] "May 30, 2025: I ran 15 kilometers today. It was really tough at first, but I feel like training three times a week is starting to pay off. I'm breathing more easily now. My marathon shoes are starting to fit my feet better, so it was a really good purchase."
[0284] Implementing interactive features
[0285] Technologies used: Dialogflow, natural language processing library
[0286] When a user reads their future diary and enters a question, the server receives and analyzes the question. The AI engine generates a response from their future self based on the question. For example, if a user asks, "What was particularly difficult about completing the race?", an appropriate response will be generated and sent to the device.
[0287] Ad insertion function
[0288] Technology used: AdMob (mobile advertising library)
[0289] The server has the means to display advertisements relevant to the user's goal achievement process at the appropriate time. For example, advertisements for training shoes or health management apps are displayed. Advertising data is managed on the server side and inserted dynamically according to the user's progress.
[0290] These tools allow users to visualize their goals and understand the process to achieve them, while the system dynamically displays appropriate ads to maximize marketing effectiveness.
[0291] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0292] Step 1:
[0293] Users input their goals and dreams into the device through an interface for entering goals. For example, a user might input a goal such as "to complete a full marathon within three years." The entered goal data is then stored as temporary data on the device.
[0294] Step 2:
[0295] The device sends the entered target data to the server as an HTTP request using the cloud service API. The input data is sent to the server in JSON format, and the server stores it in a database for analysis.
[0296] Step 3:
[0297] The server analyzes the received goal data and stores the results in the user's database. This analysis uses data mining techniques to look up the user's past goal achievement history and common success stories. The output is the analysis data and specific elements of the goal based on it.
[0298] Step 4:
[0299] The server generates a scenario for achieving the goal based on the analysis data. This scenario generation uses a machine learning model and provides the user with specific steps and plans for achieving the goal. The generated scenario is saved in the system database, and scenario data is obtained as output.
[0300] Step 5:
[0301] The server generates a future diary entry based on the scenario data. For this, it uses the generative AI model GPT-4, and generates a specific diary entry by inputting, for example, the following prompt: "The user has a goal of completing a full marathon within three years. Imagine a day two years from now and describe the efforts and progress toward achieving that goal." The future diary entry is obtained as output.
[0302] Step 6:
[0303] The device receives the generated future diary and displays it to the user, who is then provided with an interface to read the future diary and input specific questions, which are then sent from the user to the server.
[0304] Step 7:
[0305] The server analyzes the received question and generates a response from the future self. This is done using Dialogflow and natural language processing libraries. After analyzing the question and performing the necessary data processing, an answer is generated using a generative AI model. The generated response data is obtained as output.
[0306] Step 8:
[0307] The device receives the response data from the server and displays it to the user, allowing the user to experience a conversation with their future self.
[0308] Step 9:
[0309] The server generates new diary entries based on the user's progress and scenario, again using analytics and AI generative models, utilizing the progress data as input, with the new diary entries as output.
[0310] Step 10:
[0311] The server provides a means to dynamically select and display advertisements related to newly created diary entries. For example, AdMob can be used to display relevant advertisements on the user's screen. This allows for effective advertisement display and can be expected to have a positive marketing effect.
[0312] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0313] ---
[0314] The system of the present invention combines a means for users to input their goals and dreams, generate a diary of the future when those goals are achieved, and an emotion engine that recognizes the user's emotions. This system allows users to interact with their future selves and specifically understand the process leading to goal achievement. It also provides a new marketing channel for effectively inserting corporate advertisements to generate advertising revenue.
[0315] The system program processes in the following steps:
[0316] User enters goal
[0317] 1. The user inputs their goal or dream (e.g., "to complete a full marathon within three years") via a device such as a smartphone or computer.
[0318] 2. The terminal transmits the entered target data to the server.
[0319] Making goals concrete
[0320] 1. The server analyzes the received target data and stores it in the user's database.
[0321] 2. The server analyzes the goal data and collects related information (such as past user data and the process of completing a typical full marathon).
[0322] 3. The server uses an AI engine to simulate the goal-achievement process and generate a specific training plan and steps, taking into account past success stories and expert guidelines.
[0323] Future diary generation
[0324] 1. The server creates a template for a future diary based on the goal achievement scenario generated by the AI engine.
[0325] 2. The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific circumstances, emotions, and sense of accomplishment of that day.
[0326] Emotion recognition by emotion engine
[0327] 1. The device collects emotional data from the user through facial expressions, voice, text, etc.
[0328] 2. The server analyzes the received emotion data using an emotion engine to recognize the user's current emotional state.
[0329] 3. The server adjusts the scenario and advice based on the recognized emotions and provides feedback adapted to the user's emotions.
[0330] Dialogue with your future self
[0331] 1. The device provides the user with a future diary and displays an interface for interacting with their future self.
[0332] 2. The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[0333] 3. The server receives and analyzes the query data.
[0334] 4. The server generates future-self responses based on the received questions, based on the simulated goal-funnel process and user data.
[0335] 5. The server generates a response and sends it to the terminal.
[0336] 6. The device displays the user's future self's response.
[0337] Corporate advertising inserts
[0338] 1. The server selects ads for businesses that fit the user's goal-building process, such as ads for workout wear or fitness apps.
[0339] 2. The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[0340] 3. The server adjusts the content and timing of advertisements according to the user's emotional state.
[0341] Providing information to users
[0342] 1. The server combines the generated future diary, the conversation with your future self, and corporate advertisements, and sends them to the device.
[0343] 2. The device displays the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[0344] Specific examples
[0345] For example, if a user inputs a goal such as "to complete a full marathon within three years," the server analyzes the goal and generates a specific training plan based on the user's current fitness level and past data. Based on this generated scenario, a diary entry is created for the future in which the user has completed the full marathon.
[0346] If a user reads this future diary and asks their future self, for example, "What was particularly difficult about completing the race?", the server will generate an answer based on past data and simulation results and send it to the device. Furthermore, the user's emotion engine will recognize their emotions, and if it detects that the user is feeling unmotivated, for example, the system will provide encouraging messages and motivational advice. Corporate advertisements related to training are also inserted at appropriate points, allowing users to view effective advertisements while obtaining the necessary information.
[0347] ---
[0348] This allows users to visualize their goals more clearly and understand the process to achieve them. Furthermore, incorporating emotion recognition makes support for users more personalized and effective. Companies can deliver advertisements at the right time, enabling more effective marketing.
[0349] The processing flow will be explained below.
[0350] ---
[0351] Step 1:
[0352] Users input their goals and dreams (e.g., "to complete a full marathon within three years") via a device such as a smartphone or computer.
[0353] Step 2:
[0354] The terminal transmits the input target data to the server.
[0355] Step 3:
[0356] The server analyzes the received target data and stores it in the user's database.
[0357] Step 4:
[0358] The server analyzes the goal data and collects related information (such as past user data and the process of completing a typical full marathon).
[0359] Step 5:
[0360] The server uses an AI engine to simulate the process of achieving a goal and generate a specific training plan and steps, taking into account past success stories and expert guidelines.
[0361] Step 6:
[0362] The server creates a template for a future diary entry based on the goal achievement scenario generated by the AI engine.
[0363] Step 7:
[0364] The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific situation, emotions, and sense of accomplishment of that day.
[0365] Step 8:
[0366] The device provides the user with a future diary and displays an interface for interacting with their future self.
[0367] Step 9:
[0368] The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[0369] Step 10:
[0370] The server receives and analyzes the query data.
[0371] Step 11:
[0372] The server generates future-self responses based on the questions it receives, based on simulated goal-funneling processes and user data.
[0373] Step 12:
[0374] The server sends the generated response to the terminal.
[0375] Step 13:
[0376] The device will then display the user's response from their future self.
[0377] Step 14:
[0378] The device collects emotional data through the user's facial expressions, voice, text, etc.
[0379] Step 15:
[0380] The server analyzes the received emotion data using an emotion engine to recognize the user's current emotional state.
[0381] Step 16:
[0382] The server adjusts scenarios and advice based on the recognized emotions and provides feedback adapted to the user's emotions.
[0383] Step 17:
[0384] The server selects ads for businesses that fit the user's goal-building process, such as ads for workout wear or fitness apps.
[0385] Step 18:
[0386] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[0387] Step 19:
[0388] The server adjusts the content and timing of advertisements according to the user's emotional state.
[0389] Step 20:
[0390] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[0391] Step 21:
[0392] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[0393] ---
[0394] Through these steps, users can understand the specific process of achieving their goals, be motivated through dialogue with their future selves, and easily create plans to achieve their goals. Furthermore, by combining the emotion engine, support for users can be more personalized and effective. Companies can also earn revenue through effective ad delivery.
[0395] Example 2
[0396] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0397] Many users today find it difficult to maintain the specific process and motivation required to achieve their goals and dreams. They also have few opportunities to receive personalized support that addresses their emotional fluctuations, and are unable to properly navigate the path to achieving their goals. Furthermore, advertisers face challenges in effectively delivering ads that adapt to users' emotions and goals.
[0398] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for the user to input goals and dreams, a means for analyzing the input goals and dreams and generating a scenario for achieving the goals, a means for creating a future diary based on the generated scenario, a means for the user to access the future diary and interact with their future self, a means for inserting corporate advertisements related to the goal-achievement process, a means for collecting and analyzing emotional data such as the user's facial expressions, voice, and text, and a means for providing feedback adapted to the user's emotional state. This allows the user to concretely visualize their goals while receiving individual support, making it easier for them to maintain motivation to achieve them. It also provides an effective marketing channel for advertisers.
[0399] A "user" is an entity that uses the system to input goals and dreams and receives scenarios and feedback generated based on those goals and dreams.
[0400] "Means for inputting goals and dreams" refers to an interface that allows users to input their goals and dreams via devices such as smartphones or computers.
[0401] "Means for analyzing goals and dreams and generating a scenario for achieving those goals" is a function that allows the server to analyze the goals and dreams entered and generate a process and schedule for achieving them.
[0402] The "means for creating a future diary" is a function that allows the server to create a future diary of daily records leading up to the achievement of the user's goal based on the scenario generated.
[0403] "A means of communicating with your future self" is an interface that allows users to access their future diary and communicate with their future self in chatbot format.
[0404] "Means for inserting corporate advertising" is a function that allows ads related to the user's goal achievement process to be displayed at the appropriate time.
[0405] "Means for collecting and analyzing emotional data" refers to a function for collecting and analyzing emotional data through the user's facial expressions, voice, text, etc.
[0406] The "means for providing feedback" is a function for providing feedback or advice adapted to the user's emotional state based on the analyzed emotional data.
[0407] This system allows users to input their goals and dreams, and then embodies the process for achieving those goals. The system generates a scenario and future diary for achieving the goal, provides personalized feedback based on emotional data, and effectively inserts corporate advertisements tailored to the user.
[0408] Hardware and software used
[0409] The system is implemented using the following hardware and software:
[0410] User device: Smartphone, PC, etc. This allows users to input their goals and dreams and display the results.
[0411] Server: Cloud server or data center. Analyzes target data, generates scenarios, manages databases, and analyzes emotion data.
[0412] Generative AI model: A natural language processing engine that generates goal achievement scenarios and future diaries.
[0413] Emotion analysis engine: Software that analyzes a user's facial expressions, voice, and text to recognize their emotional state.
[0414] Specific processing of the system
[0415] Goal input phase
[0416] 1. The user enters their goals or dreams (e.g., "to complete a full marathon within three years") into a device such as a smartphone or computer.
[0417] 2. The terminal transmits the entered target data to the server.
[0418] Goal specification phase
[0419] 1. The server analyzes the received target data and stores it in the user's database.
[0420] 2. The server collects relevant information (past user data, general achievement process, etc.) based on the goal data.
[0421] 3. The server uses an AI engine to simulate the process of achieving the goal and generate a specific training plan and steps.
[0422] Future diary generation phase
[0423] 1. The server uses an AI engine to create a template for the future diary based on the generated goal achievement scenario.
[0424] 2. The server generates a diary entry based on a specific event (e.g., the specific situation and emotions on the day of completing a full marathon).
[0425] Emotion recognition phase using the emotion engine
[0426] 1. The device collects emotional data from the user through facial expressions, voice, text, etc.
[0427] 2. The server analyzes the received emotion data using an emotion engine to recognize the user's current emotional state.
[0428] 3. The server adjusts the scenario and advice based on the recognized emotions and provides feedback adapted to the user's emotions.
[0429] Dialogue with your future self phase
[0430] 1. The device provides the user with a future diary and displays an interface for interacting with their future self.
[0431] 2. The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[0432] 3. The server receives and analyzes the question data and generates a response from the future self.
[0433] 4. The server generates a response and sends it to the terminal.
[0434] 5. The device displays the user's future self's response.
[0435] Corporate advertising insertion phase
[0436] 1. The server selects corporate advertisements that fit the user's goal achievement process.
[0437] 2. The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[0438] 3. The server adjusts the content and timing of advertisements according to the user's emotional state.
[0439] Providing information to users
[0440] 1. The server integrates the generated future diary, the content of the conversation with your future self, and related corporate advertisements, and sends them to the device.
[0441] 2. The device displays the user's future diary, conversations with their future self, and corporate advertisements all at once.
[0442] Examples and prompts
[0443] For example, if a user inputs a goal such as "to complete a full marathon within three years," the server analyzes the goal and generates a specific training plan based on the user's current fitness level and past data. Based on this generated scenario, a diary entry is created for the future in which the user has completed the full marathon.
[0444] Example prompt for a generative AI model:
[0445] Create a future diary entry for a user with the goal of completing a full marathon within three years. The diary entry should include training details, key events, and the specific circumstances and emotions of the final completion day.
[0446] This system allows users to visualize their goals in concrete terms and understand the process to achieve them. Furthermore, by incorporating emotion recognition, personalized support can be provided to maintain motivation. Companies can also deliver effective advertising that adapts to users' emotions and goals.
[0447] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0448] The flow of this system's program processing
[0449] Goal input phase
[0450] Step 1:
[0451] Users input their goals and dreams into a device such as a smartphone or computer.
[0452] Input: The user enters their goal in text form (e.g., "Run a full marathon within three years").
[0453] Specific action: The user enters a goal into the device's text box and presses the "Submit" button.
[0454] Output: The entered target data is saved to the device.
[0455] Step 2:
[0456] The terminal transmits the input target data to the server.
[0457] Input: The goal data entered by the user.
[0458] Specific operation: The terminal sends the target data to the server via the network.
[0459] Output: The target data arrives at the server.
[0460] Goal specification phase
[0461] Step 3:
[0462] The server analyzes the received target data and stores it in a database of users.
[0463] Input: Received target data.
[0464] What happens: The server uses a text analysis algorithm to analyze the goal data and saves it as a new goal item in the user's database.
[0465] Output: Goal data stored in a database.
[0466] Step 4:
[0467] The server collects relevant information based on the analyzed goal data, including past user data and general achievement processes.
[0468] Input: Parsed target data, user database.
[0469] Specific behavior: The server searches for relevant success stories and user history and collects the necessary data.
[0470] Output: Collected relevant information data.
[0471] Step 5:
[0472] The server uses a generative AI model to simulate the process of achieving goals and generate specific training plans and steps.
[0473] Input: Collected relevant information data, prompt sentences for the generative AI model.
[0474] Specific operation: Enter a prompt such as "Complete a full marathon within three years" into the generative AI model and obtain the generated training plan.
[0475] Output: The generated training plan data.
[0476] Future diary generation phase
[0477] Step 6:
[0478] The server creates a template for a future diary based on the generated goal achievement scenario.
[0479] Input: Generated training plan data.
[0480] Specific operation: The server writes the training plan according to the diary template format.
[0481] Output: Future diary template data.
[0482] Step 7:
[0483] The server generates diary entries based on specific events (e.g., the specific situation and emotions on the day of completing a full marathon).
[0484] Input: Future diary template data, specific event data.
[0485] Specific behavior: The server fills in a template field corresponding to a specific date, describing the "date of completion of full marathon" and its details.
[0486] Output: Completed diary entry data.
[0487] Emotion recognition phase using the emotion engine
[0488] Step 8:
[0489] The device collects emotional data through the user's facial expressions, voice, text, etc.
[0490] Input: User facial expression, voice, and text data.
[0491] Specific operation: Collects user emotion data in real time using the device's camera and microphone.
[0492] Output: Collected emotion data.
[0493] Step 9:
[0494] The server analyzes the received emotion data using an emotion engine to recognize the user's current emotional state.
[0495] Input: Collected emotion data.
[0496] What it does: The server analyzes the data using an emotion analysis algorithm to determine the emotional state.
[0497] Output: Determined emotional state data.
[0498] Step 10:
[0499] The server adjusts scenarios and advice based on the recognized emotions and provides feedback adapted to the user's emotions.
[0500] Input: Determined emotional state data.
[0501] Specific behavior: The server adapts and customizes scenarios and advice based on the emotional state.
[0502] Output: Customized feedback data.
[0503] Dialogue with your future self phase
[0504] Step 11:
[0505] The device provides the user with a future diary and displays an interface for interacting with their future self.
[0506] Input: Future diary data.
[0507] Specific behavior: The device displays the appropriate interface and allows the user to view the diary.
[0508] Output: The displayed future diary interface.
[0509] Step 12:
[0510] The terminal accepts questions from the user and transmits them to the server.
[0511] Input: User question data.
[0512] Specific operation: The user enters a question on the interface, and the device sends it to the server.
[0513] Output: The question data sent to the server.
[0514] Step 13:
[0515] The server receives and analyzes the question data and generates a response as the future self.
[0516] Input: Submitted question data and user database.
[0517] Specific Action: The server analyzes the question and generates a specific response based on the user's goal achievement.
[0518] Output: The generated response data.
[0519] Step 14:
[0520] The server sends the generated response to the terminal.
[0521] Input: The generated response data.
[0522] Specific operation: The server sends response data to the terminal.
[0523] Output: The response data sent to the device.
[0524] Step 15:
[0525] The device will then display the user's response from their future self.
[0526] Input: The response data sent.
[0527] Specific operation: The device displays the response data on the screen so that the user can view it.
[0528] Output: The displayed response.
[0529] Corporate advertising insertion phase
[0530] Step 16:
[0531] The server selects business advertisements that fit the user's goal funnel.
[0532] Input: User data, advertising database.
[0533] What happens: The server analyzes user data and searches for relevant ads.
[0534] Output: Selected advertising data.
[0535] Step 17:
[0536] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[0537] Input: Selected advertising data, future diary data.
[0538] What happens: The server embeds ads into the goal-finding scenario or interaction interface.
[0539] Output: Advertisement data inserted into the diary and interface.
[0540] Step 18:
[0541] The terminal displays the advertisement sent from the server to the user.
[0542] Input: The inserted ad data.
[0543] What it does: The device displays the advertisement and allows the user to view it.
[0544] Output: The displayed ad.
[0545] Providing information to users
[0546] Step 19:
[0547] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[0548] Input: Diary data, dialogue content, advertising data.
[0549] Specific operation: The server consolidates all data and sends it to the device in bulk.
[0550] Output: A consolidated dataset.
[0551] Step 20:
[0552] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[0553] Input: The integrated dataset.
[0554] What it does: The device displays the integrated information on the screen so that the user can review it.
[0555] Output: Displayed future diary, dialogue, and advertisements.
[0556] Through these steps, the system can help users achieve their goals and provide personalized feedback and relevant advertising.
[0557] (Application example 2)
[0558] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0559] Conventional goal achievement support systems allow users to input their goals and provide support in the process, but they have difficulty providing personalized feedback and advice because they do not take the user's emotional state into account. Furthermore, when it comes to inserting corporate advertisements, it is difficult to deliver advertisements at the optimal time based on the user's needs and emotions. The present invention aims to solve these problems and provide personalized support that takes the user's emotions into account, as well as effective advertisement delivery.
[0560] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for the user to input goals and dreams, means for analyzing the input goals and dreams and generating a scenario for achieving the goal, means for creating a future diary based on the generated scenario, emotion recognition means for recognizing the user's current emotional state, means for the user to access the future diary and interact with their future self, means for adjusting the scenario and advice based on the recognized emotional state, and means for inserting corporate advertisements related to the goal-achievement process. This enables personalized support that takes the user's emotions into consideration and effective advertisement delivery.
[0561] "Means for users to input their goals and dreams" refers to the interface or device that allows users to input their goals and dreams into the system.
[0562] "Means for analyzing input goals and dreams and generating scenarios for achieving those goals" refers to software or algorithms that analyze the goals and dreams input by the user and, based on that, carry out specific processes and simulations for achieving those goals.
[0563] "Means for creating a future diary based on the generated scenario" refers to a technology that automatically generates diary entries to record the future situation in which the user achieves their goal, based on the analyzed goal achievement scenario.
[0564] "Emotion recognition means for recognizing the user's current emotional state" refers to technology or devices for determining the user's current emotional state from facial expressions, voice, text, etc.
[0565] "Means for users to access their future diary and interact with their future selves" refers to an interface or system that allows users to view the generated future diary and ask questions or comment on its contents in an interactive format.
[0566] "Means for adjusting scenarios and advice based on the recognized emotional state" refers to technology that analyzes the user's emotional state and changes or adjusts the content of the goal-achievement scenario or advice provided based on the results.
[0567] "Means for inserting corporate advertisements relevant to the process of achieving goals" refers to technologies and systems for displaying corporate advertisements at appropriate times that match the user's process of achieving their goals.
[0568] This invention relates to a system that allows users to input their goals and dreams, generates a diary entry of the future when those goals are achieved, and combines it with an emotion engine that recognizes the user's emotions. This system allows users to specifically understand the process of achieving their goals and receive feedback and advice adapted to their emotions. Furthermore, it provides a new marketing channel for generating advertising revenue by effectively inserting corporate advertisements.
[0569] System configuration and operation
[0570] This system uses the following main hardware and software:
[0571] Smartphone or smart glasses: a device that allows users to input their goals, view future diaries, and utilize a camera to capture facial expressions.
[0572] Camera: A device that captures the user's facial expressions and sends them to the emotion engine.
[0573] TensorFlow: Software used for training and inference of emotion recognition models.
[0574] OpenCV: A software library for face detection and facial expression analysis.
[0575] LangChain: Software used for future diary generation and natural language processing.
[0576] Firebase: A database service that stores and manages user data.
[0577] Program processing explanation
[0578] The server provides a means for users to input their goals and dreams through their devices. The input goal data is sent to the server in real time, which receives and analyzes it. The analysis combines past user data and general rules of success to generate a scenario for achieving the goal. The generated scenario is provided to the user in the form of a future diary using LangChain.
[0579] The camera on a smartphone or smart glasses captures the user's facial expressions and analyzes their emotions in real time using OpenCV and TensorFlow. The analyzed emotional data is sent to a server, which uses an emotion engine to determine the user's current emotional state. Based on this information, future scenarios and advice are adjusted in real time. For example, if the user is feeling down, an encouraging message or specific advice to motivate them is provided.
[0580] The server then inserts appropriate corporate advertisements related to the goal-achievement process, optimizing the content of the advertisements based on the user's emotional state and the scenario of the goal achievement. For example, sports-related goals could be matched with advertisements for training equipment and fitness apps.
[0581] Specific examples
[0582] If a user sets a goal of "running a full marathon within three years," that goal will be stored on the server via Firebase. The server will generate a specific training plan based on the user's current fitness level and past data, and create a future diary using LangChain. For example, the following will be generated:
[0583] Suppose a user has a goal of "running a full marathon within three years." Generate a future diary. The diary should include the process of achieving the goal, a specific training plan, and emotional changes. For example, "On the first day of training, I felt a little depressed, but after a month, I started to enjoy running."
[0584] While users are viewing their diary entries using their smartphones or smart glasses, the camera continuously analyzes their facial expressions, and the server uses the emotion recognition results to provide encouraging messages and appropriate advice. Training-related corporate advertisements are also seamlessly inserted, allowing users to see effective advertisements along with specific information on how to achieve their goals.
[0585] In this way, we can achieve effective marketing while helping users achieve their goals.
[0586] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0587] Step 1:
[0588] The user inputs their goals and dreams (e.g., "to complete a full marathon within three years") via a device such as a smartphone or PC. The input goal data is sent from the device to a server. On the device, the user writes their goal in a text field and presses the send button.
[0589] Input: User goal data
[0590] Output: Target data sent to the server
[0591] Step 2:
[0592] The server analyzes the received goal data and stores it in the user's database. The analysis is performed based on past user data and general success stories. In this process, the server extracts the goal data and stores it in the database as structured data.
[0593] Input: Received target data
[0594] Output: Parsed data stored in a database
[0595] Step 3:
[0596] The server analyzes the goal data and collects related information, including past user data and the process of completing a typical full marathon. Based on this information, an AI engine is used to simulate the process of achieving the goal.
[0597] Input: Historical user data, general success stories
[0598] Output: Simulated goal-funnel process
[0599] Step 4:
[0600] The server generates a specific training plan and steps based on the simulation results. In this process, the server sets the type of training the user should do and the goals for each stage based on the data generated by the AI engine.
[0601] Input: Simulation results
[0602] Output: Specific training plan
[0603] Step 5:
[0604] The server creates future diary entries based on the generated training plan and steps. For example, it automatically generates diary entries for each training day or event day. Using LangChain, each diary entry is generated in a way that is easy to understand and motivating for the user.
[0605] Input: Specific training plan
[0606] Output: Future diary entry
[0607] Step 6:
[0608] The device collects emotional data through the user's facial expressions, voice, text, etc. This process involves using a camera and microphone to capture the user's facial expressions and voice in real time and sending them to a server.
[0609] Input: User facial expressions, voice, text
[0610] Output: Emotion data sent to the server
[0611] Step 7:
[0612] The server uses an emotion engine to analyze the received emotional data and recognize the user's current emotional state. It uses TensorFlow and OpenCV to determine the emotional component and reflects the results in the internal system.
[0613] Input: Received emotion data
[0614] Output: Perceived emotional state
[0615] Step 8:
[0616] The server then tailors the scenario and advice based on the recognized emotions. For example, if the user is feeling down, this step generates encouraging messages and specific advice to motivate them.
[0617] Input: Emotional state
[0618] Output: Tailored scenarios and advice
[0619] Step 9:
[0620] The device provides the user with a future diary and displays an interface for interacting with their future self. At this stage, the user can view the generated future diary and even ask questions or make comments in an interactive format.
[0621] Input: Future diary entry, adjusted scenario
[0622] Output: Interactive interface
[0623] Step 10:
[0624] The server selects corporate advertisements related to the process of achieving the goal, inserts the advertisements into the goal achievement scenario and dialogue interface at the appropriate time, and adjusts the content and timing of the advertisements based on the user's emotional state.
[0625] Input: Goal achievement scenario, emotional state
[0626] Output: Inserted ads
[0627] Step 11:
[0628] The device integrates the generated future diary, the user's conversations, and relevant corporate advertisements, and displays them all in one place to the user, allowing the user to receive emotionally tailored advice and effective advertisements along with specific information for achieving their goals.
[0629] Input: Future diary, dialogue, advertisements
[0630] Output: Display of consolidated information
[0631] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0632] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0633] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0634] [Second embodiment]
[0635] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0636] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0637] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0638] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0639] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0640] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0641] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0642] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0643] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0644] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0645] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0646] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0647] ---
[0648] The system of the present invention provides a means for users to input their goals and dreams and generate a diary of the future when those goals have been achieved. Users can also interact with their future selves and learn about the process leading to goal achievement. Furthermore, by inserting corporate advertisements into the goal achievement process, advertising revenue can be earned.
[0649] The system program processes in the following steps:
[0650] User enters goal
[0651] 1. User inputs goal
[0652] The user inputs their goal, such as "to complete a full marathon within three years," via a device such as a smartphone or computer.
[0653] 2. Send your goal data
[0654] The terminal transmits the input target data to the server.
[0655] The server analyzes the received target data and stores it in the user's database.
[0656] Making goals concrete
[0657] 1. Goal analysis
[0658] The server analyzes the goal data and collects related information, such as past user data and the typical process of completing a full marathon.
[0659] 2. Goal achievement scenario generation
[0660] The server uses an AI engine to simulate the process of achieving a goal and generate a specific training plan and steps, taking into account past success stories and expert guidelines.
[0661] Future diary generation
[0662] 1. Initializing the Future Diary
[0663] The server creates a template for a future diary entry based on the goal achievement scenario generated by the AI engine.
[0664] 2. Creating diary content
[0665] The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific situation, emotions, and sense of accomplishment of that day.
[0666] Dialogue with your future self
[0667] 1. Providing a conversational interface
[0668] The device provides the user with a future diary and displays an interface for interacting with their future self.
[0669] 2. Accepting questions
[0670] The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[0671] The server receives and analyzes the query data.
[0672] 3. AI response generation
[0673] The server generates future-self responses based on the questions it receives, based on simulated goal-funneling processes and user data.
[0674] The server sends the generated response to the terminal.
[0675] 4. Viewing Dialogues
[0676] The device will then display the user's response from their future self.
[0677] Corporate advertising inserts
[0678] 1. Selection of advertising data
[0679] The server selects ads for businesses that fit the user's goal-building process, such as ads for workout wear or fitness apps.
[0680] 2. Ad Insertion
[0681] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[0682] Providing information to users
[0683] 1. Information Integration
[0684] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[0685] 2. Information display
[0686] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[0687] Specific examples
[0688] For example, if a user inputs a goal such as "Complete a full marathon within three years," the server analyzes that goal and generates a specific training plan based on the user's current fitness level and past data. Based on this generated scenario, a future diary entry is created in which the user has completed the full marathon. The user can read this future diary entry and ask their future self a question, such as, "What was particularly difficult on the way to completing the race?" The server generates an answer to this question based on past data and simulation results and sends it to the device. In addition, corporate advertisements related to training are inserted at appropriate points, allowing the user to view effective advertisements while obtaining the necessary information.
[0689] This allows users to visualize their goals more clearly and understand the process to achieve them, while also enabling companies to deliver advertisements at the right time, resulting in effective marketing.
[0690] The processing flow will be explained below.
[0691] ---
[0692] Step 1:
[0693] Users input their goals and dreams (e.g., "to complete a full marathon within three years") via a device such as a smartphone or computer.
[0694] Step 2:
[0695] The terminal transmits the input target data to the server.
[0696] Step 3:
[0697] The server analyzes the received target data and stores it in the user's database.
[0698] Step 4:
[0699] The server analyzes the goal data and collects related information (such as past user data and the process of completing a typical full marathon).
[0700] Step 5:
[0701] The server uses an AI engine to simulate the process of achieving a goal and generate a specific training plan and steps, taking into account past success stories and expert guidelines.
[0702] Step 6:
[0703] The server creates a template for a future diary entry based on the goal achievement scenario generated by the AI engine.
[0704] Step 7:
[0705] The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific situation, emotions, and sense of accomplishment of that day.
[0706] Step 8:
[0707] The device provides the user with a future diary and displays an interface for interacting with their future self.
[0708] Step 9:
[0709] The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[0710] The server receives and analyzes the query data.
[0711] Step 10:
[0712] The server generates future-self responses based on the questions it receives, based on simulated goal-funneling processes and user data.
[0713] Step 11:
[0714] The server sends the generated response to the terminal.
[0715] Step 12:
[0716] The device will then display the user's response from their future self.
[0717] Step 13:
[0718] The server selects ads for businesses that fit the user's goal-building process, such as ads for workout wear or fitness apps.
[0719] Step 14:
[0720] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[0721] Step 15:
[0722] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[0723] Step 16:
[0724] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[0725] ---
[0726] Through these steps, users can understand the specific process of achieving their goals, be motivated through dialogue with their future selves, and easily create plans to achieve their goals. Furthermore, companies can earn revenue through effective advertising.
[0727] Example 1
[0728] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0729] In conventional goal achievement support systems, users simply input their goals, but the specific process of achieving them and their progress are not visualized well. Furthermore, opportunities for users to receive specific feedback on their goals are limited, making it difficult to maintain motivation. Furthermore, methods for monetizing through advertising insertion are also limited. This resulted in low user goal achievement rates and made effective marketing difficult to achieve.
[0730] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0731] In this invention, the server includes means for a user to input goals and dreams, means for analyzing the input goals and dreams and generating a scenario for achieving the goal, means for creating a future diary based on the generated scenario, means for the user to access the future diary and interact with their future self, means for inserting advertisements related to the goal-achievement process, means for accepting and analyzing the user's questions and generating responses from the future self, and means for integrating and providing the future diary, the content of the interaction, and advertisements to the user. This allows the user to visualize the specific goal-achievement process, receive feedback, and maintain motivation, and also makes it possible to deliver advertisements at appropriate times.
[0732] A "user" is someone who has goals and dreams and receives support from this system to achieve them.
[0733] "Goals and dreams" refers to the specific goals and future visions that users want to achieve.
[0734] "Means" refers to the method or device used by the system to achieve a particular function.
[0735] "Analysis" refers to the act of understanding the content of the entered goals and dreams and collecting and processing information based on that.
[0736] A "scenario" is a detailed plan that outlines the process and steps a user will take to achieve their goal.
[0737] A "future diary" is a document that details future events or situations in which a user achieves a goal.
[0738] "Dialogue" refers to two-way communication between the user and the system (future self).
[0739] "Advertising" refers to marketing content that informs users about products and services offered by companies.
[0740] "Response" refers to the answer provided by the system to a user's question.
[0741] "Integration" refers to the act of bringing together and organizing different information or content.
[0742] MODE FOR CARRYING OUT THE INVENTION
[0743] The system of the present invention allows users to input their goals and dreams and generate a diary of the future when those goals have been achieved. Users can also interact with their future selves and understand the process leading up to achieving their goals. Furthermore, advertising revenue can be earned by inserting advertisements related to the process of achieving the goals.
[0744] The processing of this system is realized by the various hardware and software components shown below.
[0745] Hardware and software used
[0746] Device: A smartphone or computer is used as an input device for users to enter their goals and dreams.
[0747] Server: A computer system equipped with a processor and storage is used to analyze data, generate scenarios, create future diaries, generate dialogue responses, and insert advertisements.
[0748] Generative AI models: Use AI models that specialize in natural language processing and generation, specifically applying techniques such as GPT-3 and its successors.
[0749] Database: We use a database management system to store and manage your fitness data, success story data, and advertising data.
[0750] Program processing flow
[0751] 1. User goal input
[0752] Users input their goal, such as "to complete a full marathon within three years," using a device such as a smartphone or computer.
[0753] The terminal transmits the input target data to the server.
[0754] 2. Target data analysis and scenario generation
[0755] The server analyzes the received goal data and collects related information, including past user data and information about the process of completing a typical full marathon.
[0756] The server uses a generative AI model to generate a scenario for achieving the goal and creates a specific training plan and steps.
[0757] 3. Create a diary of the future
[0758] The server initializes a template for the future diary based on the generated scenario.
[0759] The server uses the template to generate future diary entries for specific events (e.g., the day a full marathon is completed), describing the details of the situation, including emotions and a sense of accomplishment.
[0760] 4. Talk to your future self
[0761] The device displays the future diary and provides the user with an interface for interacting with their future self.
[0762] The user enters a question such as "What was particularly difficult about completing the race?" and the device sends the question to the server.
[0763] The server analyzes the question and uses a generative AI model to generate a response from your future self, which is then sent to the device.
[0764] The terminal displays the response to the user.
[0765] 5. Corporate advertising
[0766] The server selects ads that fit the user's goal funnel, such as ads for sportswear or fitness apps.
[0767] The server inserts advertisements into goal-achievement scenarios and interactive interfaces at appropriate times.
[0768] 6. Integration and provision of information
[0769] The server integrates the generated future diary, the content of the conversation with the future self, and advertisements, and transmits them to the terminal.
[0770] The device displays integrated information to the user in one place.
[0771] Specific examples
[0772] For example, if a user inputs a goal such as "to complete a full marathon within three years," the server analyzes the goal and generates a specific training plan based on the user's current fitness level and past data. Based on this generated scenario, a future diary entry is created in which the user has completed the full marathon. The user can read this future diary entry and ask their future self, "What was particularly difficult on the way to completing the race?" The server generates an answer to this question based on past data and simulation results and sends it to the device. In addition, corporate advertisements related to training are inserted at appropriate points, allowing the user to view effective advertisements while obtaining the necessary information.
[0773] Prompt Sentence Examples
[0774] An example of a prompt sentence to be input to the generative AI model is shown below.
[0775] prompt:
[0776] "Please tell us your specific training plan for completing a full marathon within three years. Also, please write a future diary entry, including your situation and emotions on the day you complete the race."
[0777] This allows users to visualize their goals more clearly and understand the process to achieve them, while also enabling companies to deliver advertisements at the right time, resulting in effective marketing.
[0778] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0779] Step 1:
[0780] User enters goal
[0781] Users input their goal, such as "to complete a full marathon within three years," via a device such as a smartphone or computer.
[0782] Input: Users enter their goals and dreams in text format.
[0783] Output: The terminal saves the input target data and prepares it for transmission to the server.
[0784] Step 2:
[0785] Send goal data
[0786] The terminal transmits the target data entered by the user to the server.
[0787] Input: The goal data entered by the user.
[0788] Data processing: The terminal converts the data format appropriately so that it can be sent.
[0789] Output: The target data sent to the server.
[0790] Step 3:
[0791] Analyzing goal data
[0792] The server analyzes the transmitted target data and collects relevant information.
[0793] Input: The target data received by the server.
[0794] Data processing: Past user data and the general process of completing a full marathon are referenced and analyzed.
[0795] Output: The analysis results in the user's current fitness level and related data.
[0796] Step 4:
[0797] Generate a Goal-achieving Scenarios
[0798] The server uses an AI engine to simulate the process of achieving goals and generate specific training plans and steps.
[0799] Input: Parsed target data.
[0800] Data calculation: The generative AI model performs simulations based on past success stories and expert guidelines.
[0801] Output: A goal achievement scenario with specific training plans and steps.
[0802] Step 5:
[0803] Initialize the future diary
[0804] The server creates a template for a future diary entry based on the goal achievement scenario generated by the AI engine.
[0805] Input: Goal achievement scenario.
[0806] Data processing: Build the framework for the future diary and input the necessary data into the template.
[0807] Output: A template for your future diary.
[0808] Step 6:
[0809] Create diary content
[0810] The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific situation, emotions, and sense of accomplishment of that day.
[0811] Input: Future diary template and goal achievement scenario.
[0812] Data processing: Generative AI models generate specific situations and emotions.
[0813] Output: Future diary entry.
[0814] Step 7:
[0815] Providing a conversational interface
[0816] The device provides the user with a future diary and displays an interface for interacting with their future self.
[0817] Enter: Future diary entry.
[0818] Data processing: Convert the future diary into a format that can be displayed on the interface.
[0819] Output: Future diary displayed to the user.
[0820] Step 8:
[0821] Accepting user questions
[0822] The terminal accepts questions from the user and sends them to the server.
[0823] Input: The question entered by the user.
[0824] Output: The query data sent to the server.
[0825] Step 9:
[0826] Generate an AI response
[0827] The server analyzes the question data received from the user and generates a response from the future self.
[0828] Input: Question data.
[0829] Data calculation: The generative AI model generates a response based on past data and simulation results.
[0830] Output: Your response as your future self.
[0831] Step 10:
[0832] View dialogue responses
[0833] The device will then display the user's response from their future self.
[0834] Input: Your response as your future self.
[0835] Data processing: Converting the response into a format that can be displayed to the user.
[0836] Output: The interaction response displayed to the user.
[0837] Step 11:
[0838] Select advertising data
[0839] The server selects ads that fit the user's goal process.
[0840] Input: User goal data and goal achievement scenario.
[0841] Data processing: Extracting appropriate advertisements from the advertisement database.
[0842] Output: Selected advertising data.
[0843] Step 12:
[0844] Insert ads
[0845] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[0846] Input: Selected advertising data.
[0847] Data processing: Optimizing the display position and format of advertisements.
[0848] Output: The inserted ad.
[0849] Step 13:
[0850] Integrate information
[0851] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[0852] Input: Future diary, dialogue, advertisements.
[0853] Data processing: Integrate all content into one package.
[0854] Output: Consolidated information.
[0855] Step 14:
[0856] View information
[0857] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[0858] Input: Consolidated information.
[0859] Data processing: Organize and display information in an easy-to-read format.
[0860] Output: The consolidated information displayed to the user.
[0861] (Application example 1)
[0862] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0863] Conventional goal achievement support systems have difficulty in helping users visualize their goals and effectively support the process of achieving them. Additionally, they lack a means to effectively insert advertisements related to the goal achievement process at the right time, resulting in insufficient marketing effectiveness.
[0864] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0865] In this invention, the server includes: a means for a user to input goals and dreams; a means for analyzing the input goals and dreams and generating a scenario for achieving the goal; a means for creating a future diary based on the generated scenario; a means for the user to access the future diary and interact with their future self; a means for inserting advertisements related to the goal achievement process; a means for generating new diary entries at each step of the goal achievement process according to the user's current progress and situation; and a means for dynamically displaying advertisements related to the generated diary entries. This makes it easier for the user to concretely visualize the goal achievement process, and by appropriately and effectively inserting related advertisements, it is possible to enhance marketing effectiveness.
[0866] A "user" is an individual who uses the system to input their goals and dreams.
[0867] "Goals and dreams" refers to the specific achievements and desires that users wish to achieve.
[0868] A "means for inputting goals and dreams" is a device or application with a user interface that allows a user to input goals and dreams into the system.
[0869] A "means for generating a scenario for achieving a goal" is a method or algorithm that analyzes input goals or dreams and creates a specific plan for the process leading to the achievement of those goals.
[0870] The "means for creating a future diary" is a system that automatically generates a diary that records the user's future achievement status and emotions based on the generated goal achievement scenario.
[0871] The "means for interacting with your future self" refers to an interface and algorithms that allow users to engage in virtual interactions with their future selves through the generated future diary.
[0872] An "ad insertion vehicle" is a mechanism for inserting funnel-relevant ads into the system at the appropriate time.
[0873] The "means for generating new diary entries" is a system for dynamically generating new diary entries according to the user's current progress and situation.
[0874] The "means for dynamically displaying advertisements" is a mechanism for displaying related advertisements in real time in response to the generated diary entries and the user's progress.
[0875] The system of the present invention provides a means for users to input their goals and dreams and generate a diary of the future when those goals have been achieved. Users can also interact with their future selves and learn about the process leading up to goal achievement. Furthermore, advertising revenue can be earned by dynamically inserting advertisements into the goal achievement process.
[0876] Building the user interface
[0877] Technology used: Swift (iOS), Kotlin (Android)
[0878] We will create a screen with a text field and a submit button for users to enter their goals. The user will enter their goals and dreams into the device, and the system will receive that data. For example, the user might enter, "I want to complete a full marathon within three years."
[0879] Goal input function
[0880] Technologies used: Swift (iOS), Kotlin (Android)
[0881] It receives the goal data entered by the user and sends it to the server, which analyzes the received goal data and stores it in the user's database.
[0882] Communicating with the Server
[0883] Technology used: REST API, Firebase
[0884] The server analyzes the goal data and stores it in a database to generate a scenario for achieving the goal. At this time, it references the user's past data and general goal achievement process to generate a specific plan and steps.
[0885] Target analysis and scenario generation
[0886] Technology used: Python, TensorFlow
[0887] The server uses an AI engine to analyze the goal data and generate a scenario for achieving the goal, for example, by referring to past success stories and expert guidelines to create specific steps and plans tailored to the user.
[0888] Future diary generation
[0889] Technology used: GPT-4 (natural language generation model)
[0890] The server creates a template for the future diary based on the scenario generated by the AI engine. It generates diary entries for specific events, describing the specific situation and emotions of that day. For example, for a goal such as "the user will complete a full marathon within three years," it uses the following prompts:
[0891] Prompt statement:
[0892] "The user has a goal of completing a full marathon within three years. Imagine a day two years from now and describe the efforts and progress they've made toward achieving that goal."
[0893] Example output:
[0894] "May 30, 2025: I ran 15 kilometers today. It was really tough at first, but I feel like training three times a week is starting to pay off. I'm breathing more easily now. My marathon shoes are starting to fit my feet better, so it was a really good purchase."
[0895] Implementing interactive features
[0896] Technologies used: Dialogflow, natural language processing library
[0897] When a user reads their future diary and enters a question, the server receives and analyzes the question. The AI engine generates a response from their future self based on the question. For example, if a user asks, "What was particularly difficult about completing the race?", an appropriate response will be generated and sent to the device.
[0898] Ad insertion function
[0899] Technology used: AdMob (mobile advertising library)
[0900] The server has the means to display advertisements relevant to the user's goal achievement process at the appropriate time. For example, advertisements for training shoes or health management apps are displayed. Advertising data is managed on the server side and inserted dynamically according to the user's progress.
[0901] These tools allow users to visualize their goals and understand the process to achieve them, while the system dynamically displays appropriate ads to maximize marketing effectiveness.
[0902] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0903] Step 1:
[0904] Users input their goals and dreams into the device through an interface for entering goals. For example, a user might input a goal such as "to complete a full marathon within three years." The entered goal data is then stored as temporary data on the device.
[0905] Step 2:
[0906] The device sends the entered target data to the server as an HTTP request using the cloud service API. The input data is sent to the server in JSON format, and the server stores it in a database for analysis.
[0907] Step 3:
[0908] The server analyzes the received goal data and stores the results in the user's database. This analysis uses data mining techniques to look up the user's past goal achievement history and common success stories. The output is the analysis data and specific elements of the goal based on it.
[0909] Step 4:
[0910] The server generates a scenario for achieving the goal based on the analysis data. This scenario generation uses a machine learning model and provides the user with specific steps and plans for achieving the goal. The generated scenario is saved in the system database, and scenario data is obtained as output.
[0911] Step 5:
[0912] The server generates a future diary entry based on the scenario data. For this, it uses the generative AI model GPT-4, and generates a specific diary entry by inputting, for example, the following prompt: "The user has a goal of completing a full marathon within three years. Imagine a day two years from now and describe the efforts and progress toward achieving that goal." The future diary entry is obtained as output.
[0913] Step 6:
[0914] The device receives the generated future diary and displays it to the user, who is then provided with an interface to read the future diary and input specific questions, which are then sent from the user to the server.
[0915] Step 7:
[0916] The server analyzes the received question and generates a response from the future self. This is done using Dialogflow and natural language processing libraries. After analyzing the question and performing the necessary data processing, an answer is generated using a generative AI model. The generated response data is obtained as output.
[0917] Step 8:
[0918] The device receives the response data from the server and displays it to the user, allowing the user to experience a conversation with their future self.
[0919] Step 9:
[0920] The server generates new diary entries based on the user's progress and scenario, again using analytics and AI generative models, utilizing the progress data as input, with the new diary entries as output.
[0921] Step 10:
[0922] The server provides a means to dynamically select and display advertisements related to newly created diary entries. For example, AdMob can be used to display relevant advertisements on the user's screen. This allows for effective advertisement display and can be expected to have a positive marketing effect.
[0923] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0924] ---
[0925] The system of the present invention combines a means for users to input their goals and dreams, generate a diary of the future when those goals are achieved, and an emotion engine that recognizes the user's emotions. This system allows users to interact with their future selves and specifically understand the process leading to goal achievement. It also provides a new marketing channel for effectively inserting corporate advertisements to generate advertising revenue.
[0926] The system program processes in the following steps:
[0927] User enters goal
[0928] 1. The user inputs their goal or dream (e.g., "to complete a full marathon within three years") via a device such as a smartphone or computer.
[0929] 2. The terminal transmits the entered target data to the server.
[0930] Making goals concrete
[0931] 1. The server analyzes the received target data and stores it in the user's database.
[0932] 2. The server analyzes the goal data and collects related information (such as past user data and the process of completing a typical full marathon).
[0933] 3. The server uses an AI engine to simulate the goal-achievement process and generate a specific training plan and steps, taking into account past success stories and expert guidelines.
[0934] Future diary generation
[0935] 1. The server creates a template for a future diary based on the goal achievement scenario generated by the AI engine.
[0936] 2. The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific circumstances, emotions, and sense of accomplishment of that day.
[0937] Emotion recognition by emotion engine
[0938] 1. The device collects emotional data from the user through facial expressions, voice, text, etc.
[0939] 2. The server analyzes the received emotion data using an emotion engine to recognize the user's current emotional state.
[0940] 3. The server adjusts the scenario and advice based on the recognized emotions and provides feedback adapted to the user's emotions.
[0941] Dialogue with your future self
[0942] 1. The device provides the user with a future diary and displays an interface for interacting with their future self.
[0943] 2. The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[0944] 3. The server receives and analyzes the query data.
[0945] 4. The server generates future-self responses based on the received questions, based on the simulated goal-funnel process and user data.
[0946] 5. The server generates a response and sends it to the terminal.
[0947] 6. The device displays the user's future self's response.
[0948] Corporate advertising inserts
[0949] 1. The server selects ads for businesses that fit the user's goal-building process, such as ads for workout wear or fitness apps.
[0950] 2. The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[0951] 3. The server adjusts the content and timing of advertisements according to the user's emotional state.
[0952] Providing information to users
[0953] 1. The server combines the generated future diary, the conversation with your future self, and corporate advertisements, and sends them to the device.
[0954] 2. The device displays the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[0955] Specific examples
[0956] For example, if a user inputs a goal such as "to complete a full marathon within three years," the server analyzes the goal and generates a specific training plan based on the user's current fitness level and past data. Based on this generated scenario, a diary entry is created for the future in which the user has completed the full marathon.
[0957] If a user reads this future diary and asks their future self, for example, "What was particularly difficult about completing the race?", the server will generate an answer based on past data and simulation results and send it to the device. Furthermore, the user's emotion engine will recognize their emotions, and if it detects that the user is feeling unmotivated, for example, the system will provide encouraging messages and motivational advice. Corporate advertisements related to training are also inserted at appropriate points, allowing users to view effective advertisements while obtaining the necessary information.
[0958] ---
[0959] This allows users to visualize their goals more clearly and understand the process to achieve them. Furthermore, incorporating emotion recognition makes support for users more personalized and effective. Companies can deliver advertisements at the right time, enabling more effective marketing.
[0960] The processing flow will be explained below.
[0961] ---
[0962] Step 1:
[0963] Users input their goals and dreams (e.g., "to complete a full marathon within three years") via a device such as a smartphone or computer.
[0964] Step 2:
[0965] The terminal transmits the input target data to the server.
[0966] Step 3:
[0967] The server analyzes the received target data and stores it in the user's database.
[0968] Step 4:
[0969] The server analyzes the goal data and collects related information (such as past user data and the process of completing a typical full marathon).
[0970] Step 5:
[0971] The server uses an AI engine to simulate the process of achieving a goal and generate a specific training plan and steps, taking into account past success stories and expert guidelines.
[0972] Step 6:
[0973] The server creates a template for a future diary entry based on the goal achievement scenario generated by the AI engine.
[0974] Step 7:
[0975] The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific situation, emotions, and sense of accomplishment of that day.
[0976] Step 8:
[0977] The device provides the user with a future diary and displays an interface for interacting with their future self.
[0978] Step 9:
[0979] The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[0980] Step 10:
[0981] The server receives and analyzes the query data.
[0982] Step 11:
[0983] The server generates future-self responses based on the questions it receives, based on simulated goal-funneling processes and user data.
[0984] Step 12:
[0985] The server sends the generated response to the terminal.
[0986] Step 13:
[0987] The device will then display the user's response from their future self.
[0988] Step 14:
[0989] The device collects emotional data through the user's facial expressions, voice, text, etc.
[0990] Step 15:
[0991] The server analyzes the received emotion data using an emotion engine to recognize the user's current emotional state.
[0992] Step 16:
[0993] The server adjusts scenarios and advice based on the recognized emotions and provides feedback adapted to the user's emotions.
[0994] Step 17:
[0995] The server selects ads for businesses that fit the user's goal-building process, such as ads for workout wear or fitness apps.
[0996] Step 18:
[0997] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[0998] Step 19:
[0999] The server adjusts the content and timing of advertisements according to the user's emotional state.
[1000] Step 20:
[1001] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[1002] Step 21:
[1003] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[1004] ---
[1005] Through these steps, users can understand the specific process of achieving their goals, be motivated through dialogue with their future selves, and easily create plans to achieve their goals. Furthermore, by combining the emotion engine, support for users can be more personalized and effective. Companies can also earn revenue through effective ad delivery.
[1006] Example 2
[1007] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1008] Many users today find it difficult to maintain the specific process and motivation required to achieve their goals and dreams. They also have few opportunities to receive personalized support that addresses their emotional fluctuations, and are unable to properly navigate the path to achieving their goals. Furthermore, advertisers face challenges in effectively delivering ads that adapt to users' emotions and goals.
[1009] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for the user to input goals and dreams, a means for analyzing the input goals and dreams and generating a scenario for achieving the goals, a means for creating a future diary based on the generated scenario, a means for the user to access the future diary and interact with their future self, a means for inserting corporate advertisements related to the goal-achievement process, a means for collecting and analyzing emotional data such as the user's facial expressions, voice, and text, and a means for providing feedback adapted to the user's emotional state. This allows the user to concretely visualize their goals while receiving individual support, making it easier for them to maintain motivation to achieve them. It also provides an effective marketing channel for advertisers.
[1010] A "user" is an entity that uses the system to input goals and dreams and receives scenarios and feedback generated based on those goals and dreams.
[1011] "Means for inputting goals and dreams" refers to an interface that allows users to input their goals and dreams via devices such as smartphones or computers.
[1012] "Means for analyzing goals and dreams and generating a scenario for achieving those goals" is a function that allows the server to analyze the goals and dreams entered and generate a process and schedule for achieving them.
[1013] The "means for creating a future diary" is a function that allows the server to create a future diary of daily records leading up to the achievement of the user's goal based on the scenario generated.
[1014] "A means of communicating with your future self" is an interface that allows users to access their future diary and communicate with their future self in chatbot format.
[1015] "Means for inserting corporate advertising" is a function that allows ads related to the user's goal achievement process to be displayed at the appropriate time.
[1016] "Means for collecting and analyzing emotional data" refers to a function for collecting and analyzing emotional data through the user's facial expressions, voice, text, etc.
[1017] The "means for providing feedback" is a function for providing feedback or advice adapted to the user's emotional state based on the analyzed emotional data.
[1018] This system allows users to input their goals and dreams, and then embodies the process for achieving those goals. The system generates a scenario and future diary for achieving the goal, provides personalized feedback based on emotional data, and effectively inserts corporate advertisements tailored to the user.
[1019] Hardware and software used
[1020] The system is implemented using the following hardware and software:
[1021] User device: Smartphone, PC, etc. This allows users to input their goals and dreams and display the results.
[1022] Server: Cloud server or data center. Analyzes target data, generates scenarios, manages databases, and analyzes emotion data.
[1023] Generative AI model: A natural language processing engine that generates goal achievement scenarios and future diaries.
[1024] Emotion analysis engine: Software that analyzes a user's facial expressions, voice, and text to recognize their emotional state.
[1025] Specific processing of the system
[1026] Goal input phase
[1027] 1. The user enters their goals or dreams (e.g., "to complete a full marathon within three years") into a device such as a smartphone or computer.
[1028] 2. The terminal transmits the entered target data to the server.
[1029] Goal specification phase
[1030] 1. The server analyzes the received target data and stores it in the user's database.
[1031] 2. The server collects relevant information (past user data, general achievement process, etc.) based on the goal data.
[1032] 3. The server uses an AI engine to simulate the process of achieving the goal and generate a specific training plan and steps.
[1033] Future diary generation phase
[1034] 1. The server uses an AI engine to create a template for the future diary based on the generated goal achievement scenario.
[1035] 2. The server generates a diary entry based on a specific event (e.g., the specific situation and emotions on the day of completing a full marathon).
[1036] Emotion recognition phase using the emotion engine
[1037] 1. The device collects emotional data from the user through facial expressions, voice, text, etc.
[1038] 2. The server analyzes the received emotion data using an emotion engine to recognize the user's current emotional state.
[1039] 3. The server adjusts the scenario and advice based on the recognized emotions and provides feedback adapted to the user's emotions.
[1040] Dialogue with your future self phase
[1041] 1. The device provides the user with a future diary and displays an interface for interacting with their future self.
[1042] 2. The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[1043] 3. The server receives and analyzes the question data and generates a response from the future self.
[1044] 4. The server generates a response and sends it to the terminal.
[1045] 5. The device displays the user's future self's response.
[1046] Corporate advertising insertion phase
[1047] 1. The server selects corporate advertisements that fit the user's goal achievement process.
[1048] 2. The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[1049] 3. The server adjusts the content and timing of advertisements according to the user's emotional state.
[1050] Providing information to users
[1051] 1. The server integrates the generated future diary, the content of the conversation with your future self, and related corporate advertisements, and sends them to the device.
[1052] 2. The device displays the user's future diary, conversations with their future self, and corporate advertisements all at once.
[1053] Examples and prompts
[1054] For example, if a user inputs a goal such as "to complete a full marathon within three years," the server analyzes the goal and generates a specific training plan based on the user's current fitness level and past data. Based on this generated scenario, a diary entry is created for the future in which the user has completed the full marathon.
[1055] Example prompt for a generative AI model:
[1056] Create a future diary entry for a user with the goal of completing a full marathon within three years. The diary entry should include training details, key events, and the specific circumstances and emotions of the final completion day.
[1057] This system allows users to visualize their goals in concrete terms and understand the process to achieve them. Furthermore, by incorporating emotion recognition, personalized support can be provided to maintain motivation. Companies can also deliver effective advertising that adapts to users' emotions and goals.
[1058] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1059] The flow of this system's program processing
[1060] Goal input phase
[1061] Step 1:
[1062] Users input their goals and dreams into a device such as a smartphone or computer.
[1063] Input: The user enters their goal in text form (e.g., "Run a full marathon within three years").
[1064] Specific action: The user enters a goal into the device's text box and presses the "Submit" button.
[1065] Output: The entered target data is saved to the device.
[1066] Step 2:
[1067] The terminal transmits the input target data to the server.
[1068] Input: The goal data entered by the user.
[1069] Specific operation: The terminal sends the target data to the server via the network.
[1070] Output: The target data arrives at the server.
[1071] Goal specification phase
[1072] Step 3:
[1073] The server analyzes the received target data and stores it in a database of users.
[1074] Input: Received target data.
[1075] What happens: The server uses a text analysis algorithm to analyze the goal data and saves it as a new goal item in the user's database.
[1076] Output: Goal data stored in a database.
[1077] Step 4:
[1078] The server collects relevant information based on the analyzed goal data, including past user data and general achievement processes.
[1079] Input: Parsed target data, user database.
[1080] Specific behavior: The server searches for relevant success stories and user history and collects the necessary data.
[1081] Output: Collected relevant information data.
[1082] Step 5:
[1083] The server uses a generative AI model to simulate the process of achieving goals and generate specific training plans and steps.
[1084] Input: Collected relevant information data, prompt sentences for the generative AI model.
[1085] Specific operation: Enter a prompt such as "Complete a full marathon within three years" into the generative AI model and obtain the generated training plan.
[1086] Output: The generated training plan data.
[1087] Future diary generation phase
[1088] Step 6:
[1089] The server creates a template for a future diary based on the generated goal achievement scenario.
[1090] Input: Generated training plan data.
[1091] Specific operation: The server writes the training plan according to the diary template format.
[1092] Output: Future diary template data.
[1093] Step 7:
[1094] The server generates diary entries based on specific events (e.g., the specific situation and emotions on the day of completing a full marathon).
[1095] Input: Future diary template data, specific event data.
[1096] Specific behavior: The server fills in a template field corresponding to a specific date, describing the "date of completion of full marathon" and its details.
[1097] Output: Completed diary entry data.
[1098] Emotion recognition phase using the emotion engine
[1099] Step 8:
[1100] The device collects emotional data through the user's facial expressions, voice, text, etc.
[1101] Input: User facial expression, voice, and text data.
[1102] Specific operation: Collects user emotion data in real time using the device's camera and microphone.
[1103] Output: Collected emotion data.
[1104] Step 9:
[1105] The server analyzes the received emotion data using an emotion engine to recognize the user's current emotional state.
[1106] Input: Collected emotion data.
[1107] What it does: The server analyzes the data using an emotion analysis algorithm to determine the emotional state.
[1108] Output: Determined emotional state data.
[1109] Step 10:
[1110] The server adjusts scenarios and advice based on the recognized emotions and provides feedback adapted to the user's emotions.
[1111] Input: Determined emotional state data.
[1112] Specific behavior: The server adapts and customizes scenarios and advice based on the emotional state.
[1113] Output: Customized feedback data.
[1114] Dialogue with your future self phase
[1115] Step 11:
[1116] The device provides the user with a future diary and displays an interface for interacting with their future self.
[1117] Input: Future diary data.
[1118] Specific behavior: The device displays the appropriate interface and allows the user to view the diary.
[1119] Output: The displayed future diary interface.
[1120] Step 12:
[1121] The terminal accepts questions from the user and transmits them to the server.
[1122] Input: User question data.
[1123] Specific operation: The user enters a question on the interface, and the device sends it to the server.
[1124] Output: The question data sent to the server.
[1125] Step 13:
[1126] The server receives and analyzes the question data and generates a response as the future self.
[1127] Input: Submitted question data and user database.
[1128] Specific Action: The server analyzes the question and generates a specific response based on the user's goal achievement.
[1129] Output: The generated response data.
[1130] Step 14:
[1131] The server sends the generated response to the terminal.
[1132] Input: The generated response data.
[1133] Specific operation: The server sends response data to the terminal.
[1134] Output: The response data sent to the device.
[1135] Step 15:
[1136] The device will then display the user's response from their future self.
[1137] Input: The response data sent.
[1138] Specific operation: The device displays the response data on the screen so that the user can view it.
[1139] Output: The displayed response.
[1140] Corporate advertising insertion phase
[1141] Step 16:
[1142] The server selects business advertisements that fit the user's goal funnel.
[1143] Input: User data, advertising database.
[1144] What happens: The server analyzes user data and searches for relevant ads.
[1145] Output: Selected advertising data.
[1146] Step 17:
[1147] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[1148] Input: Selected advertising data, future diary data.
[1149] What happens: The server embeds ads into the goal-finding scenario or interaction interface.
[1150] Output: Advertisement data inserted into the diary and interface.
[1151] Step 18:
[1152] The terminal displays the advertisement sent from the server to the user.
[1153] Input: The inserted ad data.
[1154] What it does: The device displays the advertisement and allows the user to view it.
[1155] Output: The displayed ad.
[1156] Providing information to users
[1157] Step 19:
[1158] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[1159] Input: Diary data, dialogue content, advertising data.
[1160] Specific operation: The server consolidates all data and sends it to the device in bulk.
[1161] Output: A consolidated dataset.
[1162] Step 20:
[1163] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[1164] Input: The integrated dataset.
[1165] What it does: The device displays the integrated information on the screen so that the user can review it.
[1166] Output: Displayed future diary, dialogue, and advertisements.
[1167] Through these steps, the system can help users achieve their goals and provide personalized feedback and relevant advertising.
[1168] (Application example 2)
[1169] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1170] Conventional goal achievement support systems allow users to input their goals and provide support in the process, but they have difficulty providing personalized feedback and advice because they do not take the user's emotional state into account. Furthermore, when it comes to inserting corporate advertisements, it is difficult to deliver advertisements at the optimal time based on the user's needs and emotions. The present invention aims to solve these problems and provide personalized support that takes the user's emotions into account, as well as effective advertisement delivery.
[1171] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for the user to input goals and dreams, means for analyzing the input goals and dreams and generating a scenario for achieving the goal, means for creating a future diary based on the generated scenario, emotion recognition means for recognizing the user's current emotional state, means for the user to access the future diary and interact with their future self, means for adjusting the scenario and advice based on the recognized emotional state, and means for inserting corporate advertisements related to the goal-achievement process. This enables personalized support that takes the user's emotions into consideration and effective advertisement delivery.
[1172] "Means for users to input their goals and dreams" refers to the interface or device that allows users to input their goals and dreams into the system.
[1173] "Means for analyzing input goals and dreams and generating scenarios for achieving those goals" refers to software or algorithms that analyze the goals and dreams input by the user and, based on that, carry out specific processes and simulations for achieving those goals.
[1174] "Means for creating a future diary based on the generated scenario" refers to a technology that automatically generates diary entries to record the future situation in which the user achieves their goal, based on the analyzed goal achievement scenario.
[1175] "Emotion recognition means for recognizing the user's current emotional state" refers to technology or devices for determining the user's current emotional state from facial expressions, voice, text, etc.
[1176] "Means for users to access their future diary and interact with their future selves" refers to an interface or system that allows users to view the generated future diary and ask questions or comment on its contents in an interactive format.
[1177] "Means for adjusting scenarios and advice based on the recognized emotional state" refers to technology that analyzes the user's emotional state and changes or adjusts the content of the goal-achievement scenario or advice provided based on the results.
[1178] "Means for inserting corporate advertisements relevant to the process of achieving goals" refers to technologies and systems for displaying corporate advertisements at appropriate times that match the user's process of achieving their goals.
[1179] This invention relates to a system that allows users to input their goals and dreams, generates a diary entry of the future when those goals are achieved, and combines it with an emotion engine that recognizes the user's emotions. This system allows users to specifically understand the process of achieving their goals and receive feedback and advice adapted to their emotions. Furthermore, it provides a new marketing channel for generating advertising revenue by effectively inserting corporate advertisements.
[1180] System configuration and operation
[1181] This system uses the following main hardware and software:
[1182] Smartphone or smart glasses: a device that allows users to input their goals, view future diaries, and utilize a camera to capture facial expressions.
[1183] Camera: A device that captures the user's facial expressions and sends them to the emotion engine.
[1184] TensorFlow: Software used for training and inference of emotion recognition models.
[1185] OpenCV: A software library for face detection and facial expression analysis.
[1186] LangChain: Software used for future diary generation and natural language processing.
[1187] Firebase: A database service that stores and manages user data.
[1188] Program processing explanation
[1189] The server provides a means for users to input their goals and dreams through their devices. The input goal data is sent to the server in real time, which receives and analyzes it. The analysis combines past user data and general rules of success to generate a scenario for achieving the goal. The generated scenario is provided to the user in the form of a future diary using LangChain.
[1190] The camera on a smartphone or smart glasses captures the user's facial expressions and analyzes their emotions in real time using OpenCV and TensorFlow. The analyzed emotional data is sent to a server, which uses an emotion engine to determine the user's current emotional state. Based on this information, future scenarios and advice are adjusted in real time. For example, if the user is feeling down, an encouraging message or specific advice to motivate them is provided.
[1191] The server then inserts appropriate corporate advertisements related to the goal-achievement process, optimizing the content of the advertisements based on the user's emotional state and the scenario of the goal achievement. For example, sports-related goals could be matched with advertisements for training equipment and fitness apps.
[1192] Specific examples
[1193] If a user sets a goal of "running a full marathon within three years," that goal will be stored on the server via Firebase. The server will generate a specific training plan based on the user's current fitness level and past data, and create a future diary using LangChain. For example, the following will be generated:
[1194] Suppose a user has a goal of "running a full marathon within three years." Generate a future diary. The diary should include the process of achieving the goal, a specific training plan, and emotional changes. For example, "On the first day of training, I felt a little depressed, but after a month, I started to enjoy running."
[1195] While users are viewing their diary entries using their smartphones or smart glasses, the camera continuously analyzes their facial expressions, and the server uses the emotion recognition results to provide encouraging messages and appropriate advice. Training-related corporate advertisements are also seamlessly inserted, allowing users to see effective advertisements along with specific information on how to achieve their goals.
[1196] In this way, we can achieve effective marketing while helping users achieve their goals.
[1197] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1198] Step 1:
[1199] The user inputs their goals and dreams (e.g., "to complete a full marathon within three years") via a device such as a smartphone or PC. The input goal data is sent from the device to a server. On the device, the user writes their goal in a text field and presses the send button.
[1200] Input: User goal data
[1201] Output: Target data sent to the server
[1202] Step 2:
[1203] The server analyzes the received goal data and stores it in the user's database. The analysis is performed based on past user data and general success stories. In this process, the server extracts the goal data and stores it in the database as structured data.
[1204] Input: Received target data
[1205] Output: Parsed data stored in a database
[1206] Step 3:
[1207] The server analyzes the goal data and collects related information, including past user data and the process of completing a typical full marathon. Based on this information, an AI engine is used to simulate the process of achieving the goal.
[1208] Input: Historical user data, general success stories
[1209] Output: Simulated goal-funnel process
[1210] Step 4:
[1211] The server generates a specific training plan and steps based on the simulation results. In this process, the server sets the type of training the user should do and the goals for each stage based on the data generated by the AI engine.
[1212] Input: Simulation results
[1213] Output: Specific training plan
[1214] Step 5:
[1215] The server creates future diary entries based on the generated training plan and steps. For example, it automatically generates diary entries for each training day or event day. Using LangChain, each diary entry is generated in a way that is easy to understand and motivating for the user.
[1216] Input: Specific training plan
[1217] Output: Future diary entry
[1218] Step 6:
[1219] The device collects emotional data through the user's facial expressions, voice, text, etc. This process involves using a camera and microphone to capture the user's facial expressions and voice in real time and sending them to a server.
[1220] Input: User facial expressions, voice, text
[1221] Output: Emotion data sent to the server
[1222] Step 7:
[1223] The server uses an emotion engine to analyze the received emotional data and recognize the user's current emotional state. It uses TensorFlow and OpenCV to determine the emotional component and reflects the results in the internal system.
[1224] Input: Received emotion data
[1225] Output: Perceived emotional state
[1226] Step 8:
[1227] The server then tailors the scenario and advice based on the recognized emotions. For example, if the user is feeling down, this step generates encouraging messages and specific advice to motivate them.
[1228] Input: Emotional state
[1229] Output: Tailored scenarios and advice
[1230] Step 9:
[1231] The device provides the user with a future diary and displays an interface for interacting with their future self. At this stage, the user can view the generated future diary and even ask questions or make comments in an interactive format.
[1232] Input: Future diary entry, adjusted scenario
[1233] Output: Interactive interface
[1234] Step 10:
[1235] The server selects corporate advertisements related to the process of achieving the goal, inserts the advertisements into the goal achievement scenario and dialogue interface at the appropriate time, and adjusts the content and timing of the advertisements based on the user's emotional state.
[1236] Input: Goal achievement scenario, emotional state
[1237] Output: Inserted ads
[1238] Step 11:
[1239] The device integrates the generated future diary, the user's conversations, and relevant corporate advertisements, and displays them all in one place to the user, allowing the user to receive emotionally tailored advice and effective advertisements along with specific information for achieving their goals.
[1240] Input: Future diary, dialogue, advertisements
[1241] Output: Display of consolidated information
[1242] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1243] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1244] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1245] [Third embodiment]
[1246] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1247] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[1248] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1249] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1250] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1251] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1252] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1253] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1254] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1255] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1256] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1257] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1258] ---
[1259] The system of the present invention provides a means for users to input their goals and dreams and generate a diary of the future when those goals have been achieved. Users can also interact with their future selves and learn about the process leading to goal achievement. Furthermore, by inserting corporate advertisements into the goal achievement process, advertising revenue can be earned.
[1260] The system program processes in the following steps:
[1261] User enters goal
[1262] 1. User inputs goal
[1263] The user inputs their goal, such as "to complete a full marathon within three years," via a device such as a smartphone or computer.
[1264] 2. Send your goal data
[1265] The terminal transmits the input target data to the server.
[1266] The server analyzes the received target data and stores it in the user's database.
[1267] Making goals concrete
[1268] 1. Goal analysis
[1269] The server analyzes the goal data and collects related information, such as past user data and the typical process of completing a full marathon.
[1270] 2. Goal achievement scenario generation
[1271] The server uses an AI engine to simulate the process of achieving a goal and generate a specific training plan and steps, taking into account past success stories and expert guidelines.
[1272] Future diary generation
[1273] 1. Initializing the Future Diary
[1274] The server creates a template for a future diary entry based on the goal achievement scenario generated by the AI engine.
[1275] 2. Creating diary content
[1276] The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific situation, emotions, and sense of accomplishment of that day.
[1277] Dialogue with your future self
[1278] 1. Providing a conversational interface
[1279] The device provides the user with a future diary and displays an interface for interacting with their future self.
[1280] 2. Accepting questions
[1281] The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[1282] The server receives and analyzes the query data.
[1283] 3. AI response generation
[1284] The server generates future-self responses based on the questions it receives, based on simulated goal-funneling processes and user data.
[1285] The server sends the generated response to the terminal.
[1286] 4. Viewing Dialogues
[1287] The device will then display the user's response from their future self.
[1288] Corporate advertising inserts
[1289] 1. Selection of advertising data
[1290] The server selects ads for businesses that fit the user's goal-building process, such as ads for workout wear or fitness apps.
[1291] 2. Ad Insertion
[1292] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[1293] Providing information to users
[1294] 1. Information Integration
[1295] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[1296] 2. Information display
[1297] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[1298] Specific examples
[1299] For example, if a user inputs a goal such as "Complete a full marathon within three years," the server analyzes that goal and generates a specific training plan based on the user's current fitness level and past data. Based on this generated scenario, a future diary entry is created in which the user has completed the full marathon. The user can read this future diary entry and ask their future self a question, such as, "What was particularly difficult on the way to completing the race?" The server generates an answer to this question based on past data and simulation results and sends it to the device. In addition, corporate advertisements related to training are inserted at appropriate points, allowing the user to view effective advertisements while obtaining the necessary information.
[1300] This allows users to visualize their goals more clearly and understand the process to achieve them, while also enabling companies to deliver advertisements at the right time, resulting in effective marketing.
[1301] The processing flow will be explained below.
[1302] ---
[1303] Step 1:
[1304] Users input their goals and dreams (e.g., "to complete a full marathon within three years") via a device such as a smartphone or computer.
[1305] Step 2:
[1306] The terminal transmits the input target data to the server.
[1307] Step 3:
[1308] The server analyzes the received target data and stores it in the user's database.
[1309] Step 4:
[1310] The server analyzes the goal data and collects related information (such as past user data and the process of completing a typical full marathon).
[1311] Step 5:
[1312] The server uses an AI engine to simulate the process of achieving a goal and generate a specific training plan and steps, taking into account past success stories and expert guidelines.
[1313] Step 6:
[1314] The server creates a template for a future diary entry based on the goal achievement scenario generated by the AI engine.
[1315] Step 7:
[1316] The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific situation, emotions, and sense of accomplishment of that day.
[1317] Step 8:
[1318] The device provides the user with a future diary and displays an interface for interacting with their future self.
[1319] Step 9:
[1320] The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[1321] The server receives and analyzes the query data.
[1322] Step 10:
[1323] The server generates future-self responses based on the questions it receives, based on simulated goal-funneling processes and user data.
[1324] Step 11:
[1325] The server sends the generated response to the terminal.
[1326] Step 12:
[1327] The device will then display the user's response from their future self.
[1328] Step 13:
[1329] The server selects ads for businesses that fit the user's goal-building process, such as ads for workout wear or fitness apps.
[1330] Step 14:
[1331] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[1332] Step 15:
[1333] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[1334] Step 16:
[1335] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[1336] ---
[1337] Through these steps, users can understand the specific process of achieving their goals, be motivated through dialogue with their future selves, and easily create plans to achieve their goals. Furthermore, companies can earn revenue through effective advertising.
[1338] Example 1
[1339] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1340] In conventional goal achievement support systems, users simply input their goals, but the specific process of achieving them and their progress are not visualized well. Furthermore, opportunities for users to receive specific feedback on their goals are limited, making it difficult to maintain motivation. Furthermore, methods for monetizing through advertising insertion are also limited. This resulted in low user goal achievement rates and made effective marketing difficult to achieve.
[1341] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1342] In this invention, the server includes means for a user to input goals and dreams, means for analyzing the input goals and dreams and generating a scenario for achieving the goal, means for creating a future diary based on the generated scenario, means for the user to access the future diary and interact with their future self, means for inserting advertisements related to the goal-achievement process, means for accepting and analyzing the user's questions and generating responses from the future self, and means for integrating and providing the future diary, the content of the interaction, and advertisements to the user. This allows the user to visualize the specific goal-achievement process, receive feedback, and maintain motivation, and also makes it possible to deliver advertisements at appropriate times.
[1343] A "user" is someone who has goals and dreams and receives support from this system to achieve them.
[1344] "Goals and dreams" refers to the specific goals and future visions that users want to achieve.
[1345] "Means" refers to the method or device used by the system to achieve a particular function.
[1346] "Analysis" refers to the act of understanding the content of the entered goals and dreams and collecting and processing information based on that.
[1347] A "scenario" is a detailed plan that outlines the process and steps a user will take to achieve their goal.
[1348] A "future diary" is a document that details future events or situations in which a user achieves a goal.
[1349] "Dialogue" refers to two-way communication between the user and the system (future self).
[1350] "Advertising" refers to marketing content that informs users about products and services offered by companies.
[1351] "Response" refers to the answer provided by the system to a user's question.
[1352] "Integration" refers to the act of bringing together and organizing different information or content.
[1353] MODE FOR CARRYING OUT THE INVENTION
[1354] The system of the present invention allows users to input their goals and dreams and generate a diary of the future when those goals have been achieved. Users can also interact with their future selves and understand the process leading up to achieving their goals. Furthermore, advertising revenue can be earned by inserting advertisements related to the process of achieving the goals.
[1355] The processing of this system is realized by the various hardware and software components shown below.
[1356] Hardware and software used
[1357] Device: A smartphone or computer is used as an input device for users to enter their goals and dreams.
[1358] Server: A computer system equipped with a processor and storage is used to analyze data, generate scenarios, create future diaries, generate dialogue responses, and insert advertisements.
[1359] Generative AI models: Use AI models that specialize in natural language processing and generation, specifically applying techniques such as GPT-3 and its successors.
[1360] Database: We use a database management system to store and manage your fitness data, success story data, and advertising data.
[1361] Program processing flow
[1362] 1. User goal input
[1363] Users input their goal, such as "to complete a full marathon within three years," using a device such as a smartphone or computer.
[1364] The terminal transmits the input target data to the server.
[1365] 2. Target data analysis and scenario generation
[1366] The server analyzes the received goal data and collects related information, including past user data and information about the process of completing a typical full marathon.
[1367] The server uses a generative AI model to generate a scenario for achieving the goal and creates a specific training plan and steps.
[1368] 3. Create a diary of the future
[1369] The server initializes a template for the future diary based on the generated scenario.
[1370] The server uses the template to generate future diary entries for specific events (e.g., the day a full marathon is completed), describing the details of the situation, including emotions and a sense of accomplishment.
[1371] 4. Talk to your future self
[1372] The device displays the future diary and provides the user with an interface for interacting with their future self.
[1373] The user enters a question such as "What was particularly difficult about completing the race?" and the device sends the question to the server.
[1374] The server analyzes the question and uses a generative AI model to generate a response from your future self, which is then sent to the device.
[1375] The terminal displays the response to the user.
[1376] 5. Corporate advertising
[1377] The server selects ads that fit the user's goal funnel, such as ads for sportswear or fitness apps.
[1378] The server inserts advertisements into goal-achievement scenarios and interactive interfaces at appropriate times.
[1379] 6. Integration and provision of information
[1380] The server integrates the generated future diary, the content of the conversation with the future self, and advertisements, and transmits them to the terminal.
[1381] The device displays integrated information to the user in one place.
[1382] Specific examples
[1383] For example, if a user inputs a goal such as "to complete a full marathon within three years," the server analyzes the goal and generates a specific training plan based on the user's current fitness level and past data. Based on this generated scenario, a future diary entry is created in which the user has completed the full marathon. The user can read this future diary entry and ask their future self, "What was particularly difficult on the way to completing the race?" The server generates an answer to this question based on past data and simulation results and sends it to the device. In addition, corporate advertisements related to training are inserted at appropriate points, allowing the user to view effective advertisements while obtaining the necessary information.
[1384] Prompt Sentence Examples
[1385] An example of a prompt sentence to be input to the generative AI model is shown below.
[1386] prompt:
[1387] "Please tell us your specific training plan for completing a full marathon within three years. Also, please write a future diary entry, including your situation and emotions on the day you complete the race."
[1388] This allows users to visualize their goals more clearly and understand the process to achieve them, while also enabling companies to deliver advertisements at the right time, resulting in effective marketing.
[1389] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1390] Step 1:
[1391] User enters goal
[1392] Users input their goal, such as "to complete a full marathon within three years," via a device such as a smartphone or computer.
[1393] Input: Users enter their goals and dreams in text format.
[1394] Output: The terminal saves the input target data and prepares it for transmission to the server.
[1395] Step 2:
[1396] Send goal data
[1397] The terminal transmits the target data entered by the user to the server.
[1398] Input: The goal data entered by the user.
[1399] Data processing: The terminal converts the data format appropriately so that it can be sent.
[1400] Output: The target data sent to the server.
[1401] Step 3:
[1402] Analyzing goal data
[1403] The server analyzes the transmitted target data and collects relevant information.
[1404] Input: The target data received by the server.
[1405] Data processing: Past user data and the general process of completing a full marathon are referenced and analyzed.
[1406] Output: The analysis results in the user's current fitness level and related data.
[1407] Step 4:
[1408] Generate a Goal-achieving Scenarios
[1409] The server uses an AI engine to simulate the process of achieving goals and generate specific training plans and steps.
[1410] Input: Parsed target data.
[1411] Data calculation: The generative AI model performs simulations based on past success stories and expert guidelines.
[1412] Output: A goal achievement scenario with specific training plans and steps.
[1413] Step 5:
[1414] Initialize the future diary
[1415] The server creates a template for a future diary entry based on the goal achievement scenario generated by the AI engine.
[1416] Input: Goal achievement scenario.
[1417] Data processing: Build the framework for the future diary and input the necessary data into the template.
[1418] Output: A template for your future diary.
[1419] Step 6:
[1420] Create diary content
[1421] The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific situation, emotions, and sense of accomplishment of that day.
[1422] Input: Future diary template and goal achievement scenario.
[1423] Data processing: Generative AI models generate specific situations and emotions.
[1424] Output: Future diary entry.
[1425] Step 7:
[1426] Providing a conversational interface
[1427] The device provides the user with a future diary and displays an interface for interacting with their future self.
[1428] Enter: Future diary entry.
[1429] Data processing: Convert the future diary into a format that can be displayed on the interface.
[1430] Output: Future diary displayed to the user.
[1431] Step 8:
[1432] Accepting user questions
[1433] The terminal accepts questions from the user and sends them to the server.
[1434] Input: The question entered by the user.
[1435] Output: The query data sent to the server.
[1436] Step 9:
[1437] Generate an AI response
[1438] The server analyzes the question data received from the user and generates a response from the future self.
[1439] Input: Question data.
[1440] Data calculation: The generative AI model generates a response based on past data and simulation results.
[1441] Output: Your response as your future self.
[1442] Step 10:
[1443] View dialogue responses
[1444] The device will then display the user's response from their future self.
[1445] Input: Your response as your future self.
[1446] Data processing: Converting the response into a format that can be displayed to the user.
[1447] Output: The interaction response displayed to the user.
[1448] Step 11:
[1449] Select advertising data
[1450] The server selects ads that fit the user's goal process.
[1451] Input: User goal data and goal achievement scenario.
[1452] Data processing: Extracting appropriate advertisements from the advertisement database.
[1453] Output: Selected advertising data.
[1454] Step 12:
[1455] Insert ads
[1456] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[1457] Input: Selected advertising data.
[1458] Data processing: Optimizing the display position and format of advertisements.
[1459] Output: The inserted ad.
[1460] Step 13:
[1461] Integrate information
[1462] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[1463] Input: Future diary, dialogue, advertisements.
[1464] Data processing: Integrate all content into one package.
[1465] Output: Consolidated information.
[1466] Step 14:
[1467] View information
[1468] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[1469] Input: Consolidated information.
[1470] Data processing: Organize and display information in an easy-to-read format.
[1471] Output: The consolidated information displayed to the user.
[1472] (Application example 1)
[1473] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1474] Conventional goal achievement support systems have difficulty in helping users visualize their goals and effectively support the process of achieving them. Additionally, they lack a means to effectively insert advertisements related to the goal achievement process at the right time, resulting in insufficient marketing effectiveness.
[1475] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1476] In this invention, the server includes: a means for a user to input goals and dreams; a means for analyzing the input goals and dreams and generating a scenario for achieving the goal; a means for creating a future diary based on the generated scenario; a means for the user to access the future diary and interact with their future self; a means for inserting advertisements related to the goal achievement process; a means for generating new diary entries at each step of the goal achievement process according to the user's current progress and situation; and a means for dynamically displaying advertisements related to the generated diary entries. This makes it easier for the user to concretely visualize the goal achievement process, and by appropriately and effectively inserting related advertisements, it is possible to enhance marketing effectiveness.
[1477] A "user" is an individual who uses the system to input their goals and dreams.
[1478] "Goals and dreams" refers to the specific achievements and desires that users wish to achieve.
[1479] A "means for inputting goals and dreams" is a device or application with a user interface that allows a user to input goals and dreams into the system.
[1480] A "means for generating a scenario for achieving a goal" is a method or algorithm that analyzes input goals or dreams and creates a specific plan for the process leading to the achievement of those goals.
[1481] The "means for creating a future diary" is a system that automatically generates a diary that records the user's future achievement status and emotions based on the generated goal achievement scenario.
[1482] The "means for interacting with your future self" refers to an interface and algorithms that allow users to engage in virtual interactions with their future selves through the generated future diary.
[1483] An "ad insertion vehicle" is a mechanism for inserting funnel-relevant ads into the system at the appropriate time.
[1484] The "means for generating new diary entries" is a system for dynamically generating new diary entries according to the user's current progress and situation.
[1485] The "means for dynamically displaying advertisements" is a mechanism for displaying related advertisements in real time in response to the generated diary entries and the user's progress.
[1486] The system of the present invention provides a means for users to input their goals and dreams and generate a diary of the future when those goals have been achieved. Users can also interact with their future selves and learn about the process leading up to goal achievement. Furthermore, advertising revenue can be earned by dynamically inserting advertisements into the goal achievement process.
[1487] Building the user interface
[1488] Technology used: Swift (iOS), Kotlin (Android)
[1489] We will create a screen with a text field and a submit button for users to enter their goals. The user will enter their goals and dreams into the device, and the system will receive that data. For example, the user might enter, "I want to complete a full marathon within three years."
[1490] Goal input function
[1491] Technologies used: Swift (iOS), Kotlin (Android)
[1492] It receives the goal data entered by the user and sends it to the server, which analyzes the received goal data and stores it in the user's database.
[1493] Communicating with the Server
[1494] Technology used: REST API, Firebase
[1495] The server analyzes the goal data and stores it in a database to generate a scenario for achieving the goal. At this time, it references the user's past data and general goal achievement process to generate a specific plan and steps.
[1496] Target analysis and scenario generation
[1497] Technology used: Python, TensorFlow
[1498] The server uses an AI engine to analyze the goal data and generate a scenario for achieving the goal, for example, by referring to past success stories and expert guidelines to create specific steps and plans tailored to the user.
[1499] Future diary generation
[1500] Technology used: GPT-4 (natural language generation model)
[1501] The server creates a template for the future diary based on the scenario generated by the AI engine. It generates diary entries for specific events, describing the specific situation and emotions of that day. For example, for a goal such as "the user will complete a full marathon within three years," it uses the following prompts:
[1502] Prompt statement:
[1503] "The user has a goal of completing a full marathon within three years. Imagine a day two years from now and describe the efforts and progress they've made toward achieving that goal."
[1504] Example output:
[1505] "May 30, 2025: I ran 15 kilometers today. It was really tough at first, but I feel like training three times a week is starting to pay off. I'm breathing more easily now. My marathon shoes are starting to fit my feet better, so it was a really good purchase."
[1506] Implementing interactive features
[1507] Technologies used: Dialogflow, natural language processing library
[1508] When a user reads their future diary and enters a question, the server receives and analyzes the question. The AI engine generates a response from their future self based on the question. For example, if a user asks, "What was particularly difficult about completing the race?", an appropriate response will be generated and sent to the device.
[1509] Ad insertion function
[1510] Technology used: AdMob (mobile advertising library)
[1511] The server has the means to display advertisements relevant to the user's goal achievement process at the appropriate time. For example, advertisements for training shoes or health management apps are displayed. Advertising data is managed on the server side and inserted dynamically according to the user's progress.
[1512] These tools allow users to visualize their goals and understand the process to achieve them, while the system dynamically displays appropriate ads to maximize marketing effectiveness.
[1513] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1514] Step 1:
[1515] Users input their goals and dreams into the device through an interface for entering goals. For example, a user might input a goal such as "to complete a full marathon within three years." The entered goal data is then stored as temporary data on the device.
[1516] Step 2:
[1517] The device sends the entered target data to the server as an HTTP request using the cloud service API. The input data is sent to the server in JSON format, and the server stores it in a database for analysis.
[1518] Step 3:
[1519] The server analyzes the received goal data and stores the results in the user's database. This analysis uses data mining techniques to look up the user's past goal achievement history and common success stories. The output is the analysis data and specific elements of the goal based on it.
[1520] Step 4:
[1521] The server generates a scenario for achieving the goal based on the analysis data. This scenario generation uses a machine learning model and provides the user with specific steps and plans for achieving the goal. The generated scenario is saved in the system database, and scenario data is obtained as output.
[1522] Step 5:
[1523] The server generates a future diary entry based on the scenario data. For this, it uses the generative AI model GPT-4, and generates a specific diary entry by inputting, for example, the following prompt: "The user has a goal of completing a full marathon within three years. Imagine a day two years from now and describe the efforts and progress toward achieving that goal." The future diary entry is obtained as output.
[1524] Step 6:
[1525] The device receives the generated future diary and displays it to the user, who is then provided with an interface to read the future diary and input specific questions, which are then sent from the user to the server.
[1526] Step 7:
[1527] The server analyzes the received question and generates a response from the future self. This is done using Dialogflow and natural language processing libraries. After analyzing the question and performing the necessary data processing, an answer is generated using a generative AI model. The generated response data is obtained as output.
[1528] Step 8:
[1529] The device receives the response data from the server and displays it to the user, allowing the user to experience a conversation with their future self.
[1530] Step 9:
[1531] The server generates new diary entries based on the user's progress and scenario, again using analytics and AI generative models, utilizing the progress data as input, with the new diary entries as output.
[1532] Step 10:
[1533] The server provides a means to dynamically select and display advertisements related to newly created diary entries. For example, AdMob can be used to display relevant advertisements on the user's screen. This allows for effective advertisement display and can be expected to have a positive marketing effect.
[1534] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1535] ---
[1536] The system of the present invention combines a means for users to input their goals and dreams, generate a diary of the future when those goals are achieved, and an emotion engine that recognizes the user's emotions. This system allows users to interact with their future selves and specifically understand the process leading to goal achievement. It also provides a new marketing channel for effectively inserting corporate advertisements to generate advertising revenue.
[1537] The system program processes in the following steps:
[1538] User enters goal
[1539] 1. The user inputs their goal or dream (e.g., "to complete a full marathon within three years") via a device such as a smartphone or computer.
[1540] 2. The terminal transmits the entered target data to the server.
[1541] Making goals concrete
[1542] 1. The server analyzes the received target data and stores it in the user's database.
[1543] 2. The server analyzes the goal data and collects related information (such as past user data and the process of completing a typical full marathon).
[1544] 3. The server uses an AI engine to simulate the goal-achievement process and generate a specific training plan and steps, taking into account past success stories and expert guidelines.
[1545] Future diary generation
[1546] 1. The server creates a template for a future diary based on the goal achievement scenario generated by the AI engine.
[1547] 2. The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific circumstances, emotions, and sense of accomplishment of that day.
[1548] Emotion recognition by emotion engine
[1549] 1. The device collects emotional data from the user through facial expressions, voice, text, etc.
[1550] 2. The server analyzes the received emotion data using an emotion engine to recognize the user's current emotional state.
[1551] 3. The server adjusts the scenario and advice based on the recognized emotions and provides feedback adapted to the user's emotions.
[1552] Dialogue with your future self
[1553] 1. The device provides the user with a future diary and displays an interface for interacting with their future self.
[1554] 2. The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[1555] 3. The server receives and analyzes the query data.
[1556] 4. The server generates future-self responses based on the received questions, based on the simulated goal-funnel process and user data.
[1557] 5. The server generates a response and sends it to the terminal.
[1558] 6. The device displays the user's future self's response.
[1559] Corporate advertising inserts
[1560] 1. The server selects ads for businesses that fit the user's goal-building process, such as ads for workout wear or fitness apps.
[1561] 2. The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[1562] 3. The server adjusts the content and timing of advertisements according to the user's emotional state.
[1563] Providing information to users
[1564] 1. The server combines the generated future diary, the conversation with your future self, and corporate advertisements, and sends them to the device.
[1565] 2. The device displays the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[1566] Specific examples
[1567] For example, if a user inputs a goal such as "to complete a full marathon within three years," the server analyzes the goal and generates a specific training plan based on the user's current fitness level and past data. Based on this generated scenario, a diary entry is created for the future in which the user has completed the full marathon.
[1568] If a user reads this future diary and asks their future self, for example, "What was particularly difficult about completing the race?", the server will generate an answer based on past data and simulation results and send it to the device. Furthermore, the user's emotion engine will recognize their emotions, and if it detects that the user is feeling unmotivated, for example, the system will provide encouraging messages and motivational advice. Corporate advertisements related to training are also inserted at appropriate points, allowing users to view effective advertisements while obtaining the necessary information.
[1569] ---
[1570] This allows users to visualize their goals more clearly and understand the process to achieve them. Furthermore, incorporating emotion recognition makes support for users more personalized and effective. Companies can deliver advertisements at the right time, enabling more effective marketing.
[1571] The processing flow will be explained below.
[1572] ---
[1573] Step 1:
[1574] Users input their goals and dreams (e.g., "to complete a full marathon within three years") via a device such as a smartphone or computer.
[1575] Step 2:
[1576] The terminal transmits the input target data to the server.
[1577] Step 3:
[1578] The server analyzes the received target data and stores it in the user's database.
[1579] Step 4:
[1580] The server analyzes the goal data and collects related information (such as past user data and the process of completing a typical full marathon).
[1581] Step 5:
[1582] The server uses an AI engine to simulate the process of achieving a goal and generate a specific training plan and steps, taking into account past success stories and expert guidelines.
[1583] Step 6:
[1584] The server creates a template for a future diary entry based on the goal achievement scenario generated by the AI engine.
[1585] Step 7:
[1586] The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific situation, emotions, and sense of accomplishment of that day.
[1587] Step 8:
[1588] The device provides the user with a future diary and displays an interface for interacting with their future self.
[1589] Step 9:
[1590] The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[1591] Step 10:
[1592] The server receives and analyzes the query data.
[1593] Step 11:
[1594] The server generates future-self responses based on the questions it receives, based on simulated goal-funneling processes and user data.
[1595] Step 12:
[1596] The server sends the generated response to the terminal.
[1597] Step 13:
[1598] The device will then display the user's response from their future self.
[1599] Step 14:
[1600] The device collects emotional data through the user's facial expressions, voice, text, etc.
[1601] Step 15:
[1602] The server analyzes the received emotion data using an emotion engine to recognize the user's current emotional state.
[1603] Step 16:
[1604] The server adjusts scenarios and advice based on the recognized emotions and provides feedback adapted to the user's emotions.
[1605] Step 17:
[1606] The server selects ads for businesses that fit the user's goal-building process, such as ads for workout wear or fitness apps.
[1607] Step 18:
[1608] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[1609] Step 19:
[1610] The server adjusts the content and timing of advertisements according to the user's emotional state.
[1611] Step 20:
[1612] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[1613] Step 21:
[1614] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[1615] ---
[1616] Through these steps, users can understand the specific process of achieving their goals, be motivated through dialogue with their future selves, and easily create plans to achieve their goals. Furthermore, by combining the emotion engine, support for users can be more personalized and effective. Companies can also earn revenue through effective ad delivery.
[1617] Example 2
[1618] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1619] Many users today find it difficult to maintain the specific process and motivation required to achieve their goals and dreams. They also have few opportunities to receive personalized support that addresses their emotional fluctuations, and are unable to properly navigate the path to achieving their goals. Furthermore, advertisers face challenges in effectively delivering ads that adapt to users' emotions and goals.
[1620] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for the user to input goals and dreams, a means for analyzing the input goals and dreams and generating a scenario for achieving the goals, a means for creating a future diary based on the generated scenario, a means for the user to access the future diary and interact with their future self, a means for inserting corporate advertisements related to the goal-achievement process, a means for collecting and analyzing emotional data such as the user's facial expressions, voice, and text, and a means for providing feedback adapted to the user's emotional state. This allows the user to concretely visualize their goals while receiving individual support, making it easier for them to maintain motivation to achieve them. It also provides an effective marketing channel for advertisers.
[1621] A "user" is an entity that uses the system to input goals and dreams and receives scenarios and feedback generated based on those goals and dreams.
[1622] "Means for inputting goals and dreams" refers to an interface that allows users to input their goals and dreams via devices such as smartphones or computers.
[1623] "Means for analyzing goals and dreams and generating a scenario for achieving those goals" is a function that allows the server to analyze the goals and dreams entered and generate a process and schedule for achieving them.
[1624] The "means for creating a future diary" is a function that allows the server to create a future diary of daily records leading up to the achievement of the user's goal based on the scenario generated.
[1625] "A means of communicating with your future self" is an interface that allows users to access their future diary and communicate with their future self in chatbot format.
[1626] "Means for inserting corporate advertising" is a function that allows ads related to the user's goal achievement process to be displayed at the appropriate time.
[1627] "Means for collecting and analyzing emotional data" refers to a function for collecting and analyzing emotional data through the user's facial expressions, voice, text, etc.
[1628] The "means for providing feedback" is a function for providing feedback or advice adapted to the user's emotional state based on the analyzed emotional data.
[1629] This system allows users to input their goals and dreams, and then embodies the process for achieving those goals. The system generates a scenario and future diary for achieving the goal, provides personalized feedback based on emotional data, and effectively inserts corporate advertisements tailored to the user.
[1630] Hardware and software used
[1631] The system is implemented using the following hardware and software:
[1632] User device: Smartphone, PC, etc. This allows users to input their goals and dreams and display the results.
[1633] Server: Cloud server or data center. Analyzes target data, generates scenarios, manages databases, and analyzes emotion data.
[1634] Generative AI model: A natural language processing engine that generates goal achievement scenarios and future diaries.
[1635] Emotion analysis engine: Software that analyzes a user's facial expressions, voice, and text to recognize their emotional state.
[1636] Specific processing of the system
[1637] Goal input phase
[1638] 1. The user enters their goals or dreams (e.g., "to complete a full marathon within three years") into a device such as a smartphone or computer.
[1639] 2. The terminal transmits the entered target data to the server.
[1640] Goal specification phase
[1641] 1. The server analyzes the received target data and stores it in the user's database.
[1642] 2. The server collects relevant information (past user data, general achievement process, etc.) based on the goal data.
[1643] 3. The server uses an AI engine to simulate the process of achieving the goal and generate a specific training plan and steps.
[1644] Future diary generation phase
[1645] 1. The server uses an AI engine to create a template for the future diary based on the generated goal achievement scenario.
[1646] 2. The server generates a diary entry based on a specific event (e.g., the specific situation and emotions on the day of completing a full marathon).
[1647] Emotion recognition phase using the emotion engine
[1648] 1. The device collects emotional data from the user through facial expressions, voice, text, etc.
[1649] 2. The server analyzes the received emotion data using an emotion engine to recognize the user's current emotional state.
[1650] 3. The server adjusts the scenario and advice based on the recognized emotions and provides feedback adapted to the user's emotions.
[1651] Dialogue with your future self phase
[1652] 1. The device provides the user with a future diary and displays an interface for interacting with their future self.
[1653] 2. The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[1654] 3. The server receives and analyzes the question data and generates a response from the future self.
[1655] 4. The server generates a response and sends it to the terminal.
[1656] 5. The device displays the user's future self's response.
[1657] Corporate advertising insertion phase
[1658] 1. The server selects corporate advertisements that fit the user's goal achievement process.
[1659] 2. The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[1660] 3. The server adjusts the content and timing of advertisements according to the user's emotional state.
[1661] Providing information to users
[1662] 1. The server integrates the generated future diary, the content of the conversation with your future self, and related corporate advertisements, and sends them to the device.
[1663] 2. The device displays the user's future diary, conversations with their future self, and corporate advertisements all at once.
[1664] Examples and prompts
[1665] For example, if a user inputs a goal such as "to complete a full marathon within three years," the server analyzes the goal and generates a specific training plan based on the user's current fitness level and past data. Based on this generated scenario, a diary entry is created for the future in which the user has completed the full marathon.
[1666] Example prompt for a generative AI model:
[1667] Create a future diary entry for a user with the goal of completing a full marathon within three years. The diary entry should include training details, key events, and the specific circumstances and emotions of the final completion day.
[1668] This system allows users to visualize their goals in concrete terms and understand the process to achieve them. Furthermore, by incorporating emotion recognition, personalized support can be provided to maintain motivation. Companies can also deliver effective advertising that adapts to users' emotions and goals.
[1669] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1670] The flow of this system's program processing
[1671] Goal input phase
[1672] Step 1:
[1673] Users input their goals and dreams into a device such as a smartphone or computer.
[1674] Input: The user enters their goal in text form (e.g., "Run a full marathon within three years").
[1675] Specific action: The user enters a goal into the device's text box and presses the "Submit" button.
[1676] Output: The entered target data is saved to the device.
[1677] Step 2:
[1678] The terminal transmits the input target data to the server.
[1679] Input: The goal data entered by the user.
[1680] Specific operation: The terminal sends the target data to the server via the network.
[1681] Output: The target data arrives at the server.
[1682] Goal specification phase
[1683] Step 3:
[1684] The server analyzes the received target data and stores it in a database of users.
[1685] Input: Received target data.
[1686] What happens: The server uses a text analysis algorithm to analyze the goal data and saves it as a new goal item in the user's database.
[1687] Output: Goal data stored in a database.
[1688] Step 4:
[1689] The server collects relevant information based on the analyzed goal data, including past user data and general achievement processes.
[1690] Input: Parsed target data, user database.
[1691] Specific behavior: The server searches for relevant success stories and user history and collects the necessary data.
[1692] Output: Collected relevant information data.
[1693] Step 5:
[1694] The server uses a generative AI model to simulate the process of achieving goals and generate specific training plans and steps.
[1695] Input: Collected relevant information data, prompt sentences for the generative AI model.
[1696] Specific operation: Enter a prompt such as "Complete a full marathon within three years" into the generative AI model and obtain the generated training plan.
[1697] Output: The generated training plan data.
[1698] Future diary generation phase
[1699] Step 6:
[1700] The server creates a template for a future diary based on the generated goal achievement scenario.
[1701] Input: Generated training plan data.
[1702] Specific operation: The server writes the training plan according to the diary template format.
[1703] Output: Future diary template data.
[1704] Step 7:
[1705] The server generates diary entries based on specific events (e.g., the specific situation and emotions on the day of completing a full marathon).
[1706] Input: Future diary template data, specific event data.
[1707] Specific behavior: The server fills in a template field corresponding to a specific date, describing the "date of completion of full marathon" and its details.
[1708] Output: Completed diary entry data.
[1709] Emotion recognition phase using the emotion engine
[1710] Step 8:
[1711] The device collects emotional data through the user's facial expressions, voice, text, etc.
[1712] Input: User facial expression, voice, and text data.
[1713] Specific operation: Collects user emotion data in real time using the device's camera and microphone.
[1714] Output: Collected emotion data.
[1715] Step 9:
[1716] The server analyzes the received emotion data using an emotion engine to recognize the user's current emotional state.
[1717] Input: Collected emotion data.
[1718] What it does: The server analyzes the data using an emotion analysis algorithm to determine the emotional state.
[1719] Output: Determined emotional state data.
[1720] Step 10:
[1721] The server adjusts scenarios and advice based on the recognized emotions and provides feedback adapted to the user's emotions.
[1722] Input: Determined emotional state data.
[1723] Specific behavior: The server adapts and customizes scenarios and advice based on the emotional state.
[1724] Output: Customized feedback data.
[1725] Dialogue with your future self phase
[1726] Step 11:
[1727] The device provides the user with a future diary and displays an interface for interacting with their future self.
[1728] Input: Future diary data.
[1729] Specific behavior: The device displays the appropriate interface and allows the user to view the diary.
[1730] Output: The displayed future diary interface.
[1731] Step 12:
[1732] The terminal accepts questions from the user and transmits them to the server.
[1733] Input: User question data.
[1734] Specific operation: The user enters a question on the interface, and the device sends it to the server.
[1735] Output: The question data sent to the server.
[1736] Step 13:
[1737] The server receives and analyzes the question data and generates a response as the future self.
[1738] Input: Submitted question data and user database.
[1739] Specific Action: The server analyzes the question and generates a specific response based on the user's goal achievement.
[1740] Output: The generated response data.
[1741] Step 14:
[1742] The server sends the generated response to the terminal.
[1743] Input: The generated response data.
[1744] Specific operation: The server sends response data to the terminal.
[1745] Output: The response data sent to the device.
[1746] Step 15:
[1747] The device will then display the user's response from their future self.
[1748] Input: The response data sent.
[1749] Specific operation: The device displays the response data on the screen so that the user can view it.
[1750] Output: The displayed response.
[1751] Corporate advertising insertion phase
[1752] Step 16:
[1753] The server selects business advertisements that fit the user's goal funnel.
[1754] Input: User data, advertising database.
[1755] What happens: The server analyzes user data and searches for relevant ads.
[1756] Output: Selected advertising data.
[1757] Step 17:
[1758] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[1759] Input: Selected advertising data, future diary data.
[1760] What happens: The server embeds ads into the goal-finding scenario or interaction interface.
[1761] Output: Advertisement data inserted into the diary and interface.
[1762] Step 18:
[1763] The terminal displays the advertisement sent from the server to the user.
[1764] Input: The inserted ad data.
[1765] What it does: The device displays the advertisement and allows the user to view it.
[1766] Output: The displayed ad.
[1767] Providing information to users
[1768] Step 19:
[1769] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[1770] Input: Diary data, dialogue content, advertising data.
[1771] Specific operation: The server consolidates all data and sends it to the device in bulk.
[1772] Output: A consolidated dataset.
[1773] Step 20:
[1774] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[1775] Input: The integrated dataset.
[1776] What it does: The device displays the integrated information on the screen so that the user can review it.
[1777] Output: Displayed future diary, dialogue, and advertisements.
[1778] Through these steps, the system can help users achieve their goals and provide personalized feedback and relevant advertising.
[1779] (Application example 2)
[1780] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1781] Conventional goal achievement support systems allow users to input their goals and provide support in the process, but they have difficulty providing personalized feedback and advice because they do not take the user's emotional state into account. Furthermore, when it comes to inserting corporate advertisements, it is difficult to deliver advertisements at the optimal time based on the user's needs and emotions. The present invention aims to solve these problems and provide personalized support that takes the user's emotions into account, as well as effective advertisement delivery.
[1782] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for the user to input goals and dreams, means for analyzing the input goals and dreams and generating a scenario for achieving the goal, means for creating a future diary based on the generated scenario, emotion recognition means for recognizing the user's current emotional state, means for the user to access the future diary and interact with their future self, means for adjusting the scenario and advice based on the recognized emotional state, and means for inserting corporate advertisements related to the goal-achievement process. This enables personalized support that takes the user's emotions into consideration and effective advertisement delivery.
[1783] "Means for users to input their goals and dreams" refers to the interface or device that allows users to input their goals and dreams into the system.
[1784] "Means for analyzing input goals and dreams and generating scenarios for achieving those goals" refers to software or algorithms that analyze the goals and dreams input by the user and, based on that, carry out specific processes and simulations for achieving those goals.
[1785] "Means for creating a future diary based on the generated scenario" refers to a technology that automatically generates diary entries to record the future situation in which the user achieves their goal, based on the analyzed goal achievement scenario.
[1786] "Emotion recognition means for recognizing the user's current emotional state" refers to technology or devices for determining the user's current emotional state from facial expressions, voice, text, etc.
[1787] "Means for users to access their future diary and interact with their future selves" refers to an interface or system that allows users to view the generated future diary and ask questions or comment on its contents in an interactive format.
[1788] "Means for adjusting scenarios and advice based on the recognized emotional state" refers to technology that analyzes the user's emotional state and changes or adjusts the content of the goal-achievement scenario or advice provided based on the results.
[1789] "Means for inserting corporate advertisements relevant to the process of achieving goals" refers to technologies and systems for displaying corporate advertisements at appropriate times that match the user's process of achieving their goals.
[1790] This invention relates to a system that allows users to input their goals and dreams, generates a diary entry of the future when those goals are achieved, and combines it with an emotion engine that recognizes the user's emotions. This system allows users to specifically understand the process of achieving their goals and receive feedback and advice adapted to their emotions. Furthermore, it provides a new marketing channel for generating advertising revenue by effectively inserting corporate advertisements.
[1791] System configuration and operation
[1792] This system uses the following main hardware and software:
[1793] Smartphone or smart glasses: a device that allows users to input their goals, view future diaries, and utilize a camera to capture facial expressions.
[1794] Camera: A device that captures the user's facial expressions and sends them to the emotion engine.
[1795] TensorFlow: Software used for training and inference of emotion recognition models.
[1796] OpenCV: A software library for face detection and facial expression analysis.
[1797] LangChain: Software used for future diary generation and natural language processing.
[1798] Firebase: A database service that stores and manages user data.
[1799] Program processing explanation
[1800] The server provides a means for users to input their goals and dreams through their devices. The input goal data is sent to the server in real time, which receives and analyzes it. The analysis combines past user data and general rules of success to generate a scenario for achieving the goal. The generated scenario is provided to the user in the form of a future diary using LangChain.
[1801] The camera on a smartphone or smart glasses captures the user's facial expressions and analyzes their emotions in real time using OpenCV and TensorFlow. The analyzed emotional data is sent to a server, which uses an emotion engine to determine the user's current emotional state. Based on this information, future scenarios and advice are adjusted in real time. For example, if the user is feeling down, an encouraging message or specific advice to motivate them is provided.
[1802] The server then inserts appropriate corporate advertisements related to the goal-achievement process, optimizing the content of the advertisements based on the user's emotional state and the scenario of the goal achievement. For example, sports-related goals could be matched with advertisements for training equipment and fitness apps.
[1803] Specific examples
[1804] If a user sets a goal of "running a full marathon within three years," that goal will be stored on the server via Firebase. The server will generate a specific training plan based on the user's current fitness level and past data, and create a future diary using LangChain. For example, the following will be generated:
[1805] Suppose a user has a goal of "running a full marathon within three years." Generate a future diary. The diary should include the process of achieving the goal, a specific training plan, and emotional changes. For example, "On the first day of training, I felt a little depressed, but after a month, I started to enjoy running."
[1806] While users are viewing their diary entries using their smartphones or smart glasses, the camera continuously analyzes their facial expressions, and the server uses the emotion recognition results to provide encouraging messages and appropriate advice. Training-related corporate advertisements are also seamlessly inserted, allowing users to see effective advertisements along with specific information on how to achieve their goals.
[1807] In this way, we can achieve effective marketing while helping users achieve their goals.
[1808] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1809] Step 1:
[1810] The user inputs their goals and dreams (e.g., "to complete a full marathon within three years") via a device such as a smartphone or PC. The input goal data is sent from the device to a server. On the device, the user writes their goal in a text field and presses the send button.
[1811] Input: User goal data
[1812] Output: Target data sent to the server
[1813] Step 2:
[1814] The server analyzes the received goal data and stores it in the user's database. The analysis is performed based on past user data and general success stories. In this process, the server extracts the goal data and stores it in the database as structured data.
[1815] Input: Received target data
[1816] Output: Parsed data stored in a database
[1817] Step 3:
[1818] The server analyzes the goal data and collects related information, including past user data and the process of completing a typical full marathon. Based on this information, an AI engine is used to simulate the process of achieving the goal.
[1819] Input: Historical user data, general success stories
[1820] Output: Simulated goal-funnel process
[1821] Step 4:
[1822] The server generates a specific training plan and steps based on the simulation results. In this process, the server sets the type of training the user should do and the goals for each stage based on the data generated by the AI engine.
[1823] Input: Simulation results
[1824] Output: Specific training plan
[1825] Step 5:
[1826] The server creates future diary entries based on the generated training plan and steps. For example, it automatically generates diary entries for each training day or event day. Using LangChain, each diary entry is generated in a way that is easy to understand and motivating for the user.
[1827] Input: Specific training plan
[1828] Output: Future diary entry
[1829] Step 6:
[1830] The device collects emotional data through the user's facial expressions, voice, text, etc. This process involves using a camera and microphone to capture the user's facial expressions and voice in real time and sending them to a server.
[1831] Input: User facial expressions, voice, text
[1832] Output: Emotion data sent to the server
[1833] Step 7:
[1834] The server uses an emotion engine to analyze the received emotional data and recognize the user's current emotional state. It uses TensorFlow and OpenCV to determine the emotional component and reflects the results in the internal system.
[1835] Input: Received emotion data
[1836] Output: Perceived emotional state
[1837] Step 8:
[1838] The server then tailors the scenario and advice based on the recognized emotions. For example, if the user is feeling down, this step generates encouraging messages and specific advice to motivate them.
[1839] Input: Emotional state
[1840] Output: Tailored scenarios and advice
[1841] Step 9:
[1842] The device provides the user with a future diary and displays an interface for interacting with their future self. At this stage, the user can view the generated future diary and even ask questions or make comments in an interactive format.
[1843] Input: Future diary entry, adjusted scenario
[1844] Output: Interactive interface
[1845] Step 10:
[1846] The server selects corporate advertisements related to the process of achieving the goal, inserts the advertisements into the goal achievement scenario and dialogue interface at the appropriate time, and adjusts the content and timing of the advertisements based on the user's emotional state.
[1847] Input: Goal achievement scenario, emotional state
[1848] Output: Inserted ads
[1849] Step 11:
[1850] The device integrates the generated future diary, the user's conversations, and relevant corporate advertisements, and displays them all in one place to the user, allowing the user to receive emotionally tailored advice and effective advertisements along with specific information for achieving their goals.
[1851] Input: Future diary, dialogue, advertisements
[1852] Output: Display of consolidated information
[1853] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1854] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1855] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1856] [Fourth embodiment]
[1857] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1858] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1859] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1860] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1861] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1862] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1863] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1864] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1865] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1866] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1867] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1868] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1869] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1870] ---
[1871] The system of the present invention provides a means for users to input their goals and dreams and generate a diary of the future when those goals have been achieved. Users can also interact with their future selves and learn about the process leading to goal achievement. Furthermore, by inserting corporate advertisements into the goal achievement process, advertising revenue can be earned.
[1872] The system program processes in the following steps:
[1873] User enters goal
[1874] 1. User inputs goal
[1875] The user inputs their goal, such as "to complete a full marathon within three years," via a device such as a smartphone or computer.
[1876] 2. Send your goal data
[1877] The terminal transmits the input target data to the server.
[1878] The server analyzes the received target data and stores it in the user's database.
[1879] Making goals concrete
[1880] 1. Goal analysis
[1881] The server analyzes the goal data and collects related information, such as past user data and the typical process of completing a full marathon.
[1882] 2. Goal achievement scenario generation
[1883] The server uses an AI engine to simulate the process of achieving a goal and generate a specific training plan and steps, taking into account past success stories and expert guidelines.
[1884] Future diary generation
[1885] 1. Initializing the Future Diary
[1886] The server creates a template for a future diary entry based on the goal achievement scenario generated by the AI engine.
[1887] 2. Creating diary content
[1888] The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific situation, emotions, and sense of accomplishment of that day.
[1889] Dialogue with your future self
[1890] 1. Providing a conversational interface
[1891] The device provides the user with a future diary and displays an interface for interacting with their future self.
[1892] 2. Accepting questions
[1893] The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[1894] The server receives and analyzes the query data.
[1895] 3. AI response generation
[1896] The server generates future-self responses based on the questions it receives, based on simulated goal-funneling processes and user data.
[1897] The server sends the generated response to the terminal.
[1898] 4. Viewing Dialogues
[1899] The device will then display the user's response from their future self.
[1900] Corporate advertising inserts
[1901] 1. Selection of advertising data
[1902] The server selects ads for businesses that fit the user's goal-building process, such as ads for workout wear or fitness apps.
[1903] 2. Ad Insertion
[1904] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[1905] Providing information to users
[1906] 1. Information Integration
[1907] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[1908] 2. Information display
[1909] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[1910] Specific examples
[1911] For example, if a user inputs a goal such as "Complete a full marathon within three years," the server analyzes that goal and generates a specific training plan based on the user's current fitness level and past data. Based on this generated scenario, a future diary entry is created in which the user has completed the full marathon. The user can read this future diary entry and ask their future self a question, such as, "What was particularly difficult on the way to completing the race?" The server generates an answer to this question based on past data and simulation results and sends it to the device. In addition, corporate advertisements related to training are inserted at appropriate points, allowing the user to view effective advertisements while obtaining the necessary information.
[1912] This allows users to visualize their goals more clearly and understand the process to achieve them, while also enabling companies to deliver advertisements at the right time, resulting in effective marketing.
[1913] The processing flow will be explained below.
[1914] ---
[1915] Step 1:
[1916] Users input their goals and dreams (e.g., "to complete a full marathon within three years") via a device such as a smartphone or computer.
[1917] Step 2:
[1918] The terminal transmits the input target data to the server.
[1919] Step 3:
[1920] The server analyzes the received target data and stores it in the user's database.
[1921] Step 4:
[1922] The server analyzes the goal data and collects related information (such as past user data and the process of completing a typical full marathon).
[1923] Step 5:
[1924] The server uses an AI engine to simulate the process of achieving a goal and generate a specific training plan and steps, taking into account past success stories and expert guidelines.
[1925] Step 6:
[1926] The server creates a template for a future diary entry based on the goal achievement scenario generated by the AI engine.
[1927] Step 7:
[1928] The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific situation, emotions, and sense of accomplishment of that day.
[1929] Step 8:
[1930] The device provides the user with a future diary and displays an interface for interacting with their future self.
[1931] Step 9:
[1932] The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[1933] The server receives and analyzes the query data.
[1934] Step 10:
[1935] The server generates future-self responses based on the questions it receives, based on simulated goal-funneling processes and user data.
[1936] Step 11:
[1937] The server sends the generated response to the terminal.
[1938] Step 12:
[1939] The device will then display the user's response from their future self.
[1940] Step 13:
[1941] The server selects ads for businesses that fit the user's goal-building process, such as ads for workout wear or fitness apps.
[1942] Step 14:
[1943] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[1944] Step 15:
[1945] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[1946] Step 16:
[1947] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[1948] ---
[1949] Through these steps, users can understand the specific process of achieving their goals, be motivated through dialogue with their future selves, and easily create plans to achieve their goals. Furthermore, companies can earn revenue through effective advertising.
[1950] Example 1
[1951] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1952] In conventional goal achievement support systems, users simply input their goals, but the specific process of achieving them and their progress are not visualized well. Furthermore, opportunities for users to receive specific feedback on their goals are limited, making it difficult to maintain motivation. Furthermore, methods for monetizing through advertising insertion are also limited. This resulted in low user goal achievement rates and made effective marketing difficult to achieve.
[1953] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1954] In this invention, the server includes means for a user to input goals and dreams, means for analyzing the input goals and dreams and generating a scenario for achieving the goal, means for creating a future diary based on the generated scenario, means for the user to access the future diary and interact with their future self, means for inserting advertisements related to the goal-achievement process, means for accepting and analyzing the user's questions and generating responses from the future self, and means for integrating and providing the future diary, the content of the interaction, and advertisements to the user. This allows the user to visualize the specific goal-achievement process, receive feedback, and maintain motivation, and also makes it possible to deliver advertisements at appropriate times.
[1955] A "user" is someone who has goals and dreams and receives support from this system to achieve them.
[1956] "Goals and dreams" refers to the specific goals and future visions that users want to achieve.
[1957] "Means" refers to the method or device used by the system to achieve a particular function.
[1958] "Analysis" refers to the act of understanding the content of the entered goals and dreams and collecting and processing information based on that.
[1959] A "scenario" is a detailed plan that outlines the process and steps a user will take to achieve their goal.
[1960] A "future diary" is a document that details future events or situations in which a user achieves a goal.
[1961] "Dialogue" refers to two-way communication between the user and the system (future self).
[1962] "Advertising" refers to marketing content that informs users about products and services offered by companies.
[1963] "Response" refers to the answer provided by the system to a user's question.
[1964] "Integration" refers to the act of bringing together and organizing different information or content.
[1965] MODE FOR CARRYING OUT THE INVENTION
[1966] The system of the present invention allows users to input their goals and dreams and generate a diary of the future when those goals have been achieved. Users can also interact with their future selves and understand the process leading up to achieving their goals. Furthermore, advertising revenue can be earned by inserting advertisements related to the process of achieving the goals.
[1967] The processing of this system is realized by the various hardware and software components shown below.
[1968] Hardware and software used
[1969] Device: A smartphone or computer is used as an input device for users to enter their goals and dreams.
[1970] Server: A computer system equipped with a processor and storage is used to analyze data, generate scenarios, create future diaries, generate dialogue responses, and insert advertisements.
[1971] Generative AI models: Use AI models that specialize in natural language processing and generation, specifically applying techniques such as GPT-3 and its successors.
[1972] Database: We use a database management system to store and manage your fitness data, success story data, and advertising data.
[1973] Program processing flow
[1974] 1. User goal input
[1975] Users input their goal, such as "to complete a full marathon within three years," using a device such as a smartphone or computer.
[1976] The terminal transmits the input target data to the server.
[1977] 2. Target data analysis and scenario generation
[1978] The server analyzes the received goal data and collects related information, including past user data and information about the process of completing a typical full marathon.
[1979] The server uses a generative AI model to generate a scenario for achieving the goal and creates a specific training plan and steps.
[1980] 3. Create a diary of the future
[1981] The server initializes a template for the future diary based on the generated scenario.
[1982] The server uses the template to generate future diary entries for specific events (e.g., the day a full marathon is completed), describing the details of the situation, including emotions and a sense of accomplishment.
[1983] 4. Talk to your future self
[1984] The device displays the future diary and provides the user with an interface for interacting with their future self.
[1985] The user enters a question such as "What was particularly difficult about completing the race?" and the device sends the question to the server.
[1986] The server analyzes the question and uses a generative AI model to generate a response from your future self, which is then sent to the device.
[1987] The terminal displays the response to the user.
[1988] 5. Corporate advertising
[1989] The server selects ads that fit the user's goal funnel, such as ads for sportswear or fitness apps.
[1990] The server inserts advertisements into goal-achievement scenarios and interactive interfaces at appropriate times.
[1991] 6. Integration and provision of information
[1992] The server integrates the generated future diary, the content of the conversation with the future self, and advertisements, and transmits them to the terminal.
[1993] The device displays integrated information to the user in one place.
[1994] Specific examples
[1995] For example, if a user inputs a goal such as "to complete a full marathon within three years," the server analyzes the goal and generates a specific training plan based on the user's current fitness level and past data. Based on this generated scenario, a future diary entry is created in which the user has completed the full marathon. The user can read this future diary entry and ask their future self, "What was particularly difficult on the way to completing the race?" The server generates an answer to this question based on past data and simulation results and sends it to the device. In addition, corporate advertisements related to training are inserted at appropriate points, allowing the user to view effective advertisements while obtaining the necessary information.
[1996] Prompt Sentence Examples
[1997] An example of a prompt sentence to be input to the generative AI model is shown below.
[1998] prompt:
[1999] "Please tell us your specific training plan for completing a full marathon within three years. Also, please write a future diary entry, including your situation and emotions on the day you complete the race."
[2000] This allows users to visualize their goals more clearly and understand the process to achieve them, while also enabling companies to deliver advertisements at the right time, resulting in effective marketing.
[2001] The flow of the identification process in the first embodiment will be described with reference to FIG.
[2002] Step 1:
[2003] User enters goal
[2004] Users input their goal, such as "to complete a full marathon within three years," via a device such as a smartphone or computer.
[2005] Input: Users enter their goals and dreams in text format.
[2006] Output: The terminal saves the input target data and prepares it for transmission to the server.
[2007] Step 2:
[2008] Send goal data
[2009] The terminal transmits the target data entered by the user to the server.
[2010] Input: The goal data entered by the user.
[2011] Data processing: The terminal converts the data format appropriately so that it can be sent.
[2012] Output: The target data sent to the server.
[2013] Step 3:
[2014] Analyzing goal data
[2015] The server analyzes the transmitted target data and collects relevant information.
[2016] Input: The target data received by the server.
[2017] Data processing: Past user data and the general process of completing a full marathon are referenced and analyzed.
[2018] Output: The analysis results in the user's current fitness level and related data.
[2019] Step 4:
[2020] Generate a Goal-achieving Scenarios
[2021] The server uses an AI engine to simulate the process of achieving goals and generate specific training plans and steps.
[2022] Input: Parsed target data.
[2023] Data calculation: The generative AI model performs simulations based on past success stories and expert guidelines.
[2024] Output: A goal achievement scenario with specific training plans and steps.
[2025] Step 5:
[2026] Initialize the future diary
[2027] The server creates a template for a future diary entry based on the goal achievement scenario generated by the AI engine.
[2028] Input: Goal achievement scenario.
[2029] Data processing: Build the framework for the future diary and input the necessary data into the template.
[2030] Output: A template for your future diary.
[2031] Step 6:
[2032] Create diary content
[2033] The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific situation, emotions, and sense of accomplishment of that day.
[2034] Input: Future diary template and goal achievement scenario.
[2035] Data processing: Generative AI models generate specific situations and emotions.
[2036] Output: Future diary entry.
[2037] Step 7:
[2038] Providing a conversational interface
[2039] The device provides the user with a future diary and displays an interface for interacting with their future self.
[2040] Enter: Future diary entry.
[2041] Data processing: Convert the future diary into a format that can be displayed on the interface.
[2042] Output: Future diary displayed to the user.
[2043] Step 8:
[2044] Accepting user questions
[2045] The terminal accepts questions from the user and sends them to the server.
[2046] Input: The question entered by the user.
[2047] Output: The query data sent to the server.
[2048] Step 9:
[2049] Generate an AI response
[2050] The server analyzes the question data received from the user and generates a response from the future self.
[2051] Input: Question data.
[2052] Data calculation: The generative AI model generates a response based on past data and simulation results.
[2053] Output: Your response as your future self.
[2054] Step 10:
[2055] View dialogue responses
[2056] The device will then display the user's response from their future self.
[2057] Input: Your response as your future self.
[2058] Data processing: Converting the response into a format that can be displayed to the user.
[2059] Output: The interaction response displayed to the user.
[2060] Step 11:
[2061] Select advertising data
[2062] The server selects ads that fit the user's goal process.
[2063] Input: User goal data and goal achievement scenario.
[2064] Data processing: Extracting appropriate advertisements from the advertisement database.
[2065] Output: Selected advertising data.
[2066] Step 12:
[2067] Insert ads
[2068] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[2069] Input: Selected advertising data.
[2070] Data processing: Optimizing the display position and format of advertisements.
[2071] Output: The inserted ad.
[2072] Step 13:
[2073] Integrate information
[2074] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[2075] Input: Future diary, dialogue, advertisements.
[2076] Data processing: Integrate all content into one package.
[2077] Output: Consolidated information.
[2078] Step 14:
[2079] View information
[2080] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[2081] Input: Consolidated information.
[2082] Data processing: Organize and display information in an easy-to-read format.
[2083] Output: The consolidated information displayed to the user.
[2084] (Application example 1)
[2085] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2086] Conventional goal achievement support systems have difficulty in helping users visualize their goals and effectively support the process of achieving them. Additionally, they lack a means to effectively insert advertisements related to the goal achievement process at the right time, resulting in insufficient marketing effectiveness.
[2087] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[2088] In this invention, the server includes: a means for a user to input goals and dreams; a means for analyzing the input goals and dreams and generating a scenario for achieving the goal; a means for creating a future diary based on the generated scenario; a means for the user to access the future diary and interact with their future self; a means for inserting advertisements related to the goal achievement process; a means for generating new diary entries at each step of the goal achievement process according to the user's current progress and situation; and a means for dynamically displaying advertisements related to the generated diary entries. This makes it easier for the user to concretely visualize the goal achievement process, and by appropriately and effectively inserting related advertisements, it is possible to enhance marketing effectiveness.
[2089] A "user" is an individual who uses the system to input their goals and dreams.
[2090] "Goals and dreams" refers to the specific achievements and desires that users wish to achieve.
[2091] A "means for inputting goals and dreams" is a device or application with a user interface that allows a user to input goals and dreams into the system.
[2092] A "means for generating a scenario for achieving a goal" is a method or algorithm that analyzes input goals or dreams and creates a specific plan for the process leading to the achievement of those goals.
[2093] The "means for creating a future diary" is a system that automatically generates a diary that records the user's future achievement status and emotions based on the generated goal achievement scenario.
[2094] The "means for interacting with your future self" refers to an interface and algorithms that allow users to engage in virtual interactions with their future selves through the generated future diary.
[2095] An "ad insertion vehicle" is a mechanism for inserting funnel-relevant ads into the system at the appropriate time.
[2096] The "means for generating new diary entries" is a system for dynamically generating new diary entries according to the user's current progress and situation.
[2097] The "means for dynamically displaying advertisements" is a mechanism for displaying related advertisements in real time in response to the generated diary entries and the user's progress.
[2098] The system of the present invention provides a means for users to input their goals and dreams and generate a diary of the future when those goals have been achieved. Users can also interact with their future selves and learn about the process leading up to goal achievement. Furthermore, advertising revenue can be earned by dynamically inserting advertisements into the goal achievement process.
[2099] Building the user interface
[2100] Technology used: Swift (iOS), Kotlin (Android)
[2101] We will create a screen with a text field and a submit button for users to enter their goals. The user will enter their goals and dreams into the device, and the system will receive that data. For example, the user might enter, "I want to complete a full marathon within three years."
[2102] Goal input function
[2103] Technologies used: Swift (iOS), Kotlin (Android)
[2104] It receives the goal data entered by the user and sends it to the server, which analyzes the received goal data and stores it in the user's database.
[2105] Communicating with the Server
[2106] Technology used: REST API, Firebase
[2107] The server analyzes the goal data and stores it in a database to generate a scenario for achieving the goal. At this time, it references the user's past data and general goal achievement process to generate a specific plan and steps.
[2108] Target analysis and scenario generation
[2109] Technology used: Python, TensorFlow
[2110] The server uses an AI engine to analyze the goal data and generate a scenario for achieving the goal, for example, by referring to past success stories and expert guidelines to create specific steps and plans tailored to the user.
[2111] Future diary generation
[2112] Technology used: GPT-4 (natural language generation model)
[2113] The server creates a template for the future diary based on the scenario generated by the AI engine. It generates diary entries for specific events, describing the specific situation and emotions of that day. For example, for a goal such as "the user will complete a full marathon within three years," it uses the following prompts:
[2114] Prompt statement:
[2115] "The user has a goal of completing a full marathon within three years. Imagine a day two years from now and describe the efforts and progress they've made toward achieving that goal."
[2116] Example output:
[2117] "May 30, 2025: I ran 15 kilometers today. It was really tough at first, but I feel like training three times a week is starting to pay off. I'm breathing more easily now. My marathon shoes are starting to fit my feet better, so it was a really good purchase."
[2118] Implementing interactive features
[2119] Technologies used: Dialogflow, natural language processing library
[2120] When a user reads their future diary and enters a question, the server receives and analyzes the question. The AI engine generates a response from their future self based on the question. For example, if a user asks, "What was particularly difficult about completing the race?", an appropriate response will be generated and sent to the device.
[2121] Ad insertion function
[2122] Technology used: AdMob (mobile advertising library)
[2123] The server has the means to display advertisements relevant to the user's goal achievement process at the appropriate time. For example, advertisements for training shoes or health management apps are displayed. Advertising data is managed on the server side and inserted dynamically according to the user's progress.
[2124] These tools allow users to visualize their goals and understand the process to achieve them, while the system dynamically displays appropriate ads to maximize marketing effectiveness.
[2125] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[2126] Step 1:
[2127] Users input their goals and dreams into the device through an interface for entering goals. For example, a user might input a goal such as "to complete a full marathon within three years." The entered goal data is then stored as temporary data on the device.
[2128] Step 2:
[2129] The device sends the entered target data to the server as an HTTP request using the cloud service API. The input data is sent to the server in JSON format, and the server stores it in a database for analysis.
[2130] Step 3:
[2131] The server analyzes the received goal data and stores the results in the user's database. This analysis uses data mining techniques to look up the user's past goal achievement history and common success stories. The output is the analysis data and specific elements of the goal based on it.
[2132] Step 4:
[2133] The server generates a scenario for achieving the goal based on the analysis data. This scenario generation uses a machine learning model and provides the user with specific steps and plans for achieving the goal. The generated scenario is saved in the system database, and scenario data is obtained as output.
[2134] Step 5:
[2135] The server generates a future diary entry based on the scenario data. For this, it uses the generative AI model GPT-4, and generates a specific diary entry by inputting, for example, the following prompt: "The user has a goal of completing a full marathon within three years. Imagine a day two years from now and describe the efforts and progress toward achieving that goal." The future diary entry is obtained as output.
[2136] Step 6:
[2137] The device receives the generated future diary and displays it to the user, who is then provided with an interface to read the future diary and input specific questions, which are then sent from the user to the server.
[2138] Step 7:
[2139] The server analyzes the received question and generates a response from the future self. This is done using Dialogflow and natural language processing libraries. After analyzing the question and performing the necessary data processing, an answer is generated using a generative AI model. The generated response data is obtained as output.
[2140] Step 8:
[2141] The device receives the response data from the server and displays it to the user, allowing the user to experience a conversation with their future self.
[2142] Step 9:
[2143] The server generates new diary entries based on the user's progress and scenario, again using analytics and AI generative models, utilizing the progress data as input, with the new diary entries as output.
[2144] Step 10:
[2145] The server provides a means to dynamically select and display advertisements related to newly created diary entries. For example, AdMob can be used to display relevant advertisements on the user's screen. This allows for effective advertisement display and can be expected to have a positive marketing effect.
[2146] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[2147] ---
[2148] The system of the present invention combines a means for users to input their goals and dreams, generate a diary of the future when those goals are achieved, and an emotion engine that recognizes the user's emotions. This system allows users to interact with their future selves and specifically understand the process leading to goal achievement. It also provides a new marketing channel for effectively inserting corporate advertisements to generate advertising revenue.
[2149] The system program processes in the following steps:
[2150] User enters goal
[2151] 1. The user inputs their goal or dream (e.g., "to complete a full marathon within three years") via a device such as a smartphone or computer.
[2152] 2. The terminal transmits the entered target data to the server.
[2153] Making goals concrete
[2154] 1. The server analyzes the received target data and stores it in the user's database.
[2155] 2. The server analyzes the goal data and collects related information (such as past user data and the process of completing a typical full marathon).
[2156] 3. The server uses an AI engine to simulate the goal-achievement process and generate a specific training plan and steps, taking into account past success stories and expert guidelines.
[2157] Future diary generation
[2158] 1. The server creates a template for a future diary based on the goal achievement scenario generated by the AI engine.
[2159] 2. The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific circumstances, emotions, and sense of accomplishment of that day.
[2160] Emotion recognition by emotion engine
[2161] 1. The device collects emotional data from the user through facial expressions, voice, text, etc.
[2162] 2. The server analyzes the received emotion data using an emotion engine to recognize the user's current emotional state.
[2163] 3. The server adjusts the scenario and advice based on the recognized emotions and provides feedback adapted to the user's emotions.
[2164] Dialogue with your future self
[2165] 1. The device provides the user with a future diary and displays an interface for interacting with their future self.
[2166] 2. The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[2167] 3. The server receives and analyzes the query data.
[2168] 4. The server generates future-self responses based on the received questions, based on the simulated goal-funnel process and user data.
[2169] 5. The server generates a response and sends it to the terminal.
[2170] 6. The device displays the user's future self's response.
[2171] Corporate advertising inserts
[2172] 1. The server selects ads for businesses that fit the user's goal-building process, such as ads for workout wear or fitness apps.
[2173] 2. The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[2174] 3. The server adjusts the content and timing of advertisements according to the user's emotional state.
[2175] Providing information to users
[2176] 1. The server combines the generated future diary, the conversation with your future self, and corporate advertisements, and sends them to the device.
[2177] 2. The device displays the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[2178] Specific examples
[2179] For example, if a user inputs a goal such as "to complete a full marathon within three years," the server analyzes the goal and generates a specific training plan based on the user's current fitness level and past data. Based on this generated scenario, a diary entry is created for the future in which the user has completed the full marathon.
[2180] If a user reads this future diary and asks their future self, for example, "What was particularly difficult about completing the race?", the server will generate an answer based on past data and simulation results and send it to the device. Furthermore, the user's emotion engine will recognize their emotions, and if it detects that the user is feeling unmotivated, for example, the system will provide encouraging messages and motivational advice. Corporate advertisements related to training are also inserted at appropriate points, allowing users to view effective advertisements while obtaining the necessary information.
[2181] ---
[2182] This allows users to visualize their goals more clearly and understand the process to achieve them. Furthermore, incorporating emotion recognition makes support for users more personalized and effective. Companies can deliver advertisements at the right time, enabling more effective marketing.
[2183] The processing flow will be explained below.
[2184] ---
[2185] Step 1:
[2186] Users input their goals and dreams (e.g., "to complete a full marathon within three years") via a device such as a smartphone or computer.
[2187] Step 2:
[2188] The terminal transmits the input target data to the server.
[2189] Step 3:
[2190] The server analyzes the received target data and stores it in the user's database.
[2191] Step 4:
[2192] The server analyzes the goal data and collects related information (such as past user data and the process of completing a typical full marathon).
[2193] Step 5:
[2194] The server uses an AI engine to simulate the process of achieving a goal and generate a specific training plan and steps, taking into account past success stories and expert guidelines.
[2195] Step 6:
[2196] The server creates a template for a future diary entry based on the goal achievement scenario generated by the AI engine.
[2197] Step 7:
[2198] The server generates a diary entry for a specific event (e.g., the day you completed a full marathon), describing the specific situation, emotions, and sense of accomplishment of that day.
[2199] Step 8:
[2200] The device provides the user with a future diary and displays an interface for interacting with their future self.
[2201] Step 9:
[2202] The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[2203] Step 10:
[2204] The server receives and analyzes the query data.
[2205] Step 11:
[2206] The server generates future-self responses based on the questions it receives, based on simulated goal-funneling processes and user data.
[2207] Step 12:
[2208] The server sends the generated response to the terminal.
[2209] Step 13:
[2210] The device will then display the user's response from their future self.
[2211] Step 14:
[2212] The device collects emotional data through the user's facial expressions, voice, text, etc.
[2213] Step 15:
[2214] The server analyzes the received emotion data using an emotion engine to recognize the user's current emotional state.
[2215] Step 16:
[2216] The server adjusts scenarios and advice based on the recognized emotions and provides feedback adapted to the user's emotions.
[2217] Step 17:
[2218] The server selects ads for businesses that fit the user's goal-building process, such as ads for workout wear or fitness apps.
[2219] Step 18:
[2220] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[2221] Step 19:
[2222] The server adjusts the content and timing of advertisements according to the user's emotional state.
[2223] Step 20:
[2224] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[2225] Step 21:
[2226] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[2227] ---
[2228] Through these steps, users can understand the specific process of achieving their goals, be motivated through dialogue with their future selves, and easily create plans to achieve their goals. Furthermore, by combining the emotion engine, support for users can be more personalized and effective. Companies can also earn revenue through effective ad delivery.
[2229] Example 2
[2230] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2231] Many users today find it difficult to maintain the specific process and motivation required to achieve their goals and dreams. They also have few opportunities to receive personalized support that addresses their emotional fluctuations, and are unable to properly navigate the path to achieving their goals. Furthermore, advertisers face challenges in effectively delivering ads that adapt to users' emotions and goals.
[2232] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for the user to input goals and dreams, a means for analyzing the input goals and dreams and generating a scenario for achieving the goals, a means for creating a future diary based on the generated scenario, a means for the user to access the future diary and interact with their future self, a means for inserting corporate advertisements related to the goal-achievement process, a means for collecting and analyzing emotional data such as the user's facial expressions, voice, and text, and a means for providing feedback adapted to the user's emotional state. This allows the user to concretely visualize their goals while receiving individual support, making it easier for them to maintain motivation to achieve them. It also provides an effective marketing channel for advertisers.
[2233] A "user" is an entity that uses the system to input goals and dreams and receives scenarios and feedback generated based on those goals and dreams.
[2234] "Means for inputting goals and dreams" refers to an interface that allows users to input their goals and dreams via devices such as smartphones or computers.
[2235] "Means for analyzing goals and dreams and generating a scenario for achieving those goals" is a function that allows the server to analyze the goals and dreams entered and generate a process and schedule for achieving them.
[2236] The "means for creating a future diary" is a function that allows the server to create a future diary of daily records leading up to the achievement of the user's goal based on the scenario generated.
[2237] "A means of communicating with your future self" is an interface that allows users to access their future diary and communicate with their future self in chatbot format.
[2238] "Means for inserting corporate advertising" is a function that allows ads related to the user's goal achievement process to be displayed at the appropriate time.
[2239] "Means for collecting and analyzing emotional data" refers to a function for collecting and analyzing emotional data through the user's facial expressions, voice, text, etc.
[2240] The "means for providing feedback" is a function for providing feedback or advice adapted to the user's emotional state based on the analyzed emotional data.
[2241] This system allows users to input their goals and dreams, and then embodies the process for achieving those goals. The system generates a scenario and future diary for achieving the goal, provides personalized feedback based on emotional data, and effectively inserts corporate advertisements tailored to the user.
[2242] Hardware and software used
[2243] The system is implemented using the following hardware and software:
[2244] User device: Smartphone, PC, etc. This allows users to input their goals and dreams and display the results.
[2245] Server: Cloud server or data center. Analyzes target data, generates scenarios, manages databases, and analyzes emotion data.
[2246] Generative AI model: A natural language processing engine that generates goal achievement scenarios and future diaries.
[2247] Emotion analysis engine: Software that analyzes a user's facial expressions, voice, and text to recognize their emotional state.
[2248] Specific processing of the system
[2249] Goal input phase
[2250] 1. The user enters their goals or dreams (e.g., "to complete a full marathon within three years") into a device such as a smartphone or computer.
[2251] 2. The terminal transmits the entered target data to the server.
[2252] Goal specification phase
[2253] 1. The server analyzes the received target data and stores it in the user's database.
[2254] 2. The server collects relevant information (past user data, general achievement process, etc.) based on the goal data.
[2255] 3. The server uses an AI engine to simulate the process of achieving the goal and generate a specific training plan and steps.
[2256] Future diary generation phase
[2257] 1. The server uses an AI engine to create a template for the future diary based on the generated goal achievement scenario.
[2258] 2. The server generates a diary entry based on a specific event (e.g., the specific situation and emotions on the day of completing a full marathon).
[2259] Emotion recognition phase using the emotion engine
[2260] 1. The device collects emotional data from the user through facial expressions, voice, text, etc.
[2261] 2. The server analyzes the received emotion data using an emotion engine to recognize the user's current emotional state.
[2262] 3. The server adjusts the scenario and advice based on the recognized emotions and provides feedback adapted to the user's emotions.
[2263] Dialogue with your future self phase
[2264] 1. The device provides the user with a future diary and displays an interface for interacting with their future self.
[2265] 2. The device accepts questions from the user (e.g., "What was particularly difficult about completing the race?").
[2266] 3. The server receives and analyzes the question data and generates a response from the future self.
[2267] 4. The server generates a response and sends it to the terminal.
[2268] 5. The device displays the user's future self's response.
[2269] Corporate advertising insertion phase
[2270] 1. The server selects corporate advertisements that fit the user's goal achievement process.
[2271] 2. The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[2272] 3. The server adjusts the content and timing of advertisements according to the user's emotional state.
[2273] Providing information to users
[2274] 1. The server integrates the generated future diary, the content of the conversation with your future self, and related corporate advertisements, and sends them to the device.
[2275] 2. The device displays the user's future diary, conversations with their future self, and corporate advertisements all at once.
[2276] Examples and prompts
[2277] For example, if a user inputs a goal such as "to complete a full marathon within three years," the server analyzes the goal and generates a specific training plan based on the user's current fitness level and past data. Based on this generated scenario, a diary entry is created for the future in which the user has completed the full marathon.
[2278] Example prompt for a generative AI model:
[2279] Create a future diary entry for a user with the goal of completing a full marathon within three years. The diary entry should include training details, key events, and the specific circumstances and emotions of the final completion day.
[2280] This system allows users to visualize their goals in concrete terms and understand the process to achieve them. Furthermore, by incorporating emotion recognition, personalized support can be provided to maintain motivation. Companies can also deliver effective advertising that adapts to users' emotions and goals.
[2281] The flow of the identification process in the second embodiment will be described with reference to FIG.
[2282] The flow of this system's program processing
[2283] Goal input phase
[2284] Step 1:
[2285] Users input their goals and dreams into a device such as a smartphone or computer.
[2286] Input: The user enters their goal in text form (e.g., "Run a full marathon within three years").
[2287] Specific action: The user enters a goal into the device's text box and presses the "Submit" button.
[2288] Output: The entered target data is saved to the device.
[2289] Step 2:
[2290] The terminal transmits the input target data to the server.
[2291] Input: The goal data entered by the user.
[2292] Specific operation: The terminal sends the target data to the server via the network.
[2293] Output: The target data arrives at the server.
[2294] Goal specification phase
[2295] Step 3:
[2296] The server analyzes the received target data and stores it in a database of users.
[2297] Input: Received target data.
[2298] What happens: The server uses a text analysis algorithm to analyze the goal data and saves it as a new goal item in the user's database.
[2299] Output: Goal data stored in a database.
[2300] Step 4:
[2301] The server collects relevant information based on the analyzed goal data, including past user data and general achievement processes.
[2302] Input: Parsed target data, user database.
[2303] Specific behavior: The server searches for relevant success stories and user history and collects the necessary data.
[2304] Output: Collected relevant information data.
[2305] Step 5:
[2306] The server uses a generative AI model to simulate the process of achieving goals and generate specific training plans and steps.
[2307] Input: Collected relevant information data, prompt sentences for the generative AI model.
[2308] Specific operation: Enter a prompt such as "Complete a full marathon within three years" into the generative AI model and obtain the generated training plan.
[2309] Output: The generated training plan data.
[2310] Future diary generation phase
[2311] Step 6:
[2312] The server creates a template for a future diary based on the generated goal achievement scenario.
[2313] Input: Generated training plan data.
[2314] Specific operation: The server writes the training plan according to the diary template format.
[2315] Output: Future diary template data.
[2316] Step 7:
[2317] The server generates diary entries based on specific events (e.g., the specific situation and emotions on the day of completing a full marathon).
[2318] Input: Future diary template data, specific event data.
[2319] Specific behavior: The server fills in a template field corresponding to a specific date, describing the "date of completion of full marathon" and its details.
[2320] Output: Completed diary entry data.
[2321] Emotion recognition phase using the emotion engine
[2322] Step 8:
[2323] The device collects emotional data through the user's facial expressions, voice, text, etc.
[2324] Input: User facial expression, voice, and text data.
[2325] Specific operation: Collects user emotion data in real time using the device's camera and microphone.
[2326] Output: Collected emotion data.
[2327] Step 9:
[2328] The server analyzes the received emotion data using an emotion engine to recognize the user's current emotional state.
[2329] Input: Collected emotion data.
[2330] What it does: The server analyzes the data using an emotion analysis algorithm to determine the emotional state.
[2331] Output: Determined emotional state data.
[2332] Step 10:
[2333] The server adjusts scenarios and advice based on the recognized emotions and provides feedback adapted to the user's emotions.
[2334] Input: Determined emotional state data.
[2335] Specific behavior: The server adapts and customizes scenarios and advice based on the emotional state.
[2336] Output: Customized feedback data.
[2337] Dialogue with your future self phase
[2338] Step 11:
[2339] The device provides the user with a future diary and displays an interface for interacting with their future self.
[2340] Input: Future diary data.
[2341] Specific behavior: The device displays the appropriate interface and allows the user to view the diary.
[2342] Output: The displayed future diary interface.
[2343] Step 12:
[2344] The terminal accepts questions from the user and transmits them to the server.
[2345] Input: User question data.
[2346] Specific operation: The user enters a question on the interface, and the device sends it to the server.
[2347] Output: The question data sent to the server.
[2348] Step 13:
[2349] The server receives and analyzes the question data and generates a response as the future self.
[2350] Input: Submitted question data and user database.
[2351] Specific Action: The server analyzes the question and generates a specific response based on the user's goal achievement.
[2352] Output: The generated response data.
[2353] Step 14:
[2354] The server sends the generated response to the terminal.
[2355] Input: The generated response data.
[2356] Specific operation: The server sends response data to the terminal.
[2357] Output: The response data sent to the device.
[2358] Step 15:
[2359] The device will then display the user's response from their future self.
[2360] Input: The response data sent.
[2361] Specific operation: The device displays the response data on the screen so that the user can view it.
[2362] Output: The displayed response.
[2363] Corporate advertising insertion phase
[2364] Step 16:
[2365] The server selects business advertisements that fit the user's goal funnel.
[2366] Input: User data, advertising database.
[2367] What happens: The server analyzes user data and searches for relevant ads.
[2368] Output: Selected advertising data.
[2369] Step 17:
[2370] The server inserts advertisements into goal-finding scenarios and interactive interfaces at appropriate times.
[2371] Input: Selected advertising data, future diary data.
[2372] What happens: The server embeds ads into the goal-finding scenario or interaction interface.
[2373] Output: Advertisement data inserted into the diary and interface.
[2374] Step 18:
[2375] The terminal displays the advertisement sent from the server to the user.
[2376] Input: The inserted ad data.
[2377] What it does: The device displays the advertisement and allows the user to view it.
[2378] Output: The displayed ad.
[2379] Providing information to users
[2380] Step 19:
[2381] The server integrates the generated future diary, the content of the conversation with the future self, and the company advertisement, and transmits the integrated data to the terminal.
[2382] Input: Diary data, dialogue content, advertising data.
[2383] Specific operation: The server consolidates all data and sends it to the device in bulk.
[2384] Output: A consolidated dataset.
[2385] Step 20:
[2386] The device will display the user's future diary, conversations with their future self, and related corporate advertisements all at once.
[2387] Input: The integrated dataset.
[2388] What it does: The device displays the integrated information on the screen so that the user can review it.
[2389] Output: Displayed future diary, dialogue, and advertisements.
[2390] Through these steps, the system can help users achieve their goals and provide personalized feedback and relevant advertising.
[2391] (Application example 2)
[2392] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2393] Conventional goal achievement support systems allow users to input their goals and provide support in the process, but they have difficulty providing personalized feedback and advice because they do not take the user's emotional state into account. Furthermore, when it comes to inserting corporate advertisements, it is difficult to deliver advertisements at the optimal time based on the user's needs and emotions. The present invention aims to solve these problems and provide personalized support that takes the user's emotions into account, as well as effective advertisement delivery.
[2394] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for the user to input goals and dreams, means for analyzing the input goals and dreams and generating a scenario for achieving the goal, means for creating a future diary based on the generated scenario, emotion recognition means for recognizing the user's current emotional state, means for the user to access the future diary and interact with their future self, means for adjusting the scenario and advice based on the recognized emotional state, and means for inserting corporate advertisements related to the goal-achievement process. This enables personalized support that takes the user's emotions into consideration and effective advertisement delivery.
[2395] "Means for users to input their goals and dreams" refers to the interface or device that allows users to input their goals and dreams into the system.
[2396] "Means for analyzing input goals and dreams and generating scenarios for achieving those goals" refers to software or algorithms that analyze the goals and dreams input by the user and, based on that, carry out specific processes and simulations for achieving those goals.
[2397] "Means for creating a future diary based on the generated scenario" refers to a technology that automatically generates diary entries to record the future situation in which the user achieves their goal, based on the analyzed goal achievement scenario.
[2398] "Emotion recognition means for recognizing the user's current emotional state" refers to technology or devices for determining the user's current emotional state from facial expressions, voice, text, etc.
[2399] "Means for users to access their future diary and interact with their future selves" refers to an interface or system that allows users to view the generated future diary and ask questions or comment on its contents in an interactive format.
[2400] "Means for adjusting scenarios and advice based on the recognized emotional state" refers to technology that analyzes the user's emotional state and changes or adjusts the content of the goal-achievement scenario or advice provided based on the results.
[2401] "Means for inserting corporate advertisements relevant to the process of achieving goals" refers to technologies and systems for displaying corporate advertisements at appropriate times that match the user's process of achieving their goals.
[2402] This invention relates to a system that allows users to input their goals and dreams, generates a diary entry of the future when those goals are achieved, and combines it with an emotion engine that recognizes the user's emotions. This system allows users to specifically understand the process of achieving their goals and receive feedback and advice adapted to their emotions. Furthermore, it provides a new marketing channel for generating advertising revenue by effectively inserting corporate advertisements.
[2403] System configuration and operation
[2404] This system uses the following main hardware and software:
[2405] Smartphone or smart glasses: a device that allows users to input their goals, view future diaries, and utilize a camera to capture facial expressions.
[2406] Camera: A device that captures the user's facial expressions and sends them to the emotion engine.
[2407] TensorFlow: Software used for training and inference of emotion recognition models.
[2408] OpenCV: A software library for face detection and facial expression analysis.
[2409] LangChain: Software used for future diary generation and natural language processing.
[2410] Firebase: A database service that stores and manages user data.
[2411] Program processing explanation
[2412] The server provides a means for users to input their goals and dreams through their devices. The input goal data is sent to the server in real time, which receives and analyzes it. The analysis combines past user data and general rules of success to generate a scenario for achieving the goal. The generated scenario is provided to the user in the form of a future diary using LangChain.
[2413] The camera on a smartphone or smart glasses captures the user's facial expressions and analyzes their emotions in real time using OpenCV and TensorFlow. The analyzed emotional data is sent to a server, which uses an emotion engine to determine the user's current emotional state. Based on this information, future scenarios and advice are adjusted in real time. For example, if the user is feeling down, an encouraging message or specific advice to motivate them is provided.
[2414] The server then inserts appropriate corporate advertisements related to the goal-achievement process, optimizing the content of the advertisements based on the user's emotional state and the scenario of the goal achievement. For example, sports-related goals could be matched with advertisements for training equipment and fitness apps.
[2415] Specific examples
[2416] If a user sets a goal of "running a full marathon within three years," that goal will be stored on the server via Firebase. The server will generate a specific training plan based on the user's current fitness level and past data, and create a future diary using LangChain. For example, the following will be generated:
[2417] Suppose a user has a goal of "running a full marathon within three years." Generate a future diary. The diary should include the process of achieving the goal, a specific training plan, and emotional changes. For example, "On the first day of training, I felt a little depressed, but after a month, I started to enjoy running."
[2418] While users are viewing their diary entries using their smartphones or smart glasses, the camera continuously analyzes their facial expressions, and the server uses the emotion recognition results to provide encouraging messages and appropriate advice. Training-related corporate advertisements are also seamlessly inserted, allowing users to see effective advertisements along with specific information on how to achieve the...
Claims
1. A way for users to input their goals and dreams, A means for analyzing input goals and dreams and generating a scenario for achieving those goals; A means for creating a future diary based on the generated scenario; A way for users to access their future diary and interact with their future selves; A means to insert corporate advertisements related to the process of achieving the goal; A system including:
2. The system according to claim 1, which provides dialogue with one's future self in the form of a chatbot.
3. 2. The system according to claim 1, which simulates a process for achieving a goal and provides specific training plans and steps.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A