system
A system that inputs user information and selects an author to generate tailored action plans using a generative AI model, addressing the challenge of applying self-help teachings to real life, facilitating effective personal development.
Patent Information
- Application Number
- JP2024138322
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-19
- Publication Date
- 2026-03-04
AI Technical Summary
Modern individuals struggle to apply self-help teachings from great figures to their real lives due to the lack of specific action plans tailored to their individual situations and goals, and existing systems fail to provide effective methods for practical implementation.
A system that allows users to input their situation and goals, select a desired author or great figure, and uses a generative AI model to generate a specific action plan tailored to their needs, which is then displayed for implementation.
Enables users to easily obtain and implement specific action plans, effectively applying self-improvement teachings to their daily lives, enhancing personal growth and goal achievement.
Smart Images

Figure 2026035479000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Modern business people and those living busy lives often come into contact with self-help books and the teachings of great figures, but often struggle to know how to apply these teachings to their real lives. Furthermore, specific action plans and practical methods tailored to individual situations and goals are rarely provided, meaning many people are unable to fully utilize their effectiveness. To solve this problem, a system is needed that can present specific action plans tailored to each individual's situation and apply them to real life. [Means for solving the problem]
[0005] This invention provides a means for users to input information about their own situation and goals and select a desired author or great figure. Based on the input information and the teachings of the selected author or great figure, a generative AI model then generates a specific action plan and implementation method tailored to the user's individual situation and goals. The generated action plan is displayed along with detailed implementation methods, allowing the user to refer to and apply the plan in their daily lives. This solves the aforementioned problem by providing a system that allows users to easily obtain and implement specific action plans.
[0006] "Information about situation and goals" is information that describes the user's current living environment, challenges, goals, desired future situation, and the like.
[0007] "Input means" refers to a device or interface that allows a user to input information into a system, and includes a keyboard, touch screen, voice input device, etc.
[0008] "Desired author or great person" refers to a famous person that the user wants to refer to, or the ideas and teachings contained in their works.
[0009] "Selection means" refers to a device or interface that allows a user to specify a desired author or famous person to the system, and includes a drop-down menu, a search function, and the like.
[0010] "Acquisition means" refers to a function or process for collecting information entered and selected via input means and selection means.
[0011] "Preprocessing means" refers to processes such as data normalization and semantic analysis that are carried out to accurately analyze the acquired information.
[0012] "Generative means" refers to an AI model or algorithm that generates a specific action plan based on specific teachings, based on the acquired information and pre-processed data.
[0013] An "action plan" is a detailed set of instructions detailing specific practices and plans of action based on a user's situation and goals.
[0014] "Display means" refers to a device or interface for visually presenting the generated action plan and implementation method to the user, and includes a display, screen, etc.
[0015] The above are definitions of important terms contained in the claims. [Brief explanation of the drawings]
[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11]FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0018] First, the terms used in the following description will be explained.
[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0024] [First embodiment]
[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0037] The present invention is a system for enabling users to specifically apply self-development teachings to real life. This system is implemented by combining the following means and methods.
[0038] 1. Enter your user information
[0039] The user enters information about their situation and goals into a form on the terminal. For example, the user can enter, "I'm feeling stressed because my current job is busy. I'd like to know how to manage stress."
[0040] 2. Select the author or person you want to read
[0041] Users can use the drop-down menus and search functions in the form to select the desired author or figure. For example, a user can select "Author A."
[0042] 3. Transmission of User Information
[0043] The terminal transmits the input information and information on the selected author or famous person to the server.
[0044] 4. Receiving and Preprocessing Input Data
[0045] The server receives the data sent from the device, including the user's status, goals, and information about selected authors and famous people.
[0046] The server pre-processes the data, normalizes the retrieved information, and performs semantic analysis.
[0047] 5. Generate AI models and create action plans
[0048] Based on the pre-processed data, the server's generative AI model generates a specific action plan that reflects the teachings of the author or great person selected by the user.
[0049] For example, a stress management method based on the teachings of "Author A" might suggest 10 minutes of meditation each morning.
[0050] 6. Submit and view your action plan
[0051] The server sends the generated action plan and detailed implementation instructions to the terminal.
[0052] The device will display the action plan on the user's screen, allowing the user to refer to it and apply it to their daily lives.
[0053] For example, suppose a user is searching for "ways to reduce work stress" and is seeking advice based on the teachings of "Author A." By inputting and selecting this information, the system creates a specific action plan based on the teachings of "Author A," providing practical advice such as "meditate for 10 minutes every morning" and "take two short breaks during the day."
[0054] In this way, the system of the present invention helps users effectively apply self-improvement teachings to real-life situations, enabling users to take concrete steps toward personal growth and goal achievement.
[0055] The processing flow will be explained below.
[0056] Step 1:
[0057] The user enters information about their situation and goals into a form on the device. For example, they might enter, "My current job is busy and I'm feeling stressed. I'd like to know how to manage stress."
[0058] Step 2:
[0059] The user selects the desired author or famous person using the drop-down menu or search function in the form, for example, "Author A."
[0060] Step 3:
[0061] The terminal sends the entered information (situation and goal) and the information on the selected author or great person to the server.
[0062] Step 4:
[0063] The server receives the data sent from the device, which includes information about the user's situation, goals, and selected authors and famous people.
[0064] Step 5:
[0065] The server pre-processes the data it receives, normalizing it and performing semantic analysis, such as correcting typos and extracting important keywords.
[0066] Step 6:
[0067] The server's generative AI model generates a specific action plan based on the preprocessed data, reflecting the teachings of a specific author or great figure. For example, based on the teachings of "Author A," it suggests "10 minutes of meditation every morning."
[0068] Step 7:
[0069] The server sends the generated action plan and detailed implementation instructions to the terminal.
[0070] Step 8:
[0071] The device will then display the action plan and practice method on the user's screen. For example, it will introduce it as "a meditation method based on the teachings of Author A."
[0072] In this way, through the processing steps, the user can obtain an action plan for concretely applying the teachings of self-development to real life.
[0073] Example 1
[0074] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0075] In modern society, applying self-improvement teachings to real life is important for many people. However, self-improvement teachings often contain abstract concepts that are difficult to translate into concrete action plans. This makes it difficult for users to obtain concrete, practical action plans tailored to their own situations and goals. Furthermore, conventional systems have limited ways for users to efficiently utilize the teachings of selected authors or great figures. Therefore, an objective of the present invention is to provide a system that supports users in effectively applying self-improvement teachings to real life.
[0076] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0077] In this invention, the server includes: an input means for inputting information about a situation and a goal; a selection means for selecting a desired author or famous person; an acquisition means for acquiring the information input and selected using the input means and the selection means; a preprocessing means for preprocessing the information acquired by the acquisition means and performing normalization and semantic analysis; a generation means for generating a specific action plan based on a specific teaching based on the information preprocessed by the preprocessing means; a display means for displaying the action plan generated by the generation means; and a communication means for transmitting and receiving data between the acquisition means and the generation means via a communication protocol. This enables a user to easily acquire a specific and practical action plan suited to their situation and goal.
[0078] The "input means" is an interface for the user to input information about the situation and the goal.
[0079] The "selection means" is an interface that allows the user to select the desired author or great person.
[0080] The "acquisition means" is a means for acquiring information input and selected using the input means and selection means.
[0081] The "preprocessing means" is a means for preprocessing the information acquired by the acquisition means, and for performing normalization and semantic analysis.
[0082] The "generation means" is a means for generating a specific action plan based on a specific teaching, based on the information preprocessed by the preprocessing means.
[0083] The "display means" is a means for displaying the action plan generated by the generation means on the user's screen.
[0084] The "communication means" is a means by which the acquisition means and generation means send and receive data via a communication protocol.
[0085] A "generative AI model" is an artificial intelligence model used in the generation means to propose specific action plans based on the user's situation and goals.
[0086] A "prompt sentence" is a sentence input into a generative AI model that contains instructions for generating a specific action plan based on the user's situation and goals.
[0087] The present invention is a system for enabling users to specifically apply self-development teachings to real life. This system is implemented by combining the following means and methods.
[0088] First, the user enters information about their situation and goals into a form on the device. For example, they might say, "My current job is busy and I'm feeling stressed. I'd like to know how to manage stress." The device provides the input form using HTML and JavaScript (registered trademark).
[0089] Next, the user can select the desired author or great person using the drop-down menus or search function in the form. For example, they can select "Author A." This selection function is implemented using the JavaScript library React.
[0090] The terminal generates JSON format data to send the entered information and information on the selected authors and famous people to the server, and sends it using the HTTPS protocol.
[0091] The server receives data from the device using the Python framework Flask. The received data includes information about the user's situation, goals, and selected authors and famous people. The server normalizes and semantically analyzes the data using natural language processing libraries such as NLTK and SpaCy, thereby preprocessing the retrieved information.
[0092] Next, the server uses a generative AI model to generate a specific action plan based on the preprocessed data and reflects the teachings of the author or great person selected by the user. The generative AI model uses OpenAI's GPT-4 (registered trademark). The AI model generates an action plan by inputting a prompt sentence. An example of the prompt sentence is as follows:
[0093] "The user is currently stressed due to a busy job and is looking for ways to manage stress. The user would like to hear from Author A about stress management methods. What action plan can you suggest?"
[0094] The server then sends the generated action plan and detailed implementation instructions to the device, again using the HTTPS protocol for communication.
[0095] The device displays the action plan sent from the server on the user's screen. The UI is displayed using the React library and CSS, providing information in a format that is easy for the user to view.
[0096] As a specific example, if a user is looking for "ways to reduce work stress" and enters advice based on the teachings of "Author A," the system will generate a specific action plan, such as "meditate for 10 minutes every morning" or "take two short breaks during the day," and display it on the device.
[0097] The system provides users with a concrete and practical action plan for effectively applying self-improvement teachings to real life.
[0098] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0099] Step 1:
[0100] Users enter information about their situation and goals into a form on their device. The input form is built using HTML and JavaScript. For example, a user might enter, "I'm feeling stressed because my current job is so busy. I'd like to know how to manage stress." The entered information is converted into JSON format data and prepared for the next step.
[0101] Input: Information about the situation and goals that the user enters into an HTML form
[0102] Output: User information data in JSON format
[0103] Step 2:
[0104] Users can select the desired author or famous person using drop-down menus or a search function within the form. This selection function, built using React, allows users to select, for example, "Author A." The selected data is also converted to JSON format.
[0105] Input: Information about the author or person selected by the user
[0106] Output: Selection data in JSON format
[0107] Step 3:
[0108] The terminal acquires the information entered and selected by the user, compiles it into JSON format data, and sends the JSON data via the HTTPS protocol to the server.
[0109] Input: User information data and selection data
[0110] Output: All data sent to the server in JSON format
[0111] Step 4:
[0112] The server receives data sent from the device using Python's Flask, including information about the user's status, goals, and selected authors and famous people, and prepares the data for the next step.
[0113] Input: All data received from the terminal in JSON format
[0114] Output: Received data (raw)
[0115] Step 5:
[0116] The server preprocesses the received data, which includes normalizing and semantic analysis. It uses Python's NLTK and SpaCy libraries to parse the user input and convert it into the required format.
[0117] Input: Raw incoming data
[0118] Output: Preprocessed data
[0119] Step 6:
[0120] The server uses a generative AI model (OpenAI's GPT-4) to generate an action plan based on the preprocessed data, reflecting the teachings of the author or great person selected by the user. For example, the prompt sentence "The user is currently feeling stressed due to a busy job and is looking for ways to manage stress. The user would like to learn from Author A about stress management methods. What kind of action plan can you suggest?" is input into the AI model, and a practical action plan is generated.
[0121] Input: preprocessed data, prompt statement
[0122] Output: Generated action plan
[0123] Step 7:
[0124] The server converts the generated action plan back into JSON format and transmits it using the HTTPS protocol to send it to the terminal.
[0125] Input: Generated Action Plan
[0126] Output: Action plan in JSON format sent to the device
[0127] Step 8:
[0128] The device then displays the received action plan on the user's screen, using the React library and CSS to display the action plan and detailed instructions on how to implement it in a user-friendly UI.
[0129] Input: Action plan in JSON format received from the server
[0130] Output: Action plan displayed on the user's screen
[0131] This system allows users to easily obtain specific and practical action plans based on their own situations and goals, and apply them to their real lives.
[0132] (Application example 1)
[0133] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0134] Today's users seek a variety of information for self-development and self-improvement, but often struggle with how to apply that information to their real lives. Many users also want to feel confident in a particular fashion style, but often don't know what specific actions to take. Another issue is the lack of personalized advice and suggestions to improve their shopping experience in physical stores.
[0135] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0136] In this invention, the server includes an input means for inputting information about a situation and a goal, a selection means for selecting a desired author or great person, a generation means for generating a specific action plan based on specific teachings based on the information acquired by the acquisition means, and a suggestion means for displaying fashion suggestions in a physical store based on the teachings of the selected author or great person in accordance with the user's specific challenges and areas for improvement. This enables the user to specifically and effectively apply the teachings of self-improvement to their real life, provides a specific action plan for gaining confidence in a specific fashion style, and significantly improves the shopping experience in a physical store.
[0137] "Situation and goal information" refers to data about the challenges the user is currently facing and the goals they want to achieve.
[0138] "Input means" refers to an interface or form that allows a user to input a situation or goal into a terminal.
[0139] The "selection means" refers to an interface or menu that allows the user to select the desired author, famous person, or fashion icon.
[0140] "Acquisition means" refers to a function or system for collecting information entered and selected by a user.
[0141] "Generating means" refers to functions or algorithms that, based on the acquired information, create specific action plans or fashion suggestions based on specific teachings or advice.
[0142] "Display means" refers to a display or screen that visually presents the generated action plan or proposal to the user.
[0143] "Proposal means" refers to functions and systems for displaying specific advice and fashion suggestions in physical stores that are tailored to the user's situation and goals.
[0144] "Implementation tools" are support functions and guides for implementing the proposed action plan based on the advice of the fashion style icons and stylists selected by the user.
[0145] The present invention is a system for enabling users to apply self-improvement teachings and fashion improvement advice to their real lives in a concrete manner. This system is realized by combining a plurality of means and methods.
[0146] 1. Enter your user information
[0147] The user inputs information about his / her situation and goals using the input means of the terminal. For example, the user inputs a goal such as "I want to feel more confident in casual styles."
[0148] 2. Choose your favorite author, famous person, or fashion icon
[0149] The user selects the desired author, famous person, or fashion icon using the selection means of the terminal. For example, the user can select "Author A" or "Fashion Stylist B."
[0150] 3. Transmission of User Information
[0151] The device sends the entered information and information about the selected author, famous person, or fashion icon to the server. The sent data is encoded in JSON format.
[0152] 4. Data Reception and Preprocessing
[0153] The server receives the data sent from the device. The received data includes information about the user's situation, goals, and selected authors, famous people, and fashion icons. The server preprocesses the data, normalizes it, and performs semantic analysis. This is done using Python and natural language processing toolkits (e.g., NLTK, spaCy).
[0154] 5. AI model generation and suggestions
[0155] The server's generative AI model (e.g., GPT-4) uses the preprocessed data to generate specific action plans and fashion suggestions that reflect the teachings of authors, famous people, or fashion icons selected by the user. This is often done using TENSORFLOW (registered trademark). For example, it may suggest stress management methods based on the teachings of "Author A" or specific outfits based on the advice of "Fashion Stylist B."
[0156] 6. Submitting and Viewing Action Plans and Proposals
[0157] The server sends the generated action plan, fashion suggestions, and detailed practice methods to the device, which then displays them on the user's screen, allowing the user to refer to them and apply them to their daily lives or enjoy shopping at a physical store.
[0158] For example, if a user sets a goal of "I want to be more confident in casual style" and selects "Fashion Stylist B," the server will generate a fashion suggestion such as "Pair a simple white T-shirt with denim pants and put on a leather jacket on top," and send it to the device. This allows the user to learn specific coordination methods and try out a similar style in a physical store.
[0159] An example of a prompt is as follows:
[0160] "I want to feel more confident in casual style."
[0161] "Fashion Stylist B"
[0162] The system allows users to effectively incorporate self-improvement teachings and fashion improvement advice into their real lives.
[0163] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0164] Step 1:
[0165] The user inputs information about the situation and goals using the input means of the device. The input data may include content such as "I want to feel more confident in casual styles." This becomes the input data and is passed to the next processing step.
[0166] Step 2:
[0167] The user uses the device's selection means to select the desired author, famous person, fashion icon, or stylist. For example, "Fashion Stylist B" is selected. The entered information is sent to the server along with the data of the selected person. This becomes the input data and is passed to the next processing step.
[0168] Step 3:
[0169] The device collects the information entered in steps 1 and 2 and sends it to the server. The server receives this data and preprocesses it. Specific operations in preprocessing include data normalization and semantic analysis. Normalization standardizes the data format, and semantic analysis extracts the meaning of the data using a natural language processing toolkit (e.g., NLTK, spaCy). This clarifies the user's intent and the characteristics of the selected author, famous person, or fashion icon.
[0170] Step 4:
[0171] The server's generative AI model (e.g., GPT-4) generates specific action plans and fashion suggestions based on the preprocessed data. The generated content is based on the user's situation, goals, and the teachings of the selected person. For example, a fashion suggestion might be, "To feel confident in casual style, combine a simple white T-shirt with denim pants and top it off with a leather jacket." This is the output data for the input data.
[0172] Step 5:
[0173] The server then sends the generated action plan and fashion suggestions to the device. The data sent includes detailed practical instructions, showing the user how to make specific improvements and take action. For example, the server may provide specific instructions such as, "Choose a simple, plain white T-shirt and straight or skinny denim pants. For a stylish look, add a black leather jacket."
[0174] Step 6:
[0175] The device displays the action plans and suggestions on the user interface, allowing users to apply them to their own lives and use them when shopping in physical stores. This allows users to incorporate self-improvement advice and fashion improvement advice into their lives.
[0176] Through each of the above steps, users can obtain specific action plans and suggestions for self-improvement and fashion improvement.
[0177] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0178] The present invention is a system that allows users to concretely apply self-development teachings to real life, and by combining an emotion engine, it enables adjustment of action plans based on the user's emotions. This system is implemented by combining the following means and methods.
[0179] 1. Enter your user information
[0180] The user enters information about their situation and goals into a form on the terminal. For example, they might enter, "My current job is busy and I'm feeling stressed. I'd like to know how to manage stress."
[0181] 2. Select the author or person you want to read
[0182] The user can use the drop-down menus and search functions in the form to select the desired author or person, for example, "Author A."
[0183] 3. User Emotion Recognition
[0184] The device is equipped with an emotion engine that recognizes the user's emotions. The emotion engine uses voice analysis and facial recognition technology to identify the user's emotions. For example, it can detect stress or anxiety from the user's tone of voice and facial expressions when typing.
[0185] 4. Sending user information and emotions
[0186] The terminal transmits the input information (situation and goal), information on the selected author or famous person, and the recognized user's emotion information to the server.
[0187] 5. Receiving and Preprocessing Input Data
[0188] The server receives the data sent from the terminal, which includes the user's situation, goal, information about the selected author or famous person, and emotional information.
[0189] The server preprocesses the data, normalizes the retrieved information, and performs semantic analysis, for example, correcting typos and extracting important keywords.
[0190] 6. Generate AI models and create action plans
[0191] The server's generative AI model generates a specific action plan based on the preprocessed data, reflecting the teachings of a specific author or great figure. The model also takes into account the user's emotional state. For example, based on the teachings of "Author A," the model suggests "10 minutes of meditation every morning." However, if the user is feeling particularly stressed, the model can adjust the plan by incorporating moderate exercise in addition to meditation.
[0192] 7. Submit and view your action plan
[0193] The server sends the generated action plan and detailed implementation instructions to the terminal.
[0194] The device will then display the action plan and practice method on the user's screen. For example, it will introduce it as "a meditation method based on the teachings of Author A."
[0195] For example, suppose a user is looking for "ways to reduce work stress" and is seeking advice based on the teachings of "Author A." After the user enters and selects this information and the emotion engine recognizes that the user is experiencing high levels of stress, the system creates an action plan based on the teachings of "Author A," including "walking 30 minutes a day" in addition to meditation.
[0196] In this way, the system of the present invention takes into account the user's emotional state and helps them effectively apply self-improvement teachings to real life, thereby enabling them to take more concrete and effective steps towards personal growth and goal achievement.
[0197] The processing flow will be explained below.
[0198] Step 1:
[0199] The user enters information about their situation and goals into a form on the terminal. For example, they might enter, "My current job is busy and I'm feeling stressed. I'd like to know how to manage stress."
[0200] Step 2:
[0201] The user can use the drop-down menus and search functions in the form to select the desired author or person, for example, "Author A."
[0202] Step 3:
[0203] The device uses an emotion recognition engine to analyze the user's voice and facial expressions while they are inputting information, and recognizes the user's emotions. For example, it can identify from voice analysis that the user is feeling high levels of stress.
[0204] Step 4:
[0205] The terminal transmits the input information (situation and goal), information on the selected author or famous person, and recognized emotion information to the server.
[0206] Step 5:
[0207] The server receives the data sent from the terminal, which includes the user's situation, goal, information about the selected author or famous person, and emotional information.
[0208] Step 6:
[0209] The server pre-processes the data it receives, normalizing it and performing semantic analysis, such as correcting typos and extracting important keywords.
[0210] Step 7:
[0211] The server's generative AI model generates a specific action plan based on the preprocessed data, reflecting the teachings of a specific author or great figure. The model also takes into account the user's emotional state. For example, based on the teachings of "Author A," the model might suggest "10 minutes of meditation every morning," but if the user is feeling particularly stressed, the model might adjust the plan to include moderate exercise and relaxation techniques.
[0212] Step 8:
[0213] The server sends the generated action plan and detailed implementation instructions to the terminal.
[0214] Step 9:
[0215] The device displays the action plan and how to put it into practice on the user's screen. For example, it might introduce it as a "meditation method based on the teachings of Author A" and suggest "walking 30 minutes a day."
[0216] In this way, the system of the present invention takes into account the user's emotional state and helps them effectively apply self-improvement teachings to their real life, thereby enabling them to take more concrete and effective steps towards self-improvement and goal achievement.
[0217] Example 2
[0218] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0219] Conventional self-improvement systems have difficulty providing specific action plans that take into account the user's emotional state. Furthermore, while it is necessary to appropriately integrate multiple information input and selection methods to provide users with accurate action plans, the technological means to achieve this have been lacking. As a result, users are unable to effectively apply the self-improvement teachings to their real lives, and the support for goal achievement and personal growth is insufficient.
[0220] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a preprocessing means, a generation means using a generative AI model, and an emotion recognition means. This makes it possible to generate a specific action plan that takes into account the user's emotional state based on information about the user's situation and goals. The generated action plan is adjusted according to the user's emotions, thereby enabling effective support for achieving real-life goals and self-improvement.
[0221] The "input means" is an interface that allows the user to input information about his / her own situation and goals into the terminal.
[0222] The "selection means" is an interface that allows the user to select the desired author or great person.
[0223] The "acquisition means" is a means for collecting information input and selected using the input means and selection means.
[0224] The "emotion recognition means" is a means for analyzing and recognizing the user's emotions, and uses voice analysis and face recognition technology.
[0225] The "transmission means" is a means for transmitting the information acquired and recognized by the acquisition means and emotion recognition means to the server.
[0226] The "preprocessing means" is a means for normalizing the information input to the server and performing preprocessing such as correcting typos and extracting important keywords.
[0227] "Generative means" refers to a means for generating a specific action plan that reflects specific teachings using a generative AI model based on preprocessed information.
[0228] The "display means" is a means for displaying the generated action plan and detailed implementation methods thereof on the user's screen.
[0229] A "generative AI model" is an artificial intelligence model that generates an action plan that reflects specific teachings based on input information.
[0230] A "prompt" is a sentence containing instructions or information to be input into a generative AI model.
[0231] The present invention is a system that allows users to apply self-development teachings to real life. This system combines an emotion engine to enable adjustment of action plans based on the user's emotions. Each element and its specific processing will be described in detail below.
[0232] 1. Input Method
[0233] Users enter information about their situation and goals using an on-device form built with HTML and JavaScript, such as, "I'm feeling stressed and overwhelmed at work right now. I'd like to know how to manage stress."
[0234] 2. Selection Method
[0235] Users select the desired author or great person using drop-down menus within the form or a search function that uses JavaScript and AJAX to narrow down the results in real time. For example, select "Author A."
[0236] 3. Emotion recognition means
[0237] The device is equipped with an emotion engine that recognizes the user's emotions. It uses voice analysis tools (e.g., Amazon Polly) and facial recognition technology (Microsoft® Azure® Face API). It analyzes the tone of voice and facial expressions when the user enters information to identify stress or anxiety.
[0238] 4. Transmission Method
[0239] The device sends the acquired user information (situation and goal), information on the selected author or famous person, and the recognized emotion information to the server. Communication is performed using the HTTPS protocol.
[0240] 5. Pretreatment Methods
[0241] The server receives the data sent from the device, including the user's situation, goals, information about the selected author or famous person, and emotional information.
[0242] The server uses Python and Node.js to perform preprocessing of the data, specifically correcting typos in the text data, extracting important keywords, and normalizing the data.
[0243] 6. Generation means
[0244] Based on the preprocessed data, the server uses a generative AI model (such as OpenAI GPT-3®) to generate a specific action plan that reflects specific teachings. This generation process also takes into account the weighting of each data element and the user's emotional information. For example, based on the teachings of "Author A," the server may suggest "10 minutes of meditation every morning," but if the user is feeling high stress, it may also recommend "30 minutes of walking per day" in addition to meditation.
[0245] 7. Display means
[0246] The server then sends the generated action plan and detailed implementation instructions to the device, and this communication is also carried out using the HTTPS protocol.
[0247] The device then displays the received action plan and detailed practice instructions on the user's screen. This display uses HTML, CSS, and JavaScript. For example, it displays a "meditation method based on the teachings of Author A" along with specific steps.
[0248] Specific examples
[0249] For example, suppose a user is searching for "ways to reduce work stress" and seeks advice based on the teachings of "Author A." The user enters the information, and the emotion engine recognizes that the user is experiencing high levels of stress. In this case, the system generates an action plan based on the teachings of "Author A," including "walking 30 minutes a day" in addition to meditation.
[0250] Examples of prompt statements
[0251] The user is searching for "ways to reduce work stress" and is seeking advice based on the teachings of "Author A." Based on the user's emotional information, it appears that the user is experiencing high levels of stress. Please generate an action plan that takes this information into account.
[0252] The system effectively applies self-improvement teachings to real life situations while taking into account the user's emotional state, allowing the user to take concrete and effective steps towards self-improvement and goal achievement.
[0253] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0254] Step 1:
[0255] The user inputs information about the situation and goals into a form on the terminal. An example of input information is text such as "I'm currently busy at work and feeling stressed. I'd like to know how to manage stress." This provides information to the input means. Input: text data about the user's situation and goals, Output: input information.
[0256] Step 2:
[0257] The user selects the desired author or great person using the dropdown menu or search function in the form. This function uses JavaScript and AJAX to retrieve information about the selected author or great person in real time. Input: Author or great person selected by the user, Output: Information about the selected author or great person.
[0258] Step 3:
[0259] The device's emotion recognition means analyzes the user's emotions. It uses voice analysis tools (e.g., Amazon Polly) and facial recognition technology (Microsoft Azure Face API) to identify the user's emotions from the input text, voice, and facial expressions. For example, it detects if the user is feeling stressed. Input: User's voice, facial expressions, and text data. Output: Recognized emotional information.
[0260] Step 4:
[0261] The terminal transmits the information acquired by the input means and selection means, as well as the emotion information acquired by the emotion recognition means, to the server. This communication is performed using the HTTPS protocol, ensuring secure data transfer. Input: Acquired user information, information on selected authors and famous people, recognized emotion information. Output: Data transmitted to the server.
[0262] Step 5:
[0263] The server receives the transmitted information, which includes the user's situation, goals, information on selected authors and famous people, and emotional information. The server normalizes and semantically analyzes the received data using preprocessing means, such as correcting typos in the text and extracting important keywords. Input: transmitted data, Output: preprocessed data.
[0264] Step 6:
[0265] The server generates a specific action plan based on the preprocessed data using a generative AI model (e.g., OpenAI GPT-3). This also takes into account the teachings of specific authors and recognized emotional information. For example, based on the teachings of "Author A," it suggests "10 minutes of meditation every morning," but if the user feels high stress, it also suggests "30 minutes of walking per day." Input: Preprocessed data, Output: Generated action plan.
[0266] Step 7:
[0267] The server sends the generated action plan and detailed instructions on how to implement it to the device. Again, this communication is performed using the HTTPS protocol. Input: Generated action plan, Output: Action plan sent to the device.
[0268] Step 8:
[0269] The device displays the received action plan and detailed implementation instructions on the user's screen. This display uses HTML, CSS, and JavaScript, providing an interface that is easy for the user to understand. For example, specific operating procedures could be shown as "meditation methods based on the teachings of author A." Input: Action plan received from the server, Output: Action plan displayed on the user's screen.
[0270] In this way, the system takes into account the user's emotional state and helps them effectively apply self-improvement teachings to their real life, ultimately enabling them to take concrete and effective steps towards personal growth and goal achievement.
[0271] (Application example 2)
[0272] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0273] Conventional self-improvement systems only provide static action plans without considering the user's emotional state, which limits their practicality and effectiveness. Furthermore, there is a lack of systems aimed at improving the user experience in brick-and-mortar stores, making it difficult to provide personalized action plans based on the user's emotions.
[0274] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0275] In this invention, the server includes an input means for inputting information about a situation and a goal, a selection means for selecting a desired celebrity or great person, an acquisition means for acquiring the information input and selected using the input means and the selection means, a recognition means for recognizing the user's emotions, a generation means for generating a specific action plan based on a specific teaching based on the information acquired by the acquisition means and the recognition means, and a display means for displaying the generated action plan. This makes it possible to provide a personalized action plan that takes into account the user's emotional state even in a physical store.
[0276] "Information about the situation and goals" is data about the situation the user is currently facing and the goals the user wants to achieve.
[0277] "Input means" refers to a device or interface through which a user inputs information about the situation and goals.
[0278] A "selection means" is a device or interface that allows a user to select a desired famous person or great person.
[0279] An "acquisition means" is a device or system that collects information entered and selected using input means and selection means.
[0280] The "recognition means" is a device including an emotion engine and a sensor for recognizing the user's emotions.
[0281] The "generating means" is a device or system that generates a specific action plan based on a specific teaching, based on the information collected by the acquiring means and the recognizing means.
[0282] The "display means" is a display or output device for presenting the generated action plan to the user.
[0283] This invention is a system that recognizes a user's emotional state and provides a self-improvement action plan based on that state. The system involves inputting information about a situation and a goal, selecting a desired celebrity or great person, recognizing the user's emotions, generating an action plan based on the collected information, and displaying the action plan.
[0284] System configuration
[0285] Input methods:
[0286] The input means in this invention is implemented by a terminal such as a smartphone, tablet, etc. A user uses these devices to input information about the current situation and the goals they want to achieve.
[0287] Example: "I want to be more motivated at work."
[0288] Selection method:
[0289] The user selects the teachings of the desired celebrity or great person using the selection means, which may include a drop-down menu or a search function.
[0290] Example: Select "Celebrity A".
[0291] Recognition means:
[0292] The system uses an emotion engine to recognize the user's emotions. The emotion engine uses technologies such as FaceAPI and Google® Cloud Speech-to-Text. These technologies analyze the user's facial expressions and tone of voice to recognize emotions in real time.
[0293] Example: Detecting stress levels from the user's tone of voice.
[0294] Generation means:
[0295] Based on the information collected by the acquisition and recognition means, the server generates a specific action plan based on specific teachings, using an AI model (e.g., OpenAI GPT-4) to adjust the plan, taking into account the user's emotional state.
[0296] Example: "Based on the teachings of celebrity A, I suggest 10 minutes of meditation every morning, but if you are under high stress, I suggest moderate exercise in addition to meditation."
[0297] Display means:
[0298] The generated action plan is displayed on the user's smartphone, tablet, or smart glasses, allowing the user to confirm specific actions at the appropriate time.
[0299] Specific example explanation
[0300] Suppose a user is in a physical store looking for "ways to reduce work stress." The user enters their situation and goals into a smartphone app and selects "Celebrity B." The emotion engine recognizes that the user is experiencing high levels of stress. Based on this information, the server uses a generative AI model to generate an action plan, suggesting "30 minutes of walking and 15 minutes of relaxation sessions per day, based on the teachings of Celebrity B." This plan is then displayed on the user's smartphone.
[0301] Example prompt for generative AI model:
[0302] "User information: 'Stress reduction', 'Busy at work', 'Very high stress'. Preferred celebrity: 'Celebrity B'. Based on the teachings of Celebrity B and taking into account the user's current state and emotions, what would you suggest to reduce stress?"
[0303] In this way, users can receive specific and timely action plans tailored to them.
[0304] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0305] Step 1:
[0306] The device inputs information about the user's situation and goals. The input information includes the user's current situation and the goals they want to achieve. When this information is input to the device, the device stores it as internal data (input: information about the user's situation and goals, output: information stored in the internal database).
[0307] Step 2:
[0308] The device allows the user to select the celebrity or great person of their choice. The user can select the celebrity or great person of their choice using a drop-down menu or search function. This selection information is also input into the device and saved as internal data (input: selection of celebrity or great person, output: selection information saved in the internal database).
[0309] Step 3:
[0310] The device sends the user's input and selection information acquired to an emotion engine for emotion recognition. The device's sensors or camera are used to capture the user's facial expressions and tone of voice, which are then analyzed by the emotion engine (input: user's input and selection information, output: emotion data as the analysis result).
[0311] Step 4:
[0312] The device sends the user's emotion data analyzed by the emotion engine to the server. The server receives the emotion data, input information, and selection information and integrates them into a single dataset (input: emotion data, input information, selection information; output: integrated dataset).
[0313] Step 5:
[0314] The server preprocesses the integrated dataset. The preprocessing step involves normalizing the data, correcting typos, and performing semantic analysis to extract important keywords (input: integrated dataset, output: normalized and semantically analyzed data).
[0315] Step 6:
[0316] The server uses a generative AI model (e.g., OpenAI GPT-4) to generate a specific action plan based on the preprocessed data, paying particular attention to the user's emotional state and considering an appropriate action plan (input: normalized and semantically analyzed data, output: specific action plan).
[0317] Step 7:
[0318] The server sends the generated action plan to the terminal, which then displays the action plan. The display allows the user to view the action plan and its detailed implementation method (input: specific action plan, output: action plan displayed on the terminal).
[0319] Step 8:
[0320] After the user executes the action plan, the device performs emotion recognition again and sends the results to the server. The server then checks the user's progress based on the feedback information and provides additional advice accordingly (input: user's execution results and re-emotional data, output: progress check and additional advice).
[0321] This processing step allows users to access a personal development plan tailored to their situation and emotions, enhancing their in-store experience.
[0322] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0323] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0324] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0325] [Second embodiment]
[0326] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0327] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0328] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0329] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0330] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0331] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0332] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0333] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0334] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0335] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0336] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0337] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0338] The present invention is a system for enabling users to specifically apply self-development teachings to real life. This system is implemented by combining the following means and methods.
[0339] 1. Enter your user information
[0340] The user enters information about their situation and goals into a form on the terminal. For example, the user can enter, "I'm feeling stressed because my current job is busy. I'd like to know how to manage stress."
[0341] 2. Select the author or person you want to read
[0342] Users can use the drop-down menus and search functions in the form to select the desired author or figure. For example, a user can select "Author A."
[0343] 3. Transmission of User Information
[0344] The terminal transmits the input information and information on the selected author or famous person to the server.
[0345] 4. Receiving and Preprocessing Input Data
[0346] The server receives the data sent from the device, including the user's status, goals, and information about selected authors and famous people.
[0347] The server pre-processes the data, normalizes the retrieved information, and performs semantic analysis.
[0348] 5. Generate AI models and create action plans
[0349] Based on the pre-processed data, the server's generative AI model generates a specific action plan that reflects the teachings of the author or great person selected by the user.
[0350] For example, a stress management method based on the teachings of "Author A" might suggest 10 minutes of meditation each morning.
[0351] 6. Submit and view your action plan
[0352] The server sends the generated action plan and detailed implementation instructions to the terminal.
[0353] The device will display the action plan on the user's screen, allowing the user to refer to it and apply it to their daily lives.
[0354] For example, suppose a user is searching for "ways to reduce work stress" and is seeking advice based on the teachings of "Author A." By inputting and selecting this information, the system creates a specific action plan based on the teachings of "Author A," providing practical advice such as "meditate for 10 minutes every morning" and "take two short breaks during the day."
[0355] In this way, the system of the present invention helps users effectively apply self-improvement teachings to real-life situations, enabling users to take concrete steps toward personal growth and goal achievement.
[0356] The processing flow will be explained below.
[0357] Step 1:
[0358] The user enters information about their situation and goals into a form on the device. For example, they might enter, "My current job is busy and I'm feeling stressed. I'd like to know how to manage stress."
[0359] Step 2:
[0360] The user selects the desired author or famous person using the drop-down menu or search function in the form, for example, "Author A."
[0361] Step 3:
[0362] The terminal sends the entered information (situation and goal) and the information on the selected author or great person to the server.
[0363] Step 4:
[0364] The server receives the data sent from the device, which includes information about the user's situation, goals, and selected authors and famous people.
[0365] Step 5:
[0366] The server pre-processes the data it receives, normalizing it and performing semantic analysis, such as correcting typos and extracting important keywords.
[0367] Step 6:
[0368] The server's generative AI model generates a specific action plan based on the preprocessed data, reflecting the teachings of a specific author or great figure. For example, based on the teachings of "Author A," it suggests "10 minutes of meditation every morning."
[0369] Step 7:
[0370] The server sends the generated action plan and detailed implementation instructions to the terminal.
[0371] Step 8:
[0372] The device will then display the action plan and practice method on the user's screen. For example, it will introduce it as "a meditation method based on the teachings of Author A."
[0373] In this way, through the processing steps, the user can obtain an action plan for concretely applying the teachings of self-development to real life.
[0374] Example 1
[0375] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0376] In modern society, applying self-improvement teachings to real life is important for many people. However, self-improvement teachings often contain abstract concepts that are difficult to translate into concrete action plans. This makes it difficult for users to obtain concrete, practical action plans tailored to their own situations and goals. Furthermore, conventional systems have limited ways for users to efficiently utilize the teachings of selected authors or great figures. Therefore, an objective of the present invention is to provide a system that supports users in effectively applying self-improvement teachings to real life.
[0377] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0378] In this invention, the server includes: an input means for inputting information about a situation and a goal; a selection means for selecting a desired author or famous person; an acquisition means for acquiring the information input and selected using the input means and the selection means; a preprocessing means for preprocessing the information acquired by the acquisition means and performing normalization and semantic analysis; a generation means for generating a specific action plan based on a specific teaching based on the information preprocessed by the preprocessing means; a display means for displaying the action plan generated by the generation means; and a communication means for transmitting and receiving data between the acquisition means and the generation means via a communication protocol. This enables a user to easily acquire a specific and practical action plan suited to their situation and goal.
[0379] The "input means" is an interface for the user to input information about the situation and the goal.
[0380] The "selection means" is an interface that allows the user to select the desired author or great person.
[0381] The "acquisition means" is a means for acquiring information input and selected using the input means and selection means.
[0382] The "preprocessing means" is a means for preprocessing the information acquired by the acquisition means, and for performing normalization and semantic analysis.
[0383] The "generation means" is a means for generating a specific action plan based on a specific teaching, based on the information preprocessed by the preprocessing means.
[0384] The "display means" is a means for displaying the action plan generated by the generation means on the user's screen.
[0385] The "communication means" is a means by which the acquisition means and generation means send and receive data via a communication protocol.
[0386] A "generative AI model" is an artificial intelligence model used in the generation means to propose specific action plans based on the user's situation and goals.
[0387] A "prompt sentence" is a sentence input into a generative AI model that contains instructions for generating a specific action plan based on the user's situation and goals.
[0388] The present invention is a system for enabling users to specifically apply self-development teachings to real life. This system is implemented by combining the following means and methods.
[0389] First, the user enters information about their situation and goals into a form on the device. For example, they might say, "My current job is busy and I'm feeling stressed. I'd like to know how to manage stress." The device provides the input form using HTML and JavaScript.
[0390] Next, the user can select the desired author or great person using the drop-down menus or search function in the form. For example, they can select "Author A." This selection function is implemented using the JavaScript library React.
[0391] The terminal generates JSON format data to send the entered information and information on the selected authors and famous people to the server, and sends it using the HTTPS protocol.
[0392] The server receives data from the device using the Python framework Flask. The received data includes information about the user's situation, goals, and selected authors and famous people. The server normalizes and semantically analyzes the data using natural language processing libraries such as NLTK and SpaCy, thereby preprocessing the retrieved information.
[0393] The server then uses a generative AI model to generate a specific action plan based on the preprocessed data and reflects the teachings of the author or great person selected by the user. The generative AI model uses OpenAI's GPT-4. The AI model generates an action plan by inputting a prompt sentence. An example of the prompt sentence is as follows:
[0394] "The user is currently stressed due to a busy job and is looking for ways to manage stress. The user would like to hear from Author A about stress management methods. What action plan can you suggest?"
[0395] The server then sends the generated action plan and detailed implementation instructions to the device, again using the HTTPS protocol for communication.
[0396] The device displays the action plan sent from the server on the user's screen. The UI is displayed using the React library and CSS, providing information in a format that is easy for the user to view.
[0397] As a specific example, if a user is looking for "ways to reduce work stress" and enters advice based on the teachings of "Author A," the system will generate a specific action plan, such as "meditate for 10 minutes every morning" or "take two short breaks during the day," and display it on the device.
[0398] The system provides users with a concrete and practical action plan for effectively applying self-improvement teachings to real life.
[0399] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0400] Step 1:
[0401] Users enter information about their situation and goals into a form on their device. The input form is built using HTML and JavaScript. For example, a user might enter, "I'm feeling stressed because my current job is so busy. I'd like to know how to manage stress." The entered information is converted into JSON format data and prepared for the next step.
[0402] Input: Information about the situation and goals that the user enters into an HTML form
[0403] Output: User information data in JSON format
[0404] Step 2:
[0405] Users can select the desired author or famous person using drop-down menus or a search function within the form. This selection function, built using React, allows users to select, for example, "Author A." The selected data is also converted to JSON format.
[0406] Input: Information about the author or person selected by the user
[0407] Output: Selection data in JSON format
[0408] Step 3:
[0409] The terminal acquires the information entered and selected by the user, compiles it into JSON format data, and sends the JSON data via the HTTPS protocol to the server.
[0410] Input: User information data and selection data
[0411] Output: All data sent to the server in JSON format
[0412] Step 4:
[0413] The server receives data sent from the device using Python's Flask, including information about the user's status, goals, and selected authors and famous people, and prepares the data for the next step.
[0414] Input: All data received from the terminal in JSON format
[0415] Output: Received data (raw)
[0416] Step 5:
[0417] The server preprocesses the received data, which includes normalizing and semantic analysis. It uses Python's NLTK and SpaCy libraries to parse the user input and convert it into the required format.
[0418] Input: Raw incoming data
[0419] Output: Preprocessed data
[0420] Step 6:
[0421] The server uses a generative AI model (OpenAI's GPT-4) to generate an action plan based on the preprocessed data, reflecting the teachings of the author or great person selected by the user. For example, the prompt sentence "The user is currently feeling stressed due to a busy job and is looking for ways to manage stress. The user would like to learn from Author A about stress management methods. What kind of action plan can you suggest?" is input into the AI model, and a practical action plan is generated.
[0422] Input: preprocessed data, prompt statement
[0423] Output: Generated action plan
[0424] Step 7:
[0425] The server converts the generated action plan back into JSON format and transmits it using the HTTPS protocol to send it to the terminal.
[0426] Input: Generated Action Plan
[0427] Output: Action plan in JSON format sent to the device
[0428] Step 8:
[0429] The device then displays the received action plan on the user's screen, using the React library and CSS to display the action plan and detailed instructions on how to implement it in a user-friendly UI.
[0430] Input: Action plan in JSON format received from the server
[0431] Output: Action plan displayed on the user's screen
[0432] This system allows users to easily obtain specific and practical action plans based on their own situations and goals, and apply them to their real lives.
[0433] (Application example 1)
[0434] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0435] Today's users seek a variety of information for self-development and self-improvement, but often struggle with how to apply that information to their real lives. Many users also want to feel confident in a particular fashion style, but often don't know what specific actions to take. Another issue is the lack of personalized advice and suggestions to improve their shopping experience in physical stores.
[0436] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0437] In this invention, the server includes an input means for inputting information about a situation and a goal, a selection means for selecting a desired author or great person, a generation means for generating a specific action plan based on specific teachings based on the information acquired by the acquisition means, and a suggestion means for displaying fashion suggestions in a physical store based on the teachings of the selected author or great person in accordance with the user's specific challenges and areas for improvement. This enables the user to specifically and effectively apply the teachings of self-improvement to their real life, provides a specific action plan for gaining confidence in a specific fashion style, and significantly improves the shopping experience in a physical store.
[0438] "Situation and goal information" refers to data about the challenges the user is currently facing and the goals they want to achieve.
[0439] "Input means" refers to an interface or form that allows a user to input a situation or goal into a terminal.
[0440] The "selection means" refers to an interface or menu that allows the user to select the desired author, famous person, or fashion icon.
[0441] "Acquisition means" refers to a function or system for collecting information entered and selected by a user.
[0442] "Generating means" refers to functions or algorithms that, based on the acquired information, create specific action plans or fashion suggestions based on specific teachings or advice.
[0443] "Display means" refers to a display or screen that visually presents the generated action plan or proposal to the user.
[0444] "Proposal means" refers to functions and systems for displaying specific advice and fashion suggestions in physical stores that are tailored to the user's situation and goals.
[0445] "Implementation tools" are support functions and guides for implementing the proposed action plan based on the advice of the fashion style icons and stylists selected by the user.
[0446] The present invention is a system for enabling users to apply self-improvement teachings and fashion improvement advice to their real lives in a concrete manner. This system is realized by combining a plurality of means and methods.
[0447] 1. Enter your user information
[0448] The user inputs information about his / her situation and goals using the input means of the terminal. For example, the user inputs a goal such as "I want to feel more confident in casual styles."
[0449] 2. Choose your favorite author, famous person, or fashion icon
[0450] The user selects the desired author, famous person, or fashion icon using the selection means of the terminal. For example, the user can select "Author A" or "Fashion Stylist B."
[0451] 3. Transmission of User Information
[0452] The device sends the entered information and information about the selected author, famous person, or fashion icon to the server. The sent data is encoded in JSON format.
[0453] 4. Data Reception and Preprocessing
[0454] The server receives the data sent from the device. The received data includes information about the user's situation, goals, and selected authors, famous people, and fashion icons. The server preprocesses the data, normalizes it, and performs semantic analysis. This is done using Python and natural language processing toolkits (e.g., NLTK, spaCy).
[0455] 5. AI model generation and suggestions
[0456] The server's generative AI model (e.g., GPT-4) uses the preprocessed data to generate specific action plans and fashion suggestions that reflect the teachings of the user's chosen authors, famous people, or fashion icons. TensorFlow is often used for this. For example, it may suggest stress management methods based on the teachings of "Author A" or specific outfits based on the advice of "Fashion Stylist B."
[0457] 6. Submitting and Viewing Action Plans and Proposals
[0458] The server sends the generated action plan, fashion suggestions, and detailed practice methods to the device, which then displays them on the user's screen, allowing the user to refer to them and apply them to their daily lives or enjoy shopping at a physical store.
[0459] For example, if a user sets a goal of "I want to be more confident in casual style" and selects "Fashion Stylist B," the server will generate a fashion suggestion such as "Pair a simple white T-shirt with denim pants and put on a leather jacket on top," and send it to the device. This allows the user to learn specific coordination methods and try out a similar style in a physical store.
[0460] An example of a prompt is as follows:
[0461] "I want to feel more confident in casual style."
[0462] "Fashion Stylist B"
[0463] The system allows users to effectively incorporate self-improvement teachings and fashion improvement advice into their real lives.
[0464] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0465] Step 1:
[0466] The user inputs information about the situation and goals using the input means of the device. The input data may include content such as "I want to feel more confident in casual styles." This becomes the input data and is passed to the next processing step.
[0467] Step 2:
[0468] The user uses the device's selection means to select the desired author, famous person, fashion icon, or stylist. For example, "Fashion Stylist B" is selected. The entered information is sent to the server along with the data of the selected person. This becomes the input data and is passed to the next processing step.
[0469] Step 3:
[0470] The device collects the information entered in steps 1 and 2 and sends it to the server. The server receives this data and preprocesses it. Specific operations in preprocessing include data normalization and semantic analysis. Normalization standardizes the data format, and semantic analysis extracts the meaning of the data using a natural language processing toolkit (e.g., NLTK, spaCy). This clarifies the user's intent and the characteristics of the selected author, famous person, or fashion icon.
[0471] Step 4:
[0472] The server's generative AI model (e.g., GPT-4) generates specific action plans and fashion suggestions based on the preprocessed data. The generated content is based on the user's situation, goals, and the teachings of the selected person. For example, a fashion suggestion might be, "To feel confident in casual style, combine a simple white T-shirt with denim pants and top it off with a leather jacket." This is the output data for the input data.
[0473] Step 5:
[0474] The server then sends the generated action plan and fashion suggestions to the device. The data sent includes detailed practical instructions, showing the user how to make specific improvements and take action. For example, the server may provide specific instructions such as, "Choose a simple, plain white T-shirt and straight or skinny denim pants. For a stylish look, add a black leather jacket."
[0475] Step 6:
[0476] The device displays the action plans and suggestions on the user interface, allowing users to apply them to their own lives and use them when shopping in physical stores. This allows users to incorporate self-improvement advice and fashion improvement advice into their lives.
[0477] Through each of the above steps, users can obtain specific action plans and suggestions for self-improvement and fashion improvement.
[0478] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0479] The present invention is a system that allows users to concretely apply self-development teachings to real life, and by combining an emotion engine, it enables adjustment of action plans based on the user's emotions. This system is implemented by combining the following means and methods.
[0480] 1. Enter your user information
[0481] The user enters information about their situation and goals into a form on the terminal. For example, they might enter, "My current job is busy and I'm feeling stressed. I'd like to know how to manage stress."
[0482] 2. Select the author or person you want to read
[0483] The user can use the drop-down menus and search functions in the form to select the desired author or person, for example, "Author A."
[0484] 3. User Emotion Recognition
[0485] The device is equipped with an emotion engine that recognizes the user's emotions. The emotion engine uses voice analysis and facial recognition technology to identify the user's emotions. For example, it can detect stress or anxiety from the user's tone of voice and facial expressions when typing.
[0486] 4. Sending user information and emotions
[0487] The terminal transmits the input information (situation and goal), information on the selected author or famous person, and the recognized user's emotion information to the server.
[0488] 5. Receiving and Preprocessing Input Data
[0489] The server receives the data sent from the terminal, which includes the user's situation, goal, information about the selected author or famous person, and emotional information.
[0490] The server preprocesses the data, normalizes the retrieved information, and performs semantic analysis, for example, correcting typos and extracting important keywords.
[0491] 6. Generate AI models and create action plans
[0492] The server's generative AI model generates a specific action plan based on the preprocessed data, reflecting the teachings of a specific author or great figure. The model also takes into account the user's emotional state. For example, based on the teachings of "Author A," the model suggests "10 minutes of meditation every morning." However, if the user is feeling particularly stressed, the model can adjust the plan by incorporating moderate exercise in addition to meditation.
[0493] 7. Submit and view your action plan
[0494] The server sends the generated action plan and detailed implementation instructions to the terminal.
[0495] The device will then display the action plan and practice method on the user's screen. For example, it will introduce it as "a meditation method based on the teachings of Author A."
[0496] For example, suppose a user is looking for "ways to reduce work stress" and is seeking advice based on the teachings of "Author A." After the user enters and selects this information and the emotion engine recognizes that the user is experiencing high levels of stress, the system creates an action plan based on the teachings of "Author A," including "walking 30 minutes a day" in addition to meditation.
[0497] In this way, the system of the present invention takes into account the user's emotional state and helps them effectively apply self-improvement teachings to real life, thereby enabling them to take more concrete and effective steps towards personal growth and goal achievement.
[0498] The processing flow will be explained below.
[0499] Step 1:
[0500] The user enters information about their situation and goals into a form on the terminal. For example, they might enter, "My current job is busy and I'm feeling stressed. I'd like to know how to manage stress."
[0501] Step 2:
[0502] The user can use the drop-down menus and search functions in the form to select the desired author or person, for example, "Author A."
[0503] Step 3:
[0504] The device uses an emotion recognition engine to analyze the user's voice and facial expressions while they are inputting information, and recognizes the user's emotions. For example, it can identify from voice analysis that the user is feeling high levels of stress.
[0505] Step 4:
[0506] The terminal transmits the input information (situation and goal), information on the selected author or famous person, and recognized emotion information to the server.
[0507] Step 5:
[0508] The server receives the data sent from the terminal, which includes the user's situation, goal, information about the selected author or famous person, and emotional information.
[0509] Step 6:
[0510] The server pre-processes the data it receives, normalizing it and performing semantic analysis, such as correcting typos and extracting important keywords.
[0511] Step 7:
[0512] The server's generative AI model generates a specific action plan based on the preprocessed data, reflecting the teachings of a specific author or great figure. The model also takes into account the user's emotional state. For example, based on the teachings of "Author A," the model might suggest "10 minutes of meditation every morning," but if the user is feeling particularly stressed, the model might adjust the plan to include moderate exercise and relaxation techniques.
[0513] Step 8:
[0514] The server sends the generated action plan and detailed implementation instructions to the terminal.
[0515] Step 9:
[0516] The device displays the action plan and how to put it into practice on the user's screen. For example, it might introduce it as a "meditation method based on the teachings of Author A" and suggest "walking 30 minutes a day."
[0517] In this way, the system of the present invention takes into account the user's emotional state and helps them effectively apply self-improvement teachings to their real life, thereby enabling them to take more concrete and effective steps towards self-improvement and goal achievement.
[0518] Example 2
[0519] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0520] Conventional self-improvement systems have difficulty providing specific action plans that take into account the user's emotional state. Furthermore, while it is necessary to appropriately integrate multiple information input and selection methods to provide users with accurate action plans, the technological means to achieve this have been lacking. As a result, users are unable to effectively apply the self-improvement teachings to their real lives, and the support for goal achievement and personal growth is insufficient.
[0521] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a preprocessing means, a generation means using a generative AI model, and an emotion recognition means. This makes it possible to generate a specific action plan that takes into account the user's emotional state based on information about the user's situation and goals. The generated action plan is adjusted according to the user's emotions, thereby enabling effective support for achieving real-life goals and self-improvement.
[0522] The "input means" is an interface that allows the user to input information about his / her own situation and goals into the terminal.
[0523] The "selection means" is an interface that allows the user to select the desired author or great person.
[0524] The "acquisition means" is a means for collecting information input and selected using the input means and selection means.
[0525] The "emotion recognition means" is a means for analyzing and recognizing the user's emotions, and uses voice analysis and face recognition technology.
[0526] The "transmission means" is a means for transmitting the information acquired and recognized by the acquisition means and emotion recognition means to the server.
[0527] The "preprocessing means" is a means for normalizing the information input to the server and performing preprocessing such as correcting typos and extracting important keywords.
[0528] "Generative means" refers to a means for generating a specific action plan that reflects specific teachings using a generative AI model based on preprocessed information.
[0529] The "display means" is a means for displaying the generated action plan and detailed implementation methods thereof on the user's screen.
[0530] A "generative AI model" is an artificial intelligence model that generates an action plan that reflects specific teachings based on input information.
[0531] A "prompt" is a sentence containing instructions or information to be input into a generative AI model.
[0532] The present invention is a system that allows users to apply self-development teachings to real life. This system combines an emotion engine to enable adjustment of action plans based on the user's emotions. Each element and its specific processing will be described in detail below.
[0533] 1. Input Method
[0534] Users enter information about their situation and goals using an on-device form built with HTML and JavaScript, such as, "I'm feeling stressed and overwhelmed at work right now. I'd like to know how to manage stress."
[0535] 2. Selection Method
[0536] Users select the desired author or great person using drop-down menus within the form or a search function that uses JavaScript and AJAX to narrow down the results in real time. For example, select "Author A."
[0537] 3. Emotion recognition means
[0538] The device is equipped with an emotion engine to recognize the user's emotions. It uses voice analysis tools (e.g., Amazon Polly) and facial recognition technology (Microsoft Azure Face API). It analyzes the tone of voice and facial expressions when the user enters information to identify stress or anxiety.
[0539] 4. Transmission Method
[0540] The device sends the acquired user information (situation and goal), information on the selected author or famous person, and the recognized emotion information to the server. Communication is performed using the HTTPS protocol.
[0541] 5. Pretreatment Methods
[0542] The server receives the data sent from the device, including the user's situation, goals, information about the selected author or famous person, and emotional information.
[0543] The server uses Python and Node.js to perform preprocessing of the data, specifically correcting typos in the text data, extracting important keywords, and normalizing the data.
[0544] 6. Generation means
[0545] Based on the preprocessed data, the server uses a generative AI model (such as OpenAI GPT-3) to generate a specific action plan that reflects the specific teachings. This generation process also takes into account the weighting of each data element and the user's emotional information. For example, based on the teachings of "Author A," the server may suggest "10 minutes of meditation every morning," but if the user is feeling high stress, it may also recommend "30 minutes of walking per day" in addition to meditation.
[0546] 7. Display means
[0547] The server then sends the generated action plan and detailed implementation instructions to the device, and this communication is also carried out using the HTTPS protocol.
[0548] The device then displays the received action plan and detailed practice instructions on the user's screen. This display uses HTML, CSS, and JavaScript. For example, it displays a "meditation method based on the teachings of Author A" along with specific steps.
[0549] Specific examples
[0550] For example, suppose a user is searching for "ways to reduce work stress" and seeks advice based on the teachings of "Author A." The user enters the information, and the emotion engine recognizes that the user is experiencing high levels of stress. In this case, the system generates an action plan based on the teachings of "Author A," including "walking 30 minutes a day" in addition to meditation.
[0551] Examples of prompt statements
[0552] The user is searching for "ways to reduce work stress" and is seeking advice based on the teachings of "Author A." Based on the user's emotional information, it appears that the user is experiencing high levels of stress. Please generate an action plan that takes this information into account.
[0553] The system effectively applies self-improvement teachings to real life situations while taking into account the user's emotional state, allowing the user to take concrete and effective steps towards self-improvement and goal achievement.
[0554] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0555] Step 1:
[0556] The user inputs information about the situation and goals into a form on the terminal. An example of input information is text such as "I'm currently busy at work and feeling stressed. I'd like to know how to manage stress." This provides information to the input means. Input: text data about the user's situation and goals, Output: input information.
[0557] Step 2:
[0558] The user selects the desired author or great person using the dropdown menu or search function in the form. This function uses JavaScript and AJAX to retrieve information about the selected author or great person in real time. Input: Author or great person selected by the user, Output: Information about the selected author or great person.
[0559] Step 3:
[0560] The device's emotion recognition means analyzes the user's emotions. It uses voice analysis tools (e.g., Amazon Polly) and facial recognition technology (Microsoft Azure Face API) to identify the user's emotions from the input text, voice, and facial expressions. For example, it detects if the user is feeling stressed. Input: User's voice, facial expressions, and text data. Output: Recognized emotional information.
[0561] Step 4:
[0562] The terminal transmits the information acquired by the input means and selection means, as well as the emotion information acquired by the emotion recognition means, to the server. This communication is performed using the HTTPS protocol, ensuring secure data transfer. Input: Acquired user information, information on selected authors and famous people, recognized emotion information. Output: Data transmitted to the server.
[0563] Step 5:
[0564] The server receives the transmitted information, which includes the user's situation, goals, information on selected authors and famous people, and emotional information. The server normalizes and semantically analyzes the received data using preprocessing means, such as correcting typos in the text and extracting important keywords. Input: transmitted data, Output: preprocessed data.
[0565] Step 6:
[0566] The server generates a specific action plan based on the preprocessed data using a generative AI model (e.g., OpenAI GPT-3). This also takes into account the teachings of specific authors and recognized emotional information. For example, based on the teachings of "Author A," it suggests "10 minutes of meditation every morning," but if the user feels high stress, it also suggests "30 minutes of walking per day." Input: Preprocessed data, Output: Generated action plan.
[0567] Step 7:
[0568] The server sends the generated action plan and detailed instructions on how to implement it to the device. Again, this communication is performed using the HTTPS protocol. Input: Generated action plan, Output: Action plan sent to the device.
[0569] Step 8:
[0570] The device displays the received action plan and detailed implementation instructions on the user's screen. This display uses HTML, CSS, and JavaScript, providing an interface that is easy for the user to understand. For example, specific operating procedures could be shown as "meditation methods based on the teachings of author A." Input: Action plan received from the server, Output: Action plan displayed on the user's screen.
[0571] In this way, the system takes into account the user's emotional state and helps them effectively apply self-improvement teachings to their real life, ultimately enabling them to take concrete and effective steps towards personal growth and goal achievement.
[0572] (Application example 2)
[0573] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0574] Conventional self-improvement systems only provide static action plans without considering the user's emotional state, which limits their practicality and effectiveness. Furthermore, there is a lack of systems aimed at improving the user experience in brick-and-mortar stores, making it difficult to provide personalized action plans based on the user's emotions.
[0575] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0576] In this invention, the server includes an input means for inputting information about a situation and a goal, a selection means for selecting a desired celebrity or great person, an acquisition means for acquiring the information input and selected using the input means and the selection means, a recognition means for recognizing the user's emotions, a generation means for generating a specific action plan based on a specific teaching based on the information acquired by the acquisition means and the recognition means, and a display means for displaying the generated action plan. This makes it possible to provide a personalized action plan that takes into account the user's emotional state even in a physical store.
[0577] "Information about the situation and goals" is data about the situation the user is currently facing and the goals the user wants to achieve.
[0578] "Input means" refers to a device or interface through which a user inputs information about the situation and goals.
[0579] A "selection means" is a device or interface that allows a user to select a desired famous person or great person.
[0580] An "acquisition means" is a device or system that collects information entered and selected using input means and selection means.
[0581] The "recognition means" is a device including an emotion engine and a sensor for recognizing the user's emotions.
[0582] The "generating means" is a device or system that generates a specific action plan based on a specific teaching, based on the information collected by the acquiring means and the recognizing means.
[0583] The "display means" is a display or output device for presenting the generated action plan to the user.
[0584] This invention is a system that recognizes a user's emotional state and provides a self-improvement action plan based on that state. The system involves inputting information about a situation and a goal, selecting a desired celebrity or great person, recognizing the user's emotions, generating an action plan based on the collected information, and displaying the action plan.
[0585] System configuration
[0586] Input methods:
[0587] The input means in this invention is implemented by a terminal such as a smartphone, tablet, etc. A user uses these devices to input information about the current situation and the goals they want to achieve.
[0588] Example: "I want to be more motivated at work."
[0589] Selection method:
[0590] The user selects the teachings of the desired celebrity or great person using the selection means, which may include a drop-down menu or a search function.
[0591] Example: Select "Celebrity A".
[0592] Recognition means:
[0593] The system uses an emotion engine to recognize user emotions. The emotion engine uses technologies such as FaceAPI and Google Cloud Speech-to-Text. These technologies analyze the user's facial expressions and tone of voice to recognize emotions in real time.
[0594] Example: Detecting stress levels from the user's tone of voice.
[0595] Generation means:
[0596] Based on the information collected by the acquisition and recognition means, the server generates a specific action plan based on specific teachings, using an AI model (e.g., OpenAI GPT-4) to adjust the plan, taking into account the user's emotional state.
[0597] Example: "Based on the teachings of celebrity A, I suggest 10 minutes of meditation every morning, but if you are under high stress, I suggest moderate exercise in addition to meditation."
[0598] Display means:
[0599] The generated action plan is displayed on the user's smartphone, tablet, or smart glasses, allowing the user to confirm specific actions at the appropriate time.
[0600] Specific example explanation
[0601] Suppose a user is in a physical store looking for "ways to reduce work stress." The user enters their situation and goals into a smartphone app and selects "Celebrity B." The emotion engine recognizes that the user is experiencing high levels of stress. Based on this information, the server uses a generative AI model to generate an action plan, suggesting "30 minutes of walking and 15 minutes of relaxation sessions per day, based on the teachings of Celebrity B." This plan is then displayed on the user's smartphone.
[0602] Example prompt for generative AI model:
[0603] "User information: 'Stress reduction', 'Busy at work', 'Very high stress'. Preferred celebrity: 'Celebrity B'. Based on the teachings of Celebrity B and taking into account the user's current state and emotions, what would you suggest to reduce stress?"
[0604] In this way, users can receive specific and timely action plans tailored to them.
[0605] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0606] Step 1:
[0607] The device inputs information about the user's situation and goals. The input information includes the user's current situation and the goals they want to achieve. When this information is input to the device, the device stores it as internal data (input: information about the user's situation and goals, output: information stored in the internal database).
[0608] Step 2:
[0609] The device allows the user to select the celebrity or great person of their choice. The user can select the celebrity or great person of their choice using a drop-down menu or search function. This selection information is also input into the device and saved as internal data (input: selection of celebrity or great person, output: selection information saved in the internal database).
[0610] Step 3:
[0611] The device sends the user's input and selection information acquired to an emotion engine for emotion recognition. The device's sensors or camera are used to capture the user's facial expressions and tone of voice, which are then analyzed by the emotion engine (input: user's input and selection information, output: emotion data as the analysis result).
[0612] Step 4:
[0613] The device sends the user's emotion data analyzed by the emotion engine to the server. The server receives the emotion data, input information, and selection information and integrates them into a single dataset (input: emotion data, input information, selection information; output: integrated dataset).
[0614] Step 5:
[0615] The server preprocesses the integrated dataset. The preprocessing step involves normalizing the data, correcting typos, and performing semantic analysis to extract important keywords (input: integrated dataset, output: normalized and semantically analyzed data).
[0616] Step 6:
[0617] The server uses a generative AI model (e.g., OpenAI GPT-4) to generate a specific action plan based on the preprocessed data, paying particular attention to the user's emotional state and considering an appropriate action plan (input: normalized and semantically analyzed data, output: specific action plan).
[0618] Step 7:
[0619] The server sends the generated action plan to the terminal, which then displays the action plan. The display allows the user to view the action plan and its detailed implementation method (input: specific action plan, output: action plan displayed on the terminal).
[0620] Step 8:
[0621] After the user executes the action plan, the device performs emotion recognition again and sends the results to the server. The server then checks the user's progress based on the feedback information and provides additional advice accordingly (input: user's execution results and re-emotional data, output: progress check and additional advice).
[0622] This processing step allows users to access a personal development plan tailored to their situation and emotions, enhancing their in-store experience.
[0623] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0624] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0625] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[0626] [Third embodiment]
[0627] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[0628] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[0629] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0630] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[0631] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0632] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0633] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0634] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0635] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0636] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0637] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0638] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[0639] The present invention is a system for enabling users to specifically apply self-development teachings to real life. This system is implemented by combining the following means and methods.
[0640] 1. Enter your user information
[0641] The user enters information about their situation and goals into a form on the terminal. For example, the user can enter, "I'm feeling stressed because my current job is busy. I'd like to know how to manage stress."
[0642] 2. Select the author or person you want to read
[0643] Users can use the drop-down menus and search functions in the form to select the desired author or figure. For example, a user can select "Author A."
[0644] 3. Transmission of User Information
[0645] The terminal transmits the input information and information on the selected author or famous person to the server.
[0646] 4. Receiving and Preprocessing Input Data
[0647] The server receives the data sent from the device, including the user's status, goals, and information about selected authors and famous people.
[0648] The server pre-processes the data, normalizes the retrieved information, and performs semantic analysis.
[0649] 5. Generate AI models and create action plans
[0650] Based on the pre-processed data, the server's generative AI model generates a specific action plan that reflects the teachings of the author or great person selected by the user.
[0651] For example, a stress management method based on the teachings of "Author A" might suggest 10 minutes of meditation each morning.
[0652] 6. Submit and view your action plan
[0653] The server sends the generated action plan and detailed implementation instructions to the terminal.
[0654] The device will display the action plan on the user's screen, allowing the user to refer to it and apply it to their daily lives.
[0655] For example, suppose a user is searching for "ways to reduce work stress" and is seeking advice based on the teachings of "Author A." By inputting and selecting this information, the system creates a specific action plan based on the teachings of "Author A," providing practical advice such as "meditate for 10 minutes every morning" and "take two short breaks during the day."
[0656] In this way, the system of the present invention helps users effectively apply self-improvement teachings to real-life situations, enabling users to take concrete steps toward personal growth and goal achievement.
[0657] The processing flow will be explained below.
[0658] Step 1:
[0659] The user enters information about their situation and goals into a form on the device. For example, they might enter, "My current job is busy and I'm feeling stressed. I'd like to know how to manage stress."
[0660] Step 2:
[0661] The user selects the desired author or famous person using the drop-down menu or search function in the form, for example, "Author A."
[0662] Step 3:
[0663] The terminal sends the entered information (situation and goal) and the information on the selected author or great person to the server.
[0664] Step 4:
[0665] The server receives the data sent from the device, which includes information about the user's situation, goals, and selected authors and famous people.
[0666] Step 5:
[0667] The server pre-processes the data it receives, normalizing it and performing semantic analysis, such as correcting typos and extracting important keywords.
[0668] Step 6:
[0669] The server's generative AI model generates a specific action plan based on the preprocessed data, reflecting the teachings of a specific author or great figure. For example, based on the teachings of "Author A," it suggests "10 minutes of meditation every morning."
[0670] Step 7:
[0671] The server sends the generated action plan and detailed implementation instructions to the terminal.
[0672] Step 8:
[0673] The device will then display the action plan and practice method on the user's screen. For example, it will introduce it as "a meditation method based on the teachings of Author A."
[0674] In this way, through the processing steps, the user can obtain an action plan for concretely applying the teachings of self-development to real life.
[0675] Example 1
[0676] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0677] In modern society, applying self-improvement teachings to real life is important for many people. However, self-improvement teachings often contain abstract concepts that are difficult to translate into concrete action plans. This makes it difficult for users to obtain concrete, practical action plans tailored to their own situations and goals. Furthermore, conventional systems have limited ways for users to efficiently utilize the teachings of selected authors or great figures. Therefore, an objective of the present invention is to provide a system that supports users in effectively applying self-improvement teachings to real life.
[0678] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0679] In this invention, the server includes: an input means for inputting information about a situation and a goal; a selection means for selecting a desired author or famous person; an acquisition means for acquiring the information input and selected using the input means and the selection means; a preprocessing means for preprocessing the information acquired by the acquisition means and performing normalization and semantic analysis; a generation means for generating a specific action plan based on a specific teaching based on the information preprocessed by the preprocessing means; a display means for displaying the action plan generated by the generation means; and a communication means for transmitting and receiving data between the acquisition means and the generation means via a communication protocol. This enables a user to easily acquire a specific and practical action plan suited to their situation and goal.
[0680] The "input means" is an interface for the user to input information about the situation and the goal.
[0681] The "selection means" is an interface that allows the user to select the desired author or great person.
[0682] The "acquisition means" is a means for acquiring information input and selected using the input means and selection means.
[0683] The "preprocessing means" is a means for preprocessing the information acquired by the acquisition means, and for performing normalization and semantic analysis.
[0684] The "generation means" is a means for generating a specific action plan based on a specific teaching, based on the information preprocessed by the preprocessing means.
[0685] The "display means" is a means for displaying the action plan generated by the generation means on the user's screen.
[0686] The "communication means" is a means by which the acquisition means and generation means send and receive data via a communication protocol.
[0687] A "generative AI model" is an artificial intelligence model used in the generation means to propose specific action plans based on the user's situation and goals.
[0688] A "prompt sentence" is a sentence input into a generative AI model that contains instructions for generating a specific action plan based on the user's situation and goals.
[0689] The present invention is a system for enabling users to specifically apply self-development teachings to real life. This system is implemented by combining the following means and methods.
[0690] First, the user enters information about their situation and goals into a form on the device. For example, they might say, "My current job is busy and I'm feeling stressed. I'd like to know how to manage stress." The device provides the input form using HTML and JavaScript.
[0691] Next, the user can select the desired author or great person using the drop-down menus or search function in the form. For example, they can select "Author A." This selection function is implemented using the JavaScript library React.
[0692] The terminal generates JSON format data to send the entered information and information on the selected authors and famous people to the server, and sends it using the HTTPS protocol.
[0693] The server receives data from the device using the Python framework Flask. The received data includes information about the user's situation, goals, and selected authors and famous people. The server normalizes and semantically analyzes the data using natural language processing libraries such as NLTK and SpaCy, thereby preprocessing the retrieved information.
[0694] The server then uses a generative AI model to generate a specific action plan based on the preprocessed data and reflects the teachings of the author or great person selected by the user. The generative AI model uses OpenAI's GPT-4. The AI model generates an action plan by inputting a prompt sentence. An example of the prompt sentence is as follows:
[0695] "The user is currently stressed due to a busy job and is looking for ways to manage stress. The user would like to hear from Author A about stress management methods. What action plan can you suggest?"
[0696] The server then sends the generated action plan and detailed implementation instructions to the device, again using the HTTPS protocol for communication.
[0697] The device displays the action plan sent from the server on the user's screen. The UI is displayed using the React library and CSS, providing information in a format that is easy for the user to view.
[0698] As a specific example, if a user is looking for "ways to reduce work stress" and enters advice based on the teachings of "Author A," the system will generate a specific action plan, such as "meditate for 10 minutes every morning" or "take two short breaks during the day," and display it on the device.
[0699] The system provides users with a concrete and practical action plan for effectively applying self-improvement teachings to real life.
[0700] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0701] Step 1:
[0702] Users enter information about their situation and goals into a form on their device. The input form is built using HTML and JavaScript. For example, a user might enter, "I'm feeling stressed because my current job is so busy. I'd like to know how to manage stress." The entered information is converted into JSON format data and prepared for the next step.
[0703] Input: Information about the situation and goals that the user enters into an HTML form
[0704] Output: User information data in JSON format
[0705] Step 2:
[0706] Users can select the desired author or famous person using drop-down menus or a search function within the form. This selection function, built using React, allows users to select, for example, "Author A." The selected data is also converted to JSON format.
[0707] Input: Information about the author or person selected by the user
[0708] Output: Selection data in JSON format
[0709] Step 3:
[0710] The terminal acquires the information entered and selected by the user, compiles it into JSON format data, and sends the JSON data via the HTTPS protocol to the server.
[0711] Input: User information data and selection data
[0712] Output: All data sent to the server in JSON format
[0713] Step 4:
[0714] The server receives data sent from the device using Python's Flask, including information about the user's status, goals, and selected authors and famous people, and prepares the data for the next step.
[0715] Input: All data received from the terminal in JSON format
[0716] Output: Received data (raw)
[0717] Step 5:
[0718] The server preprocesses the received data, which includes normalizing and semantic analysis. It uses Python's NLTK and SpaCy libraries to parse the user input and convert it into the required format.
[0719] Input: Raw incoming data
[0720] Output: Preprocessed data
[0721] Step 6:
[0722] The server uses a generative AI model (OpenAI's GPT-4) to generate an action plan based on the preprocessed data, reflecting the teachings of the author or great person selected by the user. For example, the prompt sentence "The user is currently feeling stressed due to a busy job and is looking for ways to manage stress. The user would like to learn from Author A about stress management methods. What kind of action plan can you suggest?" is input into the AI model, and a practical action plan is generated.
[0723] Input: preprocessed data, prompt statement
[0724] Output: Generated action plan
[0725] Step 7:
[0726] The server converts the generated action plan back into JSON format and transmits it using the HTTPS protocol to send it to the terminal.
[0727] Input: Generated Action Plan
[0728] Output: Action plan in JSON format sent to the device
[0729] Step 8:
[0730] The device then displays the received action plan on the user's screen, using the React library and CSS to display the action plan and detailed instructions on how to implement it in a user-friendly UI.
[0731] Input: Action plan in JSON format received from the server
[0732] Output: Action plan displayed on the user's screen
[0733] This system allows users to easily obtain specific and practical action plans based on their own situations and goals, and apply them to their real lives.
[0734] (Application example 1)
[0735] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0736] Today's users seek a variety of information for self-development and self-improvement, but often struggle with how to apply that information to their real lives. Many users also want to feel confident in a particular fashion style, but often don't know what specific actions to take. Another issue is the lack of personalized advice and suggestions to improve their shopping experience in physical stores.
[0737] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0738] In this invention, the server includes an input means for inputting information about a situation and a goal, a selection means for selecting a desired author or great person, a generation means for generating a specific action plan based on specific teachings based on the information acquired by the acquisition means, and a suggestion means for displaying fashion suggestions in a physical store based on the teachings of the selected author or great person in accordance with the user's specific challenges and areas for improvement. This enables the user to specifically and effectively apply the teachings of self-improvement to their real life, provides a specific action plan for gaining confidence in a specific fashion style, and significantly improves the shopping experience in a physical store.
[0739] "Situation and goal information" refers to data about the challenges the user is currently facing and the goals they want to achieve.
[0740] "Input means" refers to an interface or form that allows a user to input a situation or goal into a terminal.
[0741] The "selection means" refers to an interface or menu that allows the user to select the desired author, famous person, or fashion icon.
[0742] "Acquisition means" refers to a function or system for collecting information entered and selected by a user.
[0743] "Generating means" refers to functions or algorithms that, based on the acquired information, create specific action plans or fashion suggestions based on specific teachings or advice.
[0744] "Display means" refers to a display or screen that visually presents the generated action plan or proposal to the user.
[0745] "Proposal means" refers to functions and systems for displaying specific advice and fashion suggestions in physical stores that are tailored to the user's situation and goals.
[0746] "Implementation tools" are support functions and guides for implementing the proposed action plan based on the advice of the fashion style icons and stylists selected by the user.
[0747] The present invention is a system for enabling users to apply self-improvement teachings and fashion improvement advice to their real lives in a concrete manner. This system is realized by combining a plurality of means and methods.
[0748] 1. Enter your user information
[0749] The user inputs information about his / her situation and goals using the input means of the terminal. For example, the user inputs a goal such as "I want to feel more confident in casual styles."
[0750] 2. Choose your favorite author, famous person, or fashion icon
[0751] The user selects the desired author, famous person, or fashion icon using the selection means of the terminal. For example, the user can select "Author A" or "Fashion Stylist B."
[0752] 3. Transmission of User Information
[0753] The device sends the entered information and information about the selected author, famous person, or fashion icon to the server. The sent data is encoded in JSON format.
[0754] 4. Data Reception and Preprocessing
[0755] The server receives the data sent from the device. The received data includes information about the user's situation, goals, and selected authors, famous people, and fashion icons. The server preprocesses the data, normalizes it, and performs semantic analysis. This is done using Python and natural language processing toolkits (e.g., NLTK, spaCy).
[0756] 5. AI model generation and suggestions
[0757] The server's generative AI model (e.g., GPT-4) uses the preprocessed data to generate specific action plans and fashion suggestions that reflect the teachings of the user's chosen authors, famous people, or fashion icons. TensorFlow is often used for this. For example, it may suggest stress management methods based on the teachings of "Author A" or specific outfits based on the advice of "Fashion Stylist B."
[0758] 6. Submitting and Viewing Action Plans and Proposals
[0759] The server sends the generated action plan, fashion suggestions, and detailed practice methods to the device, which then displays them on the user's screen, allowing the user to refer to them and apply them to their daily lives or enjoy shopping at a physical store.
[0760] For example, if a user sets a goal of "I want to be more confident in casual style" and selects "Fashion Stylist B," the server will generate a fashion suggestion such as "Pair a simple white T-shirt with denim pants and put on a leather jacket on top," and send it to the device. This allows the user to learn specific coordination methods and try out a similar style in a physical store.
[0761] An example of a prompt is as follows:
[0762] "I want to feel more confident in casual style."
[0763] "Fashion Stylist B"
[0764] The system allows users to effectively incorporate self-improvement teachings and fashion improvement advice into their real lives.
[0765] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0766] Step 1:
[0767] The user inputs information about the situation and goals using the input means of the device. The input data may include content such as "I want to feel more confident in casual styles." This becomes the input data and is passed to the next processing step.
[0768] Step 2:
[0769] The user uses the device's selection means to select the desired author, famous person, fashion icon, or stylist. For example, "Fashion Stylist B" is selected. The entered information is sent to the server along with the data of the selected person. This becomes the input data and is passed to the next processing step.
[0770] Step 3:
[0771] The device collects the information entered in steps 1 and 2 and sends it to the server. The server receives this data and preprocesses it. Specific operations in preprocessing include data normalization and semantic analysis. Normalization standardizes the data format, and semantic analysis extracts the meaning of the data using a natural language processing toolkit (e.g., NLTK, spaCy). This clarifies the user's intent and the characteristics of the selected author, famous person, or fashion icon.
[0772] Step 4:
[0773] The server's generative AI model (e.g., GPT-4) generates specific action plans and fashion suggestions based on the preprocessed data. The generated content is based on the user's situation, goals, and the teachings of the selected person. For example, a fashion suggestion might be, "To feel confident in casual style, combine a simple white T-shirt with denim pants and top it off with a leather jacket." This is the output data for the input data.
[0774] Step 5:
[0775] The server then sends the generated action plan and fashion suggestions to the device. The data sent includes detailed practical instructions, showing the user how to make specific improvements and take action. For example, the server may provide specific instructions such as, "Choose a simple, plain white T-shirt and straight or skinny denim pants. For a stylish look, add a black leather jacket."
[0776] Step 6:
[0777] The device displays the action plans and suggestions on the user interface, allowing users to apply them to their own lives and use them when shopping in physical stores. This allows users to incorporate self-improvement advice and fashion improvement advice into their lives.
[0778] Through each of the above steps, users can obtain specific action plans and suggestions for self-improvement and fashion improvement.
[0779] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0780] The present invention is a system that allows users to concretely apply self-development teachings to real life, and by combining an emotion engine, it enables adjustment of action plans based on the user's emotions. This system is implemented by combining the following means and methods.
[0781] 1. Enter your user information
[0782] The user enters information about their situation and goals into a form on the terminal. For example, they might enter, "My current job is busy and I'm feeling stressed. I'd like to know how to manage stress."
[0783] 2. Select the author or person you want to read
[0784] The user can use the drop-down menus and search functions in the form to select the desired author or person, for example, "Author A."
[0785] 3. User Emotion Recognition
[0786] The device is equipped with an emotion engine that recognizes the user's emotions. The emotion engine uses voice analysis and facial recognition technology to identify the user's emotions. For example, it can detect stress or anxiety from the user's tone of voice and facial expressions when typing.
[0787] 4. Sending user information and emotions
[0788] The terminal transmits the input information (situation and goal), information on the selected author or famous person, and the recognized user's emotion information to the server.
[0789] 5. Receiving and Preprocessing Input Data
[0790] The server receives the data sent from the terminal, which includes the user's situation, goal, information about the selected author or famous person, and emotional information.
[0791] The server preprocesses the data, normalizes the retrieved information, and performs semantic analysis, for example, correcting typos and extracting important keywords.
[0792] 6. Generate AI models and create action plans
[0793] The server's generative AI model generates a specific action plan based on the preprocessed data, reflecting the teachings of a specific author or great figure. The model also takes into account the user's emotional state. For example, based on the teachings of "Author A," the model suggests "10 minutes of meditation every morning." However, if the user is feeling particularly stressed, the model can adjust the plan by incorporating moderate exercise in addition to meditation.
[0794] 7. Submit and view your action plan
[0795] The server sends the generated action plan and detailed implementation instructions to the terminal.
[0796] The device will then display the action plan and practice method on the user's screen. For example, it will introduce it as "a meditation method based on the teachings of Author A."
[0797] For example, suppose a user is looking for "ways to reduce work stress" and is seeking advice based on the teachings of "Author A." After the user enters and selects this information and the emotion engine recognizes that the user is experiencing high levels of stress, the system creates an action plan based on the teachings of "Author A," including "walking 30 minutes a day" in addition to meditation.
[0798] In this way, the system of the present invention takes into account the user's emotional state and helps them effectively apply self-improvement teachings to real life, thereby enabling them to take more concrete and effective steps towards personal growth and goal achievement.
[0799] The processing flow will be explained below.
[0800] Step 1:
[0801] The user enters information about their situation and goals into a form on the terminal. For example, they might enter, "My current job is busy and I'm feeling stressed. I'd like to know how to manage stress."
[0802] Step 2:
[0803] The user can use the drop-down menus and search functions in the form to select the desired author or person, for example, "Author A."
[0804] Step 3:
[0805] The device uses an emotion recognition engine to analyze the user's voice and facial expressions while they are inputting information, and recognizes the user's emotions. For example, it can identify from voice analysis that the user is feeling high levels of stress.
[0806] Step 4:
[0807] The terminal transmits the input information (situation and goal), information on the selected author or famous person, and recognized emotion information to the server.
[0808] Step 5:
[0809] The server receives the data sent from the terminal, which includes the user's situation, goal, information about the selected author or famous person, and emotional information.
[0810] Step 6:
[0811] The server pre-processes the data it receives, normalizing it and performing semantic analysis, such as correcting typos and extracting important keywords.
[0812] Step 7:
[0813] The server's generative AI model generates a specific action plan based on the preprocessed data, reflecting the teachings of a specific author or great figure. The model also takes into account the user's emotional state. For example, based on the teachings of "Author A," the model might suggest "10 minutes of meditation every morning," but if the user is feeling particularly stressed, the model might adjust the plan to include moderate exercise and relaxation techniques.
[0814] Step 8:
[0815] The server sends the generated action plan and detailed implementation instructions to the terminal.
[0816] Step 9:
[0817] The device displays the action plan and how to put it into practice on the user's screen. For example, it might introduce it as a "meditation method based on the teachings of Author A" and suggest "walking 30 minutes a day."
[0818] In this way, the system of the present invention takes into account the user's emotional state and helps them effectively apply self-improvement teachings to their real life, thereby enabling them to take more concrete and effective steps towards self-improvement and goal achievement.
[0819] Example 2
[0820] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0821] Conventional self-improvement systems have difficulty providing specific action plans that take into account the user's emotional state. Furthermore, while it is necessary to appropriately integrate multiple information input and selection methods to provide users with accurate action plans, the technological means to achieve this have been lacking. As a result, users are unable to effectively apply the self-improvement teachings to their real lives, and the support for goal achievement and personal growth is insufficient.
[0822] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a preprocessing means, a generation means using a generative AI model, and an emotion recognition means. This makes it possible to generate a specific action plan that takes into account the user's emotional state based on information about the user's situation and goals. The generated action plan is adjusted according to the user's emotions, thereby enabling effective support for achieving real-life goals and self-improvement.
[0823] The "input means" is an interface that allows the user to input information about his / her own situation and goals into the terminal.
[0824] The "selection means" is an interface that allows the user to select the desired author or great person.
[0825] The "acquisition means" is a means for collecting information input and selected using the input means and selection means.
[0826] The "emotion recognition means" is a means for analyzing and recognizing the user's emotions, and uses voice analysis and face recognition technology.
[0827] The "transmission means" is a means for transmitting the information acquired and recognized by the acquisition means and emotion recognition means to the server.
[0828] The "preprocessing means" is a means for normalizing the information input to the server and performing preprocessing such as correcting typos and extracting important keywords.
[0829] "Generative means" refers to a means for generating a specific action plan that reflects specific teachings using a generative AI model based on preprocessed information.
[0830] The "display means" is a means for displaying the generated action plan and detailed implementation methods thereof on the user's screen.
[0831] A "generative AI model" is an artificial intelligence model that generates an action plan that reflects specific teachings based on input information.
[0832] A "prompt" is a sentence containing instructions or information to be input into a generative AI model.
[0833] The present invention is a system that allows users to apply self-development teachings to real life. This system combines an emotion engine to enable adjustment of action plans based on the user's emotions. Each element and its specific processing will be described in detail below.
[0834] 1. Input Method
[0835] Users enter information about their situation and goals using an on-device form built with HTML and JavaScript, such as, "I'm feeling stressed and overwhelmed at work right now. I'd like to know how to manage stress."
[0836] 2. Selection Method
[0837] Users select the desired author or great person using drop-down menus within the form or a search function that uses JavaScript and AJAX to narrow down the results in real time. For example, select "Author A."
[0838] 3. Emotion recognition means
[0839] The device is equipped with an emotion engine to recognize the user's emotions. It uses voice analysis tools (e.g., Amazon Polly) and facial recognition technology (Microsoft Azure Face API). It analyzes the tone of voice and facial expressions when the user enters information to identify stress or anxiety.
[0840] 4. Transmission Method
[0841] The device sends the acquired user information (situation and goal), information on the selected author or famous person, and the recognized emotion information to the server. Communication is performed using the HTTPS protocol.
[0842] 5. Pretreatment Methods
[0843] The server receives the data sent from the device, including the user's situation, goals, information about the selected author or famous person, and emotional information.
[0844] The server uses Python and Node.js to perform preprocessing of the data, specifically correcting typos in the text data, extracting important keywords, and normalizing the data.
[0845] 6. Generation means
[0846] Based on the preprocessed data, the server uses a generative AI model (such as OpenAI GPT-3) to generate a specific action plan that reflects the specific teachings. This generation process also takes into account the weighting of each data element and the user's emotional information. For example, based on the teachings of "Author A," the server may suggest "10 minutes of meditation every morning," but if the user is feeling high stress, it may also recommend "30 minutes of walking per day" in addition to meditation.
[0847] 7. Display means
[0848] The server then sends the generated action plan and detailed implementation instructions to the device, and this communication is also carried out using the HTTPS protocol.
[0849] The device then displays the received action plan and detailed practice instructions on the user's screen. This display uses HTML, CSS, and JavaScript. For example, it displays a "meditation method based on the teachings of Author A" along with specific steps.
[0850] Specific examples
[0851] For example, suppose a user is searching for "ways to reduce work stress" and seeks advice based on the teachings of "Author A." The user enters the information, and the emotion engine recognizes that the user is experiencing high levels of stress. In this case, the system generates an action plan based on the teachings of "Author A," including "walking 30 minutes a day" in addition to meditation.
[0852] Examples of prompt statements
[0853] The user is searching for "ways to reduce work stress" and is seeking advice based on the teachings of "Author A." Based on the user's emotional information, it appears that the user is experiencing high levels of stress. Please generate an action plan that takes this information into account.
[0854] The system effectively applies self-improvement teachings to real life situations while taking into account the user's emotional state, allowing the user to take concrete and effective steps towards self-improvement and goal achievement.
[0855] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0856] Step 1:
[0857] The user inputs information about the situation and goals into a form on the terminal. An example of input information is text such as "I'm currently busy at work and feeling stressed. I'd like to know how to manage stress." This provides information to the input means. Input: text data about the user's situation and goals, Output: input information.
[0858] Step 2:
[0859] The user selects the desired author or great person using the dropdown menu or search function in the form. This function uses JavaScript and AJAX to retrieve information about the selected author or great person in real time. Input: Author or great person selected by the user, Output: Information about the selected author or great person.
[0860] Step 3:
[0861] The device's emotion recognition means analyzes the user's emotions. It uses voice analysis tools (e.g., Amazon Polly) and facial recognition technology (Microsoft Azure Face API) to identify the user's emotions from the input text, voice, and facial expressions. For example, it detects if the user is feeling stressed. Input: User's voice, facial expressions, and text data. Output: Recognized emotional information.
[0862] Step 4:
[0863] The terminal transmits the information acquired by the input means and selection means, as well as the emotion information acquired by the emotion recognition means, to the server. This communication is performed using the HTTPS protocol, ensuring secure data transfer. Input: Acquired user information, information on selected authors and famous people, recognized emotion information. Output: Data transmitted to the server.
[0864] Step 5:
[0865] The server receives the transmitted information, which includes the user's situation, goals, information on selected authors and famous people, and emotional information. The server normalizes and semantically analyzes the received data using preprocessing means, such as correcting typos in the text and extracting important keywords. Input: transmitted data, Output: preprocessed data.
[0866] Step 6:
[0867] The server generates a specific action plan based on the preprocessed data using a generative AI model (e.g., OpenAI GPT-3). This also takes into account the teachings of specific authors and recognized emotional information. For example, based on the teachings of "Author A," it suggests "10 minutes of meditation every morning," but if the user feels high stress, it also suggests "30 minutes of walking per day." Input: Preprocessed data, Output: Generated action plan.
[0868] Step 7:
[0869] The server sends the generated action plan and detailed instructions on how to implement it to the device. Again, this communication is performed using the HTTPS protocol. Input: Generated action plan, Output: Action plan sent to the device.
[0870] Step 8:
[0871] The device displays the received action plan and detailed implementation instructions on the user's screen. This display uses HTML, CSS, and JavaScript, providing an interface that is easy for the user to understand. For example, specific operating procedures could be shown as "meditation methods based on the teachings of author A." Input: Action plan received from the server, Output: Action plan displayed on the user's screen.
[0872] In this way, the system takes into account the user's emotional state and helps them effectively apply self-improvement teachings to their real life, ultimately enabling them to take concrete and effective steps towards personal growth and goal achievement.
[0873] (Application example 2)
[0874] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0875] Conventional self-improvement systems only provide static action plans without considering the user's emotional state, which limits their practicality and effectiveness. Furthermore, there is a lack of systems aimed at improving the user experience in brick-and-mortar stores, making it difficult to provide personalized action plans based on the user's emotions.
[0876] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0877] In this invention, the server includes an input means for inputting information about a situation and a goal, a selection means for selecting a desired celebrity or great person, an acquisition means for acquiring the information input and selected using the input means and the selection means, a recognition means for recognizing the user's emotions, a generation means for generating a specific action plan based on a specific teaching based on the information acquired by the acquisition means and the recognition means, and a display means for displaying the generated action plan. This makes it possible to provide a personalized action plan that takes into account the user's emotional state even in a physical store.
[0878] "Information about the situation and goals" is data about the situation the user is currently facing and the goals the user wants to achieve.
[0879] "Input means" refers to a device or interface through which a user inputs information about the situation and goals.
[0880] A "selection means" is a device or interface that allows a user to select a desired famous person or great person.
[0881] An "acquisition means" is a device or system that collects information entered and selected using input means and selection means.
[0882] The "recognition means" is a device including an emotion engine and a sensor for recognizing the user's emotions.
[0883] The "generating means" is a device or system that generates a specific action plan based on a specific teaching, based on the information collected by the acquiring means and the recognizing means.
[0884] The "display means" is a display or output device for presenting the generated action plan to the user.
[0885] This invention is a system that recognizes a user's emotional state and provides a self-improvement action plan based on that state. The system involves inputting information about a situation and a goal, selecting a desired celebrity or great person, recognizing the user's emotions, generating an action plan based on the collected information, and displaying the action plan.
[0886] System configuration
[0887] Input methods:
[0888] The input means in this invention is implemented by a terminal such as a smartphone, tablet, etc. A user uses these devices to input information about the current situation and the goals they want to achieve.
[0889] Example: "I want to be more motivated at work."
[0890] Selection method:
[0891] The user selects the teachings of the desired celebrity or great person using the selection means, which may include a drop-down menu or a search function.
[0892] Example: Select "Celebrity A".
[0893] Recognition means:
[0894] The system uses an emotion engine to recognize user emotions. The emotion engine uses technologies such as FaceAPI and Google Cloud Speech-to-Text. These technologies analyze the user's facial expressions and tone of voice to recognize emotions in real time.
[0895] Example: Detecting stress levels from the user's tone of voice.
[0896] Generation means:
[0897] Based on the information collected by the acquisition and recognition means, the server generates a specific action plan based on specific teachings, using an AI model (e.g., OpenAI GPT-4) to adjust the plan, taking into account the user's emotional state.
[0898] Example: "Based on the teachings of celebrity A, I suggest 10 minutes of meditation every morning, but if you are under high stress, I suggest moderate exercise in addition to meditation."
[0899] Display means:
[0900] The generated action plan is displayed on the user's smartphone, tablet, or smart glasses, allowing the user to confirm specific actions at the appropriate time.
[0901] Specific example explanation
[0902] Suppose a user is in a physical store looking for "ways to reduce work stress." The user enters their situation and goals into a smartphone app and selects "Celebrity B." The emotion engine recognizes that the user is experiencing high levels of stress. Based on this information, the server uses a generative AI model to generate an action plan, suggesting "30 minutes of walking and 15 minutes of relaxation sessions per day, based on the teachings of Celebrity B." This plan is then displayed on the user's smartphone.
[0903] Example prompt for generative AI model:
[0904] "User information: 'Stress reduction', 'Busy at work', 'Very high stress'. Preferred celebrity: 'Celebrity B'. Based on the teachings of Celebrity B and taking into account the user's current state and emotions, what would you suggest to reduce stress?"
[0905] In this way, users can receive specific and timely action plans tailored to them.
[0906] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0907] Step 1:
[0908] The device inputs information about the user's situation and goals. The input information includes the user's current situation and the goals they want to achieve. When this information is input to the device, the device stores it as internal data (input: information about the user's situation and goals, output: information stored in the internal database).
[0909] Step 2:
[0910] The device allows the user to select the celebrity or great person of their choice. The user can select the celebrity or great person of their choice using a drop-down menu or search function. This selection information is also input into the device and saved as internal data (input: selection of celebrity or great person, output: selection information saved in the internal database).
[0911] Step 3:
[0912] The device sends the user's input and selection information acquired to an emotion engine for emotion recognition. The device's sensors or camera are used to capture the user's facial expressions and tone of voice, which are then analyzed by the emotion engine (input: user's input and selection information, output: emotion data as the analysis result).
[0913] Step 4:
[0914] The device sends the user's emotion data analyzed by the emotion engine to the server. The server receives the emotion data, input information, and selection information and integrates them into a single dataset (input: emotion data, input information, selection information; output: integrated dataset).
[0915] Step 5:
[0916] The server preprocesses the integrated dataset. The preprocessing step involves normalizing the data, correcting typos, and performing semantic analysis to extract important keywords (input: integrated dataset, output: normalized and semantically analyzed data).
[0917] Step 6:
[0918] The server uses a generative AI model (e.g., OpenAI GPT-4) to generate a specific action plan based on the preprocessed data, paying particular attention to the user's emotional state and considering an appropriate action plan (input: normalized and semantically analyzed data, output: specific action plan).
[0919] Step 7:
[0920] The server sends the generated action plan to the terminal, which then displays the action plan. The display allows the user to view the action plan and its detailed implementation method (input: specific action plan, output: action plan displayed on the terminal).
[0921] Step 8:
[0922] After the user executes the action plan, the device performs emotion recognition again and sends the results to the server. The server then checks the user's progress based on the feedback information and provides additional advice accordingly (input: user's execution results and re-emotional data, output: progress check and additional advice).
[0923] This processing step allows users to access a personal development plan tailored to their situation and emotions, enhancing their in-store experience.
[0924] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0925] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0926] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[0927] [Fourth embodiment]
[0928] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[0929] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[0930] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0931] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[0932] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0933] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0934] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0935] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[0936] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0937] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0938] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0939] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0940] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[0941] The present invention is a system for enabling users to specifically apply self-development teachings to real life. This system is implemented by combining the following means and methods.
[0942] 1. Enter your user information
[0943] The user enters information about their situation and goals into a form on the terminal. For example, the user can enter, "I'm feeling stressed because my current job is busy. I'd like to know how to manage stress."
[0944] 2. Select the author or person you want to read
[0945] Users can use the drop-down menus and search functions in the form to select the desired author or figure. For example, a user can select "Author A."
[0946] 3. Transmission of User Information
[0947] The terminal transmits the input information and information on the selected author or famous person to the server.
[0948] 4. Receiving and Preprocessing Input Data
[0949] The server receives the data sent from the device, including the user's status, goals, and information about selected authors and famous people.
[0950] The server pre-processes the data, normalizes the retrieved information, and performs semantic analysis.
[0951] 5. Generate AI models and create action plans
[0952] Based on the pre-processed data, the server's generative AI model generates a specific action plan that reflects the teachings of the author or great person selected by the user.
[0953] For example, a stress management method based on the teachings of "Author A" might suggest 10 minutes of meditation each morning.
[0954] 6. Submit and view your action plan
[0955] The server sends the generated action plan and detailed implementation instructions to the terminal.
[0956] The device will display the action plan on the user's screen, allowing the user to refer to it and apply it to their daily lives.
[0957] For example, suppose a user is searching for "ways to reduce work stress" and is seeking advice based on the teachings of "Author A." By inputting and selecting this information, the system creates a specific action plan based on the teachings of "Author A," providing practical advice such as "meditate for 10 minutes every morning" and "take two short breaks during the day."
[0958] In this way, the system of the present invention helps users effectively apply self-improvement teachings to real-life situations, enabling users to take concrete steps toward personal growth and goal achievement.
[0959] The processing flow will be explained below.
[0960] Step 1:
[0961] The user enters information about their situation and goals into a form on the device. For example, they might enter, "My current job is busy and I'm feeling stressed. I'd like to know how to manage stress."
[0962] Step 2:
[0963] The user selects the desired author or famous person using the drop-down menu or search function in the form, for example, "Author A."
[0964] Step 3:
[0965] The terminal sends the entered information (situation and goal) and the information on the selected author or great person to the server.
[0966] Step 4:
[0967] The server receives the data sent from the device, which includes information about the user's situation, goals, and selected authors and famous people.
[0968] Step 5:
[0969] The server pre-processes the data it receives, normalizing it and performing semantic analysis, such as correcting typos and extracting important keywords.
[0970] Step 6:
[0971] The server's generative AI model generates a specific action plan based on the preprocessed data, reflecting the teachings of a specific author or great figure. For example, based on the teachings of "Author A," it suggests "10 minutes of meditation every morning."
[0972] Step 7:
[0973] The server sends the generated action plan and detailed implementation instructions to the terminal.
[0974] Step 8:
[0975] The device will then display the action plan and practice method on the user's screen. For example, it will introduce it as "a meditation method based on the teachings of Author A."
[0976] In this way, through the processing steps, the user can obtain an action plan for concretely applying the teachings of self-development to real life.
[0977] Example 1
[0978] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[0979] In modern society, applying self-improvement teachings to real life is important for many people. However, self-improvement teachings often contain abstract concepts that are difficult to translate into concrete action plans. This makes it difficult for users to obtain concrete, practical action plans tailored to their own situations and goals. Furthermore, conventional systems have limited ways for users to efficiently utilize the teachings of selected authors or great figures. Therefore, an objective of the present invention is to provide a system that supports users in effectively applying self-improvement teachings to real life.
[0980] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0981] In this invention, the server includes: an input means for inputting information about a situation and a goal; a selection means for selecting a desired author or famous person; an acquisition means for acquiring the information input and selected using the input means and the selection means; a preprocessing means for preprocessing the information acquired by the acquisition means and performing normalization and semantic analysis; a generation means for generating a specific action plan based on a specific teaching based on the information preprocessed by the preprocessing means; a display means for displaying the action plan generated by the generation means; and a communication means for transmitting and receiving data between the acquisition means and the generation means via a communication protocol. This enables a user to easily acquire a specific and practical action plan suited to their situation and goal.
[0982] The "input means" is an interface for the user to input information about the situation and the goal.
[0983] The "selection means" is an interface that allows the user to select the desired author or great person.
[0984] The "acquisition means" is a means for acquiring information input and selected using the input means and selection means.
[0985] The "preprocessing means" is a means for preprocessing the information acquired by the acquisition means, and for performing normalization and semantic analysis.
[0986] The "generation means" is a means for generating a specific action plan based on a specific teaching, based on the information preprocessed by the preprocessing means.
[0987] The "display means" is a means for displaying the action plan generated by the generation means on the user's screen.
[0988] The "communication means" is a means by which the acquisition means and generation means send and receive data via a communication protocol.
[0989] A "generative AI model" is an artificial intelligence model used in the generation means to propose specific action plans based on the user's situation and goals.
[0990] A "prompt sentence" is a sentence input into a generative AI model that contains instructions for generating a specific action plan based on the user's situation and goals.
[0991] The present invention is a system for enabling users to specifically apply self-development teachings to real life. This system is implemented by combining the following means and methods.
[0992] First, the user enters information about their situation and goals into a form on the device. For example, they might say, "My current job is busy and I'm feeling stressed. I'd like to know how to manage stress." The device provides the input form using HTML and JavaScript.
[0993] Next, the user can select the desired author or great person using the drop-down menus or search function in the form. For example, they can select "Author A." This selection function is implemented using the JavaScript library React.
[0994] The terminal generates JSON format data to send the entered information and information on the selected authors and famous people to the server, and sends it using the HTTPS protocol.
[0995] The server receives data from the device using the Python framework Flask. The received data includes information about the user's situation, goals, and selected authors and famous people. The server normalizes and semantically analyzes the data using natural language processing libraries such as NLTK and SpaCy, thereby preprocessing the retrieved information.
[0996] The server then uses a generative AI model to generate a specific action plan based on the preprocessed data and reflects the teachings of the author or great person selected by the user. The generative AI model uses OpenAI's GPT-4. The AI model generates an action plan by inputting a prompt sentence. An example of the prompt sentence is as follows:
[0997] "The user is currently stressed due to a busy job and is looking for ways to manage stress. The user would like to hear from Author A about stress management methods. What action plan can you suggest?"
[0998] The server then sends the generated action plan and detailed implementation instructions to the device, again using the HTTPS protocol for communication.
[0999] The device displays the action plan sent from the server on the user's screen. The UI is displayed using the React library and CSS, providing information in a format that is easy for the user to view.
[1000] As a specific example, if a user is looking for "ways to reduce work stress" and enters advice based on the teachings of "Author A," the system will generate a specific action plan, such as "meditate for 10 minutes every morning" or "take two short breaks during the day," and display it on the device.
[1001] The system provides users with a concrete and practical action plan for effectively applying self-improvement teachings to real life.
[1002] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1003] Step 1:
[1004] Users enter information about their situation and goals into a form on their device. The input form is built using HTML and JavaScript. For example, a user might enter, "I'm feeling stressed because my current job is so busy. I'd like to know how to manage stress." The entered information is converted into JSON format data and prepared for the next step.
[1005] Input: Information about the situation and goals that the user enters into an HTML form
[1006] Output: User information data in JSON format
[1007] Step 2:
[1008] Users can select the desired author or famous person using drop-down menus or a search function within the form. This selection function, built using React, allows users to select, for example, "Author A." The selected data is also converted to JSON format.
[1009] Input: Information about the author or person selected by the user
[1010] Output: Selection data in JSON format
[1011] Step 3:
[1012] The terminal acquires the information entered and selected by the user, compiles it into JSON format data, and sends the JSON data via the HTTPS protocol to the server.
[1013] Input: User information data and selection data
[1014] Output: All data sent to the server in JSON format
[1015] Step 4:
[1016] The server receives data sent from the device using Python's Flask, including information about the user's status, goals, and selected authors and famous people, and prepares the data for the next step.
[1017] Input: All data received from the terminal in JSON format
[1018] Output: Received data (raw)
[1019] Step 5:
[1020] The server preprocesses the received data, which includes normalizing and semantic analysis. It uses Python's NLTK and SpaCy libraries to parse the user input and convert it into the required format.
[1021] Input: Raw incoming data
[1022] Output: Preprocessed data
[1023] Step 6:
[1024] The server uses a generative AI model (OpenAI's GPT-4) to generate an action plan based on the preprocessed data, reflecting the teachings of the author or great person selected by the user. For example, the prompt sentence "The user is currently feeling stressed due to a busy job and is looking for ways to manage stress. The user would like to learn from Author A about stress management methods. What kind of action plan can you suggest?" is input into the AI model, and a practical action plan is generated.
[1025] Input: preprocessed data, prompt statement
[1026] Output: Generated action plan
[1027] Step 7:
[1028] The server converts the generated action plan back into JSON format and transmits it using the HTTPS protocol to send it to the terminal.
[1029] Input: Generated Action Plan
[1030] Output: Action plan in JSON format sent to the device
[1031] Step 8:
[1032] The device then displays the received action plan on the user's screen, using the React library and CSS to display the action plan and detailed instructions on how to implement it in a user-friendly UI.
[1033] Input: Action plan in JSON format received from the server
[1034] Output: Action plan displayed on the user's screen
[1035] This system allows users to easily obtain specific and practical action plans based on their own situations and goals, and apply them to their real lives.
[1036] (Application example 1)
[1037] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1038] Today's users seek a variety of information for self-development and self-improvement, but often struggle with how to apply that information to their real lives. Many users also want to feel confident in a particular fashion style, but often don't know what specific actions to take. Another issue is the lack of personalized advice and suggestions to improve their shopping experience in physical stores.
[1039] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1040] In this invention, the server includes an input means for inputting information about a situation and a goal, a selection means for selecting a desired author or great person, a generation means for generating a specific action plan based on specific teachings based on the information acquired by the acquisition means, and a suggestion means for displaying fashion suggestions in a physical store based on the teachings of the selected author or great person in accordance with the user's specific challenges and areas for improvement. This enables the user to specifically and effectively apply the teachings of self-improvement to their real life, provides a specific action plan for gaining confidence in a specific fashion style, and significantly improves the shopping experience in a physical store.
[1041] "Situation and goal information" refers to data about the challenges the user is currently facing and the goals they want to achieve.
[1042] "Input means" refers to an interface or form that allows a user to input a situation or goal into a terminal.
[1043] The "selection means" refers to an interface or menu that allows the user to select the desired author, famous person, or fashion icon.
[1044] "Acquisition means" refers to a function or system for collecting information entered and selected by a user.
[1045] "Generating means" refers to functions or algorithms that, based on the acquired information, create specific action plans or fashion suggestions based on specific teachings or advice.
[1046] "Display means" refers to a display or screen that visually presents the generated action plan or proposal to the user.
[1047] "Proposal means" refers to functions and systems for displaying specific advice and fashion suggestions in physical stores that are tailored to the user's situation and goals.
[1048] "Implementation tools" are support functions and guides for implementing the proposed action plan based on the advice of the fashion style icons and stylists selected by the user.
[1049] The present invention is a system for enabling users to apply self-improvement teachings and fashion improvement advice to their real lives in a concrete manner. This system is realized by combining a plurality of means and methods.
[1050] 1. Enter your user information
[1051] The user inputs information about his / her situation and goals using the input means of the terminal. For example, the user inputs a goal such as "I want to feel more confident in casual styles."
[1052] 2. Choose your favorite author, famous person, or fashion icon
[1053] The user selects the desired author, famous person, or fashion icon using the selection means of the terminal. For example, the user can select "Author A" or "Fashion Stylist B."
[1054] 3. Transmission of User Information
[1055] The device sends the entered information and information about the selected author, famous person, or fashion icon to the server. The sent data is encoded in JSON format.
[1056] 4. Data Reception and Preprocessing
[1057] The server receives the data sent from the device. The received data includes information about the user's situation, goals, and selected authors, famous people, and fashion icons. The server preprocesses the data, normalizes it, and performs semantic analysis. This is done using Python and natural language processing toolkits (e.g., NLTK, spaCy).
[1058] 5. AI model generation and suggestions
[1059] The server's generative AI model (e.g., GPT-4) uses the preprocessed data to generate specific action plans and fashion suggestions that reflect the teachings of the user's chosen authors, famous people, or fashion icons. TensorFlow is often used for this. For example, it may suggest stress management methods based on the teachings of "Author A" or specific outfits based on the advice of "Fashion Stylist B."
[1060] 6. Submitting and Viewing Action Plans and Proposals
[1061] The server sends the generated action plan, fashion suggestions, and detailed practice methods to the device, which then displays them on the user's screen, allowing the user to refer to them and apply them to their daily lives or enjoy shopping at a physical store.
[1062] For example, if a user sets a goal of "I want to be more confident in casual style" and selects "Fashion Stylist B," the server will generate a fashion suggestion such as "Pair a simple white T-shirt with denim pants and put on a leather jacket on top," and send it to the device. This allows the user to learn specific coordination methods and try out a similar style in a physical store.
[1063] An example of a prompt is as follows:
[1064] "I want to feel more confident in casual style."
[1065] "Fashion Stylist B"
[1066] The system allows users to effectively incorporate self-improvement teachings and fashion improvement advice into their real lives.
[1067] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1068] Step 1:
[1069] The user inputs information about the situation and goals using the input means of the device. The input data may include content such as "I want to feel more confident in casual styles." This becomes the input data and is passed to the next processing step.
[1070] Step 2:
[1071] The user uses the device's selection means to select the desired author, famous person, fashion icon, or stylist. For example, "Fashion Stylist B" is selected. The entered information is sent to the server along with the data of the selected person. This becomes the input data and is passed to the next processing step.
[1072] Step 3:
[1073] The device collects the information entered in steps 1 and 2 and sends it to the server. The server receives this data and preprocesses it. Specific operations in preprocessing include data normalization and semantic analysis. Normalization standardizes the data format, and semantic analysis extracts the meaning of the data using a natural language processing toolkit (e.g., NLTK, spaCy). This clarifies the user's intent and the characteristics of the selected author, famous person, or fashion icon.
[1074] Step 4:
[1075] The server's generative AI model (e.g., GPT-4) generates specific action plans and fashion suggestions based on the preprocessed data. The generated content is based on the user's situation, goals, and the teachings of the selected person. For example, a fashion suggestion might be, "To feel confident in casual style, combine a simple white T-shirt with denim pants and top it off with a leather jacket." This is the output data for the input data.
[1076] Step 5:
[1077] The server then sends the generated action plan and fashion suggestions to the device. The data sent includes detailed practical instructions, showing the user how to make specific improvements and take action. For example, the server may provide specific instructions such as, "Choose a simple, plain white T-shirt and straight or skinny denim pants. For a stylish look, add a black leather jacket."
[1078] Step 6:
[1079] The device displays the action plans and suggestions on the user interface, allowing users to apply them to their own lives and use them when shopping in physical stores. This allows users to incorporate self-improvement advice and fashion improvement advice into their lives.
[1080] Through each of the above steps, users can obtain specific action plans and suggestions for self-improvement and fashion improvement.
[1081] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1082] The present invention is a system that allows users to concretely apply self-development teachings to real life, and by combining an emotion engine, it enables adjustment of action plans based on the user's emotions. This system is implemented by combining the following means and methods.
[1083] 1. Enter your user information
[1084] The user enters information about their situation and goals into a form on the terminal. For example, they might enter, "My current job is busy and I'm feeling stressed. I'd like to know how to manage stress."
[1085] 2. Select the author or person you want to read
[1086] The user can use the drop-down menus and search functions in the form to select the desired author or person, for example, "Author A."
[1087] 3. User Emotion Recognition
[1088] The device is equipped with an emotion engine that recognizes the user's emotions. The emotion engine uses voice analysis and facial recognition technology to identify the user's emotions. For example, it can detect stress or anxiety from the user's tone of voice and facial expressions when typing.
[1089] 4. Sending user information and emotions
[1090] The terminal transmits the input information (situation and goal), information on the selected author or famous person, and the recognized user's emotion information to the server.
[1091] 5. Receiving and Preprocessing Input Data
[1092] The server receives the data sent from the terminal, which includes the user's situation, goal, information about the selected author or famous person, and emotional information.
[1093] The server preprocesses the data, normalizes the retrieved information, and performs semantic analysis, for example, correcting typos and extracting important keywords.
[1094] 6. Generate AI models and create action plans
[1095] The server's generative AI model generates a specific action plan based on the preprocessed data, reflecting the teachings of a specific author or great figure. The model also takes into account the user's emotional state. For example, based on the teachings of "Author A," the model suggests "10 minutes of meditation every morning." However, if the user is feeling particularly stressed, the model can adjust the plan by incorporating moderate exercise in addition to meditation.
[1096] 7. Submit and view your action plan
[1097] The server sends the generated action plan and detailed implementation instructions to the terminal.
[1098] The device will then display the action plan and practice method on the user's screen. For example, it will introduce it as "a meditation method based on the teachings of Author A."
[1099] For example, suppose a user is looking for "ways to reduce work stress" and is seeking advice based on the teachings of "Author A." After the user enters and selects this information and the emotion engine recognizes that the user is experiencing high levels of stress, the system creates an action plan based on the teachings of "Author A," including "walking 30 minutes a day" in addition to meditation.
[1100] In this way, the system of the present invention takes into account the user's emotional state and helps them effectively apply self-improvement teachings to real life, thereby enabling them to take more concrete and effective steps towards personal growth and goal achievement.
[1101] The processing flow will be explained below.
[1102] Step 1:
[1103] The user enters information about their situation and goals into a form on the terminal. For example, they might enter, "My current job is busy and I'm feeling stressed. I'd like to know how to manage stress."
[1104] Step 2:
[1105] The user can use the drop-down menus and search functions in the form to select the desired author or person, for example, "Author A."
[1106] Step 3:
[1107] The device uses an emotion recognition engine to analyze the user's voice and facial expressions while they are inputting information, and recognizes the user's emotions. For example, it can identify from voice analysis that the user is feeling high levels of stress.
[1108] Step 4:
[1109] The terminal transmits the input information (situation and goal), information on the selected author or famous person, and recognized emotion information to the server.
[1110] Step 5:
[1111] The server receives the data sent from the terminal, which includes the user's situation, goal, information about the selected author or famous person, and emotional information.
[1112] Step 6:
[1113] The server pre-processes the data it receives, normalizing it and performing semantic analysis, such as correcting typos and extracting important keywords.
[1114] Step 7:
[1115] The server's generative AI model generates a specific action plan based on the preprocessed data, reflecting the teachings of a specific author or great figure. The model also takes into account the user's emotional state. For example, based on the teachings of "Author A," the model might suggest "10 minutes of meditation every morning," but if the user is feeling particularly stressed, the model might adjust the plan to include moderate exercise and relaxation techniques.
[1116] Step 8:
[1117] The server sends the generated action plan and detailed implementation instructions to the terminal.
[1118] Step 9:
[1119] The device displays the action plan and how to put it into practice on the user's screen. For example, it might introduce it as a "meditation method based on the teachings of Author A" and suggest "walking 30 minutes a day."
[1120] In this way, the system of the present invention takes into account the user's emotional state and helps them effectively apply self-improvement teachings to their real life, thereby enabling them to take more concrete and effective steps towards self-improvement and goal achievement.
[1121] Example 2
[1122] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1123] Conventional self-improvement systems have difficulty providing specific action plans that take into account the user's emotional state. Furthermore, while it is necessary to appropriately integrate multiple information input and selection methods to provide users with accurate action plans, the technological means to achieve this have been lacking. As a result, users are unable to effectively apply the self-improvement teachings to their real lives, and the support for goal achievement and personal growth is insufficient.
[1124] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a preprocessing means, a generation means using a generative AI model, and an emotion recognition means. This makes it possible to generate a specific action plan that takes into account the user's emotional state based on information about the user's situation and goals. The generated action plan is adjusted according to the user's emotions, thereby enabling effective support for achieving real-life goals and self-improvement.
[1125] The "input means" is an interface that allows the user to input information about his / her own situation and goals into the terminal.
[1126] The "selection means" is an interface that allows the user to select the desired author or great person.
[1127] The "acquisition means" is a means for collecting information input and selected using the input means and selection means.
[1128] The "emotion recognition means" is a means for analyzing and recognizing the user's emotions, and uses voice analysis and face recognition technology.
[1129] The "transmission means" is a means for transmitting the information acquired and recognized by the acquisition means and emotion recognition means to the server.
[1130] The "preprocessing means" is a means for normalizing the information input to the server and performing preprocessing such as correcting typos and extracting important keywords.
[1131] "Generative means" refers to a means for generating a specific action plan that reflects specific teachings using a generative AI model based on preprocessed information.
[1132] The "display means" is a means for displaying the generated action plan and detailed implementation methods thereof on the user's screen.
[1133] A "generative AI model" is an artificial intelligence model that generates an action plan that reflects specific teachings based on input information.
[1134] A "prompt" is a sentence containing instructions or information to be input into a generative AI model.
[1135] The present invention is a system that allows users to apply self-development teachings to real life. This system combines an emotion engine to enable adjustment of action plans based on the user's emotions. Each element and its specific processing will be described in detail below.
[1136] 1. Input Method
[1137] Users enter information about their situation and goals using an on-device form built with HTML and JavaScript, such as, "I'm feeling stressed and overwhelmed at work right now. I'd like to know how to manage stress."
[1138] 2. Selection Method
[1139] Users select the desired author or great person using drop-down menus within the form or a search function that uses JavaScript and AJAX to narrow down the results in real time. For example, select "Author A."
[1140] 3. Emotion recognition means
[1141] The device is equipped with an emotion engine to recognize the user's emotions. It uses voice analysis tools (e.g., Amazon Polly) and facial recognition technology (Microsoft Azure Face API). It analyzes the tone of voice and facial expressions when the user enters information to identify stress or anxiety.
[1142] 4. Transmission Method
[1143] The device sends the acquired user information (situation and goal), information on the selected author or famous person, and the recognized emotion information to the server. Communication is performed using the HTTPS protocol.
[1144] 5. Pretreatment Methods
[1145] The server receives the data sent from the device, including the user's situation, goals, information about the selected author or famous person, and emotional information.
[1146] The server uses Python and Node.js to perform preprocessing of the data, specifically correcting typos in the text data, extracting important keywords, and normalizing the data.
[1147] 6. Generation means
[1148] Based on the preprocessed data, the server uses a generative AI model (such as OpenAI GPT-3) to generate a specific action plan that reflects the specific teachings. This generation process also takes into account the weighting of each data element and the user's emotional information. For example, based on the teachings of "Author A," the server may suggest "10 minutes of meditation every morning," but if the user is feeling high stress, it may also recommend "30 minutes of walking per day" in addition to meditation.
[1149] 7. Display means
[1150] The server then sends the generated action plan and detailed implementation instructions to the device, and this communication is also carried out using the HTTPS protocol.
[1151] The device then displays the received action plan and detailed practice instructions on the user's screen. This display uses HTML, CSS, and JavaScript. For example, it displays a "meditation method based on the teachings of Author A" along with specific steps.
[1152] Specific examples
[1153] For example, suppose a user is searching for "ways to reduce work stress" and seeks advice based on the teachings of "Author A." The user enters the information, and the emotion engine recognizes that the user is experiencing high levels of stress. In this case, the system generates an action plan based on the teachings of "Author A," including "walking 30 minutes a day" in addition to meditation.
[1154] Examples of prompt statements
[1155] The user is searching for "ways to reduce work stress" and is seeking advice based on the teachings of "Author A." Based on the user's emotional information, it appears that the user is experiencing high levels of stress. Please generate an action plan that takes this information into account.
[1156] The system effectively applies self-improvement teachings to real life situations while taking into account the user's emotional state, allowing the user to take concrete and effective steps towards self-improvement and goal achievement.
[1157] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1158] Step 1:
[1159] The user inputs information about the situation and goals into a form on the terminal. An example of input information is text such as "I'm currently busy at work and feeling stressed. I'd like to know how to manage stress." This provides information to the input means. Input: text data about the user's situation and goals, Output: input information.
[1160] Step 2:
[1161] The user selects the desired author or great person using the dropdown menu or search function in the form. This function uses JavaScript and AJAX to retrieve information about the selected author or great person in real time. Input: Author or great person selected by the user, Output: Information about the selected author or great person.
[1162] Step 3:
[1163] The device's emotion recognition means analyzes the user's emotions. It uses voice analysis tools (e.g., Amazon Polly) and facial recognition technology (Microsoft Azure Face API) to identify the user's emotions from the input text, voice, and facial expressions. For example, it detects if the user is feeling stressed. Input: User's voice, facial expressions, and text data. Output: Recognized emotional information.
[1164] Step 4:
[1165] The terminal transmits the information acquired by the input means and selection means, as well as the emotion information acquired by the emotion recognition means, to the server. This communication is performed using the HTTPS protocol, ensuring secure data transfer. Input: Acquired user information, information on selected authors and famous people, recognized emotion information. Output: Data transmitted to the server.
[1166] Step 5:
[1167] The server receives the transmitted information, which includes the user's situation, goals, information on selected authors and famous people, and emotional information. The server normalizes and semantically analyzes the received data using preprocessing means, such as correcting typos in the text and extracting important keywords. Input: transmitted data, Output: preprocessed data.
[1168] Step 6:
[1169] The server generates a specific action plan based on the preprocessed data using a generative AI model (e.g., OpenAI GPT-3). This also takes into account the teachings of specific authors and recognized emotional information. For example, based on the teachings of "Author A," it suggests "10 minutes of meditation every morning," but if the user feels high stress, it also suggests "30 minutes of walking per day." Input: Preprocessed data, Output: Generated action plan.
[1170] Step 7:
[1171] The server sends the generated action plan and detailed instructions on how to implement it to the device. Again, this communication is performed using the HTTPS protocol. Input: Generated action plan, Output: Action plan sent to the device.
[1172] Step 8:
[1173] The device displays the received action plan and detailed implementation instructions on the user's screen. This display uses HTML, CSS, and JavaScript, providing an interface that is easy for the user to understand. For example, specific operating procedures could be shown as "meditation methods based on the teachings of author A." Input: Action plan received from the server, Output: Action plan displayed on the user's screen.
[1174] In this way, the system takes into account the user's emotional state and helps them effectively apply self-improvement teachings to their real life, ultimately enabling them to take concrete and effective steps towards personal growth and goal achievement.
[1175] (Application example 2)
[1176] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1177] Conventional self-improvement systems only provide static action plans without considering the user's emotional state, which limits their practicality and effectiveness. Furthermore, there is a lack of systems aimed at improving the user experience in brick-and-mortar stores, making it difficult to provide personalized action plans based on the user's emotions.
[1178] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1179] In this invention, the server includes an input means for inputting information about a situation and a goal, a selection means for selecting a desired celebrity or great person, an acquisition means for acquiring the information input and selected using the input means and the selection means, a recognition means for recognizing the user's emotions, a generation means for generating a specific action plan based on a specific teaching based on the information acquired by the acquisition means and the recognition means, and a display means for displaying the generated action plan. This makes it possible to provide a personalized action plan that takes into account the user's emotional state even in a physical store.
[1180] "Information about the situation and goals" is data about the situation the user is currently facing and the goals the user wants to achieve.
[1181] "Input means" refers to a device or interface through which a user inputs information about the situation and goals.
[1182] A "selection means" is a device or interface that allows a user to select a desired famous person or great person.
[1183] An "acquisition means" is a device or system that collects information entered and selected using input means and selection means.
[1184] The "recognition means" is a device including an emotion engine and a sensor for recognizing the user's emotions.
[1185] The "generating means" is a device or system that generates a specific action plan based on a specific teaching, based on the information collected by the acquiring means and the recognizing means.
[1186] The "display means" is a display or output device for presenting the generated action plan to the user.
[1187] This invention is a system that recognizes a user's emotional state and provides a self-improvement action plan based on that state. The system involves inputting information about a situation and a goal, selecting a desired celebrity or great person, recognizing the user's emotions, generating an action plan based on the collected information, and displaying the action plan.
[1188] System configuration
[1189] Input methods:
[1190] The input means in this invention is implemented by a terminal such as a smartphone, tablet, etc. A user uses these devices to input information about the current situation and the goals they want to achieve.
[1191] Example: "I want to be more motivated at work."
[1192] Selection method:
[1193] The user selects the teachings of the desired celebrity or great person using the selection means, which may include a drop-down menu or a search function.
[1194] Example: Select "Celebrity A".
[1195] Recognition means:
[1196] The system uses an emotion engine to recognize user emotions. The emotion engine uses technologies such as FaceAPI and Google Cloud Speech-to-Text. These technologies analyze the user's facial expressions and tone of voice to recognize emotions in real time.
[1197] Example: Detecting stress levels from the user's tone of voice.
[1198] Generation means:
[1199] Based on the information collected by the acquisition and recognition means, the server generates a specific action plan based on specific teachings, using an AI model (e.g., OpenAI GPT-4) to adjust the plan, taking into account the user's emotional state.
[1200] Example: "Based on the teachings of celebrity A, I suggest 10 minutes of meditation every morning, but if you are under high stress, I suggest moderate exercise in addition to meditation."
[1201] Display means:
[1202] The generated action plan is displayed on the user's smartphone, tablet, or smart glasses, allowing the user to confirm specific actions at the appropriate time.
[1203] Specific example explanation
[1204] Suppose a user is in a physical store looking for "ways to reduce work stress." The user enters their situation and goals into a smartphone app and selects "Celebrity B." The emotion engine recognizes that the user is experiencing high levels of stress. Based on this information, the server uses a generative AI model to generate an action plan, suggesting "30 minutes of walking and 15 minutes of relaxation sessions per day, based on the teachings of Celebrity B." This plan is then displayed on the user's smartphone.
[1205] Example prompt for generative AI model:
[1206] "User information: 'Stress reduction', 'Busy at work', 'Very high stress'. Preferred celebrity: 'Celebrity B'. Based on the teachings of Celebrity B and taking into account the user's current state and emotions, what would you suggest to reduce stress?"
[1207] In this way, users can receive specific and timely action plans tailored to them.
[1208] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1209] Step 1:
[1210] The device inputs information about the user's situation and goals. The input information includes the user's current situation and the goals they want to achieve. When this information is input to the device, the device stores it as internal data (input: information about the user's situation and goals, output: information stored in the internal database).
[1211] Step 2:
[1212] The device allows the user to select the celebrity or great person of their choice. The user can select the celebrity or great person of their choice using a drop-down menu or search function. This selection information is also input into the device and saved as internal data (input: selection of celebrity or great person, output: selection information saved in the internal database).
[1213] Step 3:
[1214] The device sends the user's input and selection information acquired to an emotion engine for emotion recognition. The device's sensors or camera are used to capture the user's facial expressions and tone of voice, which are then analyzed by the emotion engine (input: user's input and selection information, output: emotion data as the analysis result).
[1215] Step 4:
[1216] The device sends the user's emotion data analyzed by the emotion engine to the server. The server receives the emotion data, input information, and selection information and integrates them into a single dataset (input: emotion data, input information, selection information; output: integrated dataset).
[1217] Step 5:
[1218] The server preprocesses the integrated dataset. The preprocessing step involves normalizing the data, correcting typos, and performing semantic analysis to extract important keywords (input: integrated dataset, output: normalized and semantically analyzed data).
[1219] Step 6:
[1220] The server uses a generative AI model (e.g., OpenAI GPT-4) to generate a specific action plan based on the preprocessed data, paying particular attention to the user's emotional state and considering an appropriate action plan (input: normalized and semantically analyzed data, output: specific action plan).
[1221] Step 7:
[1222] The server sends the generated action plan to the terminal, which then displays the action plan. The display allows the user to view the action plan and its detailed implementation method (input: specific action plan, output: action plan displayed on the terminal).
[1223] Step 8:
[1224] After the user executes the action plan, the device performs emotion recognition again and sends the results to the server. The server then checks the user's progress based on the feedback information and provides additional advice accordingly (input: user's execution results and re-emotional data, output: progress check and additional advice).
[1225] This processing step allows users to access a personal development plan tailored to their situation and emotions, enhancing their in-store experience.
[1226] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.
[1227] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1228] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.
[1229] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[1230] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.
[1231] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.
[1232] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).
[1233] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.
[1234] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."
[1235] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.
[1236] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).
[1237] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.
[1238] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.
[1239] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[1240] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.
[1241] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.
[1242] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.
[1243] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.
[1244] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.
[1245] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.
[1246] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.
[1247] The following is further disclosed regarding the above embodiment.
[1248] (Claim 1)
[1249] input means for inputting information about the situation and goals;
[1250] A selection tool for selecting the desired author or great person;
[1251] an acquisition means for acquiring information input and selected using the input means and the selection means;
[1252] a generating means for generating a specific action plan based on a specific teaching based on the information acquired by the acquiring means;
[1253] The system includes a display means for displaying the generated action plan.
[1254] (Claim 2)
[1255] 2. The system according to claim 1, further comprising a preprocessing unit that preprocesses the information acquired by the acquisition unit and performs normalization and semantic analysis.
[1256] (Claim 3)
[1257] 2. The system according to claim 1, wherein the display means displays detailed implementation methods for the generated action plan.
[1258] "Example 1"
[1259] (Claim 1)
[1260] input means for inputting information about the situation and goals;
[1261] A selection tool for selecting the desired author or great person;
[1262] an acquisition means for acquiring information input and selected using the input means and the selection means;
[1263] a preprocessing means for preprocessing the information acquired by the acquisition means and performing normalization and semantic analysis;
[1264] a generating means for generating a specific action plan based on a specific teaching based on the information preprocessed by the preprocessing means;
[1265] a display means for displaying the action plan generated by the generation means;
[1266] a communication means for transmitting and receiving data between the acquiring means and the generating means via a communication protocol;
[1267] A system including:
[1268] (Claim 2)
[1269] 2. The system of claim 1, wherein the generating means generates an action plan based on the prompt sentence using a generative AI model.
[1270] (Claim 3)
[1271] 2. The system according to claim 1, wherein the display means displays detailed implementation methods for the generated action plan.
[1272] "Application Example 1"
[1273] (Claim 1)
[1274] input means for inputting information about the situation and goals;
[1275] A selection tool for selecting the desired author or great person;
[1276] an acquisition means for acquiring information input and selected using the input means and the selection means;
[1277] a generating means for generating a specific action plan based on a specific teaching based on the information acquired by the acquiring means;
[1278] a display means for displaying the generated action plan;
[1279] A suggestion means for displaying fashion suggestions based on the teachings of selected authors and great people in a physical store in response to specific issues and areas for improvement of the user;
[1280] A means for providing a method for implementing the fashion suggestion based on advice from fashion style icons and stylists selected by the user.
[1281] A system including:
[1282] (Claim 2)
[1283] 2. The system according to claim 1, further comprising a preprocessing unit that preprocesses the information acquired by the acquisition unit and performs normalization and semantic analysis.
[1284] (Claim 3)
[1285] 2. The system according to claim 1, wherein the display means displays detailed implementation methods for the generated action plan.
[1286] "Example 2: Combining Emotion Engines"
[1287] (Claim 1)
[1288] input means for inputting information about the situation and goals;
[1289] A selection tool for selecting the desired author or great person;
[1290] an acquisition means for acquiring information input and selected using the input means and the selection means;
[1291] emotion recognition means for recognizing an emotion of a user based on the information acquired by the acquisition means;
[1292] a transmitting means for transmitting the information acquired and recognized by the acquiring means and the emotion recognizing means to a server;
[1293] a preprocessing means for preprocessing the information input to the server, and performing normalization and semantic analysis;
[1294] A generating means for generating a specific action plan that reflects a specific teaching using a generative AI model based on the preprocessed information;
[1295] The system includes a display means for displaying the generated action plan.
[1296] (Claim 2)
[1297] 2. The system according to claim 1, wherein the preprocessing means is used to correct typos in the acquired information and extract important keywords.
[1298] (Claim 3)
[1299] 2. The system according to claim 1, wherein the specific action plan generated by the generating means is adjusted taking into account the recognized emotional information of the user.
[1300] (Claim 4)
[1301] 2. The system according to claim 1, wherein the display means displays detailed implementation methods for the generated action plan.
[1302] "Application example 2 when combining emotion engines"
[1303] (Claim 1)
[1304] input means for inputting information about the situation and goals;
[1305] a selection means for selecting the desired famous person or person of note;
[1306] an acquisition means for acquiring information input and selected using the input means and the selection means;
[1307] recognition means for recognizing an emotion of a user;
[1308] a generating means for generating a specific action plan based on a specific teaching based on the information acquired by the acquiring means and the recognizing means;
[1309] The system includes a display means for displaying the generated action plan.
[1310] (Claim 2)
[1311] 2. The system according to claim 1, further comprising a preprocessing unit that preprocesses the information acquired by the acquisition unit and performs normalization and semantic analysis.
[1312] (Claim 3)
[1313] 2. The system according to claim 1, wherein the display means displays detailed implementation methods for the generated action plan. [Explanation of symbols]
[1314] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>
Claims
1. input means for inputting information about the situation and goals; A selection tool for selecting the desired author or great person; an acquisition means for acquiring information input and selected using the input means and the selection means; a generating means for generating a specific action plan based on a specific teaching based on the information acquired by the acquiring means; The system includes a display means for displaying the generated action plan.
2. 2. The system according to claim 1, further comprising a preprocessing means for preprocessing the information acquired by said acquisition means and performing normalization and semantic analysis.
3. 2. The system according to claim 1, wherein said display means displays detailed implementation methods for the generated action plan.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A