system
The system integrates partner matching, counseling, conversation training, mental care, and fashion advice to address the shortcomings of conventional love support systems, providing comprehensive support for romantic activities.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- SOFTBANK GROUP CORP
- Filing Date
- 2024-10-02
- Publication Date
- 2026-04-14
AI Technical Summary
Conventional love support systems fail to provide comprehensive support for users' romantic activities, lacking integration of partner matching, counseling, conversation training, mental care, and fashion advice, leading to inconveniences and suboptimal advice due to separate data handling.
A system that collects user profile data and desired partner criteria, provides relationship counseling, generates simulated conversations, offers mental care advice, and suggests fashion items, all integrated to support romantic activities comprehensively.
The system effectively supports users' romantic activities by recommending suitable partners, offering tailored counseling and fashion advice, and enhancing conversation skills, thereby improving the overall user experience.
Smart Images

Figure 2026064722000001_ABST
Abstract
Description
Technical Field
[0001] The technology of the present disclosure relates to a system.
Background Art
[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, the method including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In a conventional love support system, there is a problem in that comprehensive support for a user's love is insufficient. Specifically, the problems are that a matching function for finding a suitable partner, a counseling function for responding to love troubles and consultations, a conversation training function for actual dates, a mental care function during love, and a fashion advice function suitable for dates are not integrated. Also, it is a problem that a user feels inconvenienced by using a plurality of services, and that optimal advice and support cannot be received because each service handles data separately.
Means for Solving the Problems
[0005] This invention provides a system that includes the following means to support users' romantic activities in various ways. First, it includes means for collecting the user's profile data and the conditions they seek in a partner and storing them in a database. Based on this data, it includes means for recommending the most suitable partner. Next, it includes means for analyzing the content of the user's romantic consultation using natural language processing and generating counseling results. It also includes means for generating a simulated conversation based on a conversation scenario selected by the user and providing an evaluation and feedback thereon. Furthermore, it includes means for providing mental care advice tailored to the user's mental state and stress level. Finally, it includes means for suggesting the most suitable fashion items based on the dating situation and providing purchase links, thereby providing a system that comprehensively supports users' romantic activities.
[0006] A "user" refers to an individual who uses the system.
[0007] "Profile data" refers to personal information including a user's hobbies, interests, values, and appearance.
[0008] "Desired partner criteria" refers to the attributes and standards that the user desires in a partner.
[0009] A "database" refers to a system for accumulating information, such as user profile data and the criteria they have for a partner.
[0010] "Matching method" refers to a function that recommends the most suitable partner based on the user's profile data and the criteria they are looking for in a partner.
[0011] "Counseling method" refers to a function that analyzes the relationship-related consultation content entered by the user and generates counseling results.
[0012] "Conversation training tools" refer to a function that generates simulated conversations based on conversation scenarios selected by the user, and provides evaluation and feedback on those conversations.
[0013] "Mental care tools" refer to functions that provide advice tailored to the user's mental state and stress level.
[0014] "Fashion advice" refers to a function that suggests the most suitable outfit based on a date situation and provides a link to purchase it.
[0015] "Natural language processing" refers to the technology that analyzes text entered by a user and understands its meaning.
[0016] "Evaluation and feedback" refers to analyzing the results of simulated conversations and providing users with areas for improvement and advice.
[0017] A "date situation" refers to the specific scene or circumstances of a date.
[0018] A "purchase link" refers to a link to an online shop where you can buy the suggested fashion items. [Brief explanation of the drawing]
[0019] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7]It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.
Mode for Carrying Out the Invention
[0020] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.
[0021] First, the language used in the following description will be explained.
[0022] In the following embodiments, the signed processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include CPU (Central Processing Unit), GPU (Graphics Processing Unit), GPGPU (General-Purpose computing on Graphics Processing Units), and APU (Accelerated Processing Unit).
[0023] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.
[0024] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.
[0025] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).
[0026] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."
[0027] [First Embodiment]
[0028] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.
[0029] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0030] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0031] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.
[0032] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0033] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0034] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.
[0035] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0036] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.
[0037] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0038] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0039] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0040] This invention relates to a system that supports users' romantic activities. This system collects the user's profile data and desired partner criteria, and recommends the most suitable partner based on this information. It also includes a range of functions providing relationship counseling, conversation training, mental care, and fashion advice for dates.
[0041] User profile collection and partner matching
[0042] First, the device prompts the user to input profile data (hobbies, interests, values, appearance, etc.). This data is sent from the device to the server and stored in a database. The user also sets criteria for their desired partner (age, hobbies, region, etc.). The server uses this data to compare it with information from other users in the database and runs an algorithm to rank the most suitable partners. This algorithm generates a list of the most suitable partners for the user and sends it to the device. The device then displays this list to the user.
[0043] Relationship counseling
[0044] When a user enters their relationship problems or questions, the device sends that information to the server. The server uses a natural language processing engine to analyze the questions and generate appropriate counseling advice. The generated advice is sent to the device and presented to the user. The server can also dynamically respond to the user's reactions and additional questions, providing even more specific advice.
[0045] Conversation training
[0046] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction), the device sends this selection to the server. The server then generates a simulated conversation using an AI chatbot based on this selection. This simulated conversation is conducted in real-time through the device. After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. This feedback is sent to the device and provided to the user.
[0047] Mental care
[0048] When a user inputs their mental state and stress level, the device sends this information to a server. The server analyzes this data and generates appropriate mental health advice. This advice includes suggestions for stress management and relaxation methods (e.g., breathing exercises, meditation) and is provided to the user through the device.
[0049] Fashion advice
[0050] When a user enters a date scenario (e.g., a casual lunch date), the device sends this information to the server. The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. These suggestions include specific items and links to online shops where they can be purchased. The device displays these suggestions to the user, who can then purchase the suggested items.
[0051] For example, if a user enters the criteria "a woman in her 30s who likes the outdoors and enjoys reading," the server searches the database, generates a list of matching women, and displays it on the device. Also, if a user enters a question about "difficulty communicating with a boyfriend," the AI will advise, "Why not try exploring his hobbies to increase common topics of conversation?" Furthermore, when a user is practicing conversation for a first date, the AI will instruct them to "introduce yourself," guide them through a simulated conversation, and provide evaluation and feedback.
[0052] Thus, the system of the present invention provides a variety of functions to comprehensively support the user's romantic activities and improve the user experience.
[0053] The following describes the processing flow.
[0054] Matching function processing steps
[0055] Step 1:
[0056] Device: The user launches the app and enters profile information (hobbies, interests, values, appearance, etc.).
[0057] Step 2:
[0058] Device: The user sets the criteria for their desired partner (age, hobbies, location, etc.).
[0059] Step 3:
[0060] Terminal: Sends the entered profile information and desired conditions to the server.
[0061] Step 4:
[0062] Server: Receives submitted profile information and preferences and stores them in the database.
[0063] Step 5:
[0064] Server: Runs an algorithm to rank the best partners by matching the profile data of other users in the database.
[0065] Step 6:
[0066] Server: Generates a ranked list of optimal partners and sends it to the terminal.
[0067] Step 7:
[0068] Terminal: Displays a list of recommended partners to the user.
[0069] Processing steps for the relationship counseling function
[0070] Step 1:
[0071] Device: The user launches the app and enters their relationship-related worries and questions.
[0072] Step 2:
[0073] Terminal: Sends the entered consultation details to the server.
[0074] Step 3:
[0075] Server: Receives the submitted consultation content and analyzes it using a natural language processing engine.
[0076] Step 4:
[0077] Server: Based on the analysis results, the AI counseling bot generates appropriate questions and presents them to the user.
[0078] Step 5:
[0079] Terminal: Displays questions from the AI to the user and receives the user's response.
[0080] Step 6:
[0081] Terminal: Sends the user's response to the server.
[0082] Step 7:
[0083] Server: Analyzes user responses and generates more specific counseling advice.
[0084] Step 8:
[0085] Server: Sends the generated counseling advice to the terminal.
[0086] Step 9:
[0087] Terminal: Displays counseling advice to the user.
[0088] Processing steps for the conversation training function
[0089] Step 1:
[0090] Device: The user launches the app and selects a conversation scenario or theme.
[0091] Step 2:
[0092] Terminal: Sends the selected scenario or theme to the server.
[0093] Step 3:
[0094] Server: Based on the submitted scenarios and themes, the AI chatbot generates simulated conversations.
[0095] Step 4:
[0096] Server: Sends the generated simulated conversation start message to the terminal.
[0097] Step 5:
[0098] Terminal: Displays a message to the user to initiate a simulated conversation and receives the user's response.
[0099] Step 6:
[0100] Terminal: Sends user responses to the server.
[0101] Step 7:
[0102] Server: Analyzes user responses and generates appropriate replies.
[0103] Step 8:
[0104] Server: Sends the generated response to the terminal.
[0105] Step 9:
[0106] Terminal: Displays the response to the user.
[0107] Step 10:
[0108] Server: After the conversation session ends, it analyzes the entire conversation and generates an evaluation and feedback.
[0109] Step 11:
[0110] Server: Sends the generated ratings and feedback to the terminal.
[0111] Step 12:
[0112] Device: Displays ratings and feedback to the user.
[0113] Processing steps of the mental care function
[0114] Step 1:
[0115] Device: The user launches the app and inputs their mental state and stress level.
[0116] Step 2:
[0117] Terminal: Sends the entered mental state and stress level to the server.
[0118] Step 3:
[0119] Server: Receives transmitted data and evaluates it using the analysis engine.
[0120] Step 4:
[0121] Server: Generates appropriate mental health advice based on the analysis results.
[0122] Step 5:
[0123] Server: Sends the generated mental health advice to the terminal.
[0124] Step 6:
[0125] Terminal: Displays mental health advice to the user.
[0126] Processing steps for the fashion advice function
[0127] Step 1:
[0128] Device: The user launches the app and enters the date scenario.
[0129] Step 2:
[0130] Terminal: Sends the entered dating scenario to the server.
[0131] Step 3:
[0132] Server: Receives the transmitted situation data and searches for appropriate fashion items.
[0133] Step 4:
[0134] Server: Generates optimal fashion style suggestions based on search results.
[0135] Step 5:
[0136] Server: Sends fashion item suggestions and purchase links to the device.
[0137] Step 6:
[0138] Terminal: Displays fashion item suggestions and purchase links to the user.
[0139] (Example 1)
[0140] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0141] In modern society, many people face various worries and challenges related to love and interpersonal relationships. In particular, there is a need for a wide range of support, including assistance with selecting a suitable partner, relationship counseling, improving conversation skills, mental health care, and fashion advice for dates. However, a system that provides comprehensive and effective solutions to these problems is still lacking. This invention aims to solve these problems in a unified manner and provide comprehensive support for users' romantic activities.
[0142] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0143] In this invention, the server includes means for collecting user profile data and the conditions desired in a partner; means for storing the received profile data and conditions in a database and recommending the most suitable partner using an algorithm; means for providing the generated recommendation list to the user terminal; means for collecting the user's consultation content, analyzing it using natural language processing, and generating counseling results; means for providing the generated counseling results to the user terminal; means for selecting a conversation scenario or theme; means for generating a simulated conversation using a generative AI model based on the selected scenario; means for generating an evaluation and feedback on the simulated conversation; means for providing the generated evaluation and feedback to the user terminal; means for collecting and analyzing the user's mental state and stress level to generate mental care advice; means for providing the generated mental care advice to the user terminal; means for the user to input a dating situation, search for fashion items appropriate to that situation, and generate clothing suggestions; and means for providing the generated fashion suggestions to the user terminal. This makes it possible to comprehensively support the user's romantic activities, providing consistent support from various consultations and skill improvement to mental care and date preparation.
[0144] A "user profile" refers to data that contains personal information about a user, such as their hobbies, interests, values, and appearance.
[0145] "Desired partner characteristics" refers to information that describes the specific traits and qualifications of the ideal partner the user desires, such as age, hobbies, and location.
[0146] A "database" is a structured data storage system used to store, manage, and retrieve user profile data, partner conditions, and other relevant information within a system.
[0147] An "algorithm" refers to a series of steps or computational methods for solving a specific problem, and in this case, it is a mathematical model or program for recommending the optimal partner.
[0148] "Counseling results" refer to information generated by analyzing the consultation content collected from users using natural language processing, in order to provide appropriate advice and guidance.
[0149] Natural Language Processing (NLP) is a collection of technologies that enable computers to understand, analyze, and generate human language.
[0150] A "generative AI model" refers to a method for cultivating artificial intelligence that generates new data based on a large dataset that has been trained on in advance.
[0151] "Simulated conversation" refers to a virtual dialogue that a user engages in with an AI based on a specific scenario, with the aim of improving conversational skills.
[0152] "Evaluation and feedback" refers to constructive opinions and suggestions for improvement provided as a result of analysis of simulated conversations and other user behaviors.
[0153] "Mental care advice" refers to information that analyzes the user's mental state and stress level, and suggests appropriate care methods and relaxation techniques.
[0154] A "situation" refers to a specific scene or environment that a user faces in a particular purpose or situation.
[0155] "Fashion items" refer to specific fashion-related products, such as clothing and accessories, that are used on dates or in specific situations.
[0156] "User terminal" refers to electronic devices such as personal computers, smartphones, and tablets that users use to interact with this system.
[0157] This invention is a system that supports users' romantic activities and includes functions such as user profile collection and partner matching, relationship counseling, conversation training, mental care, and fashion advice for dating.
[0158] User profile collection and partner matching
[0159] First, the device prompts the user to input the following profile information (hobbies, interests, values, appearance, etc.). This data is sent from the device to the server and stored in a database. The user can also set criteria for their desired partner (age, hobbies, region, etc.). The server uses this data and an algorithm to match it with other user information in the database and rank the most suitable partners. This ranking algorithm can use, for example, SQL queries or machine learning models. The generated partner list is sent to the device, which then displays it to the user.
[0160] Specific example:
[0161] Prompt: If you enter "a woman in her 30s who likes the outdoors and enjoys reading" as your desired criteria, the server will search the database and list women who meet those criteria.
[0162] Relationship counseling
[0163] When a user enters their relationship problems or questions into a device, the device sends the information to a server. The server uses a natural language processing (NLP) engine to analyze the questions and generate appropriate counseling advice. For example, a generative AI model may be used to generate the advice. This generated advice is sent to the device, which then presents it to the user. The server then dynamically responds to the user's reactions and additional questions to provide more specific advice.
[0164] Specific example:
[0165] Prompt message: If you enter a question such as "I'm having trouble communicating with him," the AI will analyze it and provide advice such as "Why not try exploring his hobbies in more depth to increase the number of topics you have in common?"
[0166] Conversation training
[0167] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction) from their device, the device sends this selection to the server. The server uses a generative AI model to generate a simulated conversation scenario and sends it to the device. The user can then engage in a real-time simulated conversation with the chatbot through their device. After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. This feedback is sent to the device and provided to the user.
[0168] Specific example:
[0169] Prompt: Select "First Date Conversation Training," and you will be instructed to "Introduce Yourself," and you will proceed with the conversation with the chatbot.
[0170] Mental care
[0171] When a user inputs their mental state and stress level into a device, that information is sent to a server. The server analyzes this data and generates appropriate mental care advice. The generated advice includes stress management and relaxation methods (e.g., breathing exercises, meditation). This advice is provided to the user through the device, and the user can practice self-care according to the advice.
[0172] Specific example:
[0173] Prompt: If you enter "high" for your stress level, the server will generate suggestions for breathing exercises and meditation.
[0174] Fashion advice
[0175] When a user enters a date scenario (e.g., a casual lunch date) into the device, that information is sent to the server. The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. These suggestions include specific items and links to online shops where they can be purchased. The device displays these suggestions to the user, who can then purchase the suggested items.
[0176] Specific example:
[0177] Prompt: When you enter "casual lunch date" as the date scenario, the server will suggest appropriate attire.
[0178] As described above, this system is designed to comprehensively support all aspects of a user's romantic activities, with each function working together to improve the user experience. This system makes it easier for users to find a suitable partner and provides consistent support for various relationship-related concerns and worries.
[0179] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0180] Step 1:
[0181] User input
[0182] The device prompts the user to input profile data (hobbies, interests, values, appearance, etc.). The user enters their profile information into a text box using a smartphone app. This input data is used in subsequent processing steps.
[0183] Step 2:
[0184] Data transmission
[0185] The device sends the entered profile data to the server. Specifically, when the user presses the "Send" button, the device sends data to the server via an HTTP POST request. The received data is stored in the server's database and used as input data for subsequent algorithmic processing.
[0186] Step 3:
[0187] Setting desired conditions
[0188] Users set their desired partner criteria (age, hobbies, location, etc.). Users select criteria using dropdown menus or checkboxes. This criteria data then becomes the input for the matching algorithm.
[0189] Step 4:
[0190] Partner Matching
[0191] The server executes an algorithm to match the user's profile data and preferences with other user information in the database. Specifically, it uses SQL queries and machine learning models to search the database for relevant profiles and ranks the most suitable partners. This calculation result is generated as a list of suitable partners.
[0192] Step 5:
[0193] Results display
[0194] The server sends the generated partner list to the device, which then displays it to the user. The device screen displays a list of matching users' photos and profile information.
[0195] Step 6:
[0196] Enter your consultation details
[0197] The user enters their relationship problems or questions into the device. The user enters their problem in the text area and presses the "Send" button.
[0198] Step 7:
[0199] Data transmission
[0200] The terminal sends that information to the server. Specifically, data is sent from the terminal to the server via an HTTP POST request. This data becomes the input for the next analysis process.
[0201] Step 8:
[0202] Analysis of consultation content
[0203] The server uses a natural language processing (NLP) engine to analyze the consultation content and generate appropriate counseling advice. The server sends the submitted text to an NLP API and receives the analysis results. The generated advice is shown in the following output.
[0204] Step 9:
[0205] Send advice
[0206] The server sends the generated advice to the terminal, which then displays it to the user. The user reads the advice displayed on the terminal's screen.
[0207] Step 10:
[0208] Dynamic response
[0209] The server dynamically responds to user feedback and additional questions, providing more specific advice. The user enters additional questions, the server uses its NLP engine to analyze them again, and generates and sends new advice.
[0210] Step 11:
[0211] Theme Selection
[0212] The user selects a specific conversation scenario or theme (e.g., first date, self-introduction). The user selects the theme from the app's UI.
[0213] Step 12:
[0214] Data transmission
[0215] The device sends the selection to the server. After selecting a theme, the device sends data to the server via an HTTP POST request.
[0216] Step 13:
[0217] Simulated conversation generation
[0218] The server generates simulated conversation scenarios using a generative AI model. The server calls a chatbot API to generate the conversation scenarios. These simulated conversations become the next output data.
[0219] Step 14:
[0220] Real-time conversation
[0221] The device engages in a simulated conversation with the user in real time. The user conducts the conversation with the chatbot within the app.
[0222] Step 15:
[0223] Analysis and Feedback
[0224] After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. The server analyzes the user's statements and generates feedback such as "You should speak more concisely." This feedback becomes the output result.
[0225] Step 16:
[0226] Provide feedback
[0227] The device provides the generated feedback to the user. The user reads the feedback displayed on the device screen.
[0228] Step 17:
[0229] Mental state input
[0230] The user inputs their mental state and stress level into the device. The user evaluates and inputs their stress level using sliders and radio buttons.
[0231] Step 18:
[0232] Data transmission
[0233] The device sends that information to the server. Once you have finished entering the information, press the "Send" button to send the data to the server.
[0234] Step 19:
[0235] Data Analysis
[0236] The server analyzes the data and generates appropriate mental health advice. The server then generates suggestions for relaxation methods based on stress levels. These suggestions become the next output data.
[0237] Step 20:
[0238] Providing advice
[0239] The server sends the generated advice to the terminal, which then provides it to the user. The user then acts on the advice displayed on the terminal screen.
[0240] Step 21:
[0241] Situation Input
[0242] The user enters the date scenario (e.g., casual lunch date) into their device. The user then selects the scenario within the app.
[0243] Step 22:
[0244] Data transmission
[0245] The terminal sends the entered situation information to the server. After selection, the terminal sends data to the server via an HTTP POST request.
[0246] Step 23:
[0247] Fashion proposal generation
[0248] The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. The server calls the online shop's API and lists the items. These suggestions become the next output data.
[0249] Step 24:
[0250] Suggestion display
[0251] The server sends the generated suggestions to the terminal, which then displays them to the user. The user then displays the suggested items on the terminal screen, and a purchase link is also provided.
[0252] In this way, each processing step collects data based on user input, performs analysis and recommendations on the server side, and provides the results to the user. This makes it possible to support the user's dating activities and provide optimal advice in various situations.
[0253] (Application Example 1)
[0254] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0255] Traditional dating support systems primarily offer partner recommendations and basic advice, but they fail to adequately address the diverse needs of users, such as providing specific date plans, fashion advice, conversation training, and mental care. As a result, users are unable to receive optimal support regarding dating and relationships, making it difficult for them to engage in effective dating activities.
[0256] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0257] In this invention, the server includes means for collecting the user's profile data and the conditions they seek in a partner; means for storing the received profile data and conditions in a database and recommending the most suitable partner; means for providing the generated recommendation list to the user's terminal; and means for generating fashion advice tailored to the dating scenario and providing suggestions including links to online shopping sites. As a result, the user can receive appropriate fashion advice for their date and is also provided with links to online shopping sites to help them choose appropriate attire for the occasion, thereby enabling them to engage in dating activities more effectively.
[0258] The server also includes means for collecting relationship-related consultation content entered by users, means for analyzing the collected consultation content using natural language processing and generating counseling results, means for providing the generated counseling results to the user's terminal, and means for generating and providing advice on mental care. As a result, users can receive appropriate counseling and mental care for their relationship worries and anxieties, and continue their relationship activities with a sense of mental security.
[0259] Furthermore, the server includes means for selecting a conversation scenario or theme, means for generating a simulated conversation based on the selected scenario, means for generating an evaluation and feedback on the simulated conversation, means for providing the generated evaluation and feedback to the user terminal, and means for managing and updating fashion advice, counseling advice, mental care advice, and user data related to the simulated conversation. This allows users to practice conversations based on actual dating scenarios and, by receiving evaluations and feedback based on the results, to approach actual dates with greater confidence.
[0260] "User profile data" refers to data that shows basic information and attributes about a user, such as name, age, hobbies, interests, and values.
[0261] "Desired partner qualities" refer to specific attributes or requirements that a user looks for in their ideal partner, such as age, hobbies, and location.
[0262] A "database" is a system or structure for efficiently storing, managing, and retrieving information.
[0263] A "recommendation list" is a list of the most suitable partner candidates for the user, determined by an algorithm.
[0264] A "date scenario" refers to a specific date situation or setting, such as a "casual lunch date."
[0265] "Fashion advice" refers to advice that specifically suggests clothing and styles suitable for a particular situation.
[0266] An "online shopping link" is a web link to an online store where the user can purchase the suggested fashion items.
[0267] "Relationship-related consultation content" refers to the user's worries, questions, and specific inquiries regarding relationships.
[0268] "Natural language processing" is the technology that uses computers to understand and analyze human language.
[0269] "Counseling results" refer to the specific advice and solutions provided to users regarding their relationship problems.
[0270] "Mental care" refers to providing support related to the user's mental health and stress management.
[0271] A "conversation scenario or theme" refers to the setting or topic for a simulated conversation, such as "first date" or "self-introduction."
[0272] A "simulated conversation" refers to a virtual conversation generated to simulate an actual conversation.
[0273] "Evaluation and feedback" refers to an analysis of the user's response and improvement points based on the results of the simulated conversation.
[0274] A "user terminal" is a device used by the user and includes smartphones, tablets, personal computers, etc.
[0275] A "server" is a central computing system on a network for data processing and storage.
[0276] "Means for management and update" refers to a method or function for appropriately maintaining data and information and reflecting new information and changes.
[0277] The present invention is a system for comprehensively supporting the user's love activities and has functions corresponding to the individual needs of the user. This system can be used by the user via a user terminal such as a smartphone. Specific embodiments will be described below.
[0278] System Configuration
[0279] This system mainly provides the following functions.
[0280] 1. Collection of user profiles and partner matching
[0281] 2. Fashion advice
[0282] 3. Love counseling
[0283] 4. Mental care
[0284] 5. Conversation training
[0285] Collection of User Profiles and Partner Matching
[0286] First, the user terminal prompts the user to input profile data (name, age, hobbies, interests, values, etc.). This data is sent from the terminal to the server and stored in the database. Additionally, the user sets the conditions for the desired partner (age, hobbies, location, etc.). The server uses this data to compare with the information of other users in the database and executes an algorithm to rank the optimal partners. This algorithm generates a list of optimal partners for the user and sends it to the terminal. The terminal displays this list to the user.
[0287] Fashion Advice
[0288] When the user inputs a specific date scenario (e.g., a casual lunch date), the terminal sends this information to the server. The server searches for fashion items suitable for the situation and generates a proposal for the optimal outfit. This proposal includes specific items and links to online shopping for purchasing them. The terminal displays these proposals to the user, and the user can purchase the proposed items.
[0289] Love Counseling
[0290] When the user inputs concerns or consultation content regarding love, the terminal sends that information to the server. The server analyzes the consultation content using a natural language processing engine and generates appropriate counseling advice. The generated advice is sent to the terminal and presented to the user. The server can also dynamically respond to the user's reactions and additional questions and provide more specific advice.
[0291] Mental Care
[0292] When a user inputs their mental state and stress level, the device sends this information to a server. The server analyzes this data and generates appropriate mental health advice. This advice includes suggestions for stress management and relaxation methods (e.g., breathing exercises, meditation) and is provided to the user through the device.
[0293] Conversation training
[0294] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction), the device sends this selection to the server. The server then generates a simulated conversation using an AI chatbot based on this selection. This simulated conversation is conducted in real-time through the device. After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. This feedback is sent to the device and provided to the user.
[0295] Hardware and software to be used
[0296] Hardware: Smartphones, tablets, personal computers
[0297] Software: Python (data processing), requests library (API communication), natural language processing engine (e.g., Hugging Face's Transformers)
[0298] Specific example
[0299] For example, if a user enters "a woman in her 30s who likes the outdoors and enjoys reading" as their desired criteria, the server searches the database, generates a list of matching women, and displays it on the terminal. Furthermore, if the user enters "I'm planning a casual lunch date for a first date," the system generates appropriate fashion advice and provides it along with links to online shops.
[0300] Also, when the user inputs a desire of "wanting to practice conversation", the server generates a simulated conversation using a first-date scenario and communicates with the user in real time. After the conversation ends, the system analyzes the user's responses and provides evaluation and feedback.
[0301] Examples of prompt sentences
[0302] "I am a 30-year-old man, and my hobbies are outdoor activities and watching movies. I am looking for an ideal partner who is a woman aged 25 to 35 and has hobbies of reading and outdoor activities. Also, I am planning a casual lunch date for the first date. I also want advice on conversation practice, consultation on love-related troubles, and stress management methods."
[0303] The flow of specific processing in Application Example 1 will be described using FIG. 12.
[0304] Step 1:
[0305] The user uses the terminal to input profile data (name, age, hobbies, interests, values, etc.) and conditions required for a partner (age, hobbies, region, etc.). The input data is sent from the terminal to the server. The server saves the received data in the database and uses it for partner matching later.
[0306] Input: User's profile data, conditions required for a partner
[0307] Output: User's profile data and conditions required for a partner saved in the database
[0308] Step 2:
[0309] The server searches for a suitable partner based on the user's profile data and partner requirements stored in the database. It then uses an algorithm to rank the best partners by cross-referencing this information with other users in the database. Finally, it generates a ranked partner list and sends it to the user's terminal.
[0310] Input: User profile data stored in the database and the criteria for a partner.
[0311] Output: Ranked partner list
[0312] Step 3:
[0313] The user enters a specific dating scenario (e.g., a casual lunch date) using their device. The entered scenario data is sent from the device to the server. The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. The generated suggestions include specific items and links to online shopping sites, and are sent back to the device.
[0314] Input: Dating scenario
[0315] Output: Fashion suggestions and online shopping links
[0316] Step 4:
[0317] The user enters their relationship problems or questions into the device. The entered questions are sent from the device to the server. The server uses a natural language processing engine to analyze the questions and generate counseling advice. The generated advice is then sent to the device and displayed to the user.
[0318] Input: Questions about love and relationships
[0319] Output: Counseling advice
[0320] Step 5:
[0321] The user inputs their mental state and stress level into a device. This input data is sent from the device to a server. The server analyzes this data and generates appropriate mental health advice. This advice is then delivered to the user via the device.
[0322] Input: Mental state and stress level
[0323] Output: Mental care advice
[0324] Step 6:
[0325] If a user wishes to receive conversation training, they input a specific conversation scenario or theme (e.g., first date, self-introduction) into their device. The entered scenario data is sent from the device to the server. The server uses an AI chatbot to generate a simulated conversation and interacts with the user in real time through the device. After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. The generated feedback is sent to the device and displayed to the user.
[0326] Input: Conversation scenarios or themes
[0327] Output: Evaluation and feedback on the simulated conversation
[0328] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0329] This invention is a system that supports users' romantic activities, providing more personalized support by combining it with an emotion engine that recognizes the user's emotions. This system collects the user's profile data and desired partner criteria, and has the function of recommending the most suitable partner. It also includes a range of functions that provide relationship counseling, conversation training, mental care, and fashion advice for dating.
[0330] User profile collection and partner matching
[0331] First, the device prompts the user to input profile data (hobbies, interests, values, appearance, etc.). This data is sent from the device to the server and stored in a database. The user also sets criteria for their desired partner (age, hobbies, region, etc.). The server uses this data to match it with information from other users in the database and runs an algorithm to rank the most suitable partners. This algorithm generates a list of the most suitable partners for the user and sends it to the device. The device then displays this list to the user. In addition, an emotion engine analyzes the user's responses (e.g., facial expressions and input speed) in real time, evaluates their emotional state, and adjusts the matching results accordingly.
[0332] Relationship counseling
[0333] When a user enters their relationship problems or questions, the device sends that information to the server. The server uses a natural language processing engine to analyze the questions and generate appropriate counseling advice. The generated advice is sent to the device and presented to the user. An emotion engine monitors the user's emotional state in real time and dynamically adjusts the counseling advice according to the user's stress level and emotions.
[0334] Conversation training
[0335] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction), the device sends this selection to the server. The server then generates a simulated conversation using an AI chatbot based on this selection. This simulated conversation is conducted in real time through the device. During the conversation, an emotion engine analyzes the user's facial expressions and tone of voice, adjusting the chatbot's responses based on the user's emotional changes. After the conversation ends, the server analyzes the entire conversation and generates an evaluation and feedback. This feedback is sent to the device and provided to the user.
[0336] Mental care
[0337] When a user inputs their mental state and stress level, the device sends this information to a server. The server analyzes this data and generates appropriate mental care advice. An emotion engine continuously monitors the user's emotional state and, if necessary, suggests additional advice and stress management methods. This advice includes suggestions for stress management and relaxation methods (e.g., breathing exercises, meditation) and is provided to the user through the device.
[0338] Fashion advice
[0339] When a user enters a date scenario (e.g., a casual lunch date), the device sends this information to the server. The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. These suggestions include specific items and links to online shops where they can be purchased. The device displays these suggestions to the user, who can then purchase the suggested items. Furthermore, an emotion engine analyzes the user's reactions and adjusts the suggestions provided to match the user's preferences.
[0340] For example, if a user enters the criteria "a woman in her 30s who likes the outdoors and enjoys reading," the server searches the database, generates a list of matching women, and displays it on the device. Also, if a user enters a question about "difficulty communicating with a boyfriend," the AI will advise, "Why not try exploring his hobbies to increase common topics of conversation?" Furthermore, when a user is practicing conversation for a first date, the AI will instruct them to "introduce yourself," guide them through a simulated conversation, and provide evaluation and feedback.
[0341] Thus, the system of the present invention provides a variety of functions to comprehensively support the user's romantic activities and improve the user experience. Furthermore, by incorporating an emotion engine, it realizes personalized support that responds to the user's emotions.
[0342] The following describes the processing flow.
[0343] Matching function processing steps (emotion engine combination)
[0344] Step 1:
[0345] Device: The user launches the app and enters profile information (hobbies, interests, values, appearance, etc.).
[0346] Step 2:
[0347] Device: The user sets the criteria for their desired partner (age, hobbies, location, etc.).
[0348] Step 3:
[0349] Terminal: Sends the entered profile information and desired conditions to the server.
[0350] Step 4:
[0351] Server: Receives submitted profile information and preferences and stores them in the database.
[0352] Step 5:
[0353] Server: Runs an algorithm that matches the profile data of other users in the database and ranks the most suitable partners.
[0354] Step 6:
[0355] Server: Generates a ranked list of optimal partners and sends it to the terminal.
[0356] Step 7:
[0357] Terminal: Displays a list of recommended partners to the user.
[0358] Step 8:
[0359] Server: The emotion engine analyzes user responses in real time and evaluates the user's emotional state.
[0360] Step 9:
[0361] Server: Based on the evaluation results of the emotion engine, the generated partner list is adjusted as needed.
[0362] Step 10:
[0363] Terminal: Redisplay the adjusted partner list to the user.
[0364] Processing steps for the relationship counseling function (combination of emotional engines)
[0365] Step 1:
[0366] Device: The user launches the app and enters their relationship-related worries and questions.
[0367] Step 2:
[0368] Terminal: Sends the entered consultation details to the server.
[0369] Step 3:
[0370] Server: Receives the submitted consultation content and analyzes it using a natural language processing engine.
[0371] Step 4:
[0372] Server: Based on the analysis results, the AI counseling bot generates appropriate questions and presents them to the user.
[0373] Step 5:
[0374] Terminal: Displays questions from the AI to the user and receives the user's response.
[0375] Step 6:
[0376] Terminal: Sends the user's response to the server.
[0377] Step 7:
[0378] Server: Analyzes user responses and generates more specific counseling advice.
[0379] Step 8:
[0380] Server: The emotion engine monitors the user's emotional state in real time and dynamically adjusts counseling advice according to the user's stress level and emotions.
[0381] Step 9:
[0382] Server: Sends the generated counseling advice to the terminal.
[0383] Step 10:
[0384] Terminal: Displays counseling advice to the user.
[0385] Processing steps for the conversation training function (combination of emotion engines)
[0386] Step 1:
[0387] Device: The user launches the app and selects a conversation scenario or theme.
[0388] Step 2:
[0389] Terminal: Sends the selected scenario or theme to the server.
[0390] Step 3:
[0391] Server: Based on the submitted scenarios and themes, the AI chatbot generates simulated conversations.
[0392] Step 4:
[0393] Server: Sends the generated simulated conversation start message to the terminal.
[0394] Step 5:
[0395] Terminal: Displays a message to the user to initiate a simulated conversation and receives the user's response.
[0396] Step 6:
[0397] Terminal: Sends user responses to the server.
[0398] Step 7:
[0399] Server: Analyzes user responses and generates appropriate replies.
[0400] Step 8:
[0401] Server: Sends the generated response to the terminal.
[0402] Step 9:
[0403] Terminal: Displays the response to the user.
[0404] Step 10:
[0405] Server: During a conversation session, the emotion engine analyzes the user's facial expressions and tone of voice in real time and adjusts the chatbot's response based on the user's emotional changes.
[0406] Step 11:
[0407] Server: After the conversation session ends, it analyzes the entire conversation and generates an evaluation and feedback.
[0408] Step 12:
[0409] Server: Sends the generated ratings and feedback to the terminal.
[0410] Step 13:
[0411] Device: Displays ratings and feedback to the user.
[0412] Processing steps of the mental care function (combination of emotional engines)
[0413] Step 1:
[0414] Device: The user launches the app and inputs their mental state and stress level.
[0415] Step 2:
[0416] Terminal: Sends the entered mental state and stress level to the server.
[0417] Step 3:
[0418] Server: Receives transmitted data and evaluates it using the analysis engine.
[0419] Step 4:
[0420] Server: Generates appropriate mental health advice based on the analysis results.
[0421] Step 5:
[0422] Server: The emotion engine continuously monitors the user's emotional state and, if necessary, suggests additional advice or stress management methods.
[0423] Step 6:
[0424] Server: Sends the generated mental health advice to the terminal.
[0425] Step 7:
[0426] Terminal: Displays mental health advice to the user.
[0427] Processing steps for the fashion advice function (combination of emotional engines)
[0428] Step 1:
[0429] Device: The user launches the app and enters the date scenario.
[0430] Step 2:
[0431] Terminal: Sends the entered dating scenario to the server.
[0432] Step 3:
[0433] Server: Receives the transmitted situation data and searches for appropriate fashion items.
[0434] Step 4:
[0435] Server: Generates optimal fashion style suggestions based on search results.
[0436] Step 5:
[0437] Server: Sends fashion item suggestions and purchase links to the device.
[0438] Step 6:
[0439] Terminal: Displays fashion item suggestions and purchase links to the user.
[0440] Step 7:
[0441] Server: The emotion engine analyzes user reactions in real time and adjusts the suggestions provided to match the user's preferences.
[0442] (Example 2)
[0443] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0444] Traditional dating support systems have limitations, offering only simple matching based on user profiles and fixed counseling advice, failing to respond to users' emotional states and real-time changes. Furthermore, conversational training often provides only one-sided feedback that ignores the user's evolving emotions. A system is needed to address these challenges and provide more personalized support.
[0445] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0446] In this invention, the server includes means for collecting user profile data and the conditions desired in a partner; means for storing the collected data in a database; means for ranking and recommending the most suitable partner based on the stored data using an algorithm; means for providing the generated recommendation list to the user terminal; and means for adjusting the recommendation results using an emotion engine that analyzes the user's reactions. This enables personalized partner recommendations that are tailored to the user's emotional state.
[0447] Furthermore, the server includes means for analyzing the relationship consultation content entered by the user using natural language processing technology and generating counseling results, means for providing the generated counseling results to the user's terminal, and means for monitoring the user's emotional state in real time and dynamically adjusting the counseling results. This enables the provision of dynamic counseling advice that responds to changes in the user's emotions.
[0448] The server also includes means for the user to select a conversation scenario or theme, means for generating a simulated conversation based on the selected scenario, means for generating an evaluation and feedback on the simulated conversation, means for providing the generated evaluation and feedback to the user terminal, and means for analyzing the user's emotional state during the conversation and adjusting the responses in the simulated conversation in real time. This enables the provision of real-time responses and feedback that correspond to the user's emotional state during conversation training.
[0449] "User profile data" refers to personal information that users provide to the system, including information such as hobbies, interests, values, and appearance.
[0450] "Desired partner characteristics" refer to the qualities and requirements of a partner that the user desires, including information such as age, hobbies, and place of residence.
[0451] "Means of collection" include interfaces for users to input information, as well as software and hardware for receiving that information.
[0452] "Means of storing in a database" include storage systems and database management systems for storing received user profile data and the conditions that users seek in a partner.
[0453] "Methods of ranking and recommending using algorithms" refer to the process of using AI algorithms to rank and recommend the most suitable partner candidates based on information stored in a database.
[0454] "Means for providing the generated recommendation list to the user terminal" includes software and hardware for transmitting and displaying the partner recommendation list generated by the server to a device accessible to the user.
[0455] "Methods for adjusting recommendation results using an emotion engine" refer to systems where the emotion engine analyzes the user's emotional state and adjusts the recommendation results and information provided in real time based on the results.
[0456] "A means of analyzing relationship-related consultation content using natural language processing technology and generating counseling results" refers to a process that uses AI and natural language processing technology to analyze relationship-related consultation content entered by a user and generate appropriate counseling advice.
[0457] "Means for providing generated counseling results to the user terminal" includes software and hardware for transmitting and displaying the counseling results generated by the server to the user's device.
[0458] "A means of monitoring the user's emotional state in real time and dynamically adjusting counseling results" refers to a system where the emotion engine detects the user's emotional state in real time and adjusts counseling advice as needed based on the results.
[0459] "Means for selecting a conversation scenario or theme" includes interfaces or software that allow the user to select a specific conversation scenario or theme.
[0460] "Means for generating simulated conversations based on selected scenarios" refers to the process of generating simulated conversations using AI or chatbot technology based on selected conversation scenarios or themes.
[0461] "Means for generating evaluations and feedback on simulated conversations" include software and algorithms for analyzing the content of simulated conversations and generating evaluations and feedback thereon.
[0462] "Means for providing generated evaluations and feedback to the user terminal" include software and hardware for sending and displaying conversation evaluations and feedback generated by the server to the user's device.
[0463] "A means of analyzing the user's emotional state during a conversation and adjusting the responses in a simulated conversation in real time" refers to a function in which an emotion engine analyzes the user's facial expressions and tone of voice during a conversation, and adjusts the content and responses of the simulated conversation in real time based on the results.
[0464] This invention is a system that supports users' romantic activities from multiple angles. The system has the function of collecting the user's profile data and desired partner criteria and recommending the most suitable partner. Furthermore, it has a series of functions that provide relationship counseling, conversation training, mental care, and fashion advice for dating.
[0465] User profile collection and partner matching
[0466] First, the device prompts the user to input profile data (hobbies, interests, values, appearance, etc.). This data is sent to the server via the device and stored in a database. Based on the stored data, the server uses an AI algorithm (e.g., a mutual recommendation algorithm) to match it with other user information in the database and rank the most suitable partners. The generated partner list is displayed to the user via the device. An emotion engine (e.g., facial recognition using OpenCV and Google® Cloud Speech-to-Text API) is used to analyze the user's responses in real time and adjust the recommendation results.
[0467] For example, if a user enters "a woman in her 30s who enjoys reading and the outdoors" as their desired criteria, the server searches the database, generates a list of matching women, and displays it on the terminal.
[0468] Example of a prompt:
[0469] "Looking for a woman in her 30s who enjoys the outdoors and reading."
[0470] Relationship counseling
[0471] When a user enters their relationship problems or questions into their device, the device sends that information to a server. The server analyzes the questions using natural language processing technology (e.g., Google Cloud Natural Language) and generates appropriate counseling advice. The generated advice is sent to the device and presented to the user. An emotion engine monitors the user's emotional state in real time and dynamically adjusts the counseling advice according to their stress level and emotions.
[0472] For example, if a user enters a question like, "I'm having trouble communicating with him," the AI will offer advice such as, "Why not try exploring his hobbies in more depth to increase the number of topics you have in common?"
[0473] Example of a prompt:
[0474] "I'm having trouble communicating with him."
[0475] Conversation training
[0476] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction), the device sends its selection to the server. The server generates a simulated conversation using an AI chatbot (e.g., OpenAI®'s GPT-3®). This simulated conversation is exchanged with the user in real time through the device. During the conversation, an emotion engine analyzes the user's facial expressions and tone of voice, adjusting the conversational responses accordingly. After the conversation ends, the server analyzes the conversation content, generates an evaluation and feedback, and sends it to the device.
[0477] As a concrete example, when a user is practicing conversation for a first date, they are instructed to "introduce yourself," and then given a simulated conversation followed by evaluation and feedback.
[0478] Example of a prompt:
[0479] "I want to practice conversation for first dates."
[0480] Mental care
[0481] When a user inputs their mental state and stress level into the device, the device sends this information to a server. The server analyzes this data and generates appropriate mental care advice. An emotion engine continuously monitors the user's emotional state and provides additional advice as needed. This advice includes suggestions for stress management and relaxation methods (e.g., breathing exercises, meditation) and is provided to the user through the device.
[0482] For example, if a user enters "I'm stressed," the server will suggest breathing exercises and meditation techniques.
[0483] Example of a prompt:
[0484] "I feel stressed."
[0485] Fashion advice
[0486] When a user enters a date scenario (e.g., a casual lunch date) into the device, the device sends this information to the server. The server searches for fashion items appropriate for the situation and generates suggestions for the best outfit. The suggestions include specific item names and links to purchase them. The device displays these suggestions to the user, who can then purchase the suggested items. Furthermore, an emotion engine analyzes the user's reactions and adjusts the suggestions to match the user's preferences.
[0487] For example, if a user enters "casual lunch date," the server will suggest casual attire and provide purchase links.
[0488] Example of a prompt:
[0489] "Suggestions for casual lunch date outfits"
[0490] In this way, the system comprehensively supports users' romantic activities and provides a variety of functions to improve the user experience. By incorporating an emotion engine, it enables personalized support that responds to the user's emotions.
[0491] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0492] Step 1:
[0493] The user enters their profile data and partner preferences.
[0494] Input: Hobbies, interests, values, appearance, and desired partner characteristics (e.g., age, hobbies, location, etc.)
[0495] Operation: Users input this information through a smartphone or PC interface.
[0496] Output: The collected user profile data and partner conditions are stored on the device.
[0497] Step 2:
[0498] The device sends data to the server.
[0499] Input: Profile data and partner conditions entered in Step 1.
[0500] Operation: The terminal uses the HTTPS protocol to encrypt and send the entered data to the server.
[0501] Output: Profile data and partner conditions received by the server
[0502] Step 3:
[0503] The server saves the data to the database.
[0504] Input: Profile data and partner conditions sent from the device.
[0505] Operation: The server uses a database management system (e.g., MySQL®, PostgreSQL) to store data in the database.
[0506] Output: User profile data and partner conditions stored in the database
[0507] Step 4:
[0508] The server uses an algorithm to rank and recommend the most suitable partners.
[0509] Input: Profile data of all users stored in the database and partner conditions
[0510] Operation: The server runs an AI algorithm (e.g., a mutual recommendation algorithm) to rank the best partner candidates.
[0511] Output: A list of the best partner for the user
[0512] Step 5:
[0513] The server sends the generated recommendation list to the terminal.
[0514] Input: Optimal partner list
[0515] Operation: The server generates a recommendation list in JSON format and sends it to the terminal.
[0516] Output: Partner list received by the terminal
[0517] Step 6:
[0518] The device displays a list of partners to the user.
[0519] Input: Partner list received from the server
[0520] Operation: The terminal displays the partner list in list format via a GUI.
[0521] Output: The partner list is displayed to the user.
[0522] Step 7:
[0523] The emotion engine analyzes user reactions.
[0524] Input: User's facial expressions and voice tone data
[0525] Operation: The emotion engine (e.g., OpenCV, Google Cloud Speech-to-Text API) uses the camera and microphone to analyze the user's emotional state in real time.
[0526] Output: Evaluation results of the user's emotional state
[0527] Step 8:
[0528] The server uses sentiment data to adjust the results.
[0529] Input: Emotional state assessment results and initial recommendation list
[0530] Operation: The server readjusts the recommendation list based on the evaluation results of the emotional state and generates a new recommendation list.
[0531] Output: The revised recommendation list and its display results
[0532] Step 9:
[0533] Users enter their relationship problems and questions.
[0534] Input: User's concerns or questions (e.g., "I'm having trouble communicating with him")
[0535] Operation: The user enters their inquiry in text format via a terminal.
[0536] Output: The entered consultation details are stored on the terminal.
[0537] Step 10:
[0538] The device sends the consultation details to the server.
[0539] Input: Consultation details
[0540] Operation: The terminal sends the consultation details to the server. For security purposes, the data is encrypted using the HTTPS protocol.
[0541] Output: Consultation content received by the server
[0542] Step 11:
[0543] The server analyzes the consultation content using natural language processing technology and generates counseling results.
[0544] Input: Consultation details
[0545] Operation: The server uses natural language processing technology (e.g., Google Cloud Natural Language) to analyze the consultation content and generate counseling advice.
[0546] Output: Counseling advice
[0547] Step 12:
[0548] The server provides the generated counseling results to the terminal.
[0549] Input: Counseling advice
[0550] Operation: The server sends counseling advice to the terminal in JSON format.
[0551] Output: Counseling advice received by the device
[0552] Step 13:
[0553] The emotion engine monitors the user's emotional state in real time and dynamically adjusts the counseling results.
[0554] Input: Counseling advice, emotional data such as the user's face and voice.
[0555] Operation: The emotion engine dynamically adjusts counseling advice based on the received emotion data.
[0556] Output: Adjusted counseling advice
[0557] Step 14:
[0558] The user selects a conversation scenario or theme.
[0559] Input: Conversation scenario or theme (e.g., "First Date," "Self-Introduction")
[0560] Operation: The user selects a conversation scenario or theme from a list on their device.
[0561] Output: Selected scenarios and themes
[0562] Step 15:
[0563] The device sends its selections to the server.
[0564] Input: Selected scenario or theme
[0565] Operation: The terminal sends the selection to the server.
[0566] Output: Selections received by the server
[0567] Step 16:
[0568] The server generates a simulated conversation based on the selected scenario.
[0569] Input: Selected scenario or theme
[0570] Operation: The server uses an AI chatbot (e.g., OpenAI's GPT-3) to generate simulated conversations based on the selected scenario.
[0571] Output: Generated simulated conversation
[0572] Step 17:
[0573] The device displays a simulated conversation.
[0574] Input: Generated simulated conversation
[0575] Operation: The device interacts with the user in real time through simulated conversations and displays the results.
[0576] Output: A simulated conversation is displayed to the user.
[0577] Step 18:
[0578] The emotion engine analyzes the user's emotions during the conversation.
[0579] Input: User's facial expressions and voice tone data
[0580] Operation: The emotion engine analyzes the user's facial expressions and voice tone in real time through the camera and microphone.
[0581] Output: Evaluation results of the user's emotional state
[0582] Step 19:
[0583] The server analyzes the conversation and generates feedback.
[0584] Input: Simulation conversation and evaluation results of emotional state
[0585] Operation: The server generates evaluations and feedback based on the conversation content and sentiment assessment.
[0586] Output: Generated evaluations and feedback
[0587] Step 20:
[0588] The device provides generated ratings and feedback.
[0589] Input: Ratings and feedback
[0590] Operation: The server sends the generated evaluation and feedback to the terminal, which then provides it to the user.
[0591] Output: Ratings and feedback provided to users
[0592] These steps enable the system to provide comprehensive support for users in their romantic endeavors. Furthermore, the use of an emotion engine allows for real-time, personalized support.
[0593] (Application Example 2)
[0594] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".
[0595] Traditional dating support systems focused on collecting user profile data and partner preferences, and recommending suitable partners, but only provided users with lists based on this information. This resulted in a lack of real-time emotional responses and personalized, emotion-based support. Furthermore, there was a lack of systems that comprehensively offered diverse support such as dating counseling, conversation training, mental care, and fashion advice, forcing users to utilize multiple services. This led to an inconsistent user experience and made effective dating support difficult.
[0596] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0597] In this invention, the server includes means for collecting user profile data and the conditions desired in a partner; means for storing the received profile data and conditions in a database and recommending the most suitable partner; means for providing the generated recommendation list to the user terminal; means including an emotion engine that analyzes the user's emotional state in real time; and means for adjusting the recommendation list based on the analysis results of the emotion engine. This enables the recommendation of the most suitable partner according to the user's emotional state. In addition, the server includes means for collecting relationship consultation content entered by the user; means for analyzing the collected consultation content using natural language processing and generating counseling results; means for providing the generated counseling results to the user terminal; means including an emotion engine that monitors the user's emotional state in real time; and means for dynamically adjusting the counseling results according to the emotional state. This enables counseling that is in line with the user's real-time emotional state. Furthermore, the server includes means for selecting a conversation scenario or theme; means for generating a simulated conversation based on the selected scenario; means including an emotion engine that analyzes the user's emotional state; means for adjusting the responses of the simulated conversation based on the emotional state; means for generating evaluations and feedback on the simulated conversation; and means for providing the generated evaluations and feedback to the user terminal. This enables appropriate conversation training that responds to changes in the user's emotions.
[0598] A "user profile" is data that includes personal information such as a user's hobbies, interests, values, and appearance.
[0599] "Desired partner criteria" refers to data that includes information such as the user's desired partner's age, hobbies, and location.
[0600] A "database" is a system for organizing and storing information such as collected user profiles and the requirements for partners.
[0601] The "recommendation list" is a list of the most suitable partners, generated based on the user's profile data and the criteria they have for a partner.
[0602] An "emotion engine" is a system that analyzes a user's facial expressions and voice tone to evaluate their emotional state in real time.
[0603] "Natural language processing" is a technology that enables computers to understand, analyze, and generate human language.
[0604] "Counseling" is the process of providing appropriate advice and solutions to users' relationship problems and concerns.
[0605] A "simulated conversation" is a virtual dialogue conducted using an AI chatbot based on a scenario or theme chosen by the user.
[0606] A "conversation scenario or theme" refers to a specific situation or topic that the user chooses during a simulated conversation.
[0607] "Evaluation and Feedback" refers to the evaluation of the user's conversational skills and advice on areas for improvement, generated after the completion of a simulated conversation.
[0608] "Dynamic adjustment" means appropriately changing the system's output (e.g., counseling results or responses in simulated conversations) according to the user's real-time emotional state.
[0609] The system program for implementing this invention integrates a wide range of functions to comprehensively support the user's romantic activities. The main hardware used includes user terminals (smartphones, tablets, personal computers, etc.) and a server, while the software includes an emotion engine, a natural language processing engine, and an AI chatbot.
[0610] The server has the means to collect user profile data and the criteria they seek in a partner. Users input information such as hobbies, interests, values, and appearance using their device. This data is immediately sent to the server and stored in the database. In addition, the criteria the user desires for a partner (age, hobbies, location, etc.) are also sent to the server and managed in the database.
[0611] The server performs partner matching based on the collected data and generates a list of optimal partners. This process utilizes an algorithm based on a neural network. The generated recommendation list is then refined through an emotion engine that analyzes the user's emotional state in real time. The emotion engine analyzes the user's facial expressions, input speed, etc., and finally provides the refined list to the user's terminal.
[0612] The server also provides a counseling function. When a user enters their relationship problems into their device, this information is sent to the server. The server uses a natural language processing engine to analyze the input and generate appropriate counseling advice. An emotion engine monitors the user's emotional state and dynamically adjusts the counseling results as needed. These results are sent to the user's device and displayed to the user.
[0613] Furthermore, the server provides conversation training. When a user selects a specific conversation scenario or theme, that selection is sent to the server. The server uses a generative AI model (e.g., GPT-3) to generate a simulated conversation, enabling real-time interaction between the user and the AI chatbot. During this simulated conversation, an emotion engine analyzes the user's emotional state in real time and adjusts the AI chatbot's responses accordingly. After the conversation ends, the server analyzes the entire conversation, generates an evaluation and feedback, and provides it to the user's terminal.
[0614] As a concrete example, when a user enters "a woman in her 30s who likes the outdoors and enjoys reading" as their desired criteria, the system works as follows:
[0615] 1. Prompt message when collecting profile information:
[0616] Please enter your hobby: Outdoors
[0617] Please enter your interest: Reading
[0618] Please enter your values: Inner fulfillment
[0619] 2. Prompts during counseling:
[0620] I'm having trouble communicating with him.
[0621] 3. Prompt sentences during conversation training:
[0622] Please select a scenario for your first date: Self-introduction
[0623] In this way, a system that comprehensively supports users' romantic activities is realized.
[0624] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0625] Step 1:
[0626] Users enter their profile data (hobbies, interests, values, appearance, etc.) and the criteria they seek in a partner (age, hobbies, location, etc.) into their device. The entered data is immediately sent to the server and stored in the database. This allows user profiles and partner criteria to be aggregated on the server.
[0627] Step 2:
[0628] The server searches other user data in the database to find the best match based on the aggregated user profiles and partner criteria. Specifically, it runs an algorithm using a neural network to find the best partner that matches the user's profile data. The recommendation list generated as a result of the search results is temporarily stored.
[0629] Step 3:
[0630] The server uses an emotion engine to analyze the user's emotional state in real time. Specifically, it analyzes the user's facial expressions and voice data to evaluate the user's current mood, level of excitement, and stress level. This emotional state is then quantified and recorded. The emotion engine uses an open-source emotion analysis module.
[0631] Step 4:
[0632] The server uses the emotion engine's analysis results to adjust the generated recommendation list. Specifically, it makes adjustments necessary to provide the best possible match based on the user's emotional state. For example, if the user is stressed, new suggestions may be added, or certain matching results may be excluded based on the user profile. The adjusted recommendation list is then finalized.
[0633] Step 5:
[0634] A refined recommendation list is sent from the server to the user's device and displayed to them. The user can review this list and select a suitable partner.
[0635] Step 6:
[0636] When a user enters their relationship problems or questions into their device, that information is sent to a server. The server uses a natural language processing engine to analyze the entered questions and generate appropriate counseling advice. The generated counseling advice is dynamically adjusted as needed, taking into account the user's emotional state.
[0637] Step 7:
[0638] The generated counseling results are sent from the server to the terminal and provided to the user. The user can use the counseling results to help resolve their relationship problems.
[0639] Step 8:
[0640] When a user selects a conversation scenario or theme, that selection is sent to the server. The server uses a generative AI model (e.g., GPT-3) to generate a simulated conversation based on the selected scenario. The AI chatbot then responds to the generated simulated conversation, taking into account how the user might emotionally react.
[0641] Step 9:
[0642] The server analyzes the simulated conversation and generates evaluations and feedback. Specifically, it analyzes the flow of the conversation and the user's utterances, providing feedback on what went well and what needs improvement. The generated evaluations and feedback are then provided to the device in a way that supports the user's learning.
[0643] Step 10:
[0644] When a user inputs their emotional and mental state, this information is sent to the server, which uses an emotion engine to perform an evaluation. Specific mental care advice (such as stress management and relaxation methods) is then provided, and appropriate advice tailored to the user's condition is displayed on the device.
[0645] This allows users to receive consistent support and effectively advance their romantic activities.
[0646] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0647] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0648] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.
[0649] [Second Embodiment]
[0650] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.
[0651] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0652] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0653] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.
[0654] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0655] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0656] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0657] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0658] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0659] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0660] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0661] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0662] This invention relates to a system that supports users' romantic activities. This system collects the user's profile data and desired partner criteria, and recommends the most suitable partner based on this information. It also includes a range of functions providing relationship counseling, conversation training, mental care, and fashion advice for dates.
[0663] User profile collection and partner matching
[0664] First, the device prompts the user to input profile data (hobbies, interests, values, appearance, etc.). This data is sent from the device to the server and stored in a database. The user also sets criteria for their desired partner (age, hobbies, region, etc.). The server uses this data to compare it with information from other users in the database and runs an algorithm to rank the most suitable partners. This algorithm generates a list of the most suitable partners for the user and sends it to the device. The device then displays this list to the user.
[0665] Relationship counseling
[0666] When a user enters their relationship problems or questions, the device sends that information to the server. The server uses a natural language processing engine to analyze the questions and generate appropriate counseling advice. The generated advice is sent to the device and presented to the user. The server can also dynamically respond to the user's reactions and additional questions, providing even more specific advice.
[0667] Conversation training
[0668] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction), the device sends this selection to the server. The server then generates a simulated conversation using an AI chatbot based on this selection. This simulated conversation is conducted in real-time through the device. After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. This feedback is sent to the device and provided to the user.
[0669] Mental care
[0670] When a user inputs their mental state and stress level, the device sends this information to a server. The server analyzes this data and generates appropriate mental health advice. This advice includes suggestions for stress management and relaxation methods (e.g., breathing exercises, meditation) and is provided to the user through the device.
[0671] Fashion advice
[0672] When a user enters a date scenario (e.g., a casual lunch date), the device sends this information to the server. The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. These suggestions include specific items and links to online shops where they can be purchased. The device displays these suggestions to the user, who can then purchase the suggested items.
[0673] For example, if a user enters the criteria "a woman in her 30s who likes the outdoors and enjoys reading," the server searches the database, generates a list of matching women, and displays it on the device. Also, if a user enters a question about "difficulty communicating with a boyfriend," the AI will advise, "Why not try exploring his hobbies to increase common topics of conversation?" Furthermore, when a user is practicing conversation for a first date, the AI will instruct them to "introduce yourself," guide them through a simulated conversation, and provide evaluation and feedback.
[0674] Thus, the system of the present invention provides a variety of functions to comprehensively support the user's romantic activities and improve the user experience.
[0675] The following describes the processing flow.
[0676] Matching function processing steps
[0677] Step 1:
[0678] Device: The user launches the app and enters profile information (hobbies, interests, values, appearance, etc.).
[0679] Step 2:
[0680] Device: The user sets the criteria for their desired partner (age, hobbies, location, etc.).
[0681] Step 3:
[0682] Terminal: Sends the entered profile information and desired conditions to the server.
[0683] Step 4:
[0684] Server: Receives submitted profile information and preferences and stores them in the database.
[0685] Step 5:
[0686] Server: Runs an algorithm to rank the best partners by matching the profile data of other users in the database.
[0687] Step 6:
[0688] Server: Generates a ranked list of optimal partners and sends it to the terminal.
[0689] Step 7:
[0690] Terminal: Displays a list of recommended partners to the user.
[0691] Processing steps for the relationship counseling function
[0692] Step 1:
[0693] Device: The user launches the app and enters their relationship-related worries and questions.
[0694] Step 2:
[0695] Terminal: Sends the entered consultation details to the server.
[0696] Step 3:
[0697] Server: Receives the submitted consultation content and analyzes it using a natural language processing engine.
[0698] Step 4:
[0699] Server: Based on the analysis results, the AI counseling bot generates appropriate questions and presents them to the user.
[0700] Step 5:
[0701] Terminal: Displays questions from the AI to the user and receives the user's response.
[0702] Step 6:
[0703] Terminal: Sends the user's response to the server.
[0704] Step 7:
[0705] Server: Analyzes user responses and generates more specific counseling advice.
[0706] Step 8:
[0707] Server: Sends the generated counseling advice to the terminal.
[0708] Step 9:
[0709] Terminal: Displays counseling advice to the user.
[0710] Processing steps for the conversation training function
[0711] Step 1:
[0712] Device: The user launches the app and selects a conversation scenario or theme.
[0713] Step 2:
[0714] Terminal: Sends the selected scenario or theme to the server.
[0715] Step 3:
[0716] Server: Based on the submitted scenarios and themes, the AI chatbot generates simulated conversations.
[0717] Step 4:
[0718] Server: Sends the generated simulated conversation start message to the terminal.
[0719] Step 5:
[0720] Terminal: Displays a message to the user to initiate a simulated conversation and receives the user's response.
[0721] Step 6:
[0722] Terminal: Sends user responses to the server.
[0723] Step 7:
[0724] Server: Analyzes user responses and generates appropriate replies.
[0725] Step 8:
[0726] Server: Sends the generated response to the terminal.
[0727] Step 9:
[0728] Terminal: Displays the response to the user.
[0729] Step 10:
[0730] Server: After the conversation session ends, it analyzes the entire conversation and generates an evaluation and feedback.
[0731] Step 11:
[0732] Server: Sends the generated ratings and feedback to the terminal.
[0733] Step 12:
[0734] Device: Displays ratings and feedback to the user.
[0735] Processing steps of the mental care function
[0736] Step 1:
[0737] Device: The user launches the app and inputs their mental state and stress level.
[0738] Step 2:
[0739] Terminal: Sends the entered mental state and stress level to the server.
[0740] Step 3:
[0741] Server: Receives transmitted data and evaluates it using the analysis engine.
[0742] Step 4:
[0743] Server: Generates appropriate mental health advice based on the analysis results.
[0744] Step 5:
[0745] Server: Sends the generated mental health advice to the terminal.
[0746] Step 6:
[0747] Terminal: Displays mental health advice to the user.
[0748] Processing steps for the fashion advice function
[0749] Step 1:
[0750] Device: The user launches the app and enters the date scenario.
[0751] Step 2:
[0752] Terminal: Sends the entered dating scenario to the server.
[0753] Step 3:
[0754] Server: Receives the transmitted situation data and searches for appropriate fashion items.
[0755] Step 4:
[0756] Server: Generates optimal fashion style suggestions based on search results.
[0757] Step 5:
[0758] Server: Sends fashion item suggestions and purchase links to the device.
[0759] Step 6:
[0760] Terminal: Displays fashion item suggestions and purchase links to the user.
[0761] (Example 1)
[0762] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0763] In modern society, many people face various worries and challenges related to love and interpersonal relationships. In particular, there is a need for a wide range of support, including assistance with selecting a suitable partner, relationship counseling, improving conversation skills, mental health care, and fashion advice for dates. However, a system that provides comprehensive and effective solutions to these problems is still lacking. This invention aims to solve these problems in a unified manner and provide comprehensive support for users' romantic activities.
[0764] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0765] In this invention, the server includes means for collecting user profile data and the conditions desired in a partner; means for storing the received profile data and conditions in a database and recommending the most suitable partner using an algorithm; means for providing the generated recommendation list to the user terminal; means for collecting the user's consultation content, analyzing it using natural language processing, and generating counseling results; means for providing the generated counseling results to the user terminal; means for selecting a conversation scenario or theme; means for generating a simulated conversation using a generative AI model based on the selected scenario; means for generating an evaluation and feedback on the simulated conversation; means for providing the generated evaluation and feedback to the user terminal; means for collecting and analyzing the user's mental state and stress level to generate mental care advice; means for providing the generated mental care advice to the user terminal; means for the user to input a dating situation, search for fashion items appropriate to that situation, and generate clothing suggestions; and means for providing the generated fashion suggestions to the user terminal. This makes it possible to comprehensively support the user's romantic activities, providing consistent support from various consultations and skill improvement to mental care and date preparation.
[0766] A "user profile" refers to data that contains personal information about a user, such as their hobbies, interests, values, and appearance.
[0767] "Desired partner characteristics" refers to information that describes the specific traits and qualifications of the ideal partner the user desires, such as age, hobbies, and location.
[0768] A "database" is a structured data storage system used to store, manage, and retrieve user profile data, partner conditions, and other relevant information within a system.
[0769] An "algorithm" refers to a series of steps or computational methods for solving a specific problem, and in this case, it is a mathematical model or program for recommending the optimal partner.
[0770] "Counseling results" refer to information generated by analyzing the consultation content collected from users using natural language processing, in order to provide appropriate advice and guidance.
[0771] Natural Language Processing (NLP) is a collection of technologies that enable computers to understand, analyze, and generate human language.
[0772] A "generative AI model" refers to a method for cultivating artificial intelligence that generates new data based on a large dataset that has been trained on in advance.
[0773] "Simulated conversation" refers to a virtual dialogue that a user engages in with an AI based on a specific scenario, with the aim of improving conversational skills.
[0774] "Evaluation and feedback" refers to constructive opinions and suggestions for improvement provided as a result of analysis of simulated conversations and other user behaviors.
[0775] "Mental care advice" refers to information that analyzes the user's mental state and stress level, and suggests appropriate care methods and relaxation techniques.
[0776] A "situation" refers to a specific scene or environment that a user faces in a particular purpose or situation.
[0777] "Fashion items" refer to specific fashion-related products, such as clothing and accessories, that are used on dates or in specific situations.
[0778] "User terminal" refers to electronic devices such as personal computers, smartphones, and tablets that users use to interact with this system.
[0779] This invention is a system that supports users' romantic activities and includes functions such as user profile collection and partner matching, relationship counseling, conversation training, mental care, and fashion advice for dating.
[0780] User profile collection and partner matching
[0781] First, the device prompts the user to input the following profile information (hobbies, interests, values, appearance, etc.). This data is sent from the device to the server and stored in a database. The user can also set criteria for their desired partner (age, hobbies, region, etc.). The server uses this data and an algorithm to match it with other user information in the database and rank the most suitable partners. This ranking algorithm can use, for example, SQL queries or machine learning models. The generated partner list is sent to the device, which then displays it to the user.
[0782] Specific example:
[0783] Prompt: If you enter "a woman in her 30s who likes the outdoors and enjoys reading" as your desired criteria, the server will search the database and list women who meet those criteria.
[0784] Relationship counseling
[0785] When a user enters their relationship problems or questions into a device, the device sends the information to a server. The server uses a natural language processing (NLP) engine to analyze the questions and generate appropriate counseling advice. For example, a generative AI model may be used to generate the advice. This generated advice is sent to the device, which then presents it to the user. The server then dynamically responds to the user's reactions and additional questions to provide more specific advice.
[0786] Specific example:
[0787] Prompt message: If you enter a question such as "I'm having trouble communicating with him," the AI will analyze it and provide advice such as "Why not try exploring his hobbies in more depth to increase the number of topics you have in common?"
[0788] Conversation training
[0789] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction) from their device, the device sends this selection to the server. The server uses a generative AI model to generate a simulated conversation scenario and sends it to the device. The user can then engage in a real-time simulated conversation with the chatbot through their device. After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. This feedback is sent to the device and provided to the user.
[0790] Specific example:
[0791] Prompt: Select "First Date Conversation Training," and you will be instructed to "Introduce Yourself," and you will proceed with the conversation with the chatbot.
[0792] Mental care
[0793] When a user inputs their mental state and stress level into a device, that information is sent to a server. The server analyzes this data and generates appropriate mental care advice. The generated advice includes stress management and relaxation methods (e.g., breathing exercises, meditation). This advice is provided to the user through the device, and the user can practice self-care according to the advice.
[0794] Specific example:
[0795] Prompt: If you enter "high" for your stress level, the server will generate suggestions for breathing exercises and meditation.
[0796] Fashion advice
[0797] When a user enters a date scenario (e.g., a casual lunch date) into the device, that information is sent to the server. The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. These suggestions include specific items and links to online shops where they can be purchased. The device displays these suggestions to the user, who can then purchase the suggested items.
[0798] Specific example:
[0799] Prompt: When you enter "casual lunch date" as the date scenario, the server will suggest appropriate attire.
[0800] As described above, this system is designed to comprehensively support all aspects of a user's romantic activities, with each function working together to improve the user experience. This system makes it easier for users to find a suitable partner and provides consistent support for various relationship-related concerns and worries.
[0801] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0802] Step 1:
[0803] User input
[0804] The device prompts the user to input profile data (hobbies, interests, values, appearance, etc.). The user enters their profile information into a text box using a smartphone app. This input data is used in subsequent processing steps.
[0805] Step 2:
[0806] Data transmission
[0807] The device sends the entered profile data to the server. Specifically, when the user presses the "Send" button, the device sends data to the server via an HTTP POST request. The received data is stored in the server's database and used as input data for subsequent algorithmic processing.
[0808] Step 3:
[0809] Setting desired conditions
[0810] Users set their desired partner criteria (age, hobbies, location, etc.). Users select criteria using dropdown menus or checkboxes. This criteria data then becomes the input for the matching algorithm.
[0811] Step 4:
[0812] Partner Matching
[0813] The server executes an algorithm to match the user's profile data and preferences with other user information in the database. Specifically, it uses SQL queries and machine learning models to search the database for relevant profiles and ranks the most suitable partners. This calculation result is generated as a list of suitable partners.
[0814] Step 5:
[0815] Results display
[0816] The server sends the generated partner list to the device, which then displays it to the user. The device screen displays a list of matching users' photos and profile information.
[0817] Step 6:
[0818] Enter your consultation details
[0819] The user enters their relationship problems or questions into the device. The user enters their problem in the text area and presses the "Send" button.
[0820] Step 7:
[0821] Data transmission
[0822] The terminal sends that information to the server. Specifically, data is sent from the terminal to the server via an HTTP POST request. This data becomes the input for the next analysis process.
[0823] Step 8:
[0824] Analysis of consultation content
[0825] The server uses a natural language processing (NLP) engine to analyze the consultation content and generate appropriate counseling advice. The server sends the submitted text to an NLP API and receives the analysis results. The generated advice is output as follows.
[0826] Step 9:
[0827] Send advice
[0828] The server sends the generated advice to the terminal, which then displays it to the user. The user reads the advice displayed on the terminal's screen.
[0829] Step 10:
[0830] Dynamic response
[0831] The server dynamically responds to user feedback and additional questions, providing more specific advice. The user enters additional questions, the server uses its NLP engine to analyze them again, and generates and sends new advice.
[0832] Step 11:
[0833] Theme Selection
[0834] The user selects a specific conversation scenario or theme (e.g., first date, self-introduction). The user selects the theme from the app's UI.
[0835] Step 12:
[0836] Data transmission
[0837] The device sends the selection to the server. After selecting a theme, the device sends data to the server via an HTTP POST request.
[0838] Step 13:
[0839] Simulated conversation generation
[0840] The server generates simulated conversation scenarios using a generative AI model. The server calls a chatbot API to generate the conversation scenarios. These simulated conversations become the next output data.
[0841] Step 14:
[0842] Real-time conversation
[0843] The device engages in a simulated conversation with the user in real time. The user conducts the conversation with the chatbot within the app.
[0844] Step 15:
[0845] Analysis and Feedback
[0846] After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. The server analyzes the user's statements and generates feedback such as "You should speak more concisely." This feedback becomes the output result.
[0847] Step 16:
[0848] Provide feedback
[0849] The device provides the generated feedback to the user. The user reads the feedback displayed on the device screen.
[0850] Step 17:
[0851] Mental state input
[0852] The user inputs their mental state and stress level into the device. The user evaluates and inputs their stress level using sliders and radio buttons.
[0853] Step 18:
[0854] Data transmission
[0855] The device sends that information to the server. Once you have finished entering the information, press the "Send" button to send the data to the server.
[0856] Step 19:
[0857] Data Analysis
[0858] The server analyzes the data and generates appropriate mental health advice. The server then generates suggestions for relaxation methods based on stress levels. These suggestions become the next output data.
[0859] Step 20:
[0860] Providing advice
[0861] The server sends the generated advice to the terminal, which then provides it to the user. The user then acts on the advice displayed on the terminal screen.
[0862] Step 21:
[0863] Situation Input
[0864] The user enters the date scenario (e.g., casual lunch date) into their device. The user then selects the scenario within the app.
[0865] Step 22:
[0866] Data transmission
[0867] The terminal sends the entered situation information to the server. After selection, the terminal sends data to the server via an HTTP POST request.
[0868] Step 23:
[0869] Fashion proposal generation
[0870] The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. The server calls the online shop's API and lists the items. These suggestions become the next output data.
[0871] Step 24:
[0872] Suggestion display
[0873] The server sends the generated suggestions to the terminal, which then displays them to the user. The user then displays the suggested items on the terminal screen, and a purchase link is also provided.
[0874] In this way, each processing step collects data based on user input, performs analysis and recommendations on the server side, and provides the results to the user. This makes it possible to support the user's dating activities and provide optimal advice in various situations.
[0875] (Application Example 1)
[0876] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0877] Traditional dating support systems primarily offer partner recommendations and basic advice, but they fail to adequately address the diverse needs of users, such as providing specific date plans, fashion advice, conversation training, and mental care. As a result, users are unable to receive optimal support regarding dating and relationships, making it difficult for them to engage in effective dating activities.
[0878] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0879] In this invention, the server includes means for collecting the user's profile data and the conditions they seek in a partner; means for storing the received profile data and conditions in a database and recommending the most suitable partner; means for providing the generated recommendation list to the user's terminal; and means for generating fashion advice tailored to the dating scenario and providing suggestions including links to online shopping sites. As a result, the user can receive appropriate fashion advice for their date and is also provided with links to online shopping sites to help them choose appropriate attire for the occasion, thereby enabling them to engage in dating activities more effectively.
[0880] The server also includes means for collecting relationship-related consultation content entered by users, means for analyzing the collected consultation content using natural language processing and generating counseling results, means for providing the generated counseling results to the user's terminal, and means for generating and providing advice on mental care. As a result, users can receive appropriate counseling and mental care for their relationship worries and anxieties, and continue their relationship activities with a sense of mental security.
[0881] Furthermore, the server includes means for selecting a conversation scenario or theme, means for generating a simulated conversation based on the selected scenario, means for generating an evaluation and feedback on the simulated conversation, means for providing the generated evaluation and feedback to the user terminal, and means for managing and updating fashion advice, counseling advice, mental care advice, and user data related to the simulated conversation. This allows users to practice conversations based on actual dating scenarios and, by receiving evaluations and feedback based on the results, to approach actual dates with greater confidence.
[0882] "User profile data" refers to data that shows basic information and attributes about a user, such as name, age, hobbies, interests, and values.
[0883] "Desired partner qualities" refer to specific attributes or requirements that a user looks for in their ideal partner, such as age, hobbies, and location.
[0884] A "database" is a system or structure for efficiently storing, managing, and retrieving information.
[0885] A "recommendation list" is a list of the most suitable partner candidates for the user, determined by an algorithm.
[0886] A "date scenario" refers to a specific date situation or setting, such as a "casual lunch date."
[0887] "Fashion advice" refers to advice that specifically suggests clothing and styles suitable for a particular situation.
[0888] An "online shopping link" is a web link to an online store where the user can purchase the suggested fashion items.
[0889] "Relationship-related consultation content" refers to the user's worries, questions, and specific inquiries regarding relationships.
[0890] "Natural language processing" is the technology that uses computers to understand and analyze human language.
[0891] "Counseling results" refer to the specific advice and solutions provided to users regarding their relationship problems.
[0892] "Mental care" refers to providing support related to the user's mental health and stress management.
[0893] A "conversation scenario or theme" refers to the setting or topic for a simulated conversation, such as "first date" or "self-introduction."
[0894] A "simulated conversation" is a virtual conversation generated to simulate a real-life conversation.
[0895] "Evaluation and feedback" refers to an analysis of the user's responses and areas for improvement based on the results of the simulated conversation.
[0896] "User terminal" refers to a device used by a user, and includes smartphones, tablets, personal computers, etc.
[0897] A "server" is a central computing system on a network used for processing and storing data.
[0898] "Means of management and updating" refer to methods and functions for properly maintaining data and information and reflecting new information and changes.
[0899] This invention is a system for comprehensively supporting users' romantic activities and has functions that respond to the individual needs of users. This system can be used by users via a user terminal such as a smartphone. Specific embodiments are described below.
[0900] System Configuration
[0901] This system primarily provides the following functions:
[0902] 1. User profile collection and partner matching
[0903] 2. Fashion advice
[0904] 3. Relationship counseling
[0905] 4. Mental care
[0906] 5. Conversation Training
[0907] User profile collection and partner matching
[0908] First, the user terminal prompts the user to input profile data (name, age, hobbies, interests, values, etc.). This data is sent from the terminal to the server and stored in a database. The user then sets criteria for their desired partner (age, hobbies, region, etc.). The server uses this data to compare it with information from other users in the database and runs an algorithm to rank the most suitable partners. This algorithm generates a list of the most suitable partners for the user and sends it to the terminal. The terminal then displays this list to the user.
[0909] Fashion advice
[0910] When a user enters a specific dating scenario (e.g., a casual lunch date), the device sends this information to the server. The server searches for fashion items appropriate for the situation and generates suggestions for the best outfit. These suggestions include specific items and links to online shopping sites to purchase them. The device displays these suggestions to the user, who can then purchase the suggested items.
[0911] Relationship counseling
[0912] When a user enters their relationship problems or questions, the device sends that information to the server. The server uses a natural language processing engine to analyze the questions and generate appropriate counseling advice. The generated advice is sent to the device and presented to the user. The server can also dynamically respond to the user's reactions and additional questions, providing even more specific advice.
[0913] Mental care
[0914] When a user inputs their mental state and stress level, the device sends this information to a server. The server analyzes this data and generates appropriate mental health advice. This advice includes suggestions for stress management and relaxation methods (e.g., breathing exercises, meditation) and is provided to the user through the device.
[0915] Conversation training
[0916] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction), the device sends this selection to the server. The server then generates a simulated conversation using an AI chatbot based on this selection. This simulated conversation is conducted in real-time through the device. After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. This feedback is sent to the device and provided to the user.
[0917] Hardware and software to be used
[0918] Hardware: Smartphones, tablets, personal computers
[0919] Software: Python (data processing), requests library (API communication), natural language processing engine (e.g., Hugging Face's Transformers)
[0920] Specific example
[0921] For example, if a user enters "a woman in her 30s who likes the outdoors and enjoys reading" as their desired criteria, the server searches the database, generates a list of matching women, and displays it on the terminal. Furthermore, if the user enters "I'm planning a casual lunch date for a first date," the system generates appropriate fashion advice and provides it along with links to online shops.
[0922] Furthermore, if a user enters a request to "practice conversation," the server generates a simulated conversation using a first date scenario and interacts with the user in real time. After the conversation ends, the system analyzes the user's responses and provides evaluation and feedback.
[0923] Example of a prompt
[0924] "I'm a 30-year-old man, and my hobbies are the outdoors and watching movies. I'm looking for an ideal partner who is a woman between 25 and 35 years old and enjoys reading and the outdoors. I'm also planning a casual lunch date for our first date. I'd like some conversation practice, advice on relationship problems, and stress management techniques."
[0925] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0926] Step 1:
[0927] The user uses their device to enter profile data (name, age, hobbies, interests, values, etc.) and criteria for a partner (age, hobbies, location, etc.). The entered data is sent from the device to the server. The server stores the received data in a database and uses it later for partner matching.
[0928] Input: User profile data, criteria for a partner
[0929] Output: User profile data and partner requirements stored in the database.
[0930] Step 2:
[0931] The server searches for a suitable partner based on the user's profile data and partner requirements stored in the database. It then uses an algorithm to rank the best partners by cross-referencing this information with other users in the database. Finally, it generates a ranked partner list and sends it to the user's terminal.
[0932] Input: User profile data stored in the database and the criteria for a partner.
[0933] Output: Ranked partner list
[0934] Step 3:
[0935] The user enters a specific dating scenario (e.g., a casual lunch date) using their device. The entered scenario data is sent from the device to the server. The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. The generated suggestions include specific items and links to online shopping sites, and are sent back to the device.
[0936] Input: Dating scenario
[0937] Output: Fashion suggestions and online shopping links
[0938] Step 4:
[0939] The user enters their relationship problems or questions into the device. The entered questions are sent from the device to the server. The server uses a natural language processing engine to analyze the questions and generate counseling advice. The generated advice is then sent to the device and displayed to the user.
[0940] Input: Questions about love and relationships
[0941] Output: Counseling advice
[0942] Step 5:
[0943] The user inputs their mental state and stress level into a device. This input data is sent from the device to a server. The server analyzes this data and generates appropriate mental health advice. This advice is then delivered to the user via the device.
[0944] Input: Mental state and stress level
[0945] Output: Mental care advice
[0946] Step 6:
[0947] If a user wishes to receive conversation training, they input a specific conversation scenario or theme (e.g., first date, self-introduction) into their device. The entered scenario data is sent from the device to the server. The server uses an AI chatbot to generate a simulated conversation and interacts with the user in real time through the device. After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. The generated feedback is sent to the device and displayed to the user.
[0948] Input: Conversation scenarios or themes
[0949] Output: Evaluation and feedback on the simulated conversation
[0950] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0951] This invention is a system that supports users' romantic activities, providing more personalized support by combining it with an emotion engine that recognizes the user's emotions. This system collects the user's profile data and desired partner criteria, and has the function of recommending the most suitable partner. It also includes a range of functions that provide relationship counseling, conversation training, mental care, and fashion advice for dating.
[0952] User profile collection and partner matching
[0953] First, the device prompts the user to input profile data (hobbies, interests, values, appearance, etc.). This data is sent from the device to the server and stored in a database. The user also sets criteria for their desired partner (age, hobbies, region, etc.). The server uses this data to match it with information from other users in the database and runs an algorithm to rank the most suitable partners. This algorithm generates a list of the most suitable partners for the user and sends it to the device. The device then displays this list to the user. In addition, an emotion engine analyzes the user's responses (e.g., facial expressions and input speed) in real time, evaluates their emotional state, and adjusts the matching results accordingly.
[0954] Relationship counseling
[0955] When a user enters their relationship problems or questions, the device sends that information to the server. The server uses a natural language processing engine to analyze the questions and generate appropriate counseling advice. The generated advice is sent to the device and presented to the user. An emotion engine monitors the user's emotional state in real time and dynamically adjusts the counseling advice according to the user's stress level and emotions.
[0956] Conversation training
[0957] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction), the device sends this selection to the server. The server then generates a simulated conversation using an AI chatbot based on this selection. This simulated conversation is conducted in real time through the device. During the conversation, an emotion engine analyzes the user's facial expressions and tone of voice, adjusting the chatbot's responses based on the user's emotional changes. After the conversation ends, the server analyzes the entire conversation and generates an evaluation and feedback. This feedback is sent to the device and provided to the user.
[0958] Mental care
[0959] When a user inputs their mental state and stress level, the device sends this information to a server. The server analyzes this data and generates appropriate mental care advice. An emotion engine continuously monitors the user's emotional state and, if necessary, suggests additional advice and stress management methods. This advice includes suggestions for stress management and relaxation methods (e.g., breathing exercises, meditation) and is provided to the user through the device.
[0960] Fashion advice
[0961] When a user enters a date scenario (e.g., a casual lunch date), the device sends this information to the server. The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. These suggestions include specific items and links to online shops where they can be purchased. The device displays these suggestions to the user, who can then purchase the suggested items. Furthermore, an emotion engine analyzes the user's reactions and adjusts the suggestions provided to match the user's preferences.
[0962] For example, if a user enters the criteria "a woman in her 30s who likes the outdoors and enjoys reading," the server searches the database, generates a list of matching women, and displays it on the device. Also, if a user enters a question about "difficulty communicating with a boyfriend," the AI will advise, "Why not try exploring his hobbies to increase common topics of conversation?" Furthermore, when a user is practicing conversation for a first date, the AI will instruct them to "introduce yourself," guide them through a simulated conversation, and provide evaluation and feedback.
[0963] Thus, the system of the present invention provides a variety of functions to comprehensively support the user's romantic activities and improve the user experience. Furthermore, by incorporating an emotion engine, it realizes personalized support that responds to the user's emotions.
[0964] The following describes the processing flow.
[0965] Matching function processing steps (emotion engine combination)
[0966] Step 1:
[0967] Device: The user launches the app and enters profile information (hobbies, interests, values, appearance, etc.).
[0968] Step 2:
[0969] Device: The user sets the criteria for their desired partner (age, hobbies, location, etc.).
[0970] Step 3:
[0971] Terminal: Sends the entered profile information and desired conditions to the server.
[0972] Step 4:
[0973] Server: Receives submitted profile information and preferences and stores them in the database.
[0974] Step 5:
[0975] Server: Runs an algorithm that matches the profile data of other users in the database and ranks the most suitable partners.
[0976] Step 6:
[0977] Server: Generates a ranked list of optimal partners and sends it to the terminal.
[0978] Step 7:
[0979] Terminal: Displays a list of recommended partners to the user.
[0980] Step 8:
[0981] Server: The emotion engine analyzes user responses in real time and evaluates the user's emotional state.
[0982] Step 9:
[0983] Server: Based on the evaluation results of the emotion engine, the generated partner list is adjusted as needed.
[0984] Step 10:
[0985] Terminal: Redisplay the adjusted partner list to the user.
[0986] Processing steps for the relationship counseling function (combination of emotional engines)
[0987] Step 1:
[0988] Device: The user launches the app and enters their relationship-related worries and questions.
[0989] Step 2:
[0990] Terminal: Sends the entered consultation details to the server.
[0991] Step 3:
[0992] Server: Receives the submitted consultation content and analyzes it using a natural language processing engine.
[0993] Step 4:
[0994] Server: Based on the analysis results, the AI counseling bot generates appropriate questions and presents them to the user.
[0995] Step 5:
[0996] Terminal: Displays questions from the AI to the user and receives the user's response.
[0997] Step 6:
[0998] Terminal: Sends the user's response to the server.
[0999] Step 7:
[1000] Server: Analyzes user responses and generates more specific counseling advice.
[1001] Step 8:
[1002] Server: The emotion engine monitors the user's emotional state in real time and dynamically adjusts counseling advice according to the user's stress level and emotions.
[1003] Step 9:
[1004] Server: Sends the generated counseling advice to the terminal.
[1005] Step 10:
[1006] Terminal: Displays counseling advice to the user.
[1007] Processing steps for the conversation training function (combination of emotion engines)
[1008] Step 1:
[1009] Device: The user launches the app and selects a conversation scenario or theme.
[1010] Step 2:
[1011] Terminal: Sends the selected scenario or theme to the server.
[1012] Step 3:
[1013] Server: Based on the submitted scenarios and themes, the AI chatbot generates simulated conversations.
[1014] Step 4:
[1015] Server: Sends the generated simulated conversation start message to the terminal.
[1016] Step 5:
[1017] Terminal: Displays a message to the user to initiate a simulated conversation and receives the user's response.
[1018] Step 6:
[1019] Terminal: Sends user responses to the server.
[1020] Step 7:
[1021] Server: Analyzes user responses and generates appropriate replies.
[1022] Step 8:
[1023] Server: Sends the generated response to the terminal.
[1024] Step 9:
[1025] Terminal: Displays the response to the user.
[1026] Step 10:
[1027] Server: During a conversation session, the emotion engine analyzes the user's facial expressions and tone of voice in real time and adjusts the chatbot's response based on the user's emotional changes.
[1028] Step 11:
[1029] Server: After the conversation session ends, it analyzes the entire conversation and generates an evaluation and feedback.
[1030] Step 12:
[1031] Server: Sends the generated ratings and feedback to the terminal.
[1032] Step 13:
[1033] Device: Displays ratings and feedback to the user.
[1034] Processing steps of the mental care function (combination of emotional engines)
[1035] Step 1:
[1036] Device: The user launches the app and inputs their mental state and stress level.
[1037] Step 2:
[1038] Terminal: Sends the entered mental state and stress level to the server.
[1039] Step 3:
[1040] Server: Receives transmitted data and evaluates it using the analysis engine.
[1041] Step 4:
[1042] Server: Generates appropriate mental health advice based on the analysis results.
[1043] Step 5:
[1044] Server: The emotion engine continuously monitors the user's emotional state and, if necessary, suggests additional advice or stress management methods.
[1045] Step 6:
[1046] Server: Sends the generated mental health advice to the terminal.
[1047] Step 7:
[1048] Terminal: Displays mental health advice to the user.
[1049] Processing steps for the fashion advice function (combination of emotional engines)
[1050] Step 1:
[1051] Device: The user launches the app and enters the date scenario.
[1052] Step 2:
[1053] Terminal: Sends the entered dating scenario to the server.
[1054] Step 3:
[1055] Server: Receives the transmitted situation data and searches for appropriate fashion items.
[1056] Step 4:
[1057] Server: Generates optimal fashion style suggestions based on search results.
[1058] Step 5:
[1059] Server: Sends fashion item suggestions and purchase links to the device.
[1060] Step 6:
[1061] Terminal: Displays fashion item suggestions and purchase links to the user.
[1062] Step 7:
[1063] Server: The emotion engine analyzes user reactions in real time and adjusts the suggestions provided to match the user's preferences.
[1064] (Example 2)
[1065] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[1066] Traditional dating support systems have limitations, offering only simple matching based on user profiles and fixed counseling advice, failing to respond to users' emotional states and real-time changes. Furthermore, conversational training often provides only one-sided feedback that ignores the user's evolving emotions. A system is needed to address these challenges and provide more personalized support.
[1067] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[1068] In this invention, the server includes means for collecting user profile data and the conditions desired in a partner; means for storing the collected data in a database; means for ranking and recommending the most suitable partner based on the stored data using an algorithm; means for providing the generated recommendation list to the user terminal; and means for adjusting the recommendation results using an emotion engine that analyzes the user's reactions. This enables personalized partner recommendations that are tailored to the user's emotional state.
[1069] Furthermore, the server includes means for analyzing the relationship consultation content entered by the user using natural language processing technology and generating counseling results, means for providing the generated counseling results to the user's terminal, and means for monitoring the user's emotional state in real time and dynamically adjusting the counseling results. This enables the provision of dynamic counseling advice that responds to changes in the user's emotions.
[1070] The server also includes means for the user to select a conversation scenario or theme, means for generating a simulated conversation based on the selected scenario, means for generating an evaluation and feedback on the simulated conversation, means for providing the generated evaluation and feedback to the user terminal, and means for analyzing the user's emotional state during the conversation and adjusting the responses in the simulated conversation in real time. This enables the provision of real-time responses and feedback that correspond to the user's emotional state during conversation training.
[1071] "User profile data" refers to personal information that users provide to the system, including information such as hobbies, interests, values, and appearance.
[1072] "Desired partner characteristics" refer to the qualities and requirements of a partner that the user desires, including information such as age, hobbies, and place of residence.
[1073] "Means of collection" include interfaces for users to input information, as well as software and hardware for receiving that information.
[1074] "Means of storing in a database" include storage systems and database management systems for storing received user profile data and the conditions that users seek in a partner.
[1075] "Methods of ranking and recommending using algorithms" refer to the process of using AI algorithms to rank and recommend the most suitable partner candidates based on information stored in a database.
[1076] "Means for providing the generated recommendation list to the user terminal" includes software and hardware for transmitting and displaying the partner recommendation list generated by the server to a device accessible to the user.
[1077] "Methods for adjusting recommendation results using an emotion engine" refer to systems where the emotion engine analyzes the user's emotional state and adjusts the recommendation results and information provided in real time based on the results.
[1078] "A means of analyzing relationship-related consultation content using natural language processing technology and generating counseling results" refers to a process that uses AI and natural language processing technology to analyze relationship-related consultation content entered by a user and generate appropriate counseling advice.
[1079] "Means for providing generated counseling results to the user terminal" includes software and hardware for transmitting and displaying the counseling results generated by the server to the user's device.
[1080] "A means of monitoring the user's emotional state in real time and dynamically adjusting counseling results" refers to a system where the emotion engine detects the user's emotional state in real time and adjusts counseling advice as needed based on the results.
[1081] "Means for selecting a conversation scenario or theme" includes interfaces or software that allow the user to select a specific conversation scenario or theme.
[1082] "Means for generating simulated conversations based on selected scenarios" refers to the process of generating simulated conversations using AI or chatbot technology based on selected conversation scenarios or themes.
[1083] "Means for generating evaluations and feedback on simulated conversations" include software and algorithms for analyzing the content of simulated conversations and generating evaluations and feedback thereon.
[1084] "Means for providing generated evaluations and feedback to the user terminal" include software and hardware for sending and displaying conversation evaluations and feedback generated by the server to the user's device.
[1085] "A means of analyzing the user's emotional state during a conversation and adjusting the responses in a simulated conversation in real time" refers to a function in which an emotion engine analyzes the user's facial expressions and tone of voice during a conversation, and adjusts the content and responses of the simulated conversation in real time based on the results.
[1086] This invention is a system that supports users' romantic activities from multiple angles. The system has the function of collecting the user's profile data and desired partner criteria and recommending the most suitable partner. Furthermore, it has a series of functions that provide relationship counseling, conversation training, mental care, and fashion advice for dating.
[1087] User profile collection and partner matching
[1088] First, the device prompts the user to input profile data (hobbies, interests, values, appearance, etc.). This data is sent to the server via the device and stored in a database. Based on the stored data, the server uses an AI algorithm (e.g., a mutual recommendation algorithm) to match it with other user information in the database and rank the most suitable partners. The generated partner list is displayed to the user via the device. An emotion engine (e.g., facial recognition using OpenCV and the Google Cloud Speech-to-Text API) is used to analyze the user's responses in real time and adjust the recommendation results.
[1089] For example, if a user enters "a woman in her 30s who enjoys reading and the outdoors" as their desired criteria, the server searches the database, generates a list of matching women, and displays it on the terminal.
[1090] Example of a prompt:
[1091] "Looking for a woman in her 30s who enjoys the outdoors and reading."
[1092] Relationship counseling
[1093] When a user enters their relationship problems or questions into their device, the device sends that information to a server. The server analyzes the questions using natural language processing technology (e.g., Google Cloud Natural Language) and generates appropriate counseling advice. The generated advice is sent to the device and presented to the user. An emotion engine monitors the user's emotional state in real time and dynamically adjusts the counseling advice according to their stress level and emotions.
[1094] For example, if a user enters a question like, "I'm having trouble communicating with him," the AI will offer advice such as, "Why not try exploring his hobbies in more depth to increase the number of topics you have in common?"
[1095] Example of a prompt:
[1096] "I'm having trouble communicating with him."
[1097] Conversation training
[1098] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction), the device sends its selection to the server. The server generates a simulated conversation using an AI chatbot (e.g., OpenAI's GPT-3). This simulated conversation is exchanged with the user in real time through the device. During the conversation, an emotion engine analyzes the user's facial expressions and tone of voice, adjusting the conversational responses accordingly. After the conversation ends, the server analyzes the conversation content, generates an evaluation and feedback, and sends it to the device.
[1099] As a concrete example, when a user is practicing conversation for a first date, they are instructed to "introduce yourself," and then given a simulated conversation followed by evaluation and feedback.
[1100] Example of a prompt:
[1101] "I want to practice conversation for first dates."
[1102] Mental care
[1103] When a user inputs their mental state and stress level into the device, the device sends this information to a server. The server analyzes this data and generates appropriate mental care advice. An emotion engine continuously monitors the user's emotional state and provides additional advice as needed. This advice includes suggestions for stress management and relaxation methods (e.g., breathing exercises, meditation) and is provided to the user through the device.
[1104] For example, if a user enters "I'm stressed," the server will suggest breathing exercises and meditation techniques.
[1105] Example of a prompt:
[1106] "I feel stressed."
[1107] Fashion advice
[1108] When a user enters a date scenario (e.g., a casual lunch date) into the device, the device sends this information to the server. The server searches for fashion items appropriate for the situation and generates suggestions for the best outfit. The suggestions include specific item names and links to purchase them. The device displays these suggestions to the user, who can then purchase the suggested items. Furthermore, an emotion engine analyzes the user's reactions and adjusts the suggestions to match the user's preferences.
[1109] For example, if a user enters "casual lunch date," the server will suggest casual attire and provide purchase links.
[1110] Example of a prompt:
[1111] "Suggestions for casual lunch date outfits"
[1112] In this way, the system comprehensively supports users' romantic activities and provides a variety of functions to improve the user experience. By incorporating an emotion engine, it enables personalized support that responds to the user's emotions.
[1113] The flow of the specific processing in Example 2 will be explained using Figure 13.
[1114] Step 1:
[1115] The user enters their profile data and partner preferences.
[1116] Input: Hobbies, interests, values, appearance, and desired partner characteristics (e.g., age, hobbies, location, etc.)
[1117] Operation: Users input this information through a smartphone or PC interface.
[1118] Output: The collected user profile data and partner conditions are stored on the device.
[1119] Step 2:
[1120] The device sends data to the server.
[1121] Input: Profile data and partner conditions entered in Step 1.
[1122] Operation: The terminal uses the HTTPS protocol to encrypt and send the entered data to the server.
[1123] Output: Profile data and partner conditions received by the server
[1124] Step 3:
[1125] The server saves the data to the database.
[1126] Input: Profile data and partner conditions sent from the device.
[1127] Operation: The server uses a database management system (e.g., MySQL, PostgreSQL) to store data in the database.
[1128] Output: User profile data and partner conditions stored in the database
[1129] Step 4:
[1130] The server uses an algorithm to rank and recommend the most suitable partners.
[1131] Input: Profile data of all users stored in the database and partner conditions
[1132] Operation: The server runs an AI algorithm (e.g., a mutual recommendation algorithm) to rank the best partner candidates.
[1133] Output: A list of the best partner for the user
[1134] Step 5:
[1135] The server sends the generated recommendation list to the terminal.
[1136] Input: Optimal partner list
[1137] Operation: The server generates a recommendation list in JSON format and sends it to the terminal.
[1138] Output: Partner list received by the terminal
[1139] Step 6:
[1140] The device displays a list of partners to the user.
[1141] Input: Partner list received from the server
[1142] Operation: The terminal displays the partner list in list format via a GUI.
[1143] Output: The partner list is displayed to the user.
[1144] Step 7:
[1145] The emotion engine analyzes user reactions.
[1146] Input: User's facial expressions and voice tone data
[1147] Operation: The emotion engine (e.g., OpenCV, Google Cloud Speech-to-Text API) uses the camera and microphone to analyze the user's emotional state in real time.
[1148] Output: Evaluation results of the user's emotional state
[1149] Step 8:
[1150] The server uses sentiment data to adjust the results.
[1151] Input: Emotional state assessment results and initial recommendation list
[1152] Operation: The server readjusts the recommendation list based on the evaluation results of the emotional state and generates a new recommendation list.
[1153] Output: The revised recommendation list and its display results
[1154] Step 9:
[1155] Users enter their relationship problems and questions.
[1156] Input: User's concerns or questions (e.g., "I'm having trouble communicating with him")
[1157] Operation: The user enters their inquiry in text format via a terminal.
[1158] Output: The entered consultation details are stored on the terminal.
[1159] Step 10:
[1160] The device sends the consultation details to the server.
[1161] Input: Consultation details
[1162] Operation: The terminal sends the consultation details to the server. For security purposes, the data is encrypted using the HTTPS protocol.
[1163] Output: Consultation content received by the server
[1164] Step 11:
[1165] The server analyzes the consultation content using natural language processing technology and generates counseling results.
[1166] Input: Consultation details
[1167] Operation: The server uses natural language processing technology (e.g., Google Cloud Natural Language) to analyze the consultation content and generate counseling advice.
[1168] Output: Counseling advice
[1169] Step 12:
[1170] The server provides the generated counseling results to the terminal.
[1171] Input: Counseling advice
[1172] Operation: The server sends counseling advice to the terminal in JSON format.
[1173] Output: Counseling advice received by the device
[1174] Step 13:
[1175] The emotion engine monitors the user's emotional state in real time and dynamically adjusts the counseling results.
[1176] Input: Counseling advice, emotional data such as the user's face and voice.
[1177] Operation: The emotion engine dynamically adjusts counseling advice based on the received emotion data.
[1178] Output: Adjusted counseling advice
[1179] Step 14:
[1180] The user selects a conversation scenario or theme.
[1181] Input: Conversation scenario or theme (e.g., "First Date," "Self-Introduction")
[1182] Operation: The user selects a conversation scenario or theme from a list on their device.
[1183] Output: Selected scenarios and themes
[1184] Step 15:
[1185] The device sends its selections to the server.
[1186] Input: Selected scenario or theme
[1187] Operation: The terminal sends the selection to the server.
[1188] Output: Selections received by the server
[1189] Step 16:
[1190] The server generates a simulated conversation based on the selected scenario.
[1191] Input: Selected scenario or theme
[1192] Operation: The server uses an AI chatbot (e.g., OpenAI's GPT-3) to generate simulated conversations based on the selected scenario.
[1193] Output: Generated simulated conversation
[1194] Step 17:
[1195] The device displays a simulated conversation.
[1196] Input: Generated simulated conversation
[1197] Operation: The device interacts with the user in real time through simulated conversations and displays the results.
[1198] Output: A simulated conversation is displayed to the user.
[1199] Step 18:
[1200] The emotion engine analyzes the user's emotions during the conversation.
[1201] Input: User's facial expressions and voice tone data
[1202] Operation: The emotion engine analyzes the user's facial expressions and voice tone in real time through the camera and microphone.
[1203] Output: Evaluation results of the user's emotional state
[1204] Step 19:
[1205] The server analyzes the conversation and generates feedback.
[1206] Input: Simulation conversation and evaluation results of emotional state
[1207] Operation: The server generates evaluations and feedback based on the conversation content and sentiment assessment.
[1208] Output: Generated evaluations and feedback
[1209] Step 20:
[1210] The device provides generated ratings and feedback.
[1211] Input: Ratings and feedback
[1212] Operation: The server sends the generated evaluation and feedback to the terminal, which then provides it to the user.
[1213] Output: Ratings and feedback provided to users
[1214] These steps enable the system to provide comprehensive support for users in their romantic endeavors. Furthermore, the use of an emotion engine allows for real-time, personalized support.
[1215] (Application Example 2)
[1216] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[1217] Traditional dating support systems focused on collecting user profile data and partner preferences, and recommending suitable partners, but only provided users with lists based on this information. This resulted in a lack of real-time emotional responses and personalized, emotion-based support. Furthermore, there was a lack of systems that comprehensively offered diverse support such as dating counseling, conversation training, mental care, and fashion advice, forcing users to utilize multiple services. This led to an inconsistent user experience and made effective dating support difficult.
[1218] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[1219] In this invention, the server includes means for collecting user profile data and the conditions desired in a partner; means for storing the received profile data and conditions in a database and recommending the most suitable partner; means for providing the generated recommendation list to the user terminal; means including an emotion engine that analyzes the user's emotional state in real time; and means for adjusting the recommendation list based on the analysis results of the emotion engine. This enables the recommendation of the most suitable partner according to the user's emotional state. In addition, the server includes means for collecting the content of consultations about love entered by the user; means for analyzing the collected consultation content using natural language processing and generating counseling results; means for providing the generated counseling results to the user terminal; means including an emotion engine that monitors the user's emotional state in real time; and means for dynamically adjusting the counseling results according to the emotional state. This enables counseling according to the user's real-time emotional state. Furthermore, the server includes means for selecting a conversation scenario or theme; means for generating a simulated conversation based on the selected scenario; means including an emotion engine that analyzes the user's emotional state; means for adjusting the responses of the simulated conversation based on the emotional state; means for generating evaluations and feedback on the simulated conversation; and means for providing the generated evaluations and feedback to the user terminal. This enables appropriate conversation training that responds to changes in the user's emotions.
[1220] A "user profile" is data that includes personal information such as a user's hobbies, interests, values, and appearance.
[1221] "Desired partner criteria" refers to data that includes information such as the user's desired partner's age, hobbies, and location.
[1222] A "database" is a system for organizing and storing information such as collected user profiles and the requirements for partners.
[1223] The "recommendation list" is a list of the most suitable partners, generated based on the user's profile data and the criteria they have for a partner.
[1224] An "emotion engine" is a system that analyzes a user's facial expressions and voice tone to evaluate their emotional state in real time.
[1225] "Natural language processing" is a technology that enables computers to understand, analyze, and generate human language.
[1226] "Counseling" is the process of providing appropriate advice and solutions to users' relationship problems and concerns.
[1227] A "simulated conversation" is a virtual dialogue conducted using an AI chatbot based on a scenario or theme chosen by the user.
[1228] A "conversation scenario or theme" refers to a specific situation or topic that the user chooses during a simulated conversation.
[1229] "Evaluation and Feedback" refers to the evaluation of the user's conversational skills and advice on areas for improvement, generated after the completion of a simulated conversation.
[1230] "Dynamic adjustment" means appropriately changing the system's output (e.g., counseling results or responses in simulated conversations) according to the user's real-time emotional state.
[1231] The system program for implementing this invention integrates a wide range of functions to comprehensively support the user's romantic activities. The main hardware used includes user terminals (smartphones, tablets, personal computers, etc.) and a server, while the software includes an emotion engine, a natural language processing engine, and an AI chatbot.
[1232] The server has the means to collect user profile data and the criteria they seek in a partner. Users input information such as hobbies, interests, values, and appearance using their device. This data is immediately sent to the server and stored in the database. In addition, the criteria the user desires for a partner (age, hobbies, location, etc.) are also sent to the server and managed in the database.
[1233] The server performs partner matching based on the collected data and generates a list of optimal partners. This process utilizes an algorithm based on a neural network. The generated recommendation list is then refined through an emotion engine that analyzes the user's emotional state in real time. The emotion engine analyzes the user's facial expressions, input speed, etc., and finally provides the refined list to the user's terminal.
[1234] The server also provides a counseling function. When a user enters their relationship problems into their device, this information is sent to the server. The server uses a natural language processing engine to analyze the input and generate appropriate counseling advice. An emotion engine monitors the user's emotional state and dynamically adjusts the counseling results as needed. These results are sent to the user's device and displayed to the user.
[1235] Furthermore, the server provides conversation training. When a user selects a specific conversation scenario or theme, that selection is sent to the server. The server uses a generative AI model (e.g., GPT-3) to generate a simulated conversation, enabling real-time interaction between the user and the AI chatbot. During this simulated conversation, an emotion engine analyzes the user's emotional state in real time and adjusts the AI chatbot's responses accordingly. After the conversation ends, the server analyzes the entire conversation, generates an evaluation and feedback, and provides it to the user's terminal.
[1236] As a concrete example, when a user enters "a woman in her 30s who likes the outdoors and enjoys reading" as their desired criteria, the system works as follows:
[1237] 1. Prompt message when collecting profile information:
[1238] Please enter your hobby: Outdoors
[1239] Please enter your interest: Reading
[1240] Please enter your values: Inner fulfillment
[1241] 2. Prompts during counseling:
[1242] I'm having trouble communicating with him.
[1243] 3. Prompt sentences during conversation training:
[1244] Please select a scenario for your first date: Self-introduction
[1245] In this way, a system that comprehensively supports users' romantic activities is realized.
[1246] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[1247] Step 1:
[1248] Users enter their profile data (hobbies, interests, values, appearance, etc.) and the criteria they seek in a partner (age, hobbies, location, etc.) into their device. The entered data is immediately sent to the server and stored in the database. This allows user profiles and partner criteria to be aggregated on the server.
[1249] Step 2:
[1250] The server searches other user data in the database to find the best match based on the aggregated user profiles and partner criteria. Specifically, it runs an algorithm using a neural network to find the best partner that matches the user's profile data. The recommendation list generated as a result of the search results is temporarily stored.
[1251] Step 3:
[1252] The server uses an emotion engine to analyze the user's emotional state in real time. Specifically, it analyzes the user's facial expressions and voice data to evaluate the user's current mood, level of excitement, and stress level. This emotional state is then quantified and recorded. The emotion engine uses an open-source emotion analysis module.
[1253] Step 4:
[1254] The server uses the emotion engine's analysis results to adjust the generated recommendation list. Specifically, it makes adjustments necessary to provide the best possible match based on the user's emotional state. For example, if the user is stressed, new suggestions may be added, or certain matching results may be excluded based on the user profile. The adjusted recommendation list is then finalized.
[1255] Step 5:
[1256] A refined recommendation list is sent from the server to the user's device and displayed to them. The user can review this list and select a suitable partner.
[1257] Step 6:
[1258] When a user enters their relationship problems or questions into their device, that information is sent to a server. The server uses a natural language processing engine to analyze the entered questions and generate appropriate counseling advice. The generated counseling advice is dynamically adjusted as needed, taking into account the user's emotional state.
[1259] Step 7:
[1260] The generated counseling results are sent from the server to the terminal and provided to the user. The user can use the counseling results to help resolve their relationship problems.
[1261] Step 8:
[1262] When a user selects a conversation scenario or theme, that selection is sent to the server. The server uses a generative AI model (e.g., GPT-3) to generate a simulated conversation based on the selected scenario. The AI chatbot then responds to the generated simulated conversation, taking into account how the user might emotionally react.
[1263] Step 9:
[1264] The server analyzes the simulated conversation and generates evaluations and feedback. Specifically, it analyzes the flow of the conversation and the user's utterances, providing feedback on what went well and what needs improvement. The generated evaluations and feedback are then provided to the device in a way that supports the user's learning.
[1265] Step 10:
[1266] When a user inputs their emotional and mental state, this information is sent to the server, which uses an emotion engine to perform an evaluation. Specific mental care advice (such as stress management and relaxation techniques) is then provided, and appropriate advice tailored to the user's condition is displayed on the device.
[1267] This allows users to receive consistent support and effectively advance their romantic activities.
[1268] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[1269] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1270] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.
[1271] [Third Embodiment]
[1272] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.
[1273] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[1274] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1275] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.
[1276] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[1277] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[1278] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[1279] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[1280] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1281] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1282] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[1283] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".
[1284] This invention relates to a system that supports users' romantic activities. This system collects the user's profile data and desired partner criteria, and recommends the most suitable partner based on this information. It also includes a range of functions providing relationship counseling, conversation training, mental care, and fashion advice for dates.
[1285] User profile collection and partner matching
[1286] First, the device prompts the user to input profile data (hobbies, interests, values, appearance, etc.). This data is sent from the device to the server and stored in a database. The user also sets criteria for their desired partner (age, hobbies, region, etc.). The server uses this data to compare it with information from other users in the database and runs an algorithm to rank the most suitable partners. This algorithm generates a list of the most suitable partners for the user and sends it to the device. The device then displays this list to the user.
[1287] Relationship counseling
[1288] When a user enters their relationship problems or questions, the device sends that information to the server. The server uses a natural language processing engine to analyze the questions and generate appropriate counseling advice. The generated advice is sent to the device and presented to the user. The server can also dynamically respond to the user's reactions and additional questions, providing even more specific advice.
[1289] Conversation training
[1290] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction), the device sends this selection to the server. The server then generates a simulated conversation using an AI chatbot based on this selection. This simulated conversation is conducted in real-time through the device. After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. This feedback is sent to the device and provided to the user.
[1291] Mental care
[1292] When a user inputs their mental state and stress level, the device sends this information to a server. The server analyzes this data and generates appropriate mental health advice. This advice includes suggestions for stress management and relaxation methods (e.g., breathing exercises, meditation) and is provided to the user through the device.
[1293] Fashion advice
[1294] When a user enters a date scenario (e.g., a casual lunch date), the device sends this information to the server. The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. These suggestions include specific items and links to online shops where they can be purchased. The device displays these suggestions to the user, who can then purchase the suggested items.
[1295] For example, if a user enters the criteria "a woman in her 30s who likes the outdoors and enjoys reading," the server searches the database, generates a list of matching women, and displays it on the device. Also, if a user enters a question about "difficulty communicating with a boyfriend," the AI will advise, "Why not try exploring his hobbies to increase common topics of conversation?" Furthermore, when a user is practicing conversation for a first date, the AI will instruct them to "introduce yourself," guide them through a simulated conversation, and provide evaluation and feedback.
[1296] Thus, the system of the present invention provides a variety of functions to comprehensively support the user's romantic activities and improve the user experience.
[1297] The following describes the processing flow.
[1298] Matching function processing steps
[1299] Step 1:
[1300] Device: The user launches the app and enters profile information (hobbies, interests, values, appearance, etc.).
[1301] Step 2:
[1302] Device: The user sets the criteria for their desired partner (age, hobbies, location, etc.).
[1303] Step 3:
[1304] Terminal: Sends the entered profile information and desired conditions to the server.
[1305] Step 4:
[1306] Server: Receives submitted profile information and preferences and stores them in the database.
[1307] Step 5:
[1308] Server: Runs an algorithm to rank the best partners by matching the profile data of other users in the database.
[1309] Step 6:
[1310] Server: Generates a ranked list of optimal partners and sends it to the terminal.
[1311] Step 7:
[1312] Terminal: Displays a list of recommended partners to the user.
[1313] Processing steps for the relationship counseling function
[1314] Step 1:
[1315] Device: The user launches the app and enters their relationship-related worries and questions.
[1316] Step 2:
[1317] Terminal: Sends the entered consultation details to the server.
[1318] Step 3:
[1319] Server: Receives the submitted consultation content and analyzes it using a natural language processing engine.
[1320] Step 4:
[1321] Server: Based on the analysis results, the AI counseling bot generates appropriate questions and presents them to the user.
[1322] Step 5:
[1323] Terminal: Displays questions from the AI to the user and receives the user's response.
[1324] Step 6:
[1325] Terminal: Sends the user's response to the server.
[1326] Step 7:
[1327] Server: Analyzes user responses and generates more specific counseling advice.
[1328] Step 8:
[1329] Server: Sends the generated counseling advice to the terminal.
[1330] Step 9:
[1331] Terminal: Displays counseling advice to the user.
[1332] Processing steps for the conversation training function
[1333] Step 1:
[1334] Device: The user launches the app and selects a conversation scenario or theme.
[1335] Step 2:
[1336] Terminal: Sends the selected scenario or theme to the server.
[1337] Step 3:
[1338] Server: Based on the submitted scenarios and themes, the AI chatbot generates simulated conversations.
[1339] Step 4:
[1340] Server: Sends the generated simulated conversation start message to the terminal.
[1341] Step 5:
[1342] Terminal: Displays a message to the user to initiate a simulated conversation and receives the user's response.
[1343] Step 6:
[1344] Terminal: Sends user responses to the server.
[1345] Step 7:
[1346] Server: Analyzes user responses and generates appropriate replies.
[1347] Step 8:
[1348] Server: Sends the generated response to the terminal.
[1349] Step 9:
[1350] Terminal: Displays the response to the user.
[1351] Step 10:
[1352] Server: After the conversation session ends, it analyzes the entire conversation and generates an evaluation and feedback.
[1353] Step 11:
[1354] Server: Sends the generated ratings and feedback to the terminal.
[1355] Step 12:
[1356] Device: Displays ratings and feedback to the user.
[1357] Processing steps of the mental care function
[1358] Step 1:
[1359] Device: The user launches the app and inputs their mental state and stress level.
[1360] Step 2:
[1361] Terminal: Sends the entered mental state and stress level to the server.
[1362] Step 3:
[1363] Server: Receives transmitted data and evaluates it using the analysis engine.
[1364] Step 4:
[1365] Server: Generates appropriate mental health advice based on the analysis results.
[1366] Step 5:
[1367] Server: Sends the generated mental health advice to the terminal.
[1368] Step 6:
[1369] Terminal: Displays mental health advice to the user.
[1370] Processing steps for the fashion advice function
[1371] Step 1:
[1372] Device: The user launches the app and enters the date scenario.
[1373] Step 2:
[1374] Terminal: Sends the entered dating scenario to the server.
[1375] Step 3:
[1376] Server: Receives the transmitted situation data and searches for appropriate fashion items.
[1377] Step 4:
[1378] Server: Generates optimal fashion style suggestions based on search results.
[1379] Step 5:
[1380] Server: Sends fashion item suggestions and purchase links to the device.
[1381] Step 6:
[1382] Terminal: Displays fashion item suggestions and purchase links to the user.
[1383] (Example 1)
[1384] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[1385] In modern society, many people face various worries and challenges related to love and interpersonal relationships. In particular, there is a need for a wide range of support, including assistance with selecting a suitable partner, relationship counseling, improving conversation skills, mental health care, and fashion advice for dates. However, a system that provides comprehensive and effective solutions to these problems is still lacking. This invention aims to solve these problems in a unified manner and provide comprehensive support for users' romantic activities.
[1386] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[1387] In this invention, the server includes means for collecting user profile data and the conditions desired in a partner; means for storing the received profile data and conditions in a database and recommending the most suitable partner using an algorithm; means for providing the generated recommendation list to the user terminal; means for collecting the user's consultation content, analyzing it using natural language processing, and generating counseling results; means for providing the generated counseling results to the user terminal; means for selecting a conversation scenario or theme; means for generating a simulated conversation using a generative AI model based on the selected scenario; means for generating an evaluation and feedback on the simulated conversation; means for providing the generated evaluation and feedback to the user terminal; means for collecting and analyzing the user's mental state and stress level to generate mental care advice; means for providing the generated mental care advice to the user terminal; means for the user to input a dating situation, search for fashion items appropriate to that situation, and generate clothing suggestions; and means for providing the generated fashion suggestions to the user terminal. This makes it possible to comprehensively support the user's romantic activities, providing consistent support from various consultations and skill improvement to mental care and date preparation.
[1388] A "user profile" refers to data that contains personal information about a user, such as their hobbies, interests, values, and appearance.
[1389] "Desired partner characteristics" refers to information that describes the specific traits and qualifications of the ideal partner the user desires, such as age, hobbies, and location.
[1390] A "database" is a structured data storage system used to store, manage, and retrieve user profile data, partner conditions, and other relevant information within a system.
[1391] An "algorithm" refers to a series of steps or computational methods for solving a specific problem, and in this case, it is a mathematical model or program for recommending the optimal partner.
[1392] "Counseling results" refer to information generated by analyzing the consultation content collected from users using natural language processing, in order to provide appropriate advice and guidance.
[1393] Natural Language Processing (NLP) is a collection of technologies that enable computers to understand, analyze, and generate human language.
[1394] A "generative AI model" refers to a method for cultivating artificial intelligence that generates new data based on a large dataset that has been trained on in advance.
[1395] "Simulated conversation" refers to a virtual dialogue that a user engages in with an AI based on a specific scenario, with the aim of improving conversational skills.
[1396] "Evaluation and feedback" refers to constructive opinions and suggestions for improvement provided as a result of analysis of simulated conversations and other user behaviors.
[1397] "Mental care advice" refers to information that analyzes the user's mental state and stress level, and suggests appropriate care methods and relaxation techniques.
[1398] A "situation" refers to a specific scene or environment that a user faces in a particular purpose or situation.
[1399] "Fashion items" refer to specific fashion-related products, such as clothing and accessories, that are used on dates or in specific situations.
[1400] "User terminal" refers to electronic devices such as personal computers, smartphones, and tablets that users use to interact with this system.
[1401] This invention is a system that supports users' romantic activities and includes functions such as user profile collection and partner matching, relationship counseling, conversation training, mental care, and fashion advice for dating.
[1402] User profile collection and partner matching
[1403] First, the device prompts the user to input the following profile information (hobbies, interests, values, appearance, etc.). This data is sent from the device to the server and stored in a database. The user can also set criteria for their desired partner (age, hobbies, region, etc.). The server uses this data and an algorithm to match it with other user information in the database and rank the most suitable partners. This ranking algorithm can use, for example, SQL queries or machine learning models. The generated partner list is sent to the device, which then displays it to the user.
[1404] Specific example:
[1405] Prompt: If you enter "a woman in her 30s who likes the outdoors and enjoys reading" as your desired criteria, the server will search the database and list women who meet those criteria.
[1406] Relationship counseling
[1407] When a user enters their relationship problems or questions into a device, the device sends the information to a server. The server uses a natural language processing (NLP) engine to analyze the questions and generate appropriate counseling advice. For example, a generative AI model may be used to generate the advice. This generated advice is sent to the device, which then presents it to the user. The server then dynamically responds to the user's reactions and additional questions to provide more specific advice.
[1408] Specific example:
[1409] Prompt message: If you enter a question such as "I'm having trouble communicating with him," the AI will analyze it and provide advice such as "Why not try exploring his hobbies in more depth to increase the number of topics you have in common?"
[1410] Conversation training
[1411] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction) from their device, the device sends this selection to the server. The server uses a generative AI model to generate a simulated conversation scenario and sends it to the device. The user can then engage in a real-time simulated conversation with the chatbot through their device. After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. This feedback is sent to the device and provided to the user.
[1412] Specific example:
[1413] Prompt: Select "First Date Conversation Training," and you will be instructed to "Introduce Yourself," and you will proceed with the conversation with the chatbot.
[1414] Mental care
[1415] When a user inputs their mental state and stress level into a device, that information is sent to a server. The server analyzes this data and generates appropriate mental care advice. The generated advice includes stress management and relaxation methods (e.g., breathing exercises, meditation). This advice is provided to the user through the device, and the user can practice self-care according to the advice.
[1416] Specific example:
[1417] Prompt: If you enter "high" for your stress level, the server will generate suggestions for breathing exercises and meditation.
[1418] Fashion advice
[1419] When a user enters a date scenario (e.g., a casual lunch date) into the device, that information is sent to the server. The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. These suggestions include specific items and links to online shops where they can be purchased. The device displays these suggestions to the user, who can then purchase the suggested items.
[1420] Specific example:
[1421] Prompt: When you enter "casual lunch date" as the date scenario, the server will suggest appropriate attire.
[1422] As described above, this system is designed to comprehensively support all aspects of a user's romantic activities, with each function working together to improve the user experience. This system makes it easier for users to find a suitable partner and provides consistent support for various relationship-related concerns and worries.
[1423] The flow of the specific processing in Example 1 will be explained using Figure 11.
[1424] Step 1:
[1425] User input
[1426] The device prompts the user to input profile data (hobbies, interests, values, appearance, etc.). The user enters their profile information into a text box using a smartphone app. This input data is used in subsequent processing steps.
[1427] Step 2:
[1428] Data transmission
[1429] The device sends the entered profile data to the server. Specifically, when the user presses the "Send" button, the device sends data to the server via an HTTP POST request. The received data is stored in the server's database and used as input data for subsequent algorithmic processing.
[1430] Step 3:
[1431] Setting desired conditions
[1432] Users set their desired partner criteria (age, hobbies, location, etc.). Users select criteria using dropdown menus or checkboxes. This criteria data then becomes the input for the matching algorithm.
[1433] Step 4:
[1434] Partner Matching
[1435] The server executes an algorithm to match the user's profile data and preferences with other user information in the database. Specifically, it uses SQL queries and machine learning models to search the database for relevant profiles and ranks the most suitable partners. This calculation result is generated as a list of suitable partners.
[1436] Step 5:
[1437] Results display
[1438] The server sends the generated partner list to the device, which then displays it to the user. The device screen displays a list of matching users' photos and profile information.
[1439] Step 6:
[1440] Enter your consultation details
[1441] The user enters their relationship problems or questions into the device. The user enters their problem in the text area and presses the "Send" button.
[1442] Step 7:
[1443] Data transmission
[1444] The terminal sends that information to the server. Specifically, data is sent from the terminal to the server via an HTTP POST request. This data becomes the input for the next analysis process.
[1445] Step 8:
[1446] Analysis of consultation content
[1447] The server uses a natural language processing (NLP) engine to analyze the consultation content and generate appropriate counseling advice. The server sends the submitted text to an NLP API and receives the analysis results. The generated advice is output as follows.
[1448] Step 9:
[1449] Send advice
[1450] The server sends the generated advice to the terminal, which then displays it to the user. The user reads the advice displayed on the terminal's screen.
[1451] Step 10:
[1452] Dynamic response
[1453] The server dynamically responds to user feedback and additional questions, providing more specific advice. The user enters additional questions, the server uses its NLP engine to analyze them again, and generates and sends new advice.
[1454] Step 11:
[1455] Theme Selection
[1456] The user selects a specific conversation scenario or theme (e.g., first date, self-introduction). The user selects the theme from the app's UI.
[1457] Step 12:
[1458] Data transmission
[1459] The device sends the selection to the server. After selecting a theme, the device sends data to the server via an HTTP POST request.
[1460] Step 13:
[1461] Simulated conversation generation
[1462] The server generates simulated conversation scenarios using a generative AI model. The server calls a chatbot API to generate the conversation scenarios. These simulated conversations become the next output data.
[1463] Step 14:
[1464] Real-time conversation
[1465] The device engages in a simulated conversation with the user in real time. The user conducts the conversation with the chatbot within the app.
[1466] Step 15:
[1467] Analysis and Feedback
[1468] After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. The server analyzes the user's statements and generates feedback such as "You should speak more concisely." This feedback becomes the output result.
[1469] Step 16:
[1470] Provide feedback
[1471] The device provides the generated feedback to the user. The user reads the feedback displayed on the device screen.
[1472] Step 17:
[1473] Mental state input
[1474] The user inputs their mental state and stress level into the device. The user evaluates and inputs their stress level using sliders and radio buttons.
[1475] Step 18:
[1476] Data transmission
[1477] The device sends that information to the server. Once you have finished entering the information, press the "Send" button to send the data to the server.
[1478] Step 19:
[1479] Data Analysis
[1480] The server analyzes the data and generates appropriate mental health advice. The server then generates suggestions for relaxation methods based on stress levels. These suggestions become the next output data.
[1481] Step 20:
[1482] Providing advice
[1483] The server sends the generated advice to the terminal, which then provides it to the user. The user then acts on the advice displayed on the terminal screen.
[1484] Step 21:
[1485] Situation Input
[1486] The user enters the date scenario (e.g., casual lunch date) into their device. The user then selects the scenario within the app.
[1487] Step 22:
[1488] Data transmission
[1489] The terminal sends the entered situation information to the server. After selection, the terminal sends data to the server via an HTTP POST request.
[1490] Step 23:
[1491] Fashion proposal generation
[1492] The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. The server calls the online shop's API and lists the items. These suggestions become the next output data.
[1493] Step 24:
[1494] Suggestion display
[1495] The server sends the generated suggestions to the terminal, which then displays them to the user. The user then displays the suggested items on the terminal screen, and a purchase link is also provided.
[1496] In this way, each processing step collects data based on user input, performs analysis and recommendations on the server side, and provides the results to the user. This makes it possible to support the user's dating activities and provide optimal advice in various situations.
[1497] (Application Example 1)
[1498] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[1499] Traditional dating support systems primarily offer partner recommendations and basic advice, but they fail to adequately address the diverse needs of users, such as providing specific date plans, fashion advice, conversation training, and mental care. As a result, users are unable to receive optimal support regarding dating and relationships, making it difficult for them to engage in effective dating activities.
[1500] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[1501] In this invention, the server includes means for collecting the user's profile data and the conditions they seek in a partner; means for storing the received profile data and conditions in a database and recommending the most suitable partner; means for providing the generated recommendation list to the user's terminal; and means for generating fashion advice tailored to the dating scenario and providing suggestions including links to online shopping sites. As a result, the user can receive appropriate fashion advice for their date and is also provided with links to online shopping sites to help them choose appropriate attire for the occasion, thereby enabling them to engage in dating activities more effectively.
[1502] The server also includes means for collecting relationship-related consultation content entered by users, means for analyzing the collected consultation content using natural language processing and generating counseling results, means for providing the generated counseling results to the user's terminal, and means for generating and providing advice on mental care. As a result, users can receive appropriate counseling and mental care for their relationship worries and anxieties, and continue their relationship activities with a sense of mental security.
[1503] Furthermore, the server includes means for selecting a conversation scenario or theme, means for generating a simulated conversation based on the selected scenario, means for generating an evaluation and feedback on the simulated conversation, means for providing the generated evaluation and feedback to the user terminal, and means for managing and updating fashion advice, counseling advice, mental care advice, and user data related to the simulated conversation. This allows users to practice conversations based on actual dating scenarios and, by receiving evaluations and feedback based on the results, to approach actual dates with greater confidence.
[1504] "User profile data" refers to data that shows basic information and attributes about a user, such as name, age, hobbies, interests, and values.
[1505] "Desired partner qualities" refer to specific attributes or requirements that a user looks for in their ideal partner, such as age, hobbies, and location.
[1506] A "database" is a system or structure for efficiently storing, managing, and retrieving information.
[1507] A "recommendation list" is a list of the most suitable partner candidates for the user, determined by an algorithm.
[1508] A "date scenario" refers to a specific date situation or setting, such as a "casual lunch date."
[1509] "Fashion advice" refers to advice that specifically suggests clothing and styles suitable for a particular situation.
[1510] An "online shopping link" is a web link to an online store where the user can purchase the suggested fashion items.
[1511] "Relationship-related consultation content" refers to the user's worries, questions, and specific inquiries regarding relationships.
[1512] "Natural language processing" is the technology that uses computers to understand and analyze human language.
[1513] "Counseling results" refer to the specific advice and solutions provided to users regarding their relationship problems.
[1514] "Mental care" refers to providing support related to the user's mental health and stress management.
[1515] A "conversation scenario or theme" refers to the setting or topic for a simulated conversation, such as "first date" or "self-introduction."
[1516] A "simulated conversation" is a virtual conversation generated to simulate a real-life conversation.
[1517] "Evaluation and feedback" refers to an analysis of the user's responses and areas for improvement based on the results of the simulated conversation.
[1518] "User terminal" refers to a device used by a user, and includes smartphones, tablets, personal computers, etc.
[1519] A "server" is a central computing system on a network used for processing and storing data.
[1520] "Means of management and updating" refer to methods and functions for properly maintaining data and information and reflecting new information and changes.
[1521] This invention is a system for comprehensively supporting users' romantic activities and has functions that respond to the individual needs of users. This system can be used by users via a user terminal such as a smartphone. Specific embodiments are described below.
[1522] System Configuration
[1523] This system primarily provides the following functions:
[1524] 1. User profile collection and partner matching
[1525] 2. Fashion advice
[1526] 3. Relationship counseling
[1527] 4. Mental care
[1528] 5. Conversation Training
[1529] User profile collection and partner matching
[1530] First, the user terminal prompts the user to input profile data (name, age, hobbies, interests, values, etc.). This data is sent from the terminal to the server and stored in a database. The user then sets criteria for their desired partner (age, hobbies, region, etc.). The server uses this data to compare it with information from other users in the database and runs an algorithm to rank the most suitable partners. This algorithm generates a list of the most suitable partners for the user and sends it to the terminal. The terminal then displays this list to the user.
[1531] Fashion advice
[1532] When a user enters a specific dating scenario (e.g., a casual lunch date), the device sends this information to the server. The server searches for fashion items appropriate for the situation and generates suggestions for the best outfit. These suggestions include specific items and links to online shopping sites to purchase them. The device displays these suggestions to the user, who can then purchase the suggested items.
[1533] Relationship counseling
[1534] When a user enters their relationship problems or questions, the device sends that information to the server. The server uses a natural language processing engine to analyze the questions and generate appropriate counseling advice. The generated advice is sent to the device and presented to the user. The server can also dynamically respond to the user's reactions and additional questions, providing even more specific advice.
[1535] Mental care
[1536] When a user inputs their mental state and stress level, the device sends this information to a server. The server analyzes this data and generates appropriate mental health advice. This advice includes suggestions for stress management and relaxation methods (e.g., breathing exercises, meditation) and is provided to the user through the device.
[1537] Conversation training
[1538] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction), the device sends this selection to the server. The server then generates a simulated conversation using an AI chatbot based on this selection. This simulated conversation is conducted in real-time through the device. After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. This feedback is sent to the device and provided to the user.
[1539] Hardware and software to be used
[1540] Hardware: Smartphones, tablets, personal computers
[1541] Software: Python (data processing), requests library (API communication), natural language processing engine (e.g., Hugging Face's Transformers)
[1542] Specific example
[1543] For example, if a user enters "a woman in her 30s who likes the outdoors and enjoys reading" as their desired criteria, the server searches the database, generates a list of matching women, and displays it on the terminal. Furthermore, if the user enters "I'm planning a casual lunch date for a first date," the system generates appropriate fashion advice and provides it along with links to online shops.
[1544] Furthermore, if a user enters a request to "practice conversation," the server generates a simulated conversation using a first date scenario and interacts with the user in real time. After the conversation ends, the system analyzes the user's responses and provides evaluation and feedback.
[1545] Example of a prompt
[1546] "I'm a 30-year-old man, and my hobbies are the outdoors and watching movies. I'm looking for an ideal partner who is a woman between 25 and 35 years old and enjoys reading and the outdoors. I'm also planning a casual lunch date for our first date. I'd like some conversation practice, advice on relationship problems, and stress management techniques."
[1547] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[1548] Step 1:
[1549] The user uses their device to enter profile data (name, age, hobbies, interests, values, etc.) and criteria for a partner (age, hobbies, location, etc.). The entered data is sent from the device to the server. The server stores the received data in a database and uses it later for partner matching.
[1550] Input: User profile data, criteria for a partner
[1551] Output: User profile data and partner requirements stored in the database.
[1552] Step 2:
[1553] The server searches for a suitable partner based on the user's profile data and partner requirements stored in the database. It then uses an algorithm to rank the best partners by cross-referencing this information with other users in the database. Finally, it generates a ranked partner list and sends it to the user's terminal.
[1554] Input: User profile data stored in the database and the criteria for a partner.
[1555] Output: Ranked partner list
[1556] Step 3:
[1557] The user enters a specific dating scenario (e.g., a casual lunch date) using their device. The entered scenario data is sent from the device to the server. The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. The generated suggestions include specific items and links to online shopping sites, and are sent back to the device.
[1558] Input: Dating scenario
[1559] Output: Fashion suggestions and online shopping links
[1560] Step 4:
[1561] The user enters their relationship problems or questions into the device. The entered questions are sent from the device to the server. The server uses a natural language processing engine to analyze the questions and generate counseling advice. The generated advice is then sent to the device and displayed to the user.
[1562] Input: Questions about love and relationships
[1563] Output: Counseling advice
[1564] Step 5:
[1565] The user inputs their mental state and stress level into a device. This input data is sent from the device to a server. The server analyzes this data and generates appropriate mental health advice. This advice is then delivered to the user via the device.
[1566] Input: Mental state and stress level
[1567] Output: Mental care advice
[1568] Step 6:
[1569] If a user wishes to receive conversation training, they input a specific conversation scenario or theme (e.g., first date, self-introduction) into their device. The entered scenario data is sent from the device to the server. The server uses an AI chatbot to generate a simulated conversation and interacts with the user in real time through the device. After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. The generated feedback is sent to the device and displayed to the user.
[1570] Input: Conversation scenarios or themes
[1571] Output: Evaluation and feedback on the simulated conversation
[1572] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[1573] This invention is a system that supports users' romantic activities, providing more personalized support by combining it with an emotion engine that recognizes the user's emotions. This system collects the user's profile data and desired partner criteria, and has the function of recommending the most suitable partner. It also includes a range of functions that provide relationship counseling, conversation training, mental care, and fashion advice for dating.
[1574] User profile collection and partner matching
[1575] First, the device prompts the user to input profile data (hobbies, interests, values, appearance, etc.). This data is sent from the device to the server and stored in a database. The user also sets criteria for their desired partner (age, hobbies, region, etc.). The server uses this data to match it with information from other users in the database and runs an algorithm to rank the most suitable partners. This algorithm generates a list of the most suitable partners for the user and sends it to the device. The device then displays this list to the user. In addition, an emotion engine analyzes the user's responses (e.g., facial expressions and input speed) in real time, evaluates their emotional state, and adjusts the matching results accordingly.
[1576] Relationship counseling
[1577] When a user enters their relationship problems or questions, the device sends that information to the server. The server uses a natural language processing engine to analyze the questions and generate appropriate counseling advice. The generated advice is sent to the device and presented to the user. An emotion engine monitors the user's emotional state in real time and dynamically adjusts the counseling advice according to the user's stress level and emotions.
[1578] Conversation training
[1579] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction), the device sends this selection to the server. The server then generates a simulated conversation using an AI chatbot based on this selection. This simulated conversation is conducted in real time through the device. During the conversation, an emotion engine analyzes the user's facial expressions and tone of voice, adjusting the chatbot's responses based on the user's emotional changes. After the conversation ends, the server analyzes the entire conversation and generates an evaluation and feedback. This feedback is sent to the device and provided to the user.
[1580] Mental care
[1581] When a user inputs their mental state and stress level, the device sends this information to a server. The server analyzes this data and generates appropriate mental care advice. An emotion engine continuously monitors the user's emotional state and, if necessary, suggests additional advice and stress management methods. This advice includes suggestions for stress management and relaxation methods (e.g., breathing exercises, meditation) and is provided to the user through the device.
[1582] Fashion advice
[1583] When a user enters a date scenario (e.g., a casual lunch date), the device sends this information to the server. The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. These suggestions include specific items and links to online shops where they can be purchased. The device displays these suggestions to the user, who can then purchase the suggested items. Furthermore, an emotion engine analyzes the user's reactions and adjusts the suggestions provided to match the user's preferences.
[1584] For example, if a user enters the criteria "a woman in her 30s who likes the outdoors and enjoys reading," the server searches the database, generates a list of matching women, and displays it on the device. Also, if a user enters a question about "difficulty communicating with a boyfriend," the AI will advise, "Why not try exploring his hobbies to increase common topics of conversation?" Furthermore, when a user is practicing conversation for a first date, the AI will instruct them to "introduce yourself," guide them through a simulated conversation, and provide evaluation and feedback.
[1585] Thus, the system of the present invention provides a variety of functions to comprehensively support the user's romantic activities and improve the user experience. Furthermore, by incorporating an emotion engine, it realizes personalized support that responds to the user's emotions.
[1586] The following describes the processing flow.
[1587] Matching function processing steps (emotion engine combination)
[1588] Step 1:
[1589] Device: The user launches the app and enters profile information (hobbies, interests, values, appearance, etc.).
[1590] Step 2:
[1591] Device: The user sets the criteria for their desired partner (age, hobbies, location, etc.).
[1592] Step 3:
[1593] Terminal: Sends the entered profile information and desired conditions to the server.
[1594] Step 4:
[1595] Server: Receives submitted profile information and preferences and stores them in the database.
[1596] Step 5:
[1597] Server: Runs an algorithm that matches the profile data of other users in the database and ranks the most suitable partners.
[1598] Step 6:
[1599] Server: Generates a ranked list of optimal partners and sends it to the terminal.
[1600] Step 7:
[1601] Terminal: Displays a list of recommended partners to the user.
[1602] Step 8:
[1603] Server: The emotion engine analyzes user responses in real time and evaluates the user's emotional state.
[1604] Step 9:
[1605] Server: Based on the evaluation results of the emotion engine, the generated partner list is adjusted as needed.
[1606] Step 10:
[1607] Terminal: Redisplay the adjusted partner list to the user.
[1608] Processing steps for the relationship counseling function (combination of emotional engines)
[1609] Step 1:
[1610] Device: The user launches the app and enters their relationship-related worries and questions.
[1611] Step 2:
[1612] Terminal: Sends the entered consultation details to the server.
[1613] Step 3:
[1614] Server: Receives the submitted consultation content and analyzes it using a natural language processing engine.
[1615] Step 4:
[1616] Server: Based on the analysis results, the AI counseling bot generates appropriate questions and presents them to the user.
[1617] Step 5:
[1618] Terminal: Displays questions from the AI to the user and receives the user's response.
[1619] Step 6:
[1620] Terminal: Sends the user's response to the server.
[1621] Step 7:
[1622] Server: Analyzes user responses and generates more specific counseling advice.
[1623] Step 8:
[1624] Server: The emotion engine monitors the user's emotional state in real time and dynamically adjusts counseling advice according to the user's stress level and emotions.
[1625] Step 9:
[1626] Server: Sends the generated counseling advice to the terminal.
[1627] Step 10:
[1628] Terminal: Displays counseling advice to the user.
[1629] Processing steps for the conversation training function (combination of emotion engines)
[1630] Step 1:
[1631] Device: The user launches the app and selects a conversation scenario or theme.
[1632] Step 2:
[1633] Terminal: Sends the selected scenario or theme to the server.
[1634] Step 3:
[1635] Server: Based on the submitted scenarios and themes, the AI chatbot generates simulated conversations.
[1636] Step 4:
[1637] Server: Sends the generated simulated conversation start message to the terminal.
[1638] Step 5:
[1639] Terminal: Displays a message to the user to initiate a simulated conversation and receives the user's response.
[1640] Step 6:
[1641] Terminal: Sends user responses to the server.
[1642] Step 7:
[1643] Server: Analyzes user responses and generates appropriate replies.
[1644] Step 8:
[1645] Server: Sends the generated response to the terminal.
[1646] Step 9:
[1647] Terminal: Displays the response to the user.
[1648] Step 10:
[1649] Server: During a conversation session, the emotion engine analyzes the user's facial expressions and tone of voice in real time and adjusts the chatbot's response based on the user's emotional changes.
[1650] Step 11:
[1651] Server: After the conversation session ends, it analyzes the entire conversation and generates an evaluation and feedback.
[1652] Step 12:
[1653] Server: Sends the generated ratings and feedback to the terminal.
[1654] Step 13:
[1655] Device: Displays ratings and feedback to the user.
[1656] Processing steps of the mental care function (combination of emotional engines)
[1657] Step 1:
[1658] Device: The user launches the app and inputs their mental state and stress level.
[1659] Step 2:
[1660] Terminal: Sends the entered mental state and stress level to the server.
[1661] Step 3:
[1662] Server: Receives transmitted data and evaluates it using the analysis engine.
[1663] Step 4:
[1664] Server: Generates appropriate mental health advice based on the analysis results.
[1665] Step 5:
[1666] Server: The emotion engine continuously monitors the user's emotional state and, if necessary, suggests additional advice or stress management methods.
[1667] Step 6:
[1668] Server: Sends the generated mental health advice to the terminal.
[1669] Step 7:
[1670] Terminal: Displays mental health advice to the user.
[1671] Processing steps for the fashion advice function (combination of emotional engines)
[1672] Step 1:
[1673] Device: The user launches the app and enters the date scenario.
[1674] Step 2:
[1675] Terminal: Sends the entered dating scenario to the server.
[1676] Step 3:
[1677] Server: Receives the transmitted situation data and searches for appropriate fashion items.
[1678] Step 4:
[1679] Server: Generates optimal fashion style suggestions based on search results.
[1680] Step 5:
[1681] Server: Sends fashion item suggestions and purchase links to the device.
[1682] Step 6:
[1683] Terminal: Displays fashion item suggestions and purchase links to the user.
[1684] Step 7:
[1685] Server: The emotion engine analyzes user reactions in real time and adjusts the suggestions provided to match the user's preferences.
[1686] (Example 2)
[1687] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[1688] Traditional dating support systems have limitations, offering only simple matching based on user profiles and fixed counseling advice, failing to respond to users' emotional states and real-time changes. Furthermore, conversational training often provides only one-sided feedback that ignores the user's evolving emotions. A system is needed to address these challenges and provide more personalized support.
[1689] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[1690] In this invention, the server includes means for collecting user profile data and the conditions desired in a partner; means for storing the collected data in a database; means for ranking and recommending the most suitable partner based on the stored data using an algorithm; means for providing the generated recommendation list to the user terminal; and means for adjusting the recommendation results using an emotion engine that analyzes the user's reactions. This enables personalized partner recommendations that are tailored to the user's emotional state.
[1691] Furthermore, the server includes means for analyzing the relationship consultation content entered by the user using natural language processing technology and generating counseling results, means for providing the generated counseling results to the user's terminal, and means for monitoring the user's emotional state in real time and dynamically adjusting the counseling results. This enables the provision of dynamic counseling advice that responds to changes in the user's emotions.
[1692] The server also includes means for the user to select a conversation scenario or theme, means for generating a simulated conversation based on the selected scenario, means for generating an evaluation and feedback on the simulated conversation, means for providing the generated evaluation and feedback to the user terminal, and means for analyzing the user's emotional state during the conversation and adjusting the responses in the simulated conversation in real time. This enables the provision of real-time responses and feedback that correspond to the user's emotional state during conversation training.
[1693] "User profile data" refers to personal information that users provide to the system, including information such as hobbies, interests, values, and appearance.
[1694] "Desired partner characteristics" refer to the qualities and requirements of a partner that the user desires, including information such as age, hobbies, and place of residence.
[1695] "Means of collection" include interfaces for users to input information, as well as software and hardware for receiving that information.
[1696] "Means of storing in a database" include storage systems and database management systems for storing received user profile data and the conditions that users seek in a partner.
[1697] "Methods of ranking and recommending using algorithms" refer to the process of using AI algorithms to rank and recommend the most suitable partner candidates based on information stored in a database.
[1698] "Means for providing the generated recommendation list to the user terminal" includes software and hardware for transmitting and displaying the partner recommendation list generated by the server to a device accessible to the user.
[1699] "Methods for adjusting recommendation results using an emotion engine" refer to systems where the emotion engine analyzes the user's emotional state and adjusts the recommendation results and information provided in real time based on the results.
[1700] "A means of analyzing relationship-related consultation content using natural language processing technology and generating counseling results" refers to a process that uses AI and natural language processing technology to analyze relationship-related consultation content entered by a user and generate appropriate counseling advice.
[1701] "Means for providing generated counseling results to the user terminal" includes software and hardware for transmitting and displaying the counseling results generated by the server to the user's device.
[1702] "A means of monitoring the user's emotional state in real time and dynamically adjusting counseling results" refers to a system where the emotion engine detects the user's emotional state in real time and adjusts counseling advice as needed based on the results.
[1703] "Means for selecting a conversation scenario or theme" includes interfaces or software that allow the user to select a specific conversation scenario or theme.
[1704] "Means for generating simulated conversations based on selected scenarios" refers to the process of generating simulated conversations using AI or chatbot technology based on selected conversation scenarios or themes.
[1705] "Means for generating evaluations and feedback on simulated conversations" include software and algorithms for analyzing the content of simulated conversations and generating evaluations and feedback thereon.
[1706] "Means for providing generated evaluations and feedback to the user terminal" include software and hardware for sending and displaying conversation evaluations and feedback generated by the server to the user's device.
[1707] "A means of analyzing the user's emotional state during a conversation and adjusting the responses in a simulated conversation in real time" refers to a function in which an emotion engine analyzes the user's facial expressions and tone of voice during a conversation, and adjusts the content and responses of the simulated conversation in real time based on the results.
[1708] This invention is a system that supports users' romantic activities from multiple angles. The system has the function of collecting the user's profile data and desired partner criteria and recommending the most suitable partner. Furthermore, it has a series of functions that provide relationship counseling, conversation training, mental care, and fashion advice for dating.
[1709] User profile collection and partner matching
[1710] First, the device prompts the user to input profile data (hobbies, interests, values, appearance, etc.). This data is sent to the server via the device and stored in a database. Based on the stored data, the server uses an AI algorithm (e.g., a mutual recommendation algorithm) to match it with other user information in the database and rank the most suitable partners. The generated partner list is displayed to the user via the device. An emotion engine (e.g., facial recognition using OpenCV and the Google Cloud Speech-to-Text API) is used to analyze the user's responses in real time and adjust the recommendation results.
[1711] For example, if a user enters "a woman in her 30s who enjoys reading and the outdoors" as their desired criteria, the server searches the database, generates a list of matching women, and displays it on the terminal.
[1712] Example of a prompt:
[1713] "Looking for a woman in her 30s who enjoys the outdoors and reading."
[1714] Relationship counseling
[1715] When a user enters their relationship problems or questions into their device, the device sends that information to a server. The server analyzes the questions using natural language processing technology (e.g., Google Cloud Natural Language) and generates appropriate counseling advice. The generated advice is sent to the device and presented to the user. An emotion engine monitors the user's emotional state in real time and dynamically adjusts the counseling advice according to their stress level and emotions.
[1716] For example, if a user enters a question like, "I'm having trouble communicating with him," the AI will offer advice such as, "Why not try exploring his hobbies in more depth to increase the number of topics you have in common?"
[1717] Example of a prompt:
[1718] "I'm having trouble communicating with him."
[1719] Conversation training
[1720] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction), the device sends its selection to the server. The server generates a simulated conversation using an AI chatbot (e.g., OpenAI's GPT-3). This simulated conversation is exchanged with the user in real time through the device. During the conversation, an emotion engine analyzes the user's facial expressions and tone of voice, adjusting the conversational responses accordingly. After the conversation ends, the server analyzes the conversation content, generates an evaluation and feedback, and sends it to the device.
[1721] As a concrete example, when a user is practicing conversation for a first date, they are instructed to "introduce yourself," and then given a simulated conversation followed by evaluation and feedback.
[1722] Example of a prompt:
[1723] "I want to practice conversation for first dates."
[1724] Mental care
[1725] When a user inputs their mental state and stress level into the device, the device sends this information to a server. The server analyzes this data and generates appropriate mental care advice. An emotion engine continuously monitors the user's emotional state and provides additional advice as needed. This advice includes suggestions for stress management and relaxation methods (e.g., breathing exercises, meditation) and is provided to the user through the device.
[1726] For example, if a user enters "I'm stressed," the server will suggest breathing exercises and meditation techniques.
[1727] Example of a prompt:
[1728] "I feel stressed."
[1729] Fashion advice
[1730] When a user enters a date scenario (e.g., a casual lunch date) into the device, the device sends this information to the server. The server searches for fashion items appropriate for the situation and generates suggestions for the best outfit. The suggestions include specific item names and links to purchase them. The device displays these suggestions to the user, who can then purchase the suggested items. Furthermore, an emotion engine analyzes the user's reactions and adjusts the suggestions to match the user's preferences.
[1731] For example, if a user enters "casual lunch date," the server will suggest casual attire and provide purchase links.
[1732] Example of a prompt:
[1733] "Suggestions for casual lunch date outfits"
[1734] In this way, the system comprehensively supports users' romantic activities and provides a variety of functions to improve the user experience. By incorporating an emotion engine, it enables personalized support that responds to the user's emotions.
[1735] The flow of the specific processing in Example 2 will be explained using Figure 13.
[1736] Step 1:
[1737] The user enters their profile data and partner preferences.
[1738] Input: Hobbies, interests, values, appearance, and desired partner characteristics (e.g., age, hobbies, location, etc.)
[1739] Operation: Users input this information through a smartphone or PC interface.
[1740] Output: The collected user profile data and partner conditions are stored on the device.
[1741] Step 2:
[1742] The device sends data to the server.
[1743] Input: Profile data and partner conditions entered in Step 1.
[1744] Operation: The terminal uses the HTTPS protocol to encrypt and send the entered data to the server.
[1745] Output: Profile data and partner conditions received by the server
[1746] Step 3:
[1747] The server saves the data to the database.
[1748] Input: Profile data and partner conditions sent from the device.
[1749] Operation: The server uses a database management system (e.g., MySQL, PostgreSQL) to store data in the database.
[1750] Output: User profile data and partner conditions stored in the database
[1751] Step 4:
[1752] The server uses an algorithm to rank and recommend the most suitable partners.
[1753] Input: Profile data of all users stored in the database and partner conditions
[1754] Operation: The server runs an AI algorithm (e.g., a mutual recommendation algorithm) to rank the best partner candidates.
[1755] Output: A list of the best partner for the user
[1756] Step 5:
[1757] The server sends the generated recommendation list to the terminal.
[1758] Input: Optimal partner list
[1759] Operation: The server generates a recommendation list in JSON format and sends it to the terminal.
[1760] Output: Partner list received by the terminal
[1761] Step 6:
[1762] The device displays a list of partners to the user.
[1763] Input: Partner list received from the server
[1764] Operation: The terminal displays the partner list in list format via a GUI.
[1765] Output: The partner list is displayed to the user.
[1766] Step 7:
[1767] The emotion engine analyzes user reactions.
[1768] Input: User's facial expressions and voice tone data
[1769] Operation: The emotion engine (e.g., OpenCV, Google Cloud Speech-to-Text API) uses the camera and microphone to analyze the user's emotional state in real time.
[1770] Output: Evaluation results of the user's emotional state
[1771] Step 8:
[1772] The server uses sentiment data to adjust the results.
[1773] Input: Emotional state assessment results and initial recommendation list
[1774] Operation: The server readjusts the recommendation list based on the evaluation results of the emotional state and generates a new recommendation list.
[1775] Output: The revised recommendation list and its display results
[1776] Step 9:
[1777] Users enter their relationship problems and questions.
[1778] Input: User's concerns or questions (e.g., "I'm having trouble communicating with him")
[1779] Operation: The user enters their inquiry in text format via a terminal.
[1780] Output: The entered consultation details are stored on the terminal.
[1781] Step 10:
[1782] The device sends the consultation details to the server.
[1783] Input: Consultation details
[1784] Operation: The terminal sends the consultation details to the server. For security purposes, the data is encrypted using the HTTPS protocol.
[1785] Output: Consultation content received by the server
[1786] Step 11:
[1787] The server analyzes the consultation content using natural language processing technology and generates counseling results.
[1788] Input: Consultation details
[1789] Operation: The server uses natural language processing technology (e.g., Google Cloud Natural Language) to analyze the consultation content and generate counseling advice.
[1790] Output: Counseling advice
[1791] Step 12:
[1792] The server provides the generated counseling results to the terminal.
[1793] Input: Counseling advice
[1794] Operation: The server sends counseling advice to the terminal in JSON format.
[1795] Output: Counseling advice received by the device
[1796] Step 13:
[1797] The emotion engine monitors the user's emotional state in real time and dynamically adjusts the counseling results.
[1798] Input: Counseling advice, emotional data such as the user's face and voice.
[1799] Operation: The emotion engine dynamically adjusts counseling advice based on the received emotion data.
[1800] Output: Adjusted counseling advice
[1801] Step 14:
[1802] The user selects a conversation scenario or theme.
[1803] Input: Conversation scenario or theme (e.g., "First Date," "Self-Introduction")
[1804] Operation: The user selects a conversation scenario or theme from a list on their device.
[1805] Output: Selected scenarios and themes
[1806] Step 15:
[1807] The device sends its selections to the server.
[1808] Input: Selected scenario or theme
[1809] Operation: The terminal sends the selection to the server.
[1810] Output: Selections received by the server
[1811] Step 16:
[1812] The server generates a simulated conversation based on the selected scenario.
[1813] Input: Selected scenario or theme
[1814] Operation: The server uses an AI chatbot (e.g., OpenAI's GPT-3) to generate simulated conversations based on the selected scenario.
[1815] Output: Generated simulated conversation
[1816] Step 17:
[1817] The device displays a simulated conversation.
[1818] Input: Generated simulated conversation
[1819] Operation: The device interacts with the user in real time through simulated conversations and displays the results.
[1820] Output: A simulated conversation is displayed to the user.
[1821] Step 18:
[1822] The emotion engine analyzes the user's emotions during the conversation.
[1823] Input: User's facial expressions and voice tone data
[1824] Operation: The emotion engine analyzes the user's facial expressions and voice tone in real time through the camera and microphone.
[1825] Output: Evaluation results of the user's emotional state
[1826] Step 19:
[1827] The server analyzes the conversation and generates feedback.
[1828] Input: Simulation conversation and evaluation results of emotional state
[1829] Operation: The server generates evaluations and feedback based on the conversation content and sentiment assessment.
[1830] Output: Generated evaluations and feedback
[1831] Step 20:
[1832] The device provides generated ratings and feedback.
[1833] Input: Ratings and feedback
[1834] Operation: The server sends the generated evaluation and feedback to the terminal, which then provides it to the user.
[1835] Output: Ratings and feedback provided to users
[1836] These steps enable the system to provide comprehensive support for users in their romantic endeavors. Furthermore, the use of an emotion engine allows for real-time, personalized support.
[1837] (Application Example 2)
[1838] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[1839] Traditional dating support systems focused on collecting user profile data and partner preferences, and recommending suitable partners, but only provided users with lists based on this information. This resulted in a lack of real-time emotional responses and personalized, emotion-based support. Furthermore, there was a lack of systems that comprehensively offered diverse support such as dating counseling, conversation training, mental care, and fashion advice, forcing users to utilize multiple services. This led to an inconsistent user experience and made effective dating support difficult.
[1840] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[1841] In this invention, the server includes means for collecting user profile data and the conditions desired in a partner; means for storing the received profile data and conditions in a database and recommending the most suitable partner; means for providing the generated recommendation list to the user terminal; means including an emotion engine that analyzes the user's emotional state in real time; and means for adjusting the recommendation list based on the analysis results of the emotion engine. This enables the recommendation of the most suitable partner according to the user's emotional state. In addition, the server includes means for collecting the content of consultations about love entered by the user; means for analyzing the collected consultation content using natural language processing and generating counseling results; means for providing the generated counseling results to the user terminal; means including an emotion engine that monitors the user's emotional state in real time; and means for dynamically adjusting the counseling results according to the emotional state. This enables counseling according to the user's real-time emotional state. Furthermore, the server includes means for selecting a conversation scenario or theme; means for generating a simulated conversation based on the selected scenario; means including an emotion engine that analyzes the user's emotional state; means for adjusting the responses of the simulated conversation based on the emotional state; means for generating evaluations and feedback on the simulated conversation; and means for providing the generated evaluations and feedback to the user terminal. This enables appropriate conversation training that responds to changes in the user's emotions.
[1842] A "user profile" is data that includes personal information such as a user's hobbies, interests, values, and appearance.
[1843] "Desired partner criteria" refers to data that includes information such as the user's desired partner's age, hobbies, and location.
[1844] A "database" is a system for organizing and storing information such as collected user profiles and the requirements for partners.
[1845] The "recommendation list" is a list of the most suitable partners, generated based on the user's profile data and the criteria they have for a partner.
[1846] An "emotion engine" is a system that analyzes a user's facial expressions and voice tone to evaluate their emotional state in real time.
[1847] "Natural language processing" is a technology that enables computers to understand, analyze, and generate human language.
[1848] "Counseling" is the process of providing appropriate advice and solutions to users' relationship problems and concerns.
[1849] A "simulated conversation" is a virtual dialogue conducted using an AI chatbot based on a scenario or theme chosen by the user.
[1850] A "conversation scenario or theme" refers to a specific situation or topic that the user chooses during a simulated conversation.
[1851] "Evaluation and Feedback" refers to the evaluation of the user's conversational skills and advice on areas for improvement, generated after the completion of a simulated conversation.
[1852] "Dynamic adjustment" means appropriately changing the system's output (e.g., counseling results or responses in simulated conversations) according to the user's real-time emotional state.
[1853] The system program for implementing this invention integrates a wide range of functions to comprehensively support the user's romantic activities. The main hardware used includes user terminals (smartphones, tablets, personal computers, etc.) and a server, while the software includes an emotion engine, a natural language processing engine, and an AI chatbot.
[1854] The server has the means to collect user profile data and the criteria they seek in a partner. Users input information such as hobbies, interests, values, and appearance using their device. This data is immediately sent to the server and stored in the database. In addition, the criteria the user desires for a partner (age, hobbies, location, etc.) are also sent to the server and managed in the database.
[1855] The server performs partner matching based on the collected data and generates a list of optimal partners. This process utilizes an algorithm based on a neural network. The generated recommendation list is then refined through an emotion engine that analyzes the user's emotional state in real time. The emotion engine analyzes the user's facial expressions, input speed, etc., and finally provides the refined list to the user's terminal.
[1856] The server also provides a counseling function. When a user enters their relationship problems into their device, this information is sent to the server. The server uses a natural language processing engine to analyze the input and generate appropriate counseling advice. An emotion engine monitors the user's emotional state and dynamically adjusts the counseling results as needed. These results are sent to the user's device and displayed to the user.
[1857] Furthermore, the server provides conversation training. When a user selects a specific conversation scenario or theme, that selection is sent to the server. The server uses a generative AI model (e.g., GPT-3) to generate a simulated conversation, enabling real-time interaction between the user and the AI chatbot. During this simulated conversation, an emotion engine analyzes the user's emotional state in real time and adjusts the AI chatbot's responses accordingly. After the conversation ends, the server analyzes the entire conversation, generates an evaluation and feedback, and provides it to the user's terminal.
[1858] As a concrete example, when a user enters "a woman in her 30s who likes the outdoors and enjoys reading" as their desired criteria, the system works as follows:
[1859] 1. Prompt message when collecting profile information:
[1860] Please enter your hobby: Outdoors
[1861] Please enter your interest: Reading
[1862] Please enter your values: Inner fulfillment
[1863] 2. Prompts during counseling:
[1864] I'm having trouble communicating with him.
[1865] 3. Prompt sentences during conversation training:
[1866] Please select a scenario for your first date: Self-introduction
[1867] In this way, a system that comprehensively supports users' romantic activities is realized.
[1868] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[1869] Step 1:
[1870] Users enter their profile data (hobbies, interests, values, appearance, etc.) and the criteria they seek in a partner (age, hobbies, location, etc.) into their device. The entered data is immediately sent to the server and stored in the database. This allows user profiles and partner criteria to be aggregated on the server.
[1871] Step 2:
[1872] The server searches other user data in the database to find the best match based on the aggregated user profiles and partner criteria. Specifically, it runs an algorithm using a neural network to find the best partner that matches the user's profile data. The recommendation list generated as a result of the search results is temporarily stored.
[1873] Step 3:
[1874] The server uses an emotion engine to analyze the user's emotional state in real time. Specifically, it analyzes the user's facial expressions and voice data to evaluate the user's current mood, level of excitement, and stress level. This emotional state is then quantified and recorded. The emotion engine uses an open-source emotion analysis module.
[1875] Step 4:
[1876] The server uses the emotion engine's analysis results to adjust the generated recommendation list. Specifically, it makes adjustments necessary to provide the best possible match based on the user's emotional state. For example, if the user is stressed, new suggestions may be added, or certain matching results may be excluded based on the user profile. The adjusted recommendation list is then finalized.
[1877] Step 5:
[1878] A refined recommendation list is sent from the server to the user's device and displayed to them. The user can review this list and select a suitable partner.
[1879] Step 6:
[1880] When a user enters their relationship problems or questions into their device, that information is sent to a server. The server uses a natural language processing engine to analyze the entered questions and generate appropriate counseling advice. The generated counseling advice is dynamically adjusted as needed, taking into account the user's emotional state.
[1881] Step 7:
[1882] The generated counseling results are sent from the server to the terminal and provided to the user. The user can use the counseling results to help resolve their relationship problems.
[1883] Step 8:
[1884] When a user selects a conversation scenario or theme, that selection is sent to the server. The server uses a generative AI model (e.g., GPT-3) to generate a simulated conversation based on the selected scenario. The AI chatbot then responds to the generated simulated conversation, taking into account how the user might emotionally react.
[1885] Step 9:
[1886] The server analyzes the simulated conversation and generates evaluations and feedback. Specifically, it analyzes the flow of the conversation and the user's utterances, providing feedback on what went well and what needs improvement. The generated evaluations and feedback are then provided to the device in a way that supports the user's learning.
[1887] Step 10:
[1888] When a user inputs their emotional and mental state, this information is sent to the server, which uses an emotion engine to perform an evaluation. Specific mental care advice (such as stress management and relaxation techniques) is then provided, and appropriate advice tailored to the user's condition is displayed on the device.
[1889] This allows users to receive consistent support and effectively advance their romantic activities.
[1890] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[1891] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1892] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.
[1893] [Fourth Embodiment]
[1894] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.
[1895] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1896] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1897] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.
[1898] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[1899] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[1900] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[1901] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.
[1902] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[1903] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1904] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1905] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[1906] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[1907] This invention relates to a system that supports users' romantic activities. This system collects the user's profile data and desired partner criteria, and recommends the most suitable partner based on this information. It also includes a range of functions providing relationship counseling, conversation training, mental care, and fashion advice for dates.
[1908] User profile collection and partner matching
[1909] First, the device prompts the user to input profile data (hobbies, interests, values, appearance, etc.). This data is sent from the device to the server and stored in a database. The user also sets criteria for their desired partner (age, hobbies, region, etc.). The server uses this data to compare it with information from other users in the database and runs an algorithm to rank the most suitable partners. This algorithm generates a list of the most suitable partners for the user and sends it to the device. The device then displays this list to the user.
[1910] Relationship counseling
[1911] When a user enters their relationship problems or questions, the device sends that information to the server. The server uses a natural language processing engine to analyze the questions and generate appropriate counseling advice. The generated advice is sent to the device and presented to the user. The server can also dynamically respond to the user's reactions and additional questions, providing even more specific advice.
[1912] Conversation training
[1913] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction), the device sends this selection to the server. The server then generates a simulated conversation using an AI chatbot based on this selection. This simulated conversation is conducted in real-time through the device. After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. This feedback is sent to the device and provided to the user.
[1914] Mental care
[1915] When a user inputs their mental state and stress level, the device sends this information to a server. The server analyzes this data and generates appropriate mental health advice. This advice includes suggestions for stress management and relaxation methods (e.g., breathing exercises, meditation) and is provided to the user through the device.
[1916] Fashion advice
[1917] When a user enters a date scenario (e.g., a casual lunch date), the device sends this information to the server. The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. These suggestions include specific items and links to online shops where they can be purchased. The device displays these suggestions to the user, who can then purchase the suggested items.
[1918] For example, if a user enters the criteria "a woman in her 30s who likes the outdoors and enjoys reading," the server searches the database, generates a list of matching women, and displays it on the device. Also, if a user enters a question about "difficulty communicating with a boyfriend," the AI will advise, "Why not try exploring his hobbies to increase common topics of conversation?" Furthermore, when a user is practicing conversation for a first date, the AI will instruct them to "introduce yourself," guide them through a simulated conversation, and provide evaluation and feedback.
[1919] Thus, the system of the present invention provides a variety of functions to comprehensively support the user's romantic activities and improve the user experience.
[1920] The following describes the processing flow.
[1921] Matching function processing steps
[1922] Step 1:
[1923] Device: The user launches the app and enters profile information (hobbies, interests, values, appearance, etc.).
[1924] Step 2:
[1925] Device: The user sets the criteria for their desired partner (age, hobbies, location, etc.).
[1926] Step 3:
[1927] Terminal: Sends the entered profile information and desired conditions to the server.
[1928] Step 4:
[1929] Server: Receives submitted profile information and preferences and stores them in the database.
[1930] Step 5:
[1931] Server: Runs an algorithm to rank the best partners by matching the profile data of other users in the database.
[1932] Step 6:
[1933] Server: Generates a ranked list of optimal partners and sends it to the terminal.
[1934] Step 7:
[1935] Terminal: Displays a list of recommended partners to the user.
[1936] Processing steps for the relationship counseling function
[1937] Step 1:
[1938] Device: The user launches the app and enters their relationship-related worries and questions.
[1939] Step 2:
[1940] Terminal: Sends the entered consultation details to the server.
[1941] Step 3:
[1942] Server: Receives the submitted consultation content and analyzes it using a natural language processing engine.
[1943] Step 4:
[1944] Server: Based on the analysis results, the AI counseling bot generates appropriate questions and presents them to the user.
[1945] Step 5:
[1946] Terminal: Displays questions from the AI to the user and receives the user's response.
[1947] Step 6:
[1948] Terminal: Sends the user's response to the server.
[1949] Step 7:
[1950] Server: Analyzes user responses and generates more specific counseling advice.
[1951] Step 8:
[1952] Server: Sends the generated counseling advice to the terminal.
[1953] Step 9:
[1954] Terminal: Displays counseling advice to the user.
[1955] Processing steps for the conversation training function
[1956] Step 1:
[1957] Device: The user launches the app and selects a conversation scenario or theme.
[1958] Step 2:
[1959] Terminal: Sends the selected scenario or theme to the server.
[1960] Step 3:
[1961] Server: Based on the submitted scenarios and themes, the AI chatbot generates simulated conversations.
[1962] Step 4:
[1963] Server: Sends the generated simulated conversation start message to the terminal.
[1964] Step 5:
[1965] Terminal: Displays a message to the user to initiate a simulated conversation and receives the user's response.
[1966] Step 6:
[1967] Terminal: Sends user responses to the server.
[1968] Step 7:
[1969] Server: Analyzes user responses and generates appropriate replies.
[1970] Step 8:
[1971] Server: Sends the generated response to the terminal.
[1972] Step 9:
[1973] Terminal: Displays the response to the user.
[1974] Step 10:
[1975] Server: After the conversation session ends, it analyzes the entire conversation and generates an evaluation and feedback.
[1976] Step 11:
[1977] Server: Sends the generated ratings and feedback to the terminal.
[1978] Step 12:
[1979] Device: Displays ratings and feedback to the user.
[1980] Processing steps of the mental care function
[1981] Step 1:
[1982] Device: The user launches the app and inputs their mental state and stress level.
[1983] Step 2:
[1984] Terminal: Sends the entered mental state and stress level to the server.
[1985] Step 3:
[1986] Server: Receives transmitted data and evaluates it using the analysis engine.
[1987] Step 4:
[1988] Server: Generates appropriate mental health advice based on the analysis results.
[1989] Step 5:
[1990] Server: Sends the generated mental health advice to the terminal.
[1991] Step 6:
[1992] Terminal: Displays mental health advice to the user.
[1993] Processing steps for the fashion advice function
[1994] Step 1:
[1995] Device: The user launches the app and enters the date scenario.
[1996] Step 2:
[1997] Terminal: Sends the entered dating scenario to the server.
[1998] Step 3:
[1999] Server: Receives the transmitted situation data and searches for appropriate fashion items.
[2000] Step 4:
[2001] Server: Generates optimal fashion style suggestions based on search results.
[2002] Step 5:
[2003] Server: Sends fashion item suggestions and purchase links to the device.
[2004] Step 6:
[2005] Terminal: Displays fashion item suggestions and purchase links to the user.
[2006] (Example 1)
[2007] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[2008] In modern society, many people face various worries and challenges related to love and interpersonal relationships. In particular, there is a need for a wide range of support, including assistance with selecting a suitable partner, relationship counseling, improving conversation skills, mental health care, and fashion advice for dates. However, a system that provides comprehensive and effective solutions to these problems is still lacking. This invention aims to solve these problems in a unified manner and provide comprehensive support for users' romantic activities.
[2009] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[2010] In this invention, the server includes means for collecting user profile data and the conditions desired in a partner; means for storing the received profile data and conditions in a database and recommending the most suitable partner using an algorithm; means for providing the generated recommendation list to the user terminal; means for collecting the user's consultation content, analyzing it using natural language processing, and generating counseling results; means for providing the generated counseling results to the user terminal; means for selecting a conversation scenario or theme; means for generating a simulated conversation using a generative AI model based on the selected scenario; means for generating an evaluation and feedback on the simulated conversation; means for providing the generated evaluation and feedback to the user terminal; means for collecting and analyzing the user's mental state and stress level to generate mental care advice; means for providing the generated mental care advice to the user terminal; means for the user to input a dating situation, search for fashion items appropriate to that situation, and generate clothing suggestions; and means for providing the generated fashion suggestions to the user terminal. This makes it possible to comprehensively support the user's romantic activities, providing consistent support from various consultations and skill improvement to mental care and date preparation.
[2011] A "user profile" refers to data that contains personal information about a user, such as their hobbies, interests, values, and appearance.
[2012] "Desired partner characteristics" refers to information that describes the specific traits and qualifications of the ideal partner the user desires, such as age, hobbies, and location.
[2013] A "database" is a structured data storage system used to store, manage, and retrieve user profile data, partner conditions, and other relevant information within a system.
[2014] An "algorithm" refers to a series of steps or computational methods for solving a specific problem, and in this case, it is a mathematical model or program for recommending the optimal partner.
[2015] "Counseling results" refer to information generated by analyzing the consultation content collected from users using natural language processing, in order to provide appropriate advice and guidance.
[2016] Natural Language Processing (NLP) is a collection of technologies that enable computers to understand, analyze, and generate human language.
[2017] A "generative AI model" refers to a method for cultivating artificial intelligence that generates new data based on a large dataset that has been trained on in advance.
[2018] "Simulated conversation" refers to a virtual dialogue that a user engages in with an AI based on a specific scenario, with the aim of improving conversational skills.
[2019] "Evaluation and feedback" refers to constructive opinions and suggestions for improvement provided as a result of analysis of simulated conversations and other user behaviors.
[2020] "Mental care advice" refers to information that analyzes the user's mental state and stress level, and suggests appropriate care methods and relaxation techniques.
[2021] A "situation" refers to a specific scene or environment that a user faces in a particular purpose or situation.
[2022] "Fashion items" refer to specific fashion-related products, such as clothing and accessories, that are used on dates or in specific situations.
[2023] "User terminal" refers to electronic devices such as personal computers, smartphones, and tablets that users use to interact with this system.
[2024] This invention is a system that supports users' romantic activities and includes functions such as user profile collection and partner matching, relationship counseling, conversation training, mental care, and fashion advice for dating.
[2025] User profile collection and partner matching
[2026] First, the device prompts the user to input the following profile information (hobbies, interests, values, appearance, etc.). This data is sent from the device to the server and stored in a database. The user can also set criteria for their desired partner (age, hobbies, region, etc.). The server uses this data and an algorithm to match it with other user information in the database and rank the most suitable partners. This ranking algorithm can use, for example, SQL queries or machine learning models. The generated partner list is sent to the device, which then displays it to the user.
[2027] Specific example:
[2028] Prompt: If you enter "a woman in her 30s who likes the outdoors and enjoys reading" as your desired criteria, the server will search the database and list women who meet those criteria.
[2029] Relationship counseling
[2030] When a user enters their relationship problems or questions into a device, the device sends the information to a server. The server uses a natural language processing (NLP) engine to analyze the questions and generate appropriate counseling advice. For example, a generative AI model may be used to generate the advice. This generated advice is sent to the device, which then presents it to the user. The server then dynamically responds to the user's reactions and additional questions to provide more specific advice.
[2031] Specific example:
[2032] Prompt message: If you enter a question such as "I'm having trouble communicating with him," the AI will analyze it and provide advice such as "Why not try exploring his hobbies in more depth to increase the number of topics you have in common?"
[2033] Conversation training
[2034] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction) from their device, the device sends this selection to the server. The server uses a generative AI model to generate a simulated conversation scenario and sends it to the device. The user can then engage in a real-time simulated conversation with the chatbot through their device. After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. This feedback is sent to the device and provided to the user.
[2035] Specific example:
[2036] Prompt: Select "First Date Conversation Training," and you will be instructed to "Introduce Yourself," and you will proceed with the conversation with the chatbot.
[2037] Mental care
[2038] When a user inputs their mental state and stress level into a device, that information is sent to a server. The server analyzes this data and generates appropriate mental care advice. The generated advice includes stress management and relaxation methods (e.g., breathing exercises, meditation). This advice is provided to the user through the device, and the user can practice self-care according to the advice.
[2039] Specific example:
[2040] Prompt: If you enter "high" for your stress level, the server will generate suggestions for breathing exercises and meditation.
[2041] Fashion advice
[2042] When a user enters a date scenario (e.g., a casual lunch date) into the device, that information is sent to the server. The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. These suggestions include specific items and links to online shops where they can be purchased. The device displays these suggestions to the user, who can then purchase the suggested items.
[2043] Specific example:
[2044] Prompt: When you enter "casual lunch date" as the date scenario, the server will suggest appropriate attire.
[2045] As described above, this system is designed to comprehensively support all aspects of a user's romantic activities, with each function working together to improve the user experience. This system makes it easier for users to find a suitable partner and provides consistent support for various relationship-related concerns and worries.
[2046] The flow of the specific processing in Example 1 will be explained using Figure 11.
[2047] Step 1:
[2048] User input
[2049] The device prompts the user to input profile data (hobbies, interests, values, appearance, etc.). The user enters their profile information into a text box using a smartphone app. This input data is used in subsequent processing steps.
[2050] Step 2:
[2051] Data transmission
[2052] The device sends the entered profile data to the server. Specifically, when the user presses the "Send" button, the device sends data to the server via an HTTP POST request. The received data is stored in the server's database and used as input data for subsequent algorithmic processing.
[2053] Step 3:
[2054] Setting desired conditions
[2055] Users set their desired partner criteria (age, hobbies, location, etc.). Users select criteria using dropdown menus or checkboxes. This criteria data then becomes the input for the matching algorithm.
[2056] Step 4:
[2057] Partner Matching
[2058] The server executes an algorithm to match the user's profile data and preferences with other user information in the database. Specifically, it uses SQL queries and machine learning models to search the database for relevant profiles and ranks the most suitable partners. This calculation result is generated as a list of suitable partners.
[2059] Step 5:
[2060] Results display
[2061] The server sends the generated partner list to the device, which then displays it to the user. The device screen displays a list of matching users' photos and profile information.
[2062] Step 6:
[2063] Enter your consultation details
[2064] The user enters their relationship problems or questions into the device. The user enters their problem in the text area and presses the "Send" button.
[2065] Step 7:
[2066] Data transmission
[2067] The terminal sends that information to the server. Specifically, data is sent from the terminal to the server via an HTTP POST request. This data becomes the input for the next analysis process.
[2068] Step 8:
[2069] Analysis of consultation content
[2070] The server uses a natural language processing (NLP) engine to analyze the consultation content and generate appropriate counseling advice. The server sends the submitted text to an NLP API and receives the analysis results. The generated advice is output as follows.
[2071] Step 9:
[2072] Send advice
[2073] The server sends the generated advice to the terminal, which then displays it to the user. The user reads the advice displayed on the terminal's screen.
[2074] Step 10:
[2075] Dynamic response
[2076] The server dynamically responds to user feedback and additional questions, providing more specific advice. The user enters additional questions, the server uses its NLP engine to analyze them again, and generates and sends new advice.
[2077] Step 11:
[2078] Theme Selection
[2079] The user selects a specific conversation scenario or theme (e.g., first date, self-introduction). The user selects the theme from the app's UI.
[2080] Step 12:
[2081] Data transmission
[2082] The device sends the selection to the server. After selecting a theme, the device sends data to the server via an HTTP POST request.
[2083] Step 13:
[2084] Simulated conversation generation
[2085] The server generates simulated conversation scenarios using a generative AI model. The server calls a chatbot API to generate the conversation scenarios. These simulated conversations become the next output data.
[2086] Step 14:
[2087] Real-time conversation
[2088] The device engages in a simulated conversation with the user in real time. The user conducts the conversation with the chatbot within the app.
[2089] Step 15:
[2090] Analysis and Feedback
[2091] After the conversation ends, the server analyzes the user's responses and generates an evaluation and feedback. The server analyzes the user's statements and generates feedback such as "You should speak more concisely." This feedback becomes the output result.
[2092] Step 16:
[2093] Provide feedback
[2094] The device provides the generated feedback to the user. The user reads the feedback displayed on the device screen.
[2095] Step 17:
[2096] Mental state input
[2097] The user inputs their mental state and stress level into the device. The user evaluates and inputs their stress level using sliders and radio buttons.
[2098] Step 18:
[2099] Data transmission
[2100] The device sends that information to the server. Once you have finished entering the information, press the "Send" button to send the data to the server.
[2101] Step 19:
[2102] Data Analysis
[2103] The server analyzes the data and generates appropriate mental health advice. The server then generates suggestions for relaxation methods based on stress levels. These suggestions become the next output data.
[2104] Step 20:
[2105] Providing advice
[2106] The server sends the generated advice to the terminal, which then provides it to the user. The user then acts on the advice displayed on the terminal screen.
[2107] Step 21:
[2108] Situation Input
[2109] The user enters the date scenario (e.g., casual lunch date) into their device. The user then selects the scenario within the app.
[2110] Step 22:
[2111] Data transmission
[2112] The terminal sends the entered situation information to the server. After selection, the terminal sends data to the server via an HTTP POST request.
[2113] Step 23:
[2114] Fashion proposal generation
[2115] The server searches for fashion items appropriate to the situation and generates suggestions for the best outfit. The server calls the online shop's API and lists the items. These suggestions become the next output data.
[2116] Step 24:
[2117] Suggestion display
[2118] The server sends the generated suggestions to the terminal, which then displays them to the user. The user then displays the suggested items on the terminal screen, and a purchase link is also provided.
[2119] In this way, each processing step collects data based on user input, performs analysis and recommendations on the server side, and provides the results to the user. This makes it possible to support the user's dating activities and provide optimal advice in various situations.
[2120] (Application Example 1)
[2121] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[2122] Traditional dating support systems primarily offer partner recommendations and basic advice, but they fail to adequately address the diverse needs of users, such as providing specific date plans, fashion advice, conversation training, and mental care. As a result, users are unable to receive optimal support regarding dating and relationships, making it difficult for them to engage in effective dating activities.
[2123] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[2124] In this invention, the server includes means for collecting the user's profile data and the conditions they seek in a partner; means for storing the received profile data and conditions in a database and recommending the most suitable partner; means for providing the generated recommendation list to the user's terminal; and means for generating fashion advice tailored to the dating scenario and providing suggestions including links to online shopping sites. As a result, the user can receive appropriate fashion advice for their date and is also provided with links to online shopping sites to help them choose appropriate attire for the occasion, thereby enabling them to engage in dating activities more effectively.
[2125] The server also includes means for collecting relationship-related consultation content entered by users, means for analyzing the collected consultation content using natural language processing and generating counseling results, means for providing the generated counseling results to the user's terminal, and means for generating and providing advice on mental care. As a result, users can receive appropriate counseling and mental care for their relationship worries and anxieties, and continue their relationship activities with a sense of mental security.
[2126] Furthermore, the server includes means for selecting a conversation scenario or theme, means for generating a simulated conversation based on the selected scenario, means for generating an evaluation and feedback on the simulated conversation, means for providing the generated evaluation and feedback to the user terminal, and means for managing and updating fashion advice, counseling advice, mental care advice, and user data related to the simulated conversation. This allows users to practice conversations based on actual dating scenarios and, by receiving evaluations and feedback based on the results, to approach actual dates with greater confidence.
[2127] "User profile data" refers to data that shows basic information and attributes about a user, such as name, age, hobbies, interests, and values.
[2128] "Desired partner qualities" refer to specific attributes or requirements that a user looks for in their ideal partner, such as age, hobbies, and location.
[2129] A "database" is a system or structure for efficiently storing, managing, and retrieving information.
[2130] A "recommendation list" is a list of the most suitable partner candidates for the user, determined by an algorithm.
[2131] A "date scenario" refers to a specific date situation or setting, such as a "casual lunch date."
[2132] "Fashion advice" refers to advice that specifically suggests clothing and styles suitable for a particular situation.
[2133] An "online shopping link" is a web link to an online store where the user can purchase the suggested fashion items.
[2134] "Relationship-related consultation content" refers to the user's worries, questions, and specific inquiries regarding relationships.
[2135] "Natural language processing" is the technology that uses computers to understand and analyze human language.
[2136] "Counseling results" refer to the specific advice and solutions provided to users regarding their relationship problems.
[2137] "Mental care" refers to providing support related to the user's mental health and stress management.
[2138] A "conversation scenario or theme" refers to the setting or topic for a simulated conversation, such as "first date" or "self-introduction."
[2139] A "simulated conversation" is a virtual conversation generated to simulate a real-life conversation.
[2140] "Evaluation and feedback" refers to an analysis of the user's responses and areas for improvement based on the results of the simulated conversation.
[2141] "User terminal" refers to a device used by a user, and includes smartphones, tablets, personal computers, etc.
[2142] A "server" is a central computing system on a network used for processing and storing data.
[2143] "Means of management and updating" refer to methods and functions for properly maintaining data and information and reflecting new information and changes.
[2144] This invention is a system for comprehensively supporting users' romantic activities and has functions that respond to the individual needs of users. This system can be used by users via a user terminal such as a smartphone. Specific embodiments are described below.
[2145] System Configuration
[2146] This system primarily provides the following functions:
[2147] 1. User profile collection and partner matching
[2148] 2. Fashion advice
[2149] 3. Relationship counseling
[2150] 4. Mental care
[2151] 5. Conversation Training
[2152] User profile collection and partner matching
[2153] First, the user terminal prompts the user to input profile data (name, age, hobbies, interests, values, etc.). This data is sent from the terminal to the server and stored in a database. The user then sets criteria for their desired partner (age, hobbies, region, etc.). The server uses this data to compare it with information from other users in the database and runs an algorithm to rank the most suitable partners. This algorithm generates a list of the most suitable partners for the user and sends it to the terminal. The terminal then displays this list to the user.
[2154] Fashion advice
[2155] When a user enters a specific dating scenario (e.g., a casual lunch date), the device sends this information to the server. The server searches for fashion items appropriate for the situation and generates suggestions for the best outfit. These suggestions include specific items and links to online shopping sites to purchase them. The device displays these suggestions to the user, who can then purchase the suggested items.
[2156] Relationship counseling
[2157] When a user enters their relationship problems or questions, the device sends that information to the server. The server uses a natural language processing engine to analyze the questions and generate appropriate counseling advice. The generated advice is sent to the device and presented to the user. The server can also dynamically respond to the user's reactions and additional questions, providing even more specific advice.
[2158] Mental care
[2159] When a user inputs their mental state and stress level, the device sends this information to a server. The server analyzes this data and generates appropriate mental health advice. This advice includes suggestions for stress management and relaxation methods (e.g., breathing exercises, meditation) and is provided to the user through the device.
[2160] Conversation training
[2161] When a user selects a specific conversation scenario or theme (e.g., first date, self-introduction), the device sends this selection to the server. The server then generates a simulated conversation using an AI chatbot based on this selection. This simulated conversation is conducted i...
Claims
1. Means for collecting user profile data and the conditions they seek in a partner, The system stores the received profile data and criteria in a database and provides a means to recommend the most suitable partner. A means of providing the generated recommendation list to the user terminal, A system that includes this.
2. A means of collecting relationship-related consultation content entered by users, A means for analyzing collected consultation content using natural language processing and generating counseling results, A means for providing the generated counseling results to the user terminal, The system according to claim 1, including the following:
3. A means of selecting a conversation scenario or theme, A means for generating a simulated conversation based on a selected scenario, A means of generating evaluations and feedback on simulated conversations, A means of providing the generated evaluation and feedback to the user terminal, The system according to claim 1, including the following:
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A