system
The system addresses dating platform challenges by analyzing user interests and emotions to suggest compatible matches anonymously, ensuring privacy and secure interaction through existing apps, enhancing the matching experience.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- SOFTBANK GROUP CORP
- Filing Date
- 2024-12-09
- Publication Date
- 2026-06-19
AI Technical Summary
Modern dating platforms face challenges such as the time and effort required to find a suitable partner, concerns about privacy, and anxiety in communication, particularly due to the lack of anonymity and complexity in installing new applications.
A system that allows users to register through existing communication apps, analyzes their hobbies and values, suggests compatible candidates anonymously, and supports secure interaction with tailored date plans, using advanced data analysis and AI to enhance compatibility determination.
Provides a safe, efficient, and privacy-protected matching experience by ensuring accurate compatibility and secure interaction without the need for additional app installations, facilitating easy and secure user encounters.
Smart Images

Figure 2026100564000001_ABST
Abstract
Description
Technical Field
[0001] The technology of the present disclosure relates to a system.
Background Art
[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, the method including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In modern society, when single people start dating, the main barriers include the amount of time and effort required to find a suitable partner, concerns about privacy, and anxiety in communication. In particular, in matching services using digital platforms, the lack of anonymity and the complexity of installing new applications are factors that increase the burden and stress on users. The present invention aims to solve these problems and provide a safe, efficient, and privacy-protected matching experience through advanced data analysis.
Means for Solving the Problems
[0005] This invention provides a system in which users register with the system through an existing communication application, and then, by acquiring and analyzing information related to their hobbies and values, the system determines and suggests compatible users. Furthermore, it is designed to allow anonymous communication with suggested candidates, ensuring privacy while enabling secure interaction. In addition, the system achieves highly accurate compatibility determination through behavioral pattern analysis using existing data and also supports the suggestion of date plans tailored to the user's preferences.
[0006] "User" refers to an individual who wishes to be matched with other users through this system.
[0007] "Online communication means" refers to methods that allow users to access this system remotely and send and receive data via the internet or similar means.
[0008] "Information analysis means" refers to a process or software that analyzes data obtained from users and uses the results to determine compatible candidates.
[0009] "Compatibility determination method" refers to a process or algorithm that determines the suitability of matching with other users based on the user's hobbies and values.
[0010] "Candidate suggestion method" refers to a function or system that selects and suggests other users suitable for matching based on the results of compatibility assessment.
[0011] "Anonymous communication methods" refer to technologies or methods for communicating with other users while protecting their personal information.
[0012] "Date suggestion method" refers to a function or system that provides date suggestions according to the user's hobbies and preferences. [Brief explanation of the drawing]
[0013] [Figure 1]This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, when an emotion engine is combined. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]
[0014] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.
[0015] First, the terms used in the following description will be explained.
[0016] In the following embodiments, the labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.
[0017] In the following embodiments, the labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.
[0018] In the following embodiments, the labeled storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.
[0019] In the following embodiments, the labeled communication I / F (Interface) is an interface including a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), etc.
[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."
[0021] [First Embodiment]
[0022] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.
[0023] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0024] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0025] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.
[0026] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0028] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.
[0029] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0030] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.
[0031] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0032] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0033] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0034] One embodiment of the present invention includes a process that uses a communication infrastructure to match users with other users.
[0035] First, users access the system using a messaging app available on their device. Registration for using the system is completed when the user adds the official account as a friend. The server receives this registration request and stores the user's basic information as a profile in the database. This allows each user to have a unique profile.
[0036] Next, the user provides the server with detailed information such as their hobbies and values by answering a series of questions provided by the system. This information is analyzed by information analysis tools and used to reveal the user's characteristics. Based on these analysis results, the server compares them with other user profiles in the database to determine compatible candidates.
[0037] The server then uses the analyzed data to suggest candidates deemed compatible with the user. The information presented is anonymized, ensuring secure matching while protecting user privacy. If a user is interested in a suggested candidate, they can send a direct message via anonymous communication.
[0038] The server also provides features to assist communication between users. This includes suggesting date plans based on users' interests. For example, if a user shares a love of watching movies, the server can recommend a "date plan to go to the cinema."
[0039] Through this series of processes, the system provides users with the ability to easily and safely explore new encounters using existing messaging apps, without having to install any new applications.
[0040] The following describes the processing flow.
[0041] Step 1:
[0042] The user adds the official account as a friend using their device's messaging app and sends the message "Start". The server receives this message and creates a new user profile in its database based on the user's LINE ID.
[0043] Step 2:
[0044] The server sends the user messages containing questions about their hobbies and values. The user then enters and submits their answers to these questions via their device.
[0045] Step 3:
[0046] The server analyzes the responses received from the user using information analysis tools and records a detailed profile of the user's hobbies and values.
[0047] Step 4:
[0048] The server uses the analyzed user profile to compare it with other user profiles in the database. An AI algorithm is then used to select candidates deemed to be a good match.
[0049] Step 5:
[0050] The server presents the user with anonymized information about selected candidates. If the user is interested in a suggested candidate, they are given the option to send a message to that candidate via an anonymous communication method.
[0051] Step 6:
[0052] When a user wishes to communicate with a proposed candidate, they send an acceptance message to the server via their device. The server then initiates an anonymous communication session between the user and the candidate.
[0053] Step 7:
[0054] The server uses a dating suggestion system to encourage conversations between users by offering suggestions for date plans based on shared hobbies. These suggestions are sent to users as messages.
[0055] Step 8:
[0056] Users provide feedback on the date plan presented via their device and decide on the next steps. This ensures continuous and smooth communication.
[0057] (Example 1)
[0058] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0059] In online dating environments, preventing the leakage of personal information and incompatible pairings between users is crucial. Furthermore, providing an environment where users can communicate with each other safely is essential. However, effective means to simultaneously address these challenges have not yet been sufficiently developed.
[0060] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0061] In this invention, the server includes means for receiving user registration via an information terminal, data analysis means for analyzing data related to preferences and interests, and determination means for determining affinity. This makes it possible to provide highly accurate matching and a secure communication environment while maintaining user anonymity.
[0062] An "information terminal" is a device equipped with communication capabilities that a user uses to access a system.
[0063] "Users" refer to individuals who seek to meet and communicate with others through the system.
[0064] A "data analysis tool" is a mechanism for analyzing data based on preferences and interests obtained from users and for evaluating user characteristics.
[0065] A "determination means" is a mechanism for evaluating compatibility with other users based on analyzed data and identifying suitable candidates.
[0066] A "candidate recommendation method" is a system that selects users with high affinity and proposes those candidates to them.
[0067] An "anonymity mediation method" is a mechanism for conducting communications while maintaining the anonymity of the users.
[0068] An "activity suggestion mechanism" is a system designed to suggest appropriate activities and events based on users' interests and to promote interaction.
[0069] This invention provides a system that allows users to access the system via an information terminal, determine appropriate compatibility with other users, and communicate safely with unknown individuals.
[0070] Users register with the system via an internet connection using information terminals such as smartphones and tablets. During registration, the user's basic information is sent to the server and stored in the database. At this point, the server receives the information and manages it appropriately.
[0071] Next, the user inputs data about their preferences and interests through the system's interface. This data is analyzed by information analysis tools to evaluate the user's characteristics. The analysis is performed on a server, and the latest machine learning algorithms and generative AI models are used to ensure efficient and accurate processing.
[0072] Based on the data analysis results, the server matches users with other users based on affinity. During this process, a candidate recommendation system is used, suggesting anonymized candidate information to the user. This ensures optimal matching for the user while protecting their privacy.
[0073] For example, if user A enters that they are interested in music and enjoy classical music, the server will find and recommend user B, who shares a similar interest. Even in this case, anonymity is maintained, and secure communication based on mutual interests is possible.
[0074] Finally, the server facilitates anonymous communication between users, providing direct contact on the communication platform and enabling users to communicate with each other with confidence. It also proposes events and activities to support the building of user relationships.
[0075] A concrete example of a prompt message is a question like, "I want to find new connections. Please tell me about the registration process and how to use the system. How can I connect with people I'm interested in anonymously?" Such prompt messages facilitate natural interaction between the system and the user and support intuitive operation.
[0076] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0077] Step 1:
[0078] Users add the official account as a friend from their information terminal and access the system.
[0079] This action sends a registration request to the server. The input includes the user's basic information (name, contact information, etc.). The server receives this and stores it in the database. The output is a state where the user's profile is stored individually in the database.
[0080] Step 2:
[0081] Users answer questions presented by the system and input information about their hobbies and interests.
[0082] Users complete these selections and inputs on the terminal interface and send them to the server. Input includes multiple-choice answers and free-text information. The server stores the received information in a database for analysis. The output is user interest information ready for analysis.
[0083] Step 3:
[0084] The server analyzes the input data using data analysis tools and evaluates the user's characteristics.
[0085] In this step, a generative AI model is used to statistically analyze the user's preferences and interests. The input is the interest information received in step 2. Through data calculations, the user's preference characteristics are quantified. The output is feature data associated with the user's profile.
[0086] Step 4:
[0087] The server performs affinity assessment based on the analyzed data and compares it with other user profiles in the database.
[0088] This process creates a list of highly compatible users. The input consists of user characteristic data and other user profile information. A similarity score is calculated using a determination algorithm. The output is a list of highly compatible candidates.
[0089] Step 5:
[0090] The server anonymizes the information of matched candidates and presents it to the user.
[0091] The information is sent to the device in a visual list format. The inputs are the candidate list generated in step 4 and the original profile information. Privacy is ensured through the anonymization process. The output is the anonymized candidate information presented to the user.
[0092] Step 6:
[0093] Users send messages to the suggested candidates via anonymous communication methods.
[0094] The user enters a message through the terminal's interface and presses the send button. The input is the message text entered by the user. The server receives this and forwards it to the recipient via an anonymous ID. The output is an anonymous message that arrives on the recipient's terminal.
[0095] Step 7:
[0096] The server generates activity suggestions based on user interests and encourages interaction.
[0097] This includes suggesting date plans and event information using a generative AI model. Inputs include commonalities and preferences between users, as well as past data. The generated suggestions are sent to the user's device. The output is a customized activity suggestion that the user receives.
[0098] (Application Example 1)
[0099] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0100] In daily life, it is difficult for users to build new relationships based on their own interests and activities, and there is a lack of means to conduct such activities while protecting individual privacy. Against this backdrop, there is a growing need for a system that supports the building of appropriate relationships while safely handling personal information.
[0101] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0102] In this invention, the server includes a function to receive user registrations via bidirectional communication means, a data analysis function to analyze information about the activities and interests obtained from the user, and a compatibility determination function to determine the degree of compatibility with other users based on the analyzed information. This enables efficient and safe matching of users with other users who share their interests.
[0103] "Users" refer to individuals who use the system to attempt to build new relationships.
[0104] "Registration" refers to the act of a user providing their basic information and interests to the system and creating a profile for using the service.
[0105] "Two-way communication means" refers to the digital communication infrastructure between users and servers that enables the sending and receiving of information.
[0106] "Activities and interests" refer to the user's hobbies and personal interests related to specific areas of activity.
[0107] "Data analysis function" refers to the processing capability to analyze user characteristics and trends based on acquired information and generate useful results.
[0108] "Fit" refers to the degree to which users' interests and values align, evaluated using numerical values and indicators.
[0109] The "matching determination function" is a function that determines the degree of matching with other users based on the results obtained from data analysis.
[0110] The "selection suggestion function" is a function that suggests other users who share similar interests and activities to the user.
[0111] "Anonymity" is an attribute that ensures the confidentiality of personal information between users and enables secure communication.
[0112] The "anonymous information exchange function" is a feature that allows users to exchange information with each other without identifying their personal information.
[0113] A "generative AI model" refers to an artificial intelligence algorithm that uses machine learning techniques to perform advanced information generation and analysis.
[0114] In this embodiment of the invention, it is possible for users to easily and safely engage in new forms of communication based on their interests using household robots and smart devices. The system operates in the following manner.
[0115] The server receives user registrations via a two-way communication method. Users provide information about their activities and interests through this communication method. The acquired information is analyzed by a data analysis function to reveal user characteristics and trends. This analysis utilizes data analysis tools such as Google Cloud®.
[0116] Subsequently, based on the analyzed information, the server calculates the degree of compatibility with other users. This compatibility determination takes into account past behavioral patterns and the degree of shared interests. After the compatibility determination is made, the selection suggestion function proposes the most suitable match for the user.
[0117] Interactions between users take place via an anonymous information exchange function, ensuring privacy and enabling secure communication. This utilizes an anonymous communication method based on the Twilio API. Furthermore, it is possible to leverage generative AI models to provide diverse information and suggestions to improve the user experience. In particular, when proposing activities, the generative AI model can be used to generate a variety of ideas.
[0118] For example, if a user is interested in travel, the system will suggest "finding a matching partner related to the user's travel destinations and enabling conversations on topics related to those regions." The following prompt can be used for the generating AI model: "Generate suggestions that will allow the user, who loves travel, to continue a conversation about places they want to visit."
[0119] In this way, through the cooperation of servers, terminals, and users, a system is realized that provides a safe communication experience that respects individual tastes and preferences.
[0120] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0121] Step 1:
[0122] The user accesses the server via a two-way communication method using a terminal. The user provides registration information, and the terminal sends this information to the server. The input in this process is the user's basic profile information, and the output generates the user's account information to be registered on the server.
[0123] Step 2:
[0124] The server passes registration information submitted by users to the data analysis function. The server analyzes information about activities and interests and extracts user characteristics. The input is registration information, and the output is characteristic data based on each user's interests. This data is processed using a cloud-based analysis tool.
[0125] Step 3:
[0126] The server determines the degree of compatibility with other users based on the analyzed characteristic data. The input is characteristic data, and the output is a compatibility evaluation with other users. The compatibility is calculated using an algorithm, quantifying the degree of agreement in tastes and preferences between users.
[0127] Step 4:
[0128] The server uses a selection suggestion function to propose matching candidates to the user based on the goodness-of-fit assessment. The input is the goodness-of-fit assessment, and the output is a list of recommended matching candidates. The server prepares this information for anonymous information exchange.
[0129] Step 5:
[0130] The user selects on the terminal whether to accept or reject the proposed matching candidates. The input is a list of matching candidates, and the output is the choice to accept or reject. Through this operation, the user will exchange anonymous information with the selected person.
[0131] Step 6:
[0132] The server uses an anonymous information exchange function to enable secure communication between users. Input is a consented communication request between users, and output is the sending and receiving of anonymous messages. The Twilio API used in this process mediates message exchange while protecting privacy.
[0133] Step 7:
[0134] The server uses a generative AI model to generate suggestions to improve the user experience. Inputs include the user's profile and past message history, while outputs are generated suggestions and activity ideas. Utilizing prompts, the generative AI model suggests content that matches the user's interests.
[0135] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0136] One embodiment of the present invention is a system in which a user matches with other users via an existing communication application, and this includes a configuration that incorporates an emotion engine.
[0137] First, the user adds the system's official account as a friend using a messaging app available on their device, completing the registration process. The server receives the registration information from the user and stores it in the profile database. After the registration process, the server sends the user questions about their hobbies, values, and daily activities. This information is collected by data analysis tools to analyze the user's preferences in detail.
[0138] A new feature introduced is an emotion engine, which analyzes user input data and behavioral patterns to estimate the user's emotional state in real time. This emotional state is integrated with the compatibility determination system and becomes an important factor for the server to make more precise decisions regarding matching users with other users.
[0139] Based on the analysis results, the server anonymously suggests other users that it deems to be a good match for the user. These suggestions include comments and recommendations that take the user's emotional state into consideration, ensuring the suggestions are more appropriate for the user. If the user accepts a suggestion, the server enables direct message exchange using anonymous communication methods.
[0140] Furthermore, the emotion engine analyzes the context of the conversation and the user's emotional state, providing appropriate conversational support and advice in real time. For example, if the user is showing signs of anxiety, the server will present relevant support messages, such as "Suggesting a relaxing topic."
[0141] In this way, this system utilizes existing messaging apps and combines them with sentiment analysis to provide a matching service that allows users to communicate with others safely, securely, and effectively.
[0142] The following describes the processing flow.
[0143] Step 1:
[0144] The user adds the official account as a friend using their device's messaging app and sends the message "Start". The server receives this message, registers the user's identification information in its database, and creates a profile.
[0145] Step 2:
[0146] The server sends questions to the user about their interests, values, and daily activities. The user responds to these questions via their device. The server collects the user's responses using information analysis tools and uses them to detail their profile information.
[0147] Step 3:
[0148] The server collects user input and behavioral data in real time and passes it to the emotion engine. The emotion engine analyzes this data and estimates the user's current emotional state.
[0149] Step 4:
[0150] The server combines emotional state data with compatibility assessment tools to accurately determine compatibility with other users. It then suggests anonymized information about candidates deemed to be a good match to the user.
[0151] Step 5:
[0152] If a user is interested in a proposed candidate, they send a pre-approval message to the server via their device. The server then uses an anonymous communication method to allow message exchange with the proposed candidate and initiates a session.
[0153] Step 6:
[0154] The server provides real-time guidance and advice to facilitate conversation based on the user's emotional state, as analyzed by the emotion engine. For example, if the server determines that the user is feeling stressed, it will provide a message such as, "Try talking about a topic that helps you relax."
[0155] Step 7:
[0156] Users communicate with suggested candidates while following conversational guides and advice provided through their devices. The server continuously collects data and optimizes the system to improve the user experience.
[0157] (Example 2)
[0158] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0159] In modern online communication, there is a need for privacy protection to allow users to interact with others with peace of mind, as well as highly accurate compatibility assessments based on emotions and preferences. However, conventional systems lack sufficient emotional evaluation and real-time conversation support, making it difficult for users to efficiently find suitable partners.
[0160] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0161] In this invention, the server includes a device for receiving user registrations via a communication device, a data analysis device for analyzing information on preferences and value criteria obtained from the user, and an emotion analysis device for estimating the user's emotional state from the user's input information and behavioral patterns. This enables users to communicate appropriately with other users in a safe and trustworthy environment and to obtain opportunities for interaction through highly accurate matching.
[0162] "User" refers to an individual or group that uses this system to communicate with other participants.
[0163] "Communication equipment" is a general term for hardware and network infrastructure used to send and receive data online.
[0164] A "data analysis device" refers to software or hardware used to process information collected from users and extract characteristics such as preferences and value criteria.
[0165] An "emotional analysis device" refers to a technical means for analyzing and estimating a user's emotional state based on their input data and behavioral patterns.
[0166] A "compatibility determination device" refers to a system component that calculates the compatibility between users based on analyzed information and identifies a suitable partner.
[0167] A "candidate suggestion device" refers to a system component that has the function of notifying the user of the compatibility determination results and facilitating communication with a suitable partner.
[0168] An "anonymous communication device" refers to a means of communication that enables users to exchange messages with each other while ensuring user privacy.
[0169] A "generative AI model" is an algorithm or system technology that uses artificial intelligence to automatically generate appropriate conversation content and suggestions that correspond to the user's emotional state.
[0170] A "conversation support device" refers to a technical component that assists users' communication by providing appropriate advice and information during communication.
[0171] To implement this invention, the user first opens an existing communication application on their terminal and registers by adding the system's official account. At this time, the terminal transmits the user's registration information to the server via an online communication device.
[0172] The server uses data analysis equipment to analyze information about the user's preferences and values based on the received information. Specific analysis includes text mining and clustering algorithms based on the collected response data. Furthermore, an emotion analysis device processes this data in real time to estimate the user's emotional state. The software used for this analysis includes a natural language processing engine, enriching human interaction by analyzing emotions and tone.
[0173] Based on the analysis results, the server uses an affinity determination device to determine affinity with other users. A generation AI model is utilized in this process to generate highly accurate suggestions that take into account the user's emotional state. The system anonymously presents candidates of highly compatible users and makes these suggestions to the user through a candidate suggestion device.
[0174] Once a user accepts a proposal, the server enables communication with the other user via an anonymous communication device. During this interaction, the conversation support device utilizes a generated AI model to provide the most appropriate conversational support for the user in real time. For example, if a user is feeling anxious, the device will offer relaxing topics and supportive messages through the conversation.
[0175] For example, if information is analyzed indicating that user A enjoys cooking as a hobby, the server will suggest, "You seem like a good match as a cooking buddy." Another example of a prompt message used as input to the generation AI model is, "Consider the user's emotional state and automatically generate appropriate and empathetic conversation content."
[0176] Thus, this system supports users in enjoying safe and effective communication.
[0177] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0178] Step 1:
[0179] The user adds the system's official account as a friend within their messaging application using their device. This initiates the user registration process. The user provides the official account's ID or QR code (registered trademark) as input, and the system registration information is generated as output.
[0180] Step 2:
[0181] The server receives user registration information via a communication device. This information is stored in a data store. The input is the user's basic profile information (e.g., user ID, name), and the output is saving to the profile database.
[0182] Step 3:
[0183] The server sends questions to registered users about their hobbies and daily activities. These questions are provided as input information in the form of a set of questions sent to the terminal, and the user's answers are sent back to the server as output.
[0184] Step 4:
[0185] The server uses a data analysis device to analyze user response data. The input for processing is the user's responses, and the output, derived from text mining techniques, reveals the user's preferences and values. For example, it might extract from the responses that the user likes "outdoors."
[0186] Step 5:
[0187] The server estimates the user's emotional state in real time through an emotion analysis device. The input consists of the user's response data and conversation content, and natural language processing technology is used to identify the emotion (e.g., happiness, tension) and output it.
[0188] Step 6:
[0189] The server utilizes a generative AI model to determine affinity based on analyzed preferences and emotional states, and calculates compatibility with other users. The input consists of preference data and emotional data, and the output generates an affinity score.
[0190] Step 7:
[0191] The server generates a list of highly compatible users and makes suggestions to the user using a candidate suggestion device. The input information is the affinity score, and a generative AI model is used to generate suggestion messages that are presented in an attractive and appropriate manner.
[0192] Step 8:
[0193] If the user reviews and accepts the proposal on their device, the server will use an anonymous communication device to begin exchanging messages with the other proposed user. The input is the user's acceptance, and the output is the establishment of an anonymous communication route.
[0194] Step 9:
[0195] The server uses a conversation support device to provide real-time conversation support through a generated AI model during anonymous communication. Input information includes the content and emotional state of the conversation, while output is support messages and advice. For example, if the conversation becomes tense, support such as "offering a relaxing topic" may be provided.
[0196] (Application Example 2)
[0197] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0198] In today's information society, more sophisticated compatibility assessments and conversational support tailored to emotions are needed for users to connect with others safely and securely. However, conventional systems have faced the challenge of being unable to accurately analyze users' emotional states and provide appropriate support based on that analysis.
[0199] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0200] In this invention, the server includes means for receiving user registration via online communication means, information analysis means for analyzing information on hobbies and values obtained from the user, and emotion estimation means for estimating the user's emotional state in real time. This makes it possible to determine compatibility with the user with higher accuracy and to provide conversational support that is appropriate to their emotions.
[0201] "User" refers to an individual who uses this system to communicate with other users.
[0202] "Online communication methods" refer to methods and technologies for sending and receiving information via networks such as the internet.
[0203] "Information analysis means" refers to technical methods for processing data obtained from users and analyzing their hobbies and values.
[0204] "Compatibility assessment method" refers to a method for evaluating and determining the degree of compatibility between a user and other users.
[0205] "Candidate suggestion method" refers to a method for presenting users with other users who have been determined to be a good match.
[0206] "Anonymous communication methods" refer to means of communicating with other users while keeping the user's personal information confidential.
[0207] "Emotion estimation methods" refer to technologies that analyze user input data and behavioral patterns to estimate emotional states.
[0208] "Conversation support methods" refer to methods that provide appropriate conversational guidance and support to users based on their estimated emotional state.
[0209] The system that implements this application consists mainly of a terminal and a server. First, the user registers by using a communication application on the terminal and adding the system's official account as a friend. The terminal sends the registration information to the server, and the server stores this information in a profile database.
[0210] The server uses information analysis tools to analyze information about users' hobbies and values and determine compatibility between users. Here, the server processes user input data and estimates the user's emotional state in real time using an emotion analysis engine. Specific hardware used includes microphones for speech recognition and cameras for facial recognition. Emotion analysis may involve using emotion recognition via APIs of cloud services, for example.
[0211] The server further uses a generative artificial intelligence model to support conversations and suggest appropriate matches based on the user's emotional state and compatibility information. This allows it to generate feedback for the user and present supportive messages such as, "You seem stressed today. I suggest an activity that will help you relax."
[0212] For example, if the server detects that a user is feeling "down," it can suggest, "Shall we look for ways to cheer you up?" In this case, a generative AI model is used to construct specific advice.
[0213] An example of a prompt message is: "If the user's emotion is detected as 'fatigue,' the AI model will suggest ways to relax and topics of conversation."
[0214] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0215] Step 1:
[0216] The user uses a communication application to add the system's official account as a friend. This causes the device to send a registration request, which the server receives. The input is the user's registration information, and the output is the user's information stored in the profile database. Based on this data, the server saves the user's basic information to the database.
[0217] Step 2:
[0218] The server sends questions to the user about their hobbies and values. When the terminal receives a question, the user enters their answer and sends it to the server. The input is the user's answer about their hobbies and values, and the output is data analyzed by an information analysis tool. The server filters the data and performs analysis using specific keywords and scoring techniques.
[0219] Step 3:
[0220] The server uses emotion estimation methods to estimate the user's emotional state in real time. Inputs are the user's behavioral patterns and voice / facial expression data, while output is the estimated emotional state. The server collects and analyzes user emotional data via cloud service APIs using speech recognition and image analysis technologies.
[0221] Step 4:
[0222] The server determines the compatibility between a user and other users through a compatibility assessment mechanism. The input is analyzed hobby / values data and emotional state data, and the output is a list of other users who have been determined to be compatible. The server uses a machine learning algorithm to integrate this data and calculate a compatibility score.
[0223] Step 5:
[0224] The server uses a candidate suggestion mechanism to suggest compatible users to the user while maintaining anonymity. The input is the compatibility assessment result, and the output is a list of candidates and advice presented to the user. The server performs the function of selecting appropriate user information and securely mediating communication to the user's terminal.
[0225] Step 6:
[0226] The server uses conversational support tools and a generative AI model to generate conversational support that responds to the user's real-time emotional state. The input is the estimated emotional state, and the output is a specific conversational support message for the user. The server then uses the generative AI model as a prompt and constructs a natural language conversation based on the prompt text.
[0227] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0228] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0229] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.
[0230] [Second Embodiment]
[0231] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.
[0232] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0233] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0234] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.
[0235] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0236] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0237] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0238] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0239] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0240] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0241] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0242] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0243] One embodiment of the present invention includes a process that uses a communication infrastructure to match users with other users.
[0244] First, users access the system using a messaging app available on their device. Registration for using the system is completed when the user adds the official account as a friend. The server receives this registration request and stores the user's basic information as a profile in the database. This allows each user to have a unique profile.
[0245] Next, the user provides the server with detailed information such as their hobbies and values by answering a series of questions provided by the system. This information is analyzed by information analysis tools and used to reveal the user's characteristics. Based on these analysis results, the server compares them with other user profiles in the database to determine compatible candidates.
[0246] The server then uses the analyzed data to suggest candidates deemed compatible with the user. The information presented is anonymized, ensuring secure matching while protecting user privacy. If a user is interested in a suggested candidate, they can send a direct message via anonymous communication.
[0247] The server also provides features to assist communication between users. This includes suggesting date plans based on users' interests. For example, if a user shares a love of watching movies, the server can recommend a "date plan to go to the cinema."
[0248] Through this series of processes, the system provides users with the ability to easily and safely explore new encounters using existing messaging apps, without having to install any new applications.
[0249] The following describes the processing flow.
[0250] Step 1:
[0251] The user adds the official account as a friend using their device's messaging app and sends the message "Start". The server receives this message and creates a new user profile in its database based on the user's LINE ID.
[0252] Step 2:
[0253] The server sends the user messages containing questions about their hobbies and values. The user then enters and submits their answers to these questions via their device.
[0254] Step 3:
[0255] The server analyzes the responses received from the user using information analysis tools and records a detailed profile of the user's hobbies and values.
[0256] Step 4:
[0257] The server uses the analyzed user profile to compare it with other user profiles in the database. An AI algorithm is then used to select candidates deemed to be a good match.
[0258] Step 5:
[0259] The server presents the user with anonymized information about selected candidates. If the user is interested in a suggested candidate, they are given the option to send a message to that candidate via an anonymous communication method.
[0260] Step 6:
[0261] When a user wishes to communicate with a proposed candidate, they send an acceptance message to the server via their device. The server then initiates an anonymous communication session between the user and the candidate.
[0262] Step 7:
[0263] The server uses a dating suggestion system to encourage conversations between users by offering suggestions for date plans based on shared hobbies. These suggestions are sent to users as messages.
[0264] Step 8:
[0265] Users provide feedback on the date plan presented via their device and decide on the next steps. This ensures continuous and smooth communication.
[0266] (Example 1)
[0267] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0268] In online dating environments, preventing the leakage of personal information and incompatible pairings between users is crucial. Furthermore, providing an environment where users can communicate with each other safely is essential. However, effective means to simultaneously address these challenges have not yet been sufficiently developed.
[0269] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0270] In this invention, the server includes means for receiving user registration via an information terminal, data analysis means for analyzing data related to preferences and interests, and determination means for determining affinity. This makes it possible to provide highly accurate matching and a secure communication environment while maintaining user anonymity.
[0271] An "information terminal" is a device equipped with communication capabilities that a user uses to access a system.
[0272] "Users" refer to individuals who seek to meet and communicate with others through the system.
[0273] A "data analysis tool" is a mechanism for analyzing data based on preferences and interests obtained from users and for evaluating user characteristics.
[0274] A "determination means" is a mechanism for evaluating compatibility with other users based on analyzed data and identifying suitable candidates.
[0275] A "candidate recommendation method" is a system that selects users with high affinity and proposes those candidates to them.
[0276] An "anonymity mediation method" is a mechanism for conducting communications while maintaining the anonymity of the users.
[0277] An "activity suggestion mechanism" is a system designed to suggest appropriate activities and events based on users' interests and to promote interaction.
[0278] This invention provides a system that allows users to access the system via an information terminal, determine appropriate compatibility with other users, and communicate safely with unknown individuals.
[0279] Users register with the system via an internet connection using information terminals such as smartphones and tablets. During registration, the user's basic information is sent to the server and stored in the database. At this point, the server receives the information and manages it appropriately.
[0280] Next, the user inputs data about their preferences and interests through the system's interface. This data is analyzed by information analysis tools to evaluate the user's characteristics. The analysis is performed on a server, and the latest machine learning algorithms and generative AI models are used to ensure efficient and accurate processing.
[0281] Based on the data analysis results, the server matches users with other users based on affinity. During this process, a candidate recommendation system is used, suggesting anonymized candidate information to the user. This ensures optimal matching for the user while protecting their privacy.
[0282] As a specific example, when user A inputs that they are interested in music and classical music is their hobby, the server finds and recommends user B who has a similar hobby. At this time, anonymity is also maintained, enabling safe communication based on mutual interests.
[0283] Finally, in order to conduct anonymous mediation among users, the server provides direct contact on the communication platform so that users can communicate with confidence. At this time, suggestions for events and activities are also made to support the establishment of relationships among users.
[0284] As a specific example of the prompt text, questions such as "I want to find new encounters. Please teach me the registration procedures and how to use the system. How can I anonymously connect with people who I'm interested in?" are used. Such prompt text promotes natural interaction between the system and the user and supports intuitive operations.
[0285] The flow of the specific process in Example 1 will be described using FIG. 11.
[0286] Step 1:
[0287] The user adds the official account as a friend from the information terminal and accesses the system.
[0288] By this operation, a registration request is sent to the server. The input includes the user's basic information (name, contact information, etc.). The server receives this and stores it in the database. The output is the state where the user's profile is individually stored in the database.
[0289] Step 2:
[0290] The user answers the questions presented by the system and inputs information regarding hobbies and interests.
[0291] Users complete these selections and inputs on the terminal interface and send them to the server. Input includes multiple-choice answers and free-text information. The server stores the received information in a database for analysis. The output is user interest information ready for analysis.
[0292] Step 3:
[0293] The server analyzes the input data using data analysis tools and evaluates the user's characteristics.
[0294] In this step, a generative AI model is used to statistically analyze the user's preferences and interests. The input is the interest information received in step 2. Through data calculations, the user's preference characteristics are quantified. The output is feature data associated with the user's profile.
[0295] Step 4:
[0296] The server performs affinity assessment based on the analyzed data and compares it with other user profiles in the database.
[0297] This process creates a list of highly compatible users. The input consists of user characteristic data and other user profile information. A similarity score is calculated using a determination algorithm. The output is a list of highly compatible candidates.
[0298] Step 5:
[0299] The server anonymizes the information of matched candidates and presents it to the user.
[0300] The information is sent to the device in a visual list format. The inputs are the candidate list generated in step 4 and the original profile information. Privacy is ensured through the anonymization process. The output is the anonymized candidate information presented to the user.
[0301] Step 6:
[0302] The user sends a message to the proposed candidate through anonymous communication means.
[0303] Message input is performed from the terminal interface, and the send button is pressed. The input is the message text entered by the user. The server receives this and transfers it to the other party via the anonymous ID. The output is the anonymous message that reaches the other party's terminal.
[0304] Step 7:
[0305] The server generates activity proposals based on the user's interests and promotes communication.
[0306] This includes proposals for date plans and event information using a generation AI model. The inputs are the commonalities and hobby information between users, and past data. The generated proposals are sent to the terminal for the user. The output is the customized activity proposals received by the user.
[0307] (Application Example 1)
[0308] Next, Application Example 1 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart glasses 214 are referred to as the "terminal".
[0309] In daily life, it is difficult for users to build new relationships based on their own interests and activities, and there is also a problem that there is a lack of means to carry out such activities while protecting individual privacy. Against this background, there is an increasing need for a system that supports appropriate relationship building while safely handling personal information.
[0310] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0311] In this invention, the server includes a function to receive user registrations via bidirectional communication means, a data analysis function to analyze information about the activities and interests obtained from the user, and a compatibility determination function to determine the degree of compatibility with other users based on the analyzed information. This enables efficient and safe matching of users with other users who share their interests.
[0312] "Users" refer to individuals who use the system to attempt to build new relationships.
[0313] "Registration" refers to the act of a user providing their basic information and interests to the system and creating a profile for using the service.
[0314] "Two-way communication means" refers to the digital communication infrastructure between users and servers that enables the sending and receiving of information.
[0315] "Activities and interests" refer to the user's hobbies and personal interests related to specific areas of activity.
[0316] "Data analysis function" refers to the processing capability to analyze user characteristics and trends based on acquired information and generate useful results.
[0317] "Fit" refers to the degree to which users' interests and values align, evaluated using numerical values and indicators.
[0318] The "matching determination function" is a function that determines the degree of matching with other users based on the results obtained from data analysis.
[0319] The "selection suggestion function" is a function that suggests other users who share similar interests and activities to the user.
[0320] "Anonymity" is an attribute that ensures the confidentiality of personal information between users and enables secure communication.
[0321] The "anonymous information exchange function" is a feature that allows users to exchange information with each other without identifying their personal information.
[0322] A "generative AI model" refers to an artificial intelligence algorithm that uses machine learning techniques to perform advanced information generation and analysis.
[0323] In this embodiment of the invention, it is possible for users to easily and safely engage in new forms of communication based on their interests using household robots and smart devices. The system operates in the following manner.
[0324] The server receives user registrations via a two-way communication method. Users provide information about their activities and interests through this communication method. The acquired information is analyzed by a data analysis function to reveal user characteristics and trends. This analysis utilizes data analysis tools such as those from Google Cloud.
[0325] Subsequently, based on the analyzed information, the server calculates the degree of compatibility with other users. This compatibility determination takes into account past behavioral patterns and the degree of shared interests. After the compatibility determination is made, the selection suggestion function proposes the most suitable match for the user.
[0326] Interactions between users take place via an anonymous information exchange function, ensuring privacy and enabling secure communication. This utilizes an anonymous communication method based on the Twilio API. Furthermore, it is possible to leverage generative AI models to provide diverse information and suggestions to improve the user experience. In particular, when proposing activities, the generative AI model can be used to generate a variety of ideas.
[0327] For example, if a user is interested in travel, the system will suggest "finding a matching partner related to the user's travel destinations and enabling conversations on topics related to those regions." The following prompt can be used for the generating AI model: "Generate suggestions that will allow the user, who loves travel, to continue a conversation about places they want to visit."
[0328] In this way, through the cooperation of servers, terminals, and users, a system is realized that provides a safe communication experience that respects individual tastes and preferences.
[0329] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0330] Step 1:
[0331] The user accesses the server via a two-way communication method using a terminal. The user provides registration information, and the terminal sends this information to the server. The input in this process is the user's basic profile information, and the output generates the user's account information to be registered on the server.
[0332] Step 2:
[0333] The server passes registration information submitted by users to the data analysis function. The server analyzes information about activities and interests and extracts user characteristics. The input is registration information, and the output is characteristic data based on each user's interests. This data is processed using a cloud-based analysis tool.
[0334] Step 3:
[0335] The server determines the degree of compatibility with other users based on the analyzed characteristic data. The input is characteristic data, and the output is a compatibility evaluation with other users. The compatibility is calculated using an algorithm, quantifying the degree of agreement in tastes and preferences between users.
[0336] Step 4:
[0337] The server uses a selection suggestion function to propose matching candidates to the user based on the goodness-of-fit assessment. The input is the goodness-of-fit assessment, and the output is a list of recommended matching candidates. The server prepares this information for anonymous information exchange.
[0338] Step 5:
[0339] The user selects on the terminal whether to accept or reject the proposed matching candidates. The input is a list of matching candidates, and the output is the choice to accept or reject. Through this operation, the user will exchange anonymous information with the selected person.
[0340] Step 6:
[0341] The server uses an anonymous information exchange function to enable secure communication between users. Input is a consented communication request between users, and output is the sending and receiving of anonymous messages. The Twilio API used in this process mediates message exchange while protecting privacy.
[0342] Step 7:
[0343] The server uses a generative AI model to generate suggestions to improve the user experience. Inputs include the user's profile and past message history, while outputs are generated suggestions and activity ideas. Utilizing prompts, the generative AI model suggests content that matches the user's interests.
[0344] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0345] One embodiment of the present invention is a system in which a user matches with other users via an existing communication application, and this includes a configuration that incorporates an emotion engine.
[0346] First, the user adds the system's official account as a friend using a messaging app available on their device, completing the registration process. The server receives the registration information from the user and stores it in the profile database. After the registration process, the server sends the user questions about their hobbies, values, and daily activities. This information is collected by data analysis tools to analyze the user's preferences in detail.
[0347] A new feature introduced is an emotion engine, which analyzes user input data and behavioral patterns to estimate the user's emotional state in real time. This emotional state is integrated with the compatibility determination system and becomes an important factor for the server to make more precise decisions regarding matching users with other users.
[0348] Based on the analysis results, the server anonymously suggests other users that it deems to be a good match for the user. These suggestions include comments and recommendations that take the user's emotional state into consideration, ensuring the suggestions are more appropriate for the user. If the user accepts a suggestion, the server enables direct message exchange using anonymous communication methods.
[0349] Furthermore, the emotion engine analyzes the context of the conversation and the user's emotional state, providing appropriate conversational support and advice in real time. For example, if the user is showing signs of anxiety, the server will present relevant support messages, such as "Suggesting a relaxing topic."
[0350] In this way, this system utilizes existing messaging apps and combines them with sentiment analysis to provide a matching service that allows users to communicate with others safely, securely, and effectively.
[0351] The following describes the processing flow.
[0352] Step 1:
[0353] The user adds the official account as a friend using their device's messaging app and sends the message "Start". The server receives this message, registers the user's identification information in its database, and creates a profile.
[0354] Step 2:
[0355] The server sends questions to the user about their interests, values, and daily activities. The user responds to these questions via their device. The server collects the user's responses using information analysis tools and uses them to detail their profile information.
[0356] Step 3:
[0357] The server collects user input and behavioral data in real time and passes it to the emotion engine. The emotion engine analyzes this data and estimates the user's current emotional state.
[0358] Step 4:
[0359] The server combines emotional state data with compatibility assessment tools to accurately determine compatibility with other users. It then suggests anonymized information about candidates deemed to be a good match to the user.
[0360] Step 5:
[0361] If a user is interested in a proposed candidate, they send a pre-approval message to the server via their device. The server then uses an anonymous communication method to allow message exchange with the proposed candidate and initiates a session.
[0362] Step 6:
[0363] The server provides real-time guidance and advice to facilitate conversation based on the user's emotional state, as analyzed by the emotion engine. For example, if the server determines that the user is feeling stressed, it will provide a message such as, "Try talking about a topic that helps you relax."
[0364] Step 7:
[0365] Users communicate with suggested candidates while following conversational guides and advice provided through their devices. The server continuously collects data and optimizes the system to improve the user experience.
[0366] (Example 2)
[0367] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0368] In modern online communication, there is a need for privacy protection to allow users to interact with others with peace of mind, as well as highly accurate compatibility assessments based on emotions and preferences. However, conventional systems lack sufficient emotional evaluation and real-time conversation support, making it difficult for users to efficiently find suitable partners.
[0369] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0370] In this invention, the server includes a device for receiving user registrations via a communication device, a data analysis device for analyzing information on preferences and value criteria obtained from the user, and an emotion analysis device for estimating the user's emotional state from the user's input information and behavioral patterns. This enables users to communicate appropriately with other users in a safe and trustworthy environment and to obtain opportunities for interaction through highly accurate matching.
[0371] "User" refers to an individual or group that uses this system to communicate with other participants.
[0372] "Communication equipment" is a general term for hardware and network infrastructure used to send and receive data online.
[0373] A "data analysis device" refers to software or hardware used to process information collected from users and extract characteristics such as preferences and value criteria.
[0374] An "emotional analysis device" refers to a technical means for analyzing and estimating a user's emotional state based on their input data and behavioral patterns.
[0375] A "compatibility determination device" refers to a system component that calculates the compatibility between users based on analyzed information and identifies a suitable partner.
[0376] A "candidate suggestion device" refers to a system component that has the function of notifying the user of the compatibility determination results and facilitating communication with a suitable partner.
[0377] An "anonymous communication device" refers to a means of communication that enables users to exchange messages with each other while ensuring user privacy.
[0378] A "generative AI model" is an algorithm or system technology that uses artificial intelligence to automatically generate appropriate conversation content and suggestions that correspond to the user's emotional state.
[0379] A "conversation support device" refers to a technical component that assists users' communication by providing appropriate advice and information during communication.
[0380] To implement this invention, the user first opens an existing communication application on their terminal and registers by adding the system's official account. At this time, the terminal transmits the user's registration information to the server via an online communication device.
[0381] The server uses data analysis equipment to analyze information about the user's preferences and values based on the received information. Specific analysis includes text mining and clustering algorithms based on the collected response data. Furthermore, an emotion analysis device processes this data in real time to estimate the user's emotional state. The software used for this analysis includes a natural language processing engine, enriching human interaction by analyzing emotions and tone.
[0382] Based on the analysis results, the server uses an affinity determination device to determine affinity with other users. A generation AI model is utilized in this process to generate highly accurate suggestions that take into account the user's emotional state. The system anonymously presents candidates of highly compatible users and makes these suggestions to the user through a candidate suggestion device.
[0383] Once a user accepts a proposal, the server enables communication with the other user via an anonymous communication device. During this interaction, the conversation support device utilizes a generated AI model to provide the most appropriate conversational support for the user in real time. For example, if a user is feeling anxious, the device will offer relaxing topics and supportive messages through the conversation.
[0384] For example, if information is analyzed indicating that user A enjoys cooking as a hobby, the server will suggest, "You seem like a good match as a cooking buddy." Another example of a prompt message used as input to the generation AI model is, "Consider the user's emotional state and automatically generate appropriate and empathetic conversation content."
[0385] Thus, this system supports users in enjoying safe and effective communication.
[0386] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0387] Step 1:
[0388] The user adds the system's official account as a friend within their messaging application using their device. This initiates the user registration process. The user provides either the official account's ID or QR code as input, and the system registration information is generated as output.
[0389] Step 2:
[0390] The server receives user registration information via a communication device. This information is stored in a data store. The input is the user's basic profile information (e.g., user ID, name), and the output is saving to the profile database.
[0391] Step 3:
[0392] The server sends questions to registered users about their hobbies and daily activities. These questions are provided as input information in the form of a set of questions sent to the terminal, and the user's answers are sent back to the server as output.
[0393] Step 4:
[0394] The server uses a data analysis device to analyze user response data. The input for processing is the user's responses, and the output, derived from text mining techniques, reveals the user's preferences and values. For example, it might extract from the responses that the user likes "outdoors."
[0395] Step 5:
[0396] The server estimates the user's emotional state in real time through an emotion analysis device. The input consists of the user's response data and conversation content, and natural language processing technology is used to identify the emotion (e.g., happiness, tension) and output it.
[0397] Step 6:
[0398] The server utilizes a generative AI model to determine affinity based on analyzed preferences and emotional states, and calculates compatibility with other users. The input consists of preference data and emotional data, and the output generates an affinity score.
[0399] Step 7:
[0400] The server generates a list of highly compatible users and makes suggestions to the user using a candidate suggestion device. The input information is the affinity score, and a generative AI model is used to generate suggestion messages that are presented in an attractive and appropriate manner.
[0401] Step 8:
[0402] If the user reviews and accepts the proposal on their device, the server will use an anonymous communication device to begin exchanging messages with the other proposed user. The input is the user's acceptance, and the output is the establishment of an anonymous communication route.
[0403] Step 9:
[0404] The server uses a conversation support device to provide real-time conversation support through a generated AI model during anonymous communication. Input information includes the content and emotional state of the conversation, while output is support messages and advice. For example, if the conversation becomes tense, support such as "offering a relaxing topic" may be provided.
[0405] (Application Example 2)
[0406] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0407] In today's information society, more sophisticated compatibility assessments and conversational support tailored to emotions are needed for users to connect with others safely and securely. However, conventional systems have faced the challenge of being unable to accurately analyze users' emotional states and provide appropriate support based on that analysis.
[0408] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0409] In this invention, the server includes means for receiving user registration via online communication means, information analysis means for analyzing information on hobbies and values obtained from the user, and emotion estimation means for estimating the user's emotional state in real time. This makes it possible to determine compatibility with the user with higher accuracy and to provide conversational support that is appropriate to their emotions.
[0410] "User" refers to an individual who uses this system to communicate with other users.
[0411] "Online communication methods" refer to methods and technologies for sending and receiving information via networks such as the internet.
[0412] "Information analysis means" refers to technical methods for processing data obtained from users and analyzing their hobbies and values.
[0413] "Compatibility assessment method" refers to a method for evaluating and determining the degree of compatibility between a user and other users.
[0414] "Candidate suggestion method" refers to a method for presenting users with other users who have been determined to be a good match.
[0415] "Anonymous communication methods" refer to means of communicating with other users while keeping the user's personal information confidential.
[0416] "Emotion estimation methods" refer to technologies that analyze user input data and behavioral patterns to estimate emotional states.
[0417] "Conversation support methods" refer to methods that provide appropriate conversational guidance and support to users based on their estimated emotional state.
[0418] The system that implements this application consists mainly of a terminal and a server. First, the user registers by using a communication application on the terminal and adding the system's official account as a friend. The terminal sends the registration information to the server, and the server stores this information in a profile database.
[0419] The server uses information analysis tools to analyze information about users' hobbies and values and determine compatibility between users. Here, the server processes user input data and estimates the user's emotional state in real time using an emotion analysis engine. Specific hardware used includes microphones for speech recognition and cameras for facial recognition. Emotion analysis may involve using emotion recognition via APIs of cloud services, for example.
[0420] The server further uses a generative artificial intelligence model to support conversations and suggest appropriate matches based on the user's emotional state and compatibility information. This allows it to generate feedback for the user and present supportive messages such as, "You seem stressed today. I suggest an activity that will help you relax."
[0421] For example, if the server detects that a user is feeling "down," it can suggest, "Shall we look for ways to cheer you up?" In this case, a generative AI model is used to construct specific advice.
[0422] An example of a prompt message is: "If the user's emotion is detected as 'fatigue,' the AI model will suggest ways to relax and topics of conversation."
[0423] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0424] Step 1:
[0425] The user uses a communication application to add the system's official account as a friend. This causes the device to send a registration request, which the server receives. The input is the user's registration information, and the output is the user's information stored in the profile database. Based on this data, the server saves the user's basic information to the database.
[0426] Step 2:
[0427] The server sends questions to the user about their hobbies and values. When the terminal receives a question, the user enters their answer and sends it to the server. The input is the user's answer about their hobbies and values, and the output is data analyzed by an information analysis tool. The server filters the data and performs analysis using specific keywords and scoring techniques.
[0428] Step 3:
[0429] The server uses emotion estimation methods to estimate the user's emotional state in real time. Inputs are the user's behavioral patterns and voice / facial expression data, while output is the estimated emotional state. The server collects and analyzes user emotional data via cloud service APIs using speech recognition and image analysis technologies.
[0430] Step 4:
[0431] The server determines the compatibility between a user and other users through a compatibility assessment mechanism. The input is analyzed hobby / values data and emotional state data, and the output is a list of other users who have been determined to be compatible. The server uses a machine learning algorithm to integrate this data and calculate a compatibility score.
[0432] Step 5:
[0433] The server uses a candidate suggestion mechanism to suggest compatible users to the user while maintaining anonymity. The input is the compatibility assessment result, and the output is a list of candidates and advice presented to the user. The server performs the function of selecting appropriate user information and securely mediating communication to the user's terminal.
[0434] Step 6:
[0435] The server uses conversational support tools and a generative AI model to generate conversational support that responds to the user's real-time emotional state. The input is the estimated emotional state, and the output is a specific conversational support message for the user. The server then uses the generative AI model as a prompt and constructs a natural language conversation based on the prompt text.
[0436] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0437] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0438] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.
[0439] [Third Embodiment]
[0440] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.
[0441] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[0442] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0443] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.
[0444] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0445] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0446] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0447] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0448] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0449] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0450] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0451] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".
[0452] One embodiment of the present invention includes a process that uses a communication infrastructure to match users with other users.
[0453] First, users access the system using a messaging app available on their device. Registration for using the system is completed when the user adds the official account as a friend. The server receives this registration request and stores the user's basic information as a profile in the database. This allows each user to have a unique profile.
[0454] Next, the user provides the server with detailed information such as their hobbies and values by answering a series of questions provided by the system. This information is analyzed by information analysis tools and used to reveal the user's characteristics. Based on these analysis results, the server compares them with other user profiles in the database to determine compatible candidates.
[0455] The server then uses the analyzed data to suggest candidates deemed compatible with the user. The information presented is anonymized, ensuring secure matching while protecting user privacy. If a user is interested in a suggested candidate, they can send a direct message via anonymous communication.
[0456] The server also provides features to assist communication between users. This includes suggesting date plans based on users' interests. For example, if a user shares a love of watching movies, the server can recommend a "date plan to go to the cinema."
[0457] Through this series of processes, the system provides users with the ability to easily and safely explore new encounters using existing messaging apps, without having to install any new applications.
[0458] The following describes the processing flow.
[0459] Step 1:
[0460] The user adds the official account as a friend using their device's messaging app and sends the message "Start". The server receives this message and creates a new user profile in its database based on the user's LINE ID.
[0461] Step 2:
[0462] The server sends the user messages containing questions about their hobbies and values. The user then enters and submits their answers to these questions via their device.
[0463] Step 3:
[0464] The server analyzes the responses received from the user using information analysis tools and records a detailed profile of the user's hobbies and values.
[0465] Step 4:
[0466] The server uses the analyzed user profile to compare it with other user profiles in the database. An AI algorithm is then used to select candidates deemed to be a good match.
[0467] Step 5:
[0468] The server presents the user with anonymized information about selected candidates. If the user is interested in a suggested candidate, they are given the option to send a message to that candidate via an anonymous communication method.
[0469] Step 6:
[0470] When a user wishes to communicate with a proposed candidate, they send an acceptance message to the server via their device. The server then initiates an anonymous communication session between the user and the candidate.
[0471] Step 7:
[0472] The server uses a dating suggestion system to encourage conversations between users by offering suggestions for date plans based on shared hobbies. These suggestions are sent to users as messages.
[0473] Step 8:
[0474] Users provide feedback on the date plan presented via their device and decide on the next steps. This ensures continuous and smooth communication.
[0475] (Example 1)
[0476] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0477] In online dating environments, preventing the leakage of personal information and incompatible pairings between users is crucial. Furthermore, providing an environment where users can communicate with each other safely is essential. However, effective means to simultaneously address these challenges have not yet been sufficiently developed.
[0478] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0479] In this invention, the server includes means for receiving user registration via an information terminal, data analysis means for analyzing data related to preferences and interests, and determination means for determining affinity. This makes it possible to provide highly accurate matching and a secure communication environment while maintaining user anonymity.
[0480] An "information terminal" is a device equipped with communication capabilities that a user uses to access a system.
[0481] "Users" refer to individuals who seek to meet and communicate with others through the system.
[0482] A "data analysis tool" is a mechanism for analyzing data based on preferences and interests obtained from users and for evaluating user characteristics.
[0483] A "determination means" is a mechanism for evaluating compatibility with other users based on analyzed data and identifying suitable candidates.
[0484] A "candidate recommendation method" is a system that selects users with high affinity and proposes those candidates to them.
[0485] An "anonymity mediation method" is a mechanism for conducting communications while maintaining the anonymity of the users.
[0486] An "activity suggestion mechanism" is a system designed to suggest appropriate activities and events based on users' interests and to promote interaction.
[0487] This invention provides a system that allows users to access the system via an information terminal, determine appropriate compatibility with other users, and communicate safely with unknown individuals.
[0488] Users register with the system via an internet connection using information terminals such as smartphones and tablets. During registration, the user's basic information is sent to the server and stored in the database. At this point, the server receives the information and manages it appropriately.
[0489] Next, the user inputs data about their preferences and interests through the system's interface. This data is analyzed by information analysis tools to evaluate the user's characteristics. The analysis is performed on a server, and the latest machine learning algorithms and generative AI models are used to ensure efficient and accurate processing.
[0490] Based on the data analysis results, the server matches users with other users based on affinity. During this process, a candidate recommendation system is used, suggesting anonymized candidate information to the user. This ensures optimal matching for the user while protecting their privacy.
[0491] For example, if user A enters that they are interested in music and enjoy classical music, the server will find and recommend user B, who shares a similar interest. Even in this case, anonymity is maintained, and secure communication based on mutual interests is possible.
[0492] Finally, the server facilitates anonymous communication between users, providing direct contact on the communication platform and enabling users to communicate with each other with confidence. It also proposes events and activities to support the building of user relationships.
[0493] A concrete example of a prompt message is a question like, "I want to find new connections. Please tell me about the registration process and how to use the system. How can I connect with people I'm interested in anonymously?" Such prompt messages facilitate natural interaction between the system and the user and support intuitive operation.
[0494] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0495] Step 1:
[0496] Users add the official account as a friend from their information terminal and access the system.
[0497] This action sends a registration request to the server. The input includes the user's basic information (name, contact information, etc.). The server receives this and stores it in the database. The output is a state where the user's profile is stored individually in the database.
[0498] Step 2:
[0499] Users answer questions presented by the system and input information about their hobbies and interests.
[0500] Users complete these selections and inputs on the terminal interface and send them to the server. Input includes multiple-choice answers and free-text information. The server stores the received information in a database for analysis. The output is user interest information ready for analysis.
[0501] Step 3:
[0502] The server analyzes the input data using data analysis tools and evaluates the user's characteristics.
[0503] In this step, a generative AI model is used to statistically analyze the user's preferences and interests. The input is the interest information received in step 2. Through data calculations, the user's preference characteristics are quantified. The output is feature data associated with the user's profile.
[0504] Step 4:
[0505] The server performs affinity assessment based on the analyzed data and compares it with other user profiles in the database.
[0506] This process creates a list of highly compatible users. The input consists of user characteristic data and other user profile information. A similarity score is calculated using a determination algorithm. The output is a list of highly compatible candidates.
[0507] Step 5:
[0508] The server anonymizes the information of matched candidates and presents it to the user.
[0509] The information is sent to the device in a visual list format. The inputs are the candidate list generated in step 4 and the original profile information. Privacy is ensured through the anonymization process. The output is the anonymized candidate information presented to the user.
[0510] Step 6:
[0511] Users send messages to the suggested candidates via anonymous communication methods.
[0512] The user enters a message through the terminal's interface and presses the send button. The input is the message text entered by the user. The server receives this and forwards it to the recipient via an anonymous ID. The output is an anonymous message that arrives on the recipient's terminal.
[0513] Step 7:
[0514] The server generates activity suggestions based on user interests and encourages interaction.
[0515] This includes suggesting date plans and event information using a generative AI model. Inputs include commonalities and preferences between users, as well as past data. The generated suggestions are sent to the user's device. The output is a customized activity suggestion that the user receives.
[0516] (Application Example 1)
[0517] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0518] In daily life, it is difficult for users to build new relationships based on their own interests and activities, and there is a lack of means to conduct such activities while protecting individual privacy. Against this backdrop, there is a growing need for a system that supports the building of appropriate relationships while safely handling personal information.
[0519] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0520] In this invention, the server includes a function to receive user registrations via bidirectional communication means, a data analysis function to analyze information about the activities and interests obtained from the user, and a compatibility determination function to determine the degree of compatibility with other users based on the analyzed information. This enables efficient and safe matching of users with other users who share their interests.
[0521] "Users" refer to individuals who use the system to attempt to build new relationships.
[0522] "Registration" refers to the act of a user providing their basic information and interests to the system and creating a profile for using the service.
[0523] "Two-way communication means" refers to the digital communication infrastructure between users and servers that enables the sending and receiving of information.
[0524] "Activities and interests" refer to the user's hobbies and personal interests related to specific areas of activity.
[0525] "Data analysis function" refers to the processing capability to analyze user characteristics and trends based on acquired information and generate useful results.
[0526] "Fit" refers to the degree to which users' interests and values align, evaluated using numerical values and indicators.
[0527] The "matching determination function" is a function that determines the degree of matching with other users based on the results obtained from data analysis.
[0528] The "selection suggestion function" is a function that suggests other users who share similar interests and activities to the user.
[0529] "Anonymity" is an attribute that ensures the confidentiality of personal information between users and enables secure communication.
[0530] The "anonymous information exchange function" is a feature that allows users to exchange information with each other without identifying their personal information.
[0531] A "generative AI model" refers to an artificial intelligence algorithm that uses machine learning techniques to perform advanced information generation and analysis.
[0532] In this embodiment of the invention, it is possible for users to easily and safely engage in new forms of communication based on their interests using household robots and smart devices. The system operates in the following manner.
[0533] The server receives user registrations via a two-way communication method. Users provide information about their activities and interests through this communication method. The acquired information is analyzed by a data analysis function to reveal user characteristics and trends. This analysis utilizes data analysis tools such as those from Google Cloud.
[0534] Subsequently, based on the analyzed information, the server calculates the degree of compatibility with other users. This compatibility determination takes into account past behavioral patterns and the degree of shared interests. After the compatibility determination is made, the selection suggestion function proposes the most suitable match for the user.
[0535] Interactions between users take place via an anonymous information exchange function, ensuring privacy and enabling secure communication. This utilizes an anonymous communication method based on the Twilio API. Furthermore, it is possible to leverage generative AI models to provide diverse information and suggestions to improve the user experience. In particular, when proposing activities, the generative AI model can be used to generate a variety of ideas.
[0536] For example, if a user is interested in travel, the system will suggest "finding a matching partner related to the user's travel destinations and enabling conversations on topics related to those regions." The following prompt can be used for the generating AI model: "Generate suggestions that will allow the user, who loves travel, to continue a conversation about places they want to visit."
[0537] In this way, through the cooperation of servers, terminals, and users, a system is realized that provides a safe communication experience that respects individual tastes and preferences.
[0538] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0539] Step 1:
[0540] The user accesses the server via a two-way communication method using a terminal. The user provides registration information, and the terminal sends this information to the server. The input in this process is the user's basic profile information, and the output generates the user's account information to be registered on the server.
[0541] Step 2:
[0542] The server passes registration information submitted by users to the data analysis function. The server analyzes information about activities and interests and extracts user characteristics. The input is registration information, and the output is characteristic data based on each user's interests. This data is processed using a cloud-based analysis tool.
[0543] Step 3:
[0544] The server determines the degree of compatibility with other users based on the analyzed characteristic data. The input is characteristic data, and the output is a compatibility evaluation with other users. The compatibility is calculated using an algorithm, quantifying the degree of agreement in tastes and preferences between users.
[0545] Step 4:
[0546] The server uses a selection suggestion function to propose matching candidates to the user based on the goodness-of-fit assessment. The input is the goodness-of-fit assessment, and the output is a list of recommended matching candidates. The server prepares this information for anonymous information exchange.
[0547] Step 5:
[0548] The user selects on the terminal whether to accept or reject the proposed matching candidates. The input is a list of matching candidates, and the output is the choice to accept or reject. Through this operation, the user will exchange anonymous information with the selected person.
[0549] Step 6:
[0550] The server uses an anonymous information exchange function to enable secure communication between users. Input is a consented communication request between users, and output is the sending and receiving of anonymous messages. The Twilio API used in this process mediates message exchange while protecting privacy.
[0551] Step 7:
[0552] The server uses a generative AI model to generate suggestions to improve the user experience. Inputs include the user's profile and past message history, while outputs are generated suggestions and activity ideas. Utilizing prompts, the generative AI model suggests content that matches the user's interests.
[0553] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0554] One embodiment of the present invention is a system in which a user matches with other users via an existing communication application, and this includes a configuration that incorporates an emotion engine.
[0555] First, the user adds the system's official account as a friend using a messaging app available on their device, completing the registration process. The server receives the registration information from the user and stores it in the profile database. After the registration process, the server sends the user questions about their hobbies, values, and daily activities. This information is collected by data analysis tools to analyze the user's preferences in detail.
[0556] A new feature introduced is an emotion engine, which analyzes user input data and behavioral patterns to estimate the user's emotional state in real time. This emotional state is integrated with the compatibility determination system and becomes an important factor for the server to make more precise decisions regarding matching users with other users.
[0557] Based on the analysis results, the server anonymously suggests other users that it deems to be a good match for the user. These suggestions include comments and recommendations that take the user's emotional state into consideration, ensuring the suggestions are more appropriate for the user. If the user accepts a suggestion, the server enables direct message exchange using anonymous communication methods.
[0558] Furthermore, the emotion engine analyzes the context of the conversation and the user's emotional state, providing appropriate conversational support and advice in real time. For example, if the user is showing signs of anxiety, the server will present relevant support messages, such as "Suggesting a relaxing topic."
[0559] In this way, this system utilizes existing messaging apps and combines them with sentiment analysis to provide a matching service that allows users to communicate with others safely, securely, and effectively.
[0560] The following describes the processing flow.
[0561] Step 1:
[0562] The user adds the official account as a friend using their device's messaging app and sends the message "Start". The server receives this message, registers the user's identification information in its database, and creates a profile.
[0563] Step 2:
[0564] The server sends questions to the user about their interests, values, and daily activities. The user responds to these questions via their device. The server collects the user's responses using information analysis tools and uses them to detail their profile information.
[0565] Step 3:
[0566] The server collects user input and behavioral data in real time and passes it to the emotion engine. The emotion engine analyzes this data and estimates the user's current emotional state.
[0567] Step 4:
[0568] The server combines emotional state data with compatibility assessment tools to accurately determine compatibility with other users. It then suggests anonymized information about candidates deemed to be a good match to the user.
[0569] Step 5:
[0570] If a user is interested in a proposed candidate, they send a pre-approval message to the server via their device. The server then uses an anonymous communication method to allow message exchange with the proposed candidate and initiates a session.
[0571] Step 6:
[0572] The server provides real-time guidance and advice to facilitate conversation based on the user's emotional state, as analyzed by the emotion engine. For example, if the server determines that the user is feeling stressed, it will provide a message such as, "Try talking about a topic that helps you relax."
[0573] Step 7:
[0574] Users communicate with suggested candidates while following conversational guides and advice provided through their devices. The server continuously collects data and optimizes the system to improve the user experience.
[0575] (Example 2)
[0576] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0577] In modern online communication, there is a need for privacy protection to allow users to interact with others with peace of mind, as well as highly accurate compatibility assessments based on emotions and preferences. However, conventional systems lack sufficient emotional evaluation and real-time conversation support, making it difficult for users to efficiently find suitable partners.
[0578] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0579] In this invention, the server includes a device for receiving user registrations via a communication device, a data analysis device for analyzing information on preferences and value criteria obtained from the user, and an emotion analysis device for estimating the user's emotional state from the user's input information and behavioral patterns. This enables users to communicate appropriately with other users in a safe and trustworthy environment and to obtain opportunities for interaction through highly accurate matching.
[0580] "User" refers to an individual or group that uses this system to communicate with other participants.
[0581] "Communication equipment" is a general term for hardware and network infrastructure used to send and receive data online.
[0582] A "data analysis device" refers to software or hardware used to process information collected from users and extract characteristics such as preferences and value criteria.
[0583] An "emotional analysis device" refers to a technical means for analyzing and estimating a user's emotional state based on their input data and behavioral patterns.
[0584] A "compatibility determination device" refers to a system component that calculates the compatibility between users based on analyzed information and identifies a suitable partner.
[0585] A "candidate suggestion device" refers to a system component that has the function of notifying the user of the compatibility determination results and facilitating communication with a suitable partner.
[0586] An "anonymous communication device" refers to a means of communication that enables users to exchange messages with each other while ensuring user privacy.
[0587] A "generative AI model" is an algorithm or system technology that uses artificial intelligence to automatically generate appropriate conversation content and suggestions that correspond to the user's emotional state.
[0588] A "conversation support device" refers to a technical component that assists users' communication by providing appropriate advice and information during communication.
[0589] To implement this invention, the user first opens an existing communication application on their terminal and registers by adding the system's official account. At this time, the terminal transmits the user's registration information to the server via an online communication device.
[0590] The server uses data analysis equipment to analyze information about the user's preferences and values based on the received information. Specific analysis includes text mining and clustering algorithms based on the collected response data. Furthermore, an emotion analysis device processes this data in real time to estimate the user's emotional state. The software used for this analysis includes a natural language processing engine, enriching human interaction by analyzing emotions and tone.
[0591] Based on the analysis results, the server uses an affinity determination device to determine affinity with other users. A generation AI model is utilized in this process to generate highly accurate suggestions that take into account the user's emotional state. The system anonymously presents candidates of highly compatible users and makes these suggestions to the user through a candidate suggestion device.
[0592] Once a user accepts a proposal, the server enables communication with the other user via an anonymous communication device. During this interaction, the conversation support device utilizes a generated AI model to provide the most appropriate conversational support for the user in real time. For example, if a user is feeling anxious, the device will offer relaxing topics and supportive messages through the conversation.
[0593] For example, if information is analyzed indicating that user A enjoys cooking as a hobby, the server will suggest, "You seem like a good match as a cooking buddy." Another example of a prompt message used as input to the generation AI model is, "Consider the user's emotional state and automatically generate appropriate and empathetic conversation content."
[0594] Thus, this system supports users in enjoying safe and effective communication.
[0595] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0596] Step 1:
[0597] The user adds the system's official account as a friend within their messaging application using their device. This initiates the user registration process. The user provides either the official account's ID or QR code as input, and the system registration information is generated as output.
[0598] Step 2:
[0599] The server receives user registration information via a communication device. This information is stored in a data store. The input is the user's basic profile information (e.g., user ID, name), and the output is saving to the profile database.
[0600] Step 3:
[0601] The server sends questions to registered users about their hobbies and daily activities. These questions are provided as input information in the form of a set of questions sent to the terminal, and the user's answers are sent back to the server as output.
[0602] Step 4:
[0603] The server uses a data analysis device to analyze user response data. The input for processing is the user's responses, and the output, derived from text mining techniques, reveals the user's preferences and values. For example, it might extract from the responses that the user likes "outdoors."
[0604] Step 5:
[0605] The server estimates the user's emotional state in real time through an emotion analysis device. The input consists of the user's response data and conversation content, and natural language processing technology is used to identify the emotion (e.g., happiness, tension) and output it.
[0606] Step 6:
[0607] The server utilizes a generative AI model to determine affinity based on analyzed preferences and emotional states, and calculates compatibility with other users. The input consists of preference data and emotional data, and the output generates an affinity score.
[0608] Step 7:
[0609] The server generates a list of highly compatible users and makes suggestions to the user using a candidate suggestion device. The input information is the affinity score, and a generative AI model is used to generate suggestion messages that are presented in an attractive and appropriate manner.
[0610] Step 8:
[0611] If the user reviews and accepts the proposal on their device, the server will use an anonymous communication device to begin exchanging messages with the other proposed user. The input is the user's acceptance, and the output is the establishment of an anonymous communication route.
[0612] Step 9:
[0613] The server uses a conversation support device to provide real-time conversation support through a generated AI model during anonymous communication. Input information includes the content and emotional state of the conversation, while output is support messages and advice. For example, if the conversation becomes tense, support such as "offering a relaxing topic" may be provided.
[0614] (Application Example 2)
[0615] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0616] In today's information society, more sophisticated compatibility assessments and conversational support tailored to emotions are needed for users to connect with others safely and securely. However, conventional systems have faced the challenge of being unable to accurately analyze users' emotional states and provide appropriate support based on that analysis.
[0617] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0618] In this invention, the server includes means for receiving user registration via online communication means, information analysis means for analyzing information on hobbies and values obtained from the user, and emotion estimation means for estimating the user's emotional state in real time. This makes it possible to determine compatibility with the user with higher accuracy and to provide conversational support that is appropriate to their emotions.
[0619] "User" refers to an individual who uses this system to communicate with other users.
[0620] "Online communication methods" refer to methods and technologies for sending and receiving information via networks such as the internet.
[0621] "Information analysis means" refers to technical methods for processing data obtained from users and analyzing their hobbies and values.
[0622] "Compatibility assessment method" refers to a method for evaluating and determining the degree of compatibility between a user and other users.
[0623] "Candidate suggestion method" refers to a method for presenting users with other users who have been determined to be a good match.
[0624] "Anonymous communication methods" refer to means of communicating with other users while keeping the user's personal information confidential.
[0625] "Emotion estimation methods" refer to technologies that analyze user input data and behavioral patterns to estimate emotional states.
[0626] "Conversation support methods" refer to methods that provide appropriate conversational guidance and support to users based on their estimated emotional state.
[0627] The system that implements this application consists mainly of a terminal and a server. First, the user registers by using a communication application on the terminal and adding the system's official account as a friend. The terminal sends the registration information to the server, and the server stores this information in a profile database.
[0628] The server uses information analysis tools to analyze information about users' hobbies and values and determine compatibility between users. Here, the server processes user input data and estimates the user's emotional state in real time using an emotion analysis engine. Specific hardware used includes microphones for speech recognition and cameras for facial recognition. Emotion analysis may involve using emotion recognition via APIs of cloud services, for example.
[0629] The server further uses a generative artificial intelligence model to support conversations and suggest appropriate matches based on the user's emotional state and compatibility information. This allows it to generate feedback for the user and present supportive messages such as, "You seem stressed today. I suggest an activity that will help you relax."
[0630] For example, if the server detects that a user is feeling "down," it can suggest, "Shall we look for ways to cheer you up?" In this case, a generative AI model is used to construct specific advice.
[0631] An example of a prompt message is: "If the user's emotion is detected as 'fatigue,' the AI model will suggest ways to relax and topics of conversation."
[0632] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0633] Step 1:
[0634] The user uses a communication application to add the system's official account as a friend. This causes the device to send a registration request, which the server receives. The input is the user's registration information, and the output is the user's information stored in the profile database. Based on this data, the server saves the user's basic information to the database.
[0635] Step 2:
[0636] The server sends questions to the user about their hobbies and values. When the terminal receives a question, the user enters their answer and sends it to the server. The input is the user's answer about their hobbies and values, and the output is data analyzed by an information analysis tool. The server filters the data and performs analysis using specific keywords and scoring techniques.
[0637] Step 3:
[0638] The server uses emotion estimation methods to estimate the user's emotional state in real time. Inputs are the user's behavioral patterns and voice / facial expression data, while output is the estimated emotional state. The server collects and analyzes user emotional data via cloud service APIs using speech recognition and image analysis technologies.
[0639] Step 4:
[0640] The server determines the compatibility between a user and other users through a compatibility assessment mechanism. The input is analyzed hobby / values data and emotional state data, and the output is a list of other users who have been determined to be compatible. The server uses a machine learning algorithm to integrate this data and calculate a compatibility score.
[0641] Step 5:
[0642] The server uses a candidate suggestion mechanism to suggest compatible users to the user while maintaining anonymity. The input is the compatibility assessment result, and the output is a list of candidates and advice presented to the user. The server performs the function of selecting appropriate user information and securely mediating communication to the user's terminal.
[0643] Step 6:
[0644] The server uses conversational support tools and a generative AI model to generate conversational support that responds to the user's real-time emotional state. The input is the estimated emotional state, and the output is a specific conversational support message for the user. The server then uses the generative AI model as a prompt and constructs a natural language conversation based on the prompt text.
[0645] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0646] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0647] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.
[0648] [Fourth Embodiment]
[0649] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.
[0650] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[0651] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0652] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.
[0653] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0654] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0655] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0656] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.
[0657] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0658] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0659] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0660] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0661] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0662] One embodiment of the present invention includes a process that uses a communication infrastructure to match users with other users.
[0663] First, users access the system using a messaging app available on their device. Registration for using the system is completed when the user adds the official account as a friend. The server receives this registration request and stores the user's basic information as a profile in the database. This allows each user to have a unique profile.
[0664] Next, the user provides the server with detailed information such as their hobbies and values by answering a series of questions provided by the system. This information is analyzed by information analysis tools and used to reveal the user's characteristics. Based on these analysis results, the server compares them with other user profiles in the database to determine compatible candidates.
[0665] The server then uses the analyzed data to suggest candidates deemed compatible with the user. The information presented is anonymized, ensuring secure matching while protecting user privacy. If a user is interested in a suggested candidate, they can send a direct message via anonymous communication.
[0666] The server also provides features to assist communication between users. This includes suggesting date plans based on users' interests. For example, if a user shares a love of watching movies, the server can recommend a "date plan to go to the cinema."
[0667] Through this series of processes, the system provides users with the ability to easily and safely explore new encounters using existing messaging apps, without having to install any new applications.
[0668] The following describes the processing flow.
[0669] Step 1:
[0670] The user adds the official account as a friend using their device's messaging app and sends the message "Start". The server receives this message and creates a new user profile in its database based on the user's LINE ID.
[0671] Step 2:
[0672] The server sends the user messages containing questions about their hobbies and values. The user then enters and submits their answers to these questions via their device.
[0673] Step 3:
[0674] The server analyzes the responses received from the user using information analysis tools and records a detailed profile of the user's hobbies and values.
[0675] Step 4:
[0676] The server uses the analyzed user profile to compare it with other user profiles in the database. An AI algorithm is then used to select candidates deemed to be a good match.
[0677] Step 5:
[0678] The server presents the user with anonymized information about selected candidates. If the user is interested in a suggested candidate, they are given the option to send a message to that candidate via an anonymous communication method.
[0679] Step 6:
[0680] When a user wishes to communicate with a proposed candidate, they send an acceptance message to the server via their device. The server then initiates an anonymous communication session between the user and the candidate.
[0681] Step 7:
[0682] The server uses a dating suggestion system to encourage conversations between users by offering suggestions for date plans based on shared hobbies. These suggestions are sent to users as messages.
[0683] Step 8:
[0684] Users provide feedback on the date plan presented via their device and decide on the next steps. This ensures continuous and smooth communication.
[0685] (Example 1)
[0686] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0687] In online dating environments, preventing the leakage of personal information and incompatible pairings between users is crucial. Furthermore, providing an environment where users can communicate with each other safely is essential. However, effective means to simultaneously address these challenges have not yet been sufficiently developed.
[0688] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0689] In this invention, the server includes means for receiving user registration via an information terminal, data analysis means for analyzing data related to preferences and interests, and determination means for determining affinity. This makes it possible to provide highly accurate matching and a secure communication environment while maintaining user anonymity.
[0690] An "information terminal" is a device equipped with communication capabilities that a user uses to access a system.
[0691] "Users" refer to individuals who seek to meet and communicate with others through the system.
[0692] A "data analysis tool" is a mechanism for analyzing data based on preferences and interests obtained from users and for evaluating user characteristics.
[0693] A "determination means" is a mechanism for evaluating compatibility with other users based on analyzed data and identifying suitable candidates.
[0694] A "candidate recommendation method" is a system that selects users with high affinity and proposes those candidates to them.
[0695] An "anonymity mediation method" is a mechanism for conducting communications while maintaining the anonymity of the users.
[0696] An "activity suggestion mechanism" is a system designed to suggest appropriate activities and events based on users' interests and to promote interaction.
[0697] This invention provides a system that allows users to access the system via an information terminal, determine appropriate compatibility with other users, and communicate safely with unknown individuals.
[0698] Users register with the system via an internet connection using information terminals such as smartphones and tablets. During registration, the user's basic information is sent to the server and stored in the database. At this point, the server receives the information and manages it appropriately.
[0699] Next, the user inputs data about their preferences and interests through the system's interface. This data is analyzed by information analysis tools to evaluate the user's characteristics. The analysis is performed on a server, and the latest machine learning algorithms and generative AI models are used to ensure efficient and accurate processing.
[0700] Based on the data analysis results, the server matches users with other users based on affinity. During this process, a candidate recommendation system is used, suggesting anonymized candidate information to the user. This ensures optimal matching for the user while protecting their privacy.
[0701] For example, if user A enters that they are interested in music and enjoy classical music, the server will find and recommend user B, who shares a similar interest. Even in this case, anonymity is maintained, and secure communication based on mutual interests is possible.
[0702] Finally, the server facilitates anonymous communication between users, providing direct contact on the communication platform and enabling users to communicate with each other with confidence. It also proposes events and activities to support the building of user relationships.
[0703] A concrete example of a prompt message is a question like, "I want to find new connections. Please tell me about the registration process and how to use the system. How can I connect with people I'm interested in anonymously?" Such prompt messages facilitate natural interaction between the system and the user and support intuitive operation.
[0704] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0705] Step 1:
[0706] Users add the official account as a friend from their information terminal and access the system.
[0707] This action sends a registration request to the server. The input includes the user's basic information (name, contact information, etc.). The server receives this and stores it in the database. The output is a state where the user's profile is stored individually in the database.
[0708] Step 2:
[0709] Users answer questions presented by the system and input information about their hobbies and interests.
[0710] Users complete these selections and inputs on the terminal interface and send them to the server. Input includes multiple-choice answers and free-text information. The server stores the received information in a database for analysis. The output is user interest information ready for analysis.
[0711] Step 3:
[0712] The server analyzes the input data using data analysis tools and evaluates the user's characteristics.
[0713] In this step, a generative AI model is used to statistically analyze the user's preferences and interests. The input is the interest information received in step 2. Through data calculations, the user's preference characteristics are quantified. The output is feature data associated with the user's profile.
[0714] Step 4:
[0715] The server performs affinity assessment based on the analyzed data and compares it with other user profiles in the database.
[0716] This process creates a list of highly compatible users. The input consists of user characteristic data and other user profile information. A similarity score is calculated using a determination algorithm. The output is a list of highly compatible candidates.
[0717] Step 5:
[0718] The server anonymizes the information of matched candidates and presents it to the user.
[0719] The information is sent to the device in a visual list format. The inputs are the candidate list generated in step 4 and the original profile information. Privacy is ensured through the anonymization process. The output is the anonymized candidate information presented to the user.
[0720] Step 6:
[0721] Users send messages to the suggested candidates via anonymous communication methods.
[0722] The user enters a message through the terminal's interface and presses the send button. The input is the message text entered by the user. The server receives this and forwards it to the recipient via an anonymous ID. The output is an anonymous message that arrives on the recipient's terminal.
[0723] Step 7:
[0724] The server generates activity suggestions based on user interests and encourages interaction.
[0725] This includes suggesting date plans and event information using a generative AI model. Inputs include commonalities and preferences between users, as well as past data. The generated suggestions are sent to the user's device. The output is a customized activity suggestion that the user receives.
[0726] (Application Example 1)
[0727] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0728] In daily life, it is difficult for users to build new relationships based on their own interests and activities, and there is a lack of means to conduct such activities while protecting individual privacy. Against this backdrop, there is a growing need for a system that supports the building of appropriate relationships while safely handling personal information.
[0729] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0730] In this invention, the server includes a function to receive user registrations via bidirectional communication means, a data analysis function to analyze information about the activities and interests obtained from the user, and a compatibility determination function to determine the degree of compatibility with other users based on the analyzed information. This enables efficient and safe matching of users with other users who share their interests.
[0731] "Users" refer to individuals who use the system to attempt to build new relationships.
[0732] "Registration" refers to the act of a user providing their basic information and interests to the system and creating a profile for using the service.
[0733] "Two-way communication means" refers to the digital communication infrastructure between users and servers that enables the sending and receiving of information.
[0734] "Activities and interests" refer to the user's hobbies and personal interests related to specific areas of activity.
[0735] "Data analysis function" refers to the processing capability to analyze user characteristics and trends based on acquired information and generate useful results.
[0736] "Fit" refers to the degree to which users' interests and values align, evaluated using numerical values and indicators.
[0737] The "matching determination function" is a function that determines the degree of matching with other users based on the results obtained from data analysis.
[0738] The "selection suggestion function" is a function that suggests other users who share similar interests and activities to the user.
[0739] "Anonymity" is an attribute that ensures the confidentiality of personal information between users and enables secure communication.
[0740] The "anonymous information exchange function" is a feature that allows users to exchange information with each other without identifying their personal information.
[0741] A "generative AI model" refers to an artificial intelligence algorithm that uses machine learning techniques to perform advanced information generation and analysis.
[0742] In this embodiment of the invention, it is possible for users to easily and safely engage in new forms of communication based on their interests using household robots and smart devices. The system operates in the following manner.
[0743] The server receives user registrations via a two-way communication method. Users provide information about their activities and interests through this communication method. The acquired information is analyzed by a data analysis function to reveal user characteristics and trends. This analysis utilizes data analysis tools such as those from Google Cloud.
[0744] Subsequently, based on the analyzed information, the server calculates the degree of compatibility with other users. This compatibility determination takes into account past behavioral patterns and the degree of shared interests. After the compatibility determination is made, the selection suggestion function proposes the most suitable match for the user.
[0745] Interactions between users take place via an anonymous information exchange function, ensuring privacy and enabling secure communication. This utilizes an anonymous communication method based on the Twilio API. Furthermore, it is possible to leverage generative AI models to provide diverse information and suggestions to improve the user experience. In particular, when proposing activities, the generative AI model can be used to generate a variety of ideas.
[0746] For example, if a user is interested in travel, the system will suggest "finding a matching partner related to the user's travel destinations and enabling conversations on topics related to those regions." The following prompt can be used for the generating AI model: "Generate suggestions that will allow the user, who loves travel, to continue a conversation about places they want to visit."
[0747] In this way, through the cooperation of servers, terminals, and users, a system is realized that provides a safe communication experience that respects individual tastes and preferences.
[0748] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0749] Step 1:
[0750] The user accesses the server via a two-way communication method using a terminal. The user provides registration information, and the terminal sends this information to the server. The input in this process is the user's basic profile information, and the output generates the user's account information to be registered on the server.
[0751] Step 2:
[0752] The server passes registration information submitted by users to the data analysis function. The server analyzes information about activities and interests and extracts user characteristics. The input is registration information, and the output is characteristic data based on each user's interests. This data is processed using a cloud-based analysis tool.
[0753] Step 3:
[0754] The server determines the degree of compatibility with other users based on the analyzed characteristic data. The input is characteristic data, and the output is a compatibility evaluation with other users. The compatibility is calculated using an algorithm, quantifying the degree of agreement in tastes and preferences between users.
[0755] Step 4:
[0756] The server uses a selection suggestion function to propose matching candidates to the user based on the goodness-of-fit assessment. The input is the goodness-of-fit assessment, and the output is a list of recommended matching candidates. The server prepares this information for anonymous information exchange.
[0757] Step 5:
[0758] The user selects on the terminal whether to accept or reject the proposed matching candidates. The input is a list of matching candidates, and the output is the choice to accept or reject. Through this operation, the user will exchange anonymous information with the selected person.
[0759] Step 6:
[0760] The server uses an anonymous information exchange function to enable secure communication between users. Input is a consented communication request between users, and output is the sending and receiving of anonymous messages. The Twilio API used in this process mediates message exchange while protecting privacy.
[0761] Step 7:
[0762] The server uses a generative AI model to generate suggestions to improve the user experience. Inputs include the user's profile and past message history, while outputs are generated suggestions and activity ideas. Utilizing prompts, the generative AI model suggests content that matches the user's interests.
[0763] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0764] One embodiment of the present invention is a system in which a user matches with other users via an existing communication application, and this includes a configuration that incorporates an emotion engine.
[0765] First, the user adds the system's official account as a friend using a messaging app available on their device, completing the registration process. The server receives the registration information from the user and stores it in the profile database. After the registration process, the server sends the user questions about their hobbies, values, and daily activities. This information is collected by data analysis tools to analyze the user's preferences in detail.
[0766] A new feature introduced is an emotion engine, which analyzes user input data and behavioral patterns to estimate the user's emotional state in real time. This emotional state is integrated with the compatibility determination system and becomes an important factor for the server to make more precise decisions regarding matching users with other users.
[0767] Based on the analysis results, the server anonymously suggests other users that it deems to be a good match for the user. These suggestions include comments and recommendations that take the user's emotional state into consideration, ensuring the suggestions are more appropriate for the user. If the user accepts a suggestion, the server enables direct message exchange using anonymous communication methods.
[0768] Furthermore, the emotion engine analyzes the context of the conversation and the user's emotional state, providing appropriate conversational support and advice in real time. For example, if the user is showing signs of anxiety, the server will present relevant support messages, such as "Suggesting a relaxing topic."
[0769] In this way, this system utilizes existing messaging apps and combines them with sentiment analysis to provide a matching service that allows users to communicate with others safely, securely, and effectively.
[0770] The following describes the processing flow.
[0771] Step 1:
[0772] The user adds the official account as a friend using their device's messaging app and sends the message "Start". The server receives this message, registers the user's identification information in its database, and creates a profile.
[0773] Step 2:
[0774] The server sends questions to the user about their interests, values, and daily activities. The user responds to these questions via their device. The server collects the user's responses using information analysis tools and uses them to detail their profile information.
[0775] Step 3:
[0776] The server collects user input and behavioral data in real time and passes it to the emotion engine. The emotion engine analyzes this data and estimates the user's current emotional state.
[0777] Step 4:
[0778] The server combines emotional state data with compatibility assessment tools to accurately determine compatibility with other users. It then suggests anonymized information about candidates deemed to be a good match to the user.
[0779] Step 5:
[0780] If a user is interested in a proposed candidate, they send a pre-approval message to the server via their device. The server then uses an anonymous communication method to allow message exchange with the proposed candidate and initiates a session.
[0781] Step 6:
[0782] The server provides real-time guidance and advice to facilitate conversation based on the user's emotional state, as analyzed by the emotion engine. For example, if the server determines that the user is feeling stressed, it will provide a message such as, "Try talking about a topic that helps you relax."
[0783] Step 7:
[0784] Users communicate with suggested candidates while following conversational guides and advice provided through their devices. The server continuously collects data and optimizes the system to improve the user experience.
[0785] (Example 2)
[0786] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0787] In modern online communication, there is a need for privacy protection to allow users to interact with others with peace of mind, as well as highly accurate compatibility assessments based on emotions and preferences. However, conventional systems lack sufficient emotional evaluation and real-time conversation support, making it difficult for users to efficiently find suitable partners.
[0788] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0789] In this invention, the server includes a device for receiving user registrations via a communication device, a data analysis device for analyzing information on preferences and value criteria obtained from the user, and an emotion analysis device for estimating the user's emotional state from the user's input information and behavioral patterns. This enables users to communicate appropriately with other users in a safe and trustworthy environment and to obtain opportunities for interaction through highly accurate matching.
[0790] "User" refers to an individual or group that uses this system to communicate with other participants.
[0791] "Communication equipment" is a general term for hardware and network infrastructure used to send and receive data online.
[0792] A "data analysis device" refers to software or hardware used to process information collected from users and extract characteristics such as preferences and value criteria.
[0793] An "emotional analysis device" refers to a technical means for analyzing and estimating a user's emotional state based on their input data and behavioral patterns.
[0794] A "compatibility determination device" refers to a system component that calculates the compatibility between users based on analyzed information and identifies a suitable partner.
[0795] A "candidate suggestion device" refers to a system component that has the function of notifying the user of the compatibility determination results and facilitating communication with a suitable partner.
[0796] An "anonymous communication device" refers to a means of communication that enables users to exchange messages with each other while ensuring user privacy.
[0797] A "generative AI model" is an algorithm or system technology that uses artificial intelligence to automatically generate appropriate conversation content and suggestions that correspond to the user's emotional state.
[0798] A "conversation support device" refers to a technical component that assists users' communication by providing appropriate advice and information during communication.
[0799] To implement this invention, the user first opens an existing communication application on their terminal and registers by adding the system's official account. At this time, the terminal transmits the user's registration information to the server via an online communication device.
[0800] The server uses data analysis equipment to analyze information about the user's preferences and values based on the received information. Specific analysis includes text mining and clustering algorithms based on the collected response data. Furthermore, an emotion analysis device processes this data in real time to estimate the user's emotional state. The software used for this analysis includes a natural language processing engine, enriching human interaction by analyzing emotions and tone.
[0801] Based on the analysis results, the server uses an affinity determination device to determine affinity with other users. A generation AI model is utilized in this process to generate highly accurate suggestions that take into account the user's emotional state. The system anonymously presents candidates of highly compatible users and makes these suggestions to the user through a candidate suggestion device.
[0802] Once a user accepts a proposal, the server enables communication with the other user via an anonymous communication device. During this interaction, the conversation support device utilizes a generated AI model to provide the most appropriate conversational support for the user in real time. For example, if a user is feeling anxious, the device will offer relaxing topics and supportive messages through the conversation.
[0803] For example, if information is analyzed indicating that user A enjoys cooking as a hobby, the server will suggest, "You seem like a good match as a cooking buddy." Another example of a prompt message used as input to the generation AI model is, "Consider the user's emotional state and automatically generate appropriate and empathetic conversation content."
[0804] Thus, this system supports users in enjoying safe and effective communication.
[0805] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0806] Step 1:
[0807] The user adds the system's official account as a friend within their messaging application using their device. This initiates the user registration process. The user provides either the official account's ID or QR code as input, and the system registration information is generated as output.
[0808] Step 2:
[0809] The server receives user registration information via a communication device. This information is stored in a data store. The input is the user's basic profile information (e.g., user ID, name), and the output is saving to the profile database.
[0810] Step 3:
[0811] The server sends questions to registered users about their hobbies and daily activities. These questions are provided as input information in the form of a set of questions sent to the terminal, and the user's answers are sent back to the server as output.
[0812] Step 4:
[0813] The server uses a data analysis device to analyze user response data. The input for processing is the user's responses, and the output, derived from text mining techniques, reveals the user's preferences and values. For example, it might extract from the responses that the user likes "outdoors."
[0814] Step 5:
[0815] The server estimates the user's emotional state in real time through an emotion analysis device. The input consists of the user's response data and conversation content, and natural language processing technology is used to identify the emotion (e.g., happiness, tension) and output it.
[0816] Step 6:
[0817] The server utilizes a generative AI model to determine affinity based on analyzed preferences and emotional states, and calculates compatibility with other users. The input consists of preference data and emotional data, and the output generates an affinity score.
[0818] Step 7:
[0819] The server generates a list of highly compatible users and makes suggestions to the user using a candidate suggestion device. The input information is the affinity score, and a generative AI model is used to generate suggestion messages that are presented in an attractive and appropriate manner.
[0820] Step 8:
[0821] If the user reviews and accepts the proposal on their device, the server will use an anonymous communication device to begin exchanging messages with the other proposed user. The input is the user's acceptance, and the output is the establishment of an anonymous communication route.
[0822] Step 9:
[0823] The server uses a conversation support device to provide real-time conversation support through a generated AI model during anonymous communication. Input information includes the content and emotional state of the conversation, while output is support messages and advice. For example, if the conversation becomes tense, support such as "offering a relaxing topic" may be provided.
[0824] (Application Example 2)
[0825] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0826] In today's information society, more sophisticated compatibility assessments and conversational support tailored to emotions are needed for users to connect with others safely and securely. However, conventional systems have faced the challenge of being unable to accurately analyze users' emotional states and provide appropriate support based on that analysis.
[0827] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0828] In this invention, the server includes means for receiving user registration via online communication means, information analysis means for analyzing information on hobbies and values obtained from the user, and emotion estimation means for estimating the user's emotional state in real time. This makes it possible to determine compatibility with the user with higher accuracy and to provide conversational support that is appropriate to their emotions.
[0829] "User" refers to an individual who uses this system to communicate with other users.
[0830] "Online communication methods" refer to methods and technologies for sending and receiving information via networks such as the internet.
[0831] "Information analysis means" refers to technical methods for processing data obtained from users and analyzing their hobbies and values.
[0832] "Compatibility assessment method" refers to a method for evaluating and determining the degree of compatibility between a user and other users.
[0833] "Candidate suggestion method" refers to a method for presenting users with other users who have been determined to be a good match.
[0834] "Anonymous communication methods" refer to means of communicating with other users while keeping the user's personal information confidential.
[0835] "Emotion estimation methods" refer to technologies that analyze user input data and behavioral patterns to estimate emotional states.
[0836] "Conversation support methods" refer to methods that provide appropriate conversational guidance and support to users based on their estimated emotional state.
[0837] The system that implements this application consists mainly of a terminal and a server. First, the user registers by using a communication application on the terminal and adding the system's official account as a friend. The terminal sends the registration information to the server, and the server stores this information in a profile database.
[0838] The server uses information analysis tools to analyze information about users' hobbies and values and determine compatibility between users. Here, the server processes user input data and estimates the user's emotional state in real time using an emotion analysis engine. Specific hardware used includes microphones for speech recognition and cameras for facial recognition. Emotion analysis may involve using emotion recognition via APIs of cloud services, for example.
[0839] The server further uses a generative artificial intelligence model to support conversations and suggest appropriate matches based on the user's emotional state and compatibility information. This allows it to generate feedback for the user and present supportive messages such as, "You seem stressed today. I suggest an activity that will help you relax."
[0840] For example, if the server detects that a user is feeling "down," it can suggest, "Shall we look for ways to cheer you up?" In this case, a generative AI model is used to construct specific advice.
[0841] An example of a prompt message is: "If the user's emotion is detected as 'fatigue,' the AI model will suggest ways to relax and topics of conversation."
[0842] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0843] Step 1:
[0844] The user uses a communication application to add the system's official account as a friend. This causes the device to send a registration request, which the server receives. The input is the user's registration information, and the output is the user's information stored in the profile database. Based on this data, the server saves the user's basic information to the database.
[0845] Step 2:
[0846] The server sends questions to the user about their hobbies and values. When the terminal receives a question, the user enters their answer and sends it to the server. The input is the user's answer about their hobbies and values, and the output is data analyzed by an information analysis tool. The server filters the data and performs analysis using specific keywords and scoring techniques.
[0847] Step 3:
[0848] The server uses emotion estimation methods to estimate the user's emotional state in real time. Inputs are the user's behavioral patterns and voice / facial expression data, while output is the estimated emotional state. The server collects and analyzes user emotional data via cloud service APIs using speech recognition and image analysis technologies.
[0849] Step 4:
[0850] The server determines the compatibility between a user and other users through a compatibility assessment mechanism. The input is analyzed hobby / values data and emotional state data, and the output is a list of other users who have been determined to be compatible. The server uses a machine learning algorithm to integrate this data and calculate a compatibility score.
[0851] Step 5:
[0852] The server uses a candidate suggestion mechanism to suggest compatible users to the user while maintaining anonymity. The input is the compatibility assessment result, and the output is a list of candidates and advice presented to the user. The server performs the function of selecting appropriate user information and securely mediating communication to the user's terminal.
[0853] Step 6:
[0854] The server uses conversational support tools and a generative AI model to generate conversational support that responds to the user's real-time emotional state. The input is the estimated emotional state, and the output is a specific conversational support message for the user. The server then uses the generative AI model as a prompt and constructs a natural language conversation based on the prompt text.
[0855] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0856] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0857] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.
[0858] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[0859] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.
[0860] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.
[0861] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.
[0862] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.
[0863] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."
[0864] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.
[0865] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.
[0866] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.
[0867] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.
[0868] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[0869] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.
[0870] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.
[0871] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.
[0872] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.
[0873] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.
[0874] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.
[0875] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.
[0876] The following is further disclosed regarding the embodiments described above.
[0877] (Claim 1)
[0878] A means of receiving user registration via online communication,
[0879] Information analysis means for analyzing information on hobbies and values obtained from the aforementioned users,
[0880] A compatibility determination means that determines compatibility with other users based on the analyzed information,
[0881] A candidate suggestion means that suggests to the user other users who have been determined to be compatible,
[0882] An anonymous communication means for mediating communication while maintaining the anonymity of the aforementioned user and the other users proposed above,
[0883] A system that includes this.
[0884] (Claim 2)
[0885] The system according to claim 1, characterized in that the compatibility determination means has a configuration that determines compatibility with higher accuracy by analyzing known behavioral pattern data.
[0886] (Claim 3)
[0887] The system according to claim 1, further comprising a date suggestion means for providing the date suggestion generated by the information analysis means to the user.
[0888] "Example 1"
[0889] (Claim 1)
[0890] A means of receiving user registration via an information terminal,
[0891] A data analysis means for analyzing data on preferences and interests obtained from the aforementioned users,
[0892] Based on the analyzed data, a determination means for determining affinity with other users,
[0893] A candidate recommendation means that recommends other users who have been determined to have a high affinity to the user,
[0894] An anonymous mediating means for mediating communications while ensuring the anonymity of the aforementioned user and other users recommended,
[0895] An activity suggestion means that provides activity suggestions based on the user's interests,
[0896] A system that includes this.
[0897] (Claim 2)
[0898] The system according to claim 1, characterized in that the determination means has a configuration that determines affinity with higher accuracy by analyzing accumulated behavioral characteristic data.
[0899] (Claim 3)
[0900] The system according to claim 1, characterized in that it has a configuration to provide the contact suggestions generated by the data analysis means to the user.
[0901] "Application Example 1"
[0902] (Claim 1)
[0903] A function to receive user registrations via two-way communication means,
[0904] A data analysis function that analyzes information about activities and interests obtained from the aforementioned users,
[0905] Based on the analyzed information, a compatibility determination function determines the degree of compatibility with other users,
[0906] A selection suggestion function that proposes other users who have been determined to have a high degree of suitability to the user,
[0907] An anonymous information exchange function that mediates information exchange while maintaining the anonymity of the aforementioned user and other users as proposed,
[0908] A processing function that uses a generative AI model to generate information for transmission,
[0909] A system that includes this.
[0910] (Claim 2)
[0911] The system according to claim 1, wherein the conformity determination function has a configuration that determines the degree of conformity with higher accuracy by analyzing known behavioral pattern data.
[0912] (Claim 3)
[0913] The system according to claim 1, further comprising an activity suggestion function that provides the user with the activity suggestions generated by the data analysis function.
[0914] "Example 2 of combining an emotion engine"
[0915] (Claim 1)
[0916] A device that receives user registrations via a communication device,
[0917] A data analysis device that analyzes information on preferences and value criteria obtained from the aforementioned users,
[0918] Based on the analyzed information and the results of the emotional analysis, an affinity determination device is provided to determine affinity with other users.
[0919] A candidate suggestion device that proposes other users who have been determined to have a high affinity to the user,
[0920] An anonymous communication device that mediates communication while maintaining the anonymity of the aforementioned user and the other users proposed above,
[0921] An emotional analysis device that estimates the emotional state from the user's input information and behavioral patterns,
[0922] A conversation support device that provides appropriate conversation support using a generated AI model during the anonymous communication,
[0923] A system that includes this.
[0924] (Claim 2)
[0925] The system according to claim 1, characterized in that the affinity determination device has a configuration that determines affinity with higher accuracy by analyzing known behavioral pattern data and emotional analysis results.
[0926] (Claim 3)
[0927] The system according to claim 1, further comprising an exchange proposal device that provides the exchange proposal generated by the data analysis device to the user.
[0928] "Application example 2 when combining with an emotional engine"
[0929] (Claim 1)
[0930] A means of receiving user registration via online communication,
[0931] Information analysis means for analyzing information on hobbies and values obtained from the aforementioned users,
[0932] A compatibility determination means that determines compatibility with other users based on the analyzed information,
[0933] A candidate suggestion means that suggests to the user other users who have been determined to be compatible,
[0934] An anonymous communication means for mediating communication while maintaining the anonymity of the aforementioned user and the other users proposed above,
[0935] An emotion estimation method that estimates the user's emotional state in real time,
[0936] A conversation support means that provides conversation support appropriate to the user based on the emotions estimated by the emotion estimation means,
[0937] A system that includes this.
[0938] (Claim 2)
[0939] The system according to claim 1, characterized in that the compatibility determination means has a configuration that determines compatibility with higher accuracy by analyzing known behavioral pattern data and emotional state data.
[0940] (Claim 3)
[0941] The system according to claim 1, further comprising a date suggestion means that provides the date suggestion generated by the information analysis means to the user, and further comprising a conversation support means that provides optimal conversation support according to the user's emotions using a generation artificial intelligence model. [Explanation of symbols]
[0942] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>
Claims
1. A means of receiving user registration via online communication, Information analysis means for analyzing information on hobbies and values obtained from the aforementioned users, A compatibility determination means that determines compatibility with other users based on the analyzed information, A candidate suggestion means that suggests to the user other users who have been determined to be compatible, An anonymous communication means for mediating communication while maintaining the anonymity of the aforementioned user and the other users proposed above, A system that includes this.
2. The system according to claim 1, characterized in that the compatibility determination means has a configuration that determines compatibility with higher accuracy by analyzing known behavioral pattern data.
3. The system according to claim 1, further comprising a date suggestion means for providing the date suggestion generated by the information analysis means to the user.