System

Abstract

A system is provided.SOLUTION: A system, comprising: means for a user to create detailed profile information and use AI to suggest an optimal contact based on the profile information; means for a user to upload a self-introduction video; means for using a AI chat bot to assist in communication; and means for using facial recognition technology to verify a user's identity and enhance security.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Current matchmaking services make it difficult to find a suitable partner due to busy lifestyles and limited opportunities to meet people. Furthermore, online matchmaking services often face security and privacy concerns, leaving users feeling uneasy. Furthermore, matchmaking agencies face challenges in effectively managing numerous profiles and providing high-quality matches. The present invention aims to solve these challenges and provide an effective and safe service for both users and matchmaking agencies to find the perfect partner or relationship. [Means for solving the problem]

[0005] The present invention solves the above problems by using the following means. It provides a means for users to create detailed profile information and uses artificial intelligence to suggest the most suitable partner based on the profile information. It also provides a means for users to upload a self-introduction video, allowing them to make a deeper impression on potential partners. It uses an AI chatbot to assist communication and offers conversation starter suggestions and advice. It also provides a means to verify users' identities using facial recognition technology and enhance security. This allows users to use the service with peace of mind and allows matchmaking agencies to effectively manage a large number of profiles and provide high-quality matches.

[0006] "User" refers to an individual who uses the online matchmaking service.

[0007] "Profile Information" means data entered by a User, including personal information, preferences, and requests.

[0008] "Artificial intelligence" refers to technology that allows computer systems to analyze user profile information and make optimal matches.

[0009] A "self-introduction video" refers to a video that a user creates to introduce themselves and uploads to an online matchmaking service.

[0010] An "AI chatbot" is a program that uses artificial intelligence to suggest conversation starters and give advice to assist users in their communication.

[0011] "Facial recognition technology" refers to technology that identifies a user's face and verifies their identity.

[0012] "Security" refers to the means and methods for protecting users' personal information and privacy in online matchmaking services.

[0013] A "matchmaking agency" refers to a company or organization that provides services to assist users in their search for a partner.

[0014] "Matching algorithm" refers to the calculation procedures and rules used to select the most suitable partner based on a user's profile information.

[0015] "Data management tools" refers to software and systems that enable matchmaking agencies to effectively manage users' profile information and matching progress. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] The system of this invention provides an online matchmaking service in which users create detailed profiles and artificial intelligence (AI) uses that information to suggest optimal matches. It also includes features such as the ability to upload self-introduction videos, an AI chatbot to assist with communication, and enhanced security using facial recognition technology.

[0038] Profile Creation and Management

[0039] After downloading the app, users create an account, which includes entering basic information (such as name, email address, and password). After logging in, users fill out a detailed profile, which includes information such as age, occupation, hobbies, and what they would look for in an ideal partner. Users can also film and upload a self-introduction video.

[0040] The server receives the profile information entered by the user and stores it in a database, which is used later in the matching process and for security checks.

[0041] AI-based matching

[0042] The server provides the entire user profile to the AI ​​engine, which analyzes the detailed profile information to learn about individual preferences and needs. Based on this learning, the AI ​​runs a matching algorithm to suggest the best match.

[0043] Example: For example, if User A enters in their profile that they "like the outdoors and would like a partner with the same hobbies," the AI ​​will search for User B, another user with similar hobbies, calculate the degree of matching, and make suggestions.

[0044] Communication support with AI chatbots

[0045] If a match is made, the server will launch an AI chatbot, which will provide appropriate conversation starter suggestions and communication advice based on the user's profile information and past conversation history.

[0046] Users can send messages to others based on conversation starters suggested by the chatbot.

[0047] Example: For example, when User A sends the first message to User B, the AI ​​chatbot might suggest, "Hi, I heard you love the outdoors. Do you have any recommended hiking trails?" This allows users to start the conversation in a natural way.

[0048] Enhanced security with facial recognition technology

[0049] When a user logs in from a new device, the device's camera takes a picture of their face and sends the image to the server. The server compares the received facial image with an existing face database and allows the user to log in if authentication is successful.

[0050] Example: For example, when User A tries to log in from a new smartphone, the device requests facial authentication. User A takes a picture of their face with the device's camera and sends it to the server. The server collates the image, and if authentication is successful, the login is permitted.

[0051] Data management tool for matchmaking agencies

[0052] The server provides matchmaking agencies with a dedicated dashboard to help agency staff efficiently manage user data, displaying users' profile information, matching progress, and other important metrics in real time.

[0053] Example: Staff at a matchmaking agency can access the dashboard to check the matching progress between User C and User D, and understand the success rate and communication status in real time. They can also use data analysis tools to analyze the matching success rate of user groups that meet specific criteria.

[0054] The present invention allows users to find their ideal partner in an efficient and safe manner, and enables matchmaking agencies to improve the quality of their services.

[0055] The processing flow will be explained below.

[0056] Step 1:

[0057] The user downloads and installs the app, then taps the app icon to launch it.

[0058] Step 2:

[0059] A user enters basic information on the account creation screen, including name, email address, and password.

[0060] Step 3:

[0061] The server receives the basic information entered and stores it in a database. The server confirms the account creation and sends a confirmation email to the user.

[0062] Step 4:

[0063] The user receives a confirmation email and clicks the link to activate their account. The device redirects the user to the app's main screen.

[0064] Step 5:

[0065] On the main screen, users enter detailed profile information, including age, gender, occupation, hobbies, and ideal partner criteria.

[0066] Step 6:

[0067] The user shoots a self-introduction video on the profile creation screen and presses the upload button. The device sends the video data to the server.

[0068] Step 7:

[0069] The server receives the detailed profile information and video data and stores them in a database. The server verifies the profile information and completes the registration if it is correct.

[0070] Step 8:

[0071] The server provides all user profiles to the AI ​​engine, which analyzes the profile information and learns the characteristics of each user.

[0072] Step 9:

[0073] The server runs AI to search for the best partner based on each user's preferences and needs. The AI ​​then applies a matching algorithm to evaluate and suggest compatible partners.

[0074] Step 10:

[0075] The server notifies the user of the matching results, and the user's device displays the matching results and the other person's profile information.

[0076] Step 11:

[0077] After a match is made, the user can use the app's messaging function to send a message to the other person. A message input screen will appear.

[0078] Step 12:

[0079] The server launches an AI chatbot that generates appropriate conversation starter suggestions and advice based on the user's profile information and conversation history.

[0080] Step 13:

[0081] The device receives the chatbot's suggestions and displays them to the user, who then sends a message based on the suggestions.

[0082] Step 14:

[0083] The server uses facial recognition technology to verify that the user is logging in from a new device. The device takes a picture of the user's face with its camera and sends the image to the server.

[0084] Step 15:

[0085] The server compares the facial image with existing data, and if authentication is successful, allows the user to log in. The authentication result is notified to the terminal.

[0086] Step 16:

[0087] The server provides a dashboard for matchmaking agencies, which agency staff access and manage user data.

[0088] Step 17:

[0089] The server updates the dashboard in real time, displaying users' progress and matching results, and agency staff use data analysis tools to develop suggestions for improving the service.

[0090] This process allows users to find their ideal partner efficiently and safely, and enables matchmaking agencies to provide effective services.

[0091] Example 1

[0092] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0093] Conventional online matchmaking services lack the means to suggest the best match based on the user's detailed profile information, which hinders smooth communication between users. They also lack security and face a high risk of unauthorized access. Furthermore, matchmaking agencies lack the means to efficiently manage user data.

[0094] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0095] In this invention, the server includes a means for storing user profiles in a database, a means for using artificial intelligence to suggest optimal partners based on detailed profile information, a means for supporting communication using an AI chatbot, a means for verifying user identities using facial recognition technology to enhance security, and a means for providing a dashboard for matchmaking agency staff to manage user data. This enables highly accurate matching based on detailed profile information, smooth communication support, strong security, and efficient data management.

[0096] "User" refers to an individual who uses the online matchmaking service.

[0097] "Profile Information" refers to detailed personal information provided by a User regarding age, occupation, hobbies, and ideal partner.

[0098] "Artificial intelligence" refers to algorithms and engines that analyze users' profile information and suggest the most suitable partner.

[0099] "Self-introduction video" refers to a video file that a user films and uploads to introduce themselves.

[0100] An "AI chatbot" is a chat program that uses artificial intelligence to assist communication between matched users.

[0101] "Facial recognition technology" refers to technology that analyzes a user's facial image and verifies their identity.

[0102] "Security" refers to the measures and protocols used to protect the safety of user data and access.

[0103] "Database" refers to a system that stores and manages data such as user profile information and self-introduction videos.

[0104] "Matching" refers to the process of suggesting the best match between users and building a relationship based on each other's profile information.

[0105] "Dashboard" refers to the interface that matchmaking agency staff use to manage and view user data.

[0106] "Matchmaking agency staff" refers to the person who works at a matchmaking agency and manages user data and matching progress.

[0107] The system of this invention provides an online matchmaking service, where users create detailed profiles and artificial intelligence (AI) uses that information to suggest optimal matches. It also offers multiple functions, such as the ability to upload self-introduction videos, an AI chatbot to support communication, and enhanced security using facial recognition technology.

[0108] Profile Creation and Management

[0109] Users download the app onto their smartphone, PC, or other device and go to the account creation screen. They enter their name, email address, and password in the basic information fields and press the "Next" button. After logging in, they access the detailed profile entry screen, enter information such as age, occupation, hobbies, and the qualities they would like in an ideal partner, and press the "Save" button. They then film a self-introduction video and use the app's upload function to send the video file to the server.

[0110] The server receives the user's basic information, detailed profile information, and self-introduction video and stores them in a database for later use in the matching process and security checks.

[0111] AI-based matching

[0112] The server extracts appropriate profile data from the database to provide all users' profile information to the AI ​​engine. The AI ​​engine analyzes the received profile data and learns the preferences and needs of each individual user. Based on this learning, the AI ​​runs a matching algorithm to suggest the most suitable partner. The server notifies the user of the matching results returned by the AI ​​engine.

[0113] Example: If user A enters in their profile that they "like the outdoors and would like a partner with the same hobby," the AI ​​will search for other users with the same hobby, user B, and calculate the degree of match and make suggestions.

[0114] Communication support with AI chatbots

[0115] If a match is made, the server will launch an AI chatbot, which will suggest appropriate conversation starters and provide communication advice based on the user's profile information and past conversation history.

[0116] Users can send messages to others based on conversation starters suggested by the chatbot.

[0117] Example: When User A sends his first message to User B, the AI ​​chatbot suggests, "Hi, I heard you love the outdoors. Do you have any recommended hiking trails?" This allows users to start the conversation in a natural way.

[0118] Enhanced security with facial recognition technology

[0119] When a user logs in from a new device, the device's camera takes a picture of their face and sends the image to the server. The server compares the received face image with an existing face database and allows login if authentication is successful.

[0120] Example: When User A tries to log in from a new smartphone, the device requests facial authentication. User A takes a picture of their face with the device's camera and sends it to the server. The server verifies the image, and if authentication is successful, the login is permitted.

[0121] Data management tool for matchmaking agencies

[0122] The server provides matchmaking agency staff with a dedicated dashboard that displays users' profile information, matching progress, and other important metrics in real time, allowing them to efficiently manage user data.

[0123] Example: A matchmaking agency staff member can access the dashboard to check the matching progress between User C and User D, and understand the success rate and communication status in real time. They can also use data analysis tools to analyze the matching success rate of user groups that meet specific criteria.

[0124] Example of input prompt for generative AI model

[0125] "Please suggest a date plan that you would recommend for a woman in her 20s who enjoys the outdoors."

[0126] "Please introduce me to a woman who would be suitable for a man in his 30s who is an engineer."

[0127] The present invention allows users to efficiently find their ideal partner based on detailed profile information, and allows matchmaking agencies to effectively manage user data and improve the quality of their services.

[0128] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0129] Step 1:

[0130] Users download and launch the app on their smartphone, computer, or other device. Next, they move to the account creation screen and enter their name, email address, and password. Once they've completed the information, they press the "Next" button. This completes the entry of their basic information.

[0131] The server receives the basic information submitted by the user and stores it in a database, thus creating a new user account.

[0132] Input: Name, Email Address, Password

[0133] Output: New user account saved in the database

[0134] Step 2:

[0135] Users log in with the account they created and access the detailed profile entry screen, where they enter their age, occupation, hobbies, and the qualities they want in an ideal partner, and then press the "Save" button.

[0136] The server receives the detailed profile information entered by the user and stores it in a database, which is used later in the matching process and for security checks.

[0137] Input: Age, occupation, hobbies, ideal partner requirements

[0138] Output: Detailed profile information stored in a database

[0139] Step 3:

[0140] The user shoots a self-introduction video and uses the app's upload function to send the video file to the server.

[0141] The server stores the received video file in a database and links it to the user's profile, making the video available for other users to view.

[0142] Input: Self-introduction video file

[0143] Output: Video files stored in the database and links to user profiles

[0144] Step 4:

[0145] The server extracts appropriate profile data from the database to provide detailed profile information for all users to the AI ​​engine.

[0146] The AI ​​engine analyzes the received profile data to learn each user's preferences and needs, and then runs a matching algorithm to suggest the best match based on the results.

[0147] The server notifies the user of the matching results returned by the AI ​​engine.

[0148] Example: If user A enters, "I love the outdoors and would like a partner with the same hobby," the AI ​​will search for user B who has the same hobby, calculate the degree of matching, and make suggestions.

[0149] Input: Detailed profile information extracted from the database

[0150] Output: Matching results reported to the user

[0151] Step 5:

[0152] If a match is made, the server will launch an AI chatbot.

[0153] The AI ​​chatbot suggests appropriate conversation starters based on the user's profile information and past conversation history.

[0154] Users can send messages to others based on conversation starters suggested by the chatbot.

[0155] Example: When User A sends their first message to User B, the AI ​​chatbot suggests, "Hi, I heard you love the outdoors. Do you have any recommended hiking trails?"

[0156] Input: Profile information, past conversation history

[0157] Output: Suggested conversation starters and messages sent

[0158] Step 6:

[0159] When a user attempts to log in from a new device, the device's camera is used to take a picture of their face and the image is sent to the server.

[0160] The server compares the received facial image with an existing facial database and allows login if authentication is successful.

[0161] Example: User A logs in from a new smartphone and is prompted for facial recognition. When the user provides a facial image, the server matches it and allows the user to log in.

[0162] Input: Face image

[0163] Output: Authentication result, login allowed

[0164] Step 7:

[0165] The server provides a dashboard for matchmaking agency staff to efficiently manage user data, displaying users' profile information, matching progress, and other important metrics in real time.

[0166] Example: A matchmaking agency staff member can access the dashboard and check the matching progress between User C and User D in real time. They can also use data analysis tools to analyze the matching success rate for a group of users who meet certain criteria.

[0167] Input: Dashboard access by matchmaking agency staff

[0168] Output: Display of user data, matching progress, data analysis results

[0169] (Application example 1)

[0170] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0171] Conventional online matchmaking services and content distribution services have had difficulty providing content and matching that fully reflects users' preferences and requests. Furthermore, methods for supporting communication and strengthening security have been limited, making it difficult to improve the user experience. The present invention aims to solve these issues and provide a system that offers a more personalized viewing and matching experience.

[0172] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0173] In this invention, the server includes means for users to create detailed profile information, means for using artificial intelligence to suggest the best partner based on the profile information, means for users to upload self-introduction videos, means for using an AI chatbot to support communication, means for verifying the user's identity using facial recognition technology to enhance security, means for suggesting the best video content based on the user's profile information and viewing history, and means for the AI ​​chatbot to provide viewing support, thereby enabling users to efficiently and safely find the best partner and content.

[0174] "User" means an individual or entity that uses the System and creates profile information and uploads a self-introduction video.

[0175] "Profile information" refers to detailed personal information entered by the user, including basic information, hobbies, preferences, and the characteristics desired in an ideal partner.

[0176] "Artificial intelligence" refers to software and technology designed to give computers some of the intelligence of humans, and algorithms that analyze users' profile information and suggest the most suitable partners and content.

[0177] A "self-introduction video" is a short video that a user films and uploads for the purpose of introducing themselves.

[0178] An "AI chatbot" is a program that uses artificial intelligence to automatically converse with users and assist with communication.

[0179] "Facial recognition technology" refers to technology that analyzes facial images captured by a camera and recognizes and identifies specific users.

[0180] "Viewing history" refers to a record of the video content a user has viewed to date, and is data used to understand the user's preferences.

[0181] "Video content" refers to all content in a viewable video format, such as movies, television programs, and videos.

[0182] "Recommendation" refers to the act of using artificial intelligence or algorithms to recommend appropriate content based on a user's preferences and viewing history.

[0183] "Security" refers to the technologies and measures that protect systems and data from unauthorized access, tampering, theft, etc.

[0184] "Identity verification" refers to the process of verifying that a person is a legitimate user when logging into a system.

[0185] A system embodying this invention comprises the following major components: a user terminal, a server, and an associated artificial intelligence (AI) engine.

[0186] User Device

[0187] User devices are used by users to create and enter detailed profile information and upload self-introduction videos. Examples include smartphones, smart glasses, and head-mounted displays. When a user logs in to a device using facial recognition, the device's camera captures a facial image and sends it to a server.

[0188] server

[0189] The server provides four main functions:

[0190] 1. Managing your profile information:

[0191] It receives profile information entered by users on their devices and stores it in a database, including detailed personal information such as age, occupation, hobbies, and what they would like in an ideal partner.

[0192] 2. AI Matching and Recommendations:

[0193] The server then provides the saved profile information to an AI engine for analysis. The AI ​​engine uses machine learning frameworks such as TensorFlow. Based on the profile information and viewing history, the AI ​​will suggest the most suitable partner and video content.

[0194] 3. Viewing and communication support with AI chatbots:

[0195] The server uses an AI chatbot to assist with viewing and communication. Using trained AI models (such as TensorFlow), the server makes suggestions to help users start natural conversations and resolves questions while viewing.

[0196] 4. Enhanced security with facial recognition technology:

[0197] To perform facial recognition when a user logs in from a new device, the server uses the OpenCV library to analyze the facial image and perform authentication.

[0198] Specific examples

[0199] For example, if User A tries to log in from a new smartphone, the device will request facial authentication. User A will take a picture of their face with the camera and send it to the server. The server will then use facial recognition technology to authenticate them, and if authentication is successful, they will be allowed to log in.

[0200] Also, if User B enters in his profile that he "loves the outdoors and wants a partner who shares the same hobby," the AI ​​will search for User C, another user who shares the same hobby, calculate the degree of matching, and make a suggestion.

[0201] Example prompts to input to the generative AI model

[0202] Here are some examples of prompts to input to a generative AI model:

[0203] User profile: Age 25, Occupation: Engineer, Favorite genre: Fantasy, Viewing history: Harry Potter series

[0204] Output: Recommend the best movie to watch next.

[0205] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0206] Step 1:

[0207] Users enter detailed profile information. Using their devices, users enter and upload basic information (such as name, age, occupation, hobbies, and ideal partner requirements) and a self-introduction video.

[0208] Input: Basic information, self-introduction video

[0209] Data processing: Formatting information on the device so that it can be sent to the server

[0210] Output: Sending profile information and video to the server

[0211] Step 2:

[0212] The server stores the received profile information and self-introduction video in a database. The server analyzes the received data and stores it in the database in an appropriate format.

[0213] Input: Profile information, self-introduction video

[0214] Data processing: Analyzing data and converting it into a format that can be stored in a database

[0215] Output: Save information to a database

[0216] Step 3:

[0217] Based on the profile and viewing history data, the server uses an AI engine to recommend suitable partners or video content. The AI ​​engine analyzes the profile information and viewing history using machine learning frameworks such as TensorFlow.

[0218] Input: Profile information, viewing history data

[0219] Data calculation: Analyzes data using an AI engine and recommends the most suitable people and content

[0220] Output: List of suitable people or video content

[0221] Step 4:

[0222] The server uses an AI chatbot to support users' communication and viewing, suggesting appropriate conversations and providing support while viewing based on the user's profile information and viewing history.

[0223] Input: Profile information, viewing history, user questions and conversation input

[0224] Data processing: Perform data analysis and natural language processing to generate appropriate suggestions and answers

[0225] Output: Text of the suggestion or answer

[0226] Step 5:

[0227] When a user tries to log in from a new device, the device uses a camera to take a facial image and sends it to the server, which then uses facial recognition technology (e.g., OpenCV) to match the facial image with an existing database.

[0228] Input: Face image

[0229] Data Computing: Using facial recognition algorithms to match against a database

[0230] Output: Authentication result (success / failure)

[0231] Step 6:

[0232] The server uses a generative AI model based on viewing history and profile information to generate prompts to recommend the most suitable video content to the user. See the example prompt below.

[0233] Input: Viewing history, profile information

[0234] Data processing: Generate prompts based on viewing history and profile information

[0235] Output: prompt statement

[0236] Example prompt sentence:

[0237] User profile: Age 25, Occupation: Engineer, Favorite genre: Fantasy, Viewing history: Harry Potter series

[0238] Output: Recommend the best movie to watch next.

[0239] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0240] The system of this invention incorporates an emotion engine into an online matchmaking service, recognizing and analyzing the user's emotional state to provide more precise matching and communication support. Users create detailed profiles and upload self-introduction videos, and advanced matching is performed using artificial intelligence (AI) and the emotion engine. In addition, an AI chatbot suggests optimal communication based on the user's emotional state, and facial recognition technology is used to enhance security.

[0241] Profile Creation and Management

[0242] After downloading and installing the app, users create an account by entering basic information such as their name, email address, and password. After logging in, users can enter detailed profile information (age, gender, occupation, hobbies, ideal partner criteria, etc.) and record and upload a self-introduction video.

[0243] The server receives the detailed profile information and self-introduction video entered by the user, stores them in a database, and verifies the user's basic information and detailed profile information to complete the registration.

[0244] AI-based matching

[0245] The server provides all user profiles to the AI ​​engine, which analyzes the user's detailed profile information and self-introduction video to learn about individual preferences and needs. Based on this learning, the AI ​​runs a matching algorithm to suggest the best possible match.

[0246] Example: For example, if User A enters in their profile that they are an outdoor enthusiast and would like a partner with the same hobbies, the AI ​​will search for User B, another user with the same hobbies, calculate the degree of match, and make suggestions.

[0247] Emotion recognition by emotion engine

[0248] The server uses an emotion engine to extract emotion data from the user's uploaded self-introduction video and message content, such as determining what emotions the user expresses in the video and whether the tone of the message is positive or negative.

[0249] Matching based on emotion data

[0250] The server combines and analyzes the emotional data and the user's profile information to suggest a partner that best suits the user's current emotional state, allowing the user to find a partner who is a better emotional fit according to their emotional state.

[0251] Example: For example, if the emotion engine determines that User A is "happily talking about the outdoors" in their self-introduction video, it will prioritize matching with User B, who also displays positive emotions.

[0252] Communication support with AI chatbots

[0253] The server uses an AI chatbot to assist with communication, which uses user profile information and emotional data to suggest conversation starters and provide appropriate communication advice.

[0254] Example: For example, when User A sends their first message to User B, the AI ​​chatbot might suggest something like, "Hi, I see you also love the outdoors. Are there any hiking trails you've been on recently that you'd recommend?"

[0255] Enhanced security with facial recognition technology

[0256] When a user logs in from a new device, the device's camera is used to take a picture of their face and send the image to the server, which then compares the received face image with an existing face database and allows the user to log in if authentication is successful.

[0257] Example: For example, when User A tries to log in from a new smartphone, the device requests facial authentication. User A takes a picture of their face with the device's camera and sends it to the server. The server collates the image, and if authentication is successful, the login is permitted.

[0258] Data management tool for matchmaking agencies

[0259] The server provides matchmaking agencies with a dedicated dashboard to help agency staff efficiently manage user data, displaying users' profile information, matching progress, and other important metrics in real time.

[0260] Example: Staff at a matchmaking agency can access the dashboard to check the matching progress between User C and User D, and understand the success rate and communication status in real time. They can also use data analysis tools to analyze the matching success rate of user groups that meet specific criteria.

[0261] This invention allows users to find the perfect partner efficiently and safely, and enables matchmaking agencies to improve the quality of their services. The introduction of an emotion engine enables matching based on the user's emotional state, enabling more accurate and personalized services to be provided.

[0262] The processing flow will be explained below.

[0263] Step 1:

[0264] The user downloads and installs the app, then taps the app icon to launch it.

[0265] Step 2:

[0266] A user enters basic information on the account creation screen, including name, email address, and password.

[0267] Step 3:

[0268] The server receives the basic information entered and stores it in a database. The server confirms the account creation and sends a confirmation email to the user.

[0269] Step 4:

[0270] The user receives a confirmation email and clicks the link to activate their account. The device redirects the user to the app's main screen.

[0271] Step 5:

[0272] On the main screen, users enter detailed profile information, including age, gender, occupation, hobbies, and ideal partner criteria.

[0273] Step 6:

[0274] The user shoots a self-introduction video on the profile creation screen and presses the upload button. The device sends the video data to the server.

[0275] Step 7:

[0276] The server receives the detailed profile information and video data and stores them in a database. The server verifies the profile information and completes the registration if it is correct.

[0277] Step 8:

[0278] The server provides all user profiles to the AI ​​engine, which analyzes the profile information and learns the characteristics of each user.

[0279] Step 9:

[0280] The server uses an emotion engine to analyze the uploaded video data and determine the user's emotional state (happiness, sadness, anger, etc.), and then integrates the emotion data with the profile information.

[0281] Step 10:

[0282] The server runs AI to search for the best partner based on each user's preferences, desires, and emotional state. The AI ​​then applies a matching algorithm to evaluate and suggest compatible partners.

[0283] Step 11:

[0284] The server notifies the user of the matching results, and the device displays the matching results and the other person's profile information and emotional state to the user.

[0285] Step 12:

[0286] After a match is made, the user can use the app's messaging function to send a message to the other person. A message input screen will appear.

[0287] Step 13:

[0288] The server launches an AI chatbot that generates appropriate conversation starter suggestions and advice based on the user's profile information, emotional data, and past conversation history.

[0289] Step 14:

[0290] The device receives the chatbot's suggestions and displays them to the user, who then sends a message based on the suggestions.

[0291] Step 15:

[0292] The server uses facial recognition technology to verify that the user is logging in from a new device. The device takes a picture of the user's face with its camera and sends the image to the server.

[0293] Step 16:

[0294] The server compares the facial image with existing data, and if authentication is successful, allows the user to log in. The authentication result is notified to the terminal.

[0295] Step 17:

[0296] The server provides a dashboard for matchmaking agencies, which agency staff access and manage user data.

[0297] Step 18:

[0298] The server updates the dashboard in real time, displaying users' progress and matching results, and agency staff use data analysis tools to develop suggestions for improving the service.

[0299] This process allows users to find the perfect partner efficiently and safely, and enables matchmaking agencies to provide effective services. The introduction of an emotion engine enables matching based on the user's emotional state, enabling more accurate and personalized services to be provided.

[0300] Example 2

[0301] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0302] In online matchmaking services, the process of users creating detailed profiles and finding a suitable partner is crucial. However, conventional systems only match users based on profile information without considering their emotional state, making it difficult for users to find the perfect match. Furthermore, communication support and security measures were insufficient, resulting in an unsatisfactory matchmaking experience for users.

[0303] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for creating detailed profile information for the user; means for using artificial intelligence to suggest a suitable partner based on the profile information; means for uploading a self-introduction video; means for supporting communication using an AI chatbot; means for verifying the user's identity using facial recognition technology to enhance security; means for extracting emotional data from the detailed profile information and the self-introduction video using an emotion engine that recognizes and analyzes the user's emotional state; means for suggesting a suitable partner based on the emotional data for the user's current emotional state; and means for providing a dashboard for matchmaking service providers and displaying and managing user profile information and matching progress in real time. This enables precise matching based on the user's emotional state, providing a safe and efficient online matchmaking experience.

[0304] "User" refers to an individual who participates in the online matchmaking service using the System.

[0305] "Detailed profile information" refers to information entered by the user, such as age, gender, occupation, hobbies, and ideal partner criteria.

[0306] "Artificial intelligence" refers to algorithms and technologies that analyze users' profile information, learn their preferences and needs, and suggest the most suitable partner.

[0307] "Self-Introduction Video" refers to a video file uploaded by a User to the System to introduce themselves.

[0308] An "AI chatbot" is a program that uses artificial intelligence to automatically provide appropriate conversation starters and advice to support communication between users.

[0309] "Facial recognition technology" refers to technology that analyzes a user's facial image to verify their identity.

[0310] "Emotion engine" refers to technology that extracts emotional data from users' self-introduction videos and message content, and recognizes and analyzes their emotional state.

[0311] "Emotion data" refers to data that indicates emotional states such as joy, sadness, and tension obtained from users' videos and messages extracted by the emotion engine.

[0312] "Dashboard" refers to the interface through which matchmaking service providers can view and manage user profile information, matching progress, and other important metrics in real time.

[0313] A "matching algorithm" refers to a calculation method for suggesting the most suitable partner based on a user's profile information and emotional data.

[0314] "Upload" refers to the act of a user sending and storing a self-introduction video or other data into the system.

[0315] The system of this invention incorporates an emotion engine into an online matchmaking service, recognizing and analyzing the user's emotional state to provide more precise matching and communication support. Users create detailed profiles and upload self-introduction videos, and advanced matching is performed using artificial intelligence (AI) and the emotion engine. In addition, an AI chatbot suggests optimal communication based on the user's emotional state, and facial recognition technology is used to enhance security.

[0316] Profile Creation and Management

[0317] After downloading and installing the app, users create an account by entering their name, email address, and password. After registering, users enter detailed profile information such as age, gender, occupation, hobbies, and ideal partner characteristics, and then film and upload a self-introduction video.

[0318] The server receives the detailed profile information and self-introduction video entered by the user, stores them in a database, and verifies the user's basic information and detailed profile information to complete the account registration.

[0319] AI-based matching

[0320] The server provides all user profiles to the AI ​​engine, which analyzes the user's detailed profile information and self-introduction video to learn about individual preferences and needs. Based on this learning, the AI ​​runs a matching algorithm to suggest the best possible match.

[0321] Example: For example, if User A enters in their profile that they are an outdoor enthusiast and would like a partner with the same hobbies, the AI ​​will search for User B, another user with the same hobbies, calculate the degree of match, and make suggestions.

[0322] Emotion recognition by emotion engine

[0323] The server uses an emotion engine to extract emotion data from the user's uploaded self-introduction video and message content, such as determining what emotions the user expresses in the video and whether the tone of the message is positive or negative.

[0324] Matching based on emotion data

[0325] The server combines and analyzes the emotional data and the user's profile information to suggest a partner that best suits the user's current emotional state, allowing the user to find a partner who is a better emotional fit according to their emotional state.

[0326] Example: For example, if the emotion engine determines that User A is "happily talking about the outdoors" in their self-introduction video, it will prioritize matching with User B, who also displays positive emotions.

[0327] Communication support with AI chatbots

[0328] The server uses an AI chatbot to assist with communication, which uses user profile information and emotional data to suggest conversation starters and provide appropriate communication advice.

[0329] Example: For example, when User A sends their first message to User B, the AI ​​chatbot might suggest, "Hi, I see you also love the outdoors. Are there any hiking trails you've been on recently that you'd recommend?"

[0330] Enhanced security with facial recognition technology

[0331] When a user logs in from a new device, the device's camera is used to take a picture of their face and send the image to the server, which then compares the received face image with an existing face database and allows the user to log in if authentication is successful.

[0332] Example: For example, when user A tries to log in from a new smartphone, the device requests facial authentication. User A takes a picture of his / her face with the camera and sends it to the server. The server verifies the image, and if authentication is successful, the login is permitted.

[0333] Data management tool for matchmaking agencies

[0334] The server provides matchmaking agencies with a dedicated dashboard, allowing agency staff to efficiently manage user data. The dashboard displays users' profile information, matching progress, and other important metrics in real time.

[0335] Example: Staff at a matchmaking agency can access the dashboard to check the matching progress between User C and User D, and understand the success rate and communication status in real time. They can also use data analysis tools to analyze the matching success rate of user groups that meet specific criteria.

[0336] The above configuration allows users to find the perfect partner efficiently and safely, and enables matchmaking service providers to improve the quality of their services. The introduction of an emotion engine enables matching based on the user's emotional state, making it possible to provide more accurate and personalized services.

[0337] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0338] Step 1:

[0339] The user downloads and installs the app. After installation, the user launches the app and presses the "New Registration" button. They enter their name, email address, and password, and press the "Submit" button. The entered information is sent to the server.

[0340] The server stores the received user information in a database and sends a confirmation link to the user's email address, which the user clicks to activate the account.

[0341] Input: Name, Email Address, Password

[0342] Output: Account creation completed and confirmation email sent

[0343] Step 2:

[0344] After logging in, users enter detailed profile information (age, gender, occupation, hobbies, ideal partner conditions, etc.). They then use the app's camera function to shoot a self-introduction video. After shooting the video, they preview it and, if there are no problems, press the "Upload" button.

[0345] The server receives the detailed profile information and self-introduction video entered by the user, stores them in a database, verifies the profile information, and completes the registration.

[0346] Input: Detailed profile information, introduction video

[0347] Output: Information saved to database and profile registration completed

[0348] Step 3:

[0349] The server provides all user profiles and self-introduction videos to the AI ​​engine, which analyzes the users' detailed profile information and videos to learn their individual preferences and needs. Based on this learning, it runs a matching algorithm to suggest the best possible match.

[0350] Input: All user profiles, introduction videos

[0351] Output: Suggestion based on the learning results

[0352] Specific behavior:

[0353] The server sends the profile information and self-introduction video to the AI ​​engine.

[0354] The AI ​​engine analyzes the input data and learns the user's hobbies and preferences.

[0355] The AI ​​engine runs the optimal matching algorithm based on the learning results and identifies the partner.

[0356] Step 4:

[0357] The server uses an emotion engine to extract emotion data from the self-introduction videos and message content uploaded by users, such as determining what emotions users express in the videos and whether the tone of their messages is positive or negative.

[0358] Input: Self-introduction video, message content

[0359] Output: Extracted emotion data

[0360] Specific behavior:

[0361] The server sends the video and text data to the emotion engine.

[0362] The emotion engine analyzes facial expressions, tone of voice, and spoken content in the video to extract emotional data.

[0363] The server stores the extracted emotion data.

[0364] Step 5:

[0365] The server combines and analyzes the emotional data and the user's profile information to suggest a partner who is best suited to the user's current emotional state, allowing the user to find a partner who is a better emotional fit based on the user's emotional state.

[0366] Input: Emotion data, detailed profile information

[0367] Output: Suggested partners based on emotional state

[0368] Specific behavior:

[0369] The server combines the profile information with the emotion data and runs a matching algorithm.

[0370] The matching algorithm takes emotional data into account to identify the best match for the user.

[0371] The server notifies the user of the matching results.

[0372] Step 6:

[0373] The server uses an AI chatbot to assist communication, which provides conversation starter suggestions and appropriate communication advice based on the user's profile information and emotional data.

[0374] Input: Profile information, emotion data

[0375] Output: Conversation starter suggestions, communication advice

[0376] Specific behavior:

[0377] The server provides profile information and emotional data to the AI ​​chatbot.

[0378] AI chatbots generate conversation starters and advice.

[0379] For example, when User A sends their first message to User B, the AI ​​chatbot will make a suggestion such as, "Hi, I see you also love the outdoors. Are there any hiking trails you've been on recently that you'd recommend?"

[0380] Step 7:

[0381] When a user logs in from a new device, the device's camera is used to take a picture of their face and send the image to the server, which then compares the received face image with an existing face database and allows the user to log in if authentication is successful.

[0382] Input: Face image

[0383] Output: Login authentication result

[0384] Specific behavior:

[0385] The device will launch the camera at the start of a new login session.

[0386] The user takes a picture of their face using a camera and sends it to the server.

[0387] The server compares the received facial image with existing facial data in a database.

[0388] If authentication is successful, the user is allowed to log in.

[0389] Step 8:

[0390] The server provides matchmaking agencies with a dedicated dashboard, allowing agency staff to efficiently manage user data. The dashboard displays users' profile information, matching progress, and other important metrics in real time.

[0391] Input: User data

[0392] Output: Real-time data display on a dashboard

[0393] Specific behavior:

[0394] The matchmaking agency staff member opens a browser and logs in to a dedicated dashboard.

[0395] The server displays user profile information, matching progress, and other metrics in real time.

[0396] Staff can use the dashboard to efficiently manage user data and provide the best matching support.

[0397] (Application example 2)

[0398] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0399] In modern society, online matchmaking is becoming increasingly common, but it is difficult to accurately assess compatibility and emotional fit between users. Another issue is the lack of a system that analyzes emotions in real time and provides communication support based on that analysis. Furthermore, security in online environments is a critical issue, and it is necessary to reduce the risk of impersonation and unauthorized access.

[0400] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for allowing a user to create detailed profile information and using artificial intelligence to suggest a suitable partner based on the profile information, a means for the user to upload a self-introduction video, a means for using an AI chatbot to provide communication support, a means for verifying the user's identity using facial recognition technology to enhance security, a means including an emotion engine for analyzing emotions in real time in a virtual space, and a means for providing communication support prompts using a generative AI model. This enables precise and personalized matching based on the user's emotional state, making it possible to provide a safe and effective online matchmaking service.

[0401] "Detailed profile information" refers to individual information provided by a user, including basic information about themselves, hobbies, ideal partner criteria, etc.

[0402] "Artificial intelligence" refers to technology that analyzes a user's profile information and emotional data to suggest the most suitable partner.

[0403] A "self-introduction video" refers to a video that a user films and uploads to introduce their characteristics, hobbies, and other information.

[0404] An "AI chatbot" is an artificial intelligence that provides appropriate communication advice and conversation suggestions based on a user's profile information and emotional data.

[0405] "Facial recognition technology" refers to technology that analyzes a user's facial image to verify their identity and enhance security.

[0406] The "emotion engine" refers to an engine that extracts emotional data from the self-introduction videos and message content uploaded by users and analyzes their emotional state in real time.

[0407] "Generative AI model" refers to an artificial intelligence model that generates communication assistance prompts and other suggestions based on a user's profile information and emotional data.

[0408] "Virtual space" refers to a virtual online environment constructed using digital technology.

[0409] This invention realizes a system that recognizes and analyzes the emotional state of users in online matchmaking services, and provides more precise matching and communication support.

[0410] Program Description

[0411] This system is implemented by an application installed on a smartphone, smart glasses, or a head-mounted display. The main processes are explained below.

[0412] Create and store detailed profile information

[0413] Users download the application and create an account. They then enter detailed profile information, such as their name, age, gender, hobbies, and ideal partner criteria. This data is sent to a server and stored in a database. This allows a profile to be built that reflects the user's personality and preferences.

[0414] Upload your introduction video

[0415] Users film a self-introduction video and upload it to the server via the application. The server stores the video in a database and makes it available for other users to view. The uploaded video is analyzed by an emotion engine to extract the user's emotional state.

[0416] Communication support with AI chatbots

[0417] The server uses an AI chatbot to suggest appropriate communication based on the user's detailed profile information and emotional data. For example, when a user sends a message to another user, the AI ​​chatbot can provide conversation starters and topic suggestions.

[0418] Enhanced security with facial recognition technology

[0419] When a user logs in from a new device, the device's camera is used to take a picture of their face and send the image to the server. The server compares the received facial image with an existing face database and allows the user to log in if authentication is successful. This prevents unauthorized access and strengthens security.

[0420] Real-time sentiment analysis with emotion engine

[0421] At virtual matchmaking events, the emotion engine analyzes users' real-time emotional state, extracting emotions from the video and audio data of their self-introduction videos, and then suggests the most suitable partner based on that data.

[0422] Prompts provided using generative AI models

[0423] The generative AI model analyzes user profile information and emotional data to generate communication-assistance prompts, allowing users to maintain natural conversations.

[0424] Specific examples

[0425] User: Alice

[0426] Age: 30

[0427] Hobbies: Outdoors

[0428] Introduction video: intro_video_alice.mp4

[0429] Emotion: Positive

[0430] Example prompt sentence:

[0431] Please provide details for User A:

[0432] Name: Alice

[0433] Age: 30

[0434] Hobbies: Outdoors

[0435] Emotional state: Positive

[0436] Suggest her a suitable partner profile, taking into account emotional data and hobbies.

[0437] User: Bob

[0438] Age: 32

[0439] Hobbies: Outdoors

[0440] Introduction video: intro_video_bob.mp4

[0441] Emotion: Positive

[0442] Example prompt sentence:

[0443] Please provide details for User B:

[0444] Name: Bob

[0445] Age: 32

[0446] Hobbies: Outdoors

[0447] Emotional state: Positive

[0448] Suggest him a suitable partner profile, taking into account emotional data and hobbies.

[0449] This system allows users to receive highly accurate matching based on their emotional state and natural communication support, while facial recognition technology provides enhanced security for safe use of the service.

[0450] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0451] Step 1:

[0452] A user downloads the application and creates an account.

[0453] Input: Name, Email Address, Password

[0454] Output: Save account information

[0455] Specific operation: The terminal enters basic information such as the user's name, email address, and password into an input form. The server receives this information and stores it in a database.

[0456] Step 2:

[0457] The user enters detailed profile information.

[0458] Input: Age, gender, hobbies, ideal partner conditions

[0459] Output: Save detailed profile information

[0460] How it works: The user enters detailed profile information such as age, gender, hobbies, and ideal partner characteristics into an input form on the device. The server receives this information and stores it in a database.

[0461] Step 3:

[0462] Users film and upload their own self-introduction videos.

[0463] Input: Self-introduction video file

[0464] Output: Save video and extract emotion data

[0465] Specific operation: The device shoots a self-introduction video and uploads the file to the server. The server receives the video file and stores it in a database. At the same time, the emotion engine analyzes the video file and extracts emotion data.

[0466] Step 4:

[0467] The server suggests the best partner based on the emotional data.

[0468] Input: detailed profile information, emotional data

[0469] Output: Matching list

[0470] How it works: The server uses AI to analyze the detailed profile information and emotional data stored. The AI ​​then searches for suitable partners based on the user's preferences and emotional data, and generates a match list.

[0471] Step 5:

[0472] The AI ​​chatbot generates suggested messages for the user.

[0473] Input: User profile information, emotion data, match list

[0474] Output: Proposal message

[0475] Specific operation: The server uses a generative AI model to create prompts based on the user's profile information, emotional data, and matching list, thereby providing appropriate conversation suggestions to the user.

[0476] Step 6:

[0477] Uses facial recognition technology to verify user identity.

[0478] Input: Face image

[0479] Output: Authentication result

[0480] Specific operation: When a user attempts to log in from a new device, the device takes a facial image and sends it to the server. The server compares the received facial image with an existing facial database and allows login if authentication is successful.

[0481] Step 7:

[0482] A user starts chatting in a virtual space.

[0483] Input: Proposal message, user input message

[0484] Output: Generates a chat message

[0485] Specific operation: When a user enters a chat room, the device receives suggested messages from the server. When the user enters a message and sends it to the server, the AI ​​chatbot generates a corresponding reply message and sends it to the user.

[0486] Through these specific processing steps, users can enjoy highly accurate matching based on their emotional state and natural communication support. Furthermore, enhanced security using facial recognition technology allows users to use the service safely.

[0487] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0488] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0489] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0490] [Second embodiment]

[0491] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0492] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0493] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0494] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0495] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0496] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0497] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0498] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0499] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0500] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0501] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0502] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0503] The system of this invention provides an online matchmaking service in which users create detailed profiles and artificial intelligence (AI) uses that information to suggest optimal matches. It also includes features such as the ability to upload self-introduction videos, an AI chatbot to assist with communication, and enhanced security using facial recognition technology.

[0504] Profile Creation and Management

[0505] After downloading the app, users create an account, which includes entering basic information (such as name, email address, and password). After logging in, users fill out a detailed profile, which includes information such as age, occupation, hobbies, and what they would look for in an ideal partner. Users can also film and upload a self-introduction video.

[0506] The server receives the profile information entered by the user and stores it in a database, which is used later in the matching process and for security checks.

[0507] AI-based matching

[0508] The server provides the entire user profile to the AI ​​engine, which analyzes the detailed profile information to learn about individual preferences and needs. Based on this learning, the AI ​​runs a matching algorithm to suggest the best match.

[0509] Example: For example, if User A enters in their profile that they "like the outdoors and would like a partner with the same hobbies," the AI ​​will search for User B, another user with similar hobbies, calculate the degree of matching, and make suggestions.

[0510] Communication support with AI chatbots

[0511] If a match is made, the server will launch an AI chatbot, which will provide appropriate conversation starter suggestions and communication advice based on the user's profile information and past conversation history.

[0512] Users can send messages to others based on conversation starters suggested by the chatbot.

[0513] Example: For example, when User A sends the first message to User B, the AI ​​chatbot might suggest, "Hi, I heard you love the outdoors. Do you have any recommended hiking trails?" This allows users to start the conversation in a natural way.

[0514] Enhanced security with facial recognition technology

[0515] When a user logs in from a new device, the device's camera takes a picture of their face and sends the image to the server. The server compares the received facial image with an existing face database and allows the user to log in if authentication is successful.

[0516] Example: For example, when User A tries to log in from a new smartphone, the device requests facial authentication. User A takes a picture of their face with the device's camera and sends it to the server. The server collates the image, and if authentication is successful, the login is permitted.

[0517] Data management tool for matchmaking agencies

[0518] The server provides matchmaking agencies with a dedicated dashboard to help agency staff efficiently manage user data, displaying users' profile information, matching progress, and other important metrics in real time.

[0519] Example: Staff at a matchmaking agency can access the dashboard to check the matching progress between User C and User D, and understand the success rate and communication status in real time. They can also use data analysis tools to analyze the matching success rate of user groups that meet specific criteria.

[0520] The present invention allows users to find their ideal partner in an efficient and safe manner, and enables matchmaking agencies to improve the quality of their services.

[0521] The processing flow will be explained below.

[0522] Step 1:

[0523] The user downloads and installs the app, then taps the app icon to launch it.

[0524] Step 2:

[0525] A user enters basic information on the account creation screen, including name, email address, and password.

[0526] Step 3:

[0527] The server receives the basic information entered and stores it in a database. The server confirms the account creation and sends a confirmation email to the user.

[0528] Step 4:

[0529] The user receives a confirmation email and clicks the link to activate their account. The device redirects the user to the app's main screen.

[0530] Step 5:

[0531] On the main screen, users enter detailed profile information, including age, gender, occupation, hobbies, and ideal partner criteria.

[0532] Step 6:

[0533] The user shoots a self-introduction video on the profile creation screen and presses the upload button. The device sends the video data to the server.

[0534] Step 7:

[0535] The server receives the detailed profile information and video data and stores them in a database. The server verifies the profile information and completes the registration if it is correct.

[0536] Step 8:

[0537] The server provides all user profiles to the AI ​​engine, which analyzes the profile information and learns the characteristics of each user.

[0538] Step 9:

[0539] The server runs AI to search for the best partner based on each user's preferences and needs. The AI ​​then applies a matching algorithm to evaluate and suggest compatible partners.

[0540] Step 10:

[0541] The server notifies the user of the matching results, and the user's device displays the matching results and the other person's profile information.

[0542] Step 11:

[0543] After a match is made, the user can use the app's messaging function to send a message to the other person. A message input screen will appear.

[0544] Step 12:

[0545] The server launches an AI chatbot that generates appropriate conversation starter suggestions and advice based on the user's profile information and conversation history.

[0546] Step 13:

[0547] The device receives the chatbot's suggestions and displays them to the user, who then sends a message based on the suggestions.

[0548] Step 14:

[0549] The server uses facial recognition technology to verify that the user is logging in from a new device. The device takes a picture of the user's face with its camera and sends the image to the server.

[0550] Step 15:

[0551] The server compares the facial image with existing data, and if authentication is successful, allows the user to log in. The authentication result is notified to the terminal.

[0552] Step 16:

[0553] The server provides a dashboard for matchmaking agencies, which agency staff access and manage user data.

[0554] Step 17:

[0555] The server updates the dashboard in real time, displaying users' progress and matching results, and agency staff use data analysis tools to develop suggestions for improving the service.

[0556] This process allows users to find their ideal partner efficiently and safely, and enables matchmaking agencies to provide effective services.

[0557] Example 1

[0558] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0559] Conventional online matchmaking services lack the means to suggest the best match based on the user's detailed profile information, which hinders smooth communication between users. They also lack security and face a high risk of unauthorized access. Furthermore, matchmaking agencies lack the means to efficiently manage user data.

[0560] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0561] In this invention, the server includes a means for storing user profiles in a database, a means for using artificial intelligence to suggest optimal partners based on detailed profile information, a means for supporting communication using an AI chatbot, a means for verifying user identities using facial recognition technology to enhance security, and a means for providing a dashboard for matchmaking agency staff to manage user data. This enables highly accurate matching based on detailed profile information, smooth communication support, strong security, and efficient data management.

[0562] "User" refers to an individual who uses the online matchmaking service.

[0563] "Profile Information" refers to detailed personal information provided by a User regarding age, occupation, hobbies, and ideal partner.

[0564] "Artificial intelligence" refers to algorithms and engines that analyze users' profile information and suggest the most suitable partner.

[0565] "Self-introduction video" refers to a video file that a user films and uploads to introduce themselves.

[0566] An "AI chatbot" is a chat program that uses artificial intelligence to assist communication between matched users.

[0567] "Facial recognition technology" refers to technology that analyzes a user's facial image and verifies their identity.

[0568] "Security" refers to the measures and protocols used to protect the safety of user data and access.

[0569] "Database" refers to a system that stores and manages data such as user profile information and self-introduction videos.

[0570] "Matching" refers to the process of suggesting the best match between users and building a relationship based on each other's profile information.

[0571] "Dashboard" refers to the interface that matchmaking agency staff use to manage and view user data.

[0572] "Matchmaking agency staff" refers to the person who works at a matchmaking agency and manages user data and matching progress.

[0573] The system of this invention provides an online matchmaking service, where users create detailed profiles and artificial intelligence (AI) uses that information to suggest optimal matches. It also offers multiple functions, such as the ability to upload self-introduction videos, an AI chatbot to support communication, and enhanced security using facial recognition technology.

[0574] Profile Creation and Management

[0575] Users download the app onto their smartphone, PC, or other device and go to the account creation screen. They enter their name, email address, and password in the basic information fields and press the "Next" button. After logging in, they access the detailed profile entry screen, enter information such as age, occupation, hobbies, and the qualities they would like in an ideal partner, and press the "Save" button. They then film a self-introduction video and use the app's upload function to send the video file to the server.

[0576] The server receives the user's basic information, detailed profile information, and self-introduction video and stores them in a database for later use in the matching process and security checks.

[0577] AI-based matching

[0578] The server extracts appropriate profile data from the database to provide all users' profile information to the AI ​​engine. The AI ​​engine analyzes the received profile data and learns the preferences and needs of each individual user. Based on this learning, the AI ​​runs a matching algorithm to suggest the most suitable partner. The server notifies the user of the matching results returned by the AI ​​engine.

[0579] Example: If user A enters in their profile that they "like the outdoors and would like a partner with the same hobby," the AI ​​will search for other users with the same hobby, user B, and calculate the degree of match and make suggestions.

[0580] Communication support with AI chatbots

[0581] If a match is made, the server will launch an AI chatbot, which will suggest appropriate conversation starters and provide communication advice based on the user's profile information and past conversation history.

[0582] Users can send messages to others based on conversation starters suggested by the chatbot.

[0583] Example: When User A sends his first message to User B, the AI ​​chatbot suggests, "Hi, I heard you love the outdoors. Do you have any recommended hiking trails?" This allows users to start the conversation in a natural way.

[0584] Enhanced security with facial recognition technology

[0585] When a user logs in from a new device, the device's camera takes a picture of their face and sends the image to the server. The server compares the received face image with an existing face database and allows login if authentication is successful.

[0586] Example: When User A tries to log in from a new smartphone, the device requests facial authentication. User A takes a picture of their face with the device's camera and sends it to the server. The server verifies the image, and if authentication is successful, the login is permitted.

[0587] Data management tool for matchmaking agencies

[0588] The server provides matchmaking agency staff with a dedicated dashboard that displays users' profile information, matching progress, and other important metrics in real time, allowing them to efficiently manage user data.

[0589] Example: A matchmaking agency staff member can access the dashboard to check the matching progress between User C and User D, and understand the success rate and communication status in real time. They can also use data analysis tools to analyze the matching success rate of user groups that meet specific criteria.

[0590] Example of input prompt for generative AI model

[0591] "Please suggest a date plan that you would recommend for a woman in her 20s who enjoys the outdoors."

[0592] "Please introduce me to a woman who would be suitable for a man in his 30s who is an engineer."

[0593] The present invention allows users to efficiently find their ideal partner based on detailed profile information, and allows matchmaking agencies to effectively manage user data and improve the quality of their services.

[0594] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0595] Step 1:

[0596] Users download and launch the app on their smartphone, computer, or other device. Next, they move to the account creation screen and enter their name, email address, and password. Once they've completed the information, they press the "Next" button. This completes the entry of their basic information.

[0597] The server receives the basic information submitted by the user and stores it in a database, thus creating a new user account.

[0598] Input: Name, Email Address, Password

[0599] Output: New user account saved in the database

[0600] Step 2:

[0601] Users log in with the account they created and access the detailed profile entry screen, where they enter their age, occupation, hobbies, and the qualities they want in an ideal partner, and then press the "Save" button.

[0602] The server receives the detailed profile information entered by the user and stores it in a database, which is used later in the matching process and for security checks.

[0603] Input: Age, occupation, hobbies, ideal partner requirements

[0604] Output: Detailed profile information stored in a database

[0605] Step 3:

[0606] The user shoots a self-introduction video and uses the app's upload function to send the video file to the server.

[0607] The server stores the received video file in a database and links it to the user's profile, making the video available for other users to view.

[0608] Input: Self-introduction video file

[0609] Output: Video files stored in the database and links to user profiles

[0610] Step 4:

[0611] The server extracts appropriate profile data from the database to provide detailed profile information for all users to the AI ​​engine.

[0612] The AI ​​engine analyzes the received profile data to learn each user's preferences and needs, and then runs a matching algorithm to suggest the best match based on the results.

[0613] The server notifies the user of the matching results returned by the AI ​​engine.

[0614] Example: If user A enters, "I love the outdoors and would like a partner with the same hobby," the AI ​​will search for user B who has the same hobby, calculate the degree of matching, and make suggestions.

[0615] Input: Detailed profile information extracted from the database

[0616] Output: Matching results reported to the user

[0617] Step 5:

[0618] If a match is made, the server will launch an AI chatbot.

[0619] The AI ​​chatbot suggests appropriate conversation starters based on the user's profile information and past conversation history.

[0620] Users can send messages to others based on conversation starters suggested by the chatbot.

[0621] Example: When User A sends their first message to User B, the AI ​​chatbot suggests, "Hi, I heard you love the outdoors. Do you have any recommended hiking trails?"

[0622] Input: Profile information, past conversation history

[0623] Output: Suggested conversation starters and messages sent

[0624] Step 6:

[0625] When a user attempts to log in from a new device, the device's camera is used to take a picture of their face and the image is sent to the server.

[0626] The server compares the received facial image with an existing facial database and allows login if authentication is successful.

[0627] Example: User A logs in from a new smartphone and is prompted for facial recognition. When the user provides a facial image, the server matches it and allows the user to log in.

[0628] Input: Face image

[0629] Output: Authentication result, login allowed

[0630] Step 7:

[0631] The server provides a dashboard for matchmaking agency staff to efficiently manage user data, displaying users' profile information, matching progress, and other important metrics in real time.

[0632] Example: A matchmaking agency staff member can access the dashboard and check the matching progress between User C and User D in real time. They can also use data analysis tools to analyze the matching success rate for a group of users who meet certain criteria.

[0633] Input: Dashboard access by matchmaking agency staff

[0634] Output: Display of user data, matching progress, data analysis results

[0635] (Application example 1)

[0636] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0637] Conventional online matchmaking services and content distribution services have had difficulty providing content and matching that fully reflects users' preferences and requests. Furthermore, methods for supporting communication and strengthening security have been limited, making it difficult to improve the user experience. The present invention aims to solve these issues and provide a system that offers a more personalized viewing and matching experience.

[0638] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0639] In this invention, the server includes means for users to create detailed profile information, means for using artificial intelligence to suggest the best partner based on the profile information, means for users to upload self-introduction videos, means for using an AI chatbot to support communication, means for verifying the user's identity using facial recognition technology to enhance security, means for suggesting the best video content based on the user's profile information and viewing history, and means for the AI ​​chatbot to provide viewing support, thereby enabling users to efficiently and safely find the best partner and content.

[0640] "User" means an individual or entity that uses the System and creates profile information and uploads a self-introduction video.

[0641] "Profile information" refers to detailed personal information entered by the user, including basic information, hobbies, preferences, and the characteristics desired in an ideal partner.

[0642] "Artificial intelligence" refers to software and technology designed to give computers some of the intelligence of humans, and algorithms that analyze users' profile information and suggest the most suitable partners and content.

[0643] A "self-introduction video" is a short video that a user films and uploads for the purpose of introducing themselves.

[0644] An "AI chatbot" is a program that uses artificial intelligence to automatically converse with users and assist with communication.

[0645] "Facial recognition technology" refers to technology that analyzes facial images captured by a camera and recognizes and identifies specific users.

[0646] "Viewing history" refers to a record of the video content a user has viewed to date, and is data used to understand the user's preferences.

[0647] "Video content" refers to all content in a viewable video format, such as movies, television programs, and videos.

[0648] "Recommendation" refers to the act of using artificial intelligence or algorithms to recommend appropriate content based on a user's preferences and viewing history.

[0649] "Security" refers to the technologies and measures that protect systems and data from unauthorized access, tampering, theft, etc.

[0650] "Identity verification" refers to the process of verifying that a person is a legitimate user when logging into a system.

[0651] A system embodying this invention comprises the following major components: a user terminal, a server, and an associated artificial intelligence (AI) engine.

[0652] User Device

[0653] User devices are used by users to create and enter detailed profile information and upload self-introduction videos. Examples include smartphones, smart glasses, and head-mounted displays. When a user logs in to a device using facial recognition, the device's camera captures a facial image and sends it to a server.

[0654] server

[0655] The server provides four main functions:

[0656] 1. Managing your profile information:

[0657] It receives profile information entered by users on their devices and stores it in a database, including detailed personal information such as age, occupation, hobbies, and what they would like in an ideal partner.

[0658] 2. AI Matching and Recommendations:

[0659] The server then provides the saved profile information to an AI engine for analysis. The AI ​​engine uses machine learning frameworks such as TensorFlow. Based on the profile information and viewing history, the AI ​​will suggest the most suitable partner and video content.

[0660] 3. Viewing and communication support with AI chatbots:

[0661] The server uses an AI chatbot to assist with viewing and communication. Using trained AI models (such as TensorFlow), the server makes suggestions to help users start natural conversations and resolves questions while viewing.

[0662] 4. Enhanced security with facial recognition technology:

[0663] To perform facial recognition when a user logs in from a new device, the server uses the OpenCV library to analyze the facial image and perform authentication.

[0664] Specific examples

[0665] For example, if User A tries to log in from a new smartphone, the device will request facial authentication. User A will take a picture of their face with the camera and send it to the server. The server will then use facial recognition technology to authenticate them, and if authentication is successful, they will be allowed to log in.

[0666] Also, if User B enters in his profile that he "loves the outdoors and wants a partner who shares the same hobby," the AI ​​will search for User C, another user who shares the same hobby, calculate the degree of matching, and make a suggestion.

[0667] Example prompts to input to the generative AI model

[0668] Here are some examples of prompts to input to a generative AI model:

[0669] User profile: Age 25, Occupation: Engineer, Favorite genre: Fantasy, Viewing history: Harry Potter series

[0670] Output: Recommend the best movie to watch next.

[0671] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0672] Step 1:

[0673] Users enter detailed profile information. Using their devices, users enter and upload basic information (such as name, age, occupation, hobbies, and ideal partner requirements) and a self-introduction video.

[0674] Input: Basic information, self-introduction video

[0675] Data processing: Formatting information on the device so that it can be sent to the server

[0676] Output: Sending profile information and video to the server

[0677] Step 2:

[0678] The server stores the received profile information and self-introduction video in a database. The server analyzes the received data and stores it in the database in an appropriate format.

[0679] Input: Profile information, self-introduction video

[0680] Data processing: Analyzing data and converting it into a format that can be stored in a database

[0681] Output: Save information to a database

[0682] Step 3:

[0683] Based on the profile and viewing history data, the server uses an AI engine to recommend suitable partners or video content. The AI ​​engine analyzes the profile information and viewing history using machine learning frameworks such as TensorFlow.

[0684] Input: Profile information, viewing history data

[0685] Data calculation: Analyzes data using an AI engine and recommends the most suitable people and content

[0686] Output: List of suitable people or video content

[0687] Step 4:

[0688] The server uses an AI chatbot to support users' communication and viewing, suggesting appropriate conversations and providing support while viewing based on the user's profile information and viewing history.

[0689] Input: Profile information, viewing history, user questions and conversation input

[0690] Data processing: Perform data analysis and natural language processing to generate appropriate suggestions and answers

[0691] Output: Text of the suggestion or answer

[0692] Step 5:

[0693] When a user tries to log in from a new device, the device uses a camera to take a facial image and sends it to the server, which then uses facial recognition technology (e.g., OpenCV) to match the facial image with an existing database.

[0694] Input: Face image

[0695] Data Computing: Using facial recognition algorithms to match against a database

[0696] Output: Authentication result (success / failure)

[0697] Step 6:

[0698] The server uses a generative AI model based on viewing history and profile information to generate prompts to recommend the most suitable video content to the user. See the example prompt below.

[0699] Input: Viewing history, profile information

[0700] Data processing: Generate prompts based on viewing history and profile information

[0701] Output: prompt statement

[0702] Example prompt sentence:

[0703] User profile: Age 25, Occupation: Engineer, Favorite genre: Fantasy, Viewing history: Harry Potter series

[0704] Output: Recommend the best movie to watch next.

[0705] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0706] The system of this invention incorporates an emotion engine into an online matchmaking service, recognizing and analyzing the user's emotional state to provide more precise matching and communication support. Users create detailed profiles and upload self-introduction videos, and advanced matching is performed using artificial intelligence (AI) and the emotion engine. In addition, an AI chatbot suggests optimal communication based on the user's emotional state, and facial recognition technology is used to enhance security.

[0707] Profile Creation and Management

[0708] After downloading and installing the app, users create an account by entering basic information such as their name, email address, and password. After logging in, users can enter detailed profile information (age, gender, occupation, hobbies, ideal partner criteria, etc.) and record and upload a self-introduction video.

[0709] The server receives the detailed profile information and self-introduction video entered by the user, stores them in a database, and verifies the user's basic information and detailed profile information to complete the registration.

[0710] AI-based matching

[0711] The server provides all user profiles to the AI ​​engine, which analyzes the user's detailed profile information and self-introduction video to learn about individual preferences and needs. Based on this learning, the AI ​​runs a matching algorithm to suggest the best possible match.

[0712] Example: For example, if User A enters in their profile that they are an outdoor enthusiast and would like a partner with the same hobbies, the AI ​​will search for User B, another user with the same hobbies, calculate the degree of match, and make suggestions.

[0713] Emotion recognition by emotion engine

[0714] The server uses an emotion engine to extract emotion data from the user's uploaded self-introduction video and message content, such as determining what emotions the user expresses in the video and whether the tone of the message is positive or negative.

[0715] Matching based on emotion data

[0716] The server combines and analyzes the emotional data and the user's profile information to suggest a partner that best suits the user's current emotional state, allowing the user to find a partner who is a better emotional fit according to their emotional state.

[0717] Example: For example, if the emotion engine determines that User A is "happily talking about the outdoors" in their self-introduction video, it will prioritize matching with User B, who also displays positive emotions.

[0718] Communication support with AI chatbots

[0719] The server uses an AI chatbot to assist with communication, which uses user profile information and emotional data to suggest conversation starters and provide appropriate communication advice.

[0720] Example: For example, when User A sends their first message to User B, the AI ​​chatbot might suggest something like, "Hi, I see you also love the outdoors. Are there any hiking trails you've been on recently that you'd recommend?"

[0721] Enhanced security with facial recognition technology

[0722] When a user logs in from a new device, the device's camera is used to take a picture of their face and send the image to the server, which then compares the received face image with an existing face database and allows the user to log in if authentication is successful.

[0723] Example: For example, when User A tries to log in from a new smartphone, the device requests facial authentication. User A takes a picture of their face with the device's camera and sends it to the server. The server collates the image, and if authentication is successful, the login is permitted.

[0724] Data management tool for matchmaking agencies

[0725] The server provides matchmaking agencies with a dedicated dashboard to help agency staff efficiently manage user data, displaying users' profile information, matching progress, and other important metrics in real time.

[0726] Example: Staff at a matchmaking agency can access the dashboard to check the matching progress between User C and User D, and understand the success rate and communication status in real time. They can also use data analysis tools to analyze the matching success rate of user groups that meet specific criteria.

[0727] This invention allows users to find the perfect partner efficiently and safely, and enables matchmaking agencies to improve the quality of their services. The introduction of an emotion engine enables matching based on the user's emotional state, enabling more accurate and personalized services to be provided.

[0728] The processing flow will be explained below.

[0729] Step 1:

[0730] The user downloads and installs the app, then taps the app icon to launch it.

[0731] Step 2:

[0732] A user enters basic information on the account creation screen, including name, email address, and password.

[0733] Step 3:

[0734] The server receives the basic information entered and stores it in a database. The server confirms the account creation and sends a confirmation email to the user.

[0735] Step 4:

[0736] The user receives a confirmation email and clicks the link to activate their account. The device redirects the user to the app's main screen.

[0737] Step 5:

[0738] On the main screen, users enter detailed profile information, including age, gender, occupation, hobbies, and ideal partner criteria.

[0739] Step 6:

[0740] The user shoots a self-introduction video on the profile creation screen and presses the upload button. The device sends the video data to the server.

[0741] Step 7:

[0742] The server receives the detailed profile information and video data and stores them in a database. The server verifies the profile information and completes the registration if it is correct.

[0743] Step 8:

[0744] The server provides all user profiles to the AI ​​engine, which analyzes the profile information and learns the characteristics of each user.

[0745] Step 9:

[0746] The server uses an emotion engine to analyze the uploaded video data and determine the user's emotional state (happiness, sadness, anger, etc.), and then integrates the emotion data with the profile information.

[0747] Step 10:

[0748] The server runs AI to search for the best partner based on each user's preferences, desires, and emotional state. The AI ​​then applies a matching algorithm to evaluate and suggest compatible partners.

[0749] Step 11:

[0750] The server notifies the user of the matching results, and the device displays the matching results and the other person's profile information and emotional state to the user.

[0751] Step 12:

[0752] After a match is made, the user can use the app's messaging function to send a message to the other person. A message input screen will appear.

[0753] Step 13:

[0754] The server launches an AI chatbot that generates appropriate conversation starter suggestions and advice based on the user's profile information, emotional data, and past conversation history.

[0755] Step 14:

[0756] The device receives the chatbot's suggestions and displays them to the user, who then sends a message based on the suggestions.

[0757] Step 15:

[0758] The server uses facial recognition technology to verify that the user is logging in from a new device. The device takes a picture of the user's face with its camera and sends the image to the server.

[0759] Step 16:

[0760] The server compares the facial image with existing data, and if authentication is successful, allows the user to log in. The authentication result is notified to the terminal.

[0761] Step 17:

[0762] The server provides a dashboard for matchmaking agencies, which agency staff access and manage user data.

[0763] Step 18:

[0764] The server updates the dashboard in real time, displaying users' progress and matching results, and agency staff use data analysis tools to develop suggestions for improving the service.

[0765] This process allows users to find the perfect partner efficiently and safely, and enables matchmaking agencies to provide effective services. The introduction of an emotion engine enables matching based on the user's emotional state, enabling more accurate and personalized services to be provided.

[0766] Example 2

[0767] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0768] In online matchmaking services, the process of users creating detailed profiles and finding a suitable partner is crucial. However, conventional systems only match users based on profile information without considering their emotional state, making it difficult for users to find the perfect match. Furthermore, communication support and security measures were insufficient, resulting in an unsatisfactory matchmaking experience for users.

[0769] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for creating detailed profile information for the user; means for using artificial intelligence to suggest a suitable partner based on the profile information; means for uploading a self-introduction video; means for supporting communication using an AI chatbot; means for verifying the user's identity using facial recognition technology to enhance security; means for extracting emotional data from the detailed profile information and the self-introduction video using an emotion engine that recognizes and analyzes the user's emotional state; means for suggesting a suitable partner based on the emotional data for the user's current emotional state; and means for providing a dashboard for matchmaking service providers and displaying and managing user profile information and matching progress in real time. This enables precise matching based on the user's emotional state, providing a safe and efficient online matchmaking experience.

[0770] "User" refers to an individual who participates in the online matchmaking service using the System.

[0771] "Detailed profile information" refers to information entered by the user, such as age, gender, occupation, hobbies, and ideal partner criteria.

[0772] "Artificial intelligence" refers to algorithms and technologies that analyze users' profile information, learn their preferences and needs, and suggest the most suitable partner.

[0773] "Self-Introduction Video" refers to a video file uploaded by a User to the System to introduce themselves.

[0774] An "AI chatbot" is a program that uses artificial intelligence to automatically provide appropriate conversation starters and advice to support communication between users.

[0775] "Facial recognition technology" refers to technology that analyzes a user's facial image to verify their identity.

[0776] "Emotion engine" refers to technology that extracts emotional data from users' self-introduction videos and message content, and recognizes and analyzes their emotional state.

[0777] "Emotion data" refers to data that indicates emotional states such as joy, sadness, and tension obtained from users' videos and messages extracted by the emotion engine.

[0778] "Dashboard" refers to the interface through which matchmaking service providers can view and manage user profile information, matching progress, and other important metrics in real time.

[0779] A "matching algorithm" refers to a calculation method for suggesting the most suitable partner based on a user's profile information and emotional data.

[0780] "Upload" refers to the act of a user sending and storing a self-introduction video or other data into the system.

[0781] The system of this invention incorporates an emotion engine into an online matchmaking service, recognizing and analyzing the user's emotional state to provide more precise matching and communication support. Users create detailed profiles and upload self-introduction videos, and advanced matching is performed using artificial intelligence (AI) and the emotion engine. In addition, an AI chatbot suggests optimal communication based on the user's emotional state, and facial recognition technology is used to enhance security.

[0782] Profile Creation and Management

[0783] After downloading and installing the app, users create an account by entering their name, email address, and password. After registering, users enter detailed profile information such as age, gender, occupation, hobbies, and ideal partner characteristics, and then film and upload a self-introduction video.

[0784] The server receives the detailed profile information and self-introduction video entered by the user, stores them in a database, and verifies the user's basic information and detailed profile information to complete the account registration.

[0785] AI-based matching

[0786] The server provides all user profiles to the AI ​​engine, which analyzes the user's detailed profile information and self-introduction video to learn about individual preferences and needs. Based on this learning, the AI ​​runs a matching algorithm to suggest the best possible match.

[0787] Example: For example, if User A enters in their profile that they are an outdoor enthusiast and would like a partner with the same hobbies, the AI ​​will search for User B, another user with the same hobbies, calculate the degree of match, and make suggestions.

[0788] Emotion recognition by emotion engine

[0789] The server uses an emotion engine to extract emotion data from the user's uploaded self-introduction video and message content, such as determining what emotions the user expresses in the video and whether the tone of the message is positive or negative.

[0790] Matching based on emotion data

[0791] The server combines and analyzes the emotional data and the user's profile information to suggest a partner that best suits the user's current emotional state, allowing the user to find a partner who is a better emotional fit according to their emotional state.

[0792] Example: For example, if the emotion engine determines that User A is "happily talking about the outdoors" in their self-introduction video, it will prioritize matching with User B, who also displays positive emotions.

[0793] Communication support with AI chatbots

[0794] The server uses an AI chatbot to assist with communication, which uses user profile information and emotional data to suggest conversation starters and provide appropriate communication advice.

[0795] Example: For example, when User A sends their first message to User B, the AI ​​chatbot might suggest, "Hi, I see you also love the outdoors. Are there any hiking trails you've been on recently that you'd recommend?"

[0796] Enhanced security with facial recognition technology

[0797] When a user logs in from a new device, the device's camera is used to take a picture of their face and send the image to the server, which then compares the received face image with an existing face database and allows the user to log in if authentication is successful.

[0798] Example: For example, when user A tries to log in from a new smartphone, the device requests facial authentication. User A takes a picture of his / her face with the camera and sends it to the server. The server verifies the image, and if authentication is successful, the login is permitted.

[0799] Data management tool for matchmaking agencies

[0800] The server provides matchmaking agencies with a dedicated dashboard, allowing agency staff to efficiently manage user data. The dashboard displays users' profile information, matching progress, and other important metrics in real time.

[0801] Example: Staff at a matchmaking agency can access the dashboard to check the matching progress between User C and User D, and understand the success rate and communication status in real time. They can also use data analysis tools to analyze the matching success rate of user groups that meet specific criteria.

[0802] The above configuration allows users to find the perfect partner efficiently and safely, and enables matchmaking service providers to improve the quality of their services. The introduction of an emotion engine enables matching based on the user's emotional state, making it possible to provide more accurate and personalized services.

[0803] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0804] Step 1:

[0805] The user downloads and installs the app. After installation, the user launches the app and presses the "New Registration" button. They enter their name, email address, and password, and press the "Submit" button. The entered information is sent to the server.

[0806] The server stores the received user information in a database and sends a confirmation link to the user's email address, which the user clicks to activate the account.

[0807] Input: Name, Email Address, Password

[0808] Output: Account creation completed and confirmation email sent

[0809] Step 2:

[0810] After logging in, users enter detailed profile information (age, gender, occupation, hobbies, ideal partner conditions, etc.). They then use the app's camera function to shoot a self-introduction video. After shooting the video, they preview it and, if there are no problems, press the "Upload" button.

[0811] The server receives the detailed profile information and self-introduction video entered by the user, stores them in a database, verifies the profile information, and completes the registration.

[0812] Input: Detailed profile information, introduction video

[0813] Output: Information saved to database and profile registration completed

[0814] Step 3:

[0815] The server provides all user profiles and self-introduction videos to the AI ​​engine, which analyzes the users' detailed profile information and videos to learn their individual preferences and needs. Based on this learning, it runs a matching algorithm to suggest the best possible match.

[0816] Input: All user profiles, introduction videos

[0817] Output: Suggestion based on the learning results

[0818] Specific behavior:

[0819] The server sends the profile information and self-introduction video to the AI ​​engine.

[0820] The AI ​​engine analyzes the input data and learns the user's hobbies and preferences.

[0821] The AI ​​engine runs the optimal matching algorithm based on the learning results and identifies the partner.

[0822] Step 4:

[0823] The server uses an emotion engine to extract emotion data from the self-introduction videos and message content uploaded by users, such as determining what emotions users express in the videos and whether the tone of their messages is positive or negative.

[0824] Input: Self-introduction video, message content

[0825] Output: Extracted emotion data

[0826] Specific behavior:

[0827] The server sends the video and text data to the emotion engine.

[0828] The emotion engine analyzes facial expressions, tone of voice, and spoken content in the video to extract emotional data.

[0829] The server stores the extracted emotion data.

[0830] Step 5:

[0831] The server combines and analyzes the emotional data and the user's profile information to suggest a partner who is best suited to the user's current emotional state, allowing the user to find a partner who is a better emotional fit based on the user's emotional state.

[0832] Input: Emotion data, detailed profile information

[0833] Output: Suggested partners based on emotional state

[0834] Specific behavior:

[0835] The server combines the profile information with the emotion data and runs a matching algorithm.

[0836] The matching algorithm takes emotional data into account to identify the best match for the user.

[0837] The server notifies the user of the matching results.

[0838] Step 6:

[0839] The server uses an AI chatbot to assist communication, which provides conversation starter suggestions and appropriate communication advice based on the user's profile information and emotional data.

[0840] Input: Profile information, emotion data

[0841] Output: Conversation starter suggestions, communication advice

[0842] Specific behavior:

[0843] The server provides profile information and emotional data to the AI ​​chatbot.

[0844] AI chatbots generate conversation starters and advice.

[0845] For example, when User A sends their first message to User B, the AI ​​chatbot will make a suggestion such as, "Hi, I see you also love the outdoors. Are there any hiking trails you've been on recently that you'd recommend?"

[0846] Step 7:

[0847] When a user logs in from a new device, the device's camera is used to take a picture of their face and send the image to the server, which then compares the received face image with an existing face database and allows the user to log in if authentication is successful.

[0848] Input: Face image

[0849] Output: Login authentication result

[0850] Specific behavior:

[0851] The device will launch the camera at the start of a new login session.

[0852] The user takes a picture of their face using a camera and sends it to the server.

[0853] The server compares the received facial image with existing facial data in a database.

[0854] If authentication is successful, the user is allowed to log in.

[0855] Step 8:

[0856] The server provides matchmaking agencies with a dedicated dashboard, allowing agency staff to efficiently manage user data. The dashboard displays users' profile information, matching progress, and other important metrics in real time.

[0857] Input: User data

[0858] Output: Real-time data display on a dashboard

[0859] Specific behavior:

[0860] The matchmaking agency staff member opens a browser and logs in to a dedicated dashboard.

[0861] The server displays user profile information, matching progress, and other metrics in real time.

[0862] Staff can use the dashboard to efficiently manage user data and provide the best matching support.

[0863] (Application example 2)

[0864] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0865] In modern society, online matchmaking is becoming increasingly common, but it is difficult to accurately assess compatibility and emotional fit between users. Another issue is the lack of a system that analyzes emotions in real time and provides communication support based on that analysis. Furthermore, security in online environments is a critical issue, and it is necessary to reduce the risk of impersonation and unauthorized access.

[0866] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for allowing a user to create detailed profile information and using artificial intelligence to suggest a suitable partner based on the profile information, a means for the user to upload a self-introduction video, a means for using an AI chatbot to provide communication support, a means for verifying the user's identity using facial recognition technology to enhance security, a means including an emotion engine for analyzing emotions in real time in a virtual space, and a means for providing communication support prompts using a generative AI model. This enables precise and personalized matching based on the user's emotional state, making it possible to provide a safe and effective online matchmaking service.

[0867] "Detailed profile information" refers to individual information provided by a user, including basic information about themselves, hobbies, ideal partner criteria, etc.

[0868] "Artificial intelligence" refers to technology that analyzes a user's profile information and emotional data to suggest the most suitable partner.

[0869] A "self-introduction video" refers to a video that a user films and uploads to introduce their characteristics, hobbies, and other information.

[0870] An "AI chatbot" is an artificial intelligence that provides appropriate communication advice and conversation suggestions based on a user's profile information and emotional data.

[0871] "Facial recognition technology" refers to technology that analyzes a user's facial image to verify their identity and enhance security.

[0872] The "emotion engine" refers to an engine that extracts emotional data from the self-introduction videos and message content uploaded by users and analyzes their emotional state in real time.

[0873] "Generative AI model" refers to an artificial intelligence model that generates communication assistance prompts and other suggestions based on a user's profile information and emotional data.

[0874] "Virtual space" refers to a virtual online environment constructed using digital technology.

[0875] This invention realizes a system that recognizes and analyzes the emotional state of users in online matchmaking services, and provides more precise matching and communication support.

[0876] Program Description

[0877] This system is implemented by an application installed on a smartphone, smart glasses, or a head-mounted display. The main processes are explained below.

[0878] Create and store detailed profile information

[0879] Users download the application and create an account. They then enter detailed profile information, such as their name, age, gender, hobbies, and ideal partner criteria. This data is sent to a server and stored in a database. This allows a profile to be built that reflects the user's personality and preferences.

[0880] Upload your introduction video

[0881] Users film a self-introduction video and upload it to the server via the application. The server stores the video in a database and makes it available for other users to view. The uploaded video is analyzed by an emotion engine to extract the user's emotional state.

[0882] Communication support with AI chatbots

[0883] The server uses an AI chatbot to suggest appropriate communication based on the user's detailed profile information and emotional data. For example, when a user sends a message to another user, the AI ​​chatbot can provide conversation starters and topic suggestions.

[0884] Enhanced security with facial recognition technology

[0885] When a user logs in from a new device, the device's camera is used to take a picture of their face and send the image to the server. The server compares the received facial image with an existing face database and allows the user to log in if authentication is successful. This prevents unauthorized access and strengthens security.

[0886] Real-time sentiment analysis with emotion engine

[0887] At virtual matchmaking events, the emotion engine analyzes users' real-time emotional state, extracting emotions from the video and audio data of their self-introduction videos, and then suggests the most suitable partner based on that data.

[0888] Prompts provided using generative AI models

[0889] The generative AI model analyzes user profile information and emotional data to generate communication-assistance prompts, allowing users to maintain natural conversations.

[0890] Specific examples

[0891] User: Alice

[0892] Age: 30

[0893] Hobbies: Outdoors

[0894] Introduction video: intro_video_alice.mp4

[0895] Emotion: Positive

[0896] Example prompt sentence:

[0897] Please provide details for User A:

[0898] Name: Alice

[0899] Age: 30

[0900] Hobbies: Outdoors

[0901] Emotional state: Positive

[0902] Suggest her a suitable partner profile, taking into account emotional data and hobbies.

[0903] User: Bob

[0904] Age: 32

[0905] Hobbies: Outdoors

[0906] Introduction video: intro_video_bob.mp4

[0907] Emotion: Positive

[0908] Example prompt sentence:

[0909] Please provide details for User B:

[0910] Name: Bob

[0911] Age: 32

[0912] Hobbies: Outdoors

[0913] Emotional state: Positive

[0914] Suggest him a suitable partner profile, taking into account emotional data and hobbies.

[0915] This system allows users to receive highly accurate matching based on their emotional state and natural communication support, while facial recognition technology provides enhanced security for safe use of the service.

[0916] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0917] Step 1:

[0918] A user downloads the application and creates an account.

[0919] Input: Name, Email Address, Password

[0920] Output: Save account information

[0921] Specific operation: The terminal enters basic information such as the user's name, email address, and password into an input form. The server receives this information and stores it in a database.

[0922] Step 2:

[0923] The user enters detailed profile information.

[0924] Input: Age, gender, hobbies, ideal partner conditions

[0925] Output: Save detailed profile information

[0926] How it works: The user enters detailed profile information such as age, gender, hobbies, and ideal partner characteristics into an input form on the device. The server receives this information and stores it in a database.

[0927] Step 3:

[0928] Users film and upload their own self-introduction videos.

[0929] Input: Self-introduction video file

[0930] Output: Save video and extract emotion data

[0931] Specific operation: The device shoots a self-introduction video and uploads the file to the server. The server receives the video file and stores it in a database. At the same time, the emotion engine analyzes the video file and extracts emotion data.

[0932] Step 4:

[0933] The server suggests the best partner based on the emotional data.

[0934] Input: detailed profile information, emotional data

[0935] Output: Matching list

[0936] How it works: The server uses AI to analyze the detailed profile information and emotional data stored. The AI ​​then searches for suitable partners based on the user's preferences and emotional data, and generates a match list.

[0937] Step 5:

[0938] The AI ​​chatbot generates suggested messages for the user.

[0939] Input: User profile information, emotion data, match list

[0940] Output: Proposal message

[0941] Specific operation: The server uses a generative AI model to create prompts based on the user's profile information, emotional data, and matching list, thereby providing appropriate conversation suggestions to the user.

[0942] Step 6:

[0943] Uses facial recognition technology to verify user identity.

[0944] Input: Face image

[0945] Output: Authentication result

[0946] Specific operation: When a user attempts to log in from a new device, the device takes a facial image and sends it to the server. The server compares the received facial image with an existing facial database and allows login if authentication is successful.

[0947] Step 7:

[0948] A user starts chatting in a virtual space.

[0949] Input: Proposal message, user input message

[0950] Output: Generates a chat message

[0951] Specific operation: When a user enters a chat room, the device receives suggested messages from the server. When the user enters a message and sends it to the server, the AI ​​chatbot generates a corresponding reply message and sends it to the user.

[0952] Through these specific processing steps, users can enjoy highly accurate matching based on their emotional state and natural communication support. Furthermore, enhanced security using facial recognition technology allows users to use the service safely.

[0953] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0954] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0955] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0956] [Third embodiment]

[0957] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0958] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0959] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0960] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0961] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0962] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0963] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0964] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0965] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0966] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0967] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0968] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0969] The system of this invention provides an online matchmaking service in which users create detailed profiles and artificial intelligence (AI) uses that information to suggest optimal matches. It also includes features such as the ability to upload self-introduction videos, an AI chatbot to assist with communication, and enhanced security using facial recognition technology.

[0970] Profile Creation and Management

[0971] After downloading the app, users create an account, which includes entering basic information (such as name, email address, and password). After logging in, users fill out a detailed profile, which includes information such as age, occupation, hobbies, and what they would look for in an ideal partner. Users can also film and upload a self-introduction video.

[0972] The server receives the profile information entered by the user and stores it in a database, which is used later in the matching process and for security checks.

[0973] AI-based matching

[0974] The server provides the entire user profile to the AI ​​engine, which analyzes the detailed profile information to learn about individual preferences and needs. Based on this learning, the AI ​​runs a matching algorithm to suggest the best match.

[0975] Example: For example, if User A enters in their profile that they "like the outdoors and would like a partner with the same hobbies," the AI ​​will search for User B, another user with similar hobbies, calculate the degree of matching, and make suggestions.

[0976] Communication support with AI chatbots

[0977] If a match is made, the server will launch an AI chatbot, which will provide appropriate conversation starter suggestions and communication advice based on the user's profile information and past conversation history.

[0978] Users can send messages to others based on conversation starters suggested by the chatbot.

[0979] Example: For example, when User A sends the first message to User B, the AI ​​chatbot might suggest, "Hi, I heard you love the outdoors. Do you have any recommended hiking trails?" This allows users to start the conversation in a natural way.

[0980] Enhanced security with facial recognition technology

[0981] When a user logs in from a new device, the device's camera takes a picture of their face and sends the image to the server. The server compares the received facial image with an existing face database and allows the user to log in if authentication is successful.

[0982] Example: For example, when User A tries to log in from a new smartphone, the device requests facial authentication. User A takes a picture of their face with the device's camera and sends it to the server. The server collates the image, and if authentication is successful, the login is permitted.

[0983] Data management tool for matchmaking agencies

[0984] The server provides matchmaking agencies with a dedicated dashboard to help agency staff efficiently manage user data, displaying users' profile information, matching progress, and other important metrics in real time.

[0985] Example: Staff at a matchmaking agency can access the dashboard to check the matching progress between User C and User D, and understand the success rate and communication status in real time. They can also use data analysis tools to analyze the matching success rate of user groups that meet specific criteria.

[0986] The present invention allows users to find their ideal partner in an efficient and safe manner, and enables matchmaking agencies to improve the quality of their services.

[0987] The processing flow will be explained below.

[0988] Step 1:

[0989] The user downloads and installs the app, then taps the app icon to launch it.

[0990] Step 2:

[0991] A user enters basic information on the account creation screen, including name, email address, and password.

[0992] Step 3:

[0993] The server receives the basic information entered and stores it in a database. The server confirms the account creation and sends a confirmation email to the user.

[0994] Step 4:

[0995] The user receives a confirmation email and clicks the link to activate their account. The device redirects the user to the app's main screen.

[0996] Step 5:

[0997] On the main screen, users enter detailed profile information, including age, gender, occupation, hobbies, and ideal partner criteria.

[0998] Step 6:

[0999] The user shoots a self-introduction video on the profile creation screen and presses the upload button. The device sends the video data to the server.

[1000] Step 7:

[1001] The server receives the detailed profile information and video data and stores them in a database. The server verifies the profile information and completes the registration if it is correct.

[1002] Step 8:

[1003] The server provides all user profiles to the AI ​​engine, which analyzes the profile information and learns the characteristics of each user.

[1004] Step 9:

[1005] The server runs AI to search for the best partner based on each user's preferences and needs. The AI ​​then applies a matching algorithm to evaluate and suggest compatible partners.

[1006] Step 10:

[1007] The server notifies the user of the matching results, and the user's device displays the matching results and the other person's profile information.

[1008] Step 11:

[1009] After a match is made, the user can use the app's messaging function to send a message to the other person. A message input screen will appear.

[1010] Step 12:

[1011] The server launches an AI chatbot that generates appropriate conversation starter suggestions and advice based on the user's profile information and conversation history.

[1012] Step 13:

[1013] The device receives the chatbot's suggestions and displays them to the user, who then sends a message based on the suggestions.

[1014] Step 14:

[1015] The server uses facial recognition technology to verify that the user is logging in from a new device. The device takes a picture of the user's face with its camera and sends the image to the server.

[1016] Step 15:

[1017] The server compares the facial image with existing data, and if authentication is successful, allows the user to log in. The authentication result is notified to the terminal.

[1018] Step 16:

[1019] The server provides a dashboard for matchmaking agencies, which agency staff access and manage user data.

[1020] Step 17:

[1021] The server updates the dashboard in real time, displaying users' progress and matching results, and agency staff use data analysis tools to develop suggestions for improving the service.

[1022] This process allows users to find their ideal partner efficiently and safely, and enables matchmaking agencies to provide effective services.

[1023] Example 1

[1024] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1025] Conventional online matchmaking services lack the means to suggest the best match based on the user's detailed profile information, which hinders smooth communication between users. They also lack security and face a high risk of unauthorized access. Furthermore, matchmaking agencies lack the means to efficiently manage user data.

[1026] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1027] In this invention, the server includes a means for storing user profiles in a database, a means for using artificial intelligence to suggest optimal partners based on detailed profile information, a means for supporting communication using an AI chatbot, a means for verifying user identities using facial recognition technology to enhance security, and a means for providing a dashboard for matchmaking agency staff to manage user data. This enables highly accurate matching based on detailed profile information, smooth communication support, strong security, and efficient data management.

[1028] "User" refers to an individual who uses the online matchmaking service.

[1029] "Profile Information" refers to detailed personal information provided by a User regarding age, occupation, hobbies, and ideal partner.

[1030] "Artificial intelligence" refers to algorithms and engines that analyze users' profile information and suggest the most suitable partner.

[1031] "Self-introduction video" refers to a video file that a user films and uploads to introduce themselves.

[1032] An "AI chatbot" is a chat program that uses artificial intelligence to assist communication between matched users.

[1033] "Facial recognition technology" refers to technology that analyzes a user's facial image and verifies their identity.

[1034] "Security" refers to the measures and protocols used to protect the safety of user data and access.

[1035] "Database" refers to a system that stores and manages data such as user profile information and self-introduction videos.

[1036] "Matching" refers to the process of suggesting the best match between users and building a relationship based on each other's profile information.

[1037] "Dashboard" refers to the interface that matchmaking agency staff use to manage and view user data.

[1038] "Matchmaking agency staff" refers to the person who works at a matchmaking agency and manages user data and matching progress.

[1039] The system of this invention provides an online matchmaking service, where users create detailed profiles and artificial intelligence (AI) uses that information to suggest optimal matches. It also offers multiple functions, such as the ability to upload self-introduction videos, an AI chatbot to support communication, and enhanced security using facial recognition technology.

[1040] Profile Creation and Management

[1041] Users download the app onto their smartphone, PC, or other device and go to the account creation screen. They enter their name, email address, and password in the basic information fields and press the "Next" button. After logging in, they access the detailed profile entry screen, enter information such as age, occupation, hobbies, and the qualities they would like in an ideal partner, and press the "Save" button. They then film a self-introduction video and use the app's upload function to send the video file to the server.

[1042] The server receives the user's basic information, detailed profile information, and self-introduction video and stores them in a database for later use in the matching process and security checks.

[1043] AI-based matching

[1044] The server extracts appropriate profile data from the database to provide all users' profile information to the AI ​​engine. The AI ​​engine analyzes the received profile data and learns the preferences and needs of each individual user. Based on this learning, the AI ​​runs a matching algorithm to suggest the most suitable partner. The server notifies the user of the matching results returned by the AI ​​engine.

[1045] Example: If user A enters in their profile that they "like the outdoors and would like a partner with the same hobby," the AI ​​will search for other users with the same hobby, user B, and calculate the degree of match and make suggestions.

[1046] Communication support with AI chatbots

[1047] If a match is made, the server will launch an AI chatbot, which will suggest appropriate conversation starters and provide communication advice based on the user's profile information and past conversation history.

[1048] Users can send messages to others based on conversation starters suggested by the chatbot.

[1049] Example: When User A sends his first message to User B, the AI ​​chatbot suggests, "Hi, I heard you love the outdoors. Do you have any recommended hiking trails?" This allows users to start the conversation in a natural way.

[1050] Enhanced security with facial recognition technology

[1051] When a user logs in from a new device, the device's camera takes a picture of their face and sends the image to the server. The server compares the received face image with an existing face database and allows login if authentication is successful.

[1052] Example: When User A tries to log in from a new smartphone, the device requests facial authentication. User A takes a picture of their face with the device's camera and sends it to the server. The server verifies the image, and if authentication is successful, the login is permitted.

[1053] Data management tool for matchmaking agencies

[1054] The server provides matchmaking agency staff with a dedicated dashboard that displays users' profile information, matching progress, and other important metrics in real time, allowing them to efficiently manage user data.

[1055] Example: A matchmaking agency staff member can access the dashboard to check the matching progress between User C and User D, and understand the success rate and communication status in real time. They can also use data analysis tools to analyze the matching success rate of user groups that meet specific criteria.

[1056] Example of input prompt for generative AI model

[1057] "Please suggest a date plan that you would recommend for a woman in her 20s who enjoys the outdoors."

[1058] "Please introduce me to a woman who would be suitable for a man in his 30s who is an engineer."

[1059] The present invention allows users to efficiently find their ideal partner based on detailed profile information, and allows matchmaking agencies to effectively manage user data and improve the quality of their services.

[1060] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1061] Step 1:

[1062] Users download and launch the app on their smartphone, computer, or other device. Next, they move to the account creation screen and enter their name, email address, and password. Once they've completed the information, they press the "Next" button. This completes the entry of their basic information.

[1063] The server receives the basic information submitted by the user and stores it in a database, thus creating a new user account.

[1064] Input: Name, Email Address, Password

[1065] Output: New user account saved in the database

[1066] Step 2:

[1067] Users log in with the account they created and access the detailed profile entry screen, where they enter their age, occupation, hobbies, and the qualities they want in an ideal partner, and then press the "Save" button.

[1068] The server receives the detailed profile information entered by the user and stores it in a database, which is used later in the matching process and for security checks.

[1069] Input: Age, occupation, hobbies, ideal partner requirements

[1070] Output: Detailed profile information stored in a database

[1071] Step 3:

[1072] The user shoots a self-introduction video and uses the app's upload function to send the video file to the server.

[1073] The server stores the received video file in a database and links it to the user's profile, making the video available for other users to view.

[1074] Input: Self-introduction video file

[1075] Output: Video files stored in the database and links to user profiles

[1076] Step 4:

[1077] The server extracts appropriate profile data from the database to provide detailed profile information for all users to the AI ​​engine.

[1078] The AI ​​engine analyzes the received profile data to learn each user's preferences and needs, and then runs a matching algorithm to suggest the best match based on the results.

[1079] The server notifies the user of the matching results returned by the AI ​​engine.

[1080] Example: If user A enters, "I love the outdoors and would like a partner with the same hobby," the AI ​​will search for user B who has the same hobby, calculate the degree of matching, and make suggestions.

[1081] Input: Detailed profile information extracted from the database

[1082] Output: Matching results reported to the user

[1083] Step 5:

[1084] If a match is made, the server will launch an AI chatbot.

[1085] The AI ​​chatbot suggests appropriate conversation starters based on the user's profile information and past conversation history.

[1086] Users can send messages to others based on conversation starters suggested by the chatbot.

[1087] Example: When User A sends their first message to User B, the AI ​​chatbot suggests, "Hi, I heard you love the outdoors. Do you have any recommended hiking trails?"

[1088] Input: Profile information, past conversation history

[1089] Output: Suggested conversation starters and messages sent

[1090] Step 6:

[1091] When a user attempts to log in from a new device, the device's camera is used to take a picture of their face and the image is sent to the server.

[1092] The server compares the received facial image with an existing facial database and allows login if authentication is successful.

[1093] Example: User A logs in from a new smartphone and is prompted for facial recognition. When the user provides a facial image, the server matches it and allows the user to log in.

[1094] Input: Face image

[1095] Output: Authentication result, login allowed

[1096] Step 7:

[1097] The server provides a dashboard for matchmaking agency staff to efficiently manage user data, displaying users' profile information, matching progress, and other important metrics in real time.

[1098] Example: A matchmaking agency staff member can access the dashboard and check the matching progress between User C and User D in real time. They can also use data analysis tools to analyze the matching success rate for a group of users who meet certain criteria.

[1099] Input: Dashboard access by matchmaking agency staff

[1100] Output: Display of user data, matching progress, data analysis results

[1101] (Application example 1)

[1102] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1103] Conventional online matchmaking services and content distribution services have had difficulty providing content and matching that fully reflects users' preferences and requests. Furthermore, methods for supporting communication and strengthening security have been limited, making it difficult to improve the user experience. The present invention aims to solve these issues and provide a system that offers a more personalized viewing and matching experience.

[1104] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1105] In this invention, the server includes means for users to create detailed profile information, means for using artificial intelligence to suggest the best partner based on the profile information, means for users to upload self-introduction videos, means for using an AI chatbot to support communication, means for verifying the user's identity using facial recognition technology to enhance security, means for suggesting the best video content based on the user's profile information and viewing history, and means for the AI ​​chatbot to provide viewing support, thereby enabling users to efficiently and safely find the best partner and content.

[1106] "User" means an individual or entity that uses the System and creates profile information and uploads a self-introduction video.

[1107] "Profile information" refers to detailed personal information entered by the user, including basic information, hobbies, preferences, and the characteristics desired in an ideal partner.

[1108] "Artificial intelligence" refers to software and technology designed to give computers some of the intelligence of humans, and algorithms that analyze users' profile information and suggest the most suitable partners and content.

[1109] A "self-introduction video" is a short video that a user films and uploads for the purpose of introducing themselves.

[1110] An "AI chatbot" is a program that uses artificial intelligence to automatically converse with users and assist with communication.

[1111] "Facial recognition technology" refers to technology that analyzes facial images captured by a camera and recognizes and identifies specific users.

[1112] "Viewing history" refers to a record of the video content a user has viewed to date, and is data used to understand the user's preferences.

[1113] "Video content" refers to all content in a viewable video format, such as movies, television programs, and videos.

[1114] "Recommendation" refers to the act of using artificial intelligence or algorithms to recommend appropriate content based on a user's preferences and viewing history.

[1115] "Security" refers to the technologies and measures that protect systems and data from unauthorized access, tampering, theft, etc.

[1116] "Identity verification" refers to the process of verifying that a person is a legitimate user when logging into a system.

[1117] A system embodying this invention comprises the following major components: a user terminal, a server, and an associated artificial intelligence (AI) engine.

[1118] User Device

[1119] User devices are used by users to create and enter detailed profile information and upload self-introduction videos. Examples include smartphones, smart glasses, and head-mounted displays. When a user logs in to a device using facial recognition, the device's camera captures a facial image and sends it to a server.

[1120] server

[1121] The server provides four main functions:

[1122] 1. Managing your profile information:

[1123] It receives profile information entered by users on their devices and stores it in a database, including detailed personal information such as age, occupation, hobbies, and what they would like in an ideal partner.

[1124] 2. AI Matching and Recommendations:

[1125] The server then provides the saved profile information to an AI engine for analysis. The AI ​​engine uses machine learning frameworks such as TensorFlow. Based on the profile information and viewing history, the AI ​​will suggest the most suitable partner and video content.

[1126] 3. Viewing and communication support with AI chatbots:

[1127] The server uses an AI chatbot to assist with viewing and communication. Using trained AI models (such as TensorFlow), the server makes suggestions to help users start natural conversations and resolves questions while viewing.

[1128] 4. Enhanced security with facial recognition technology:

[1129] To perform facial recognition when a user logs in from a new device, the server uses the OpenCV library to analyze the facial image and perform authentication.

[1130] Specific examples

[1131] For example, if User A tries to log in from a new smartphone, the device will request facial authentication. User A will take a picture of their face with the camera and send it to the server. The server will then use facial recognition technology to authenticate them, and if authentication is successful, they will be allowed to log in.

[1132] Also, if User B enters in his profile that he "loves the outdoors and wants a partner who shares the same hobby," the AI ​​will search for User C, another user who shares the same hobby, calculate the degree of matching, and make a suggestion.

[1133] Example prompts to input to the generative AI model

[1134] Here are some examples of prompts to input to a generative AI model:

[1135] User profile: Age 25, Occupation: Engineer, Favorite genre: Fantasy, Viewing history: Harry Potter series

[1136] Output: Recommend the best movie to watch next.

[1137] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1138] Step 1:

[1139] Users enter detailed profile information. Using their devices, users enter and upload basic information (such as name, age, occupation, hobbies, and ideal partner requirements) and a self-introduction video.

[1140] Input: Basic information, self-introduction video

[1141] Data processing: Formatting information on the device so that it can be sent to the server

[1142] Output: Sending profile information and video to the server

[1143] Step 2:

[1144] The server stores the received profile information and self-introduction video in a database. The server analyzes the received data and stores it in the database in an appropriate format.

[1145] Input: Profile information, self-introduction video

[1146] Data processing: Analyzing data and converting it into a format that can be stored in a database

[1147] Output: Save information to a database

[1148] Step 3:

[1149] Based on the profile and viewing history data, the server uses an AI engine to recommend suitable partners or video content. The AI ​​engine analyzes the profile information and viewing history using machine learning frameworks such as TensorFlow.

[1150] Input: Profile information, viewing history data

[1151] Data calculation: Analyzes data using an AI engine and recommends the most suitable people and content

[1152] Output: List of suitable people or video content

[1153] Step 4:

[1154] The server uses an AI chatbot to support users' communication and viewing, suggesting appropriate conversations and providing support while viewing based on the user's profile information and viewing history.

[1155] Input: Profile information, viewing history, user questions and conversation input

[1156] Data processing: Perform data analysis and natural language processing to generate appropriate suggestions and answers

[1157] Output: Text of the suggestion or answer

[1158] Step 5:

[1159] When a user tries to log in from a new device, the device uses a camera to take a facial image and sends it to the server, which then uses facial recognition technology (e.g., OpenCV) to match the facial image with an existing database.

[1160] Input: Face image

[1161] Data Computing: Using facial recognition algorithms to match against a database

[1162] Output: Authentication result (success / failure)

[1163] Step 6:

[1164] The server uses a generative AI model based on viewing history and profile information to generate prompts to recommend the most suitable video content to the user. See the example prompt below.

[1165] Input: Viewing history, profile information

[1166] Data processing: Generate prompts based on viewing history and profile information

[1167] Output: prompt statement

[1168] Example prompt sentence:

[1169] User profile: Age 25, Occupation: Engineer, Favorite genre: Fantasy, Viewing history: Harry Potter series

[1170] Output: Recommend the best movie to watch next.

[1171] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1172] The system of this invention incorporates an emotion engine into an online matchmaking service, recognizing and analyzing the user's emotional state to provide more precise matching and communication support. Users create detailed profiles and upload self-introduction videos, and advanced matching is performed using artificial intelligence (AI) and the emotion engine. In addition, an AI chatbot suggests optimal communication based on the user's emotional state, and facial recognition technology is used to enhance security.

[1173] Profile Creation and Management

[1174] After downloading and installing the app, users create an account by entering basic information such as their name, email address, and password. After logging in, users can enter detailed profile information (age, gender, occupation, hobbies, ideal partner criteria, etc.) and record and upload a self-introduction video.

[1175] The server receives the detailed profile information and self-introduction video entered by the user, stores them in a database, and verifies the user's basic information and detailed profile information to complete the registration.

[1176] AI-based matching

[1177] The server provides all user profiles to the AI ​​engine, which analyzes the user's detailed profile information and self-introduction video to learn about individual preferences and needs. Based on this learning, the AI ​​runs a matching algorithm to suggest the best possible match.

[1178] Example: For example, if User A enters in their profile that they are an outdoor enthusiast and would like a partner with the same hobbies, the AI ​​will search for User B, another user with the same hobbies, calculate the degree of match, and make suggestions.

[1179] Emotion recognition by emotion engine

[1180] The server uses an emotion engine to extract emotion data from the user's uploaded self-introduction video and message content, such as determining what emotions the user expresses in the video and whether the tone of the message is positive or negative.

[1181] Matching based on emotion data

[1182] The server combines and analyzes the emotional data and the user's profile information to suggest a partner that best suits the user's current emotional state, allowing the user to find a partner who is a better emotional fit according to their emotional state.

[1183] Example: For example, if the emotion engine determines that User A is "happily talking about the outdoors" in their self-introduction video, it will prioritize matching with User B, who also displays positive emotions.

[1184] Communication support with AI chatbots

[1185] The server uses an AI chatbot to assist with communication, which uses user profile information and emotional data to suggest conversation starters and provide appropriate communication advice.

[1186] Example: For example, when User A sends their first message to User B, the AI ​​chatbot might suggest something like, "Hi, I see you also love the outdoors. Are there any hiking trails you've been on recently that you'd recommend?"

[1187] Enhanced security with facial recognition technology

[1188] When a user logs in from a new device, the device's camera is used to take a picture of their face and send the image to the server, which then compares the received face image with an existing face database and allows the user to log in if authentication is successful.

[1189] Example: For example, when User A tries to log in from a new smartphone, the device requests facial authentication. User A takes a picture of their face with the device's camera and sends it to the server. The server collates the image, and if authentication is successful, the login is permitted.

[1190] Data management tool for matchmaking agencies

[1191] The server provides matchmaking agencies with a dedicated dashboard to help agency staff efficiently manage user data, displaying users' profile information, matching progress, and other important metrics in real time.

[1192] Example: Staff at a matchmaking agency can access the dashboard to check the matching progress between User C and User D, and understand the success rate and communication status in real time. They can also use data analysis tools to analyze the matching success rate of user groups that meet specific criteria.

[1193] This invention allows users to find the perfect partner efficiently and safely, and enables matchmaking agencies to improve the quality of their services. The introduction of an emotion engine enables matching based on the user's emotional state, enabling more accurate and personalized services to be provided.

[1194] The processing flow will be explained below.

[1195] Step 1:

[1196] The user downloads and installs the app, then taps the app icon to launch it.

[1197] Step 2:

[1198] A user enters basic information on the account creation screen, including name, email address, and password.

[1199] Step 3:

[1200] The server receives the basic information entered and stores it in a database. The server confirms the account creation and sends a confirmation email to the user.

[1201] Step 4:

[1202] The user receives a confirmation email and clicks the link to activate their account. The device redirects the user to the app's main screen.

[1203] Step 5:

[1204] On the main screen, users enter detailed profile information, including age, gender, occupation, hobbies, and ideal partner criteria.

[1205] Step 6:

[1206] The user shoots a self-introduction video on the profile creation screen and presses the upload button. The device sends the video data to the server.

[1207] Step 7:

[1208] The server receives the detailed profile information and video data and stores them in a database. The server verifies the profile information and completes the registration if it is correct.

[1209] Step 8:

[1210] The server provides all user profiles to the AI ​​engine, which analyzes the profile information and learns the characteristics of each user.

[1211] Step 9:

[1212] The server uses an emotion engine to analyze the uploaded video data and determine the user's emotional state (happiness, sadness, anger, etc.), and then integrates the emotion data with the profile information.

[1213] Step 10:

[1214] The server runs AI to search for the best partner based on each user's preferences, desires, and emotional state. The AI ​​then applies a matching algorithm to evaluate and suggest compatible partners.

[1215] Step 11:

[1216] The server notifies the user of the matching results, and the device displays the matching results and the other person's profile information and emotional state to the user.

[1217] Step 12:

[1218] After a match is made, the user can use the app's messaging function to send a message to the other person. A message input screen will appear.

[1219] Step 13:

[1220] The server launches an AI chatbot that generates appropriate conversation starter suggestions and advice based on the user's profile information, emotional data, and past conversation history.

[1221] Step 14:

[1222] The device receives the chatbot's suggestions and displays them to the user, who then sends a message based on the suggestions.

[1223] Step 15:

[1224] The server uses facial recognition technology to verify that the user is logging in from a new device. The device takes a picture of the user's face with its camera and sends the image to the server.

[1225] Step 16:

[1226] The server compares the facial image with existing data, and if authentication is successful, allows the user to log in. The authentication result is notified to the terminal.

[1227] Step 17:

[1228] The server provides a dashboard for matchmaking agencies, which agency staff access and manage user data.

[1229] Step 18:

[1230] The server updates the dashboard in real time, displaying users' progress and matching results, and agency staff use data analysis tools to develop suggestions for improving the service.

[1231] This process allows users to find the perfect partner efficiently and safely, and enables matchmaking agencies to provide effective services. The introduction of an emotion engine enables matching based on the user's emotional state, enabling more accurate and personalized services to be provided.

[1232] Example 2

[1233] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1234] In online matchmaking services, the process of users creating detailed profiles and finding a suitable partner is crucial. However, conventional systems only match users based on profile information without considering their emotional state, making it difficult for users to find the perfect match. Furthermore, communication support and security measures were insufficient, resulting in an unsatisfactory matchmaking experience for users.

[1235] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for creating detailed profile information for the user; means for using artificial intelligence to suggest a suitable partner based on the profile information; means for uploading a self-introduction video; means for supporting communication using an AI chatbot; means for verifying the user's identity using facial recognition technology to enhance security; means for extracting emotional data from the detailed profile information and the self-introduction video using an emotion engine that recognizes and analyzes the user's emotional state; means for suggesting a suitable partner based on the emotional data for the user's current emotional state; and means for providing a dashboard for matchmaking service providers and displaying and managing user profile information and matching progress in real time. This enables precise matching based on the user's emotional state, providing a safe and efficient online matchmaking experience.

[1236] "User" refers to an individual who participates in the online matchmaking service using the System.

[1237] "Detailed profile information" refers to information entered by the user, such as age, gender, occupation, hobbies, and ideal partner criteria.

[1238] "Artificial intelligence" refers to algorithms and technologies that analyze users' profile information, learn their preferences and needs, and suggest the most suitable partner.

[1239] "Self-Introduction Video" refers to a video file uploaded by a User to the System to introduce themselves.

[1240] An "AI chatbot" is a program that uses artificial intelligence to automatically provide appropriate conversation starters and advice to support communication between users.

[1241] "Facial recognition technology" refers to technology that analyzes a user's facial image to verify their identity.

[1242] "Emotion engine" refers to technology that extracts emotional data from users' self-introduction videos and message content, and recognizes and analyzes their emotional state.

[1243] "Emotion data" refers to data that indicates emotional states such as joy, sadness, and tension obtained from users' videos and messages extracted by the emotion engine.

[1244] "Dashboard" refers to the interface through which matchmaking service providers can view and manage user profile information, matching progress, and other important metrics in real time.

[1245] A "matching algorithm" refers to a calculation method for suggesting the most suitable partner based on a user's profile information and emotional data.

[1246] "Upload" refers to the act of a user sending and storing a self-introduction video or other data into the system.

[1247] The system of this invention incorporates an emotion engine into an online matchmaking service, recognizing and analyzing the user's emotional state to provide more precise matching and communication support. Users create detailed profiles and upload self-introduction videos, and advanced matching is performed using artificial intelligence (AI) and the emotion engine. In addition, an AI chatbot suggests optimal communication based on the user's emotional state, and facial recognition technology is used to enhance security.

[1248] Profile Creation and Management

[1249] After downloading and installing the app, users create an account by entering their name, email address, and password. After registering, users enter detailed profile information such as age, gender, occupation, hobbies, and ideal partner characteristics, and then film and upload a self-introduction video.

[1250] The server receives the detailed profile information and self-introduction video entered by the user, stores them in a database, and verifies the user's basic information and detailed profile information to complete the account registration.

[1251] AI-based matching

[1252] The server provides all user profiles to the AI ​​engine, which analyzes the user's detailed profile information and self-introduction video to learn about individual preferences and needs. Based on this learning, the AI ​​runs a matching algorithm to suggest the best possible match.

[1253] Example: For example, if User A enters in their profile that they are an outdoor enthusiast and would like a partner with the same hobbies, the AI ​​will search for User B, another user with the same hobbies, calculate the degree of match, and make suggestions.

[1254] Emotion recognition by emotion engine

[1255] The server uses an emotion engine to extract emotion data from the user's uploaded self-introduction video and message content, such as determining what emotions the user expresses in the video and whether the tone of the message is positive or negative.

[1256] Matching based on emotion data

[1257] The server combines and analyzes the emotional data and the user's profile information to suggest a partner that best suits the user's current emotional state, allowing the user to find a partner who is a better emotional fit according to their emotional state.

[1258] Example: For example, if the emotion engine determines that User A is "happily talking about the outdoors" in their self-introduction video, it will prioritize matching with User B, who also displays positive emotions.

[1259] Communication support with AI chatbots

[1260] The server uses an AI chatbot to assist with communication, which uses user profile information and emotional data to suggest conversation starters and provide appropriate communication advice.

[1261] Example: For example, when User A sends their first message to User B, the AI ​​chatbot might suggest, "Hi, I see you also love the outdoors. Are there any hiking trails you've been on recently that you'd recommend?"

[1262] Enhanced security with facial recognition technology

[1263] When a user logs in from a new device, the device's camera is used to take a picture of their face and send the image to the server, which then compares the received face image with an existing face database and allows the user to log in if authentication is successful.

[1264] Example: For example, when user A tries to log in from a new smartphone, the device requests facial authentication. User A takes a picture of his / her face with the camera and sends it to the server. The server verifies the image, and if authentication is successful, the login is permitted.

[1265] Data management tool for matchmaking agencies

[1266] The server provides matchmaking agencies with a dedicated dashboard, allowing agency staff to efficiently manage user data. The dashboard displays users' profile information, matching progress, and other important metrics in real time.

[1267] Example: Staff at a matchmaking agency can access the dashboard to check the matching progress between User C and User D, and understand the success rate and communication status in real time. They can also use data analysis tools to analyze the matching success rate of user groups that meet specific criteria.

[1268] The above configuration allows users to find the perfect partner efficiently and safely, and enables matchmaking service providers to improve the quality of their services. The introduction of an emotion engine enables matching based on the user's emotional state, making it possible to provide more accurate and personalized services.

[1269] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1270] Step 1:

[1271] The user downloads and installs the app. After installation, the user launches the app and presses the "New Registration" button. They enter their name, email address, and password, and press the "Submit" button. The entered information is sent to the server.

[1272] The server stores the received user information in a database and sends a confirmation link to the user's email address, which the user clicks to activate the account.

[1273] Input: Name, Email Address, Password

[1274] Output: Account creation completed and confirmation email sent

[1275] Step 2:

[1276] After logging in, users enter detailed profile information (age, gender, occupation, hobbies, ideal partner conditions, etc.). They then use the app's camera function to shoot a self-introduction video. After shooting the video, they preview it and, if there are no problems, press the "Upload" button.

[1277] The server receives the detailed profile information and self-introduction video entered by the user, stores them in a database, verifies the profile information, and completes the registration.

[1278] Input: Detailed profile information, introduction video

[1279] Output: Information saved to database and profile registration completed

[1280] Step 3:

[1281] The server provides all user profiles and self-introduction videos to the AI ​​engine, which analyzes the users' detailed profile information and videos to learn their individual preferences and needs. Based on this learning, it runs a matching algorithm to suggest the best possible match.

[1282] Input: All user profiles, introduction videos

[1283] Output: Suggestion based on the learning results

[1284] Specific behavior:

[1285] The server sends the profile information and self-introduction video to the AI ​​engine.

[1286] The AI ​​engine analyzes the input data and learns the user's hobbies and preferences.

[1287] The AI ​​engine runs the optimal matching algorithm based on the learning results and identifies the partner.

[1288] Step 4:

[1289] The server uses an emotion engine to extract emotion data from the self-introduction videos and message content uploaded by users, such as determining what emotions users express in the videos and whether the tone of their messages is positive or negative.

[1290] Input: Self-introduction video, message content

[1291] Output: Extracted emotion data

[1292] Specific behavior:

[1293] The server sends the video and text data to the emotion engine.

[1294] The emotion engine analyzes facial expressions, tone of voice, and spoken content in the video to extract emotional data.

[1295] The server stores the extracted emotion data.

[1296] Step 5:

[1297] The server combines and analyzes the emotional data and the user's profile information to suggest a partner who is best suited to the user's current emotional state, allowing the user to find a partner who is a better emotional fit based on the user's emotional state.

[1298] Input: Emotion data, detailed profile information

[1299] Output: Suggested partners based on emotional state

[1300] Specific behavior:

[1301] The server combines the profile information with the emotion data and runs a matching algorithm.

[1302] The matching algorithm takes emotional data into account to identify the best match for the user.

[1303] The server notifies the user of the matching results.

[1304] Step 6:

[1305] The server uses an AI chatbot to assist communication, which provides conversation starter suggestions and appropriate communication advice based on the user's profile information and emotional data.

[1306] Input: Profile information, emotion data

[1307] Output: Conversation starter suggestions, communication advice

[1308] Specific behavior:

[1309] The server provides profile information and emotional data to the AI ​​chatbot.

[1310] AI chatbots generate conversation starters and advice.

[1311] For example, when User A sends their first message to User B, the AI ​​chatbot will make a suggestion such as, "Hi, I see you also love the outdoors. Are there any hiking trails you've been on recently that you'd recommend?"

[1312] Step 7:

[1313] When a user logs in from a new device, the device's camera is used to take a picture of their face and send the image to the server, which then compares the received face image with an existing face database and allows the user to log in if authentication is successful.

[1314] Input: Face image

[1315] Output: Login authentication result

[1316] Specific behavior:

[1317] The device will launch the camera at the start of a new login session.

[1318] The user takes a picture of their face using a camera and sends it to the server.

[1319] The server compares the received facial image with existing facial data in a database.

[1320] If authentication is successful, the user is allowed to log in.

[1321] Step 8:

[1322] The server provides matchmaking agencies with a dedicated dashboard, allowing agency staff to efficiently manage user data. The dashboard displays users' profile information, matching progress, and other important metrics in real time.

[1323] Input: User data

[1324] Output: Real-time data display on a dashboard

[1325] Specific behavior:

[1326] The matchmaking agency staff member opens a browser and logs in to a dedicated dashboard.

[1327] The server displays user profile information, matching progress, and other metrics in real time.

[1328] Staff can use the dashboard to efficiently manage user data and provide the best matching support.

[1329] (Application example 2)

[1330] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1331] In modern society, online matchmaking is becoming increasingly common, but it is difficult to accurately assess compatibility and emotional fit between users. Another issue is the lack of a system that analyzes emotions in real time and provides communication support based on that analysis. Furthermore, security in online environments is a critical issue, and it is necessary to reduce the risk of impersonation and unauthorized access.

[1332] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for allowing a user to create detailed profile information and using artificial intelligence to suggest a suitable partner based on the profile information, a means for the user to upload a self-introduction video, a means for using an AI chatbot to provide communication support, a means for verifying the user's identity using facial recognition technology to enhance security, a means including an emotion engine for analyzing emotions in real time in a virtual space, and a means for providing communication support prompts using a generative AI model. This enables precise and personalized matching based on the user's emotional state, making it possible to provide a safe and effective online matchmaking service.

[1333] "Detailed profile information" refers to individual information provided by a user, including basic information about themselves, hobbies, ideal partner criteria, etc.

[1334] "Artificial intelligence" refers to technology that analyzes a user's profile information and emotional data to suggest the most suitable partner.

[1335] A "self-introduction video" refers to a video that a user films and uploads to introduce their characteristics, hobbies, and other information.

[1336] An "AI chatbot" is an artificial intelligence that provides appropriate communication advice and conversation suggestions based on a user's profile information and emotional data.

[1337] "Facial recognition technology" refers to technology that analyzes a user's facial image to verify their identity and enhance security.

[1338] The "emotion engine" refers to an engine that extracts emotional data from the self-introduction videos and message content uploaded by users and analyzes their emotional state in real time.

[1339] "Generative AI model" refers to an artificial intelligence model that generates communication assistance prompts and other suggestions based on a user's profile information and emotional data.

[1340] "Virtual space" refers to a virtual online environment constructed using digital technology.

[1341] This invention realizes a system that recognizes and analyzes the emotional state of users in online matchmaking services, and provides more precise matching and communication support.

[1342] Program Description

[1343] This system is implemented by an application installed on a smartphone, smart glasses, or a head-mounted display. The main processes are explained below.

[1344] Create and store detailed profile information

[1345] Users download the application and create an account. They then enter detailed profile information, such as their name, age, gender, hobbies, and ideal partner criteria. This data is sent to a server and stored in a database. This allows a profile to be built that reflects the user's personality and preferences.

[1346] Upload your introduction video

[1347] Users film a self-introduction video and upload it to the server via the application. The server stores the video in a database and makes it available for other users to view. The uploaded video is analyzed by an emotion engine to extract the user's emotional state.

[1348] Communication support with AI chatbots

[1349] The server uses an AI chatbot to suggest appropriate communication based on the user's detailed profile information and emotional data. For example, when a user sends a message to another user, the AI ​​chatbot can provide conversation starters and topic suggestions.

[1350] Enhanced security with facial recognition technology

[1351] When a user logs in from a new device, the device's camera is used to take a picture of their face and send the image to the server. The server compares the received facial image with an existing face database and allows the user to log in if authentication is successful. This prevents unauthorized access and strengthens security.

[1352] Real-time sentiment analysis with emotion engine

[1353] At virtual matchmaking events, the emotion engine analyzes users' real-time emotional state, extracting emotions from the video and audio data of their self-introduction videos, and then suggests the most suitable partner based on that data.

[1354] Prompts provided using generative AI models

[1355] The generative AI model analyzes user profile information and emotional data to generate communication-assistance prompts, allowing users to maintain natural conversations.

[1356] Specific examples

[1357] User: Alice

[1358] Age: 30

[1359] Hobbies: Outdoors

[1360] Introduction video: intro_video_alice.mp4

[1361] Emotion: Positive

[1362] Example prompt sentence:

[1363] Please provide details for User A:

[1364] Name: Alice

[1365] Age: 30

[1366] Hobbies: Outdoors

[1367] Emotional state: Positive

[1368] Suggest her a suitable partner profile, taking into account emotional data and hobbies.

[1369] User: Bob

[1370] Age: 32

[1371] Hobbies: Outdoors

[1372] Introduction video: intro_video_bob.mp4

[1373] Emotion: Positive

[1374] Example prompt sentence:

[1375] Please provide details for User B:

[1376] Name: Bob

[1377] Age: 32

[1378] Hobbies: Outdoors

[1379] Emotional state: Positive

[1380] Suggest him a suitable partner profile, taking into account emotional data and hobbies.

[1381] This system allows users to receive highly accurate matching based on their emotional state and natural communication support, while facial recognition technology provides enhanced security for safe use of the service.

[1382] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1383] Step 1:

[1384] A user downloads the application and creates an account.

[1385] Input: Name, Email Address, Password

[1386] Output: Save account information

[1387] Specific operation: The terminal enters basic information such as the user's name, email address, and password into an input form. The server receives this information and stores it in a database.

[1388] Step 2:

[1389] The user enters detailed profile information.

[1390] Input: Age, gender, hobbies, ideal partner conditions

[1391] Output: Save detailed profile information

[1392] How it works: The user enters detailed profile information such as age, gender, hobbies, and ideal partner characteristics into an input form on the device. The server receives this information and stores it in a database.

[1393] Step 3:

[1394] Users film and upload their own self-introduction videos.

[1395] Input: Self-introduction video file

[1396] Output: Save video and extract emotion data

[1397] Specific operation: The device shoots a self-introduction video and uploads the file to the server. The server receives the video file and stores it in a database. At the same time, the emotion engine analyzes the video file and extracts emotion data.

[1398] Step 4:

[1399] The server suggests the best partner based on the emotional data.

[1400] Input: detailed profile information, emotional data

[1401] Output: Matching list

[1402] How it works: The server uses AI to analyze the detailed profile information and emotional data stored. The AI ​​then searches for suitable partners based on the user's preferences and emotional data, and generates a match list.

[1403] Step 5:

[1404] The AI ​​chatbot generates suggested messages for the user.

[1405] Input: User profile information, emotion data, match list

[1406] Output: Proposal message

[1407] Specific operation: The server uses a generative AI model to create prompts based on the user's profile information, emotional data, and matching list, thereby providing appropriate conversation suggestions to the user.

[1408] Step 6:

[1409] Uses facial recognition technology to verify user identity.

[1410] Input: Face image

[1411] Output: Authentication result

[1412] Specific operation: When a user attempts to log in from a new device, the device takes a facial image and sends it to the server. The server compares the received facial image with an existing facial database and allows login if authentication is successful.

[1413] Step 7:

[1414] A user starts chatting in a virtual space.

[1415] Input: Proposal message, user input message

[1416] Output: Generates a chat message

[1417] Specific operation: When a user enters a chat room, the device receives suggested messages from the server. When the user enters a message and sends it to the server, the AI ​​chatbot generates a corresponding reply message and sends it to the user.

[1418] Through these specific processing steps, users can enjoy highly accurate matching based on their emotional state and natural communication support. Furthermore, enhanced security using facial recognition technology allows users to use the service safely.

[1419] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1420] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1421] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1422] [Fourth embodiment]

[1423] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1424] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1425] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1426] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1427] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1428] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1429] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1430] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1431] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1432] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1433] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1434] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1435] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1436] The system of this invention provides an online matchmaking service in which users create detailed profiles and artificial intelligence (AI) uses that information to suggest optimal matches. It also includes features such as the ability to upload self-introduction videos, an AI chatbot to assist with communication, and enhanced security using facial recognition technology.

[1437] Profile Creation and Management

[1438] After downloading the app, users create an account, which includes entering basic information (such as name, email address, and password). After logging in, users fill out a detailed profile, which includes information such as age, occupation, hobbies, and what they would look for in an ideal partner. Users can also film and upload a self-introduction video.

[1439] The server receives the profile information entered by the user and stores it in a database, which is used later in the matching process and for security checks.

[1440] AI-based matching

[1441] The server provides the entire user profile to the AI ​​engine, which analyzes the detailed profile information to learn about individual preferences and needs. Based on this learning, the AI ​​runs a matching algorithm to suggest the best match.

[1442] Example: For example, if User A enters in their profile that they "like the outdoors and would like a partner with the same hobbies," the AI ​​will search for User B, another user with similar hobbies, calculate the degree of matching, and make suggestions.

[1443] Communication support with AI chatbots

[1444] If a match is made, the server will launch an AI chatbot, which will provide appropriate conversation starter suggestions and communication advice based on the user's profile information and past conversation history.

[1445] Users can send messages to others based on conversation starters suggested by the chatbot.

[1446] Example: For example, when User A sends the first message to User B, the AI ​​chatbot might suggest, "Hi, I heard you love the outdoors. Do you have any recommended hiking trails?" This allows users to start the conversation in a natural way.

[1447] Enhanced security with facial recognition technology

[1448] When a user logs in from a new device, the device's camera takes a picture of their face and sends the image to the server. The server compares the received facial image with an existing face database and allows the user to log in if authentication is successful.

[1449] Example: For example, when User A tries to log in from a new smartphone, the device requests facial authentication. User A takes a picture of their face with the device's camera and sends it to the server. The server collates the image, and if authentication is successful, the login is permitted.

[1450] Data management tool for matchmaking agencies

[1451] The server provides matchmaking agencies with a dedicated dashboard to help agency staff efficiently manage user data, displaying users' profile information, matching progress, and other important metrics in real time.

[1452] Example: Staff at a matchmaking agency can access the dashboard to check the matching progress between User C and User D, and understand the success rate and communication status in real time. They can also use data analysis tools to analyze the matching success rate of user groups that meet specific criteria.

[1453] The present invention allows users to find their ideal partner in an efficient and safe manner, and enables matchmaking agencies to improve the quality of their services.

[1454] The processing flow will be explained below.

[1455] Step 1:

[1456] The user downloads and installs the app, then taps the app icon to launch it.

[1457] Step 2:

[1458] A user enters basic information on the account creation screen, including name, email address, and password.

[1459] Step 3:

[1460] The server receives the basic information entered and stores it in a database. The server confirms the account creation and sends a confirmation email to the user.

[1461] Step 4:

[1462] The user receives a confirmation email and clicks the link to activate their account. The device redirects the user to the app's main screen.

[1463] Step 5:

[1464] On the main screen, users enter detailed profile information, including age, gender, occupation, hobbies, and ideal partner criteria.

[1465] Step 6:

[1466] The user shoots a self-introduction video on the profile creation screen and presses the upload button. The device sends the video data to the server.

[1467] Step 7:

[1468] The server receives the detailed profile information and video data and stores them in a database. The server verifies the profile information and completes the registration if it is correct.

[1469] Step 8:

[1470] The server provides all user profiles to the AI ​​engine, which analyzes the profile information and learns the characteristics of each user.

[1471] Step 9:

[1472] The server runs AI to search for the best partner based on each user's preferences and needs. The AI ​​then applies a matching algorithm to evaluate and suggest compatible partners.

[1473] Step 10:

[1474] The server notifies the user of the matching results, and the user's device displays the matching results and the other person's profile information.

[1475] Step 11:

[1476] After a match is made, the user can use the app's messaging function to send a message to the other person. A message input screen will appear.

[1477] Step 12:

[1478] The server launches an AI chatbot that generates appropriate conversation starter suggestions and advice based on the user's profile information and conversation history.

[1479] Step 13:

[1480] The device receives the chatbot's suggestions and displays them to the user, who then sends a message based on the suggestions.

[1481] Step 14:

[1482] The server uses facial recognition technology to verify that the user is logging in from a new device. The device takes a picture of the user's face with its camera and sends the image to the server.

[1483] Step 15:

[1484] The server compares the facial image with existing data, and if authentication is successful, allows the user to log in. The authentication result is notified to the terminal.

[1485] Step 16:

[1486] The server provides a dashboard for matchmaking agencies, which agency staff access and manage user data.

[1487] Step 17:

[1488] The server updates the dashboard in real time, displaying users' progress and matching results, and agency staff use data analysis tools to develop suggestions for improving the service.

[1489] This process allows users to find their ideal partner efficiently and safely, and enables matchmaking agencies to provide effective services.

[1490] Example 1

[1491] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1492] Conventional online matchmaking services lack the means to suggest the best match based on the user's detailed profile information, which hinders smooth communication between users. They also lack security and face a high risk of unauthorized access. Furthermore, matchmaking agencies lack the means to efficiently manage user data.

[1493] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1494] In this invention, the server includes a means for storing user profiles in a database, a means for using artificial intelligence to suggest optimal partners based on detailed profile information, a means for supporting communication using an AI chatbot, a means for verifying user identities using facial recognition technology to enhance security, and a means for providing a dashboard for matchmaking agency staff to manage user data. This enables highly accurate matching based on detailed profile information, smooth communication support, strong security, and efficient data management.

[1495] "User" refers to an individual who uses the online matchmaking service.

[1496] "Profile Information" refers to detailed personal information provided by a User regarding age, occupation, hobbies, and ideal partner.

[1497] "Artificial intelligence" refers to algorithms and engines that analyze users' profile information and suggest the most suitable partner.

[1498] "Self-introduction video" refers to a video file that a user films and uploads to introduce themselves.

[1499] An "AI chatbot" is a chat program that uses artificial intelligence to assist communication between matched users.

[1500] "Facial recognition technology" refers to technology that analyzes a user's facial image and verifies their identity.

[1501] "Security" refers to the measures and protocols used to protect the safety of user data and access.

[1502] "Database" refers to a system that stores and manages data such as user profile information and self-introduction videos.

[1503] "Matching" refers to the process of suggesting the best match between users and building a relationship based on each other's profile information.

[1504] "Dashboard" refers to the interface that matchmaking agency staff use to manage and view user data.

[1505] "Matchmaking agency staff" refers to the person who works at a matchmaking agency and manages user data and matching progress.

[1506] The system of this invention provides an online matchmaking service, where users create detailed profiles and artificial intelligence (AI) uses that information to suggest optimal matches. It also offers multiple functions, such as the ability to upload self-introduction videos, an AI chatbot to support communication, and enhanced security using facial recognition technology.

[1507] Profile Creation and Management

[1508] Users download the app onto their smartphone, PC, or other device and go to the account creation screen. They enter their name, email address, and password in the basic information fields and press the "Next" button. After logging in, they access the detailed profile entry screen, enter information such as age, occupation, hobbies, and the qualities they would like in an ideal partner, and press the "Save" button. They then film a self-introduction video and use the app's upload function to send the video file to the server.

[1509] The server receives the user's basic information, detailed profile information, and self-introduction video and stores them in a database for later use in the matching process and security checks.

[1510] AI-based matching

[1511] The server extracts appropriate profile data from the database to provide all users' profile information to the AI ​​engine. The AI ​​engine analyzes the received profile data and learns the preferences and needs of each individual user. Based on this learning, the AI ​​runs a matching algorithm to suggest the most suitable partner. The server notifies the user of the matching results returned by the AI ​​engine.

[1512] Example: If user A enters in their profile that they "like the outdoors and would like a partner with the same hobby," the AI ​​will search for other users with the same hobby, user B, and calculate the degree of match and make suggestions.

[1513] Communication support with AI chatbots

[1514] If a match is made, the server will launch an AI chatbot, which will suggest appropriate conversation starters and provide communication advice based on the user's profile information and past conversation history.

[1515] Users can send messages to others based on conversation starters suggested by the chatbot.

[1516] Example: When User A sends his first message to User B, the AI ​​chatbot suggests, "Hi, I heard you love the outdoors. Do you have any recommended hiking trails?" This allows users to start the conversation in a natural way.

[1517] Enhanced security with facial recognition technology

[1518] When a user logs in from a new device, the device's camera takes a picture of their face and sends the image to the server. The server compares the received face image with an existing face database and allows login if authentication is successful.

[1519] Example: When User A tries to log in from a new smartphone, the device requests facial authentication. User A takes a picture of their face with the device's camera and sends it to the server. The server verifies the image, and if authentication is successful, the login is permitted.

[1520] Data management tool for matchmaking agencies

[1521] The server provides matchmaking agency staff with a dedicated dashboard that displays users' profile information, matching progress, and other important metrics in real time, allowing them to efficiently manage user data.

[1522] Example: A matchmaking agency staff member can access the dashboard to check the matching progress between User C and User D, and understand the success rate and communication status in real time. They can also use data analysis tools to analyze the matching success rate of user groups that meet specific criteria.

[1523] Example of input prompt for generative AI model

[1524] "Please suggest a date plan that you would recommend for a woman in her 20s who enjoys the outdoors."

[1525] "Please introduce me to a woman who would be suitable for a man in his 30s who is an engineer."

[1526] The present invention allows users to efficiently find their ideal partner based on detailed profile information, and allows matchmaking agencies to effectively manage user data and improve the quality of their services.

[1527] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1528] Step 1:

[1529] Users download and launch the app on their smartphone, computer, or other device. Next, they move to the account creation screen and enter their name, email address, and password. Once they've completed the information, they press the "Next" button. This completes the entry of their basic information.

[1530] The server receives the basic information submitted by the user and stores it in a database, thus creating a new user account.

[1531] Input: Name, Email Address, Password

[1532] Output: New user account saved in the database

[1533] Step 2:

[1534] Users log in with the account they created and access the detailed profile entry screen, where they enter their age, occupation, hobbies, and the qualities they want in an ideal partner, and then press the "Save" button.

[1535] The server receives the detailed profile information entered by the user and stores it in a database, which is used later in the matching process and for security checks.

[1536] Input: Age, occupation, hobbies, ideal partner requirements

[1537] Output: Detailed profile information stored in a database

[1538] Step 3:

[1539] The user shoots a self-introduction video and uses the app's upload function to send the video file to the server.

[1540] The server stores the received video file in a database and links it to the user's profile, making the video available for other users to view.

[1541] Input: Self-introduction video file

[1542] Output: Video files stored in the database and links to user profiles

[1543] Step 4:

[1544] The server extracts appropriate profile data from the database to provide detailed profile information for all users to the AI ​​engine.

[1545] The AI ​​engine analyzes the received profile data to learn each user's preferences and needs, and then runs a matching algorithm to suggest the best match based on the results.

[1546] The server notifies the user of the matching results returned by the AI ​​engine.

[1547] Example: If user A enters, "I love the outdoors and would like a partner with the same hobby," the AI ​​will search for user B who has the same hobby, calculate the degree of matching, and make suggestions.

[1548] Input: Detailed profile information extracted from the database

[1549] Output: Matching results reported to the user

[1550] Step 5:

[1551] If a match is made, the server will launch an AI chatbot.

[1552] The AI ​​chatbot suggests appropriate conversation starters based on the user's profile information and past conversation history.

[1553] Users can send messages to others based on conversation starters suggested by the chatbot.

[1554] Example: When User A sends their first message to User B, the AI ​​chatbot suggests, "Hi, I heard you love the outdoors. Do you have any recommended hiking trails?"

[1555] Input: Profile information, past conversation history

[1556] Output: Suggested conversation starters and messages sent

[1557] Step 6:

[1558] When a user attempts to log in from a new device, the device's camera is used to take a picture of their face and the image is sent to the server.

[1559] The server compares the received facial image with an existing facial database and allows login if authentication is successful.

[1560] Example: User A logs in from a new smartphone and is prompted for facial recognition. When the user provides a facial image, the server matches it and allows the user to log in.

[1561] Input: Face image

[1562] Output: Authentication result, login allowed

[1563] Step 7:

[1564] The server provides a dashboard for matchmaking agency staff to efficiently manage user data, displaying users' profile information, matching progress, and other important metrics in real time.

[1565] Example: A matchmaking agency staff member can access the dashboard and check the matching progress between User C and User D in real time. They can also use data analysis tools to analyze the matching success rate for a group of users who meet certain criteria.

[1566] Input: Dashboard access by matchmaking agency staff

[1567] Output: Display of user data, matching progress, data analysis results

[1568] (Application example 1)

[1569] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1570] Conventional online matchmaking services and content distribution services have had difficulty providing content and matching that fully reflects users' preferences and requests. Furthermore, methods for supporting communication and strengthening security have been limited, making it difficult to improve the user experience. The present invention aims to solve these issues and provide a system that offers a more personalized viewing and matching experience.

[1571] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1572] In this invention, the server includes means for users to create detailed profile information, means for using artificial intelligence to suggest the best partner based on the profile information, means for users to upload self-introduction videos, means for using an AI chatbot to support communication, means for verifying the user's identity using facial recognition technology to enhance security, means for suggesting the best video content based on the user's profile information and viewing history, and means for the AI ​​chatbot to provide viewing support, thereby enabling users to efficiently and safely find the best partner and content.

[1573] "User" means an individual or entity that uses the System and creates profile information and uploads a self-introduction video.

[1574] "Profile information" refers to detailed personal information entered by the user, including basic information, hobbies, preferences, and the characteristics desired in an ideal partner.

[1575] "Artificial intelligence" refers to software and technology designed to give computers some of the intelligence of humans, and algorithms that analyze users' profile information and suggest the most suitable partners and content.

[1576] A "self-introduction video" is a short video that a user films and uploads for the purpose of introducing themselves.

[1577] An "AI chatbot" is a program that uses artificial intelligence to automatically converse with users and assist with communication.

[1578] "Facial recognition technology" refers to technology that analyzes facial images captured by a camera and recognizes and identifies specific users.

[1579] "Viewing history" refers to a record of the video content a user has viewed to date, and is data used to understand the user's preferences.

[1580] "Video content" refers to all content in a viewable video format, such as movies, television programs, and videos.

[1581] "Recommendation" refers to the act of using artificial intelligence or algorithms to recommend appropriate content based on a user's preferences and viewing history.

[1582] "Security" refers to the technologies and measures that protect systems and data from unauthorized access, tampering, theft, etc.

[1583] "Identity verification" refers to the process of verifying that a person is a legitimate user when logging into a system.

[1584] A system embodying this invention comprises the following major components: a user terminal, a server, and an associated artificial intelligence (AI) engine.

[1585] User Device

[1586] User devices are used by users to create and enter detailed profile information and upload self-introduction videos. Examples include smartphones, smart glasses, and head-mounted displays. When a user logs in to a device using facial recognition, the device's camera captures a facial image and sends it to a server.

[1587] server

[1588] The server provides four main functions:

[1589] 1. Managing your profile information:

[1590] It receives profile information entered by users on their devices and stores it in a database, including detailed personal information such as age, occupation, hobbies, and what they would like in an ideal partner.

[1591] 2. AI Matching and Recommendations:

[1592] The server then provides the saved profile information to an AI engine for analysis. The AI ​​engine uses machine learning frameworks such as TensorFlow. Based on the profile information and viewing history, the AI ​​will suggest the most suitable partner and video content.

[1593] 3. Viewing and communication support with AI chatbots:

[1594] The server uses an AI chatbot to assist with viewing and communication. Using trained AI models (such as TensorFlow), the server makes suggestions to help users start natural conversations and resolves questions while viewing.

[1595] 4. Enhanced security with facial recognition technology:

[1596] To perform facial recognition when a user logs in from a new device, the server uses the OpenCV library to analyze the facial image and perform authentication.

[1597] Specific examples

[1598] For example, if User A tries to log in from a new smartphone, the device will request facial authentication. User A will take a picture of their face with the camera and send it to the server. The server will then use facial recognition technology to authenticate them, and if authentication is successful, they will be allowed to log in.

[1599] Also, if User B enters in his profile that he "loves the outdoors and wants a partner who shares the same hobby," the AI ​​will search for User C, another user who shares the same hobby, calculate the degree of matching, and make a suggestion.

[1600] Example prompts to input to the generative AI model

[1601] Here are some examples of prompts to input to a generative AI model:

[1602] User profile: Age 25, Occupation: Engineer, Favorite genre: Fantasy, Viewing history: Harry Potter series

[1603] Output: Recommend the best movie to watch next.

[1604] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1605] Step 1:

[1606] Users enter detailed profile information. Using their devices, users enter and upload basic information (such as name, age, occupation, hobbies, and ideal partner requirements) and a self-introduction video.

[1607] Input: Basic information, self-introduction video

[1608] Data processing: Formatting information on the device so that it can be sent to the server

[1609] Output: Sending profile information and video to the server

[1610] Step 2:

[1611] The server stores the received profile information and self-introduction video in a database. The server analyzes the received data and stores it in the database in an appropriate format.

[1612] Input: Profile information, self-introduction video

[1613] Data processing: Analyzing data and converting it into a format that can be stored in a database

[1614] Output: Save information to a database

[1615] Step 3:

[1616] Based on the profile and viewing history data, the server uses an AI engine to recommend suitable partners or video content. The AI ​​engine analyzes the profile information and viewing history using machine learning frameworks such as TensorFlow.

[1617] Input: Profile information, viewing history data

[1618] Data calculation: Analyzes data using an AI engine and recommends the most suitable people and content

[1619] Output: List of suitable people or video content

[1620] Step 4:

[1621] The server uses an AI chatbot to support users' communication and viewing, suggesting appropriate conversations and providing support while viewing based on the user's profile information and viewing history.

[1622] Input: Profile information, viewing history, user questions and conversation input

[1623] Data processing: Perform data analysis and natural language processing to generate appropriate suggestions and answers

[1624] Output: Text of the suggestion or answer

[1625] Step 5:

[1626] When a user tries to log in from a new device, the device uses a camera to take a facial image and sends it to the server, which then uses facial recognition technology (e.g., OpenCV) to match the facial image with an existing database.

[1627] Input: Face image

[1628] Data Computing: Using facial recognition algorithms to match against a database

[1629] Output: Authentication result (success / failure)

[1630] Step 6:

[1631] The server uses a generative AI model based on viewing history and profile information to generate prompts to recommend the most suitable video content to the user. See the example prompt below.

[1632] Input: Viewing history, profile information

[1633] Data processing: Generate prompts based on viewing history and profile information

[1634] Output: prompt statement

[1635] Example prompt sentence:

[1636] User profile: Age 25, Occupation: Engineer, Favorite genre: Fantasy, Viewing history: Harry Potter series

[1637] Output: Recommend the best movie to watch next.

[1638] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1639] The system of this invention incorporates an emotion engine into an online matchmaking service, recognizing and analyzing the user's emotional state to provide more precise matching and communication support. Users create detailed profiles and upload self-introduction videos, and advanced matching is performed using artificial intelligence (AI) and the emotion engine. In addition, an AI chatbot suggests optimal communication based on the user's emotional state, and facial recognition technology is used to enhance security.

[1640] Profile Creation and Management

[1641] After downloading and installing the app, users create an account by entering basic information such as their name, email address, and password. After logging in, users can enter detailed profile information (age, gender, occupation, hobbies, ideal partner criteria, etc.) and record and upload a self-introduction video.

[1642] The server receives the detailed profile information and self-introduction video entered by the user, stores them in a database, and verifies the user's basic information and detailed profile information to complete the registration.

[1643] AI-based matching

[1644] The server provides all user profiles to the AI ​​engine, which analyzes the user's detailed profile information and self-introduction video to learn about individual preferences and needs. Based on this learning, the AI ​​runs a matching algorithm to suggest the best possible match.

[1645] Example: For example, if User A enters in their profile that they are an outdoor enthusiast and would like a partner with the same hobbies, the AI ​​will search for User B, another user with the same hobbies, calculate the degree of match, and make suggestions.

[1646] Emotion recognition by emotion engine

[1647] The server uses an emotion engine to extract emotion data from the user's uploaded self-introduction video and message content, such as determining what emotions the user expresses in the video and whether the tone of the message is positive or negative.

[1648] Matching based on emotion data

[1649] The server combines and analyzes the emotional data and the user's profile information to suggest a partner that best suits the user's current emotional state, allowing the user to find a partner who is a better emotional fit according to their emotional state.

[1650] Example: For example, if the emotion engine determines that User A is "happily talking about the outdoors" in their self-introduction video, it will prioritize matching with User B, who also displays positive emotions.

[1651] Communication support with AI chatbots

[1652] The server uses an AI chatbot to assist with communication, which uses user profile information and emotional data to suggest conversation starters and provide appropriate communication advice.

[1653] Example: For example, when User A sends their first message to User B, the AI ​​chatbot might suggest something like, "Hi, I see you also love the outdoors. Are there any hiking trails you've been on recently that you'd recommend?"

[1654] Enhanced security with facial recognition technology

[1655] When a user logs in from a new device, the device's camera is used to take a picture of their face and send the image to the server, which then compares the received face image with an existing face database and allows the user to log in if authentication is successful.

[1656] Example: For example, when User A tries to log in from a new smartphone, the device requests facial authentication. User A takes a picture of their face with the device's camera and sends it to the server. The server collates the image, and if authentication is successful, the login is permitted.

[1657] Data management tool for matchmaking agencies

[1658] The server provides matchmaking agencies with a dedicated dashboard to help agency staff efficiently manage user data, displaying users' profile information, matching progress, and other important metrics in real time.

[1659] Example: Staff at a matchmaking agency can access the dashboard to check the matching progress between User C and User D, and understand the success rate and communication status in real time. They can also use data analysis tools to analyze the matching success rate of user groups that meet specific criteria.

[1660] This invention allows users to find the perfect partner efficiently and safely, and enables matchmaking agencies to improve the quality of their services. The introduction of an emotion engine enables matching based on the user's emotional state, enabling more accurate and personalized services to be provided.

[1661] The processing flow will be explained below.

[1662] Step 1:

[1663] The user downloads and installs the app, then taps the app icon to launch it.

[1664] Step 2:

[1665] A user enters basic information on the account creation screen, including name, email address, and password.

[1666] Step 3:

[1667] The server receives the basic information entered and stores it in a database. The server confirms the account creation and sends a confirmation email to the user.

[1668] Step 4:

[1669] The user receives a confirmation email and clicks the link to activate their account. The device redirects the user to the app's main screen.

[1670] Step 5:

[1671] On the main screen, users enter detailed profile information, including age, gender, occupation, hobbies, and ideal partner criteria.

[1672] Step 6:

[1673] The user shoots a self-introduction video on the profile creation screen and presses the upload button. The device sends the video data to the server.

[1674] Step 7:

[1675] The server receives the detailed profile information and video data and stores them in a database. The server verifies the profile information and completes the registration if it is correct.

[1676] Step 8:

[1677] The server provides all user profiles to the AI ​​engine, which analyzes the profile information and learns the characteristics of each user.

[1678] Step 9:

[1679] The server uses an emotion engine to analyze the uploaded video data and determine the user's emotional state (happiness, sadness, anger, etc.), and then integrates the emotion data with the profile information.

[1680] Step 10:

[1681] The server runs AI to search for the best partner based on each user's preferences, desires, and emotional state. The AI ​​then applies a matching algorithm to evaluate and suggest compatible partners.

[1682] Step 11:

[1683] The server notifies the user of the matching results, and the device displays the matching results and the other person's profile information and emotional state to the user.

[1684] Step 12:

[1685] After a match is made, the user can use the app's messaging function to send a message to the other person. A message input screen will appear.

[1686] Step 13:

[1687] The server launches an AI chatbot that generates appropriate conversation starter suggestions and advice based on the user's profile information, emotional data, and past conversation history.

[1688] Step 14:

[1689] The device receives the chatbot's suggestions and displays them to the user, who then sends a message based on the suggestions.

[1690] Step 15:

[1691] The server uses facial recognition technology to verify that the user is logging in from a new device. The device takes a picture of the user's face with its camera and sends the image to the server.

[1692] Step 16:

[1693] The server compares the facial image with existing data, and if authentication is successful, allows the user to log in. The authentication result is notified to the terminal.

[1694] Step 17:

[1695] The server provides a dashboard for matchmaking agencies, which agency staff access and manage user data.

[1696] Step 18:

[1697] The server updates the dashboard in real time, displaying users' progress and matching results, and agency staff use data analysis tools to develop suggestions for improving the service.

[1698] This process allows users to find the perfect partner efficiently and safely, and enables matchmaking agencies to provide effective services. The introduction of an emotion engine enables matching based on the user's emotional state, enabling more accurate and personalized services to be provided.

[1699] Example 2

[1700] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1701] In online matchmaking services, the process of users creating detailed profiles and finding a suitable partner is crucial. However, conventional systems only match users based on profile information without considering their emotional state, making it difficult for users to find the perfect match. Furthermore, communication support and security measures were insufficient, resulting in an unsatisfactory matchmaking experience for users.

[1702] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for creating detailed profile information for the user; means for using artificial intelligence to suggest a suitable partner based on the profile information; means for uploading a self-introduction video; means for supporting communication using an AI chatbot; means for verifying the user's identity using facial recognition technology to enhance security; means for extracting emotional data from the detailed profile information and the self-introduction video using an emotion engine that recognizes and analyzes the user's emotional state; means for suggesting a suitable partner based on the emotional data for the user's current emotional state; and means for providing a dashboard for matchmaking service providers and displaying and managing user profile information and matching progress in real time. This enables precise matching based on the user's emotional state, providing a safe and efficient online matchmaking experience.

[1703] "User" refers to an individual who participates in the online matchmaking service using the System.

[1704] "Detailed profile information" refers to information entered by the user, such as age, gender, occupation, hobbies, and ideal partner criteria.

[1705] "Artificial intelligence" refers to algorithms and technologies that analyze users' profile information, learn their preferences and needs, and suggest the most suitable partner.

[1706] "Self-Introduction Video" refers to a video file uploaded by a User to the System to introduce themselves.

[1707] An "AI chatbot" is a program that uses artificial intelligence to automatically provide appropriate conversation starters and advice to support communication between users.

[1708] "Facial recognition technology" refers to technology that analyzes a user's facial image to verify their identity.

[1709] "Emotion engine" refers to technology that extracts emotional data from users' self-introduction videos and message content, and recognizes and analyzes their emotional state.

[1710] "Emotion data" refers to data that indicates emotional states such as joy, sadness, and tension obtained from users' videos and messages extracted by the emotion engine.

[1711] "Dashboard" refers to the interface through which matchmaking service providers can view and manage user profile information, matching progress, and other important metrics in real time.

[1712] A "matching algorithm" refers to a calculation method for suggesting the most suitable partner based on a user's profile information and emotional data.

[1713] "Upload" refers to the act of a user sending and storing a self-introduction video or other data into the system.

[1714] The system of this invention incorporates an emotion engine into an online matchmaking service, recognizing and analyzing the user's emotional state to provide more precise matching and communication support. Users create detailed profiles and upload self-introduction videos, and advanced matching is performed using artificial intelligence (AI) and the emotion engine. In addition, an AI chatbot suggests optimal communication based on the user's emotional state, and facial recognition technology is used to enhance security.

[1715] Profile Creation and Management

[1716] After downloading and installing the app, users create an account by entering their name, email address, and password. After registering, users enter detailed profile information such as age, gender, occupation, hobbies, and ideal partner characteristics, and then film and upload a self-introduction video.

[1717] The server receives the detailed profile information and self-introduction video entered by the user, stores them in a database, and verifies the user's basic information and detailed profile information to complete the account registration.

[1718] AI-based matching

[1719] The server provides all user profiles to the AI ​​engine, which analyzes the user's detailed profile information and self-introduction video to learn about individual preferences and needs. Based on this learning, the AI ​​runs a matching algorithm to suggest the best possible match.

[1720] Example: For example, if User A enters in their profile that they are an outdoor enthusiast and would like a partner with the same hobbies, the AI ​​will search for User B, another user with the same hobbies, calculate the degree of match, and make suggestions.

[1721] Emotion recognition by emotion engine

[1722] The server uses an emotion engine to extract emotion data from the user's uploaded self-introduction video and message content, such as determining what emotions the user expresses in the video and whether the tone of the message is positive or negative.

[1723] Matching based on emotion data

[1724] The server combines and analyzes the emotional data and the user's profile information to suggest a partner that best suits the user's current emotional state, allowing the user to find a partner who is a better emotional fit according to their emotional state.

[1725] Example: For example, if the emotion engine determines that User A is "happily talking about the outdoors" in their self-introduction video, it will prioritize matching with User B, who also displays positive emotions.

[1726] Communication support with AI chatbots

[1727] The server uses an AI chatbot to assist with communication, which uses user profile information and emotional data to suggest conversation starters and provide appropriate communication advice.

[1728] Example: For example, when User A sends their first message to User B, the AI ​​chatbot might suggest, "Hi, I see you also love the outdoors. Are there any hiking trails you've been on recently that you'd recommend?"

[1729] Enhanced security with facial recognition technology

[1730] When a user logs in from a new device, the device's camera is used to take a picture of their face and send the image to the server, which then compares the received face image with an existing face database and allows the user to log in if authentication is successful.

[1731] Example: For example, when user A tries to log in from a new smartphone, the device requests facial authentication. User A takes a picture of his / her face with the camera and sends it to the server. The server verifies the image, and if authentication is successful, the login is permitted.

[1732] Data management tool for matchmaking agencies

[1733] The server provides matchmaking agencies with a dedicated dashboard, allowing agency staff to efficiently manage user data. The dashboard displays users' profile information, matching progress, and other important metrics in real time.

[1734] Example: Staff at a matchmaking agency can access the dashboard to check the matching progress between User C and User D, and understand the success rate and communication status in real time. They can also use data analysis tools to analyze the matching success rate of user groups that meet specific criteria.

[1735] The above configuration allows users to find the perfect partner efficiently and safely, and enables matchmaking service providers to improve the quality of their services. The introduction of an emotion engine enables matching based on the user's emotional state, making it possible to provide more accurate and personalized services.

[1736] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1737] Step 1:

[1738] The user downloads and installs the app. After installation, the user launches the app and presses the "New Registration" button. They enter their name, email address, and password, and press the "Submit" button. The entered information is sent to the server.

[1739] The server stores the received user information in a database and sends a confirmation link to the user's email address, which the user clicks to activate the account.

[1740] Input: Name, Email Address, Password

[1741] Output: Account creation completed and confirmation email sent

[1742] Step 2:

[1743] After logging in, users enter detailed profile information (age, gender, occupation, hobbies, ideal partner conditions, etc.). They then use the app's camera function to shoot a self-introduction video. After shooting the video, they preview it and, if there are no problems, press the "Upload" button.

[1744] The server receives the detailed profile information and self-introduction video entered by the user, stores them in a database, verifies the profile information, and completes the registration.

[1745] Input: Detailed profile information, introduction video

[1746] Output: Information saved to database and profile registration completed

[1747] Step 3:

[1748] The server provides all user profiles and self-introduction videos to the AI ​​engine, which analyzes the users' detailed profile information and videos to learn their individual preferences and needs. Based on this learning, it runs a matching algorithm to suggest the best possible match.

[1749] Input: All user profiles, introduction videos

[1750] Output: Suggestion based on the learning results

[1751] Specific behavior:

[1752] The server sends the profile information and self-introduction video to the AI ​​engine.

[1753] The AI ​​engine analyzes the input data and learns the user's hobbies and preferences.

[1754] The AI ​​engine runs the optimal matching algorithm based on the learning results and identifies the partner.

[1755] Step 4:

[1756] The server uses an emotion engine to extract emotion data from the self-introduction videos and message content uploaded by users, such as determining what emotions users express in the videos and whether the tone of their messages is positive or negative.

[1757] Input: Self-introduction video, message content

[1758] Output: Extracted emotion data

[1759] Specific behavior:

[1760] The server sends the video and text data to the emotion engine.

[1761] The emotion engine analyzes facial expressions, tone of voice, and spoken content in the video to extract emotional data.

[1762] The server stores the extracted emotion data.

[1763] Step 5:

[1764] The server combines and analyzes the emotional data and the user's profile information to suggest a partner who is best suited to the user's current emotional state, allowing the user to find a partner who is a better emotional fit based on the user's emotional state.

[1765] Input: Emotion data, detailed profile information

[1766] Output: Suggested partners based on emotional state

[1767] Specific behavior:

[1768] The server combines the profile information with the emotion data and runs a matching algorithm.

[1769] The matching algorithm takes emotional data into account to identify the best match for the user.

[1770] The server notifies the user of the matching results.

[1771] Step 6:

[1772] The server uses an AI chatbot to assist communication, which provides conversation starter suggestions and appropriate communication advice based on the user's profile information and emotional data.

[1773] Input: Profile information, emotion data

[1774] Output: Conversation starter suggestions, communication advice

[1775] Specific behavior:

[1776] The server provides profile information and emotional data to the AI ​​chatbot.

[1777] AI chatbots generate conversation starters and advice.

[1778] For example, when User A sends their first message to User B, the AI ​​chatbot will make a suggestion such as, "Hi, I see you also love the outdoors. Are there any hiking trails you've been on recently that you'd recommend?"

[1779] Step 7:

[1780] When a user logs in from a new device, the device's camera is used to take a picture of their face and send the image to the server, which then compares the received face image with an existing face database and allows the user to log in if authentication is successful.

[1781] Input: Face image

[1782] Output: Login authentication result

[1783] Specific behavior:

[1784] The device will launch the camera at the start of a new login session.

[1785] The user takes a picture of their face using a camera and sends it to the server.

[1786] The server compares the received facial image with existing facial data in a database.

[1787] If authentication is successful, the user is allowed to log in.

[1788] Step 8:

[1789] The server provides matchmaking agencies with a dedicated dashboard, allowing agency staff to efficiently manage user data. The dashboard displays users' profile information, matching progress, and other important metrics in real time.

[1790] Input: User data

[1791] Output: Real-time data display on a dashboard

[1792] Specific behavior:

[1793] The matchmaking agency staff member opens a browser and logs in to a dedicated dashboard.

[1794] The server displays user profile information, matching progress, and other metrics in real time.

[1795] Staff can use the dashboard to efficiently manage user data and provide the best matching support.

[1796] (Application example 2)

[1797] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1798] In modern society, online matchmaking is becoming increasingly common, but it is difficult to accurately assess compatibility and emotional fit between users. Another issue is the lack of a system that analyzes emotions in real time and provides communication support based on that analysis. Furthermore, security in online environments is a critical issue, and it is necessary to reduce the risk of impersonation and unauthorized access.

[1799] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for allowing a user to create detailed profile information and using artificial intelligence to suggest a suitable partner based on the profile information, a means for the user to upload a self-introduction video, a means for using an AI chatbot to provide communication support, a means for verifying the user's identity using facial recognition technology to enhance security, a means including an emotion engine for analyzing emotions in real time in a virtual space, and a means for providing communication support prompts using a generative AI model. This enables precise and personalized matching based on the user's emotional state, making it possible to provide a safe and effective online matchmaking service.

[1800] "Detailed profile information" refers to individual information provided by a user, including basic information about themselves, hobbies, ideal partner criteria, etc.

[1801] "Artificial intelligence" refers to technology that analyzes a user's profile information and emotional data to suggest the most suitable partner.

[1802] A "self-introduction video" refers to a video that a user films and uploads to introduce their characteristics, hobbies, and other information.

[1803] An "AI chatbot" is an artificial intelligence that provides appropriate communication advice and conversation suggestions based on a user's profile information and emotional data.

[1804] "Facial recognition technology" refers to technology that analyzes a user's facial image to verify their identity and enhance security.

[1805] The "emotion engine" refers to an engine that extracts emotional data from the self-introduction videos and message content uploaded by users and analyzes their emotional state in real time.

[1806] "Generative AI model" refers to an artificial intelligence model that generates communication assistance prompts and other suggestions based on a user's profile information and emotional data.

[1807] "Virtual space" refers to a virtual online environment constructed using digital technology.

[1808] This invention realizes a system that recognizes and analyzes the emotional state of users in online matchmaking services, and provides more precise matching and communication support.

[1809] Program Description

[1810] This system is implemented by an application installed on a smartphone, smart glasses, or a head-mounted display. The main processes are explained below.

[1811] Create and store detailed profile information

[1812] Users download the application and create an account. They then enter detailed profile information, such as their name, age, gender, hobbies, and ideal partner criteria. This data is sent to a server and stored in a database. This allows a profile to be built that reflects the user's personality and preferences.

[1813] Upload your introduction video

[1814] Users film a self-introduction video and upload it to the server via the application. The server stores the video in a database and makes it available for other users to view. The uploaded video is analyzed by an emotion engine to extract the user's emotional state.

[1815] Communication support with AI chatbots

[1816] The server uses an AI chatbot to suggest appropriate communication based on the user's detailed profile information and emotional data. For example, when a user sends a message to another user, the AI ​​chatbot can provide conversation starters and topic suggestions.

[1817] Enhanced security with facial recognition technology

[1818] When a user logs in from a new device, the device's camera is used to take a picture of their face and send the image to the server. The server compares the received facial image with an existing face database and allows the user to log in if authentication is successful. This prevents unauthorized access and strengthens security.

[1819] Real-time sentiment analysis with emotion engine

[1820] At virtual matchmaking events, the emotion engine analyzes users' real-time emotional state, extracting emotions from the video and audio data of their self-introduction videos, and then suggests the most suitable partner based on that data.

[1821] Prompts provided using generative AI models

[1822] The generative AI model analyzes user profile information and emotional data to generate communication-assistance prompts, allowing users to maintain natural conversations.

[1823] Specific examples

[1824] User: Alice

[1825] Age: 30

[1826] Hobbies: Outdoors

[1827] Introduction video: intro_video_alice.mp4

[1828] Emotion: Positive

[1829] Example prompt sentence:

[1830] Please provide details for User A:

[1831] Name: Alice

[1832] Age: 30

[1833] Hobbies: Outdoors

[1834] Emotional state: Positive

[1835] Suggest her a suitable partner profile, taking into account emotional data and hobbies.

[1836] User: Bob

[1837] Age: 32

[1838] Hobbies: Outdoors

[1839] Introduction video: intro_video_bob.mp4

[1840] Emotion: Positive

[1841] Example prompt sentence:

[1842] Please provide details for User B:

[1843] Name: Bob

[1844] Age: 32

[1845] Hobbies: Outdoors

[1846] Emotional state: Positive

[1847] Suggest him a suitable partner profile, taking into account emotional data and hobbies.

[1848] This system allows users to receive highly accurate matching based on their emotional state and natural communication support, while facial recognition technology provides enhanced security for safe use of the service.

[1849] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1850] Step 1:

[1851] A user downloads the application and creates an account.

[1852] Input: Name, Email Address, Password

[1853] Output: Save account information

[1854] Specific operation: The terminal enters basic information such as the user's name, email address, and password into an input form. The server receives this information and stores it in a database.

[1855] Step 2:

[1856] The user enters detailed profile information.

[1857] Input: Age, gender, hobbies, ideal partner conditions

[1858] Output: Save detailed profile information

[1859] How it works: The user enters detailed profile information such as age, gender, hobbies, and ideal partner characteristics into an input form on the device. The server receives this information and stores it in a database.

[1860] Step 3:

[1861] Users film and upload their own self-introduction videos.

[1862] Input: Self-introduction video file

[1863] Output: Save video and extract emotion data

[1864] Specific operation: The device shoots a self-introduction video and uploads the file to the server. The server receives the video file and stores it in a database. At the same time, the emotion engine analyzes the video file and extracts emotion data.

[1865] Step 4:

[1866] The server suggests the best partner based on the emotional data.

[1867] Input: detailed profile information, emotional data

[1868] Output: Matching list

[1869] How it works: The server uses AI to analyze the detailed profile information and emotional data stored. The AI ​​then searches for suitable partners based on the user's preferences and emotional data, and generates a match list.

[1870] Step 5:

[1871] The AI ​​chatbot generates suggested messages for the user.

[1872] Input: User profile information, emotion data, match list

[1873] Output: Proposal message

[1874] Specific operation: The server uses a generative AI model to create prompts based on the user's profile information, emotional data, and matching list, thereby providing appropriate conversation suggestions to the user.

[1875] Step 6:

[1876] Uses facial recognition technology to verify user identity.

[1877] Input: Face image

[1878] Output: Authentication result

[1879] Specific operation: When a user attempts to log in from a new device, the device takes a facial image and sends it to the server. The server compares the received facial image with an existing facial database and allows login if authentication is successful.

[1880] Step 7:

[1881] A user starts chatting in a virtual space.

[1882] Input: Proposal message, user input message

[1883] Output: Generates a chat message

[1884] Specific operation: When a user enters a chat room, the device receives suggested messages from the server. When the user enters a message and sends it to the server, the AI ​​chatbot generates a corresponding reply message and sends it to the user.

[1885] Through these specific processing steps, users can enjoy highly accurate matching based on their emotional state and natural communication support. Furthermore, enhanced security using facial recognition technology allows users to use the service safely.

[1886] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1887] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1888] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1889] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1890] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1891] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1892] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1893] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1894] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1895] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1896] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1897] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1898] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1899] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1900] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1901] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1902] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1903] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1904] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1905] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1906] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1907] The following is further disclosed regarding the above embodiment.

[1908] (Claim 1)

[1909] Users create detailed profile information,

[1910] A means for suggesting the most suitable partner based on the profile information using artificial intelligence;

[1911] A means for users to upload a self-introduction video;

[1912] A means of using AI chatbots to assist with communication, and

[1913] A means of verifying user identity using facial recognition technology to enhance security;

[1914] A system including:

[1915] (Claim 2)

[1916] a means of storing detailed user profile information;

[1917] A means of analyzing profile information using artificial intelligence to learn individual preferences and needs;

[1918] A means for proposing the most suitable partner based on the learning results;

[1919] 10. The system of claim 1, comprising:

[1920] (Claim 3)

[1921] A means for accepting a user's operation to upload a self-introduction video;

[1922] A means to store uploaded videos and display them to other users;

[1923] 10. The system of claim 1, comprising:

[1924] "Example 1"

[1925] (Claim 1)

[1926] a means for users to create detailed profile information;

[1927] A means for suggesting the most suitable partner based on the profile information using artificial intelligence;

[1928] A means for users to upload a self-introduction video;

[1929] A means of using AI chatbots to assist with communication, and

[1930] A means of verifying user identity using facial recognition technology to enhance security;

[1931] a means for storing user profiles in a database;

[1932] A means to activate an AI chatbot when a match is made, and

[1933] A means to provide a dashboard for matchmaking agency staff to manage user data;

[1934] A system including:

[1935] (Claim 2)

[1936] a means of storing detailed user profile information;

[1937] A means of analyzing profile information using artificial intelligence to learn individual preferences and needs;

[1938] A means for proposing the most suitable partner based on the learning results;

[1939] 10. The system of claim 1, comprising:

[1940] (Claim 3)

[1941] A means for accepting a user's operation to upload a self-introduction video;

[1942] A means to store uploaded videos and display them to other users;

[1943] When a match is made, an AI chatbot will be activated to suggest conversation starters.

[1944] 10. The system of claim 1, comprising:

[1945] "Application Example 1"

[1946] (Claim 1)

[1947] Users create detailed profile information,

[1948] A means for suggesting the most suitable partner based on the profile information using artificial intelligence;

[1949] A means for users to upload a self-introduction video;

[1950] A means of using AI chatbots to assist with communication, and

[1951] A means of verifying user identity using facial recognition technology to enhance security;

[1952] A means to suggest optimal video content based on user profile information and viewing history,

[1953] How AI chatbots can provide viewing support,

[1954] A system including:

[1955] (Claim 2)

[1956] a means of storing detailed user profile information;

[1957] A means of analyzing profile information using artificial intelligence to learn individual preferences and needs;

[1958] A means for proposing the most suitable partner based on the learning results;

[1959] A means to analyze viewing history and suggest optimal video content,

[1960] 10. The system of claim 1, comprising:

[1961] (Claim 3)

[1962] A means for accepting a user's operation to upload a self-introduction video;

[1963] A means to store uploaded videos and display them to other users;

[1964] A means to strengthen security by authenticating users' faces,

[1965] 10. The system of claim 1, comprising:

[1966] "Example 2: Combining Emotion Engines"

[1967] (Claim 1)

[1968] Users create detailed profile information,

[1969] A means for suggesting the most suitable partner based on the profile information using artificial intelligence;

[1970] A means for users to upload a self-introduction video;

[1971] A means of using AI chatbots to assist with communication, and

[1972] A means of verifying user identity using facial recognition technology to enhance security;

[1973] means for extracting emotional data from the detailed profile information and self-introduction video using an emotion engine that recognizes and analyzes the user's emotional state;

[1974] A means to suggest the partner who is most suitable for the user's current emotional state based on emotional data;

[1975] Provides a dashboard for matchmaking service providers to display and manage user profile information and matching progress in real time,

[1976] A system including:

[1977] (Claim 2)

[1978] a means of storing detailed user profile information;

[1979] A means of analyzing profile information using artificial intelligence to learn individual preferences and needs;

[1980] A means for proposing the most suitable partner based on the learning results;

[1981] A means for extracting emotional data from the self-introduction video and message content using an emotion engine and analyzing the emotional state of the user;

[1982] 10. The system of claim 1, comprising:

[1983] (Claim 3)

[1984] A means for accepting a user's operation to upload a self-introduction video;

[1985] A means to store uploaded videos and display them to other users;

[1986] means for extracting sentiment data from uploaded videos and profiles;

[1987] 10. The system of claim 1, comprising:

[1988] "Application example 2 when combining emotion engines"

[1989] (Claim 1)

[1990] Users create detailed profile information,

[1991] A means for suggesting the most suitable partner based on the profile information using artificial intelligence;

[1992] A means for users to upload a self-introduction video;

[1993] A means of using AI chatbots to assist with communication, and

[1994] A means of verifying user identity using facial recognition technology to enhance security;

[1995] a means including an emotion engine for analyzing emotions in real time in a virtual space;

[1996] A means for providing communication support prompts using a generative AI model;

[1997] A system including:

[1998] (Claim 2)

[1999] a means of storing detailed user profile information;

[2000] A means of analyzing profile information using artificial intelligence to learn individual preferences and needs;

[2001] A means for proposing the most suitable partner based on the learning results;

[2002] A means of providing feedback on the most suitable partner based on the results of real-time sentiment analysis,

[2003] 10. The system of claim 1, comprising:

[2004] (Claim 3)

[2005] A means for accepting a user's operation to upload a self-introduction video;

[2006] A means to store uploaded videos and display them to other users;

[2007] a means for providing prompt responses using a generative AI model; and

[2008] 10. The system of claim 1, comprising: [Explanation of symbols]

[2009] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. Users create detailed profile information, A means for suggesting the most suitable partner based on the profile information using artificial intelligence; A means for users to upload a self-introduction video; A means of using AI chatbots to assist with communication, and A means of verifying user identity using facial recognition technology to enhance security; A system including:

2. a means of storing detailed user profile information; A means of analyzing profile information using artificial intelligence to learn individual preferences and needs; A means for proposing the most suitable partner based on the learning results; The system of claim 1 , comprising:

3. A means for accepting a user's operation to upload a self-introduction video; A means to store uploaded videos and display them to other users; The system of claim 1 , comprising:

Images