System

Abstract

A system is provided.SOLUTION: A system includes user input means, avatar generation means for generating an avatar on the basis of generation information, virtual conversation generation means for allowing avatars to have a conversation with each other, simulation generation means for performing a simulation of a future child on the basis of profile information of a user, proposal means for proposing a date place or a common hobby based on hobbies and preferences of the user, congeniality determination means for determining congeniality on the basis of conversation content, a simulation result, and the like, and display means for displaying them.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Current matchmaking services rely on static criteria such as appearance and income, making it difficult to accurately assess the true compatibility between users. This results in many mismatches after actual meetings, reducing user satisfaction. Another problem is that compatibility assessments are limited to romance and marriage, and do not take into account compatibility in work or life in general. To solve these issues, a system is needed that uses generative AI technology to provide more accurate compatibility assessments based on detailed user profile information. [Means for solving the problem]

[0005] To solve the above problems, the present invention provides the following means: A user input means is provided, through which the user inputs detailed profile information. Next, an avatar generation means is provided that generates an avatar based on the generation information, and a virtual avatar is generated by analyzing the user's hobbies and preferences. A virtual conversation generation means is also provided, through which the avatars converse with each other, and a virtual matchmaking session is conducted. Furthermore, a simulation generation means is provided that simulates future children based on the user's profile information. A suggestion means is provided that suggests date locations and common hobbies based on the user's hobbies and preferences, and the suggestion means suggests date locations and hobbies. Finally, a compatibility assessment means is provided that assesses compatibility based on the content of the conversation and the simulation results, and these results are provided to the user through a display means. As a result, a system is realized that can scientifically assess compatibility not only in romance and marriage, but also in work and life in general.

[0006] "User input means" refers to a means by which a user inputs detailed profile information such as their name, age, gender, hobbies, preferences, and future goals into the system.

[0007] "Generation information" is information that the generation AI analyzes based on the user's detailed profile information and is necessary to generate an avatar.

[0008] The "avatar generation means" is a means for generating a virtual avatar by analyzing the user's hobbies and preferences based on the generation information.

[0009] The "virtual conversation generation means" is a means for starting a virtual matchmaking session in which the generated avatars converse with each other, and generating the content of the conversation in real time.

[0010] The "simulation generation means" is a means for simulating the characteristics of a future child based on the user's profile information.

[0011] The "suggestion means" is a means for suggesting the best date spot or common hobbies based on the user's hobbies and preferences.

[0012] The "compatibility determination means" is a means for determining the compatibility between users based on the content of the virtual conversation, the simulation results, and the generated information.

[0013] The "display means" is a means for displaying generated information, simulation results, proposals, compatibility assessment results, etc. to the user. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0022] [First embodiment]

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0035] The present invention is a system that generates an avatar based on detailed user profile information and determines compatibility through virtual matchmaking. The system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility determination means, and a display means.

[0036] System construction details

[0037] To implement this system, a server, a device, and a user are required. The server uses generative AI to analyze the user's profile information, generate avatars, generate virtual conversations, assess compatibility, suggest date locations, and perform simulations. The device receives input from the user, communicates with the server, and displays the information.

[0038] What the program does

[0039] User Registration

[0040] The user accesses the system and selects new registration on the login screen. The terminal displays a registration form and asks for information such as name, age, gender, hobbies, preferences, and future goals. When the user enters the required information and presses the submit button, the terminal sends the input data to the server.

[0041] Profile analysis and avatar generation

[0042] The server stores the received user information in a database. The server then invokes the generation AI to analyze the user's characteristics. The generation AI extracts multidimensional features from the user's profile data and generates a virtual avatar. The server then stores the generated avatar information in a database.

[0043] Virtual matchmaking

[0044] The server searches for compatible pairs among registered users and calculates similarity using feature vectors. The server then generates pairs of users with high similarity and saves their information. The server then sets the date and time of the virtual matchmaking and sends that information to the target user's device. The device then notifies the user of the date and time of the matchmaking.

[0045] Virtual matchmaking

[0046] When a user logs in to the system at the specified time, the device starts a virtual matchmaking session. The server calls a generation AI to generate a conversation between avatars in real time. The generation AI generates a conversation between avatars based on the conversation content and simulation results. The device displays the conversation content to the user and updates it in real time.

[0047] Future Baby Simulator

[0048] During the matchmaking process, the server simulates the future child based on the profiles of both parties. The generation AI predicts the characteristics of the future child based on the genetic profiles and common characteristics of both parties. The server sends the simulation results to the device, which then displays the simulation results of the future child to the user.

[0049] Suggestions for date locations and common hobbies

[0050] The AI ​​analyzes the user's hobbies and preferences and selects the best date location. The server generates a list of potential date locations and common hobbies and sends it to the device. The device then displays the list of potential date locations and common hobbies to the user.

[0051] Compatibility assessment and feedback

[0052] Once the session is over, the server analyzes the content of the virtual matchmaking session and evaluates compatibility. The AI ​​calculates a compatibility score that comprehensively takes into account the content of the conversation, common hobbies, future simulations, etc. The server generates feedback along with the compatibility score and sends it to the device. The device then provides the compatibility score and feedback to the user.

[0053] Specific examples

[0054] 1. User Registration

[0055] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his or her hobbies.

[0056] User B logs in in the same way and enters "listening to music" and "tennis" as his hobbies.

[0057] 2. Profile Analysis

[0058] The server stores information about users A and B, analyzes it using a generation AI, and generates avatars for each.

[0059] User A's avatar is holding a movie reel, and User B's avatar is holding a tennis racket.

[0060] 3. Virtual matchmaking

[0061] The server finds user C, who shares the same hobby of watching movies, and sets a date and time for a matchmaking meeting between user A and user C and notifies them.

[0062] 4. Virtual matchmaking

[0063] User A and User C log in at the specified time. Their avatars talk about "movies they've recently seen" in the virtual space.

[0064] 5. Future Baby Simulation

[0065] During the conversation, the server simulates the future children of user A and user C, displaying the characteristics of children who share the common skills of sports and watching movies.

[0066] 6. Suggesting date spots and common hobbies

[0067] The generative AI suggests movie theaters and cooking classes and displays them on the device.

[0068] 7. Compatibility assessment and feedback

[0069] After the session ends, the server calculates a compatibility score based on the conversation content and simulation results, and provides feedback to User A and User C: "Compatibility score: 85%."

[0070] The above is a specific embodiment of the present invention.

[0071] The processing flow will be explained below.

[0072] Step 1: User Registration

[0073] 1.1 The user accesses the system and enters personal information on the new registration screen.

[0074] 1.2 The device displays an input form and asks the user to enter their name, age, gender, hobbies, preferences, future goals, etc.

[0075] 1.3 The user enters the required information and presses the send button.

[0076] 1.4 The terminal sends the entered data to the server.

[0077] Step 2: Profile analysis and avatar generation

[0078] 2.1 The server stores the received user information in a database.

[0079] 2.2 The server calls the generation AI and analyzes the user's profile information.

[0080] 2.3 Generative AI extracts features from information such as the user's hobbies and preferences and generates a virtual avatar.

[0081] 2.4 The server stores the generated avatar information in a database.

[0082] Step 3: Set up a virtual matchmaking session

[0083] 3.1 The server calculates the similarity based on the feature vectors to find compatible pairs among the registered users.

[0084] 3.2 The server generates pairs of users with high similarity and stores their information.

[0085] 3.3 The server will set the date and time of the virtual matchmaking and send that information to the target user's device.

[0086] 3.4 The device will notify the user of the date and time of the matchmaking.

[0087] Step 4: Conduct a virtual matchmaking session

[0088] 4.1 The user logs into the system at the designated time.

[0089] 4.2 The device will start the virtual matchmaking session.

[0090] 4.3 The server calls the generation AI to generate conversations between avatars in real time.

[0091] 4.4 The generation AI generates conversation content and conducts dialogue between avatars.

[0092] 4.5 The device displays the generated conversation content to the user in real time.

[0093] Step 5: Simulating the future baby

[0094] 5.1 During the virtual matchmaking session, the server will simulate the future children based on the profiles of both parties.

[0095] 5.2 Generative AI predicts the characteristics of future children based on the genetic profiles and common characteristics of both parents.

[0096] 5.3 The server sends the simulation results to the terminal.

[0097] 5.4 The device displays the simulation results of the future child to the user.

[0098] Step 6: Suggesting date locations and common hobbies

[0099] 6.1 The generating AI analyzes the user's hobbies and preferences and selects the best date location and common hobbies.

[0100] 6.2 The server generates a list of possible date locations and common interests and sends it to the device.

[0101] 6.3 The device will display a list of possible locations for dates and common interests to the user.

[0102] Step 7: Compatibility assessment and feedback

[0103] 7.1 The server will analyze the content of the virtual matchmaking session and evaluate compatibility.

[0104] 7.2 The generation AI calculates a compatibility score by comprehensively taking into account the content of the conversation, common hobbies, future simulations, etc.

[0105] 7.3 The server generates a compatibility score and feedback and sends it to the device.

[0106] 7.4 The device will provide users with compatibility scores and feedback.

[0107] Example 1

[0108] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0109] Conventional online matchmaking systems generate avatars based on detailed user profile information, and when conducting virtual conversations, the judgement of compatibility is unclear. Furthermore, they lack additional features such as the ability to select a date location or simulate future children, making it difficult to improve the user experience.

[0110] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0111] In this invention, the server includes an avatar generation means for generating an avatar based on the generation information, a simulation generation means for simulating future children based on the user's profile information, and a suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences, thereby enabling precise avatar generation based on the user's detailed profile, a simulation of future children, and suggestions for optimal date locations.

[0112] "User input means" refers to the interface through which users input personal information, hobbies, and preferences into the system.

[0113] The "avatar generation means for generating an avatar based on generation information" is a system element that analyzes multidimensional features based on user input information and generates a virtual avatar.

[0114] The "virtual conversation generation means" is a function that generates conversation content in real time when the generated avatars converse with each other.

[0115] The "simulation generation means for simulating future children based on the user's profile information" is a function that analyzes the user's genetic information and profile and predicts the characteristics and special skills of the child that will be born in the future.

[0116] "A suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences" is a function that analyzes the user's hobbies and preferences and suggests the most suitable date locations and common hobbies.

[0117] The "compatibility determination means for determining compatibility based on the content of conversations and simulation results" is a function that analyzes the content of conversations between avatars and the results of simulations, and quantifies and determines the compatibility between users.

[0118] "Display means" refers to an interface that visually displays information and suggestions generated by the system to the user.

[0119] The "date and time setting means for setting and notifying the date and time of the matchmaking" is a function for setting the date and time of the virtual matchmaking and notifying the user of that information.

[0120] The present invention is a system that generates an avatar based on detailed user profile information and determines compatibility through virtual matchmaking. The system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility determination means, a display means, and a date and time setting means for setting and notifying the date and time of the matchmaking.

[0121] System construction details

[0122] To implement this system, a server, a terminal, and a user are required. Specifically, the following hardware and software are used:

[0123] 1. Server: Analyzes user profile information using generation AI, generates avatars, generates virtual conversations, assesses compatibility, suggests date locations, and simulates children.

[0124] 2. Terminal: Receives input from the user, communicates with the server, and displays information. To perform these operations, the terminal accesses the system via a web browser or mobile application.

[0125] 3. User: Access the system, enter profile information, and participate in virtual matchmaking.

[0126] Details of what the program does

[0127] User Registration

[0128] The user accesses the system and selects new registration. The terminal displays a registration form, and the user enters information such as name, age, gender, hobbies, preferences, and future goals. The entered information is sent from the terminal to the server, where it is stored in a database.

[0129] Profile analysis and avatar generation

[0130] The server then calls the generation AI based on the received user information to analyze the user's characteristics. The generation AI extracts multidimensional features and generates a virtual avatar based on the user's hobbies and preferences. The generated avatar information is then stored in a database.

[0131] Setting up a virtual matchmaking session

[0132] The server selects users with many common hobbies and preferences from among multiple registered users, calculates similarities using feature vectors, creates pairs of users with many common interests, sets a date and time for a virtual matchmaking session, and notifies the target users' devices.

[0133] Virtual matchmaking

[0134] The user logs in to the system at a specified time, and the device starts a virtual matchmaking session. The server calls the generation AI to generate a conversation between the avatars in real time. The conversation content is periodically sent to the device and displayed to the user in real time.

[0135] Future Baby Simulator

[0136] During the conversation, the server simulates the future child based on the user's profile information. The generation AI analyzes the user's genetic information and predicts the child's characteristics and special skills. The simulation results are sent to the user's device and displayed to the user.

[0137] Suggestions for date locations and common hobbies

[0138] The AI ​​analyzes the user's hobbies and preferences to suggest the best date locations and shared hobbies. The server generates a list of suggested locations and sends it to the device. The device then displays the list of potential locations for dates and shared hobbies to the user.

[0139] Compatibility assessment and feedback

[0140] Once the session is over, the server uses the generative AI to analyze the conversation and simulation results and calculate a compatibility score, which is then sent to the device and displayed to the user.

[0141] Specific examples

[0142] User Registration:

[0143] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his hobbies. User B also logs in and enters "listening to music" and "tennis" as his hobbies.

[0144] Profile Analysis:

[0145] The server stores information about users A and B, and uses the AI ​​to generate avatars for each user. User A's avatar holds a film reel, and user B's avatar holds a tennis racket.

[0146] Virtual Matchmaking:

[0147] The server finds user C, who shares the same hobby of watching movies, and sets a date and time for a matchmaking meeting between user A and user C and notifies them.

[0148] Conducting virtual matchmaking:

[0149] User A and User C log in at the specified time. Their avatars talk about "movies they've recently seen" in the virtual space.

[0150] Future Baby Simulator:

[0151] During the conversation, the server simulates the future children of User A and User C. It displays the characteristics of children who share common skills of sports and watching movies.

[0152] Suggestions for date locations and common interests:

[0153] The generative AI suggests movie theaters and cooking classes and displays them on the device.

[0154] Compatibility assessment and feedback:

[0155] After the session ends, the server calculates a compatibility score based on the conversation content and simulation results, and provides feedback to User A and User C: "Compatibility score: 85%."

[0156] Example prompts: "User A: My hobbies are watching movies and cooking." "User B: My hobbies are listening to music and playing tennis." "User C: My hobbies are watching movies."

[0157] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0158] Step 1: User Registration

[0159] User: Accesses the system and selects new registration. Enters information such as name, age, gender, hobbies, preferences, and future goals.

[0160] Input: User profile information (name, age, gender, hobbies, preferences, future goals, etc.).

[0161] Output: The terminal sends the entered information to the server.

[0162] Terminal: Displays a registration form containing various data fields. When the user enters information and presses the submit button, the form data is sent to the server.

[0163] Specific actions: For example, a user enters "watching movies" and "cooking" as hobbies in a form and clicks the submit button.

[0164] Input: User-entered form data.

[0165] Output: The raw user data sent to the server.

[0166] Step 2: Profile analysis and avatar generation

[0167] Server: Stores the received user information in a database, then invokes the generative AI model to analyze the user's characteristics.

[0168] Input: User profile data.

[0169] Output: The saved data and the analysis request sent to the generating AI.

[0170] Generative AI: Extracts multidimensional features from user profile data and generates a virtual avatar.

[0171] Specific operation: Based on the user's hobby of "watching movies," an avatar holding a movie film is generated.

[0172] Input: User profile data.

[0173] Output: Generated avatar data (e.g., avatar holding a film reel).

[0174] Server: Stores the generated avatar information in a database.

[0175] Input: Avatar data generated by the generative AI.

[0176] Output: Data stored in the database.

[0177] Step 3: Set up a virtual matchmaking session

[0178] Server: Searches for compatible pairs from multiple registered users and calculates similarity using feature vectors.

[0179] Input: Profile data for multiple users.

[0180] Output: A pair of compatible users.

[0181] Server: Creates pairs of users with high similarity and stores their information in a database. Sets the date and time for the virtual matchmaking and notifies the target user's device.

[0182] Specific operation: Create a pair of users A and C who share a common interest in watching movies, set a date and time, and receive a notification.

[0183] Input: A compatible user pair.

[0184] Output: Database storage and notification data.

[0185] Terminal: Notifies the user of the date and time of the matchmaking.

[0186] Input: Notification data from the server.

[0187] Output: Notification information that is displayed to the user.

[0188] Step 4: Conduct a virtual matchmaking session

[0189] User: Log in to the system at a specified time.

[0190] Input: Notification of matchmaking date and time.

[0191] Output: Logged in to the system.

[0192] Terminal: Start a virtual matchmaking session.

[0193] Specific operation: The user is presented with a virtual space where avatars can interact with each other.

[0194] Input: User login data.

[0195] Output: Virtual space display.

[0196] Server: Calls the generative AI model and generates conversations between avatars in real time.

[0197] Input: User profile data and matchmaking information.

[0198] Output: Real-time generated conversation data.

[0199] Server: Sends the generated conversation content to the terminal.

[0200] Input: Conversational data generated by generative AI.

[0201] Output: Data sent to the terminal.

[0202] Device: Displays the conversation to the user and updates it in real time.

[0203] Input: Conversation data from the server.

[0204] Output: The conversation that is displayed.

[0205] Step 5: Simulating the future baby

[0206] Server: During the matchmaking process, a simulation of future children is performed based on the profiles of both parties.

[0207] Input: Matchmaking pair profile data.

[0208] Output: A simulation request for a future child.

[0209] Generative AI: Predicts the characteristics of future children based on the genetic profiles and shared traits of both parents.

[0210] Specific operation: Generate a future child that reflects the common skill of user A and user C, "sports."

[0211] Input: Pair profile data.

[0212] Output: Simulation results of future children.

[0213] Server: Sends the simulation results to the terminal.

[0214] Input: Simulation results from generative AI.

[0215] Output: Data sent to the terminal.

[0216] Terminal: Displays the simulation results of the future child to the user.

[0217] Input: Simulation result transmission data.

[0218] Output: Simulation results that are displayed to the user.

[0219] Step 6: Suggesting date locations and common hobbies

[0220] Generative AI: Analyzes the user's hobbies and preferences and selects the best date location.

[0221] Input: User profile data.

[0222] Output: A request for suggestions on date locations and common interests.

[0223] Server: Generates a list of possible date locations and common hobbies and sends it to the device.

[0224] Specific actions: Suggest going to the cinema or a cooking class.

[0225] Input: Suggested results from generative AI.

[0226] Output: Data sent to the terminal.

[0227] Device: Shows users a list of potential dates and common interests.

[0228] Input: Proposal submission data.

[0229] Output: The suggestion that is displayed to the user.

[0230] Step 7: Compatibility assessment and feedback

[0231] Server: Analyzes the content of the session using a generation AI and evaluates compatibility.

[0232] Input: Session data (conversation content, simulation results, etc.).

[0233] Output: A request to calculate the compatibility score.

[0234] Generative AI: Calculates compatibility scores by comprehensively taking into account conversation content, common hobbies, future simulations, etc.

[0235] Specific actions: Evaluate common interests and the level of conversation excitement.

[0236] Input: Session analysis data.

[0237] Output: Compatibility score.

[0238] Server: Generates compatibility scores and feedback and sends them to the device.

[0239] Input: Compatibility score generated by the generated AI.

[0240] Output: Sending feedback data.

[0241] Device: Providing compatibility scores and feedback to users.

[0242] Input: Submit feedback data.

[0243] Output: The feedback that is displayed to the user.

[0244] (Application example 1)

[0245] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0246] Conventional virtual matchmaking systems often lack accuracy in determining compatibility using detailed user profile information, making it difficult to improve the user experience. Furthermore, it is difficult to implement multiple functions, such as real-time conversation generation, simulation of future children, and date suggestions, making comprehensive evaluation difficult.

[0247] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0248] In this invention, the server includes a user input means, an avatar generation means for generating avatars based on the generation information, a virtual conversation generation means for the avatars to converse with each other, a simulation generation means for simulating future children based on the user's profile information, a suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences, a means for the user to conduct a virtual matchmaking meeting using a smartphone, a conversation generation means for generating conversation content in real time, and a display means for displaying these. This enables highly accurate avatar generation and compatibility assessment based on the user's detailed profile information, significantly improving the user experience.

[0249] "User input means" means a device or interface through which a user inputs their profile information.

[0250] "Generation information" is data used to generate avatars and conversation content based on the profile information entered by the user.

[0251] The "avatar generation means" is a device or system for generating an avatar that virtually represents a user based on the generation information.

[0252] The "virtual conversation generating means" is a device or system that generates conversation content for avatars to converse with each other in real time.

[0253] The "simulation generation means" is a device or system that simulates the characteristics and appearance of the future child based on the user's profile information.

[0254] The "suggestion means" is a device or system that analyzes the user's hobbies and preferences and suggests the best date spot or common hobbies.

[0255] The "compatibility determination means" is a device or system that determines the compatibility between users based on the content of the conversation, the results of the simulation, and the like.

[0256] "Display means" refers to a device or interface that visually displays various information and results of the system to the user.

[0257] "Means for users to conduct virtual matchmaking using a smartphone" refers to a device or system that allows users to conduct virtual matchmaking using their own avatars using a smartphone.

[0258] The "conversation generation means for generating conversation content in real time" is a device or system that generates conversation content so that users' avatars can have natural conversations in real time.

[0259] In this invention, the following system configuration is required for users to conduct virtual matchmaking using their smartphones: This system includes a user input means, an avatar generation means for generating avatars based on generation information, a virtual conversation generation means for the avatars to converse with each other, a simulation generation means for simulating future children based on the user's profile information, a suggestion means, a compatibility determination means, and a display means.

[0260] A description of what the program does

[0261] User Input Method

[0262] It provides an interface for users to input their profile information (name, age, gender, hobbies, preferences, future goals, etc.) from their smartphones. The input data is sent to the server.

[0263] Avatar generation method

[0264] The server analyzes the received user information using a generative AI model (for example, using TensorFlow or PyTorch) to generate an avatar that represents the user's characteristics. This avatar has multiple features based on the user's hobbies and preferences.

[0265] Virtual conversation generation method

[0266] The server generates conversations between the generated avatars in real time using a generative AI model, which generates conversations naturally based on the users' shared hobbies and interests.

[0267] Simulation Generation Method

[0268] The server simulates the characteristics of the future child based on the user's profile information, using the user's genetic profile and a generative AI model to predict the characteristics of the future child.

[0269] Proposal means

[0270] The generative AI model analyzes the user's interests and preferences and generates a list of suggestions for suitable date locations and shared hobbies. The server then sends this list to the smartphone and displays it.

[0271] Compatibility determination method

[0272] Based on the content of the virtual matchmaking session and the simulation results, the server determines compatibility using a generative AI model to calculate a compatibility score that takes into account the content of the conversation and shared interests and preferences.

[0273] Display means

[0274] All results (avatars, virtual conversations, simulated future children, date suggestions, and compatibility scores) are displayed on the smartphone screen.

[0275] Specific examples

[0276] 1. User registration prompt

[0277] Name: User A

[0278] Age: 30

[0279] Gender: Male

[0280] Hobbies: Watching movies

[0281] Future goal: Travel the world

[0282] 2. Matchmaking prompts

[0283] User ID: 1

[0284] 3. Future Baby Simulation Prompt

[0285] User ID: 1

[0286] Match ID: 2

[0287] 4. Compatibility score prompt

[0288] User ID: 1

[0289] In this way, users can input detailed profile information via their smartphones, and receive real-time avatar generation and virtual conversations using generative AI models, simulations of future children, suggestions for date locations, and compatibility assessments. This system can accurately assess compatibility between users and provide a realistic virtual matchmaking experience.

[0290] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0291] Step 1: User Registration

[0292] Users use their smartphones to enter profile information such as their name, age, gender, hobbies, preferences, and future goals into a registration form, and the device then sends this input data to the server.

[0293] Input: User profile information (name, age, gender, hobbies, preferences, future goals)

[0294] Output: User profile information sent to the server

[0295] Step 2: Profile analysis and avatar generation

[0296] The server stores the received user information in a database. It then uses a generative AI model (using TensorFlow or PyTorch) to analyze the user information and extract detailed features. Based on these features, it generates an avatar that virtually represents the user.

[0297] Input: User profile information stored on the server

[0298] Output: Generated virtual avatar

[0299] Step 3: Save your avatar

[0300] The server stores the generated avatar information in a database, where the user ID and the corresponding avatar information are recorded.

[0301] Input: Generated virtual avatar

[0302] Output: Avatar information stored in the database

[0303] Step 4: Matching users

[0304] The server retrieves information about other users from a database and searches for compatible pairs. To do this, it uses a generative AI model to calculate the similarity of each user's feature vectors and selects a partner with high similarity.

[0305] Input: Multiple user profile information stored in a database

[0306] Output: Pairing information of compatible users

[0307] Step 5: Schedule a virtual meeting

[0308] When the server finds a compatible user pair, it sets a date and time for the virtual matchmaking and sends that information to the user's device, which then notifies the user of the date and time of the matchmaking.

[0309] Input: Pairing information of compatible users

[0310] Output: Notification of matchmaking date and time

[0311] Step 6: Conduct a virtual matchmaking session

[0312] When a user logs in to the system at the designated time, the device starts a virtual matchmaking session. The server uses a generative AI model to generate a conversation between the avatars in real time and sends it to the device. The device then displays the conversation to the user, updating it in real time.

[0313] Input: User login to the system, date and time of the matchmaking

[0314] Output: Real-time generated conversation

[0315] Step 7: Simulating your future child

[0316] During the virtual matchmaking session, the server simulates the future child based on the profiles of both parties. Using a generative AI model, it predicts the characteristics of the future child based on the genetic profiles and shared traits of both parties and sends the results to the device. The device then displays the simulated child to the user.

[0317] Input: Profile information of both users

[0318] Output: Simulation results of future children

[0319] Step 8: Suggesting date locations and common hobbies

[0320] Using a generative AI model, the server analyzes the user's hobbies and preferences to generate a list of suitable date locations and common hobbies. The server then sends this list to the device, which then displays it to the user.

[0321] Input: User's hobbies and preferences

[0322] Output: A list of suggested date locations and common interests

[0323] Step 9: Compatibility assessment and feedback

[0324] After the virtual matchmaking session ends, the server analyzes the session content and evaluates compatibility. Using a generative AI model, the server calculates a compatibility score by comprehensively considering the content of the conversation, shared interests, and future simulation results. The server then sends this compatibility score to the device, which then provides feedback to the user.

[0325] Input: Virtual matchmaking session details, common hobbies, future simulation results

[0326] Output: Compatibility score and feedback

[0327] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0328] This invention combines an emotion engine with a system that generates an avatar based on a user's detailed profile information and determines compatibility through virtual matchmaking, recognizing and analyzing the user's emotional state in real time. This system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility determination means, a display means, and an emotion engine.

[0329] System construction details

[0330] To implement this system, a server, a device, and a user are required. The server uses a generative AI and an emotion engine to analyze the user's profile information, generate an avatar, generate virtual conversations, assess compatibility, suggest date locations, and simulate future children. The device receives input from the user and communicates with the server to display the information. The emotion engine analyzes the user's facial expressions and voice to recognize their emotional state in real time.

[0331] What the program does

[0332] User Registration

[0333] The user accesses the system and selects new registration on the login screen. The terminal displays a registration form and asks for information such as name, age, gender, hobbies, preferences, and future goals. When the user enters the required information and presses the submit button, the terminal sends the input data to the server.

[0334] Profile analysis and avatar generation

[0335] The server stores the received user information in a database. The server then calls the generation AI and analyzes the user's profile information. The generation AI extracts features from information such as the user's hobbies and preferences, and generates a virtual avatar. The server then stores the generated avatar information in a database.

[0336] Setting up a virtual matchmaking session

[0337] The server searches for compatible pairs among registered users and calculates the similarity based on the feature vectors. The server then generates pairs of users with high similarity and stores their information. The server then sets the date and time of the virtual matchmaking and sends that information to the target user's device. The device then notifies the user of the date and time of the matchmaking.

[0338] Virtual matchmaking

[0339] When a user logs in to the system at a specified time, the device starts a virtual matchmaking session. The server calls a generation AI to generate conversations between avatars in real time. The generation AI generates the conversation content and the avatars interact with each other. The device displays the generated conversation content to the user in real time.

[0340] Emotion analysis using an emotion engine

[0341] During a virtual matchmaking session, the emotion engine analyzes the user's facial expressions and voice in real time to recognize their emotional state, which is then fed back to the generative AI, which dynamically adjusts the conversation to match the user's emotional state.

[0342] Future Baby Simulator

[0343] During the matchmaking process, the server simulates the future child based on the profiles of both parties. The generation AI predicts the characteristics of the future child based on the genetic profiles and common characteristics of both parties. The server sends the simulation results to the device, which then displays the simulation results of the future child to the user.

[0344] Suggestions for date locations and common hobbies

[0345] The AI ​​analyzes the user's hobbies and preferences and selects the best date location and shared hobbies. The server generates a list of potential date locations and shared hobbies and sends it to the device. The device then displays the list of potential date locations and shared hobbies to the user.

[0346] Compatibility assessment and feedback

[0347] Once the session is over, the server analyzes the content of the virtual matchmaking session and evaluates compatibility. The generating AI calculates a compatibility score by comprehensively taking into account the content of the conversation, common interests, future simulation results, and perceived emotional state. The server generates a compatibility score and feedback and sends it to the device. The device then provides the compatibility score and feedback to the user.

[0348] Specific examples

[0349] 1. User Registration

[0350] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his or her hobbies.

[0351] User B logs in in the same way and enters "listening to music" and "tennis" as his hobbies.

[0352] 2. Profile Analysis

[0353] The server stores information about users A and B, analyzes it using a generation AI, and generates avatars for each.

[0354] User A's avatar is holding a movie reel, and User B's avatar is holding a tennis racket.

[0355] 3. Virtual matchmaking

[0356] The server finds user C, who shares the same hobby of watching movies, and sets a date and time for a matchmaking meeting between user A and user C and notifies them.

[0357] 4. Virtual matchmaking

[0358] User A and User C log in at the specified time. Their avatars talk about "movies they've recently seen" in the virtual space.

[0359] 5. Emotion Analysis Using an Emotion Engine

[0360] During the virtual conversation, the emotion engine analyzes User A's facial expressions and voice and detects "fun."

[0361] The generative AI recognizes "fun" and expands the conversation into even more fun topics.

[0362] 6. Future Baby Simulation

[0363] During the conversation, the server simulates the future children of user A and user C, displaying the characteristics of children who share the common skills of sports and watching movies.

[0364] 7. Suggesting date spots and common hobbies

[0365] The generative AI suggests movie theaters and cooking classes and displays them on the device.

[0366] 8. Compatibility assessment and feedback

[0367] After the session ends, the server calculates a compatibility score based on the conversation content, simulation results, and emotional state, and provides feedback such as "Compatibility score: 85%."

[0368] The above is a specific embodiment of the present invention.

[0369] The processing flow will be explained below.

[0370] Step 1: User Registration

[0371] 1.1 The user accesses the system and enters personal information on the new registration screen.

[0372] 1.2 The device will display a registration form and ask you to enter your name, age, gender, hobbies, preferences, future goals, etc.

[0373] 1.3 The user enters the required information and presses the send button.

[0374] 1.4 The terminal sends the entered data to the server.

[0375] Step 2: Profile analysis and avatar generation

[0376] 2.1 The server stores the received user information in a database.

[0377] 2.2 The server calls the generation AI and analyzes the user's profile information.

[0378] 2.3 Generative AI extracts features from information such as the user's hobbies and preferences and generates a virtual avatar.

[0379] 2.4 The server stores the generated avatar information in a database.

[0380] Step 3: Set up a virtual matchmaking session

[0381] 3.1 The server calculates the similarity based on the feature vectors to find compatible pairs among the registered users.

[0382] 3.2 The server generates pairs of users with high similarity and stores their information.

[0383] 3.3 The server will set the date and time of the virtual matchmaking and send that information to the target user's device.

[0384] 3.4 The device will notify the user of the date and time of the matchmaking.

[0385] Step 4: Conduct a virtual matchmaking session

[0386] 4.1 The user logs into the system at the designated time.

[0387] 4.2 The device will start the virtual matchmaking session.

[0388] 4.3 The server calls the generation AI to generate conversations between avatars in real time.

[0389] 4.4 The generation AI generates conversation content and conducts dialogue between avatars.

[0390] 4.5 The device displays the generated conversation content to the user in real time.

[0391] Step 5: Emotion analysis using the emotion engine

[0392] 5.1 Users provide facial and audio feedback during virtual matchmaking sessions.

[0393] 5.2 The emotion engine analyzes the user's facial expressions and voice in real time to recognize the user's emotional state.

[0394] 5.3 The server feeds back the emotional state data to the AI ​​generator.

[0395] 5.4 Generative AI dynamically adjusts conversation content based on emotional state feedback.

[0396] Step 6: Simulating the future baby

[0397] 6.1 During the matchmaking process, the server simulates future children based on the profiles of both parties.

[0398] 6.2 Generative AI predicts the characteristics of future children based on the genetic profiles and common characteristics of both parents.

[0399] 6.3 The server sends the simulation results to the terminal.

[0400] 6.4 The device displays the simulation results of the future child to the user.

[0401] Step 7: Suggesting date locations and common hobbies

[0402] 7.1 The generating AI analyzes the user's hobbies and preferences and selects the best date location and common hobbies.

[0403] 7.2 The server generates a list of possible date locations and common interests and sends it to the device.

[0404] 7.3 The device will display a list of possible locations for dates and common interests to the user.

[0405] Step 8: Compatibility assessment and feedback

[0406] 8.1 The server will analyze the content of the virtual matchmaking session and evaluate compatibility.

[0407] 8.2 The generative AI calculates a compatibility score by comprehensively taking into account the content of the conversation, common interests, future simulation results, perceived emotional state, etc.

[0408] 8.3 The server generates a compatibility score and feedback and sends it to the device.

[0409] 8.4 The device will provide users with compatibility scores and feedback.

[0410] Specific examples

[0411] 1. User Registration

[0412] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his or her hobbies.

[0413] User B logs in in the same way and enters "listening to music" and "tennis" as his hobbies.

[0414] 2. Profile Analysis

[0415] The server stores information about users A and B, analyzes it using a generation AI, and generates avatars for each.

[0416] User A's avatar is holding a movie reel, and User B's avatar is holding a tennis racket.

[0417] 3. Virtual matchmaking

[0418] The server finds user C, who shares the same hobby of watching movies, and sets a date and time for a matchmaking meeting between user A and user C and notifies them.

[0419] 4. Virtual matchmaking

[0420] User A and User C log in at the specified time. Their avatars talk about "movies they've recently seen" in the virtual space.

[0421] 5. Emotion Analysis Using an Emotion Engine

[0422] During the virtual conversation, the emotion engine analyzes User A's facial expressions and voice and detects "fun."

[0423] The generative AI recognizes "fun" and expands the conversation into even more fun topics.

[0424] 6. Future Baby Simulation

[0425] During the conversation, the server simulates the future children of user A and user C, displaying the characteristics of children who share the common skills of sports and watching movies.

[0426] 7. Suggesting date spots and common hobbies

[0427] The generative AI suggests movie theaters and cooking classes and displays them on the device.

[0428] 8. Compatibility assessment and feedback

[0429] After the session ends, the server calculates a compatibility score based on the conversation content, simulation results, and emotional state, and provides feedback such as "Compatibility score: 85%."

[0430] The above is a specific embodiment of the present invention.

[0431] Example 2

[0432] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0433] Conventional virtual matchmaking systems only determine compatibility based on the user's profile information and hobbies and preferences, and do not take into account the user's real-time emotional state or physiological reactions, which means they are unable to fully assess true compatibility in actual communication. Furthermore, the conversation content is static, meaning it is not possible to dynamically adjust the conversation to match the user's emotional state, which limits the user experience.

[0434] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a user input means, an avatar generation means for generating an avatar based on generation information, a virtual conversation generation means for avatars to converse with each other, a simulation generation means for simulating future children based on the user's profile information, a suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences, a compatibility determination means for determining compatibility based on the content of the conversation and the simulation results, a display means for displaying these, an emotion analysis means for recognizing the user's emotional state in real time by analyzing facial expressions and voice, and a conversation adjustment means for dynamically adjusting the content of the conversation based on the recognized emotional state. This enables natural and dynamic conversation that reflects the user's emotional state in real time, thereby achieving a more accurate compatibility determination that is closer to actual communication.

[0435] "User input means" means an interface device through which a user accesses the system and registers, logs in, and enters profile information.

[0436] The "avatar generation means" is a device that analyzes the user's hobbies and preferences based on the generation information, extracts features, and generates a virtual avatar.

[0437] The "virtual conversation generating means" is a device that generates conversation content in real time for the generated avatars to converse with each other and displays it.

[0438] The "simulation generation means" is a device that simulates the characteristics of the future child based on the user's profile information and generates the results.

[0439] The "suggestion means" is a device that selects the most suitable date location or common hobby based on the user's hobbies and preferences and suggests them to the user.

[0440] The "compatibility determination means" is a device that determines the compatibility between users based on the content of the conversation, the simulation results, the emotional state, and the like.

[0441] The "display means" is a device that displays the generated avatar, conversation content, simulation results, proposal content, compatibility assessment results, etc. to the user.

[0442] The "emotion analysis means" is a device that analyzes the user's facial expressions and voice to recognize their emotional state in real time.

[0443] The "conversation adjustment means" is a device that dynamically adjusts the content of the conversation based on the emotional state recognized by the emotion analysis means.

[0444] The present invention combines an emotion engine with a system that generates an avatar based on a user's detailed profile information and determines compatibility through virtual matchmaking, thereby recognizing and analyzing the user's emotional state in real time. This system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility determination means, a display means, an emotion analysis means, and a conversation adjustment means.

[0445] A detailed explanation of the program's processing

[0446] User Registration

[0447] The user accesses the system and selects new registration on the login screen. The terminal displays a registration form and asks the user to enter information such as name, age, gender, hobbies, preferences, and future goals. When the user enters the required information and presses the submit button, the terminal sends the input data to the server. The server receives the data and stores it in a database.

[0448] Profile analysis and avatar generation

[0449] The server calls the AI ​​based on the received user information and analyzes the user's profile information. The AI ​​extracts features from the user's hobbies and preferences to generate a virtual avatar. The generated avatar information is then stored in a database by the server.

[0450] Setting up a virtual matchmaking session

[0451] The server searches for compatible pairs among registered users and calculates similarity based on feature vectors. It generates pairs of users with high similarity and saves their information. The server then sets the date and time of the virtual matchmaking and sends that information to the target user's device. The device then notifies the user of the date and time of the matchmaking.

[0452] Virtual matchmaking

[0453] When a user logs in to the system at the designated time, the device starts a virtual matchmaking session. The server calls the generation AI to generate conversation content between the avatars in real time. The generated conversation content is sent to the device and displayed to the user.

[0454] Sentiment analysis and conversation adjustment

[0455] During the virtual matchmaking session, the emotion analysis means analyzes the user's facial expressions and voice in real time to recognize the user's emotional state. The recognized emotional state is fed back to the generation AI by the server, and the conversation content is dynamically adjusted to match the user's emotional state.

[0456] Simulation of a child of the future

[0457] During the matchmaking process, the server simulates the future child based on the profiles of both parties. The generative AI predicts the characteristics of the future child based on the genetic profiles and common characteristics of both parties. The simulation results are sent to the terminal and displayed to the user.

[0458] Suggestions for date locations and common hobbies

[0459] The AI ​​analyzes the user's hobbies and preferences to select the best date locations and common interests. The generated suggestions are sent to the user's device and displayed to them.

[0460] Compatibility assessment and feedback

[0461] Once the session is over, the server analyzes the details of the virtual matchmaking session and evaluates compatibility. The AI ​​calculates a compatibility score by comprehensively considering the content of the conversation, common interests, future simulation results, and emotional state. The compatibility score and feedback are sent to the device and provided to the user.

[0462] Examples of specific examples and prompts

[0463] For example, consider the following user registration scenario:

[0464] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his or her hobbies.

[0465] User B logs in in the same way and enters "listening to music" and "tennis" as his hobbies.

[0466] The server stores information about users A and B, analyzes it using a generation AI, and generates avatars for each.

[0467] User A's avatar is holding a movie reel, and User B's avatar is holding a tennis racket.

[0468] An example prompt is:

[0469] Profile Information:

[0470] Name: User A

[0471] Age: 28

[0472] Gender: Female

[0473] Hobbies: Watching movies, cooking

[0474] Hobbies: Comedy movies, French cuisine

[0475] Future goal: To have my own vegetable garden

[0476] Avatar creation requirements:

[0477] Generate an avatar that captures the characteristics of user A based on their profile information

[0478] The avatar reflects user A's hobbies and interests.

[0479] Virtual Conversation Generation Requirements:

[0480] Generate conversations based on the common interests of users A and B

[0481] Dynamically adjust the conversation content by incorporating the analysis results of the emotion engine during the conversation.

[0482] The above is a specific embodiment for carrying out the invention. This system, which involves the server, terminals, and users working together, analyzes users' emotions in real time, and enables accurate compatibility assessment through virtual matchmaking that is similar to real communication.

[0483] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0484] Step 1:

[0485] User Registration

[0486] Input: The user accesses the system and enters information such as name, age, gender, hobbies, preferences, and future goals.

[0487] Specific operation: The terminal receives information entered by the user. When the user presses the send button, the input data is sent from the terminal to the server.

[0488] Data processing: The server converts the received data into the required format and stores it in the database.

[0489] Output: User information data stored on the server.

[0490] Step 2:

[0491] Profile analysis and avatar generation

[0492] Input: User information data stored on the server.

[0493] Specific operation: The server calls the generation AI and analyzes the saved user information. The generation AI extracts features from information such as hobbies and preferences.

[0494] Data processing: Generative AI generates a virtual avatar based on the features.

[0495] Output: The server saves the generated avatar information in the database.

[0496] Step 3:

[0497] Setting up a virtual matchmaking session

[0498] Input: All user profile data and avatar information stored on our servers.

[0499] Specific operation: The server searches for compatible pairs among registered users and calculates the similarity based on the feature vector. It selects pairs with high similarity and sets a date and time for the virtual matchmaking. The set date and time and pair information are sent to the target user's device.

[0500] Data processing: The server saves the calculated similarity and the set date and time information.

[0501] Output: The device notifies the user of the date and time of the matchmaking and the other person's information.

[0502] Step 4:

[0503] Virtual matchmaking

[0504] Input: User login information and the scheduled date and time of the matchmaking.

[0505] How it works: When a user logs in to the system at the specified time, the device starts a virtual matchmaking session. The server calls the generation AI to generate conversation content between the avatars in real time. The generated conversation content is sent to the device and displayed to the user.

[0506] Data processing: Conversation content data generated by the generative AI.

[0507] Output: The conversation is displayed in real time on the user's device.

[0508] Step 5:

[0509] Sentiment analysis and conversation adjustment

[0510] Input: Facial and voice data of the user during the virtual matchmaking session.

[0511] Specific operation: The emotion analysis means analyzes the user's facial expressions and voice in real time to recognize the user's emotional state. Based on the recognized emotional state, the server provides feedback to the generation AI. The generation AI dynamically adjusts the content of the conversation according to the emotional state.

[0512] Data processing: Emotional state data from emotion analysis and adjusted conversation content data.

[0513] Output: Dynamically adjusted conversation content displayed on the user's device.

[0514] Step 6:

[0515] Simulation of a child of the future

[0516] Input: Profile data of both users in the virtual matchmaking session.

[0517] How it works: The server simulates the future child based on the profiles of both users. The generation AI predicts the child's characteristics based on the genetic profiles and common traits of both users. The simulation results are sent to the device.

[0518] Data processing: Simulation result data generated by generative AI.

[0519] Output: Simulation results of the future child displayed on the user's device.

[0520] Step 7:

[0521] Suggestions for date locations and common hobbies

[0522] Input: User preferences data.

[0523] Specific operation: The generating AI analyzes the user's hobbies and preferences and selects the best date location and common hobbies.

[0524] Data processing: Analyzed hobby and preference data and proposal candidate data.

[0525] Output: A list of potential date locations and common interests displayed on the user's device.

[0526] Step 8:

[0527] Compatibility assessment and feedback

[0528] Input: Content data of the virtual matchmaking session, emotional state data, simulation result data, etc.

[0529] Specific operation: After the session ends, the server comprehensively analyzes all data and uses the generation AI to calculate a compatibility score. Feedback content is generated along with the compatibility score and sent to the device.

[0530] Data processing: Analysis results and generated compatibility score data and feedback data.

[0531] Output: Compatibility score and feedback displayed on the user's device.

[0532] (Application example 2)

[0533] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0534] In recent years, the evolution of interaction technologies in virtual spaces has led to an increasing need for improving user experiences. However, conventional virtual interaction systems have struggled to recognize a user's emotional state in real time and dynamically respond based on that state. Furthermore, it has been rare for systems to provide recommendations tailored to individual needs based on the user's profile information. This has led to problems such as a lack of user engagement and satisfaction, making it difficult to provide a satisfying interaction experience.

[0535] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a user input means, an avatar generation means for generating an avatar based on generation information, a virtual conversation generation means for avatars to converse with each other, a simulation generation means for simulating future children based on the user's profile information, a suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences, a compatibility determination means for determining compatibility based on the content of the conversation and the simulation results, an emotion engine for analyzing the user's facial expressions and voice to recognize the user's emotional state in real time, a recommendation means for recommending products according to the emotional state, and a display means for displaying these. This makes it possible to recognize the user's emotional state in real time and make appropriate recommendations based on that state.

[0536] "User input means" refers to an interface that allows users to input data such as profile information, hobbies, and preferences into the system.

[0537] The "avatar generation means" is a system part that generates a virtual avatar by analyzing the user's profile information and hobbies and preferences based on the generation information.

[0538] The "virtual conversation generation means" is a system part that generates conversation content in real time for the generated avatars to converse with each other.

[0539] The "simulation generation means" is the part of the system that creates a simulation of the future child based on the user's profile information.

[0540] The "suggestion means" is the part of the system that suggests the best date spot or common hobbies based on the user's hobbies and preferences.

[0541] The "compatibility determination means" is the system part that determines the compatibility between users based on the content of the conversation, the simulation results, the recognized emotional state, etc.

[0542] The "display means" is an interface for displaying to the user the generated avatar, the content of the conversation, the suggested date location, the compatibility assessment results, etc.

[0543] The "emotion engine" is the part of the system that analyzes the user's facial expressions and voice in real time and recognizes their emotional state.

[0544] The "recommendation means" is the part of the system that recommends the most appropriate products and services based on the user's emotional state.

[0545] This invention generates an avatar based on a user's detailed profile information, and recognizes and analyzes the user's emotional state in real time by combining an emotion engine with a system that judges compatibility through virtual matchmaking. The system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility judgment means, a display means, an emotion engine, and a recommendation means.

[0546] composition

[0547] To implement this system, the following hardware and software are required:

[0548] Hardware: smart glasses (e.g., Google Glass), head-mounted displays (e.g., Oculus Quest), servers, and user devices

[0549] Software: Emotion engine (e.g., Affectiva SDK), generative AI engine (e.g., OpenAI GPT-4)

[0550] What the program does

[0551] Overall system flow

[0552] 1. User Registration:

[0553] Users access the virtual store by wearing smart glasses or a head-mounted display, and fill out a registration form to enter their profile information, including their name, age, gender, hobbies, preferences, and goals.

[0554] The server receives the user's input and stores it in a database.

[0555] 2. Profile analysis and avatar generation:

[0556] The server calls the AI ​​generator, extracts features from the user's detailed profile information, and generates a virtual avatar, which is then sent to the user's device and displayed.

[0557] 3. Directions to the virtual store:

[0558] Once registration is complete, a user avatar is generated and guides them around the virtual store. The emotion engine analyzes the user's facial expressions and voice to provide real-time feedback on their emotional state.

[0559] 4. Emotion engine and product recommendations:

[0560] During a virtual conversation, the emotion engine analyzes the user's facial expressions and comments to recognize emotions such as "interest," "surprise," and "happiness." Based on these emotional states, the generative AI recommends the most suitable products to the user. This data is fed back to the server and used to improve the experience in future visits.

[0561] 5. Data Collection and Analysis:

[0562] User responses and purchase history during the shopping session are collected in a database and analyzed to provide a more personalized experience in the future.

[0563] Examples and prompts

[0564] 1. User Registration:

[0565] The user puts on the smart glasses and the screen where they enter their information displays the message, "Please enter your user information: name, age, gender, hobbies, preferences, and goals."

[0566] 2. Avatar generation:

[0567] The prompt to be entered for the generation AI is, "Please generate an avatar based on the information entered. We will generate an avatar with characteristics that match your hobbies and preferences."

[0568] 3. Real-time sentiment analysis:

[0569] The prompt for the emotion engine states, "Analyze the user's facial expressions and voice to recognize and analyze their emotional state in real time."

[0570] 4. Product recommendation:

[0571] The prompt for the AI ​​generator is, "Recommend products that the user might be interested in based on their emotional state. Consider their purchase history and reflect it in your next recommendation."

[0572] As described above, the present invention allows users to enjoy shopping in a virtual store while having their emotional state recognized in real time, and by providing an individually personalized experience, it is possible to improve user satisfaction.

[0573] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0574] Step 1:

[0575] Users access the virtual store by wearing smart glasses or a head-mounted display. They enter their profile information, such as their name, age, gender, hobbies, preferences, and goals, into a new registration form. This information is sent from the device to the server, where it is stored in a database.

[0576] Step 2:

[0577] The server receives the user information and calls the AI ​​to extract features from the user's detailed profile information. Based on these extracted features, it generates a virtual avatar. The generated avatar information is then stored in a database.

[0578] Step 3:

[0579] The generated avatar is sent to the user's device and displayed on the user's screen. When the user accesses the virtual store, the avatar guides the user around the store. During the guidance, the emotion engine analyzes the user's facial expressions and voice in real time and feeds back their emotional state to the server.

[0580] Step 4:

[0581] During interactions in the virtual store, the emotion engine analyzes the user's facial expressions and voice to recognize their emotional state in real time. The recognized emotions are fed back to the generative AI and used as input to recommend products appropriate for the user's "interest" or "joy."

[0582] Step 5:

[0583] The server calls the AI ​​based on the user's emotional state and recommends suitable products to the user. For example, if the user expresses "joy," the AI ​​selects products that match that emotion and sends them to the user's device as suggestions. The user can then view the recommended products through an avatar.

[0584] Step 6:

[0585] At each step during a shopping session, the user's reactions and purchase history are sent from the device to a server, which stores the collected data in a database and analyzes it for future personalized experiences. The analysis results are then reflected in future recommendations and interactions.

[0586] Step 7:

[0587] Once the entire session is over, the user exits the virtual store experience, removes the smart glasses or head-mounted display, and the server stores all data and prepares the next time the user logs in for an optimized interaction.

[0588] The above processing flow allows users to enjoy shopping in a virtual store while having their emotional state recognized in real time, and by providing an individually personalized experience, user satisfaction can be improved.

[0589] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0590] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0591] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0592] [Second embodiment]

[0593] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0594] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0595] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0596] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0597] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0598] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0599] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0600] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0601] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0602] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0603] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0604] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0605] The present invention is a system that generates an avatar based on detailed user profile information and determines compatibility through virtual matchmaking. The system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility determination means, and a display means.

[0606] System construction details

[0607] To implement this system, a server, a device, and a user are required. The server uses generative AI to analyze the user's profile information, generate avatars, generate virtual conversations, assess compatibility, suggest date locations, and perform simulations. The device receives input from the user, communicates with the server, and displays the information.

[0608] What the program does

[0609] User Registration

[0610] The user accesses the system and selects new registration on the login screen. The terminal displays a registration form and asks for information such as name, age, gender, hobbies, preferences, and future goals. When the user enters the required information and presses the submit button, the terminal sends the input data to the server.

[0611] Profile analysis and avatar generation

[0612] The server stores the received user information in a database. The server then invokes the generation AI to analyze the user's characteristics. The generation AI extracts multidimensional features from the user's profile data and generates a virtual avatar. The server then stores the generated avatar information in a database.

[0613] Virtual matchmaking

[0614] The server searches for compatible pairs among registered users and calculates similarity using feature vectors. The server then generates pairs of users with high similarity and saves their information. The server then sets the date and time of the virtual matchmaking and sends that information to the target user's device. The device then notifies the user of the date and time of the matchmaking.

[0615] Virtual matchmaking

[0616] When a user logs in to the system at the specified time, the device starts a virtual matchmaking session. The server calls a generation AI to generate a conversation between avatars in real time. The generation AI generates a conversation between avatars based on the conversation content and simulation results. The device displays the conversation content to the user and updates it in real time.

[0617] Future Baby Simulator

[0618] During the matchmaking process, the server simulates the future child based on the profiles of both parties. The generation AI predicts the characteristics of the future child based on the genetic profiles and common characteristics of both parties. The server sends the simulation results to the device, which then displays the simulation results of the future child to the user.

[0619] Suggestions for date locations and common hobbies

[0620] The AI ​​analyzes the user's hobbies and preferences and selects the best date location. The server generates a list of potential date locations and common hobbies and sends it to the device. The device then displays the list of potential date locations and common hobbies to the user.

[0621] Compatibility assessment and feedback

[0622] Once the session is over, the server analyzes the content of the virtual matchmaking session and evaluates compatibility. The AI ​​calculates a compatibility score that comprehensively takes into account the content of the conversation, common hobbies, future simulations, etc. The server generates feedback along with the compatibility score and sends it to the device. The device then provides the compatibility score and feedback to the user.

[0623] Specific examples

[0624] 1. User Registration

[0625] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his or her hobbies.

[0626] User B logs in in the same way and enters "listening to music" and "tennis" as his hobbies.

[0627] 2. Profile Analysis

[0628] The server stores information about users A and B, analyzes it using a generation AI, and generates avatars for each.

[0629] User A's avatar is holding a movie reel, and User B's avatar is holding a tennis racket.

[0630] 3. Virtual matchmaking

[0631] The server finds user C, who shares the same hobby of watching movies, and sets a date and time for a matchmaking meeting between user A and user C and notifies them.

[0632] 4. Virtual matchmaking

[0633] User A and User C log in at the specified time. Their avatars talk about "movies they've recently seen" in the virtual space.

[0634] 5. Future Baby Simulation

[0635] During the conversation, the server simulates the future children of user A and user C, displaying the characteristics of children who share the common skills of sports and watching movies.

[0636] 6. Suggesting date spots and common hobbies

[0637] The generative AI suggests movie theaters and cooking classes and displays them on the device.

[0638] 7. Compatibility assessment and feedback

[0639] After the session ends, the server calculates a compatibility score based on the conversation content and simulation results, and provides feedback to User A and User C: "Compatibility score: 85%."

[0640] The above is a specific embodiment of the present invention.

[0641] The processing flow will be explained below.

[0642] Step 1: User Registration

[0643] 1.1 The user accesses the system and enters personal information on the new registration screen.

[0644] 1.2 The device displays an input form and asks the user to enter their name, age, gender, hobbies, preferences, future goals, etc.

[0645] 1.3 The user enters the required information and presses the send button.

[0646] 1.4 The terminal sends the entered data to the server.

[0647] Step 2: Profile analysis and avatar generation

[0648] 2.1 The server stores the received user information in a database.

[0649] 2.2 The server calls the generation AI and analyzes the user's profile information.

[0650] 2.3 Generative AI extracts features from information such as the user's hobbies and preferences and generates a virtual avatar.

[0651] 2.4 The server stores the generated avatar information in a database.

[0652] Step 3: Set up a virtual matchmaking session

[0653] 3.1 The server calculates the similarity based on the feature vectors to find compatible pairs among the registered users.

[0654] 3.2 The server generates pairs of users with high similarity and stores their information.

[0655] 3.3 The server will set the date and time of the virtual matchmaking and send that information to the target user's device.

[0656] 3.4 The device will notify the user of the date and time of the matchmaking.

[0657] Step 4: Conduct a virtual matchmaking session

[0658] 4.1 The user logs into the system at the designated time.

[0659] 4.2 The device will start the virtual matchmaking session.

[0660] 4.3 The server calls the generation AI to generate conversations between avatars in real time.

[0661] 4.4 The generation AI generates conversation content and conducts dialogue between avatars.

[0662] 4.5 The device displays the generated conversation content to the user in real time.

[0663] Step 5: Simulating the future baby

[0664] 5.1 During the virtual matchmaking session, the server will simulate the future children based on the profiles of both parties.

[0665] 5.2 Generative AI predicts the characteristics of future children based on the genetic profiles and common characteristics of both parents.

[0666] 5.3 The server sends the simulation results to the terminal.

[0667] 5.4 The device displays the simulation results of the future child to the user.

[0668] Step 6: Suggesting date locations and common hobbies

[0669] 6.1 The generating AI analyzes the user's hobbies and preferences and selects the best date location and common hobbies.

[0670] 6.2 The server generates a list of possible date locations and common interests and sends it to the device.

[0671] 6.3 The device will display a list of possible locations for dates and common interests to the user.

[0672] Step 7: Compatibility assessment and feedback

[0673] 7.1 The server will analyze the content of the virtual matchmaking session and evaluate compatibility.

[0674] 7.2 The generation AI calculates a compatibility score by comprehensively taking into account the content of the conversation, common hobbies, future simulations, etc.

[0675] 7.3 The server generates a compatibility score and feedback and sends it to the device.

[0676] 7.4 The device will provide users with compatibility scores and feedback.

[0677] Example 1

[0678] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0679] Conventional online matchmaking systems generate avatars based on detailed user profile information, and when conducting virtual conversations, the judgement of compatibility is unclear. Furthermore, they lack additional features such as the ability to select a date location or simulate future children, making it difficult to improve the user experience.

[0680] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0681] In this invention, the server includes an avatar generation means for generating an avatar based on the generation information, a simulation generation means for simulating future children based on the user's profile information, and a suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences, thereby enabling precise avatar generation based on the user's detailed profile, a simulation of future children, and suggestions for optimal date locations.

[0682] "User input means" refers to the interface through which users input personal information, hobbies, and preferences into the system.

[0683] The "avatar generation means for generating an avatar based on generation information" is a system element that analyzes multidimensional features based on user input information and generates a virtual avatar.

[0684] The "virtual conversation generation means" is a function that generates conversation content in real time when the generated avatars converse with each other.

[0685] The "simulation generation means for simulating future children based on the user's profile information" is a function that analyzes the user's genetic information and profile and predicts the characteristics and special skills of the child that will be born in the future.

[0686] "A suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences" is a function that analyzes the user's hobbies and preferences and suggests the most suitable date locations and common hobbies.

[0687] The "compatibility determination means for determining compatibility based on the content of conversations and simulation results" is a function that analyzes the content of conversations between avatars and the results of simulations, and quantifies and determines the compatibility between users.

[0688] "Display means" refers to an interface that visually displays information and suggestions generated by the system to the user.

[0689] The "date and time setting means for setting and notifying the date and time of the matchmaking" is a function for setting the date and time of the virtual matchmaking and notifying the user of that information.

[0690] The present invention is a system that generates an avatar based on detailed user profile information and determines compatibility through virtual matchmaking. The system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility determination means, a display means, and a date and time setting means that sets and notifies the user of the date and time of the matchmaking.

[0691] System construction details

[0692] To implement this system, a server, a terminal, and a user are required. Specifically, the following hardware and software are used:

[0693] 1. Server: Analyzes user profile information using generation AI, generates avatars, generates virtual conversations, assesses compatibility, suggests date locations, and simulates children.

[0694] 2. Terminal: Receives input from the user, communicates with the server, and displays information. To perform these operations, the terminal accesses the system via a web browser or mobile application.

[0695] 3. User: Access the system, enter profile information, and participate in virtual matchmaking.

[0696] Details of what the program does

[0697] User Registration

[0698] The user accesses the system and selects new registration. The terminal displays a registration form, and the user enters information such as name, age, gender, hobbies, preferences, and future goals. The entered information is sent from the terminal to the server, where it is stored in a database.

[0699] Profile analysis and avatar generation

[0700] The server then calls the generation AI based on the received user information to analyze the user's characteristics. The generation AI extracts multidimensional features and generates a virtual avatar based on the user's hobbies and preferences. The generated avatar information is then stored in a database.

[0701] Setting up a virtual matchmaking session

[0702] The server selects users with many common hobbies and preferences from among multiple registered users, calculates similarities using feature vectors, creates pairs of users with many common interests, sets a date and time for a virtual matchmaking session, and notifies the target users' devices.

[0703] Virtual matchmaking

[0704] The user logs in to the system at a specified time, and the device starts a virtual matchmaking session. The server calls the generation AI to generate a conversation between the avatars in real time. The conversation content is periodically sent to the device and displayed to the user in real time.

[0705] Future Baby Simulator

[0706] During the conversation, the server simulates the future child based on the user's profile information. The generation AI analyzes the user's genetic information and predicts the child's characteristics and special skills. The simulation results are sent to the user's device and displayed to the user.

[0707] Suggestions for date locations and common hobbies

[0708] The AI ​​analyzes the user's hobbies and preferences to suggest the best date locations and shared hobbies. The server generates a list of suggested locations and sends it to the device. The device then displays the list of potential locations for dates and shared hobbies to the user.

[0709] Compatibility assessment and feedback

[0710] Once the session is over, the server uses the generative AI to analyze the conversation and simulation results and calculate a compatibility score, which is then sent to the device and displayed to the user.

[0711] Specific examples

[0712] User Registration:

[0713] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his hobbies. User B also logs in and enters "listening to music" and "tennis" as his hobbies.

[0714] Profile Analysis:

[0715] The server stores information about users A and B, and uses the AI ​​to generate avatars for each user. User A's avatar holds a film reel, and user B's avatar holds a tennis racket.

[0716] Virtual Matchmaking:

[0717] The server finds user C, who shares the same hobby of watching movies, and sets a date and time for a matchmaking meeting between user A and user C and notifies them.

[0718] Conducting virtual matchmaking:

[0719] User A and User C log in at the specified time. Their avatars talk about "movies they've recently seen" in the virtual space.

[0720] Future Baby Simulator:

[0721] During the conversation, the server simulates the future children of User A and User C. It displays the characteristics of children who share common skills of sports and watching movies.

[0722] Suggestions for date locations and common interests:

[0723] The generative AI suggests movie theaters and cooking classes and displays them on the device.

[0724] Compatibility assessment and feedback:

[0725] After the session ends, the server calculates a compatibility score based on the conversation content and simulation results, and provides feedback to User A and User C: "Compatibility score: 85%."

[0726] Example prompts: "User A: My hobbies are watching movies and cooking." "User B: My hobbies are listening to music and playing tennis." "User C: My hobbies are watching movies."

[0727] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0728] Step 1: User Registration

[0729] User: Accesses the system and selects new registration. Enters information such as name, age, gender, hobbies, preferences, and future goals.

[0730] Input: User profile information (name, age, gender, hobbies, preferences, future goals, etc.).

[0731] Output: The terminal sends the entered information to the server.

[0732] Terminal: Displays a registration form containing various data fields. When the user enters information and presses the submit button, the form data is sent to the server.

[0733] Specific actions: For example, a user enters "watching movies" and "cooking" as hobbies in a form and clicks the submit button.

[0734] Input: User-entered form data.

[0735] Output: The raw user data sent to the server.

[0736] Step 2: Profile analysis and avatar generation

[0737] Server: Stores the received user information in a database, then invokes the generative AI model to analyze the user's characteristics.

[0738] Input: User profile data.

[0739] Output: The saved data and the analysis request sent to the generating AI.

[0740] Generative AI: Extracts multidimensional features from user profile data and generates a virtual avatar.

[0741] Specific operation: Based on the user's hobby of "watching movies," an avatar holding a movie film is generated.

[0742] Input: User profile data.

[0743] Output: Generated avatar data (e.g., avatar holding a film reel).

[0744] Server: Stores the generated avatar information in a database.

[0745] Input: Avatar data generated by the generative AI.

[0746] Output: Data stored in the database.

[0747] Step 3: Set up a virtual matchmaking session

[0748] Server: Searches for compatible pairs from multiple registered users and calculates similarity using feature vectors.

[0749] Input: Profile data for multiple users.

[0750] Output: A pair of compatible users.

[0751] Server: Creates pairs of users with high similarity and stores their information in a database. Sets the date and time for the virtual matchmaking and notifies the target user's device.

[0752] Specific operation: Create a pair of users A and C who share a common interest in watching movies, set a date and time, and receive a notification.

[0753] Input: A compatible user pair.

[0754] Output: Database storage and notification data.

[0755] Terminal: Notifies the user of the date and time of the matchmaking.

[0756] Input: Notification data from the server.

[0757] Output: Notification information that is displayed to the user.

[0758] Step 4: Conduct a virtual matchmaking session

[0759] User: Log in to the system at a specified time.

[0760] Input: Notification of matchmaking date and time.

[0761] Output: Logged in to the system.

[0762] Terminal: Start a virtual matchmaking session.

[0763] Specific operation: The user is presented with a virtual space where avatars can interact with each other.

[0764] Input: User login data.

[0765] Output: Virtual space display.

[0766] Server: Calls the generative AI model and generates conversations between avatars in real time.

[0767] Input: User profile data and matchmaking information.

[0768] Output: Real-time generated conversation data.

[0769] Server: Sends the generated conversation content to the terminal.

[0770] Input: Conversational data generated by generative AI.

[0771] Output: Data sent to the terminal.

[0772] Device: Displays the conversation to the user and updates it in real time.

[0773] Input: Conversation data from the server.

[0774] Output: The conversation that is displayed.

[0775] Step 5: Simulating the future baby

[0776] Server: During the matchmaking process, a simulation of future children is performed based on the profiles of both parties.

[0777] Input: Matchmaking pair profile data.

[0778] Output: A simulation request for a future child.

[0779] Generative AI: Predicts the characteristics of future children based on the genetic profiles and shared traits of both parents.

[0780] Specific operation: Generate a future child that reflects the common skill of user A and user C, "sports."

[0781] Input: Pair profile data.

[0782] Output: Simulation results of future children.

[0783] Server: Sends the simulation results to the terminal.

[0784] Input: Simulation results from generative AI.

[0785] Output: Data sent to the terminal.

[0786] Terminal: Displays the simulation results of the future child to the user.

[0787] Input: Simulation result transmission data.

[0788] Output: Simulation results that are displayed to the user.

[0789] Step 6: Suggesting date locations and common hobbies

[0790] Generative AI: Analyzes the user's hobbies and preferences and selects the best date location.

[0791] Input: User profile data.

[0792] Output: A request for suggestions on date locations and common interests.

[0793] Server: Generates a list of possible date locations and common hobbies and sends it to the device.

[0794] Specific actions: Suggest going to the cinema or a cooking class.

[0795] Input: Suggested results from generative AI.

[0796] Output: Data sent to the terminal.

[0797] Device: Shows users a list of potential dates and common interests.

[0798] Input: Proposal submission data.

[0799] Output: The suggestion that is displayed to the user.

[0800] Step 7: Compatibility assessment and feedback

[0801] Server: Analyzes the content of the session using a generation AI and evaluates compatibility.

[0802] Input: Session data (conversation content, simulation results, etc.).

[0803] Output: A request to calculate the compatibility score.

[0804] Generative AI: Calculates compatibility scores by comprehensively taking into account conversation content, common hobbies, future simulations, etc.

[0805] Specific actions: Evaluate common interests and the level of conversation excitement.

[0806] Input: Session analysis data.

[0807] Output: Compatibility score.

[0808] Server: Generates compatibility scores and feedback and sends them to the device.

[0809] Input: Compatibility score generated by the generated AI.

[0810] Output: Sending feedback data.

[0811] Device: Providing compatibility scores and feedback to users.

[0812] Input: Submit feedback data.

[0813] Output: The feedback that is displayed to the user.

[0814] (Application example 1)

[0815] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0816] Conventional virtual matchmaking systems often lack accuracy in determining compatibility using detailed user profile information, making it difficult to improve the user experience. Furthermore, it is difficult to implement multiple functions, such as real-time conversation generation, simulation of future children, and date suggestions, making comprehensive evaluation difficult.

[0817] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0818] In this invention, the server includes a user input means, an avatar generation means for generating avatars based on the generation information, a virtual conversation generation means for the avatars to converse with each other, a simulation generation means for simulating future children based on the user's profile information, a suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences, a means for the user to conduct a virtual matchmaking meeting using a smartphone, a conversation generation means for generating conversation content in real time, and a display means for displaying these. This enables highly accurate avatar generation and compatibility assessment based on the user's detailed profile information, significantly improving the user experience.

[0819] "User input means" means a device or interface through which a user inputs their profile information.

[0820] "Generation information" is data used to generate avatars and conversation content based on the profile information entered by the user.

[0821] The "avatar generation means" is a device or system for generating an avatar that virtually represents a user based on the generation information.

[0822] The "virtual conversation generating means" is a device or system that generates conversation content for avatars to converse with each other in real time.

[0823] The "simulation generation means" is a device or system that simulates the characteristics and appearance of the future child based on the user's profile information.

[0824] The "suggestion means" is a device or system that analyzes the user's hobbies and preferences and suggests the best date spot or common hobbies.

[0825] The "compatibility determination means" is a device or system that determines the compatibility between users based on the content of the conversation, the results of the simulation, and the like.

[0826] "Display means" refers to a device or interface that visually displays various information and results of the system to the user.

[0827] "Means for users to conduct virtual matchmaking using a smartphone" refers to a device or system that allows users to conduct virtual matchmaking using their own avatars using a smartphone.

[0828] The "conversation generation means for generating conversation content in real time" is a device or system that generates conversation content so that users' avatars can have natural conversations in real time.

[0829] In this invention, the following system configuration is required for users to conduct virtual matchmaking using their smartphones: This system includes a user input means, an avatar generation means for generating avatars based on generation information, a virtual conversation generation means for the avatars to converse with each other, a simulation generation means for simulating future children based on the user's profile information, a suggestion means, a compatibility determination means, and a display means.

[0830] A description of what the program does

[0831] User Input Method

[0832] It provides an interface for users to input their profile information (name, age, gender, hobbies, preferences, future goals, etc.) from their smartphones. The input data is sent to the server.

[0833] Avatar generation method

[0834] The server analyzes the received user information using a generative AI model (for example, using TensorFlow or PyTorch) to generate an avatar that represents the user's characteristics. This avatar has multiple features based on the user's hobbies and preferences.

[0835] Virtual conversation generation method

[0836] The server generates conversations between the generated avatars in real time using a generative AI model, which generates conversations naturally based on the users' shared hobbies and interests.

[0837] Simulation Generation Method

[0838] The server simulates the characteristics of the future child based on the user's profile information, using the user's genetic profile and a generative AI model to predict the characteristics of the future child.

[0839] Proposal means

[0840] The generative AI model analyzes the user's interests and preferences and generates a list of suggestions for suitable date locations and shared hobbies. The server then sends this list to the smartphone and displays it.

[0841] Compatibility determination method

[0842] Based on the content of the virtual matchmaking session and the simulation results, the server determines compatibility using a generative AI model to calculate a compatibility score that takes into account the content of the conversation and shared interests and preferences.

[0843] Display means

[0844] All results (avatars, virtual conversations, simulated future children, date suggestions, and compatibility scores) are displayed on the smartphone screen.

[0845] Specific examples

[0846] 1. User registration prompt

[0847] Name: User A

[0848] Age: 30

[0849] Gender: Male

[0850] Hobbies: Watching movies

[0851] Future goal: Travel the world

[0852] 2. Matchmaking prompts

[0853] User ID: 1

[0854] 3. Future Baby Simulation Prompt

[0855] User ID: 1

[0856] Match ID: 2

[0857] 4. Compatibility score prompt

[0858] User ID: 1

[0859] In this way, users can input detailed profile information via their smartphones, and receive real-time avatar generation and virtual conversations using generative AI models, simulations of future children, suggestions for date locations, and compatibility assessments. This system can accurately assess compatibility between users and provide a realistic virtual matchmaking experience.

[0860] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0861] Step 1: User Registration

[0862] Users use their smartphones to enter profile information such as their name, age, gender, hobbies, preferences, and future goals into a registration form, and the device then sends this input data to the server.

[0863] Input: User profile information (name, age, gender, hobbies, preferences, future goals)

[0864] Output: User profile information sent to the server

[0865] Step 2: Profile analysis and avatar generation

[0866] The server stores the received user information in a database. It then uses a generative AI model (using TensorFlow or PyTorch) to analyze the user information and extract detailed features. Based on these features, it generates an avatar that virtually represents the user.

[0867] Input: User profile information stored on the server

[0868] Output: Generated virtual avatar

[0869] Step 3: Save your avatar

[0870] The server stores the generated avatar information in a database, where the user ID and corresponding avatar information are recorded.

[0871] Input: Generated virtual avatar

[0872] Output: Avatar information stored in the database

[0873] Step 4: Matching users

[0874] The server retrieves information about other users from a database and searches for compatible pairs. To do this, it uses a generative AI model to calculate the similarity of each user's feature vectors and selects a partner with high similarity.

[0875] Input: Multiple user profile information stored in a database

[0876] Output: Pairing information of compatible users

[0877] Step 5: Schedule a virtual meeting

[0878] When the server finds a compatible user pair, it sets a date and time for the virtual matchmaking and sends that information to the user's device, which then notifies the user of the date and time of the matchmaking.

[0879] Input: Pairing information of compatible users

[0880] Output: Notification of matchmaking date and time

[0881] Step 6: Conduct a virtual matchmaking session

[0882] When a user logs in to the system at the designated time, the device starts a virtual matchmaking session. The server uses a generative AI model to generate a conversation between the avatars in real time and sends it to the device. The device then displays the conversation to the user, updating it in real time.

[0883] Input: User login to the system, date and time of the matchmaking

[0884] Output: Real-time generated conversation

[0885] Step 7: Simulating your future child

[0886] During the virtual matchmaking session, the server simulates the future child based on the profiles of both parties. Using a generative AI model, it predicts the characteristics of the future child based on the genetic profiles and common characteristics of both parties, and sends the results to the device. The device then displays the simulated child to the user.

[0887] Input: Profile information of both users

[0888] Output: Simulation results of future children

[0889] Step 8: Suggesting date locations and common hobbies

[0890] Using a generative AI model, the server analyzes the user's hobbies and preferences to generate a list of suitable date locations and common hobbies. The server then sends this list to the device, which then displays it to the user.

[0891] Input: User's hobbies and preferences

[0892] Output: A list of suggested date locations and common interests

[0893] Step 9: Compatibility assessment and feedback

[0894] After the virtual matchmaking session ends, the server analyzes the session content and evaluates compatibility. Using a generative AI model, the server calculates a compatibility score by comprehensively considering the content of the conversation, shared interests, and future simulation results. The server then sends this compatibility score to the device, which then provides feedback to the user.

[0895] Input: Virtual matchmaking session details, common hobbies, future simulation results

[0896] Output: Compatibility score and feedback

[0897] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0898] This invention combines an emotion engine with a system that generates an avatar based on a user's detailed profile information and determines compatibility through virtual matchmaking, recognizing and analyzing the user's emotional state in real time. This system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility determination means, a display means, and an emotion engine.

[0899] System construction details

[0900] To implement this system, a server, a device, and a user are required. The server uses a generative AI and an emotion engine to analyze the user's profile information, generate an avatar, generate virtual conversations, assess compatibility, suggest date locations, and simulate future children. The device receives input from the user and communicates with the server to display the information. The emotion engine analyzes the user's facial expressions and voice to recognize their emotional state in real time.

[0901] What the program does

[0902] User Registration

[0903] The user accesses the system and selects new registration on the login screen. The terminal displays a registration form and asks for information such as name, age, gender, hobbies, preferences, and future goals. When the user enters the required information and presses the submit button, the terminal sends the input data to the server.

[0904] Profile analysis and avatar generation

[0905] The server stores the received user information in a database. The server then calls the generation AI and analyzes the user's profile information. The generation AI extracts features from information such as the user's hobbies and preferences, and generates a virtual avatar. The server then stores the generated avatar information in a database.

[0906] Setting up a virtual matchmaking session

[0907] The server searches for compatible pairs among registered users and calculates the similarity based on the feature vectors. The server then generates pairs of users with high similarity and stores their information. The server then sets the date and time of the virtual matchmaking and sends that information to the target user's device. The device then notifies the user of the date and time of the matchmaking.

[0908] Virtual matchmaking

[0909] When a user logs in to the system at a specified time, the device starts a virtual matchmaking session. The server calls a generation AI to generate conversations between avatars in real time. The generation AI generates the conversation content and the avatars interact with each other. The device displays the generated conversation content to the user in real time.

[0910] Emotion analysis using an emotion engine

[0911] During a virtual matchmaking session, the emotion engine analyzes the user's facial expressions and voice in real time to recognize their emotional state, which is then fed back to the generative AI, which dynamically adjusts the conversation to match the user's emotional state.

[0912] Future Baby Simulator

[0913] During the matchmaking process, the server simulates the future child based on the profiles of both parties. The generation AI predicts the characteristics of the future child based on the genetic profiles and common characteristics of both parties. The server sends the simulation results to the device, which then displays the simulation results of the future child to the user.

[0914] Suggestions for date locations and common hobbies

[0915] The AI ​​analyzes the user's hobbies and preferences and selects the best date location and shared hobbies. The server generates a list of potential date locations and shared hobbies and sends it to the device. The device then displays the list of potential date locations and shared hobbies to the user.

[0916] Compatibility assessment and feedback

[0917] Once the session is over, the server analyzes the content of the virtual matchmaking session and evaluates compatibility. The generating AI calculates a compatibility score by comprehensively taking into account the content of the conversation, common interests, future simulation results, and perceived emotional state. The server generates a compatibility score and feedback and sends it to the device. The device then provides the compatibility score and feedback to the user.

[0918] Specific examples

[0919] 1. User Registration

[0920] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his or her hobbies.

[0921] User B logs in in the same way and enters "listening to music" and "tennis" as his hobbies.

[0922] 2. Profile Analysis

[0923] The server stores information about users A and B, analyzes it using a generation AI, and generates avatars for each.

[0924] User A's avatar is holding a movie reel, and User B's avatar is holding a tennis racket.

[0925] 3. Virtual matchmaking

[0926] The server finds user C, who shares the same hobby of watching movies, and sets a date and time for a matchmaking meeting between user A and user C and notifies them.

[0927] 4. Virtual matchmaking

[0928] User A and User C log in at the specified time. Their avatars talk about "movies they've recently seen" in the virtual space.

[0929] 5. Emotion analysis using an emotion engine

[0930] During the virtual conversation, the emotion engine analyzes User A's facial expressions and voice and detects "fun."

[0931] The generative AI recognizes "fun" and expands the conversation into even more fun topics.

[0932] 6. Future Baby Simulation

[0933] During the conversation, the server simulates the future children of user A and user C, displaying the characteristics of children who share the common skills of sports and watching movies.

[0934] 7. Suggesting date spots and common hobbies

[0935] The generative AI suggests movie theaters and cooking classes and displays them on the device.

[0936] 8. Compatibility assessment and feedback

[0937] After the session ends, the server calculates a compatibility score based on the conversation content, simulation results, and emotional state, and provides feedback such as "Compatibility score: 85%."

[0938] The above is a specific embodiment of the present invention.

[0939] The processing flow will be explained below.

[0940] Step 1: User Registration

[0941] 1.1 The user accesses the system and enters personal information on the new registration screen.

[0942] 1.2 The device will display a registration form and ask you to enter your name, age, gender, hobbies, preferences, future goals, etc.

[0943] 1.3 The user enters the required information and presses the send button.

[0944] 1.4 The terminal sends the entered data to the server.

[0945] Step 2: Profile analysis and avatar generation

[0946] 2.1 The server stores the received user information in a database.

[0947] 2.2 The server calls the generation AI and analyzes the user's profile information.

[0948] 2.3 Generative AI extracts features from information such as the user's hobbies and preferences and generates a virtual avatar.

[0949] 2.4 The server stores the generated avatar information in a database.

[0950] Step 3: Set up a virtual matchmaking session

[0951] 3.1 The server calculates the similarity based on the feature vectors to find compatible pairs among the registered users.

[0952] 3.2 The server generates pairs of users with high similarity and stores their information.

[0953] 3.3 The server will set the date and time of the virtual matchmaking and send that information to the target user's device.

[0954] 3.4 The device will notify the user of the date and time of the matchmaking.

[0955] Step 4: Conduct a virtual matchmaking session

[0956] 4.1 The user logs into the system at the designated time.

[0957] 4.2 The device will start the virtual matchmaking session.

[0958] 4.3 The server calls the generation AI to generate conversations between avatars in real time.

[0959] 4.4 The generation AI generates conversation content and conducts dialogue between avatars.

[0960] 4.5 The device displays the generated conversation content to the user in real time.

[0961] Step 5: Emotion analysis using the emotion engine

[0962] 5.1 Users provide facial and audio feedback during virtual matchmaking sessions.

[0963] 5.2 The emotion engine analyzes the user's facial expressions and voice in real time to recognize the user's emotional state.

[0964] 5.3 The server feeds back the emotional state data to the AI ​​generator.

[0965] 5.4 Generative AI dynamically adjusts conversation content based on emotional state feedback.

[0966] Step 6: Simulating the future baby

[0967] 6.1 During the matchmaking process, the server simulates future children based on the profiles of both parties.

[0968] 6.2 Generative AI predicts the characteristics of future children based on the genetic profiles and common characteristics of both parents.

[0969] 6.3 The server sends the simulation results to the terminal.

[0970] 6.4 The device displays the simulation results of the future child to the user.

[0971] Step 7: Suggesting date locations and common hobbies

[0972] 7.1 The generating AI analyzes the user's hobbies and preferences and selects the best date location and common hobbies.

[0973] 7.2 The server generates a list of possible date locations and common interests and sends it to the device.

[0974] 7.3 The device will display a list of possible locations for dates and common interests to the user.

[0975] Step 8: Compatibility assessment and feedback

[0976] 8.1 The server will analyze the content of the virtual matchmaking session and evaluate compatibility.

[0977] 8.2 The generative AI calculates a compatibility score by comprehensively taking into account the content of the conversation, common interests, future simulation results, perceived emotional state, etc.

[0978] 8.3 The server generates a compatibility score and feedback and sends it to the device.

[0979] 8.4 The device will provide users with compatibility scores and feedback.

[0980] Specific examples

[0981] 1. User Registration

[0982] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his or her hobbies.

[0983] User B logs in in the same way and enters "listening to music" and "tennis" as his hobbies.

[0984] 2. Profile Analysis

[0985] The server stores information about users A and B, analyzes it using a generation AI, and generates avatars for each.

[0986] User A's avatar is holding a movie reel, and User B's avatar is holding a tennis racket.

[0987] 3. Virtual matchmaking

[0988] The server finds user C, who shares the same hobby of watching movies, and sets a date and time for a matchmaking meeting between user A and user C and notifies them.

[0989] 4. Virtual matchmaking

[0990] User A and User C log in at the specified time. Their avatars talk about "movies they've recently seen" in the virtual space.

[0991] 5. Emotion analysis using an emotion engine

[0992] During the virtual conversation, the emotion engine analyzes User A's facial expressions and voice and detects "fun."

[0993] The generative AI recognizes "fun" and expands the conversation into even more fun topics.

[0994] 6. Future Baby Simulation

[0995] During the conversation, the server simulates the future children of user A and user C, displaying the characteristics of children who share the common skills of sports and watching movies.

[0996] 7. Suggesting date spots and common hobbies

[0997] The generative AI suggests movie theaters and cooking classes and displays them on the device.

[0998] 8. Compatibility assessment and feedback

[0999] After the session ends, the server calculates a compatibility score based on the conversation content, simulation results, and emotional state, and provides feedback such as "Compatibility score: 85%."

[1000] The above is a specific embodiment of the present invention.

[1001] Example 2

[1002] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1003] Conventional virtual matchmaking systems only determine compatibility based on the user's profile information and hobbies and preferences, and do not take into account the user's real-time emotional state or physiological reactions, which means they are unable to fully assess true compatibility in actual communication. Furthermore, the conversation content is static, meaning it is not possible to dynamically adjust the conversation to match the user's emotional state, which limits the user experience.

[1004] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a user input means, an avatar generation means for generating an avatar based on generation information, a virtual conversation generation means for avatars to converse with each other, a simulation generation means for simulating future children based on the user's profile information, a suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences, a compatibility determination means for determining compatibility based on the content of the conversation and the simulation results, a display means for displaying these, an emotion analysis means for recognizing the user's emotional state in real time by analyzing facial expressions and voice, and a conversation adjustment means for dynamically adjusting the content of the conversation based on the recognized emotional state. This enables natural and dynamic conversation that reflects the user's emotional state in real time, thereby achieving a more accurate compatibility determination that is closer to actual communication.

[1005] "User input means" means an interface device through which a user accesses the system and registers, logs in, and enters profile information.

[1006] The "avatar generation means" is a device that analyzes the user's hobbies and preferences based on the generation information, extracts features, and generates a virtual avatar.

[1007] The "virtual conversation generating means" is a device that generates conversation content in real time for the generated avatars to converse with each other and displays it.

[1008] The "simulation generation means" is a device that simulates the characteristics of the future child based on the user's profile information and generates the results.

[1009] The "suggestion means" is a device that selects the most suitable date location or common hobby based on the user's hobbies and preferences and suggests them to the user.

[1010] The "compatibility determination means" is a device that determines the compatibility between users based on the content of the conversation, the simulation results, the emotional state, and the like.

[1011] The "display means" is a device that displays the generated avatar, conversation content, simulation results, proposal content, compatibility assessment results, etc. to the user.

[1012] The "emotion analysis means" is a device that analyzes the user's facial expressions and voice to recognize their emotional state in real time.

[1013] The "conversation adjustment means" is a device that dynamically adjusts the content of the conversation based on the emotional state recognized by the emotion analysis means.

[1014] The present invention combines an emotion engine with a system that generates an avatar based on a user's detailed profile information and determines compatibility through virtual matchmaking, thereby recognizing and analyzing the user's emotional state in real time. This system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility determination means, a display means, an emotion analysis means, and a conversation adjustment means.

[1015] A detailed explanation of the program's processing

[1016] User Registration

[1017] The user accesses the system and selects new registration on the login screen. The terminal displays a registration form and asks the user to enter information such as name, age, gender, hobbies, preferences, and future goals. When the user enters the required information and presses the submit button, the terminal sends the input data to the server. The server receives the data and stores it in a database.

[1018] Profile analysis and avatar generation

[1019] The server calls the AI ​​based on the received user information and analyzes the user's profile information. The AI ​​extracts features from the user's hobbies and preferences and generates a virtual avatar. The generated avatar information is then stored in a database by the server.

[1020] Setting up a virtual matchmaking session

[1021] The server searches for compatible pairs among registered users and calculates similarity based on feature vectors. It generates pairs of users with high similarity and saves their information. The server then sets the date and time of the virtual matchmaking and sends that information to the target user's device. The device then notifies the user of the date and time of the matchmaking.

[1022] Virtual matchmaking

[1023] When a user logs in to the system at the designated time, the device starts a virtual matchmaking session. The server calls the generation AI to generate conversation content between the avatars in real time. The generated conversation content is sent to the device and displayed to the user.

[1024] Sentiment analysis and conversation adjustment

[1025] During the virtual matchmaking session, the emotion analysis means analyzes the user's facial expressions and voice in real time to recognize the user's emotional state. The recognized emotional state is fed back to the generation AI by the server, and the conversation content is dynamically adjusted to match the user's emotional state.

[1026] Simulation of a child of the future

[1027] During the matchmaking process, the server simulates the future child based on the profiles of both parties. The generative AI predicts the characteristics of the future child based on the genetic profiles and common characteristics of both parties. The simulation results are sent to the device and displayed to the user.

[1028] Suggestions for date locations and common hobbies

[1029] The AI ​​analyzes the user's hobbies and preferences to select the best date locations and common interests. The generated suggestions are sent to the device and displayed to the user.

[1030] Compatibility assessment and feedback

[1031] Once the session is over, the server analyzes the details of the virtual matchmaking session and evaluates compatibility. The AI ​​calculates a compatibility score by comprehensively considering the content of the conversation, common interests, future simulation results, and emotional state. The compatibility score and feedback are sent to the device and provided to the user.

[1032] Examples of specific examples and prompts

[1033] For example, consider the following user registration scenario:

[1034] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his or her hobbies.

[1035] User B logs in in the same way and enters "listening to music" and "tennis" as his hobbies.

[1036] The server stores information about users A and B, analyzes it using a generation AI, and generates avatars for each.

[1037] User A's avatar is holding a movie reel, and User B's avatar is holding a tennis racket.

[1038] An example prompt is:

[1039] Profile Information:

[1040] Name: User A

[1041] Age: 28

[1042] Gender: Female

[1043] Hobbies: Watching movies, cooking

[1044] Hobbies: Comedy movies, French cuisine

[1045] Future goal: To have my own vegetable garden

[1046] Avatar creation requirements:

[1047] Generate an avatar that captures the characteristics of user A based on their profile information

[1048] The avatar reflects user A's hobbies and interests.

[1049] Virtual Conversation Generation Requirements:

[1050] Generate conversations based on the common interests of users A and B

[1051] Dynamically adjust the conversation content by incorporating the analysis results of the emotion engine during the conversation.

[1052] The above is a specific embodiment for carrying out the invention. This system, which involves the server, terminals, and users working together, analyzes users' emotions in real time, and enables accurate compatibility assessment through virtual matchmaking that is close to real communication.

[1053] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1054] Step 1:

[1055] User Registration

[1056] Input: The user accesses the system and enters information such as name, age, gender, hobbies, preferences, and future goals.

[1057] Specific operation: The terminal receives information entered by the user. When the user presses the send button, the input data is sent from the terminal to the server.

[1058] Data processing: The server converts the received data into the required format and stores it in the database.

[1059] Output: User information data stored on the server.

[1060] Step 2:

[1061] Profile analysis and avatar generation

[1062] Input: User information data stored on the server.

[1063] Specific operation: The server calls the generation AI and analyzes the saved user information. The generation AI extracts features from information such as hobbies and preferences.

[1064] Data processing: Generative AI generates a virtual avatar based on the features.

[1065] Output: The server saves the generated avatar information in the database.

[1066] Step 3:

[1067] Setting up a virtual matchmaking session

[1068] Input: All user profile data and avatar information stored on our servers.

[1069] Specific operation: The server searches for compatible pairs among registered users and calculates the similarity based on the feature vector. It selects pairs with high similarity and sets a date and time for the virtual matchmaking. The set date and time and pair information are sent to the target user's device.

[1070] Data processing: The server saves the calculated similarity and the set date and time information.

[1071] Output: The device notifies the user of the date and time of the matchmaking and the other person's information.

[1072] Step 4:

[1073] Virtual matchmaking

[1074] Input: User login information and the scheduled date and time of the matchmaking.

[1075] How it works: When a user logs in to the system at the specified time, the device starts a virtual matchmaking session. The server calls the generation AI to generate conversation content between the avatars in real time. The generated conversation content is sent to the device and displayed to the user.

[1076] Data processing: Conversation content data generated by the generative AI.

[1077] Output: The conversation is displayed in real time on the user's device.

[1078] Step 5:

[1079] Sentiment analysis and conversation adjustment

[1080] Input: Facial and voice data of the user during the virtual matchmaking session.

[1081] Specific operation: The emotion analysis means analyzes the user's facial expressions and voice in real time to recognize the user's emotional state. Based on the recognized emotional state, the server provides feedback to the generation AI. The generation AI dynamically adjusts the content of the conversation according to the emotional state.

[1082] Data processing: Emotional state data from emotion analysis and adjusted conversation content data.

[1083] Output: Dynamically adjusted conversation content displayed on the user's device.

[1084] Step 6:

[1085] Simulation of a child of the future

[1086] Input: Profile data of both users in the virtual matchmaking session.

[1087] How it works: The server simulates the future child based on the profiles of both users. The generation AI predicts the child's characteristics based on the genetic profiles and common traits of both users. The simulation results are sent to the device.

[1088] Data processing: Simulation result data generated by generative AI.

[1089] Output: Simulation results of the future child displayed on the user's device.

[1090] Step 7:

[1091] Suggestions for date locations and common hobbies

[1092] Input: User preferences data.

[1093] Specific operation: The generating AI analyzes the user's hobbies and preferences and selects the best date location and common hobbies.

[1094] Data processing: Analyzed hobby and preference data and proposal candidate data.

[1095] Output: A list of potential date locations and common interests displayed on the user's device.

[1096] Step 8:

[1097] Compatibility assessment and feedback

[1098] Input: Content data of the virtual matchmaking session, emotional state data, simulation result data, etc.

[1099] Specific operation: After the session ends, the server comprehensively analyzes all data and uses the generation AI to calculate a compatibility score. Feedback content is generated along with the compatibility score and sent to the device.

[1100] Data processing: Analysis results and generated compatibility score data and feedback data.

[1101] Output: Compatibility score and feedback displayed on the user's device.

[1102] (Application example 2)

[1103] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1104] In recent years, the evolution of interaction technologies in virtual spaces has led to an increasing need for improving user experiences. However, conventional virtual interaction systems have struggled to recognize a user's emotional state in real time and dynamically respond based on that state. Furthermore, it has been rare for systems to provide recommendations tailored to individual needs based on the user's profile information. This has led to problems such as a lack of user engagement and satisfaction, making it difficult to provide a satisfying interaction experience.

[1105] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a user input means, an avatar generation means for generating an avatar based on generation information, a virtual conversation generation means for avatars to converse with each other, a simulation generation means for simulating future children based on the user's profile information, a suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences, a compatibility determination means for determining compatibility based on the content of the conversation and the simulation results, an emotion engine for analyzing the user's facial expressions and voice to recognize the user's emotional state in real time, a recommendation means for recommending products according to the emotional state, and a display means for displaying these. This makes it possible to recognize the user's emotional state in real time and make appropriate recommendations based on that state.

[1106] "User input means" refers to an interface that allows users to input data such as profile information, hobbies, and preferences into the system.

[1107] The "avatar generation means" is a system part that generates a virtual avatar by analyzing the user's profile information and hobbies and preferences based on the generation information.

[1108] The "virtual conversation generation means" is a system part that generates conversation content in real time for the generated avatars to converse with each other.

[1109] The "simulation generation means" is the part of the system that creates a simulation of the future child based on the user's profile information.

[1110] The "suggestion means" is the part of the system that suggests the best date spot or common hobbies based on the user's hobbies and preferences.

[1111] The "compatibility determination means" is the system part that determines the compatibility between users based on the content of the conversation, the simulation results, the recognized emotional state, etc.

[1112] The "display means" is an interface for displaying to the user the generated avatar, the content of the conversation, the suggested date location, the compatibility assessment results, etc.

[1113] The "emotion engine" is the part of the system that analyzes the user's facial expressions and voice in real time and recognizes their emotional state.

[1114] The "recommendation means" is the part of the system that recommends the most appropriate products and services based on the user's emotional state.

[1115] This invention generates an avatar based on a user's detailed profile information, and recognizes and analyzes the user's emotional state in real time by combining an emotion engine with a system that judges compatibility through virtual matchmaking. The system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility judgment means, a display means, an emotion engine, and a recommendation means.

[1116] composition

[1117] To implement this system, the following hardware and software are required:

[1118] Hardware: smart glasses (e.g., Google Glass), head-mounted displays (e.g., Oculus Quest), servers, and user devices

[1119] Software: Emotion engine (e.g., Affectiva SDK), generative AI engine (e.g., OpenAI GPT-4)

[1120] What the program does

[1121] Overall system flow

[1122] 1. User Registration:

[1123] Users access the virtual store by wearing smart glasses or a head-mounted display, and fill out a registration form to enter their profile information, including their name, age, gender, hobbies, preferences, and goals.

[1124] The server receives the user's input and stores it in a database.

[1125] 2. Profile analysis and avatar generation:

[1126] The server calls the AI ​​generator, extracts features from the user's detailed profile information, and generates a virtual avatar, which is then sent to the user's device and displayed.

[1127] 3. Directions to the virtual store:

[1128] Once registration is complete, a user avatar is generated and guides them around the virtual store. The emotion engine analyzes the user's facial expressions and voice to provide real-time feedback on their emotional state.

[1129] 4. Emotion engine and product recommendations:

[1130] During a virtual conversation, the emotion engine analyzes the user's facial expressions and comments to recognize emotions such as "interest," "surprise," and "happiness." Based on these emotional states, the generative AI recommends the most suitable products to the user. This data is fed back to the server and used to improve the experience in future visits.

[1131] 5. Data Collection and Analysis:

[1132] User responses and purchase history during the shopping session are collected in a database and analyzed to provide a more personalized experience in the future.

[1133] Examples and prompts

[1134] 1. User Registration:

[1135] The user puts on the smart glasses and the screen where they enter their information displays the message, "Please enter your user information: name, age, gender, hobbies, preferences, and goals."

[1136] 2. Avatar generation:

[1137] The prompt to be entered for the generation AI is, "Please generate an avatar based on the information entered. We will generate an avatar with characteristics that match your hobbies and preferences."

[1138] 3. Real-time sentiment analysis:

[1139] The prompt for the emotion engine states, "Analyze the user's facial expressions and voice to recognize and analyze their emotional state in real time."

[1140] 4. Product recommendation:

[1141] The prompt for the AI ​​generator was, "Recommend products that the user might be interested in based on their emotional state. Consider their purchase history and reflect it in your next recommendation."

[1142] As described above, the present invention allows users to enjoy shopping in a virtual store while having their emotional state recognized in real time, and by providing an individually personalized experience, it is possible to improve user satisfaction.

[1143] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1144] Step 1:

[1145] Users access the virtual store by wearing smart glasses or a head-mounted display. They enter their profile information, such as their name, age, gender, hobbies, preferences, and goals, into a new registration form. This information is sent from the device to the server, where it is stored in a database.

[1146] Step 2:

[1147] The server receives the user information and calls the AI ​​to extract features from the user's detailed profile information. Based on these extracted features, it generates a virtual avatar. The generated avatar information is then stored in a database.

[1148] Step 3:

[1149] The generated avatar is sent to the user's device and displayed on the user's screen. When the user accesses the virtual store, the avatar guides the user around the store. During the guidance, the emotion engine analyzes the user's facial expressions and voice in real time and feeds back their emotional state to the server.

[1150] Step 4:

[1151] During interactions in the virtual store, the emotion engine analyzes the user's facial expressions and voice to recognize their emotional state in real time. The recognized emotions are fed back to the generative AI and used as input to recommend products appropriate for the user's "interest" or "joy."

[1152] Step 5:

[1153] The server calls the AI ​​based on the user's emotional state and recommends suitable products to the user. For example, if the user expresses "joy," the AI ​​selects products that match that emotion and sends them to the user's device as suggestions. The user can then view the recommended products through an avatar.

[1154] Step 6:

[1155] At each step during a shopping session, the user's reactions and purchase history are sent from the device to a server, which stores the collected data in a database and analyzes it for future personalized experiences. The analysis results are then reflected in future recommendations and interactions.

[1156] Step 7:

[1157] Once the entire session is over, the user exits the virtual store experience, removes the smart glasses or head-mounted display, and the server stores all data and prepares the next time the user logs in for an optimized interaction.

[1158] The above processing flow allows users to enjoy shopping in a virtual store while having their emotional state recognized in real time, and by providing an individually personalized experience, user satisfaction can be improved.

[1159] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1160] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1161] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1162] [Third embodiment]

[1163] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1164] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1165] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1166] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1167] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1168] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1169] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1170] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1171] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1172] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1173] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1174] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1175] The present invention is a system that generates an avatar based on detailed user profile information and determines compatibility through virtual matchmaking. The system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility determination means, and a display means.

[1176] System construction details

[1177] To implement this system, a server, a device, and a user are required. The server uses generative AI to analyze the user's profile information, generate avatars, generate virtual conversations, assess compatibility, suggest date locations, and perform simulations. The device receives input from the user, communicates with the server, and displays the information.

[1178] What the program does

[1179] User Registration

[1180] The user accesses the system and selects new registration on the login screen. The terminal displays a registration form and asks for information such as name, age, gender, hobbies, preferences, and future goals. When the user enters the required information and presses the submit button, the terminal sends the input data to the server.

[1181] Profile analysis and avatar generation

[1182] The server stores the received user information in a database. The server then invokes the generation AI to analyze the user's characteristics. The generation AI extracts multidimensional features from the user's profile data and generates a virtual avatar. The server then stores the generated avatar information in a database.

[1183] Virtual matchmaking

[1184] The server searches for compatible pairs among registered users and calculates similarity using feature vectors. The server then generates pairs of users with high similarity and saves their information. The server then sets the date and time of the virtual matchmaking and sends that information to the target user's device. The device then notifies the user of the date and time of the matchmaking.

[1185] Virtual matchmaking

[1186] When a user logs in to the system at the specified time, the device starts a virtual matchmaking session. The server calls a generation AI to generate a conversation between avatars in real time. The generation AI generates a conversation between avatars based on the conversation content and simulation results. The device displays the conversation content to the user and updates it in real time.

[1187] Future Baby Simulator

[1188] During the matchmaking process, the server simulates the future child based on the profiles of both parties. The generation AI predicts the characteristics of the future child based on the genetic profiles and common characteristics of both parties. The server sends the simulation results to the device, which then displays the simulation results of the future child to the user.

[1189] Suggestions for date locations and common hobbies

[1190] The AI ​​analyzes the user's hobbies and preferences and selects the best date location. The server generates a list of potential date locations and common hobbies and sends it to the device. The device then displays the list of potential date locations and common hobbies to the user.

[1191] Compatibility assessment and feedback

[1192] Once the session is over, the server analyzes the content of the virtual matchmaking session and evaluates compatibility. The AI ​​calculates a compatibility score that comprehensively takes into account the content of the conversation, common hobbies, future simulations, etc. The server generates feedback along with the compatibility score and sends it to the device. The device then provides the compatibility score and feedback to the user.

[1193] Specific examples

[1194] 1. User Registration

[1195] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his or her hobbies.

[1196] User B logs in in the same way and enters "listening to music" and "tennis" as his hobbies.

[1197] 2. Profile Analysis

[1198] The server stores information about users A and B, analyzes it using a generation AI, and generates avatars for each.

[1199] User A's avatar is holding a movie reel, and User B's avatar is holding a tennis racket.

[1200] 3. Virtual matchmaking

[1201] The server finds user C, who shares the same hobby of watching movies, and sets a date and time for a matchmaking meeting between user A and user C and notifies them.

[1202] 4. Virtual matchmaking

[1203] User A and User C log in at the specified time. Their avatars talk about "movies they've recently seen" in the virtual space.

[1204] 5. Future Baby Simulation

[1205] During the conversation, the server simulates the future children of user A and user C, displaying the characteristics of children who share the common skills of sports and watching movies.

[1206] 6. Suggesting date spots and common hobbies

[1207] The generative AI suggests movie theaters and cooking classes and displays them on the device.

[1208] 7. Compatibility assessment and feedback

[1209] After the session ends, the server calculates a compatibility score based on the conversation content and simulation results, and provides feedback to User A and User C: "Compatibility score: 85%."

[1210] The above is a specific embodiment of the present invention.

[1211] The processing flow will be explained below.

[1212] Step 1: User Registration

[1213] 1.1 The user accesses the system and enters personal information on the new registration screen.

[1214] 1.2 The device displays an input form and asks the user to enter their name, age, gender, hobbies, preferences, future goals, etc.

[1215] 1.3 The user enters the required information and presses the send button.

[1216] 1.4 The terminal sends the entered data to the server.

[1217] Step 2: Profile analysis and avatar generation

[1218] 2.1 The server stores the received user information in a database.

[1219] 2.2 The server calls the generation AI and analyzes the user's profile information.

[1220] 2.3 Generative AI extracts features from information such as the user's hobbies and preferences and generates a virtual avatar.

[1221] 2.4 The server stores the generated avatar information in a database.

[1222] Step 3: Set up a virtual matchmaking session

[1223] 3.1 The server calculates the similarity based on the feature vectors to find compatible pairs among the registered users.

[1224] 3.2 The server generates pairs of users with high similarity and stores their information.

[1225] 3.3 The server will set the date and time of the virtual matchmaking and send that information to the target user's device.

[1226] 3.4 The device will notify the user of the date and time of the matchmaking.

[1227] Step 4: Conduct a virtual matchmaking session

[1228] 4.1 The user logs into the system at the designated time.

[1229] 4.2 The device will start the virtual matchmaking session.

[1230] 4.3 The server calls the generation AI to generate conversations between avatars in real time.

[1231] 4.4 The generation AI generates conversation content and conducts dialogue between avatars.

[1232] 4.5 The device displays the generated conversation content to the user in real time.

[1233] Step 5: Simulating the future baby

[1234] 5.1 During the virtual matchmaking session, the server will simulate the future children based on the profiles of both parties.

[1235] 5.2 Generative AI predicts the characteristics of future children based on the genetic profiles and common characteristics of both parents.

[1236] 5.3 The server sends the simulation results to the terminal.

[1237] 5.4 The device displays the simulation results of the future child to the user.

[1238] Step 6: Suggesting date locations and common hobbies

[1239] 6.1 The generating AI analyzes the user's hobbies and preferences and selects the best date location and common hobbies.

[1240] 6.2 The server generates a list of possible date locations and common interests and sends it to the device.

[1241] 6.3 The device will display a list of possible locations for dates and common interests to the user.

[1242] Step 7: Compatibility assessment and feedback

[1243] 7.1 The server will analyze the content of the virtual matchmaking session and evaluate compatibility.

[1244] 7.2 The generation AI calculates a compatibility score by comprehensively taking into account the content of the conversation, common hobbies, future simulations, etc.

[1245] 7.3 The server generates a compatibility score and feedback and sends it to the device.

[1246] 7.4 The device will provide users with compatibility scores and feedback.

[1247] Example 1

[1248] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1249] Conventional online matchmaking systems generate avatars based on detailed user profile information, and when conducting virtual conversations, the judgement of compatibility is unclear. Furthermore, they lack additional features such as the ability to select a date location or simulate future children, making it difficult to improve the user experience.

[1250] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1251] In this invention, the server includes an avatar generation means for generating an avatar based on the generation information, a simulation generation means for simulating future children based on the user's profile information, and a suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences, thereby enabling precise avatar generation based on the user's detailed profile, a simulation of future children, and suggestions for optimal date locations.

[1252] "User input means" refers to the interface through which users input personal information, hobbies, and preferences into the system.

[1253] The "avatar generation means for generating an avatar based on generation information" is a system element that analyzes multidimensional features based on user input information and generates a virtual avatar.

[1254] The "virtual conversation generation means" is a function that generates conversation content in real time when the generated avatars converse with each other.

[1255] The "simulation generation means for simulating future children based on the user's profile information" is a function that analyzes the user's genetic information and profile and predicts the characteristics and special skills of the child that will be born in the future.

[1256] "A suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences" is a function that analyzes the user's hobbies and preferences and suggests the most suitable date locations and common hobbies.

[1257] The "compatibility determination means for determining compatibility based on the content of conversations and simulation results" is a function that analyzes the content of conversations between avatars and the results of simulations, and quantifies and determines the compatibility between users.

[1258] "Display means" refers to an interface that visually displays information and suggestions generated by the system to the user.

[1259] The "date and time setting means for setting and notifying the date and time of the matchmaking" is a function for setting the date and time of the virtual matchmaking and notifying the user of that information.

[1260] The present invention is a system that generates an avatar based on detailed user profile information and determines compatibility through virtual matchmaking. The system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility determination means, a display means, and a date and time setting means that sets and notifies the user of the date and time of the matchmaking.

[1261] System construction details

[1262] To implement this system, a server, a terminal, and a user are required. Specifically, the following hardware and software are used:

[1263] 1. Server: Analyzes user profile information using generation AI, generates avatars, generates virtual conversations, assesses compatibility, suggests date locations, and simulates children.

[1264] 2. Terminal: Receives input from the user, communicates with the server, and displays information. To perform these operations, the terminal accesses the system via a web browser or mobile application.

[1265] 3. User: Access the system, enter profile information, and participate in virtual matchmaking.

[1266] Details of what the program does

[1267] User Registration

[1268] The user accesses the system and selects new registration. The terminal displays a registration form, and the user enters information such as name, age, gender, hobbies, preferences, and future goals. The entered information is sent from the terminal to the server, where it is stored in a database.

[1269] Profile analysis and avatar generation

[1270] The server then calls the generation AI based on the received user information to analyze the user's characteristics. The generation AI extracts multidimensional features and generates a virtual avatar based on the user's hobbies and preferences. The generated avatar information is then stored in a database.

[1271] Setting up a virtual matchmaking session

[1272] The server selects users with many common hobbies and preferences from among multiple registered users, calculates similarities using feature vectors, creates pairs of users with many common interests, sets a date and time for a virtual matchmaking session, and notifies the target users' devices.

[1273] Virtual matchmaking

[1274] The user logs in to the system at a specified time, and the device starts a virtual matchmaking session. The server calls the generation AI to generate a conversation between the avatars in real time. The conversation content is periodically sent to the device and displayed to the user in real time.

[1275] Future Baby Simulator

[1276] During the conversation, the server simulates the future child based on the user's profile information. The generation AI analyzes the user's genetic information and predicts the child's characteristics and special skills. The simulation results are sent to the user's device and displayed to the user.

[1277] Suggestions for date locations and common hobbies

[1278] The AI ​​analyzes the user's hobbies and preferences to suggest the best date locations and shared hobbies. The server generates a list of suggested locations and sends it to the device. The device then displays the list of potential locations for dates and shared hobbies to the user.

[1279] Compatibility assessment and feedback

[1280] Once the session is over, the server uses the generative AI to analyze the conversation and simulation results and calculate a compatibility score, which is then sent to the device and displayed to the user.

[1281] Specific examples

[1282] User Registration:

[1283] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his hobbies. User B also logs in and enters "listening to music" and "tennis" as his hobbies.

[1284] Profile Analysis:

[1285] The server stores information about users A and B, and uses the AI ​​to generate avatars for each user. User A's avatar holds a film reel, and user B's avatar holds a tennis racket.

[1286] Virtual Matchmaking:

[1287] The server finds user C, who shares the same hobby of watching movies, and sets a date and time for a matchmaking meeting between user A and user C and notifies them.

[1288] Conducting virtual matchmaking:

[1289] User A and User C log in at the specified time. Their avatars talk about "movies they've recently seen" in the virtual space.

[1290] Future Baby Simulator:

[1291] During the conversation, the server simulates the future children of User A and User C. It displays the characteristics of children who share common skills of sports and watching movies.

[1292] Suggestions for date locations and common interests:

[1293] The generative AI suggests movie theaters and cooking classes and displays them on the device.

[1294] Compatibility assessment and feedback:

[1295] After the session ends, the server calculates a compatibility score based on the conversation content and simulation results, and provides feedback to User A and User C: "Compatibility score: 85%."

[1296] Example prompts: "User A: My hobbies are watching movies and cooking." "User B: My hobbies are listening to music and playing tennis." "User C: My hobbies are watching movies."

[1297] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1298] Step 1: User Registration

[1299] User: Accesses the system and selects new registration. Enters information such as name, age, gender, hobbies, preferences, and future goals.

[1300] Input: User profile information (name, age, gender, hobbies, preferences, future goals, etc.).

[1301] Output: The terminal sends the entered information to the server.

[1302] Terminal: Displays a registration form containing various data fields. When the user enters information and presses the submit button, the form data is sent to the server.

[1303] Specific actions: For example, a user enters "watching movies" and "cooking" as hobbies in a form and clicks the submit button.

[1304] Input: User-entered form data.

[1305] Output: The raw user data sent to the server.

[1306] Step 2: Profile analysis and avatar generation

[1307] Server: Stores the received user information in a database, then invokes the generative AI model to analyze the user's characteristics.

[1308] Input: User profile data.

[1309] Output: The saved data and the analysis request sent to the generating AI.

[1310] Generative AI: Extracts multidimensional features from user profile data and generates a virtual avatar.

[1311] Specific operation: Based on the user's hobby of "watching movies," an avatar holding a movie film is generated.

[1312] Input: User profile data.

[1313] Output: Generated avatar data (e.g., avatar holding a film reel).

[1314] Server: Stores the generated avatar information in a database.

[1315] Input: Avatar data generated by the generative AI.

[1316] Output: Data stored in the database.

[1317] Step 3: Set up a virtual matchmaking session

[1318] Server: Searches for compatible pairs from multiple registered users and calculates similarity using feature vectors.

[1319] Input: Profile data for multiple users.

[1320] Output: A pair of compatible users.

[1321] Server: Creates pairs of users with high similarity and stores their information in a database. Sets the date and time for the virtual matchmaking and notifies the target user's device.

[1322] Specific operation: Create a pair of users A and C who share a common interest in watching movies, set a date and time, and receive a notification.

[1323] Input: A compatible user pair.

[1324] Output: Database storage and notification data.

[1325] Terminal: Notifies the user of the date and time of the matchmaking.

[1326] Input: Notification data from the server.

[1327] Output: Notification information that is displayed to the user.

[1328] Step 4: Conduct a virtual matchmaking session

[1329] User: Log in to the system at a specified time.

[1330] Input: Notification of matchmaking date and time.

[1331] Output: Logged in to the system.

[1332] Terminal: Start a virtual matchmaking session.

[1333] Specific operation: The user is presented with a virtual space where avatars can interact with each other.

[1334] Input: User login data.

[1335] Output: Virtual space display.

[1336] Server: Calls the generative AI model and generates conversations between avatars in real time.

[1337] Input: User profile data and matchmaking information.

[1338] Output: Real-time generated conversation data.

[1339] Server: Sends the generated conversation content to the terminal.

[1340] Input: Conversational data generated by generative AI.

[1341] Output: Data sent to the terminal.

[1342] Device: Displays the conversation to the user and updates it in real time.

[1343] Input: Conversation data from the server.

[1344] Output: The conversation that is displayed.

[1345] Step 5: Simulating the future baby

[1346] Server: During the matchmaking process, a simulation of future children is performed based on the profiles of both parties.

[1347] Input: Matchmaking pair profile data.

[1348] Output: A simulation request for a future child.

[1349] Generative AI: Predicts the characteristics of future children based on the genetic profiles and shared traits of both parents.

[1350] Specific operation: Generate a future child that reflects the common skill of user A and user C, "sports."

[1351] Input: Pair profile data.

[1352] Output: Simulation results of future children.

[1353] Server: Sends the simulation results to the terminal.

[1354] Input: Simulation results from generative AI.

[1355] Output: Data sent to the terminal.

[1356] Terminal: Displays the simulation results of the future child to the user.

[1357] Input: Simulation result transmission data.

[1358] Output: Simulation results that are displayed to the user.

[1359] Step 6: Suggesting date locations and common hobbies

[1360] Generative AI: Analyzes the user's hobbies and preferences and selects the best date location.

[1361] Input: User profile data.

[1362] Output: A request for suggestions on date locations and common interests.

[1363] Server: Generates a list of possible date locations and common hobbies and sends it to the device.

[1364] Specific actions: Suggest going to the cinema or a cooking class.

[1365] Input: Suggested results from generative AI.

[1366] Output: Data sent to the terminal.

[1367] Device: Shows users a list of potential dates and common interests.

[1368] Input: Proposal submission data.

[1369] Output: The suggestion that is displayed to the user.

[1370] Step 7: Compatibility assessment and feedback

[1371] Server: Analyzes the content of the session using a generation AI and evaluates compatibility.

[1372] Input: Session data (conversation content, simulation results, etc.).

[1373] Output: A request to calculate the compatibility score.

[1374] Generative AI: Calculates compatibility scores by comprehensively taking into account conversation content, common hobbies, future simulations, etc.

[1375] Specific actions: Evaluate common interests and the level of conversation excitement.

[1376] Input: Session analysis data.

[1377] Output: Compatibility score.

[1378] Server: Generates compatibility scores and feedback and sends them to the device.

[1379] Input: Compatibility score generated by the generated AI.

[1380] Output: Sending feedback data.

[1381] Device: Providing compatibility scores and feedback to users.

[1382] Input: Submit feedback data.

[1383] Output: The feedback that is displayed to the user.

[1384] (Application example 1)

[1385] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1386] Conventional virtual matchmaking systems often lack accuracy in determining compatibility using detailed user profile information, making it difficult to improve the user experience. Furthermore, it is difficult to implement multiple functions, such as real-time conversation generation, simulation of future children, and date suggestions, making comprehensive evaluation difficult.

[1387] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1388] In this invention, the server includes a user input means, an avatar generation means for generating avatars based on the generation information, a virtual conversation generation means for the avatars to converse with each other, a simulation generation means for simulating future children based on the user's profile information, a suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences, a means for the user to conduct a virtual matchmaking meeting using a smartphone, a conversation generation means for generating conversation content in real time, and a display means for displaying these. This enables highly accurate avatar generation and compatibility assessment based on the user's detailed profile information, significantly improving the user experience.

[1389] "User input means" means a device or interface through which a user inputs their profile information.

[1390] "Generation information" is data used to generate avatars and conversation content based on the profile information entered by the user.

[1391] The "avatar generation means" is a device or system for generating an avatar that virtually represents a user based on the generation information.

[1392] The "virtual conversation generating means" is a device or system that generates conversation content for avatars to converse with each other in real time.

[1393] The "simulation generation means" is a device or system that simulates the characteristics and appearance of the future child based on the user's profile information.

[1394] The "suggestion means" is a device or system that analyzes the user's hobbies and preferences and suggests the best date spot or common hobbies.

[1395] The "compatibility determination means" is a device or system that determines the compatibility between users based on the content of the conversation, the results of the simulation, and the like.

[1396] "Display means" refers to a device or interface that visually displays various information and results of the system to the user.

[1397] "Means for users to conduct virtual matchmaking using a smartphone" refers to a device or system that allows users to conduct virtual matchmaking using their own avatars using a smartphone.

[1398] The "conversation generation means for generating conversation content in real time" is a device or system that generates conversation content so that users' avatars can have natural conversations in real time.

[1399] In this invention, the following system configuration is required for a user to conduct a virtual matchmaking session using a smartphone: This system includes a user input means, an avatar generation means for generating an avatar based on generation information, a virtual conversation generation means for the avatars to converse with each other, a simulation generation means for simulating future children based on the user's profile information, a suggestion means, a compatibility determination means, and a display means.

[1400] A description of what the program does

[1401] User Input Method

[1402] It provides an interface for users to input their profile information (name, age, gender, hobbies, preferences, future goals, etc.) from their smartphones. The input data is sent to the server.

[1403] Avatar generation method

[1404] The server analyzes the received user information using a generative AI model (for example, using TensorFlow or PyTorch) to generate an avatar that represents the user's characteristics. This avatar has multiple features based on the user's hobbies and preferences.

[1405] Virtual conversation generation method

[1406] The server generates conversations between the generated avatars in real time using a generative AI model, which generates conversations naturally based on the users' shared hobbies and interests.

[1407] Simulation Generation Method

[1408] The server simulates the characteristics of the future child based on the user's profile information, using the user's genetic profile and a generative AI model to predict the characteristics of the future child.

[1409] Proposal means

[1410] The generative AI model analyzes the user's interests and preferences and generates a list of suggestions for suitable date locations and shared hobbies. The server then sends this list to the smartphone and displays it.

[1411] Compatibility determination method

[1412] Based on the content of the virtual matchmaking session and the simulation results, the server determines compatibility using a generative AI model to calculate a compatibility score that takes into account the content of the conversation and shared interests and preferences.

[1413] Display means

[1414] All results (avatars, virtual conversations, simulated future children, date suggestions, and compatibility scores) are displayed on the smartphone screen.

[1415] Specific examples

[1416] 1. User registration prompt

[1417] Name: User A

[1418] Age: 30

[1419] Gender: Male

[1420] Hobbies: Watching movies

[1421] Future goal: Travel the world

[1422] 2. Matchmaking prompts

[1423] User ID: 1

[1424] 3. Future Baby Simulation Prompt

[1425] User ID: 1

[1426] Match ID: 2

[1427] 4. Compatibility score prompt

[1428] User ID: 1

[1429] In this way, users can input detailed profile information via their smartphones, and receive real-time avatar generation and virtual conversations using generative AI models, simulations of future children, suggestions for date locations, and compatibility assessments. This system can accurately assess compatibility between users and provide a realistic virtual matchmaking experience.

[1430] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1431] Step 1: User Registration

[1432] Users use their smartphones to enter profile information such as their name, age, gender, hobbies, preferences, and future goals into a registration form, and the device then sends this input data to the server.

[1433] Input: User profile information (name, age, gender, hobbies, preferences, future goals)

[1434] Output: User profile information sent to the server

[1435] Step 2: Profile analysis and avatar generation

[1436] The server stores the received user information in a database. It then uses a generative AI model (using TensorFlow or PyTorch) to analyze the user information and extract detailed features. Based on these features, it generates an avatar that virtually represents the user.

[1437] Input: User profile information stored on the server

[1438] Output: Generated virtual avatar

[1439] Step 3: Save your avatar

[1440] The server stores the generated avatar information in a database, where the user ID and the corresponding avatar information are recorded.

[1441] Input: Generated virtual avatar

[1442] Output: Avatar information stored in the database

[1443] Step 4: Matching users

[1444] The server retrieves information about other users from a database and searches for compatible pairs. To do this, it uses a generative AI model to calculate the similarity of each user's feature vectors and selects a partner with high similarity.

[1445] Input: Multiple user profile information stored in a database

[1446] Output: Pairing information of compatible users

[1447] Step 5: Schedule a virtual meeting

[1448] When the server finds a compatible user pair, it sets a date and time for the virtual matchmaking and sends that information to the user's device, which then notifies the user of the date and time of the matchmaking.

[1449] Input: Pairing information of compatible users

[1450] Output: Notification of matchmaking date and time

[1451] Step 6: Conduct a virtual matchmaking session

[1452] When a user logs in to the system at the designated time, the device starts a virtual matchmaking session. The server uses a generative AI model to generate a conversation between the avatars in real time and sends it to the device. The device then displays the conversation to the user, updating it in real time.

[1453] Input: User login to the system, date and time of the matchmaking

[1454] Output: Real-time generated conversation

[1455] Step 7: Simulating your future child

[1456] During the virtual matchmaking session, the server simulates the future child based on the profiles of both parties. Using a generative AI model, it predicts the characteristics of the future child based on the genetic profiles and shared traits of both parties and sends the results to the device. The device then displays the simulated child to the user.

[1457] Input: Profile information of both users

[1458] Output: Simulation results of future children

[1459] Step 8: Suggesting date locations and common hobbies

[1460] Using a generative AI model, the server analyzes the user's hobbies and preferences to generate a list of suitable date locations and common hobbies. The server then sends this list to the device, which then displays it to the user.

[1461] Input: User's hobbies and preferences

[1462] Output: A list of suggested date locations and common interests

[1463] Step 9: Compatibility assessment and feedback

[1464] After the virtual matchmaking session ends, the server analyzes the session content and evaluates compatibility. Using a generative AI model, the server calculates a compatibility score by comprehensively considering the content of the conversation, shared interests, and future simulation results. The server then sends this compatibility score to the device, which then provides feedback to the user.

[1465] Input: Virtual matchmaking session details, common hobbies, future simulation results

[1466] Output: Compatibility score and feedback

[1467] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1468] This invention combines an emotion engine with a system that generates an avatar based on a user's detailed profile information and determines compatibility through virtual matchmaking, recognizing and analyzing the user's emotional state in real time. This system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility determination means, a display means, and an emotion engine.

[1469] System construction details

[1470] To implement this system, a server, a device, and a user are required. The server uses a generative AI and an emotion engine to analyze the user's profile information, generate an avatar, generate virtual conversations, assess compatibility, suggest date locations, and simulate future children. The device receives input from the user and communicates with the server to display the information. The emotion engine analyzes the user's facial expressions and voice to recognize their emotional state in real time.

[1471] What the program does

[1472] User Registration

[1473] The user accesses the system and selects new registration on the login screen. The terminal displays a registration form and asks for information such as name, age, gender, hobbies, preferences, and future goals. When the user enters the required information and presses the submit button, the terminal sends the input data to the server.

[1474] Profile analysis and avatar generation

[1475] The server stores the received user information in a database. The server then calls the generation AI and analyzes the user's profile information. The generation AI extracts features from information such as the user's hobbies and preferences, and generates a virtual avatar. The server then stores the generated avatar information in a database.

[1476] Setting up a virtual matchmaking session

[1477] The server searches for compatible pairs among registered users and calculates the similarity based on the feature vectors. The server then generates pairs of users with high similarity and stores their information. The server then sets the date and time of the virtual matchmaking and sends that information to the target user's device. The device then notifies the user of the date and time of the matchmaking.

[1478] Virtual matchmaking

[1479] When a user logs in to the system at a specified time, the device starts a virtual matchmaking session. The server calls a generation AI to generate conversations between avatars in real time. The generation AI generates the conversation content and the avatars interact with each other. The device displays the generated conversation content to the user in real time.

[1480] Emotion analysis using an emotion engine

[1481] During a virtual matchmaking session, the emotion engine analyzes the user's facial expressions and voice in real time to recognize their emotional state, which is then fed back to the generative AI, which dynamically adjusts the conversation to match the user's emotional state.

[1482] Future Baby Simulator

[1483] During the matchmaking process, the server simulates the future child based on the profiles of both parties. The generation AI predicts the characteristics of the future child based on the genetic profiles and common characteristics of both parties. The server sends the simulation results to the device, which then displays the simulation results of the future child to the user.

[1484] Suggestions for date locations and common hobbies

[1485] The AI ​​analyzes the user's hobbies and preferences and selects the best date location and shared hobbies. The server generates a list of potential date locations and shared hobbies and sends it to the device. The device then displays the list of potential date locations and shared hobbies to the user.

[1486] Compatibility assessment and feedback

[1487] Once the session is over, the server analyzes the content of the virtual matchmaking session and evaluates compatibility. The generating AI calculates a compatibility score by comprehensively taking into account the content of the conversation, common interests, future simulation results, and perceived emotional state. The server generates a compatibility score and feedback and sends it to the device. The device then provides the compatibility score and feedback to the user.

[1488] Specific examples

[1489] 1. User Registration

[1490] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his or her hobbies.

[1491] User B logs in in the same way and enters "listening to music" and "tennis" as his hobbies.

[1492] 2. Profile Analysis

[1493] The server stores information about users A and B, analyzes it using a generation AI, and generates avatars for each.

[1494] User A's avatar is holding a movie reel, and User B's avatar is holding a tennis racket.

[1495] 3. Virtual matchmaking

[1496] The server finds user C, who shares the same hobby of watching movies, and sets a date and time for a matchmaking meeting between user A and user C and notifies them.

[1497] 4. Virtual matchmaking

[1498] User A and User C log in at the specified time. Their avatars talk about "movies they've recently seen" in the virtual space.

[1499] 5. Emotion analysis using an emotion engine

[1500] During the virtual conversation, the emotion engine analyzes User A's facial expressions and voice and detects "fun."

[1501] The generative AI recognizes "fun" and expands the conversation into even more fun topics.

[1502] 6. Future Baby Simulation

[1503] During the conversation, the server simulates the future children of user A and user C, displaying the characteristics of children who share the common skills of sports and watching movies.

[1504] 7. Suggesting date spots and common hobbies

[1505] The generative AI suggests movie theaters and cooking classes and displays them on the device.

[1506] 8. Compatibility assessment and feedback

[1507] After the session ends, the server calculates a compatibility score based on the conversation content, simulation results, and emotional state, and provides feedback such as "Compatibility score: 85%."

[1508] The above is a specific embodiment of the present invention.

[1509] The processing flow will be explained below.

[1510] Step 1: User Registration

[1511] 1.1 The user accesses the system and enters personal information on the new registration screen.

[1512] 1.2 The device will display a registration form and ask you to enter your name, age, gender, hobbies, preferences, future goals, etc.

[1513] 1.3 The user enters the required information and presses the send button.

[1514] 1.4 The terminal sends the entered data to the server.

[1515] Step 2: Profile analysis and avatar generation

[1516] 2.1 The server stores the received user information in a database.

[1517] 2.2 The server calls the generation AI and analyzes the user's profile information.

[1518] 2.3 Generative AI extracts features from information such as the user's hobbies and preferences and generates a virtual avatar.

[1519] 2.4 The server stores the generated avatar information in a database.

[1520] Step 3: Set up a virtual matchmaking session

[1521] 3.1 The server calculates the similarity based on the feature vectors to find compatible pairs among the registered users.

[1522] 3.2 The server generates pairs of users with high similarity and stores their information.

[1523] 3.3 The server will set the date and time of the virtual matchmaking and send that information to the target user's device.

[1524] 3.4 The device will notify the user of the date and time of the matchmaking.

[1525] Step 4: Conduct a virtual matchmaking session

[1526] 4.1 The user logs into the system at the designated time.

[1527] 4.2 The device will start the virtual matchmaking session.

[1528] 4.3 The server calls the generation AI to generate conversations between avatars in real time.

[1529] 4.4 The generation AI generates conversation content and conducts dialogue between avatars.

[1530] 4.5 The device displays the generated conversation content to the user in real time.

[1531] Step 5: Emotion analysis using the emotion engine

[1532] 5.1 Users provide facial and audio feedback during virtual matchmaking sessions.

[1533] 5.2 The emotion engine analyzes the user's facial expressions and voice in real time to recognize the user's emotional state.

[1534] 5.3 The server feeds back the emotional state data to the AI ​​generator.

[1535] 5.4 Generative AI dynamically adjusts conversation content based on emotional state feedback.

[1536] Step 6: Simulating the future baby

[1537] 6.1 During the matchmaking process, the server simulates future children based on the profiles of both parties.

[1538] 6.2 Generative AI predicts the characteristics of future children based on the genetic profiles and common characteristics of both parents.

[1539] 6.3 The server sends the simulation results to the terminal.

[1540] 6.4 The device displays the simulation results of the future child to the user.

[1541] Step 7: Suggesting date locations and common hobbies

[1542] 7.1 The generating AI analyzes the user's hobbies and preferences and selects the best date location and common hobbies.

[1543] 7.2 The server generates a list of possible date locations and common interests and sends it to the device.

[1544] 7.3 The device will display a list of possible locations for dates and common interests to the user.

[1545] Step 8: Compatibility assessment and feedback

[1546] 8.1 The server will analyze the content of the virtual matchmaking session and evaluate compatibility.

[1547] 8.2 The generative AI calculates a compatibility score by comprehensively taking into account the content of the conversation, common interests, future simulation results, perceived emotional state, etc.

[1548] 8.3 The server generates a compatibility score and feedback and sends it to the device.

[1549] 8.4 The device will provide users with compatibility scores and feedback.

[1550] Specific examples

[1551] 1. User Registration

[1552] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his or her hobbies.

[1553] User B logs in in the same way and enters "listening to music" and "tennis" as his hobbies.

[1554] 2. Profile Analysis

[1555] The server stores information about users A and B, analyzes it using a generation AI, and generates avatars for each.

[1556] User A's avatar is holding a movie reel, and User B's avatar is holding a tennis racket.

[1557] 3. Virtual matchmaking

[1558] The server finds user C, who shares the same hobby of watching movies, and sets a date and time for a matchmaking meeting between user A and user C and notifies them.

[1559] 4. Virtual matchmaking

[1560] User A and User C log in at the specified time. Their avatars talk about "movies they've recently seen" in the virtual space.

[1561] 5. Emotion analysis using an emotion engine

[1562] During the virtual conversation, the emotion engine analyzes User A's facial expressions and voice and detects "fun."

[1563] The generative AI recognizes "fun" and expands the conversation into even more fun topics.

[1564] 6. Future Baby Simulation

[1565] During the conversation, the server simulates the future children of user A and user C, displaying the characteristics of children who share the common skills of sports and watching movies.

[1566] 7. Suggesting date spots and common hobbies

[1567] The generative AI suggests movie theaters and cooking classes and displays them on the device.

[1568] 8. Compatibility assessment and feedback

[1569] After the session ends, the server calculates a compatibility score based on the conversation content, simulation results, and emotional state, and provides feedback such as "Compatibility score: 85%."

[1570] The above is a specific embodiment of the present invention.

[1571] Example 2

[1572] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1573] Conventional virtual matchmaking systems only determine compatibility based on the user's profile information and hobbies and preferences, and do not take into account the user's real-time emotional state or physiological reactions, which means they are unable to fully assess true compatibility in actual communication. Furthermore, the conversation content is static, meaning it is not possible to dynamically adjust the conversation to match the user's emotional state, which limits the user experience.

[1574] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a user input means, an avatar generation means for generating an avatar based on generation information, a virtual conversation generation means for avatars to converse with each other, a simulation generation means for simulating future children based on the user's profile information, a suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences, a compatibility determination means for determining compatibility based on the content of the conversation and the simulation results, a display means for displaying these, an emotion analysis means for recognizing the user's emotional state in real time by analyzing facial expressions and voice, and a conversation adjustment means for dynamically adjusting the content of the conversation based on the recognized emotional state. This enables natural and dynamic conversation that reflects the user's emotional state in real time, thereby achieving a more accurate compatibility determination that is closer to actual communication.

[1575] "User input means" means an interface device through which a user accesses the system and registers, logs in, and enters profile information.

[1576] The "avatar generation means" is a device that analyzes the user's hobbies and preferences based on the generation information, extracts features, and generates a virtual avatar.

[1577] The "virtual conversation generating means" is a device that generates conversation content in real time for the generated avatars to converse with each other and displays it.

[1578] The "simulation generation means" is a device that simulates the characteristics of the future child based on the user's profile information and generates the results.

[1579] The "suggestion means" is a device that selects the most suitable date location or common hobby based on the user's hobbies and preferences and suggests them to the user.

[1580] The "compatibility determination means" is a device that determines the compatibility between users based on the content of the conversation, the simulation results, the emotional state, and the like.

[1581] The "display means" is a device that displays the generated avatar, conversation content, simulation results, proposal content, compatibility assessment results, etc. to the user.

[1582] The "emotion analysis means" is a device that analyzes the user's facial expressions and voice to recognize their emotional state in real time.

[1583] The "conversation adjustment means" is a device that dynamically adjusts the content of the conversation based on the emotional state recognized by the emotion analysis means.

[1584] The present invention combines an emotion engine with a system that generates an avatar based on a user's detailed profile information and determines compatibility through virtual matchmaking, thereby recognizing and analyzing the user's emotional state in real time. This system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility determination means, a display means, an emotion analysis means, and a conversation adjustment means.

[1585] A detailed explanation of the program's processing

[1586] User Registration

[1587] The user accesses the system and selects new registration on the login screen. The terminal displays a registration form and asks the user to enter information such as name, age, gender, hobbies, preferences, and future goals. When the user enters the required information and presses the submit button, the terminal sends the input data to the server. The server receives the data and stores it in a database.

[1588] Profile analysis and avatar generation

[1589] The server calls the AI ​​based on the received user information and analyzes the user's profile information. The AI ​​extracts features from the user's hobbies and preferences and generates a virtual avatar. The generated avatar information is then stored in a database by the server.

[1590] Setting up a virtual matchmaking session

[1591] The server searches for compatible pairs among registered users and calculates similarity based on feature vectors. It generates pairs of users with high similarity and saves their information. The server then sets the date and time of the virtual matchmaking and sends that information to the target user's device. The device then notifies the user of the date and time of the matchmaking.

[1592] Virtual matchmaking

[1593] When a user logs in to the system at the designated time, the device starts a virtual matchmaking session. The server calls the generation AI to generate conversation content between the avatars in real time. The generated conversation content is sent to the device and displayed to the user.

[1594] Sentiment analysis and conversation adjustment

[1595] During the virtual matchmaking session, the emotion analysis means analyzes the user's facial expressions and voice in real time to recognize the user's emotional state. The recognized emotional state is fed back to the generation AI by the server, and the conversation content is dynamically adjusted to match the user's emotional state.

[1596] Simulation of a child of the future

[1597] During the matchmaking process, the server simulates the future child based on the profiles of both parties. The generative AI predicts the characteristics of the future child based on the genetic profiles and common characteristics of both parties. The simulation results are sent to the device and displayed to the user.

[1598] Suggestions for date locations and common hobbies

[1599] The AI ​​analyzes the user's hobbies and preferences to select the best date locations and common interests. The generated suggestions are sent to the device and displayed to the user.

[1600] Compatibility assessment and feedback

[1601] Once the session is over, the server analyzes the details of the virtual matchmaking session and evaluates compatibility. The AI ​​calculates a compatibility score by comprehensively considering the content of the conversation, common interests, future simulation results, and emotional state. The compatibility score and feedback are sent to the device and provided to the user.

[1602] Examples of specific examples and prompts

[1603] For example, consider the following user registration scenario:

[1604] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his or her hobbies.

[1605] User B logs in in the same way and enters "listening to music" and "tennis" as his hobbies.

[1606] The server stores information about users A and B, analyzes it using a generation AI, and generates avatars for each.

[1607] User A's avatar is holding a movie reel, and User B's avatar is holding a tennis racket.

[1608] An example prompt is:

[1609] Profile Information:

[1610] Name: User A

[1611] Age: 28

[1612] Gender: Female

[1613] Hobbies: Watching movies, cooking

[1614] Hobbies: Comedy movies, French cuisine

[1615] Future goal: To have my own vegetable garden

[1616] Avatar creation requirements:

[1617] Generate an avatar that captures the characteristics of user A based on their profile information

[1618] The avatar reflects user A's hobbies and interests.

[1619] Virtual Conversation Generation Requirements:

[1620] Generate conversations based on the common interests of users A and B

[1621] Dynamically adjust the conversation content by incorporating the analysis results of the emotion engine during the conversation.

[1622] The above is a specific embodiment for carrying out the invention. This system, which involves the server, terminals, and users working together, analyzes users' emotions in real time, and enables accurate compatibility assessment through virtual matchmaking that is close to real communication.

[1623] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1624] Step 1:

[1625] User Registration

[1626] Input: The user accesses the system and enters information such as name, age, gender, hobbies, preferences, and future goals.

[1627] Specific operation: The terminal receives information entered by the user. When the user presses the send button, the input data is sent from the terminal to the server.

[1628] Data processing: The server converts the received data into the required format and stores it in the database.

[1629] Output: User information data stored on the server.

[1630] Step 2:

[1631] Profile analysis and avatar generation

[1632] Input: User information data stored on the server.

[1633] Specific operation: The server calls the generation AI and analyzes the saved user information. The generation AI extracts features from information such as hobbies and preferences.

[1634] Data processing: Generative AI generates a virtual avatar based on the features.

[1635] Output: The server saves the generated avatar information in the database.

[1636] Step 3:

[1637] Setting up a virtual matchmaking session

[1638] Input: All user profile data and avatar information stored on our servers.

[1639] Specific operation: The server searches for compatible pairs among registered users and calculates the similarity based on the feature vector. It selects pairs with high similarity and sets a date and time for the virtual matchmaking. The set date and time and pair information are sent to the target user's device.

[1640] Data processing: The server saves the calculated similarity and the set date and time information.

[1641] Output: The device notifies the user of the date and time of the matchmaking and the other person's information.

[1642] Step 4:

[1643] Virtual matchmaking

[1644] Input: User login information and the scheduled date and time of the matchmaking.

[1645] How it works: When a user logs in to the system at the specified time, the device starts a virtual matchmaking session. The server calls the generation AI to generate conversation content between the avatars in real time. The generated conversation content is sent to the device and displayed to the user.

[1646] Data processing: Conversation content data generated by the generative AI.

[1647] Output: The conversation is displayed in real time on the user's device.

[1648] Step 5:

[1649] Sentiment analysis and conversation adjustment

[1650] Input: Facial and voice data of the user during the virtual matchmaking session.

[1651] Specific operation: The emotion analysis means analyzes the user's facial expressions and voice in real time to recognize the user's emotional state. Based on the recognized emotional state, the server provides feedback to the generation AI. The generation AI dynamically adjusts the content of the conversation according to the emotional state.

[1652] Data processing: Emotional state data from emotion analysis and adjusted conversation content data.

[1653] Output: Dynamically adjusted conversation content displayed on the user's device.

[1654] Step 6:

[1655] Simulation of a child of the future

[1656] Input: Profile data of both users in the virtual matchmaking session.

[1657] How it works: The server simulates the future child based on the profiles of both users. The generation AI predicts the child's characteristics based on the genetic profiles and common traits of both users. The simulation results are sent to the device.

[1658] Data processing: Simulation result data generated by generative AI.

[1659] Output: Simulation results of the future child displayed on the user's device.

[1660] Step 7:

[1661] Suggestions for date locations and common hobbies

[1662] Input: User preferences data.

[1663] Specific operation: The generating AI analyzes the user's hobbies and preferences and selects the best date location and common hobbies.

[1664] Data processing: Analyzed hobby and preference data and proposal candidate data.

[1665] Output: A list of potential date locations and common interests displayed on the user's device.

[1666] Step 8:

[1667] Compatibility assessment and feedback

[1668] Input: Content data of the virtual matchmaking session, emotional state data, simulation result data, etc.

[1669] Specific operation: After the session ends, the server comprehensively analyzes all data and uses the generation AI to calculate a compatibility score. Feedback content is generated along with the compatibility score and sent to the device.

[1670] Data processing: Analysis results and generated compatibility score data and feedback data.

[1671] Output: Compatibility score and feedback displayed on the user's device.

[1672] (Application example 2)

[1673] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1674] In recent years, the evolution of interaction technologies in virtual spaces has led to an increasing need for improving user experiences. However, conventional virtual interaction systems have struggled to recognize a user's emotional state in real time and dynamically respond based on that state. Furthermore, it has been rare for systems to provide recommendations tailored to individual needs based on the user's profile information. This has led to problems such as a lack of user engagement and satisfaction, making it difficult to provide a satisfying interaction experience.

[1675] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a user input means, an avatar generation means for generating an avatar based on generation information, a virtual conversation generation means for avatars to converse with each other, a simulation generation means for simulating future children based on the user's profile information, a suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences, a compatibility determination means for determining compatibility based on the content of the conversation and the simulation results, an emotion engine for analyzing the user's facial expressions and voice to recognize the user's emotional state in real time, a recommendation means for recommending products according to the emotional state, and a display means for displaying these. This makes it possible to recognize the user's emotional state in real time and make appropriate recommendations based on that state.

[1676] "User input means" refers to an interface that allows users to input data such as profile information, hobbies, and preferences into the system.

[1677] The "avatar generation means" is a system part that generates a virtual avatar by analyzing the user's profile information and hobbies and preferences based on the generation information.

[1678] The "virtual conversation generation means" is a system part that generates conversation content in real time for the generated avatars to converse with each other.

[1679] The "simulation generation means" is the part of the system that creates a simulation of the future child based on the user's profile information.

[1680] The "suggestion means" is the part of the system that suggests the best date spot or common hobbies based on the user's hobbies and preferences.

[1681] The "compatibility determination means" is the system part that determines the compatibility between users based on the content of the conversation, the simulation results, the recognized emotional state, etc.

[1682] The "display means" is an interface for displaying to the user the generated avatar, the content of the conversation, the suggested date location, the compatibility assessment results, etc.

[1683] The "emotion engine" is the part of the system that analyzes the user's facial expressions and voice in real time and recognizes their emotional state.

[1684] The "recommendation means" is the part of the system that recommends the most appropriate products and services based on the user's emotional state.

[1685] This invention generates an avatar based on a user's detailed profile information, and recognizes and analyzes the user's emotional state in real time by combining an emotion engine with a system that judges compatibility through virtual matchmaking. The system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility judgment means, a display means, an emotion engine, and a recommendation means.

[1686] composition

[1687] To implement this system, the following hardware and software are required:

[1688] Hardware: smart glasses (e.g., Google Glass), head-mounted displays (e.g., Oculus Quest), servers, and user devices

[1689] Software: Emotion engine (e.g., Affectiva SDK), generative AI engine (e.g., OpenAI GPT-4)

[1690] What the program does

[1691] Overall system flow

[1692] 1. User Registration:

[1693] Users access the virtual store by wearing smart glasses or a head-mounted display, and fill out a registration form to enter their profile information, including their name, age, gender, hobbies, preferences, and goals.

[1694] The server receives the user's input and stores it in a database.

[1695] 2. Profile analysis and avatar generation:

[1696] The server calls the AI ​​generator, extracts features from the user's detailed profile information, and generates a virtual avatar, which is then sent to the user's device and displayed.

[1697] 3. Directions to the virtual store:

[1698] Once registration is complete, a user avatar is generated and guides them around the virtual store. The emotion engine analyzes the user's facial expressions and voice to provide real-time feedback on their emotional state.

[1699] 4. Emotion engine and product recommendations:

[1700] During a virtual conversation, the emotion engine analyzes the user's facial expressions and comments to recognize emotions such as "interest," "surprise," and "happiness." Based on these emotional states, the generative AI recommends the most suitable products to the user. This data is fed back to the server and used to improve the experience in future visits.

[1701] 5. Data Collection and Analysis:

[1702] User responses and purchase history during the shopping session are collected in a database and analyzed to provide a more personalized experience in the future.

[1703] Examples and prompts

[1704] 1. User Registration:

[1705] The user puts on the smart glasses and the screen where they enter their information displays the message, "Please enter your user information: name, age, gender, hobbies, preferences, and goals."

[1706] 2. Avatar generation:

[1707] The prompt to be entered for the generation AI is, "Please generate an avatar based on the information entered. We will generate an avatar with characteristics that match your hobbies and preferences."

[1708] 3. Real-time sentiment analysis:

[1709] The prompt for the emotion engine states, "Analyze the user's facial expressions and voice to recognize and analyze their emotional state in real time."

[1710] 4. Product recommendation:

[1711] The prompt for the AI ​​generator was, "Recommend products that the user might be interested in based on their emotional state. Consider their purchase history and reflect it in your next recommendation."

[1712] As described above, the present invention allows users to enjoy shopping in a virtual store while having their emotional state recognized in real time, and by providing an individually personalized experience, it is possible to improve user satisfaction.

[1713] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1714] Step 1:

[1715] Users access the virtual store by wearing smart glasses or a head-mounted display. They enter their profile information, such as their name, age, gender, hobbies, preferences, and goals, into a new registration form. This information is sent from the device to the server, where it is stored in a database.

[1716] Step 2:

[1717] The server receives the user information and calls the AI ​​to extract features from the user's detailed profile information. Based on these extracted features, it generates a virtual avatar. The generated avatar information is then stored in a database.

[1718] Step 3:

[1719] The generated avatar is sent to the user's device and displayed on the user's screen. When the user accesses the virtual store, the avatar guides the user around the store. During the guidance, the emotion engine analyzes the user's facial expressions and voice in real time and feeds back their emotional state to the server.

[1720] Step 4:

[1721] During interactions in the virtual store, the emotion engine analyzes the user's facial expressions and voice to recognize their emotional state in real time. The recognized emotions are fed back to the generative AI and used as input to recommend products appropriate for the user's "interest" or "joy."

[1722] Step 5:

[1723] The server calls the AI ​​based on the user's emotional state and recommends suitable products to the user. For example, if the user expresses "joy," the AI ​​selects products that match that emotion and sends them to the user's device as suggestions. The user can then view the recommended products through an avatar.

[1724] Step 6:

[1725] At each step during a shopping session, the user's reactions and purchase history are sent from the device to a server, which stores the collected data in a database and analyzes it for future personalized experiences. The analysis results are then reflected in future recommendations and interactions.

[1726] Step 7:

[1727] Once the entire session is over, the user exits the virtual store experience, removes the smart glasses or head-mounted display, and the server stores all data and prepares the next time the user logs in for an optimized interaction.

[1728] The above processing flow allows users to enjoy shopping in a virtual store while having their emotional state recognized in real time, and by providing an individually personalized experience, user satisfaction can be improved.

[1729] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1730] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1731] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1732] [Fourth embodiment]

[1733] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1734] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1735] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1736] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1737] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1738] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1739] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1740] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1741] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1742] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1743] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1744] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1745] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1746] The present invention is a system that generates an avatar based on detailed user profile information and determines compatibility through virtual matchmaking. The system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility determination means, and a display means.

[1747] System construction details

[1748] To implement this system, a server, a device, and a user are required. The server uses generative AI to analyze the user's profile information, generate avatars, generate virtual conversations, assess compatibility, suggest date locations, and perform simulations. The device receives input from the user, communicates with the server, and displays the information.

[1749] What the program does

[1750] User Registration

[1751] The user accesses the system and selects new registration on the login screen. The terminal displays a registration form and asks for information such as name, age, gender, hobbies, preferences, and future goals. When the user enters the required information and presses the submit button, the terminal sends the input data to the server.

[1752] Profile analysis and avatar generation

[1753] The server stores the received user information in a database. The server then invokes the generation AI to analyze the user's characteristics. The generation AI extracts multidimensional features from the user's profile data and generates a virtual avatar. The server then stores the generated avatar information in a database.

[1754] Virtual matchmaking

[1755] The server searches for compatible pairs among registered users and calculates similarity using feature vectors. The server then generates pairs of users with high similarity and saves their information. The server then sets the date and time of the virtual matchmaking and sends that information to the target user's device. The device then notifies the user of the date and time of the matchmaking.

[1756] Virtual matchmaking

[1757] When a user logs in to the system at the specified time, the device starts a virtual matchmaking session. The server calls a generation AI to generate a conversation between avatars in real time. The generation AI generates a conversation between avatars based on the conversation content and simulation results. The device displays the conversation content to the user and updates it in real time.

[1758] Future Baby Simulator

[1759] During the matchmaking process, the server simulates the future child based on the profiles of both parties. The generation AI predicts the characteristics of the future child based on the genetic profiles and common characteristics of both parties. The server sends the simulation results to the device, which then displays the simulation results of the future child to the user.

[1760] Suggestions for date locations and common hobbies

[1761] The AI ​​analyzes the user's hobbies and preferences and selects the best date location. The server generates a list of potential date locations and common hobbies and sends it to the device. The device then displays the list of potential date locations and common hobbies to the user.

[1762] Compatibility assessment and feedback

[1763] Once the session is over, the server analyzes the content of the virtual matchmaking session and evaluates compatibility. The AI ​​calculates a compatibility score that comprehensively takes into account the content of the conversation, common hobbies, future simulations, etc. The server generates feedback along with the compatibility score and sends it to the device. The device then provides the compatibility score and feedback to the user.

[1764] Specific examples

[1765] 1. User Registration

[1766] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his or her hobbies.

[1767] User B logs in in the same way and enters "listening to music" and "tennis" as his hobbies.

[1768] 2. Profile Analysis

[1769] The server stores information about users A and B, analyzes it using a generation AI, and generates avatars for each.

[1770] User A's avatar is holding a movie reel, and User B's avatar is holding a tennis racket.

[1771] 3. Virtual matchmaking

[1772] The server finds user C, who shares the same hobby of watching movies, and sets a date and time for a matchmaking meeting between user A and user C and notifies them.

[1773] 4. Virtual matchmaking

[1774] User A and User C log in at the specified time. Their avatars talk about "movies they've recently seen" in the virtual space.

[1775] 5. Future Baby Simulation

[1776] During the conversation, the server simulates the future children of user A and user C, displaying the characteristics of children who share the common skills of sports and watching movies.

[1777] 6. Suggesting date spots and common hobbies

[1778] The generative AI suggests movie theaters and cooking classes and displays them on the device.

[1779] 7. Compatibility assessment and feedback

[1780] After the session ends, the server calculates a compatibility score based on the conversation content and simulation results, and provides feedback to User A and User C: "Compatibility score: 85%."

[1781] The above is a specific embodiment of the present invention.

[1782] The processing flow will be explained below.

[1783] Step 1: User Registration

[1784] 1.1 The user accesses the system and enters personal information on the new registration screen.

[1785] 1.2 The device displays an input form and asks the user to enter their name, age, gender, hobbies, preferences, future goals, etc.

[1786] 1.3 The user enters the required information and presses the send button.

[1787] 1.4 The terminal sends the entered data to the server.

[1788] Step 2: Profile analysis and avatar generation

[1789] 2.1 The server stores the received user information in a database.

[1790] 2.2 The server calls the generation AI and analyzes the user's profile information.

[1791] 2.3 Generative AI extracts features from information such as the user's hobbies and preferences and generates a virtual avatar.

[1792] 2.4 The server stores the generated avatar information in a database.

[1793] Step 3: Set up a virtual matchmaking session

[1794] 3.1 The server calculates the similarity based on the feature vectors to find compatible pairs among the registered users.

[1795] 3.2 The server generates pairs of users with high similarity and stores their information.

[1796] 3.3 The server will set the date and time of the virtual matchmaking and send that information to the target user's device.

[1797] 3.4 The device will notify the user of the date and time of the matchmaking.

[1798] Step 4: Conduct a virtual matchmaking session

[1799] 4.1 The user logs into the system at the designated time.

[1800] 4.2 The device will start the virtual matchmaking session.

[1801] 4.3 The server calls the generation AI to generate conversations between avatars in real time.

[1802] 4.4 The generation AI generates conversation content and conducts dialogue between avatars.

[1803] 4.5 The device displays the generated conversation content to the user in real time.

[1804] Step 5: Simulating the future baby

[1805] 5.1 During the virtual matchmaking session, the server will simulate the future children based on the profiles of both parties.

[1806] 5.2 Generative AI predicts the characteristics of future children based on the genetic profiles and common characteristics of both parents.

[1807] 5.3 The server sends the simulation results to the terminal.

[1808] 5.4 The device displays the simulation results of the future child to the user.

[1809] Step 6: Suggesting date locations and common hobbies

[1810] 6.1 The generating AI analyzes the user's hobbies and preferences and selects the best date location and common hobbies.

[1811] 6.2 The server generates a list of possible date locations and common interests and sends it to the device.

[1812] 6.3 The device will display a list of possible locations for dates and common interests to the user.

[1813] Step 7: Compatibility assessment and feedback

[1814] 7.1 The server will analyze the content of the virtual matchmaking session and evaluate compatibility.

[1815] 7.2 The generation AI calculates a compatibility score by comprehensively taking into account the content of the conversation, common hobbies, future simulations, etc.

[1816] 7.3 The server generates a compatibility score and feedback and sends it to the device.

[1817] 7.4 The device will provide users with compatibility scores and feedback.

[1818] Example 1

[1819] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1820] Conventional online matchmaking systems generate avatars based on detailed user profile information, and when conducting virtual conversations, the judgement of compatibility is unclear. Furthermore, they lack additional features such as the ability to select a date location or simulate future children, making it difficult to improve the user experience.

[1821] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1822] In this invention, the server includes an avatar generation means for generating an avatar based on the generation information, a simulation generation means for simulating future children based on the user's profile information, and a suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences, thereby enabling precise avatar generation based on the user's detailed profile, a simulation of future children, and suggestions for optimal date locations.

[1823] "User input means" refers to the interface through which users input personal information, hobbies, and preferences into the system.

[1824] The "avatar generation means for generating an avatar based on generation information" is a system element that analyzes multidimensional features based on user input information and generates a virtual avatar.

[1825] The "virtual conversation generation means" is a function that generates conversation content in real time when the generated avatars converse with each other.

[1826] The "simulation generation means for simulating future children based on the user's profile information" is a function that analyzes the user's genetic information and profile and predicts the characteristics and special skills of the child that will be born in the future.

[1827] "A suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences" is a function that analyzes the user's hobbies and preferences and suggests the most suitable date locations and common hobbies.

[1828] The "compatibility determination means for determining compatibility based on the content of conversations and simulation results" is a function that analyzes the content of conversations between avatars and the results of simulations, and quantifies and determines the compatibility between users.

[1829] "Display means" refers to an interface that visually displays information and suggestions generated by the system to the user.

[1830] The "date and time setting means for setting and notifying the date and time of the matchmaking" is a function for setting the date and time of the virtual matchmaking and notifying the user of that information.

[1831] The present invention is a system that generates an avatar based on detailed user profile information and determines compatibility through virtual matchmaking. The system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility determination means, a display means, and a date and time setting means that sets and notifies the user of the date and time of the matchmaking.

[1832] System construction details

[1833] To implement this system, a server, a terminal, and a user are required. Specifically, the following hardware and software are used:

[1834] 1. Server: Analyzes user profile information using generation AI, generates avatars, generates virtual conversations, assesses compatibility, suggests date locations, and simulates children.

[1835] 2. Terminal: Receives input from the user, communicates with the server, and displays information. To perform these operations, the terminal accesses the system via a web browser or mobile application.

[1836] 3. User: Access the system, enter profile information, and participate in virtual matchmaking.

[1837] Details of what the program does

[1838] User Registration

[1839] The user accesses the system and selects new registration. The terminal displays a registration form, and the user enters information such as name, age, gender, hobbies, preferences, and future goals. The entered information is sent from the terminal to the server, where it is stored in a database.

[1840] Profile analysis and avatar generation

[1841] The server then calls the generation AI based on the received user information to analyze the user's characteristics. The generation AI extracts multidimensional features and generates a virtual avatar based on the user's hobbies and preferences. The generated avatar information is then stored in a database.

[1842] Setting up a virtual matchmaking session

[1843] The server selects users with many common hobbies and preferences from among multiple registered users, calculates similarities using feature vectors, creates pairs of users with many common interests, sets a date and time for a virtual matchmaking session, and notifies the target users' devices.

[1844] Virtual matchmaking

[1845] The user logs in to the system at a specified time, and the device starts a virtual matchmaking session. The server calls the generation AI to generate a conversation between the avatars in real time. The conversation content is periodically sent to the device and displayed to the user in real time.

[1846] Future Baby Simulator

[1847] During the conversation, the server simulates the future child based on the user's profile information. The generation AI analyzes the user's genetic information and predicts the child's characteristics and special skills. The simulation results are sent to the user's device and displayed to the user.

[1848] Suggestions for date locations and common hobbies

[1849] The AI ​​analyzes the user's hobbies and preferences to suggest the best date locations and shared hobbies. The server generates a list of suggested locations and sends it to the device. The device then displays the list of potential locations for dates and shared hobbies to the user.

[1850] Compatibility assessment and feedback

[1851] Once the session is over, the server uses the generative AI to analyze the conversation and simulation results and calculate a compatibility score, which is then sent to the device and displayed to the user.

[1852] Specific examples

[1853] User Registration:

[1854] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his hobbies. User B also logs in and enters "listening to music" and "tennis" as his hobbies.

[1855] Profile Analysis:

[1856] The server stores information about users A and B, and uses the AI ​​to generate avatars for each user. User A's avatar holds a film reel, and user B's avatar holds a tennis racket.

[1857] Virtual Matchmaking:

[1858] The server finds user C, who shares the same hobby of watching movies, and sets a date and time for a matchmaking meeting between user A and user C and notifies them.

[1859] Conducting virtual matchmaking:

[1860] User A and User C log in at the specified time. Their avatars talk about "movies they've recently seen" in the virtual space.

[1861] Future Baby Simulator:

[1862] During the conversation, the server simulates the future children of User A and User C. It displays the characteristics of children who share common skills of sports and watching movies.

[1863] Suggestions for date locations and common interests:

[1864] The generative AI suggests movie theaters and cooking classes and displays them on the device.

[1865] Compatibility assessment and feedback:

[1866] After the session ends, the server calculates a compatibility score based on the conversation content and simulation results, and provides feedback to User A and User C: "Compatibility score: 85%."

[1867] Example prompts: "User A: My hobbies are watching movies and cooking." "User B: My hobbies are listening to music and playing tennis." "User C: My hobbies are watching movies."

[1868] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1869] Step 1: User Registration

[1870] User: Accesses the system and selects new registration. Enters information such as name, age, gender, hobbies, preferences, and future goals.

[1871] Input: User profile information (name, age, gender, hobbies, preferences, future goals, etc.).

[1872] Output: The terminal sends the entered information to the server.

[1873] Terminal: Displays a registration form containing various data fields. When the user enters information and presses the submit button, the form data is sent to the server.

[1874] Specific actions: For example, a user enters "watching movies" and "cooking" as hobbies in a form and clicks the submit button.

[1875] Input: User-entered form data.

[1876] Output: The raw user data sent to the server.

[1877] Step 2: Profile analysis and avatar generation

[1878] Server: Stores the received user information in a database, then invokes the generative AI model to analyze the user's characteristics.

[1879] Input: User profile data.

[1880] Output: The saved data and the analysis request sent to the generating AI.

[1881] Generative AI: Extracts multidimensional features from user profile data and generates a virtual avatar.

[1882] Specific operation: Based on the user's hobby of "watching movies," an avatar holding a movie film is generated.

[1883] Input: User profile data.

[1884] Output: Generated avatar data (e.g., avatar holding a film reel).

[1885] Server: Stores the generated avatar information in a database.

[1886] Input: Avatar data generated by the generative AI.

[1887] Output: Data stored in the database.

[1888] Step 3: Set up a virtual matchmaking session

[1889] Server: Searches for compatible pairs from multiple registered users and calculates similarity using feature vectors.

[1890] Input: Profile data for multiple users.

[1891] Output: A pair of compatible users.

[1892] Server: Creates pairs of users with high similarity and stores their information in a database. Sets the date and time for the virtual matchmaking and notifies the target user's device.

[1893] Specific operation: Create a pair of users A and C who share a common interest in watching movies, set a date and time, and receive a notification.

[1894] Input: A compatible user pair.

[1895] Output: Database storage and notification data.

[1896] Terminal: Notifies the user of the date and time of the matchmaking.

[1897] Input: Notification data from the server.

[1898] Output: Notification information that is displayed to the user.

[1899] Step 4: Conduct a virtual matchmaking session

[1900] User: Log in to the system at a specified time.

[1901] Input: Notification of matchmaking date and time.

[1902] Output: Logged in to the system.

[1903] Terminal: Start a virtual matchmaking session.

[1904] Specific operation: The user is presented with a virtual space where avatars can interact with each other.

[1905] Input: User login data.

[1906] Output: Virtual space display.

[1907] Server: Calls the generative AI model and generates conversations between avatars in real time.

[1908] Input: User profile data and matchmaking information.

[1909] Output: Real-time generated conversation data.

[1910] Server: Sends the generated conversation content to the terminal.

[1911] Input: Conversational data generated by generative AI.

[1912] Output: Data sent to the terminal.

[1913] Device: Displays the conversation to the user and updates it in real time.

[1914] Input: Conversation data from the server.

[1915] Output: The conversation that is displayed.

[1916] Step 5: Simulating the future baby

[1917] Server: During the matchmaking process, a simulation of future children is performed based on the profiles of both parties.

[1918] Input: Matchmaking pair profile data.

[1919] Output: A simulation request for a future child.

[1920] Generative AI: Predicts the characteristics of future children based on the genetic profiles and shared traits of both parents.

[1921] Specific operation: Generate a future child that reflects the common skill of user A and user C, "sports."

[1922] Input: Pair profile data.

[1923] Output: Simulation results of future children.

[1924] Server: Sends the simulation results to the terminal.

[1925] Input: Simulation results from generative AI.

[1926] Output: Data sent to the terminal.

[1927] Terminal: Displays the simulation results of the future child to the user.

[1928] Input: Simulation result transmission data.

[1929] Output: Simulation results that are displayed to the user.

[1930] Step 6: Suggesting date locations and common hobbies

[1931] Generative AI: Analyzes the user's hobbies and preferences and selects the best date location.

[1932] Input: User profile data.

[1933] Output: A request for suggestions on date locations and common interests.

[1934] Server: Generates a list of possible date locations and common hobbies and sends it to the device.

[1935] Specific actions: Suggest going to the cinema or a cooking class.

[1936] Input: Suggested results from generative AI.

[1937] Output: Data sent to the terminal.

[1938] Device: Shows users a list of potential dates and common interests.

[1939] Input: Proposal submission data.

[1940] Output: The suggestion that is displayed to the user.

[1941] Step 7: Compatibility assessment and feedback

[1942] Server: Analyzes the content of the session using a generation AI and evaluates compatibility.

[1943] Input: Session data (conversation content, simulation results, etc.).

[1944] Output: A request to calculate the compatibility score.

[1945] Generative AI: Calculates compatibility scores by comprehensively taking into account conversation content, common hobbies, future simulations, etc.

[1946] Specific actions: Evaluate common interests and the level of conversation excitement.

[1947] Input: Session analysis data.

[1948] Output: Compatibility score.

[1949] Server: Generates compatibility scores and feedback and sends them to the device.

[1950] Input: Compatibility score generated by the generated AI.

[1951] Output: Sending feedback data.

[1952] Device: Providing compatibility scores and feedback to users.

[1953] Input: Submit feedback data.

[1954] Output: The feedback that is displayed to the user.

[1955] (Application example 1)

[1956] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1957] Conventional virtual matchmaking systems often lack accuracy in determining compatibility using detailed user profile information, making it difficult to improve the user experience. Furthermore, it is difficult to implement multiple functions, such as real-time conversation generation, simulation of future children, and date suggestions, making comprehensive evaluation difficult.

[1958] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1959] In this invention, the server includes a user input means, an avatar generation means for generating avatars based on the generation information, a virtual conversation generation means for the avatars to converse with each other, a simulation generation means for simulating future children based on the user's profile information, a suggestion means for suggesting date locations and common hobbies based on the user's hobbies and preferences, a means for the user to conduct a virtual matchmaking meeting using a smartphone, a conversation generation means for generating conversation content in real time, and a display means for displaying these. This enables highly accurate avatar generation and compatibility assessment based on the user's detailed profile information, significantly improving the user experience.

[1960] "User input means" means a device or interface through which a user inputs their profile information.

[1961] "Generation information" is data used to generate avatars and conversation content based on the profile information entered by the user.

[1962] The "avatar generation means" is a device or system for generating an avatar that virtually represents a user based on the generation information.

[1963] The "virtual conversation generating means" is a device or system that generates conversation content for avatars to converse with each other in real time.

[1964] The "simulation generation means" is a device or system that simulates the characteristics and appearance of the future child based on the user's profile information.

[1965] The "suggestion means" is a device or system that analyzes the user's hobbies and preferences and suggests the best date spot or common hobbies.

[1966] The "compatibility determination means" is a device or system that determines the compatibility between users based on the content of the conversation, the results of the simulation, and the like.

[1967] "Display means" refers to a device or interface that visually displays various information and results of the system to the user.

[1968] "Means for users to conduct virtual matchmaking using a smartphone" refers to a device or system that allows users to conduct virtual matchmaking using their own avatars using a smartphone.

[1969] The "conversation generation means for generating conversation content in real time" is a device or system that generates conversation content so that users' avatars can have natural conversations in real time.

[1970] In this invention, the following system configuration is required for a user to conduct a virtual matchmaking session using a smartphone: This system includes a user input means, an avatar generation means for generating an avatar based on generation information, a virtual conversation generation means for the avatars to converse with each other, a simulation generation means for simulating future children based on the user's profile information, a suggestion means, a compatibility determination means, and a display means.

[1971] A description of what the program does

[1972] User Input Method

[1973] It provides an interface for users to input their profile information (name, age, gender, hobbies, preferences, future goals, etc.) from their smartphones. The input data is sent to the server.

[1974] Avatar generation method

[1975] The server analyzes the received user information using a generative AI model (for example, using TensorFlow or PyTorch) to generate an avatar that represents the user's characteristics. This avatar has multiple features based on the user's hobbies and preferences.

[1976] Virtual conversation generation method

[1977] The server generates conversations between the generated avatars in real time using a generative AI model, which generates conversations naturally based on the users' shared hobbies and interests.

[1978] Simulation Generation Method

[1979] The server simulates the characteristics of the future child based on the user's profile information, using the user's genetic profile and a generative AI model to predict the characteristics of the future child.

[1980] Proposal means

[1981] The generative AI model analyzes the user's interests and preferences and generates a list of suggestions for suitable date locations and shared hobbies. The server then sends this list to the smartphone and displays it.

[1982] Compatibility determination method

[1983] Based on the content of the virtual matchmaking session and the simulation results, the server determines compatibility using a generative AI model to calculate a compatibility score that takes into account the content of the conversation and shared interests and preferences.

[1984] Display means

[1985] All results (avatars, virtual conversations, simulated future children, date suggestions, and compatibility scores) are displayed on the smartphone screen.

[1986] Specific examples

[1987] 1. User registration prompt

[1988] Name: User A

[1989] Age: 30

[1990] Gender: Male

[1991] Hobbies: Watching movies

[1992] Future goal: Travel the world

[1993] 2. Matchmaking prompts

[1994] User ID: 1

[1995] 3. Future Baby Simulation Prompt

[1996] User ID: 1

[1997] Match ID: 2

[1998] 4. Compatibility score prompt

[1999] User ID: 1

[2000] In this way, users can input detailed profile information via their smartphones, and receive real-time avatar generation and virtual conversations using generative AI models, simulations of future children, suggestions for date locations, and compatibility assessments. This system can accurately assess compatibility between users and provide a realistic virtual matchmaking experience.

[2001] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2002] Step 1: User Registration

[2003] Users use their smartphones to enter profile information such as their name, age, gender, hobbies, preferences, and future goals into a registration form, and the device then sends this input data to the server.

[2004] Input: User profile information (name, age, gender, hobbies, preferences, future goals)

[2005] Output: User profile information sent to the server

[2006] Step 2: Profile analysis and avatar generation

[2007] The server stores the received user information in a database. It then uses a generative AI model (using TensorFlow or PyTorch) to analyze the user information and extract detailed features. Based on these features, it generates an avatar that virtually represents the user.

[2008] Input: User profile information stored on the server

[2009] Output: Generated virtual avatar

[2010] Step 3: Save your avatar

[2011] The server stores the generated avatar information in a database, where the user ID and the corresponding avatar information are recorded.

[2012] Input: Generated virtual avatar

[2013] Output: Avatar information stored in the database

[2014] Step 4: Matching users

[2015] The server retrieves information about other users from a database and searches for compatible pairs. To do this, it uses a generative AI model to calculate the similarity of each user's feature vectors and selects a partner with high similarity.

[2016] Input: Multiple user profile information stored in a database

[2017] Output: Pairing information of compatible users

[2018] Step 5: Schedule a virtual meeting

[2019] When the server finds a compatible user pair, it sets a date and time for the virtual matchmaking and sends that information to the user's device, which then notifies the user of the date and time of the matchmaking.

[2020] Input: Pairing information of compatible users

[2021] Output: Notification of matchmaking date and time

[2022] Step 6: Conduct a virtual matchmaking session

[2023] When a user logs in to the system at the designated time, the device starts a virtual matchmaking session. The server uses a generative AI model to generate a conversation between the avatars in real time and sends it to the device. The device then displays the conversation to the user, updating it in real time.

[2024] Input: User login to the system, date and time of the matchmaking

[2025] Output: Real-time generated conversation

[2026] Step 7: Simulating your future child

[2027] During the virtual matchmaking session, the server simulates the future child based on the profiles of both parties. Using a generative AI model, it predicts the characteristics of the future child based on the genetic profiles and shared traits of both parties and sends the results to the device. The device then displays the simulated child to the user.

[2028] Input: Profile information of both users

[2029] Output: Simulation results of future children

[2030] Step 8: Suggesting date locations and common hobbies

[2031] Using a generative AI model, the server analyzes the user's hobbies and preferences to generate a list of suitable date locations and common hobbies. The server then sends this list to the device, which then displays it to the user.

[2032] Input: User's hobbies and preferences

[2033] Output: A list of suggested date locations and common interests

[2034] Step 9: Compatibility assessment and feedback

[2035] After the virtual matchmaking session ends, the server analyzes the session content and evaluates compatibility. Using a generative AI model, the server calculates a compatibility score by comprehensively considering the content of the conversation, shared interests, and future simulation results. The server then sends this compatibility score to the device, which then provides feedback to the user.

[2036] Input: Virtual matchmaking session details, common hobbies, future simulation results

[2037] Output: Compatibility score and feedback

[2038] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2039] This invention combines an emotion engine with a system that generates an avatar based on a user's detailed profile information and determines compatibility through virtual matchmaking, recognizing and analyzing the user's emotional state in real time. This system includes a user input means, an avatar generation means based on the generated information, a virtual conversation generation means, a simulation generation means, a suggestion means, a compatibility determination means, a display means, and an emotion engine.

[2040] System construction details

[2041] To implement this system, a server, a device, and a user are required. The server uses a generative AI and an emotion engine to analyze the user's profile information, generate an avatar, generate virtual conversations, assess compatibility, suggest date locations, and simulate future children. The device receives input from the user and communicates with the server to display the information. The emotion engine analyzes the user's facial expressions and voice to recognize their emotional state in real time.

[2042] What the program does

[2043] User Registration

[2044] The user accesses the system and selects new registration on the login screen. The terminal displays a registration form and asks for information such as name, age, gender, hobbies, preferences, and future goals. When the user enters the required information and presses the submit button, the terminal sends the input data to the server.

[2045] Profile analysis and avatar generation

[2046] The server stores the received user information in a database. The server then calls the generation AI and analyzes the user's profile information. The generation AI extracts features from information such as the user's hobbies and preferences, and generates a virtual avatar. The server then stores the generated avatar information in a database.

[2047] Setting up a virtual matchmaking session

[2048] The server searches for compatible pairs among registered users and calculates the similarity based on the feature vectors. The server then generates pairs of users with high similarity and stores their information. The server then sets the date and time of the virtual matchmaking and sends that information to the target user's device. The device then notifies the user of the date and time of the matchmaking.

[2049] Virtual matchmaking

[2050] When a user logs in to the system at a specified time, the device starts a virtual matchmaking session. The server calls a generation AI to generate conversations between avatars in real time. The generation AI generates the conversation content and the avatars interact with each other. The device displays the generated conversation content to the user in real time.

[2051] Emotion analysis using an emotion engine

[2052] During a virtual matchmaking session, the emotion engine analyzes the user's facial expressions and voice in real time to recognize their emotional state, which is then fed back to the generative AI, which dynamically adjusts the conversation to match the user's emotional state.

[2053] Future Baby Simulator

[2054] During the matchmaking process, the server simulates the future child based on the profiles of both parties. The generation AI predicts the characteristics of the future child based on the genetic profiles and common characteristics of both parties. The server sends the simulation results to the device, which then displays the simulation results of the future child to the user.

[2055] Suggestions for date locations and common hobbies

[2056] The AI ​​analyzes the user's hobbies and preferences and selects the best date location and shared hobbies. The server generates a list of potential date locations and shared hobbies and sends it to the device. The device then displays the list of potential date locations and shared hobbies to the user.

[2057] Compatibility assessment and feedback

[2058] Once the session is over, the server analyzes the content of the virtual matchmaking session and evaluates compatibility. The generating AI calculates a compatibility score by comprehensively taking into account the content of the conversation, common interests, future simulation results, and perceived emotional state. The server generates a compatibility score and feedback and sends it to the device. The device then provides the compatibility score and feedback to the user.

[2059] Specific examples

[2060] 1. User Registration

[2061] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his or her hobbies.

[2062] User B logs in in the same way and enters "listening to music" and "tennis" as his hobbies.

[2063] 2. Profile Analysis

[2064] The server stores information about users A and B, analyzes it using a generation AI, and generates avatars for each.

[2065] User A's avatar is holding a movie reel, and User B's avatar is holding a tennis racket.

[2066] 3. Virtual matchmaking

[2067] The server finds user C, who shares the same hobby of watching movies, and sets a date and time for a matchmaking meeting between user A and user C and notifies them.

[2068] 4. Virtual matchmaking

[2069] User A and User C log in at the specified time. Their avatars talk about "movies they've recently seen" in the virtual space.

[2070] 5. Emotion Analysis Using an Emotion Engine

[2071] During the virtual conversation, the emotion engine analyzes User A's facial expressions and voice and detects "fun."

[2072] The generative AI recognizes "fun" and expands the conversation into even more fun topics.

[2073] 6. Future Baby Simulation

[2074] During the conversation, the server simulates the future children of user A and user C, displaying the characteristics of children who share the common skills of sports and watching movies.

[2075] 7. Suggesting date spots and common hobbies

[2076] The generative AI suggests movie theaters and cooking classes and displays them on the device.

[2077] 8. Compatibility assessment and feedback

[2078] After the session ends, the server calculates a compatibility score based on the conversation content, simulation results, and emotional state, and provides feedback such as "Compatibility score: 85%."

[2079] The above is a specific embodiment of the present invention.

[2080] The processing flow will be explained below.

[2081] Step 1: User Registration

[2082] 1.1 The user accesses the system and enters personal information on the new registration screen.

[2083] 1.2 The device will display a registration form and ask you to enter your name, age, gender, hobbies, preferences, future goals, etc.

[2084] 1.3 The user enters the required information and presses the send button.

[2085] 1.4 The terminal sends the entered data to the server.

[2086] Step 2: Profile analysis and avatar generation

[2087] 2.1 The server stores the received user information in a database.

[2088] 2.2 The server calls the generation AI and analyzes the user's profile information.

[2089] 2.3 Generative AI extracts features from information such as the user's hobbies and preferences and generates a virtual avatar.

[2090] 2.4 The server stores the generated avatar information in a database.

[2091] Step 3: Set up a virtual matchmaking session

[2092] 3.1 The server calculates the similarity based on the feature vectors to find compatible pairs among the registered users.

[2093] 3.2 The server generates pairs of users with high similarity and stores their information.

[2094] 3.3 The server will set the date and time of the virtual matchmaking and send that information to the target user's device.

[2095] 3.4 The device will notify the user of the date and time of the matchmaking.

[2096] Step 4: Conduct a virtual matchmaking session

[2097] 4.1 The user logs into the system at the designated time.

[2098] 4.2 The device will start the virtual matchmaking session.

[2099] 4.3 The server calls the generation AI to generate conversations between avatars in real time.

[2100] 4.4 The generation AI generates conversation content and conducts dialogue between avatars.

[2101] 4.5 The device displays the generated conversation content to the user in real time.

[2102] Step 5: Emotion analysis using the emotion engine

[2103] 5.1 Users provide facial and audio feedback during virtual matchmaking sessions.

[2104] 5.2 The emotion engine analyzes the user's facial expressions and voice in real time to recognize the user's emotional state.

[2105] 5.3 The server feeds back the emotional state data to the AI ​​generator.

[2106] 5.4 Generative AI dynamically adjusts conversation content based on emotional state feedback.

[2107] Step 6: Simulating the future baby

[2108] 6.1 During the matchmaking process, the server simulates future children based on the profiles of both parties.

[2109] 6.2 Generative AI predicts the characteristics of future children based on the genetic profiles and common characteristics of both parents.

[2110] 6.3 The server sends the simulation results to the terminal.

[2111] 6.4 The device displays the simulation results of the future child to the user.

[2112] Step 7: Suggesting date locations and common hobbies

[2113] 7.1 The generating AI analyzes the user's hobbies and preferences and selects the best date location and common hobbies.

[2114] 7.2 The server generates a list of possible date locations and common interests and sends it to the device.

[2115] 7.3 The device will display a list of possible locations for dates and common interests to the user.

[2116] Step 8: Compatibility assessment and feedback

[2117] 8.1 The server will analyze the content of the virtual matchmaking session and evaluate compatibility.

[2118] 8.2 The generative AI calculates a compatibility score by comprehensively taking into account the content of the conversation, common interests, future simulation results, perceived emotional state, etc.

[2119] 8.3 The server generates a compatibility score and feedback and sends it to the device.

[2120] 8.4 The device will provide users with compatibility scores and feedback.

[2121] Specific examples

[2122] 1. User Registration

[2123] User A logs in to the system, registers, and enters "watching movies" and "cooking" as his or her hobbies.

[2124] User B logs in in the same way and enters "listening to music" and "tennis" as his hobbies.

[2125] 2. Profile Analysis

[2126] The server stores information about users A and B, analyzes it using a generation AI, and generates avatars for each.

[2127] User A's avatar is holding a movie reel, and User B's avatar is holding a tennis racket.

[2128] 3. Virtual matchmaking

[2129] The server finds user C, who shares the same hobby of watching movies, and sets a date and time for a matchmaking meeting between user A and user C and notifies them.

[2130] 4. Virtual matchmaking

[2131] User A and User C log in at the specified time. Their avatars talk about "movies they've recently seen" in the virtual space.

[2132] 5. Emotion Analysis Using an Emotion Engine

[2133] During the virtual conversation, the emotion engine analyzes User A's facial expressions and voice and detects "fun."

[2134] The generative AI recognizes "fun" and expands the conversation into even more fun topics.

[2135] 6. Future Baby Simulation

[2136] During the conversation, the server simulates the future children of user A and user C, displaying the characteristics of children who share the common skills of sports and watching movies.

[2137] 7. Suggesting date spots and common hobbies

[2138] The generative AI suggests movie theaters and cooking classes and displays them on the device.

[2139] 8. Compatibility assessment and feedback

[2140] After the session ends, the server calculates a compatibility score based on the conversation content, simulation results, and emotional state, and provides feedback such as "Compatibility score: 85%."

[2141] The above is a specific embodiment of the present invention.

[2142] Example 2

[2143] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2144] Conventional virtual matchmaking systems only determine compatibility based on the user's profile information and hobbies and preferences, and do not take into account the user's real-time emotional state or physiological reactions, which means they are unable to fully assess true compatibility in actual communication. Furthermore, the conversation content is static, meaning it is not possible to dynamically adjust the conversation to match the user's emotional state, which limits the user experience.

[2145] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a user input means, an avatar generation means for generating an avatar based on generation information, a virtual conversation generation means for avatars to converse with each other, a simulation generation means for simulating future children based on the user's profile information, a suggestion means for suggesting date locations a...

Claims

1. a user input means; avatar generation means for generating an avatar based on the generation information; a virtual conversation generating means for avatars to converse with each other; a simulation generating means for simulating a future child based on the user's profile information; A suggestion tool that suggests date locations and common hobbies based on the user's hobbies and preferences; A compatibility determination means for determining compatibility based on the content of the conversation and the results of the simulation; a display means for displaying these; A system including:

2. 2. The system according to claim 1, wherein said avatar generating means analyzes the user's hobbies and preferences and generates a virtual avatar based on a plurality of feature quantities.

3. 2. The system according to claim 1, wherein said virtual conversation generating means holds a virtual matchmaking session between the generated avatars and generates conversation content in real time.

Images