System

Abstract

To provide a marriage consultation service system.SOLUTION: The initial data input by the user is stored in the database. A self-introduction moving image photographed by a user is analyzed by an AI technique to generate a matching profile. To examine detailed history information inputted by a user and to store it in a database as highly reliable information. When the user submits a support request, the server notifies the engagement advisor of the request and notifies the user of the advice. When the user requests support after marriage, the server forwards the request to the expert and notifies the user of the progress. When a user inputs detailed personal data and cooperates with a related service, a server analyzes a personal profile on the basis of the collected data and reflects it on a matching algorithm.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional matchmaking services are expensive, placing a significant financial burden on many users. Furthermore, the quality of the service is insufficient, there is no guarantee that users will be matched with their ideal partner, and users find it difficult to work at their own pace. Furthermore, conventional matchmaking services lack support after marriage, which can make it difficult for users to prepare for marriage. There is a need to solve these issues and provide low-cost, high-quality matchmaking services. [Means for solving the problem]

[0005] To solve the above problems, the system of the present invention provides the following: a means for users to input initial data and send it from their devices; a means for the server to save the user's initial data in a database; a means for users to film a self-introduction video and upload it from their devices; a means for the server to analyze the uploaded video using AI technology and generate a matching profile; a means for users to input detailed career information and send it from their devices; a means for the server to review the received career information and save it in a database as reliable information; a means for users to submit a support request; a means for the server to notify a matchmaking advisor of the request and provide advice to the user; a means for users to request post-marriage support; a means for the server to forward the request to a specialist and notify the user of progress; a means for users to input detailed personal data and link with related services; and a means for the server to analyze personal profiles based on the collected data and reflect them in a matching algorithm. This system allows users to use high-quality matchmaking services at low cost, increasing the chances of meeting their ideal partner. Post-marriage support is also provided, reducing the difficulties of preparing for marriage.

[0006] A "user" is an individual who uses the marriage consultation service.

[0007] A "terminal" is a computer device, smartphone, tablet, etc. that a user uses to input information or shoot and upload videos.

[0008] A "server" is a computer system that receives, processes, and stores information sent by users.

[0009] "Initial data" refers to basic information (such as name, gender, age, occupation, and location) provided by a user when registering.

[0010] "Video" refers to a file in which a user records self-introductions and other information in video and audio format.

[0011] "AI technology" is a technology that analyzes users' videos and other data and automatically makes decisions and recommendations.

[0012] A "matching profile" is information used to identify compatible partners based on a user's personality, speaking style, hobbies, career history, etc.

[0013] "Career information" is detailed personal information provided by a user, such as educational background, work history, hobbies, and preferences.

[0014] "Certificate" refers to documents uploaded by users to verify the authenticity of their career information, such as their educational background and work history.

[0015] "Verification" is the process by which the server verifies the authenticity and accuracy of the biographical information it receives.

[0016] A "support request" is a request for assistance or advice submitted by a user to a matchmaking advisor or specialist.

[0017] A "marriage advisor" is a specialist who provides specific advice and support to users.

[0018] A "specialist" is an external service provider that the server works with to provide post-marriage support.

[0019] "Progress" refers to the current status and progress of the support provided by the specialist provider.

[0020] "Personal data" refers to detailed information such as a user's hobbies, preferences, frequency of contact, and financial sense.

[0021] "Affiliated Services" are external services or applications that work together to provide users' personal data.

[0022] "Analysis" is the process of analyzing the user's characteristics and compatibility based on the data collected by the server.

[0023] A "matching algorithm" is a calculation method for identifying compatible partners based on a user's characteristics. [Brief explanation of the drawings]

[0024] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0025] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0026] First, the terms used in the following description will be explained.

[0027] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0028] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0029] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0030] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0031] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0032] [First embodiment]

[0033] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0034] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0035] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0036] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0037] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0038] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0039] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0040] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0041] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0042] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0043] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0044] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0045] The system of the present invention is designed to achieve low-cost, high-quality matching in marriage consultation services. This system is composed of elements including users, terminals, and servers, and performs the following specific operations.

[0046] User registration and initial data entry

[0047] 1. Users

[0048] When starting the service, users register an account to enter basic information such as name, gender, age, occupation, location, etc. For example, a user enters information such as "Yamada Taro," a 30-year-old male engineer.

[0049] 2. Terminal

[0050] The terminal displays the data entered by the user on the screen, and when the user presses the send button, the data is sent to the server.

[0051] 3. Server

[0052] The server processes the received initial data and stores it in a database for each user, thereby registering the user's basic information in the system.

[0053] Video Review Process

[0054] 1. Users

[0055] A user can record a self-introduction video and upload it to the system. For example, the user can say in the self-introduction video, "My hobbies are reading and traveling."

[0056] 2. Terminal

[0057] The device sends the captured video to the server.

[0058] 3. Server

[0059] The server uses AI technology to analyze the uploaded video, analysing the user's speaking style and personality, and then generates a matching profile based on the analysis results, which is stored in a database.

[0060] Background Check Process

[0061] 1. Users

[0062] Users enter detailed information such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. For example, a user may provide information such as "I graduated from the University of Tokyo and am currently working for an IT company."

[0063] 2. Terminal

[0064] The terminal sends the entered information and certificate documents to the server.

[0065] 3. Server

[0066] The server reviews the received background information, stores it in a database as reliable information, and notifies the user if any fraud or violation is detected.

[0067] Providing manned support

[0068] 1. Users

[0069] Users request support such as profile improvement or dating advice. For example, "How can I make my profile more appealing?"

[0070] 2. Server

[0071] Transfer support requests to matchmaking advisors and manage their progress.

[0072] 3. Marriage Advisor

[0073] The marriage advisor provides advice based on the user's request and registers the content on the server.

[0074] 4. Server

[0075] The server notifies the user of the advice and stores it in a database.

[0076] Post-marriage support

[0077] 1. Users

[0078] If the marriage is successful, you can request support with wedding preparations, ring selection, etc. For example, you can ask for recommendations on wedding venues.

[0079] 2. Terminal

[0080] Sends the request to the server.

[0081] 3. Server

[0082] The server forwards the request to a suitable specialist and manages the progress.

[0083] 4. Specialist

[0084] The specialists report the status of service provision to the server, and based on the report, notify the user of the latest information.

[0085] Detailed personal analysis

[0086] 1. Users

[0087] Detailed personal data such as hobbies, preferences, frequency of contact, and financial sense is entered and linked to related services. For example, detailed information such as "I like watching movies and go to the cinema once a week" is provided.

[0088] 2. Terminal

[0089] The input data is sent to the server, and necessary data is obtained from the related services.

[0090] 3. Server

[0091] Based on the collected data, personal profiles are analyzed in detail and the results are reflected in the next matching algorithm.

[0092] In this way, the "Marriage AI" system aggregates basic and detailed information about users and uses AI technology to provide optimal matches and high-quality support, allowing users to effectively find a partner at low cost.

[0093] The processing flow will be explained below.

[0094] Step 1:

[0095] Users access an account registration form and enter initial data such as name, gender, age, occupation, and location.

[0096] Step 2:

[0097] The terminal displays the initial data entered by the user on the screen, and after confirmation, the data is sent to the server by pressing the send button.

[0098] Step 3:

[0099] The server analyzes the received initial data and stores the user's account in a database.

[0100] Step 4:

[0101] The user shoots a self-introduction video on the terminal and uploads the video including the self-introduction content to the system.

[0102] Step 5:

[0103] The terminal transmits the captured video file to the server.

[0104] Step 6:

[0105] The server analyzes the received video file using AI technology to determine the user's speaking style and personality.

[0106] Step 7:

[0107] The server generates a matching profile based on the analysis results and stores it in a database.

[0108] Step 8:

[0109] The user inputs detailed career information such as educational background, work history, hobbies, and preferences from the terminal.

[0110] Step 9:

[0111] The terminal transmits the entered history information to the server.

[0112] Step 10:

[0113] The server reviews the received background information, stores it in a database as reliable information, and notifies the user if there is anything suspicious.

[0114] Step 11:

[0115] Users can submit support requests from their devices, asking for things like profile improvement or dating advice.

[0116] Step 12:

[0117] The server transfers the support request to the matchmaking advisor and manages the progress of the request.

[0118] Step 13:

[0119] The marriage advisor provides specific advice to the user and registers the details on the server.

[0120] Step 14:

[0121] The server notifies the user of the advice and stores it in a database.

[0122] Step 15:

[0123] After getting married, users can request support with wedding preparations and ring selection.

[0124] Step 16:

[0125] The terminal transmits a request for support after marriage to the server.

[0126] Step 17:

[0127] The server transfers the request to the specialist and manages the progress.

[0128] Step 18:

[0129] The specialists report the status of service provision to the server, and the server notifies the user of the details.

[0130] Step 19:

[0131] Users enter detailed personal data such as hobbies, preferences, frequency of contact, and financial sense on their devices and approve integration with related services.

[0132] Step 20:

[0133] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[0134] Step 21:

[0135] The server performs a detailed analysis of the user's personal profile based on the collected data and reflects the results of the analysis in the next matching algorithm.

[0136] Step 22:

[0137] The server uses an improved matching algorithm to present the best possible matches to the user.

[0138] Example 1

[0139] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0140] A major challenge facing modern marriage consultation services is the high cost and effort required to achieve efficient, high-quality matching. There is a particular need for a system that can provide users with a self-introduction video, detailed analysis of personal information, reliable information, and even post-marriage support. However, existing systems struggle to provide these services effectively and at low cost. Furthermore, there is a lack of appropriate advice and support for users, making it necessary to improve the user experience.

[0141] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0142] In this invention, the server includes a means for storing the user's initial data in a database, a means for analyzing the self-introduction video using prompt sentences in a generative AI model to generate a matching profile, and a means for analyzing the personal profile based on the collected data and reflecting this in the matching algorithm. This enables efficient registration of initial data, reliable profile generation, detailed personal data analysis, and optimal matching based on that data, all at low cost and effectively. It is also possible to provide users with appropriate advice and post-match support, which is expected to improve the overall user experience.

[0143] "Initial data" refers to basic information such as the user's name, gender, age, occupation, and location.

[0144] A "terminal" is a device used by a user to input data and send it to a server, and includes smartphones, personal computers, etc.

[0145] "Server" refers to a computer system that receives, processes, and stores data submitted by users.

[0146] A "database" is a system that allows a server to systematically store user information.

[0147] A "self-introduction video" is a video in which a user introduces themselves.

[0148] A "generative AI model" refers to an algorithm or system that uses artificial intelligence techniques to analyze data and extract meaning and patterns.

[0149] A "prompt" is text containing instructions or questions to be given to a generative AI model.

[0150] A "matching profile" is profile information generated based on a user's characteristics and preferences to help them find the perfect partner candidate.

[0151] "Career information" refers to detailed information entered by the user, such as educational background, work history, hobbies, and preferences.

[0152] "Reliability" means that information or data is accurate and free from falsehoods or errors.

[0153] A "support request" is a request submitted by a user for profile improvement, dating advice, post-marriage assistance, etc.

[0154] A "marriage advisor" refers to an expert who provides consultation and advice to users in a marriage consultation service.

[0155] "Specialist companies" refer to companies that provide post-marriage support services such as wedding preparations and ring selection.

[0156] "Personal data" refers to detailed personal information such as a user's hobbies, preferences, frequency of contact, and financial sense.

[0157] "Related services" are external services that are used in conjunction with the user's detailed personal data.

[0158] A "matching algorithm" refers to a calculation method or rule for finding the best partner candidate based on user information.

[0159] The system of the present invention uses the elements of users, terminals, and servers to achieve low-cost, high-quality matching in a marriage consultation service. This system performs the following specific processes.

[0160] User registration and initial data entry

[0161] 1. Users

[0162] A user registers an account through an application or website by entering initial data such as name, gender, age, occupation, location, etc. For example, a user enters information as "Taro Yamada," a male, 30-year-old engineer.

[0163] 2. Terminal

[0164] The terminal displays the entered initial data on the screen and sends the data to the server by pressing the send button. The data is sent securely using the HTTPS protocol.

[0165] 3. Server

[0166] The server validates the received initial data and stores it in the database after confirming that there are no errors. This registers the user's basic information in the system.

[0167] Video Review Process

[0168] 1. Users

[0169] Users can use the camera on their smartphone or PC to shoot a self-introduction video and upload it to the system using the "Video Upload" function. For example, in the self-introduction video, they can say, "My hobbies are reading and traveling."

[0170] 2. Terminal

[0171] The device sends the captured video to the server using the HTTP POST method, with the video file sent in MP4 format or similar.

[0172] 3. Server

[0173] The server receives the video file and analyzes it using a generative AI model, with a prompt such as "Analyze the content spoken in this video and the speaker's personality." Based on the analysis results, a matching profile for the user is generated and stored in a database.

[0174] Background Check Process

[0175] 1. Users

[0176] Users enter detailed information such as their educational background, work history, hobbies, and preferences, and upload supporting documents in PDF or image file format if necessary. For example, they can provide information such as "I graduated from the University of Tokyo and am currently working for an IT company."

[0177] 2. Terminal

[0178] The device sends the entered information and credentials to the server. The information is serialized in JSON format, and files are sent as multipart form data.

[0179] 3. Server

[0180] The server verifies the received information and certificates, performs necessary checks and analyses, then stores the information in a database as reliable information and notifies the user if any fraud is detected.

[0181] Providing manned support

[0182] 1. Users

[0183] Users can request profile improvement or dating advice through the application's support function, such as "How can I make my profile more appealing?"

[0184] 2. Server

[0185] The server transfers the support request to the matchmaking advisor and manages the progress of the request.

[0186] 3. Marriage Advisor

[0187] Based on the request, the matchmaking advisor creates advice and registers it on the server. For example, they can provide specific advice such as, "In your self-introduction, it's a good idea to include your strengths and specific anecdotes."

[0188] 4. Server

[0189] The server notifies the user of the advice and stores the content in a database.

[0190] Post-marriage support

[0191] 1. Users

[0192] If the marriage is successful, you can request support with wedding preparations, ring selection, etc. For example, you can ask for recommendations on wedding venues.

[0193] 2. Terminal

[0194] The device sends the request to the server in JSON format using HTTPS to ensure secure communication.

[0195] 3. Server

[0196] The server forwards the request to a suitable specialist and manages the progress.

[0197] 4. Specialist

[0198] The specialists report the status of service provision to the server, and the server notifies the user of the latest information based on the content of the reports.

[0199] Detailed personal analysis

[0200] 1. Users

[0201] Users input detailed personal data such as their hobbies, preferences, contact frequency, and financial sense, and then link it to external related services. For example, users can provide information such as "I like watching movies and go to the cinema once a week."

[0202] 2. Terminal

[0203] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[0204] 3. Server

[0205] The server generates a personal profile based on the collected data and applies it to the matching algorithm, using a generative AI model to analyze the data and generate a profile that will enable highly accurate matching.

[0206] As a complete system, the present invention efficiently aggregates basic and detailed user information and then uses generative AI models to provide optimal matching and high-quality support. Specific examples of prompts include:

[0207] "Please use AI to analyze the self-introduction videos of users in a marriage consultation service and generate optimal matching profiles."

[0208] "We review the authenticity of the biographical information provided by users to ensure there is no fraud."

[0209] This allows users to enjoy effective and reliable matchmaking services at low cost.

[0210] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0211] User registration and initial data entry

[0212] Step 1:

[0213] A user enters initial data such as "name," "gender," "age," "occupation," and "location" through an application or website. For example, a user enters information such as "Yamada Taro," a male, 30-year-old engineer.

[0214] Input: Basic information entered by the user (name, gender, age, occupation, location)

[0215] Output: User profile initial data

[0216] Step 2:

[0217] The terminal displays the entered initial data on the screen for the user to confirm. When the user presses the "Send" button, the terminal sends the data to the server using the HTTPS protocol.

[0218] Input: Basic information entered by the user, and pressing the submit button

[0219] Output: Basic information sent to the server

[0220] Step 3:

[0221] The initial data received by the server is validated to ensure there are no errors in the content and then saved to the database. For example, it checks whether the age is an integer or whether the email address is in the correct format.

[0222] Input: User basic information sent to the server

[0223] Output: User profile information stored in a database

[0224] Video Review Process

[0225] Step 1:

[0226] The user shoots a self-introduction video using the camera on their smartphone or PC. After filming, the video is uploaded to the system using the application's "Video Upload" function. For example, a user may film a video saying, "My hobbies are reading and traveling."

[0227] Input: Self-introduction video

[0228] Output: Video file saved on device

[0229] Step 2:

[0230] The device temporarily saves the uploaded video, and when the user presses the "Send" button, the video file is sent to the server. The HTTP POST method is used to send the video file in MP4 format.

[0231] Input: Video file, press send button

[0232] Output: Video file sent to the server

[0233] Step 3:

[0234] The server receives the video file and creates a prompt for the generative AI model, such as "Analyze the content of what is being said in this video and the speaker's personality."The server then generates a matching profile for the user based on the analysis results obtained from the generative AI model and stores it in a database.

[0235] Input: Video file sent to the server

[0236] Output: Generated matching profile, analysis results stored in database

[0237] Background Check Process

[0238] Step 1:

[0239] Users enter detailed information such as their educational background, work history, hobbies, and preferences into the application's input form, and upload supporting documents in PDF or image format if necessary. For example, they can provide information such as "graduated from the University of Tokyo and currently works for an IT company."

[0240] Input: Detailed information such as educational background, work history, hobbies and interests, and supporting documents

[0241] Output: Details and supporting documents stored on your device

[0242] Step 2:

[0243] The device sends the entered details and supporting documents to the server, where the information is serialized in JSON format and the files are sent as multipart form data.

[0244] Input: Detailed information, supporting documents, click submit button

[0245] Output: Details and proof sent to the server

[0246] Step 3:

[0247] The server verifies the details and certificates received, performs necessary checks and analyses, stores the information in a database as reliable information, and notifies the user if any irregularities are detected.

[0248] Input: Details and supporting documents sent to the server

[0249] Output: reliable information stored in a database, notification to the user

[0250] Providing manned support

[0251] Step 1:

[0252] A user requests profile improvement or dating advice from the application's support function, for example, "How can I make my profile more appealing?"

[0253] Input: Support request details

[0254] Output: Support request saved on device

[0255] Step 2:

[0256] The server transfers the support request to the matchmaking advisor and manages the progress of the request.

[0257] Input: Support request from user

[0258] Output: Transfer request to matchmaking advisor

[0259] Step 3:

[0260] Based on the request, the matchmaking consultant will create advice and register it on the server. For example, they can provide specific advice such as, "In your self-introduction, it's a good idea to include your strengths and specific anecdotes."

[0261] Input: Support request details

[0262] Output: Created advice, registered details on the server

[0263] Step 4:

[0264] The server notifies the user of the advice and stores the contents in a database.

[0265] Input: Advice content

[0266] Output: Notify user, save advice to database

[0267] Post-marriage support

[0268] Step 1:

[0269] If the user gets married, they can request support for wedding preparations, ring selection, etc. For example, they can ask, "Please recommend a wedding venue."

[0270] Input: Post-marriage support request

[0271] Output: Support request saved on device

[0272] Step 2:

[0273] The device sends the request to the server in JSON format using HTTPS to ensure secure communication.

[0274] Input: Support request details, click the send button

[0275] Output: Support request sent to the server

[0276] Step 3:

[0277] The server forwards the request to a suitable specialist and manages the progress.

[0278] Input: Support request details

[0279] Output: Request for transfer to specialist company, progress management

[0280] Step 4:

[0281] The specialists report the status of service provision to the server, and the server notifies the user of the latest information based on the content of the reports.

[0282] Input: Service availability from specialist vendors

[0283] Output: Notify user of latest information

[0284] Detailed personal analysis

[0285] Step 1:

[0286] Users input detailed personal data such as "interests and preferences," "frequency of contact," and "money sense," and link it to external related services. For example, it provides information such as "I like watching movies and go to the cinema once a week."

[0287] Input: Detailed information such as hobbies, preferences, frequency of contact, and financial sense

[0288] Output: Details saved on the device

[0289] Step 2:

[0290] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[0291] Input: Detailed information, press the submit button

[0292] Output: Details sent to the server, data retrieved from related services

[0293] Step 3:

[0294] The server generates a personal profile based on the collected data and applies it to the matching algorithm, which uses a generative AI model to analyze the data and achieve high-precision matching.

[0295] Input: Collected detailed data, generative AI model

[0296] Output: Generated personal profile, fed into the matching algorithm

[0297] The system efficiently and accurately collects basic and detailed user information and utilizes generative AI models to provide optimal matching and high-quality support.

[0298] (Application example 1)

[0299] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0300] In recent years, there has been a demand for virtual stores to efficiently analyze users' purchasing behavior and provide optimal products and services. However, conventional systems have had difficulty in analyzing users' individual preferences and purchasing behavior in detail and making personalized recommendations. In addition, user support and advice are not provided in real time, which has led to low satisfaction.

[0301] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0302] In this invention, the server includes: a means for a user to input initial data and transmit it from the terminal; a means for the server to save the user's initial data in a database; a means for a user to film a self-introduction video and upload it from the terminal; a means for the server to analyze the uploaded video using AI technology and generate a matching profile; a means for a user to input detailed career information and transmit it from the terminal; a means for the server to review the received career information and store it in a database as reliable information; a means for a user to submit a support request; a means for the server to notify an expert of the request and notify the user of advice; a means for a user to request specific support; a means for the server to forward the request to the expert and notify the user of progress; a means for a user to input detailed personal data and link with related services; a means for the server to analyze a personal profile based on collected data and reflect it in a matching algorithm; a means for a user to input purchasing behavior data and transmit it from the terminal; and a means for the server to analyze the received purchasing behavior data and generate individual recommendations using a recommendation algorithm. This enables detailed analysis of users' individual preferences and purchasing behavior and makes personalized recommendations in real time.

[0303] "User" refers to an individual who uses the system to receive services.

[0304] "Initial data" refers to basic information that a user first enters when using the system.

[0305] "Terminal" refers to a digital device used by a user, such as a computer, smartphone, or tablet.

[0306] "Server" refers to the central computer that processes and stores data and manages the entire system.

[0307] A "database" is a storage area within a system for organizing and storing information obtained from users.

[0308] A "self-introduction video" is video content that a user has filmed to introduce basic information about themselves and their hobbies and preferences.

[0309] "Uploading" refers to the act of a user sending digital data from a terminal to a server.

[0310] "AI technology" refers to the use of artificial intelligence techniques, including machine learning and data analysis, to analyze data and make inferences and predictions.

[0311] A "matching profile" is a user profile created based on the user's attributes and personality information analyzed using AI technology.

[0312] "Career information" is detailed user information such as educational background, work history, hobbies, and preferences.

[0313] "Verification" is the process by which the server verifies the reliability and accuracy of the data it receives.

[0314] A "support request" is an action by a user to communicate through the system that they require support.

[0315] An "expert" is a person with the expertise to respond to a support request submitted by a user.

[0316] "Professional" refers to a company or organization that provides a specific service or product.

[0317] "Integration" refers to the sharing of data and functions between different systems.

[0318] A "matching algorithm" is an algorithm that calculates and provides the best match based on a user's profile and data.

[0319] "Purchasing behavior data" is information about products and services purchased by a user in the past.

[0320] A "recommendation algorithm" is an algorithm that suggests optimal products and services based on a user's preferences and behavioral history.

[0321] This invention relates to a personalized recommendation system for a virtual store used by a user. This system includes functions for a user to input initial data and send it from a terminal, a server to save the user's initial data in a database, a user to film a self-introduction video and upload it from a terminal, a server to analyze the uploaded video using AI technology and generate a matching profile, a user to input detailed career information and send it from a terminal, a server to review the received career information and save it in a database as reliable information, a user to submit a support request, a server to notify an expert of the request and notify the user of advice, a user to request specific support, a server to forward the request to an expert and notify the user of progress, a user to input detailed personal data and link with related services, a server to analyze the personal profile based on the collected data and reflect it in a matching algorithm, a user to input purchasing behavior data and send it from a terminal, and a server to analyze the received purchasing behavior data and generate individual recommendations using a recommendation algorithm.

[0322] Hardware and software used

[0323] The system is implemented using the following hardware and software:

[0324] User devices: computers, smartphones, tablets, etc.

[0325] Server: Central computer for data processing and storage, cloud service (e.g. AWS®, Google® Cloud).

[0326] Database: A system for storing user information and analytical data (e.g., MySQL®, MongoDB).

[0327] AI technology: Machine learning frameworks for implementing data analysis, video analysis, and recommendation algorithms (e.g., TENSORFLOW (registered trademark), PyTorch).

[0328] Data processing and calculation

[0329] The server processes and calculates the data in the following steps:

[0330] 1. Initial data sent from the user's device is stored in the database, including name, gender, age, occupation, location, etc.

[0331] 2. When a user uploads a self-introduction video, the server uses AI technology to analyze the video and generate a matching profile based on the user's speaking style and personality.

[0332] 3. The user enters detailed background information, and the server examines the data sent from the device and stores it in a database as reliable information. If any fraudulent data or violations are detected, the server notifies the user.

[0333] 4. When a user submits a support request, the server notifies an expert of the request and provides advice to the user. For example, a request might be "I want to choose a new outdoor jacket."

[0334] 5. When a user requests specific support, the server forwards the request to a specialist and notifies the user of the status of the service. Specific support may include wedding preparations, etc.

[0335] 6. Once the user enters detailed personal data, the server will connect with related services to perform a detailed analysis of the personal profile and reflect this in the next matching algorithm.

[0336] 7. The user inputs purchasing behavior data, the server analyzes the data sent from the device, and generates personalized recommendations using a recommendation algorithm.

[0337] Specific examples (prompt sentence examples)

[0338] 1. "I'm looking for a new tent for camping. Which one do you recommend?"

[0339] 2. "What are the best snacks for a weekend movie night?"

[0340] 3. "Please suggest a fashion outfit for going to a jazz concert."

[0341] In this way, the system according to the present invention can provide personalized recommendations and real-time advice based on detailed analysis of users' individual preferences and purchasing behavior, thereby improving the user experience in the virtual store.

[0342] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0343] Step 1:

[0344] The user enters initial data (such as name, gender, age, occupation, and location) and sends it from the terminal. The entered data is sent from the terminal to the server. The server saves this initial data in a database. In this process, the server checks the data format and stores the initial data in the database as structured data.

[0345] Step 2:

[0346] The user films a self-introduction video and uploads it from their device. The device then sends the video data to the server. The server then analyzes the received video using AI technology (e.g., TensorFlow) to determine the user's speaking style and personality. Based on the analysis results, the server generates a matching profile and stores it in a database.

[0347] Step 3:

[0348] The user enters detailed career information (educational background, work history, hobbies, preferences, etc.) and submits it from the device. The device then sends the career information to the server. The server reviews the received career information and stores it in a database as reliable information. The review includes validating the input data and checking supporting documents as necessary. If any fraud or violation is detected, the server notifies the user.

[0349] Step 4:

[0350] A user submits a support request. For example, a user might request, "I want to choose a new outdoor jacket." The device then sends the request to the server. The server then notifies an expert of the request, who then provides advice. The advice is then sent to the user via the server. This allows the user to receive personalized advice from the expert.

[0351] Step 5:

[0352] The user requests specific support (e.g., wedding preparations). The device sends the request to the server. The server forwards the request to a specialist, who reports the status of the service provided to the server. The server notifies the user of the progress. This process allows the user to receive specialized support.

[0353] Step 6:

[0354] The user enters detailed personal data (hobbies, preferences, frequency of contact, financial sense, etc.) and sends it from their device. The device then sends the data to the server. The server then performs a detailed analysis of the personal profile based on the data and connects with related services. The profile results are reflected in the next matching algorithm, making it possible to provide personalized services to the user.

[0355] Step 7:

[0356] The user enters purchasing behavior data (past purchase history and browsing history) and sends it from the device. The device then sends the data to the server. The server analyzes the received purchasing behavior data and generates individual recommendations using a generative AI model. The recommendation results are notified to the user, allowing them to receive personalized product and service suggestions.

[0357] In each step, a personalized recommendation system in the virtual store is realized through specific actions taken by the server, the terminal, and the user.

[0358] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0359] The system of this invention utilizes AI technology and an emotion engine to provide a low-cost, high-quality marriage consultation service. It includes the main elements of the user, terminal, and server, each of which performs the following specific operations.

[0360] User registration and initial data entry

[0361] 1. Users

[0362] When starting the service, a user registers an account to enter basic information such as name, gender, age, occupation, location, etc. For example, a user enters basic information such as the name "Yamada Taro," gender, and age.

[0363] 2. Terminal

[0364] The terminal displays the initial data entered by the user on the screen, asks for confirmation, and then sends the data to the server by pressing a send button.

[0365] 3. Server

[0366] The server stores the received initial data in a database and creates an account for the user.

[0367] Video Review Process

[0368] 1. Users

[0369] Users can record a self-introduction video on their device and upload it to the system. For example, they can introduce themselves by saying, "My hobbies are reading and traveling."

[0370] 2. Terminal

[0371] The device sends the captured video file to the server.

[0372] 3. Server

[0373] The server analyzes the uploaded video file using AI technology to determine the user's speaking style, personality, and emotions. The emotion engine analyzes the user's facial expressions and tone of voice to obtain emotional data.

[0374] The server generates a matching profile based on the analysis results and stores it in a database.

[0375] Background Check Process

[0376] 1. Users

[0377] Users enter detailed career information such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. For example, a user may provide information such as "I graduated from the University of Tokyo and am currently working for an IT company."

[0378] 2. Terminal

[0379] The terminal transmits the entered history information to the server.

[0380] 3. Server

[0381] The server reviews the received background information, stores it in a database as reliable information, checks for fraud or violations, and notifies the user if there is anything suspicious.

[0382] Providing manned support

[0383] 1. Users

[0384] Users request support such as profile improvement or dating advice. For example, "How can I make my profile more appealing?"

[0385] 2. Server

[0386] The server forwards the support request to a matchmaking advisor.

[0387] 3. Marriage Advisor

[0388] The marriage advisor provides specific advice to the user and registers the details on the server.

[0389] 4. Server

[0390] The server notifies the user of the advice and stores it in a database. The emotion engine analyzes the user's emotions in real time and provides the results to the advisor.

[0391] Post-marriage support

[0392] 1. Users

[0393] After getting married, users can request support for wedding preparations, ring selection, etc. For example, they can ask for recommendations for wedding venues.

[0394] 2. Terminal

[0395] The terminal transmits a request for support after marriage to the server.

[0396] 3. Server

[0397] The server transfers the request to the specialist and manages the progress.

[0398] 4. Specialist

[0399] The specialists report the status of service provision to the server, and the server notifies the user of the details.

[0400] Detailed personal analysis

[0401] 1. Users

[0402] Users input detailed personal data such as their hobbies, preferences, frequency of contact, and financial sense, and then approve the connection to related services. For example, they provide detailed information such as "I like watching movies and go to the cinema once a week."

[0403] 2. Terminal

[0404] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[0405] 3. Server

[0406] The server performs a detailed analysis of the user's personal profile based on the collected data and reflects the results of the analysis in the next matching algorithm.

[0407] The emotion engine simultaneously analyzes the user's emotional data and incorporates it into a personal profile.

[0408] In this way, the system of the present invention utilizes AI technology and an emotion engine to provide users with optimal matches and high-quality support, allowing them to effectively pursue their matchmaking at low cost.

[0409] The processing flow will be explained below.

[0410] Step 1:

[0411] Users access an account registration form and enter initial data such as name, gender, age, occupation, and location.

[0412] Step 2:

[0413] The terminal displays the initial data entered by the user on a confirmation screen, and when the user presses the send button, the data is sent to the server.

[0414] Step 3:

[0415] The server stores the received initial data in a database.

[0416] Step 4:

[0417] Users film a self-introduction video on their device and upload it to the system, introducing themselves, for example, "My hobbies are reading and traveling."

[0418] Step 5:

[0419] The terminal transmits the captured video file to the server.

[0420] Step 6:

[0421] The server analyzes the received video file using AI technology to determine the user's speaking style and personality, and then uses an emotion engine to analyze the user's facial expressions and tone of voice to obtain emotional data.

[0422] Step 7:

[0423] The server generates a matching profile based on the analysis results and emotional data and stores it in a database.

[0424] Step 8:

[0425] Users enter detailed career information such as their educational background, work history, hobbies, and preferences into the terminal, providing information such as "graduated from the University of Tokyo and currently works for an IT company."

[0426] Step 9:

[0427] The terminal sends the entered biographical information and certificate documents to the server.

[0428] Step 10:

[0429] The server reviews the received background information, stores it in a database as reliable information, and notifies the user if there is anything suspicious.

[0430] Step 11:

[0431] Users submit support requests, such as profile improvements and dating advice, right from their devices. For example, they might ask, "How can I make my profile more appealing?"

[0432] Step 12:

[0433] The server forwards the support request to a matchmaking advisor.

[0434] Step 13:

[0435] The marriage advisor provides specific advice to the user and registers the details on the server.

[0436] Step 14:

[0437] The server notifies the user of the advice and stores it in a database. The emotion engine analyzes the user's emotional changes and provides them to the advisor.

[0438] Step 15:

[0439] After getting married, users can request support for wedding preparations, ring selection, etc. For example, they can ask for recommendations for wedding venues.

[0440] Step 16:

[0441] The terminal transmits a request for support after marriage to the server.

[0442] Step 17:

[0443] The server transfers the request to the specialist and manages the progress.

[0444] Step 18:

[0445] The specialists report the status of service provision to the server, and the server notifies the user of the details.

[0446] Step 19:

[0447] Users input detailed personal data such as their hobbies, preferences, frequency of contact, and financial sense on their devices, and then approve the connection to related services. For example, they may provide detailed information such as "I like watching movies and go to the cinema once a week."

[0448] Step 20:

[0449] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[0450] Step 21:

[0451] The server performs a detailed analysis of the user's personal profile based on the collected data and emotional data, and reflects the results in the next matching algorithm.

[0452] Step 22:

[0453] The server uses an improved matching algorithm to present the best possible matches to the user.

[0454] Example 2

[0455] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0456] Conventional marriage consultation services have had problems such as the time and cost required for the user information gathering and matching process, as well as the difficulty of finding the perfect partner for the user. Furthermore, matching based on simple information input does not take into account the user's personality or emotions, making effective matching difficult.

[0457] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0458] In this invention, the server includes: means for a user to input initial data and send it from the terminal; means for the server to save the user's initial data in a database; means for a user to film a self-introduction video and upload it from the terminal; means for the server to analyze the uploaded video using AI technology and generate a matching profile; means for a user to input detailed career information and send it from the terminal; means for the server to review the received career information and save it in a database as highly reliable information; means for a user to submit a support request; means for the server to notify a matchmaking advisor of the request and notify the user of advice; means for a user to request post-marriage support; means for the server to forward the request to a specialist and notify the user of progress; means for a user to input detailed personal data and link with related services; means for the server to analyze a personal profile based on the collected data and reflect the results in a matching algorithm; means for the server to use an emotion engine to analyze the user's emotional data in real time; means for the server to provide the user's emotional data to the matchmaking advisor; and means for the server to review suspicious career information and notify the user. This will enable high-quality matching and support that takes into account the user's personality and emotions.

[0459] "Initial data" refers to basic information that is initially entered when using the service, such as the user's name, gender, age, occupation, and location.

[0460] "Terminal" refers to an electronic device that a user uses to input information and transmit data to a server.

[0461] "Server" refers to a central computer system for receiving, processing, and storing data submitted by users.

[0462] "Database" refers to a digital information storage system in which a server organizes and permanently stores information.

[0463] "Self-introduction video" refers to a video file that a user shoots to introduce themselves and uploads to the system.

[0464] "AI technology" refers to technology that uses artificial intelligence to analyze data and perform specific tasks.

[0465] "Matching profile" refers to profile data generated based on information such as a user's personality, preferences, and emotions analyzed using AI technology.

[0466] "Career information" refers to detailed personal information entered by the user, such as educational background, work history, hobbies, and preferences.

[0467] A "marriage advisor" refers to an expert who provides users with advice and support regarding marriage hunting.

[0468] "Specialist providers" refer to those who handle post-wedding support requests and provide services such as wedding planning and ring selection.

[0469] An "emotion engine" refers to an analysis system that analyzes a user's facial expressions, tone of voice, etc. to obtain emotional data.

[0470] "Suspicious background information" refers to background information provided by a user that is unreliable or may be false.

[0471] The system of the present invention includes the main elements of a user, a terminal, and a server, and utilizes AI technology and an emotion engine to provide marriage consultation services at low cost and with high quality.

[0472] When starting the service, the user uses a terminal to enter basic initial data such as name, gender, age, occupation, and location. The data entered by the user is sent to the server by the terminal. The server stores the received initial data in a database and creates an account for the user.

[0473] Next, the user films a self-introduction video on their device and uploads it to the system. For example, they might introduce themselves by saying, "My hobbies are reading and traveling." This video file is also sent to the server via the device. The server uses a generative AI model to analyze the uploaded video and determine the user's speaking style, personality, and emotions. An emotion engine analyzes the user's facial expressions and tone of voice to obtain emotional data. Based on the analysis results, the server generates a matching profile and stores it in a database.

[0474] Users also enter detailed career information such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. For example, they may provide information such as "graduated from the University of Tokyo and currently works for an IT company." The device then sends this information to the server, which then reviews the received career information and stores it in a database as reliable information. At this time, the server checks for any fraud or violations, and notifies the user if anything suspicious is found.

[0475] Additionally, users can request support such as profile improvement and dating advice. For example, they can request, "How can I make my self-introduction more appealing?" The server forwards this request to a matchmaking advisor. The matchmaking advisor provides specific advice to the user and registers it on the server. The server notifies the user of the advice and stores it in a database. The emotion engine also analyzes the user's emotions in real time and provides the results to the advisor.

[0476] After getting married, the user can request support for wedding preparations, ring selection, etc. For example, they can ask for "recommended wedding venues." The device sends this support request to the server, which then forwards the request to a specialist and manages the progress. The specialist reports the status of the service provided to the server, and the server notifies the user of the details.

[0477] For detailed personal analysis, the user enters detailed personal data such as hobbies, preferences, frequency of contact, and financial sense, and approves data sharing with other related services. For example, a user may provide information such as "I like watching movies and go to the cinema once a week." The device then sends this data to the server, which retrieves the necessary data from related services. The server then performs a detailed analysis of the user's personal profile based on the retrieved data and reflects the results in the next matching algorithm. In parallel, the emotion engine analyzes the user's emotional data and incorporates it into the personal profile.

[0478] Examples of specific prompt sentences include, "Please explain in detail the user registration procedure for the matchmaking system" and "Please tell me in detail the flow of the video review process for the matchmaking system."

[0479] In this way, this system, which utilizes AI technology, enables users to effectively pursue their matchmaking at low cost, and receives high-quality support and matching.

[0480] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0481] Step 1:

[0482] The user enters the initial data and sends it from the terminal.

[0483] The user enters basic initial data such as name, gender, age, occupation, and location into the terminal. This data includes information such as "Yamada Taro, male, 30 years old, engineer, living in Tokyo." The terminal then sends the entered data to the server. The server stores the received data in a database and creates an account for the user.

[0484] Input: Basic data such as name, gender, age, occupation, location, etc.

[0485] Output: User accounts stored in the database

[0486] Step 2:

[0487] Users record their own self-introduction videos and upload them from their devices.

[0488] The user records a video of themselves introducing themselves on their device. For example, they might say, "My hobbies are reading and traveling." The recorded video file is saved on the device and uploaded to the system. The device then sends this video file to the server. The server receives the video file and analyzes it using AI technology and an emotion engine.

[0489] Input: Self-introduction video file

[0490] Output: Analyzed video data (speaking style, personality, emotion assessment results)

[0491] Step 3:

[0492] The server analyzes the video and generates a matching profile

[0493] The server analyzes the received video file using AI technology and an emotion engine. This analysis determines the user's speaking style, personality, and emotions. For example, the AI ​​may determine that the user is cheerful and sociable. Based on this, the server generates a matching profile and stores it in a database.

[0494] Input: Analyzed video data

[0495] Output: The generated matching profile

[0496] Step 4:

[0497] The user enters detailed biographical information and submits it from the device

[0498] Users enter detailed career information such as their educational background, work history, hobbies, and preferences, and upload supporting documents such as "graduated from the University of Tokyo and currently works for an IT company." The device then sends the career information and supporting documents to the server, which receives and reviews this information and stores it in a database as reliable information.

[0499] Input: detailed career information, supporting documents

[0500] Output: reliable biographical information stored in a database

[0501] Step 5:

[0502] The server reviews the background information and notifies the user if there is anything suspicious.

[0503] The server reviews the user's background information to check for any irregularities or violations. If anything suspicious is found, the server notifies the user and asks for additional information or reconfirmation.

[0504] Input: Detailed biographical information

[0505] Output: Save reliable information in a database or notify the user

[0506] Step 6:

[0507] A user submits a support request, which the server forwards to a matchmaking advisor.

[0508] A user requests support such as profile improvement or dating advice. Specifically, they ask, "How can I make my profile more appealing?" The server forwards this request to a matchmaking advisor.

[0509] Input: Support Request

[0510] Output: Transfer request to matchmaking advisor

[0511] Step 7:

[0512] A marriage advisor provides advice and registers it on the server.

[0513] The marriage advisor provides specific advice to the user and registers the advice on the server. For example, the advisor may provide advice such as, "It would be good if you wrote more specifically about your hobbies and interests."

[0514] Input: Support Request

[0515] Output: Advice provided

[0516] Step 8:

[0517] The server notifies the user of the advice and stores it in the database.

[0518] The server notifies the user of the advice received from the matchmaking advisor and stores it in a database. The emotion engine also analyzes the user's emotions in real time and provides the results to the advisor.

[0519] Input: Advice provided

[0520] Output: Notify user and save to database

[0521] Step 9:

[0522] The user requests post-marriage support and sends it from the device

[0523] The user requests support for wedding preparations, ring selection, etc. For example, they may ask, "Please recommend a wedding venue." The device sends this support request to the server.

[0524] Input: Post-marriage support request

[0525] Output: Request sent to server

[0526] Step 10:

[0527] The server forwards the request to the specialist and notifies the user of the progress

[0528] The server transfers the support request after the marriage to the specialist and manages the progress. The specialist reports the service provision status to the server, and the server notifies the user of the information.

[0529] Input: Post-marriage support request

[0530] Output: Forward to specialist and notify user

[0531] Step 11:

[0532] Users enter detailed personal data and connect with related services

[0533] Users input detailed personal data such as their hobbies, preferences, frequency of contact, and financial sense, providing information such as "I like watching movies and go to the cinema once a week." They also approve data sharing with other related services. The device then sends this data to the server and retrieves the necessary data from the related services.

[0534] Input: Detailed personal data

[0535] Output: Data retrieved from related services

[0536] Step 12:

[0537] The server analyzes personal profiles based on the data collected and reflects this in the matching algorithm.

[0538] The server analyzes the user's personal profile in detail based on the collected data and reflects the analysis results in the next matching algorithm. It also analyzes the user's emotional data using an emotion engine and incorporates it into the personal profile.

[0539] Input: Detailed personal data collected

[0540] Output: Personal profile reflected in the matching algorithm

[0541] (Application example 2)

[0542] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0543] Conventional marriage consultation services have faced the problem of high costs for providing high-quality matching and support. It is also difficult to analyze users' emotions and detailed career information in real time and provide optimal advice based on this information. Furthermore, there is a lack of a way for users to receive support efficiently and effectively using smart devices.

[0544] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a user to make a support request in real time using a smart device, a means for analyzing the user's emotional data in real time using AI technology and storing it in a database, and a means for providing appropriate advice using prompt sentences based on a generative AI model. This enables users to receive high-quality matchmaking support and post-marriage support at low cost.

[0545] A "user" is an individual who uses the marriage consultation service.

[0546] A "terminal" is a mobile device used by a user, such as a smartphone or smart glasses.

[0547] "Server" means the central computer system that stores and analyzes User data and manages the entire Service.

[0548] "Initial data" refers to basic personal information such as name, gender, age, and location that a user enters when registering.

[0549] A "database" is an information management system for systematically storing user information, analysis results, and the like.

[0550] A "self-introduction video" is a short video that a user films to introduce their hobbies, interests, and personality.

[0551] "AI technology" is a technology that uses artificial intelligence to perform data analysis and pattern recognition.

[0552] A "matching profile" is a data set used to recommend optimal partner candidates based on user information.

[0553] "Career information" is detailed personal information provided by a user, such as educational background, work history, hobbies, and preferences.

[0554] A "support request" is a request made by a user to a matchmaking advisor or specialist for support.

[0555] A "marriage advisor" is a specialist who provides advice and support to users in marriage consultation services.

[0556] "Specialist vendors" are professional vendors who provide wedding preparation and related services after the marriage.

[0557] A "personal profile" is a profile generated by analyzing a user's detailed personal information and emotional data.

[0558] A "smart device" is a device with advanced functionality that is connected to the Internet, such as a smartphone or smart glasses.

[0559] "Real-time analytics" refers to an analytical process that is performed immediately as data is generated.

[0560] A "generative AI model" is a generative artificial intelligence algorithm that is trained to perform a specific task.

[0561] A "prompt" is an instruction or question given to a generative AI model, which then generates an appropriate output.

[0562] This invention utilizes AI technology and an emotion engine to provide low-cost, high-quality marriage consultation services. In particular, a specific embodiment of the invention is described below in the context of building a virtual marriage consultation center using smart devices.

[0563] User registration and initial data entry

[0564] The user uses a smart device (e.g., smartphone or smart glasses) to enter basic information such as name, gender, age, and location. The device displays the entered data on the screen and, after confirmation, sends it to the server. The server stores the received initial data in a database and creates an account for the user.

[0565] Video Review Process

[0566] Users film a self-introduction video on their smart device and upload it to the server. The server then uses AI technology to analyze the uploaded video and obtain emotional data based on the user's speaking style, personality, facial expressions, tone of voice, etc. The analysis results are stored in a database and used as a matching profile.

[0567] Background Check Process

[0568] Users enter detailed career information, such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. The device then sends the input data to the server, which reviews the received information. Only highly reliable information is stored in the database and reflected in the next match.

[0569] Providing manned support

[0570] Users use their smart devices to request support such as improving their profile or dating advice. The server then forwards the request to a matchmaking advisor, who then provides specific advice to the user. The advice is registered on the server and notified to the user. The system also has a real-time emotion analysis function, which uses AI technology to analyze the user's emotional data and reflects it in the support content.

[0571] Post-marriage support

[0572] After getting married, users request support for wedding preparations and their new life. The request is sent to the server using a smart device. The server then forwards the request to a specialist and manages the progress. The status of the service provided by the specialist is notified to the user via the server.

[0573] Detailed personal analysis

[0574] Users input detailed personal data such as hobbies, preferences, frequency of contact, and financial sense, and approve connection to related services. The device then sends the input data to the server, which collects various data and generates a detailed personal profile. The generated profile is reflected in the next matching approach. The system also provides optimal advice using prompts based on the generative AI model.

[0575] Program processing overview

[0576] 1. Hardware and Software Use:

[0577] Smart devices (smartphones, smart glasses)

[0578] Server and Database Server: MySQL

[0579] AI technology and emotion analysis engine

[0580] Web framework: Flask

[0581] 2. Data processing and calculation:

[0582] Input and storage of initial data and biographical information

[0583] Upload a video file and obtain emotional data through AI analysis

[0584] Background checks and credibility checks

[0585] Real-time emotion analysis and AI-powered prompt generation

[0586] Support request management and routing to specialists

[0587] Specific examples

[0588] A user accesses a virtual matchmaking agency app and inputs a support request saying, "I want to make my self-introduction more appealing." AI technology and an emotion engine perform real-time analysis, and using a generative AI model, generate a prompt message saying, "To improve your self-introduction, it would be good to talk more specifically about your hobbies and interests," and notify the user of this message.

[0589] Example prompt sentence:

[0590] To improve your self-introduction, it's a good idea to talk specifically about your hobbies and interests.

[0591] In this way, the present invention can provide users with effective support for finding a partner and support after marriage at low cost.

[0592] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0593] Step 1:

[0594] The user uses a smart device to input initial data such as name, gender, age, and location. The device displays this input data on the screen and sends it to the server after the user confirms it. The server stores the received initial data in a database and creates an account for the user. The input data consists of basic personal information, and a new record is generated in the database based on this data.

[0595] Step 2:

[0596] Users use their smart devices to film a self-introduction video and upload it to a server. The server receives the uploaded video file and uses AI technology to process and analyze it. Through analysis, emotional data is generated based on the user's speaking style, personality, facial expressions, and tone of voice. This emotional data is stored in a database and is reflected in subsequent matching profiles.

[0597] Step 3:

[0598] Using a smart device, users enter detailed career information such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. The device then sends the input data and supporting documents to a server. The server then reviews the received data, confirms its authenticity, and stores it in a database. At this point, a data analysis algorithm checks for any irregularities or inconsistencies, and if there are no problems, the data is reflected in the matching algorithm.

[0599] Step 4:

[0600] Users use their smart devices to send support requests, such as profile improvements or dating advice. The server receives the request and notifies the matchmaking advisor. The matchmaking advisor provides specific advice for the support content and registers it on the server. The server notifies the registered advice to the user and also stores it in a database. During this process, the advice may also reflect the results of sentiment analysis.

[0601] Step 5:

[0602] After getting married, users request support for wedding preparations and their new life. They input the request using a smart device and send it from the terminal to a server. The server then forwards the request to a specialist and manages the progress. The status of the service provided by the specialist is notified to the user via the server. The input request details are tracked by a progress management system, and updates are sent to the server as needed and displayed to the user.

[0603] Step 6:

[0604] Users input detailed personal data such as hobbies, preferences, frequency of contact, and financial sense, and approve linkage with related services. The device sends this input data to the server, which then retrieves the necessary data from the related services. The server analyzes this data and generates a detailed personal profile of the user. The generated profile is reflected in the next matching algorithm, helping the user choose a partner based on their individual needs and preferences.

[0605] Step 7:

[0606] The server uses the generative AI model to generate prompts in response to support requests from users. For example, in response to a request such as "I want to make my self-introduction more appealing," the server sends specific advice such as "To improve your self-introduction, it would be good to talk specifically about your hobbies and interests." The generated prompts are notified to the user in real time, and are linked to the results of sentiment analysis to provide optimal advice.

[0607] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0608] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0609] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0610] [Second embodiment]

[0611] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0612] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0613] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0614] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0615] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0616] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0617] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0618] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0619] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0620] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0621] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0622] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0623] The system of the present invention is designed to achieve low-cost, high-quality matching in marriage consultation services. This system is composed of elements including users, terminals, and servers, and performs the following specific operations.

[0624] User registration and initial data entry

[0625] 1. Users

[0626] When starting the service, users register an account to enter basic information such as name, gender, age, occupation, location, etc. For example, a user enters information such as "Yamada Taro," a 30-year-old male engineer.

[0627] 2. Terminal

[0628] The terminal displays the data entered by the user on the screen, and when the user presses the send button, the data is sent to the server.

[0629] 3. Server

[0630] The server processes the received initial data and stores it in a database for each user, thereby registering the user's basic information in the system.

[0631] Video Review Process

[0632] 1. Users

[0633] A user can record a self-introduction video and upload it to the system. For example, the user can say in the self-introduction video, "My hobbies are reading and traveling."

[0634] 2. Terminal

[0635] The device sends the captured video to the server.

[0636] 3. Server

[0637] The server uses AI technology to analyze the uploaded video, analysing the user's speaking style and personality, and then generates a matching profile based on the analysis results, which is stored in a database.

[0638] Background Check Process

[0639] 1. Users

[0640] Users enter detailed information such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. For example, a user may provide information such as "I graduated from the University of Tokyo and am currently working for an IT company."

[0641] 2. Terminal

[0642] The terminal sends the entered information and certificate documents to the server.

[0643] 3. Server

[0644] The server reviews the received background information, stores it in a database as reliable information, and notifies the user if any fraud or violation is detected.

[0645] Providing manned support

[0646] 1. Users

[0647] Users request support such as profile improvement or dating advice. For example, "How can I make my profile more appealing?"

[0648] 2. Server

[0649] Transfer support requests to matchmaking advisors and manage their progress.

[0650] 3. Marriage Advisor

[0651] The marriage advisor provides advice based on the user's request and registers the content on the server.

[0652] 4. Server

[0653] The server notifies the user of the advice and stores it in a database.

[0654] Post-marriage support

[0655] 1. Users

[0656] If the marriage is successful, you can request support with wedding preparations, ring selection, etc. For example, you can ask for recommendations on wedding venues.

[0657] 2. Terminal

[0658] Sends the request to the server.

[0659] 3. Server

[0660] The server forwards the request to a suitable specialist and manages the progress.

[0661] 4. Specialist

[0662] The specialists report the status of service provision to the server, and based on the report, notify the user of the latest information.

[0663] Detailed personal analysis

[0664] 1. Users

[0665] Detailed personal data such as hobbies, preferences, frequency of contact, and financial sense is entered and linked to related services. For example, detailed information such as "I like watching movies and go to the cinema once a week" is provided.

[0666] 2. Terminal

[0667] The input data is sent to the server, and necessary data is obtained from the related services.

[0668] 3. Server

[0669] Based on the collected data, personal profiles are analyzed in detail and the results are reflected in the next matching algorithm.

[0670] In this way, the "Marriage AI" system aggregates basic and detailed information about users and uses AI technology to provide optimal matches and high-quality support, allowing users to effectively find a partner at low cost.

[0671] The processing flow will be explained below.

[0672] Step 1:

[0673] Users access an account registration form and enter initial data such as name, gender, age, occupation, and location.

[0674] Step 2:

[0675] The terminal displays the initial data entered by the user on the screen, and after confirmation, the data is sent to the server by pressing the send button.

[0676] Step 3:

[0677] The server analyzes the received initial data and stores the user's account in a database.

[0678] Step 4:

[0679] The user shoots a self-introduction video on the terminal and uploads the video including the self-introduction content to the system.

[0680] Step 5:

[0681] The terminal transmits the captured video file to the server.

[0682] Step 6:

[0683] The server analyzes the received video file using AI technology to determine the user's speaking style and personality.

[0684] Step 7:

[0685] The server generates a matching profile based on the analysis results and stores it in a database.

[0686] Step 8:

[0687] The user inputs detailed career information such as educational background, work history, hobbies, and preferences from the terminal.

[0688] Step 9:

[0689] The terminal transmits the entered history information to the server.

[0690] Step 10:

[0691] The server reviews the received background information, stores it in a database as reliable information, and notifies the user if there is anything suspicious.

[0692] Step 11:

[0693] Users can submit support requests from their devices, asking for things like profile improvement or dating advice.

[0694] Step 12:

[0695] The server transfers the support request to the matchmaking advisor and manages the progress of the request.

[0696] Step 13:

[0697] The marriage advisor provides specific advice to the user and registers the details on the server.

[0698] Step 14:

[0699] The server notifies the user of the advice and stores it in a database.

[0700] Step 15:

[0701] After getting married, users can request support with wedding preparations and ring selection.

[0702] Step 16:

[0703] The terminal transmits a request for support after marriage to the server.

[0704] Step 17:

[0705] The server transfers the request to the specialist and manages the progress.

[0706] Step 18:

[0707] The specialists report the status of service provision to the server, and the server notifies the user of the details.

[0708] Step 19:

[0709] Users enter detailed personal data such as hobbies, preferences, frequency of contact, and financial sense on their devices and approve integration with related services.

[0710] Step 20:

[0711] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[0712] Step 21:

[0713] The server performs a detailed analysis of the user's personal profile based on the collected data and reflects the results of the analysis in the next matching algorithm.

[0714] Step 22:

[0715] The server uses an improved matching algorithm to present the best possible matches to the user.

[0716] Example 1

[0717] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0718] A major challenge facing modern marriage consultation services is the high cost and effort required to achieve efficient, high-quality matching. There is a particular need for a system that can provide users with a self-introduction video, detailed analysis of personal information, reliable information, and even post-marriage support. However, existing systems struggle to provide these services effectively and at low cost. Furthermore, there is a lack of appropriate advice and support for users, making it necessary to improve the user experience.

[0719] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0720] In this invention, the server includes a means for storing the user's initial data in a database, a means for analyzing the self-introduction video using prompt sentences in a generative AI model to generate a matching profile, and a means for analyzing the personal profile based on the collected data and reflecting this in the matching algorithm. This enables efficient registration of initial data, reliable profile generation, detailed personal data analysis, and optimal matching based on that data, all at low cost and effectively. It is also possible to provide users with appropriate advice and post-match support, which is expected to improve the overall user experience.

[0721] "Initial data" refers to basic information such as the user's name, gender, age, occupation, and location.

[0722] A "terminal" is a device used by a user to input data and send it to a server, and includes smartphones, personal computers, etc.

[0723] "Server" refers to a computer system that receives, processes, and stores data submitted by users.

[0724] A "database" is a system that allows a server to systematically store user information.

[0725] A "self-introduction video" is a video in which a user introduces themselves.

[0726] A "generative AI model" refers to an algorithm or system that uses artificial intelligence techniques to analyze data and extract meaning and patterns.

[0727] A "prompt" is text containing instructions or questions to be given to a generative AI model.

[0728] A "matching profile" is profile information generated based on a user's characteristics and preferences to help them find the perfect partner candidate.

[0729] "Career information" refers to detailed information entered by the user, such as educational background, work history, hobbies, and preferences.

[0730] "Reliability" means that information or data is accurate and free from falsehoods or errors.

[0731] A "support request" is a request submitted by a user for profile improvement, dating advice, post-marriage assistance, etc.

[0732] A "marriage advisor" refers to an expert who provides consultation and advice to users in a marriage consultation service.

[0733] "Specialist companies" refer to companies that provide post-marriage support services such as wedding preparations and ring selection.

[0734] "Personal data" refers to detailed personal information such as a user's hobbies, preferences, frequency of contact, and financial sense.

[0735] "Related services" are external services that are used in conjunction with the user's detailed personal data.

[0736] A "matching algorithm" refers to a calculation method or rule for finding the best partner candidate based on user information.

[0737] The system of the present invention uses the elements of users, terminals, and servers to achieve low-cost, high-quality matching in a marriage consultation service. This system performs the following specific processes.

[0738] User registration and initial data entry

[0739] 1. Users

[0740] A user registers an account through an application or website by entering initial data such as name, gender, age, occupation, location, etc. For example, a user enters information as "Taro Yamada," a male, 30-year-old engineer.

[0741] 2. Terminal

[0742] The terminal displays the entered initial data on the screen and sends the data to the server by pressing the send button. The data is sent securely using the HTTPS protocol.

[0743] 3. Server

[0744] The server validates the received initial data and stores it in the database after confirming that there are no errors. This registers the user's basic information in the system.

[0745] Video Review Process

[0746] 1. Users

[0747] Users can use the camera on their smartphone or PC to shoot a self-introduction video and upload it to the system using the "Video Upload" function. For example, in the self-introduction video, they can say, "My hobbies are reading and traveling."

[0748] 2. Terminal

[0749] The device sends the captured video to the server using the HTTP POST method, with the video file sent in MP4 format or similar.

[0750] 3. Server

[0751] The server receives the video file and analyzes it using a generative AI model, with a prompt such as "Analyze the content spoken in this video and the speaker's personality." Based on the analysis results, a matching profile for the user is generated and stored in a database.

[0752] Background Check Process

[0753] 1. Users

[0754] Users enter detailed information such as their educational background, work history, hobbies, and preferences, and upload supporting documents in PDF or image file format if necessary. For example, they can provide information such as "I graduated from the University of Tokyo and am currently working for an IT company."

[0755] 2. Terminal

[0756] The device sends the entered information and credentials to the server. The information is serialized in JSON format, and files are sent as multipart form data.

[0757] 3. Server

[0758] The server verifies the received information and certificates, performs necessary checks and analyses, then stores the information in a database as reliable information and notifies the user if any fraud is detected.

[0759] Providing manned support

[0760] 1. Users

[0761] Users can request profile improvement or dating advice through the application's support function, such as "How can I make my profile more appealing?"

[0762] 2. Server

[0763] The server transfers the support request to the matchmaking advisor and manages the progress of the request.

[0764] 3. Marriage Advisor

[0765] Based on the request, the matchmaking advisor creates advice and registers it on the server. For example, they can provide specific advice such as, "In your self-introduction, it's a good idea to include your strengths and specific anecdotes."

[0766] 4. Server

[0767] The server notifies the user of the advice and stores the content in a database.

[0768] Post-marriage support

[0769] 1. Users

[0770] If the marriage is successful, you can request support with wedding preparations, ring selection, etc. For example, you can ask for recommendations on wedding venues.

[0771] 2. Terminal

[0772] The device sends the request to the server in JSON format using HTTPS to ensure secure communication.

[0773] 3. Server

[0774] The server forwards the request to a suitable specialist and manages the progress.

[0775] 4. Specialist

[0776] The specialists report the status of service provision to the server, and the server notifies the user of the latest information based on the content of the reports.

[0777] Detailed personal analysis

[0778] 1. Users

[0779] Users input detailed personal data such as their hobbies, preferences, contact frequency, and financial sense, and then link it to external related services. For example, users can provide information such as "I like watching movies and go to the cinema once a week."

[0780] 2. Terminal

[0781] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[0782] 3. Server

[0783] The server generates a personal profile based on the collected data and applies it to the matching algorithm, using a generative AI model to analyze the data and generate a profile that will enable highly accurate matching.

[0784] As a complete system, the present invention efficiently aggregates basic and detailed user information and then uses generative AI models to provide optimal matching and high-quality support. Specific examples of prompts include:

[0785] "Please use AI to analyze the self-introduction videos of users in a marriage consultation service and generate optimal matching profiles."

[0786] "We review the authenticity of the biographical information provided by users to ensure there is no fraud."

[0787] This allows users to enjoy effective and reliable matchmaking services at low cost.

[0788] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0789] User registration and initial data entry

[0790] Step 1:

[0791] A user enters initial data such as "name," "gender," "age," "occupation," and "location" through an application or website. For example, a user enters information such as "Yamada Taro," a male, 30-year-old engineer.

[0792] Input: Basic information entered by the user (name, gender, age, occupation, location)

[0793] Output: User profile initial data

[0794] Step 2:

[0795] The terminal displays the entered initial data on the screen for the user to confirm. When the user presses the "Send" button, the terminal sends the data to the server using the HTTPS protocol.

[0796] Input: Basic information entered by the user, and pressing the submit button

[0797] Output: Basic information sent to the server

[0798] Step 3:

[0799] The initial data received by the server is validated to ensure there are no errors in the content and then saved to the database. For example, it checks whether the age is an integer or whether the email address is in the correct format.

[0800] Input: User basic information sent to the server

[0801] Output: User profile information stored in a database

[0802] Video Review Process

[0803] Step 1:

[0804] The user shoots a self-introduction video using the camera on their smartphone or PC. After filming, the video is uploaded to the system using the application's "Video Upload" function. For example, a user may film a video saying, "My hobbies are reading and traveling."

[0805] Input: Self-introduction video

[0806] Output: Video file saved on device

[0807] Step 2:

[0808] The device temporarily saves the uploaded video, and when the user presses the "Send" button, the video file is sent to the server. The HTTP POST method is used to send the video file in MP4 format.

[0809] Input: Video file, press send button

[0810] Output: Video file sent to the server

[0811] Step 3:

[0812] The server receives the video file and creates a prompt for the generative AI model, such as "Analyze the content of what is being said in this video and the speaker's personality."The server then generates a matching profile for the user based on the analysis results obtained from the generative AI model and stores it in a database.

[0813] Input: Video file sent to the server

[0814] Output: Generated matching profile, analysis results stored in database

[0815] Background Check Process

[0816] Step 1:

[0817] Users enter detailed information such as their educational background, work history, hobbies, and preferences into the application's input form, and upload supporting documents in PDF or image format if necessary. For example, they can provide information such as "graduated from the University of Tokyo and currently works for an IT company."

[0818] Input: Detailed information such as educational background, work history, hobbies and interests, and supporting documents

[0819] Output: Details and supporting documents stored on your device

[0820] Step 2:

[0821] The device sends the entered details and supporting documents to the server, where the information is serialized in JSON format and the files are sent as multipart form data.

[0822] Input: Detailed information, supporting documents, click submit button

[0823] Output: Details and proof sent to the server

[0824] Step 3:

[0825] The server verifies the details and certificates received, performs necessary checks and analyses, stores the information in a database as reliable information, and notifies the user if any irregularities are detected.

[0826] Input: Details and supporting documents sent to the server

[0827] Output: reliable information stored in a database, notification to the user

[0828] Providing manned support

[0829] Step 1:

[0830] A user requests profile improvement or dating advice from the application's support function, for example, "How can I make my profile more appealing?"

[0831] Input: Support request details

[0832] Output: Support request saved on device

[0833] Step 2:

[0834] The server transfers the support request to the matchmaking advisor and manages the progress of the request.

[0835] Input: Support request from user

[0836] Output: Transfer request to matchmaking advisor

[0837] Step 3:

[0838] Based on the request, the matchmaking consultant will create advice and register it on the server. For example, they can provide specific advice such as, "In your self-introduction, it's a good idea to include your strengths and specific anecdotes."

[0839] Input: Support request details

[0840] Output: Created advice, registered details on the server

[0841] Step 4:

[0842] The server notifies the user of the advice and stores the contents in a database.

[0843] Input: Advice content

[0844] Output: Notify user, save advice to database

[0845] Post-marriage support

[0846] Step 1:

[0847] If the user gets married, they can request support for wedding preparations, ring selection, etc. For example, they can ask, "Please recommend a wedding venue."

[0848] Input: Post-marriage support request

[0849] Output: Support request saved on device

[0850] Step 2:

[0851] The device sends the request to the server in JSON format using HTTPS to ensure secure communication.

[0852] Input: Support request details, click the send button

[0853] Output: Support request sent to the server

[0854] Step 3:

[0855] The server forwards the request to a suitable specialist and manages the progress.

[0856] Input: Support request details

[0857] Output: Request for transfer to specialist company, progress management

[0858] Step 4:

[0859] The specialists report the status of service provision to the server, and the server notifies the user of the latest information based on the content of the reports.

[0860] Input: Service availability from specialist vendors

[0861] Output: Notify user of latest information

[0862] Detailed personal analysis

[0863] Step 1:

[0864] Users input detailed personal data such as "interests and preferences," "frequency of contact," and "money sense," and link it to external related services. For example, it provides information such as "I like watching movies and go to the cinema once a week."

[0865] Input: Detailed information such as hobbies, preferences, frequency of contact, and financial sense

[0866] Output: Details saved on the device

[0867] Step 2:

[0868] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[0869] Input: Detailed information, press the submit button

[0870] Output: Details sent to the server, data retrieved from related services

[0871] Step 3:

[0872] The server generates a personal profile based on the collected data and applies it to the matching algorithm, which uses a generative AI model to analyze the data and achieve high-precision matching.

[0873] Input: Collected detailed data, generative AI model

[0874] Output: Generated personal profile, fed into the matching algorithm

[0875] The system efficiently and accurately collects basic and detailed user information and utilizes generative AI models to provide optimal matching and high-quality support.

[0876] (Application example 1)

[0877] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0878] In recent years, there has been a demand for virtual stores to efficiently analyze users' purchasing behavior and provide optimal products and services. However, conventional systems have had difficulty in analyzing users' individual preferences and purchasing behavior in detail and making personalized recommendations. In addition, user support and advice are not provided in real time, which has led to low satisfaction.

[0879] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0880] In this invention, the server includes: a means for a user to input initial data and transmit it from the terminal; a means for the server to save the user's initial data in a database; a means for a user to film a self-introduction video and upload it from the terminal; a means for the server to analyze the uploaded video using AI technology and generate a matching profile; a means for a user to input detailed career information and transmit it from the terminal; a means for the server to review the received career information and store it in a database as reliable information; a means for a user to submit a support request; a means for the server to notify an expert of the request and notify the user of advice; a means for a user to request specific support; a means for the server to forward the request to the expert and notify the user of progress; a means for a user to input detailed personal data and link with related services; a means for the server to analyze a personal profile based on collected data and reflect it in a matching algorithm; a means for a user to input purchasing behavior data and transmit it from the terminal; and a means for the server to analyze the received purchasing behavior data and generate individual recommendations using a recommendation algorithm. This enables detailed analysis of users' individual preferences and purchasing behavior and makes personalized recommendations in real time.

[0881] "User" refers to an individual who uses the system to receive services.

[0882] "Initial data" refers to basic information that a user first enters when using the system.

[0883] "Terminal" refers to a digital device used by a user, such as a computer, smartphone, or tablet.

[0884] "Server" refers to the central computer that processes and stores data and manages the entire system.

[0885] A "database" is a storage area within a system for organizing and storing information obtained from users.

[0886] A "self-introduction video" is video content that a user has filmed to introduce basic information about themselves and their hobbies and preferences.

[0887] "Uploading" refers to the act of a user sending digital data from a terminal to a server.

[0888] "AI technology" refers to the use of artificial intelligence techniques, including machine learning and data analysis, to analyze data and make inferences and predictions.

[0889] A "matching profile" is a user profile created based on the user's attributes and personality information analyzed using AI technology.

[0890] "Career information" is detailed user information such as educational background, work history, hobbies, and preferences.

[0891] "Verification" is the process by which the server verifies the reliability and accuracy of the data it receives.

[0892] A "support request" is an action by a user to communicate through the system that they require support.

[0893] An "expert" is a person with the expertise to respond to a support request submitted by a user.

[0894] "Professional" refers to a company or organization that provides a specific service or product.

[0895] "Integration" refers to the sharing of data and functions between different systems.

[0896] A "matching algorithm" is an algorithm that calculates and provides the best match based on a user's profile and data.

[0897] "Purchasing behavior data" is information about products and services purchased by a user in the past.

[0898] A "recommendation algorithm" is an algorithm that suggests optimal products and services based on a user's preferences and behavioral history.

[0899] This invention relates to a personalized recommendation system for a virtual store used by a user. This system includes functions for a user to input initial data and send it from a terminal, a server to save the user's initial data in a database, a user to film a self-introduction video and upload it from a terminal, a server to analyze the uploaded video using AI technology and generate a matching profile, a user to input detailed career information and send it from a terminal, a server to review the received career information and save it in a database as reliable information, a user to submit a support request, a server to notify an expert of the request and notify the user of advice, a user to request specific support, a server to forward the request to an expert and notify the user of progress, a user to input detailed personal data and link with related services, a server to analyze the personal profile based on the collected data and reflect it in a matching algorithm, a user to input purchasing behavior data and send it from a terminal, and a server to analyze the received purchasing behavior data and generate individual recommendations using a recommendation algorithm.

[0900] Hardware and software used

[0901] The system is implemented using the following hardware and software:

[0902] User devices: computers, smartphones, tablets, etc.

[0903] Server: A central computer for data processing and storage, a cloud service (e.g. AWS, Google Cloud).

[0904] Database: A system for storing user information and analytical data (e.g., MySQL, MongoDB).

[0905] AI technologies: Machine learning frameworks (e.g., TensorFlow, PyTorch) for data analysis, video analysis, and recommendation algorithms.

[0906] Data processing and calculation

[0907] The server processes and calculates the data in the following steps:

[0908] 1. Initial data sent from the user's device is stored in the database, including name, gender, age, occupation, location, etc.

[0909] 2. When a user uploads a self-introduction video, the server uses AI technology to analyze the video and generate a matching profile based on the user's speaking style and personality.

[0910] 3. The user enters detailed background information, and the server examines the data sent from the device and stores it in a database as reliable information. If any fraudulent data or violations are detected, the server notifies the user.

[0911] 4. When a user submits a support request, the server notifies an expert of the request and provides advice to the user. For example, a request might be "I want to choose a new outdoor jacket."

[0912] 5. When a user requests specific support, the server forwards the request to a specialist and notifies the user of the status of the service. Specific support may include wedding preparations, etc.

[0913] 6. Once the user enters detailed personal data, the server will connect with related services to perform a detailed analysis of the personal profile and reflect this in the next matching algorithm.

[0914] 7. The user inputs purchasing behavior data, the server analyzes the data sent from the device, and generates personalized recommendations using a recommendation algorithm.

[0915] Specific examples (prompt sentence examples)

[0916] 1. "I'm looking for a new tent for camping. Which one do you recommend?"

[0917] 2. "What are the best snacks for a weekend movie night?"

[0918] 3. "Please suggest a fashion outfit for going to a jazz concert."

[0919] In this way, the system according to the present invention can provide personalized recommendations and real-time advice based on detailed analysis of users' individual preferences and purchasing behavior, thereby improving the user experience in the virtual store.

[0920] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0921] Step 1:

[0922] The user enters initial data (such as name, gender, age, occupation, and location) and sends it from the terminal. The entered data is sent from the terminal to the server. The server saves this initial data in a database. In this process, the server checks the data format and stores the initial data in the database as structured data.

[0923] Step 2:

[0924] The user films a self-introduction video and uploads it from their device. The device then sends the video data to the server. The server then analyzes the received video using AI technology (e.g., TensorFlow) to determine the user's speaking style and personality. Based on the analysis results, the server generates a matching profile and stores it in a database.

[0925] Step 3:

[0926] The user enters detailed career information (educational background, work history, hobbies, preferences, etc.) and submits it from the device. The device then sends the career information to the server. The server reviews the received career information and stores it in a database as reliable information. The review includes validating the input data and checking supporting documents as necessary. If any fraud or violation is detected, the server notifies the user.

[0927] Step 4:

[0928] A user submits a support request. For example, a user might request, "I want to choose a new outdoor jacket." The device then sends the request to the server. The server then notifies an expert of the request, who then provides advice. The advice is then sent to the user via the server. This allows the user to receive personalized advice from the expert.

[0929] Step 5:

[0930] The user requests specific support (e.g., wedding preparations). The device sends the request to the server. The server forwards the request to a specialist, who reports the status of the service provided to the server. The server notifies the user of the progress. This process allows the user to receive specialized support.

[0931] Step 6:

[0932] The user enters detailed personal data (hobbies, preferences, frequency of contact, financial sense, etc.) and sends it from their device. The device then sends the data to the server. The server then performs a detailed analysis of the personal profile based on the data and connects with related services. The profile results are reflected in the next matching algorithm, making it possible to provide personalized services to the user.

[0933] Step 7:

[0934] The user enters purchasing behavior data (past purchase history and browsing history) and sends it from the device. The device then sends the data to the server. The server analyzes the received purchasing behavior data and generates individual recommendations using a generative AI model. The recommendation results are notified to the user, allowing them to receive personalized product and service suggestions.

[0935] In each step, a personalized recommendation system in the virtual store is realized through specific actions taken by the server, the terminal, and the user.

[0936] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0937] The system of this invention utilizes AI technology and an emotion engine to provide a low-cost, high-quality marriage consultation service. It includes the main elements of the user, terminal, and server, each of which performs the following specific operations.

[0938] User registration and initial data entry

[0939] 1. Users

[0940] When starting the service, a user registers an account to enter basic information such as name, gender, age, occupation, location, etc. For example, a user enters basic information such as the name "Yamada Taro," gender, and age.

[0941] 2. Terminal

[0942] The terminal displays the initial data entered by the user on the screen, asks for confirmation, and then sends the data to the server by pressing a send button.

[0943] 3. Server

[0944] The server stores the received initial data in a database and creates an account for the user.

[0945] Video Review Process

[0946] 1. Users

[0947] Users can record a self-introduction video on their device and upload it to the system. For example, they can introduce themselves by saying, "My hobbies are reading and traveling."

[0948] 2. Terminal

[0949] The device sends the captured video file to the server.

[0950] 3. Server

[0951] The server analyzes the uploaded video file using AI technology to determine the user's speaking style, personality, and emotions. The emotion engine analyzes the user's facial expressions and tone of voice to obtain emotional data.

[0952] The server generates a matching profile based on the analysis results and stores it in a database.

[0953] Background Check Process

[0954] 1. Users

[0955] Users enter detailed career information such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. For example, a user may provide information such as "I graduated from the University of Tokyo and am currently working for an IT company."

[0956] 2. Terminal

[0957] The terminal transmits the entered history information to the server.

[0958] 3. Server

[0959] The server reviews the received background information, stores it in a database as reliable information, checks for fraud or violations, and notifies the user if there is anything suspicious.

[0960] Providing manned support

[0961] 1. Users

[0962] Users request support such as profile improvement or dating advice. For example, "How can I make my profile more appealing?"

[0963] 2. Server

[0964] The server forwards the support request to a matchmaking advisor.

[0965] 3. Marriage Advisor

[0966] The marriage advisor provides specific advice to the user and registers the details on the server.

[0967] 4. Server

[0968] The server notifies the user of the advice and stores it in a database. The emotion engine analyzes the user's emotions in real time and provides the results to the advisor.

[0969] Post-marriage support

[0970] 1. Users

[0971] After getting married, users can request support for wedding preparations, ring selection, etc. For example, they can ask for recommendations for wedding venues.

[0972] 2. Terminal

[0973] The terminal transmits a request for support after marriage to the server.

[0974] 3. Server

[0975] The server transfers the request to the specialist and manages the progress.

[0976] 4. Specialist

[0977] The specialists report the status of service provision to the server, and the server notifies the user of the details.

[0978] Detailed personal analysis

[0979] 1. Users

[0980] Users input detailed personal data such as their hobbies, preferences, frequency of contact, and financial sense, and then approve the connection to related services. For example, they provide detailed information such as "I like watching movies and go to the cinema once a week."

[0981] 2. Terminal

[0982] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[0983] 3. Server

[0984] The server performs a detailed analysis of the user's personal profile based on the collected data and reflects the results of the analysis in the next matching algorithm.

[0985] The emotion engine simultaneously analyzes the user's emotional data and incorporates it into a personal profile.

[0986] In this way, the system of the present invention utilizes AI technology and an emotion engine to provide users with optimal matches and high-quality support, allowing them to effectively pursue their matchmaking at low cost.

[0987] The processing flow will be explained below.

[0988] Step 1:

[0989] Users access an account registration form and enter initial data such as name, gender, age, occupation, and location.

[0990] Step 2:

[0991] The terminal displays the initial data entered by the user on a confirmation screen, and when the user presses the send button, the data is sent to the server.

[0992] Step 3:

[0993] The server stores the received initial data in a database.

[0994] Step 4:

[0995] Users film a self-introduction video on their device and upload it to the system, introducing themselves, for example, "My hobbies are reading and traveling."

[0996] Step 5:

[0997] The terminal transmits the captured video file to the server.

[0998] Step 6:

[0999] The server analyzes the received video file using AI technology to determine the user's speaking style and personality, and then uses an emotion engine to analyze the user's facial expressions and tone of voice to obtain emotional data.

[1000] Step 7:

[1001] The server generates a matching profile based on the analysis results and emotional data and stores it in a database.

[1002] Step 8:

[1003] Users enter detailed career information such as their educational background, work history, hobbies, and preferences into the terminal, providing information such as "graduated from the University of Tokyo and currently works for an IT company."

[1004] Step 9:

[1005] The terminal sends the entered biographical information and certificate documents to the server.

[1006] Step 10:

[1007] The server reviews the received background information, stores it in a database as reliable information, and notifies the user if there is anything suspicious.

[1008] Step 11:

[1009] Users submit support requests, such as profile improvements and dating advice, right from their devices. For example, they might ask, "How can I make my profile more appealing?"

[1010] Step 12:

[1011] The server forwards the support request to a matchmaking advisor.

[1012] Step 13:

[1013] The marriage advisor provides specific advice to the user and registers the details on the server.

[1014] Step 14:

[1015] The server notifies the user of the advice and stores it in a database. The emotion engine analyzes the user's emotional changes and provides them to the advisor.

[1016] Step 15:

[1017] After getting married, users can request support for wedding preparations, ring selection, etc. For example, they can ask for recommendations for wedding venues.

[1018] Step 16:

[1019] The terminal transmits a request for support after marriage to the server.

[1020] Step 17:

[1021] The server transfers the request to the specialist and manages the progress.

[1022] Step 18:

[1023] The specialists report the status of service provision to the server, and the server notifies the user of the details.

[1024] Step 19:

[1025] Users input detailed personal data such as their hobbies, preferences, frequency of contact, and financial sense on their devices, and then approve the connection to related services. For example, they may provide detailed information such as "I like watching movies and go to the cinema once a week."

[1026] Step 20:

[1027] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[1028] Step 21:

[1029] The server performs a detailed analysis of the user's personal profile based on the collected data and emotional data, and reflects the results in the next matching algorithm.

[1030] Step 22:

[1031] The server uses an improved matching algorithm to present the best possible matches to the user.

[1032] Example 2

[1033] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1034] Conventional marriage consultation services have had problems such as the time and cost required for the user information gathering and matching process, as well as the difficulty of finding the perfect partner for the user. Furthermore, matching based on simple information input does not take into account the user's personality or emotions, making effective matching difficult.

[1035] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1036] In this invention, the server includes: means for a user to input initial data and send it from the terminal; means for the server to save the user's initial data in a database; means for a user to film a self-introduction video and upload it from the terminal; means for the server to analyze the uploaded video using AI technology and generate a matching profile; means for a user to input detailed career information and send it from the terminal; means for the server to review the received career information and save it in a database as highly reliable information; means for a user to submit a support request; means for the server to notify a matchmaking advisor of the request and notify the user of advice; means for a user to request post-marriage support; means for the server to forward the request to a specialist and notify the user of progress; means for a user to input detailed personal data and link with related services; means for the server to analyze a personal profile based on the collected data and reflect the results in a matching algorithm; means for the server to use an emotion engine to analyze the user's emotional data in real time; means for the server to provide the user's emotional data to the matchmaking advisor; and means for the server to review suspicious career information and notify the user. This will enable high-quality matching and support that takes into account the user's personality and emotions.

[1037] "Initial data" refers to basic information that is initially entered when using the service, such as the user's name, gender, age, occupation, and location.

[1038] "Terminal" refers to an electronic device that a user uses to input information and transmit data to a server.

[1039] "Server" refers to a central computer system for receiving, processing, and storing data submitted by users.

[1040] "Database" refers to a digital information storage system in which a server organizes and permanently stores information.

[1041] "Self-introduction video" refers to a video file that a user shoots to introduce themselves and uploads to the system.

[1042] "AI technology" refers to technology that uses artificial intelligence to analyze data and perform specific tasks.

[1043] "Matching profile" refers to profile data generated based on information such as a user's personality, preferences, and emotions analyzed using AI technology.

[1044] "Career information" refers to detailed personal information entered by the user, such as educational background, work history, hobbies, and preferences.

[1045] A "marriage advisor" refers to an expert who provides users with advice and support regarding marriage hunting.

[1046] "Specialist providers" refer to those who handle post-wedding support requests and provide services such as wedding planning and ring selection.

[1047] An "emotion engine" refers to an analysis system that analyzes a user's facial expressions, tone of voice, etc. to obtain emotional data.

[1048] "Suspicious background information" refers to background information provided by a user that is unreliable or may be false.

[1049] The system of the present invention includes the main elements of a user, a terminal, and a server, and utilizes AI technology and an emotion engine to provide marriage consultation services at low cost and with high quality.

[1050] When starting the service, the user uses a terminal to enter basic initial data such as name, gender, age, occupation, and location. The data entered by the user is sent to the server by the terminal. The server stores the received initial data in a database and creates an account for the user.

[1051] Next, the user films a self-introduction video on their device and uploads it to the system. For example, they might introduce themselves by saying, "My hobbies are reading and traveling." This video file is also sent to the server via the device. The server uses a generative AI model to analyze the uploaded video and determine the user's speaking style, personality, and emotions. An emotion engine analyzes the user's facial expressions and tone of voice to obtain emotional data. Based on the analysis results, the server generates a matching profile and stores it in a database.

[1052] Users also enter detailed career information such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. For example, they may provide information such as "graduated from the University of Tokyo and currently works for an IT company." The device then sends this information to the server, which then reviews the received career information and stores it in a database as reliable information. At this time, the server checks for any fraud or violations, and notifies the user if anything suspicious is found.

[1053] Additionally, users can request support such as profile improvement and dating advice. For example, they can request, "How can I make my self-introduction more appealing?" The server forwards this request to a matchmaking advisor. The matchmaking advisor provides specific advice to the user and registers it on the server. The server notifies the user of the advice and stores it in a database. The emotion engine also analyzes the user's emotions in real time and provides the results to the advisor.

[1054] After getting married, the user can request support for wedding preparations, ring selection, etc. For example, they can ask for "recommended wedding venues." The device sends this support request to the server, which then forwards the request to a specialist and manages the progress. The specialist reports the status of the service provided to the server, and the server notifies the user of the details.

[1055] For detailed personal analysis, the user enters detailed personal data such as hobbies, preferences, frequency of contact, and financial sense, and approves data sharing with other related services. For example, a user may provide information such as "I like watching movies and go to the cinema once a week." The device then sends this data to the server, which retrieves the necessary data from related services. The server then performs a detailed analysis of the user's personal profile based on the retrieved data and reflects the results in the next matching algorithm. In parallel, the emotion engine analyzes the user's emotional data and incorporates it into the personal profile.

[1056] Examples of specific prompt sentences include, "Please explain in detail the user registration procedure for the matchmaking system" and "Please tell me in detail the flow of the video review process for the matchmaking system."

[1057] In this way, this system, which utilizes AI technology, enables users to effectively pursue their matchmaking at low cost, and receives high-quality support and matching.

[1058] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1059] Step 1:

[1060] The user enters the initial data and sends it from the terminal.

[1061] The user enters basic initial data such as name, gender, age, occupation, and location into the terminal. This data includes information such as "Yamada Taro, male, 30 years old, engineer, living in Tokyo." The terminal then sends the entered data to the server. The server stores the received data in a database and creates an account for the user.

[1062] Input: Basic data such as name, gender, age, occupation, location, etc.

[1063] Output: User accounts stored in the database

[1064] Step 2:

[1065] Users record their own self-introduction videos and upload them from their devices.

[1066] The user records a video of themselves introducing themselves on their device. For example, they might say, "My hobbies are reading and traveling." The recorded video file is saved on the device and uploaded to the system. The device then sends this video file to the server. The server receives the video file and analyzes it using AI technology and an emotion engine.

[1067] Input: Self-introduction video file

[1068] Output: Analyzed video data (speaking style, personality, emotion assessment results)

[1069] Step 3:

[1070] The server analyzes the video and generates a matching profile

[1071] The server analyzes the received video file using AI technology and an emotion engine. This analysis determines the user's speaking style, personality, and emotions. For example, the AI ​​may determine that the user is cheerful and sociable. Based on this, the server generates a matching profile and stores it in a database.

[1072] Input: Analyzed video data

[1073] Output: The generated matching profile

[1074] Step 4:

[1075] The user enters detailed biographical information and submits it from the device

[1076] Users enter detailed career information such as their educational background, work history, hobbies, and preferences, and upload supporting documents such as "graduated from the University of Tokyo and currently works for an IT company." The device then sends the career information and supporting documents to the server, which receives and reviews this information and stores it in a database as reliable information.

[1077] Input: detailed career information, supporting documents

[1078] Output: reliable biographical information stored in a database

[1079] Step 5:

[1080] The server reviews the background information and notifies the user if there is anything suspicious.

[1081] The server reviews the user's background information to check for any irregularities or violations. If anything suspicious is found, the server notifies the user and asks for additional information or reconfirmation.

[1082] Input: Detailed biographical information

[1083] Output: Save reliable information in a database or notify the user

[1084] Step 6:

[1085] A user submits a support request, which the server forwards to a matchmaking advisor.

[1086] A user requests support such as profile improvement or dating advice. Specifically, they ask, "How can I make my profile more appealing?" The server forwards this request to a matchmaking advisor.

[1087] Input: Support Request

[1088] Output: Transfer request to matchmaking advisor

[1089] Step 7:

[1090] A marriage advisor provides advice and registers it on the server.

[1091] The marriage advisor provides specific advice to the user and registers the advice on the server. For example, the advisor may provide advice such as, "It would be good if you wrote more specifically about your hobbies and interests."

[1092] Input: Support Request

[1093] Output: Advice provided

[1094] Step 8:

[1095] The server notifies the user of the advice and stores it in the database.

[1096] The server notifies the user of the advice received from the matchmaking advisor and stores it in a database. The emotion engine also analyzes the user's emotions in real time and provides the results to the advisor.

[1097] Input: Advice provided

[1098] Output: Notify user and save to database

[1099] Step 9:

[1100] The user requests post-marriage support and sends it from the device

[1101] The user requests support for wedding preparations, ring selection, etc. For example, they may ask, "Please recommend a wedding venue." The device sends this support request to the server.

[1102] Input: Post-marriage support request

[1103] Output: Request sent to server

[1104] Step 10:

[1105] The server forwards the request to the specialist and notifies the user of the progress

[1106] The server transfers the support request after the marriage to the specialist and manages the progress. The specialist reports the service provision status to the server, and the server notifies the user of the information.

[1107] Input: Post-marriage support request

[1108] Output: Forward to specialist and notify user

[1109] Step 11:

[1110] Users enter detailed personal data and connect with related services

[1111] Users input detailed personal data such as their hobbies, preferences, frequency of contact, and financial sense, providing information such as "I like watching movies and go to the cinema once a week." They also approve data sharing with other related services. The device then sends this data to the server and retrieves the necessary data from the related services.

[1112] Input: Detailed personal data

[1113] Output: Data retrieved from related services

[1114] Step 12:

[1115] The server analyzes personal profiles based on the data collected and reflects this in the matching algorithm.

[1116] The server analyzes the user's personal profile in detail based on the collected data and reflects the analysis results in the next matching algorithm. It also analyzes the user's emotional data using an emotion engine and incorporates it into the personal profile.

[1117] Input: Detailed personal data collected

[1118] Output: Personal profile reflected in the matching algorithm

[1119] (Application example 2)

[1120] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1121] Conventional marriage consultation services have faced the problem of high costs for providing high-quality matching and support. It is also difficult to analyze users' emotions and detailed career information in real time and provide optimal advice based on this information. Furthermore, there is a lack of a way for users to receive support efficiently and effectively using smart devices.

[1122] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a user to make a support request in real time using a smart device, a means for analyzing the user's emotional data in real time using AI technology and storing it in a database, and a means for providing appropriate advice using prompt sentences based on a generative AI model. This enables users to receive high-quality matchmaking support and post-marriage support at low cost.

[1123] A "user" is an individual who uses the marriage consultation service.

[1124] A "terminal" is a mobile device used by a user, such as a smartphone or smart glasses.

[1125] "Server" means the central computer system that stores and analyzes User data and manages the entire Service.

[1126] "Initial data" refers to basic personal information such as name, gender, age, and location that a user enters when registering.

[1127] A "database" is an information management system for systematically storing user information, analysis results, and the like.

[1128] A "self-introduction video" is a short video that a user films to introduce their hobbies, interests, and personality.

[1129] "AI technology" is a technology that uses artificial intelligence to perform data analysis and pattern recognition.

[1130] A "matching profile" is a data set used to recommend optimal partner candidates based on user information.

[1131] "Career information" is detailed personal information provided by a user, such as educational background, work history, hobbies, and preferences.

[1132] A "support request" is a request made by a user to a matchmaking advisor or specialist for support.

[1133] A "marriage advisor" is a specialist who provides advice and support to users in marriage consultation services.

[1134] "Specialist vendors" are professional vendors who provide wedding preparation and related services after the marriage.

[1135] A "personal profile" is a profile generated by analyzing a user's detailed personal information and emotional data.

[1136] A "smart device" is a device with advanced functionality that is connected to the Internet, such as a smartphone or smart glasses.

[1137] "Real-time analytics" refers to an analytical process that is performed immediately as data is generated.

[1138] A "generative AI model" is a generative artificial intelligence algorithm that is trained to perform a specific task.

[1139] A "prompt" is an instruction or question given to a generative AI model, which then generates an appropriate output.

[1140] This invention utilizes AI technology and an emotion engine to provide low-cost, high-quality marriage consultation services. In particular, a specific embodiment of the invention is described below in the context of building a virtual marriage consultation center using smart devices.

[1141] User registration and initial data entry

[1142] The user uses a smart device (e.g., smartphone or smart glasses) to enter basic information such as name, gender, age, and location. The device displays the entered data on the screen and, after confirmation, sends it to the server. The server stores the received initial data in a database and creates an account for the user.

[1143] Video Review Process

[1144] Users film a self-introduction video on their smart device and upload it to the server. The server then uses AI technology to analyze the uploaded video and obtain emotional data based on the user's speaking style, personality, facial expressions, tone of voice, etc. The analysis results are stored in a database and used as a matching profile.

[1145] Background Check Process

[1146] Users enter detailed career information, such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. The device then sends the input data to the server, which reviews the received information. Only highly reliable information is stored in the database and reflected in the next match.

[1147] Providing manned support

[1148] Users use their smart devices to request support such as improving their profile or dating advice. The server then forwards the request to a matchmaking advisor, who then provides specific advice to the user. The advice is registered on the server and notified to the user. The system also has a real-time emotion analysis function, which uses AI technology to analyze the user's emotional data and reflects it in the support content.

[1149] Post-marriage support

[1150] After getting married, users request support for wedding preparations and their new life. The request is sent to the server using a smart device. The server then forwards the request to a specialist and manages the progress. The status of the service provided by the specialist is notified to the user via the server.

[1151] Detailed personal analysis

[1152] Users input detailed personal data such as hobbies, preferences, frequency of contact, and financial sense, and approve connection to related services. The device then sends the input data to the server, which collects various data and generates a detailed personal profile. The generated profile is reflected in the next matching approach. The system also provides optimal advice using prompts based on the generative AI model.

[1153] Program processing overview

[1154] 1. Hardware and Software Use:

[1155] Smart devices (smartphones, smart glasses)

[1156] Server and Database Server: MySQL

[1157] AI technology and emotion analysis engine

[1158] Web framework: Flask

[1159] 2. Data processing and calculation:

[1160] Input and storage of initial data and biographical information

[1161] Upload a video file and obtain emotional data through AI analysis

[1162] Background checks and credibility checks

[1163] Real-time emotion analysis and AI-powered prompt generation

[1164] Support request management and routing to specialists

[1165] Specific examples

[1166] A user accesses a virtual matchmaking agency app and inputs a support request saying, "I want to make my self-introduction more appealing." AI technology and an emotion engine perform real-time analysis, and using a generative AI model, generate a prompt message saying, "To improve your self-introduction, it would be good to talk more specifically about your hobbies and interests," and notify the user of this message.

[1167] Example prompt sentence:

[1168] To improve your self-introduction, it's a good idea to talk specifically about your hobbies and interests.

[1169] In this way, the present invention can provide users with effective support for finding a partner and support after marriage at low cost.

[1170] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1171] Step 1:

[1172] The user uses a smart device to input initial data such as name, gender, age, and location. The device displays this input data on the screen and sends it to the server after the user confirms it. The server stores the received initial data in a database and creates an account for the user. The input data consists of basic personal information, and a new record is generated in the database based on this data.

[1173] Step 2:

[1174] Users use their smart devices to film a self-introduction video and upload it to a server. The server receives the uploaded video file and uses AI technology to process and analyze it. Through analysis, emotional data is generated based on the user's speaking style, personality, facial expressions, and tone of voice. This emotional data is stored in a database and is reflected in subsequent matching profiles.

[1175] Step 3:

[1176] Using a smart device, users enter detailed career information such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. The device then sends the input data and supporting documents to a server. The server then reviews the received data, confirms its authenticity, and stores it in a database. At this point, a data analysis algorithm checks for any irregularities or inconsistencies, and if there are no problems, the data is reflected in the matching algorithm.

[1177] Step 4:

[1178] Users use their smart devices to send support requests, such as profile improvements or dating advice. The server receives the request and notifies the matchmaking advisor. The matchmaking advisor provides specific advice for the support content and registers it on the server. The server notifies the registered advice to the user and also stores it in a database. During this process, the advice may also reflect the results of sentiment analysis.

[1179] Step 5:

[1180] After getting married, users request support for wedding preparations and their new life. They input the request using a smart device and send it from the terminal to a server. The server then forwards the request to a specialist and manages the progress. The status of the service provided by the specialist is notified to the user via the server. The input request details are tracked by a progress management system, and updates are sent to the server as needed and displayed to the user.

[1181] Step 6:

[1182] Users input detailed personal data such as hobbies, preferences, frequency of contact, and financial sense, and approve linkage with related services. The device sends this input data to the server, which then retrieves the necessary data from the related services. The server analyzes this data and generates a detailed personal profile of the user. The generated profile is reflected in the next matching algorithm, helping the user choose a partner based on their individual needs and preferences.

[1183] Step 7:

[1184] The server uses the generative AI model to generate prompts in response to support requests from users. For example, in response to a request such as "I want to make my self-introduction more appealing," the server sends specific advice such as "To improve your self-introduction, it would be good to talk specifically about your hobbies and interests." The generated prompts are notified to the user in real time, and are linked to the results of sentiment analysis to provide optimal advice.

[1185] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1186] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1187] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1188] [Third embodiment]

[1189] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1190] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1191] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1192] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1193] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1194] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1195] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1196] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1197] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1198] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1199] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1200] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1201] The system of the present invention is designed to achieve low-cost, high-quality matching in marriage consultation services. This system is composed of elements including users, terminals, and servers, and performs the following specific operations.

[1202] User registration and initial data entry

[1203] 1. Users

[1204] When starting the service, users register an account to enter basic information such as name, gender, age, occupation, location, etc. For example, a user enters information such as "Yamada Taro," a 30-year-old male engineer.

[1205] 2. Terminal

[1206] The terminal displays the data entered by the user on the screen, and when the user presses the send button, the data is sent to the server.

[1207] 3. Server

[1208] The server processes the received initial data and stores it in a database for each user, thereby registering the user's basic information in the system.

[1209] Video Review Process

[1210] 1. Users

[1211] A user can record a self-introduction video and upload it to the system. For example, the user can say in the self-introduction video, "My hobbies are reading and traveling."

[1212] 2. Terminal

[1213] The device sends the captured video to the server.

[1214] 3. Server

[1215] The server uses AI technology to analyze the uploaded video, analysing the user's speaking style and personality, and then generates a matching profile based on the analysis results, which is stored in a database.

[1216] Background Check Process

[1217] 1. Users

[1218] Users enter detailed information such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. For example, a user may provide information such as "I graduated from the University of Tokyo and am currently working for an IT company."

[1219] 2. Terminal

[1220] The terminal sends the entered information and certificate documents to the server.

[1221] 3. Server

[1222] The server reviews the received background information, stores it in a database as reliable information, and notifies the user if any fraud or violation is detected.

[1223] Providing manned support

[1224] 1. Users

[1225] Users request support such as profile improvement or dating advice. For example, "How can I make my profile more appealing?"

[1226] 2. Server

[1227] Transfer support requests to matchmaking advisors and manage their progress.

[1228] 3. Marriage Advisor

[1229] The marriage advisor provides advice based on the user's request and registers the content on the server.

[1230] 4. Server

[1231] The server notifies the user of the advice and stores it in a database.

[1232] Post-marriage support

[1233] 1. Users

[1234] If the marriage is successful, you can request support with wedding preparations, ring selection, etc. For example, you can ask for recommendations on wedding venues.

[1235] 2. Terminal

[1236] Sends the request to the server.

[1237] 3. Server

[1238] The server forwards the request to a suitable specialist and manages the progress.

[1239] 4. Specialist

[1240] The specialists report the status of service provision to the server, and based on the report, notify the user of the latest information.

[1241] Detailed personal analysis

[1242] 1. Users

[1243] Detailed personal data such as hobbies, preferences, frequency of contact, and financial sense is entered and linked to related services. For example, detailed information such as "I like watching movies and go to the cinema once a week" is provided.

[1244] 2. Terminal

[1245] The input data is sent to the server, and necessary data is obtained from the related services.

[1246] 3. Server

[1247] Based on the collected data, personal profiles are analyzed in detail and the results are reflected in the next matching algorithm.

[1248] In this way, the "Marriage AI" system aggregates basic and detailed information about users and uses AI technology to provide optimal matches and high-quality support, allowing users to effectively find a partner at low cost.

[1249] The processing flow will be explained below.

[1250] Step 1:

[1251] Users access an account registration form and enter initial data such as name, gender, age, occupation, and location.

[1252] Step 2:

[1253] The terminal displays the initial data entered by the user on the screen, and after confirmation, the data is sent to the server by pressing the send button.

[1254] Step 3:

[1255] The server analyzes the received initial data and stores the user's account in a database.

[1256] Step 4:

[1257] The user shoots a self-introduction video on the terminal and uploads the video including the self-introduction content to the system.

[1258] Step 5:

[1259] The terminal transmits the captured video file to the server.

[1260] Step 6:

[1261] The server analyzes the received video file using AI technology to determine the user's speaking style and personality.

[1262] Step 7:

[1263] The server generates a matching profile based on the analysis results and stores it in a database.

[1264] Step 8:

[1265] The user inputs detailed career information such as educational background, work history, hobbies, and preferences from the terminal.

[1266] Step 9:

[1267] The terminal transmits the entered history information to the server.

[1268] Step 10:

[1269] The server reviews the received background information, stores it in a database as reliable information, and notifies the user if there is anything suspicious.

[1270] Step 11:

[1271] Users can submit support requests from their devices, asking for things like profile improvement or dating advice.

[1272] Step 12:

[1273] The server transfers the support request to the matchmaking advisor and manages the progress of the request.

[1274] Step 13:

[1275] The marriage advisor provides specific advice to the user and registers the details on the server.

[1276] Step 14:

[1277] The server notifies the user of the advice and stores it in a database.

[1278] Step 15:

[1279] After getting married, users can request support with wedding preparations and ring selection.

[1280] Step 16:

[1281] The terminal transmits a request for support after marriage to the server.

[1282] Step 17:

[1283] The server transfers the request to the specialist and manages the progress.

[1284] Step 18:

[1285] The specialists report the status of service provision to the server, and the server notifies the user of the details.

[1286] Step 19:

[1287] Users enter detailed personal data such as hobbies, preferences, frequency of contact, and financial sense on their devices and approve integration with related services.

[1288] Step 20:

[1289] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[1290] Step 21:

[1291] The server performs a detailed analysis of the user's personal profile based on the collected data and reflects the results of the analysis in the next matching algorithm.

[1292] Step 22:

[1293] The server uses an improved matching algorithm to present the best possible matches to the user.

[1294] Example 1

[1295] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1296] A major challenge facing modern marriage consultation services is the high cost and effort required to achieve efficient, high-quality matching. There is a particular need for a system that can provide users with a self-introduction video, detailed analysis of personal information, reliable information, and even post-marriage support. However, existing systems struggle to provide these services effectively and at low cost. Furthermore, there is a lack of appropriate advice and support for users, making it necessary to improve the user experience.

[1297] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1298] In this invention, the server includes a means for storing the user's initial data in a database, a means for analyzing the self-introduction video using prompt sentences in a generative AI model to generate a matching profile, and a means for analyzing the personal profile based on the collected data and reflecting this in the matching algorithm. This enables efficient registration of initial data, reliable profile generation, detailed personal data analysis, and optimal matching based on that data, all at low cost and effectively. It is also possible to provide users with appropriate advice and post-match support, which is expected to improve the overall user experience.

[1299] "Initial data" refers to basic information such as the user's name, gender, age, occupation, and location.

[1300] A "terminal" is a device used by a user to input data and send it to a server, and includes smartphones, personal computers, etc.

[1301] "Server" refers to a computer system that receives, processes, and stores data submitted by users.

[1302] A "database" is a system that allows a server to systematically store user information.

[1303] A "self-introduction video" is a video in which a user introduces themselves.

[1304] A "generative AI model" refers to an algorithm or system that uses artificial intelligence techniques to analyze data and extract meaning and patterns.

[1305] A "prompt" is text containing instructions or questions to be given to a generative AI model.

[1306] A "matching profile" is profile information generated based on a user's characteristics and preferences to help them find the perfect partner candidate.

[1307] "Career information" refers to detailed information entered by the user, such as educational background, work history, hobbies, and preferences.

[1308] "Reliability" means that information or data is accurate and free from falsehoods or errors.

[1309] A "support request" is a request submitted by a user for profile improvement, dating advice, post-marriage assistance, etc.

[1310] A "marriage advisor" refers to an expert who provides consultation and advice to users in a marriage consultation service.

[1311] "Specialist companies" refer to companies that provide post-marriage support services such as wedding preparations and ring selection.

[1312] "Personal data" refers to detailed personal information such as a user's hobbies, preferences, frequency of contact, and financial sense.

[1313] "Related services" are external services that are used in conjunction with the user's detailed personal data.

[1314] A "matching algorithm" refers to a calculation method or rule for finding the best partner candidate based on user information.

[1315] The system of the present invention uses the elements of users, terminals, and servers to achieve low-cost, high-quality matching in a marriage consultation service. This system performs the following specific processes.

[1316] User registration and initial data entry

[1317] 1. Users

[1318] A user registers an account through an application or website by entering initial data such as name, gender, age, occupation, location, etc. For example, a user enters information as "Taro Yamada," a male, 30-year-old engineer.

[1319] 2. Terminal

[1320] The terminal displays the entered initial data on the screen and sends the data to the server by pressing the send button. The data is sent securely using the HTTPS protocol.

[1321] 3. Server

[1322] The server validates the received initial data and stores it in the database after confirming that there are no errors. This registers the user's basic information in the system.

[1323] Video Review Process

[1324] 1. Users

[1325] Users can use the camera on their smartphone or PC to shoot a self-introduction video and upload it to the system using the "Video Upload" function. For example, in the self-introduction video, they can say, "My hobbies are reading and traveling."

[1326] 2. Terminal

[1327] The device sends the captured video to the server using the HTTP POST method, with the video file sent in MP4 format or similar.

[1328] 3. Server

[1329] The server receives the video file and analyzes it using a generative AI model, with a prompt such as "Analyze the content spoken in this video and the speaker's personality." Based on the analysis results, a matching profile for the user is generated and stored in a database.

[1330] Background Check Process

[1331] 1. Users

[1332] Users enter detailed information such as their educational background, work history, hobbies, and preferences, and upload supporting documents in PDF or image file format if necessary. For example, they can provide information such as "I graduated from the University of Tokyo and am currently working for an IT company."

[1333] 2. Terminal

[1334] The device sends the entered information and credentials to the server. The information is serialized in JSON format, and files are sent as multipart form data.

[1335] 3. Server

[1336] The server verifies the received information and certificates, performs necessary checks and analyses, then stores the information in a database as reliable information and notifies the user if any fraud is detected.

[1337] Providing manned support

[1338] 1. Users

[1339] Users can request profile improvement or dating advice through the application's support function, such as "How can I make my profile more appealing?"

[1340] 2. Server

[1341] The server transfers the support request to the matchmaking advisor and manages the progress of the request.

[1342] 3. Marriage Advisor

[1343] Based on the request, the matchmaking advisor creates advice and registers it on the server. For example, they can provide specific advice such as, "In your self-introduction, it's a good idea to include your strengths and specific anecdotes."

[1344] 4. Server

[1345] The server notifies the user of the advice and stores the content in a database.

[1346] Post-marriage support

[1347] 1. Users

[1348] If the marriage is successful, you can request support with wedding preparations, ring selection, etc. For example, you can ask for recommendations on wedding venues.

[1349] 2. Terminal

[1350] The device sends the request to the server in JSON format using HTTPS to ensure secure communication.

[1351] 3. Server

[1352] The server forwards the request to a suitable specialist and manages the progress.

[1353] 4. Specialist

[1354] The specialists report the status of service provision to the server, and the server notifies the user of the latest information based on the content of the reports.

[1355] Detailed personal analysis

[1356] 1. Users

[1357] Users input detailed personal data such as their hobbies, preferences, contact frequency, and financial sense, and then link it to external related services. For example, users can provide information such as "I like watching movies and go to the cinema once a week."

[1358] 2. Terminal

[1359] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[1360] 3. Server

[1361] The server generates a personal profile based on the collected data and applies it to the matching algorithm, using a generative AI model to analyze the data and generate a profile that will enable highly accurate matching.

[1362] As a complete system, the present invention efficiently aggregates basic and detailed user information and then uses generative AI models to provide optimal matching and high-quality support. Specific examples of prompts include:

[1363] "Please use AI to analyze the self-introduction videos of users in a marriage consultation service and generate optimal matching profiles."

[1364] "We review the authenticity of the biographical information provided by users to ensure there is no fraud."

[1365] This allows users to enjoy effective and reliable matchmaking services at low cost.

[1366] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1367] User registration and initial data entry

[1368] Step 1:

[1369] A user enters initial data such as "name," "gender," "age," "occupation," and "location" through an application or website. For example, a user enters information such as "Yamada Taro," a male, 30-year-old engineer.

[1370] Input: Basic information entered by the user (name, gender, age, occupation, location)

[1371] Output: User profile initial data

[1372] Step 2:

[1373] The terminal displays the entered initial data on the screen for the user to confirm. When the user presses the "Send" button, the terminal sends the data to the server using the HTTPS protocol.

[1374] Input: Basic information entered by the user, and pressing the submit button

[1375] Output: Basic information sent to the server

[1376] Step 3:

[1377] The initial data received by the server is validated to ensure there are no errors in the content and then saved to the database. For example, it checks whether the age is an integer or whether the email address is in the correct format.

[1378] Input: User basic information sent to the server

[1379] Output: User profile information stored in a database

[1380] Video Review Process

[1381] Step 1:

[1382] The user shoots a self-introduction video using the camera on their smartphone or PC. After filming, the video is uploaded to the system using the application's "Video Upload" function. For example, a user may film a video saying, "My hobbies are reading and traveling."

[1383] Input: Self-introduction video

[1384] Output: Video file saved on device

[1385] Step 2:

[1386] The device temporarily saves the uploaded video, and when the user presses the "Send" button, the video file is sent to the server. The HTTP POST method is used to send the video file in MP4 format.

[1387] Input: Video file, press send button

[1388] Output: Video file sent to the server

[1389] Step 3:

[1390] The server receives the video file and creates a prompt for the generative AI model, such as "Analyze the content of what is being said in this video and the speaker's personality."The server then generates a matching profile for the user based on the analysis results obtained from the generative AI model and stores it in a database.

[1391] Input: Video file sent to the server

[1392] Output: Generated matching profile, analysis results stored in database

[1393] Background Check Process

[1394] Step 1:

[1395] Users enter detailed information such as their educational background, work history, hobbies, and preferences into the application's input form, and upload supporting documents in PDF or image format if necessary. For example, they can provide information such as "graduated from the University of Tokyo and currently works for an IT company."

[1396] Input: Detailed information such as educational background, work history, hobbies and interests, and supporting documents

[1397] Output: Details and supporting documents stored on your device

[1398] Step 2:

[1399] The device sends the entered details and supporting documents to the server, where the information is serialized in JSON format and the files are sent as multipart form data.

[1400] Input: Detailed information, supporting documents, click submit button

[1401] Output: Details and proof sent to the server

[1402] Step 3:

[1403] The server verifies the details and certificates received, performs necessary checks and analyses, stores the information in a database as reliable information, and notifies the user if any irregularities are detected.

[1404] Input: Details and supporting documents sent to the server

[1405] Output: reliable information stored in a database, notification to the user

[1406] Providing manned support

[1407] Step 1:

[1408] A user requests profile improvement or dating advice from the application's support function, for example, "How can I make my profile more appealing?"

[1409] Input: Support request details

[1410] Output: Support request saved on device

[1411] Step 2:

[1412] The server transfers the support request to the matchmaking advisor and manages the progress of the request.

[1413] Input: Support request from user

[1414] Output: Transfer request to matchmaking advisor

[1415] Step 3:

[1416] Based on the request, the matchmaking consultant will create advice and register it on the server. For example, they can provide specific advice such as, "In your self-introduction, it's a good idea to include your strengths and specific anecdotes."

[1417] Input: Support request details

[1418] Output: Created advice, registered details on the server

[1419] Step 4:

[1420] The server notifies the user of the advice and stores the contents in a database.

[1421] Input: Advice content

[1422] Output: Notify user, save advice to database

[1423] Post-marriage support

[1424] Step 1:

[1425] If the user gets married, they can request support for wedding preparations, ring selection, etc. For example, they can ask, "Please recommend a wedding venue."

[1426] Input: Post-marriage support request

[1427] Output: Support request saved on device

[1428] Step 2:

[1429] The device sends the request to the server in JSON format using HTTPS to ensure secure communication.

[1430] Input: Support request details, click the send button

[1431] Output: Support request sent to the server

[1432] Step 3:

[1433] The server forwards the request to a suitable specialist and manages the progress.

[1434] Input: Support request details

[1435] Output: Request for transfer to specialist company, progress management

[1436] Step 4:

[1437] The specialists report the status of service provision to the server, and the server notifies the user of the latest information based on the content of the reports.

[1438] Input: Service availability from specialist vendors

[1439] Output: Notify user of latest information

[1440] Detailed personal analysis

[1441] Step 1:

[1442] Users input detailed personal data such as "interests and preferences," "frequency of contact," and "money sense," and link it to external related services. For example, it provides information such as "I like watching movies and go to the cinema once a week."

[1443] Input: Detailed information such as hobbies, preferences, frequency of contact, and financial sense

[1444] Output: Details saved on the device

[1445] Step 2:

[1446] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[1447] Input: Detailed information, press the submit button

[1448] Output: Details sent to the server, data retrieved from related services

[1449] Step 3:

[1450] The server generates a personal profile based on the collected data and applies it to the matching algorithm, which uses a generative AI model to analyze the data and achieve high-precision matching.

[1451] Input: Collected detailed data, generative AI model

[1452] Output: Generated personal profile, fed into the matching algorithm

[1453] The system efficiently and accurately collects basic and detailed user information and utilizes generative AI models to provide optimal matching and high-quality support.

[1454] (Application example 1)

[1455] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1456] In recent years, there has been a demand for virtual stores to efficiently analyze users' purchasing behavior and provide optimal products and services. However, conventional systems have had difficulty in analyzing users' individual preferences and purchasing behavior in detail and making personalized recommendations. In addition, user support and advice are not provided in real time, which has led to low satisfaction.

[1457] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1458] In this invention, the server includes: a means for a user to input initial data and transmit it from the terminal; a means for the server to save the user's initial data in a database; a means for a user to film a self-introduction video and upload it from the terminal; a means for the server to analyze the uploaded video using AI technology and generate a matching profile; a means for a user to input detailed career information and transmit it from the terminal; a means for the server to review the received career information and store it in a database as reliable information; a means for a user to submit a support request; a means for the server to notify an expert of the request and notify the user of advice; a means for a user to request specific support; a means for the server to forward the request to the expert and notify the user of progress; a means for a user to input detailed personal data and link with related services; a means for the server to analyze a personal profile based on collected data and reflect it in a matching algorithm; a means for a user to input purchasing behavior data and transmit it from the terminal; and a means for the server to analyze the received purchasing behavior data and generate individual recommendations using a recommendation algorithm. This enables detailed analysis of users' individual preferences and purchasing behavior and makes personalized recommendations in real time.

[1459] "User" refers to an individual who uses the system to receive services.

[1460] "Initial data" refers to basic information that a user first enters when using the system.

[1461] "Terminal" refers to a digital device used by a user, such as a computer, smartphone, or tablet.

[1462] "Server" refers to the central computer that processes and stores data and manages the entire system.

[1463] A "database" is a storage area within a system for organizing and storing information obtained from users.

[1464] A "self-introduction video" is video content that a user has filmed to introduce basic information about themselves and their hobbies and preferences.

[1465] "Uploading" refers to the act of a user sending digital data from a terminal to a server.

[1466] "AI technology" refers to the use of artificial intelligence techniques, including machine learning and data analysis, to analyze data and make inferences and predictions.

[1467] A "matching profile" is a user profile created based on the user's attributes and personality information analyzed using AI technology.

[1468] "Career information" is detailed user information such as educational background, work history, hobbies, and preferences.

[1469] "Verification" is the process by which the server verifies the reliability and accuracy of the data it receives.

[1470] A "support request" is an action by a user to communicate through the system that they require support.

[1471] An "expert" is a person with the expertise to respond to a support request submitted by a user.

[1472] "Professional" refers to a company or organization that provides a specific service or product.

[1473] "Integration" refers to the sharing of data and functions between different systems.

[1474] A "matching algorithm" is an algorithm that calculates and provides the best match based on a user's profile and data.

[1475] "Purchasing behavior data" is information about products and services purchased by a user in the past.

[1476] A "recommendation algorithm" is an algorithm that suggests optimal products and services based on a user's preferences and behavioral history.

[1477] This invention relates to a personalized recommendation system for a virtual store used by a user. This system includes functions for a user to input initial data and send it from a terminal, a server to save the user's initial data in a database, a user to film a self-introduction video and upload it from a terminal, a server to analyze the uploaded video using AI technology and generate a matching profile, a user to input detailed career information and send it from a terminal, a server to review the received career information and save it in a database as reliable information, a user to submit a support request, a server to notify an expert of the request and notify the user of advice, a user to request specific support, a server to forward the request to an expert and notify the user of progress, a user to input detailed personal data and link with related services, a server to analyze the personal profile based on the collected data and reflect it in a matching algorithm, a user to input purchasing behavior data and send it from a terminal, and a server to analyze the received purchasing behavior data and generate individual recommendations using a recommendation algorithm.

[1478] Hardware and software used

[1479] The system is implemented using the following hardware and software:

[1480] User devices: computers, smartphones, tablets, etc.

[1481] Server: A central computer for data processing and storage, a cloud service (e.g. AWS, Google Cloud).

[1482] Database: A system for storing user information and analytical data (e.g., MySQL, MongoDB).

[1483] AI technologies: Machine learning frameworks (e.g., TensorFlow, PyTorch) for data analysis, video analysis, and recommendation algorithms.

[1484] Data processing and calculation

[1485] The server processes and calculates the data in the following steps:

[1486] 1. Initial data sent from the user's device is stored in the database, including name, gender, age, occupation, location, etc.

[1487] 2. When a user uploads a self-introduction video, the server uses AI technology to analyze the video and generate a matching profile based on the user's speaking style and personality.

[1488] 3. The user enters detailed background information, and the server examines the data sent from the device and stores it in a database as reliable information. If any fraudulent data or violations are detected, the server notifies the user.

[1489] 4. When a user submits a support request, the server notifies an expert of the request and provides advice to the user. For example, a request might be "I want to choose a new outdoor jacket."

[1490] 5. When a user requests specific support, the server forwards the request to a specialist and notifies the user of the status of the service. Specific support may include wedding preparations, etc.

[1491] 6. Once the user enters detailed personal data, the server will connect with related services to perform a detailed analysis of the personal profile and reflect this in the next matching algorithm.

[1492] 7. The user inputs purchasing behavior data, the server analyzes the data sent from the device, and generates personalized recommendations using a recommendation algorithm.

[1493] Specific examples (prompt sentence examples)

[1494] 1. "I'm looking for a new tent for camping. Which one do you recommend?"

[1495] 2. "What are the best snacks for a weekend movie night?"

[1496] 3. "Please suggest a fashion outfit for going to a jazz concert."

[1497] In this way, the system according to the present invention can provide personalized recommendations and real-time advice based on detailed analysis of users' individual preferences and purchasing behavior, thereby improving the user experience in the virtual store.

[1498] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1499] Step 1:

[1500] The user enters initial data (such as name, gender, age, occupation, and location) and sends it from the terminal. The entered data is sent from the terminal to the server. The server saves this initial data in a database. In this process, the server checks the data format and stores the initial data in the database as structured data.

[1501] Step 2:

[1502] The user films a self-introduction video and uploads it from their device. The device then sends the video data to the server. The server then analyzes the received video using AI technology (e.g., TensorFlow) to determine the user's speaking style and personality. Based on the analysis results, the server generates a matching profile and stores it in a database.

[1503] Step 3:

[1504] The user enters detailed career information (educational background, work history, hobbies, preferences, etc.) and submits it from the device. The device then sends the career information to the server. The server reviews the received career information and stores it in a database as reliable information. The review includes validating the input data and checking supporting documents as necessary. If any fraud or violation is detected, the server notifies the user.

[1505] Step 4:

[1506] A user submits a support request. For example, a user might request, "I want to choose a new outdoor jacket." The device then sends the request to the server. The server then notifies an expert of the request, who then provides advice. The advice is then sent to the user via the server. This allows the user to receive personalized advice from the expert.

[1507] Step 5:

[1508] The user requests specific support (e.g., wedding preparations). The device sends the request to the server. The server forwards the request to a specialist, who reports the status of the service provided to the server. The server notifies the user of the progress. This process allows the user to receive specialized support.

[1509] Step 6:

[1510] The user enters detailed personal data (hobbies, preferences, frequency of contact, financial sense, etc.) and sends it from their device. The device then sends the data to the server. The server then performs a detailed analysis of the personal profile based on the data and connects with related services. The profile results are reflected in the next matching algorithm, making it possible to provide personalized services to the user.

[1511] Step 7:

[1512] The user enters purchasing behavior data (past purchase history and browsing history) and sends it from the device. The device then sends the data to the server. The server analyzes the received purchasing behavior data and generates individual recommendations using a generative AI model. The recommendation results are notified to the user, allowing them to receive personalized product and service suggestions.

[1513] In each step, a personalized recommendation system in the virtual store is realized through specific actions taken by the server, the terminal, and the user.

[1514] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1515] The system of this invention utilizes AI technology and an emotion engine to provide a low-cost, high-quality marriage consultation service. It includes the main elements of the user, terminal, and server, each of which performs the following specific operations.

[1516] User registration and initial data entry

[1517] 1. Users

[1518] When starting the service, a user registers an account to enter basic information such as name, gender, age, occupation, location, etc. For example, a user enters basic information such as the name "Yamada Taro," gender, and age.

[1519] 2. Terminal

[1520] The terminal displays the initial data entered by the user on the screen, asks for confirmation, and then sends the data to the server by pressing a send button.

[1521] 3. Server

[1522] The server stores the received initial data in a database and creates an account for the user.

[1523] Video Review Process

[1524] 1. Users

[1525] Users can record a self-introduction video on their device and upload it to the system. For example, they can introduce themselves by saying, "My hobbies are reading and traveling."

[1526] 2. Terminal

[1527] The device sends the captured video file to the server.

[1528] 3. Server

[1529] The server analyzes the uploaded video file using AI technology to determine the user's speaking style, personality, and emotions. The emotion engine analyzes the user's facial expressions and tone of voice to obtain emotional data.

[1530] The server generates a matching profile based on the analysis results and stores it in a database.

[1531] Background Check Process

[1532] 1. Users

[1533] Users enter detailed career information such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. For example, a user may provide information such as "I graduated from the University of Tokyo and am currently working for an IT company."

[1534] 2. Terminal

[1535] The terminal transmits the entered history information to the server.

[1536] 3. Server

[1537] The server reviews the received background information, stores it in a database as reliable information, checks for fraud or violations, and notifies the user if there is anything suspicious.

[1538] Providing manned support

[1539] 1. Users

[1540] Users request support such as profile improvement or dating advice. For example, "How can I make my profile more appealing?"

[1541] 2. Server

[1542] The server forwards the support request to a matchmaking advisor.

[1543] 3. Marriage Advisor

[1544] The marriage advisor provides specific advice to the user and registers the details on the server.

[1545] 4. Server

[1546] The server notifies the user of the advice and stores it in a database. The emotion engine analyzes the user's emotions in real time and provides the results to the advisor.

[1547] Post-marriage support

[1548] 1. Users

[1549] After getting married, users can request support for wedding preparations, ring selection, etc. For example, they can ask for recommendations for wedding venues.

[1550] 2. Terminal

[1551] The terminal transmits a request for support after marriage to the server.

[1552] 3. Server

[1553] The server transfers the request to the specialist and manages the progress.

[1554] 4. Specialist

[1555] The specialists report the status of service provision to the server, and the server notifies the user of the details.

[1556] Detailed personal analysis

[1557] 1. Users

[1558] Users input detailed personal data such as their hobbies, preferences, frequency of contact, and financial sense, and then approve the connection to related services. For example, they provide detailed information such as "I like watching movies and go to the cinema once a week."

[1559] 2. Terminal

[1560] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[1561] 3. Server

[1562] The server performs a detailed analysis of the user's personal profile based on the collected data and reflects the results of the analysis in the next matching algorithm.

[1563] The emotion engine simultaneously analyzes the user's emotional data and incorporates it into a personal profile.

[1564] In this way, the system of the present invention utilizes AI technology and an emotion engine to provide users with optimal matches and high-quality support, allowing them to effectively pursue their matchmaking at low cost.

[1565] The processing flow will be explained below.

[1566] Step 1:

[1567] Users access an account registration form and enter initial data such as name, gender, age, occupation, and location.

[1568] Step 2:

[1569] The terminal displays the initial data entered by the user on a confirmation screen, and when the user presses the send button, the data is sent to the server.

[1570] Step 3:

[1571] The server stores the received initial data in a database.

[1572] Step 4:

[1573] Users film a self-introduction video on their device and upload it to the system, introducing themselves, for example, "My hobbies are reading and traveling."

[1574] Step 5:

[1575] The terminal transmits the captured video file to the server.

[1576] Step 6:

[1577] The server analyzes the received video file using AI technology to determine the user's speaking style and personality, and then uses an emotion engine to analyze the user's facial expressions and tone of voice to obtain emotional data.

[1578] Step 7:

[1579] The server generates a matching profile based on the analysis results and emotional data and stores it in a database.

[1580] Step 8:

[1581] Users enter detailed career information such as their educational background, work history, hobbies, and preferences into the terminal, providing information such as "graduated from the University of Tokyo and currently works for an IT company."

[1582] Step 9:

[1583] The terminal sends the entered biographical information and certificate documents to the server.

[1584] Step 10:

[1585] The server reviews the received background information, stores it in a database as reliable information, and notifies the user if there is anything suspicious.

[1586] Step 11:

[1587] Users submit support requests, such as profile improvements and dating advice, right from their devices. For example, they might ask, "How can I make my profile more appealing?"

[1588] Step 12:

[1589] The server forwards the support request to a matchmaking advisor.

[1590] Step 13:

[1591] The marriage advisor provides specific advice to the user and registers the details on the server.

[1592] Step 14:

[1593] The server notifies the user of the advice and stores it in a database. The emotion engine analyzes the user's emotional changes and provides them to the advisor.

[1594] Step 15:

[1595] After getting married, users can request support for wedding preparations, ring selection, etc. For example, they can ask for recommendations for wedding venues.

[1596] Step 16:

[1597] The terminal transmits a request for support after marriage to the server.

[1598] Step 17:

[1599] The server transfers the request to the specialist and manages the progress.

[1600] Step 18:

[1601] The specialists report the status of service provision to the server, and the server notifies the user of the details.

[1602] Step 19:

[1603] Users input detailed personal data such as their hobbies, preferences, frequency of contact, and financial sense on their devices, and then approve the connection to related services. For example, they may provide detailed information such as "I like watching movies and go to the cinema once a week."

[1604] Step 20:

[1605] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[1606] Step 21:

[1607] The server performs a detailed analysis of the user's personal profile based on the collected data and emotional data, and reflects the results in the next matching algorithm.

[1608] Step 22:

[1609] The server uses an improved matching algorithm to present the best possible matches to the user.

[1610] Example 2

[1611] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1612] Conventional marriage consultation services have had problems such as the time and cost required for the user information gathering and matching process, as well as the difficulty of finding the perfect partner for the user. Furthermore, matching based on simple information input does not take into account the user's personality or emotions, making effective matching difficult.

[1613] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1614] In this invention, the server includes: means for a user to input initial data and send it from the terminal; means for the server to save the user's initial data in a database; means for a user to film a self-introduction video and upload it from the terminal; means for the server to analyze the uploaded video using AI technology and generate a matching profile; means for a user to input detailed career information and send it from the terminal; means for the server to review the received career information and save it in a database as highly reliable information; means for a user to submit a support request; means for the server to notify a matchmaking advisor of the request and notify the user of advice; means for a user to request post-marriage support; means for the server to forward the request to a specialist and notify the user of progress; means for a user to input detailed personal data and link with related services; means for the server to analyze a personal profile based on the collected data and reflect the results in a matching algorithm; means for the server to use an emotion engine to analyze the user's emotional data in real time; means for the server to provide the user's emotional data to the matchmaking advisor; and means for the server to review suspicious career information and notify the user. This will enable high-quality matching and support that takes into account the user's personality and emotions.

[1615] "Initial data" refers to basic information that is initially entered when using the service, such as the user's name, gender, age, occupation, and location.

[1616] "Terminal" refers to an electronic device that a user uses to input information and transmit data to a server.

[1617] "Server" refers to a central computer system for receiving, processing, and storing data submitted by users.

[1618] "Database" refers to a digital information storage system in which a server organizes and permanently stores information.

[1619] "Self-introduction video" refers to a video file that a user shoots to introduce themselves and uploads to the system.

[1620] "AI technology" refers to technology that uses artificial intelligence to analyze data and perform specific tasks.

[1621] "Matching profile" refers to profile data generated based on information such as a user's personality, preferences, and emotions analyzed using AI technology.

[1622] "Career information" refers to detailed personal information entered by the user, such as educational background, work history, hobbies, and preferences.

[1623] A "marriage advisor" refers to an expert who provides users with advice and support regarding marriage hunting.

[1624] "Specialist providers" refer to those who handle post-wedding support requests and provide services such as wedding planning and ring selection.

[1625] An "emotion engine" refers to an analysis system that analyzes a user's facial expressions, tone of voice, etc. to obtain emotional data.

[1626] "Suspicious background information" refers to background information provided by a user that is unreliable or may be false.

[1627] The system of the present invention includes the main elements of a user, a terminal, and a server, and utilizes AI technology and an emotion engine to provide marriage consultation services at low cost and with high quality.

[1628] When starting the service, the user uses a terminal to enter basic initial data such as name, gender, age, occupation, and location. The data entered by the user is sent to the server by the terminal. The server stores the received initial data in a database and creates an account for the user.

[1629] Next, the user films a self-introduction video on their device and uploads it to the system. For example, they might introduce themselves by saying, "My hobbies are reading and traveling." This video file is also sent to the server via the device. The server uses a generative AI model to analyze the uploaded video and determine the user's speaking style, personality, and emotions. An emotion engine analyzes the user's facial expressions and tone of voice to obtain emotional data. Based on the analysis results, the server generates a matching profile and stores it in a database.

[1630] Users also enter detailed career information such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. For example, they may provide information such as "graduated from the University of Tokyo and currently works for an IT company." The device then sends this information to the server, which then reviews the received career information and stores it in a database as reliable information. At this time, the server checks for any fraud or violations, and notifies the user if anything suspicious is found.

[1631] Additionally, users can request support such as profile improvement and dating advice. For example, they can request, "How can I make my self-introduction more appealing?" The server forwards this request to a matchmaking advisor. The matchmaking advisor provides specific advice to the user and registers it on the server. The server notifies the user of the advice and stores it in a database. The emotion engine also analyzes the user's emotions in real time and provides the results to the advisor.

[1632] After getting married, the user can request support for wedding preparations, ring selection, etc. For example, they can ask for "recommended wedding venues." The device sends this support request to the server, which then forwards the request to a specialist and manages the progress. The specialist reports the status of the service provided to the server, and the server notifies the user of the details.

[1633] For detailed personal analysis, the user enters detailed personal data such as hobbies, preferences, frequency of contact, and financial sense, and approves data sharing with other related services. For example, a user may provide information such as "I like watching movies and go to the cinema once a week." The device then sends this data to the server, which retrieves the necessary data from related services. The server then performs a detailed analysis of the user's personal profile based on the retrieved data and reflects the results in the next matching algorithm. In parallel, the emotion engine analyzes the user's emotional data and incorporates it into the personal profile.

[1634] Examples of specific prompt sentences include, "Please explain in detail the user registration procedure for the matchmaking system" and "Please tell me in detail the flow of the video review process for the matchmaking system."

[1635] In this way, this system, which utilizes AI technology, enables users to effectively pursue their matchmaking at low cost, and receives high-quality support and matching.

[1636] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1637] Step 1:

[1638] The user enters the initial data and sends it from the terminal.

[1639] The user enters basic initial data such as name, gender, age, occupation, and location into the terminal. This data includes information such as "Yamada Taro, male, 30 years old, engineer, living in Tokyo." The terminal then sends the entered data to the server. The server stores the received data in a database and creates an account for the user.

[1640] Input: Basic data such as name, gender, age, occupation, location, etc.

[1641] Output: User accounts stored in the database

[1642] Step 2:

[1643] Users record their own self-introduction videos and upload them from their devices.

[1644] The user records a video of themselves introducing themselves on their device. For example, they might say, "My hobbies are reading and traveling." The recorded video file is saved on the device and uploaded to the system. The device then sends this video file to the server. The server receives the video file and analyzes it using AI technology and an emotion engine.

[1645] Input: Self-introduction video file

[1646] Output: Analyzed video data (speaking style, personality, emotion assessment results)

[1647] Step 3:

[1648] The server analyzes the video and generates a matching profile

[1649] The server analyzes the received video file using AI technology and an emotion engine. This analysis determines the user's speaking style, personality, and emotions. For example, the AI ​​may determine that the user is cheerful and sociable. Based on this, the server generates a matching profile and stores it in a database.

[1650] Input: Analyzed video data

[1651] Output: The generated matching profile

[1652] Step 4:

[1653] The user enters detailed biographical information and submits it from the device

[1654] Users enter detailed career information such as their educational background, work history, hobbies, and preferences, and upload supporting documents such as "graduated from the University of Tokyo and currently works for an IT company." The device then sends the career information and supporting documents to the server, which receives and reviews this information and stores it in a database as reliable information.

[1655] Input: detailed career information, supporting documents

[1656] Output: reliable biographical information stored in a database

[1657] Step 5:

[1658] The server reviews the background information and notifies the user if there is anything suspicious.

[1659] The server reviews the user's background information to check for any irregularities or violations. If anything suspicious is found, the server notifies the user and asks for additional information or reconfirmation.

[1660] Input: Detailed biographical information

[1661] Output: Save reliable information in a database or notify the user

[1662] Step 6:

[1663] A user submits a support request, which the server forwards to a matchmaking advisor.

[1664] A user requests support such as profile improvement or dating advice. Specifically, they ask, "How can I make my profile more appealing?" The server forwards this request to a matchmaking advisor.

[1665] Input: Support Request

[1666] Output: Transfer request to matchmaking advisor

[1667] Step 7:

[1668] A marriage advisor provides advice and registers it on the server.

[1669] The marriage advisor provides specific advice to the user and registers the advice on the server. For example, the advisor may provide advice such as, "It would be good if you wrote more specifically about your hobbies and interests."

[1670] Input: Support Request

[1671] Output: Advice provided

[1672] Step 8:

[1673] The server notifies the user of the advice and stores it in the database.

[1674] The server notifies the user of the advice received from the matchmaking advisor and stores it in a database. The emotion engine also analyzes the user's emotions in real time and provides the results to the advisor.

[1675] Input: Advice provided

[1676] Output: Notify user and save to database

[1677] Step 9:

[1678] The user requests post-marriage support and sends it from the device

[1679] The user requests support for wedding preparations, ring selection, etc. For example, they may ask, "Please recommend a wedding venue." The device sends this support request to the server.

[1680] Input: Post-marriage support request

[1681] Output: Request sent to server

[1682] Step 10:

[1683] The server forwards the request to the specialist and notifies the user of the progress

[1684] The server transfers the support request after the marriage to the specialist and manages the progress. The specialist reports the service provision status to the server, and the server notifies the user of the information.

[1685] Input: Post-marriage support request

[1686] Output: Forward to specialist and notify user

[1687] Step 11:

[1688] Users enter detailed personal data and connect with related services

[1689] Users input detailed personal data such as their hobbies, preferences, frequency of contact, and financial sense, providing information such as "I like watching movies and go to the cinema once a week." They also approve data sharing with other related services. The device then sends this data to the server and retrieves the necessary data from the related services.

[1690] Input: Detailed personal data

[1691] Output: Data retrieved from related services

[1692] Step 12:

[1693] The server analyzes personal profiles based on the data collected and reflects this in the matching algorithm.

[1694] The server analyzes the user's personal profile in detail based on the collected data and reflects the analysis results in the next matching algorithm. It also analyzes the user's emotional data using an emotion engine and incorporates it into the personal profile.

[1695] Input: Detailed personal data collected

[1696] Output: Personal profile reflected in the matching algorithm

[1697] (Application example 2)

[1698] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1699] Conventional marriage consultation services have faced the problem of high costs for providing high-quality matching and support. It is also difficult to analyze users' emotions and detailed career information in real time and provide optimal advice based on this information. Furthermore, there is a lack of a way for users to receive support efficiently and effectively using smart devices.

[1700] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a user to make a support request in real time using a smart device, a means for analyzing the user's emotional data in real time using AI technology and storing it in a database, and a means for providing appropriate advice using prompt sentences based on a generative AI model. This enables users to receive high-quality matchmaking support and post-marriage support at low cost.

[1701] A "user" is an individual who uses the marriage consultation service.

[1702] A "terminal" is a mobile device used by a user, such as a smartphone or smart glasses.

[1703] "Server" means the central computer system that stores and analyzes User data and manages the entire Service.

[1704] "Initial data" refers to basic personal information such as name, gender, age, and location that a user enters when registering.

[1705] A "database" is an information management system for systematically storing user information, analysis results, and the like.

[1706] A "self-introduction video" is a short video that a user films to introduce their hobbies, interests, and personality.

[1707] "AI technology" is a technology that uses artificial intelligence to perform data analysis and pattern recognition.

[1708] A "matching profile" is a data set used to recommend optimal partner candidates based on user information.

[1709] "Career information" is detailed personal information provided by a user, such as educational background, work history, hobbies, and preferences.

[1710] A "support request" is a request made by a user to a matchmaking advisor or specialist for support.

[1711] A "marriage advisor" is a specialist who provides advice and support to users in marriage consultation services.

[1712] "Specialist vendors" are professional vendors who provide wedding preparation and related services after the marriage.

[1713] A "personal profile" is a profile generated by analyzing a user's detailed personal information and emotional data.

[1714] A "smart device" is a device with advanced functionality that is connected to the Internet, such as a smartphone or smart glasses.

[1715] "Real-time analytics" refers to an analytical process that is performed immediately as data is generated.

[1716] A "generative AI model" is a generative artificial intelligence algorithm that is trained to perform a specific task.

[1717] A "prompt" is an instruction or question given to a generative AI model, which then generates an appropriate output.

[1718] This invention utilizes AI technology and an emotion engine to provide low-cost, high-quality marriage consultation services. In particular, a specific embodiment of the invention is described below in the context of building a virtual marriage consultation center using smart devices.

[1719] User registration and initial data entry

[1720] The user uses a smart device (e.g., smartphone or smart glasses) to enter basic information such as name, gender, age, and location. The device displays the entered data on the screen and, after confirmation, sends it to the server. The server stores the received initial data in a database and creates an account for the user.

[1721] Video Review Process

[1722] Users film a self-introduction video on their smart device and upload it to the server. The server then uses AI technology to analyze the uploaded video and obtain emotional data based on the user's speaking style, personality, facial expressions, tone of voice, etc. The analysis results are stored in a database and used as a matching profile.

[1723] Background Check Process

[1724] Users enter detailed career information, such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. The device then sends the input data to the server, which reviews the received information. Only highly reliable information is stored in the database and reflected in the next match.

[1725] Providing manned support

[1726] Users use their smart devices to request support such as improving their profile or dating advice. The server then forwards the request to a matchmaking advisor, who then provides specific advice to the user. The advice is registered on the server and notified to the user. The system also has a real-time emotion analysis function, which uses AI technology to analyze the user's emotional data and reflects it in the support content.

[1727] Post-marriage support

[1728] After getting married, users request support for wedding preparations and their new life. The request is sent to the server using a smart device. The server then forwards the request to a specialist and manages the progress. The status of the service provided by the specialist is notified to the user via the server.

[1729] Detailed personal analysis

[1730] Users input detailed personal data such as hobbies, preferences, frequency of contact, and financial sense, and approve connection to related services. The device then sends the input data to the server, which collects various data and generates a detailed personal profile. The generated profile is reflected in the next matching approach. The system also provides optimal advice using prompts based on the generative AI model.

[1731] Program processing overview

[1732] 1. Hardware and Software Use:

[1733] Smart devices (smartphones, smart glasses)

[1734] Server and Database Server: MySQL

[1735] AI technology and emotion analysis engine

[1736] Web framework: Flask

[1737] 2. Data processing and calculation:

[1738] Input and storage of initial data and biographical information

[1739] Upload a video file and obtain emotional data through AI analysis

[1740] Background checks and credibility checks

[1741] Real-time emotion analysis and AI-powered prompt generation

[1742] Support request management and routing to specialists

[1743] Specific examples

[1744] A user accesses a virtual matchmaking agency app and inputs a support request saying, "I want to make my self-introduction more appealing." AI technology and an emotion engine perform real-time analysis, and using a generative AI model, generate a prompt message saying, "To improve your self-introduction, it would be good to talk more specifically about your hobbies and interests," and notify the user of this message.

[1745] Example prompt sentence:

[1746] To improve your self-introduction, it's a good idea to talk specifically about your hobbies and interests.

[1747] In this way, the present invention can provide users with effective support for finding a partner and support after marriage at low cost.

[1748] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1749] Step 1:

[1750] The user uses a smart device to input initial data such as name, gender, age, and location. The device displays this input data on the screen and sends it to the server after the user confirms it. The server stores the received initial data in a database and creates an account for the user. The input data consists of basic personal information, and a new record is generated in the database based on this data.

[1751] Step 2:

[1752] Users use their smart devices to film a self-introduction video and upload it to a server. The server receives the uploaded video file and uses AI technology to process and analyze it. Through analysis, emotional data is generated based on the user's speaking style, personality, facial expressions, and tone of voice. This emotional data is stored in a database and is reflected in subsequent matching profiles.

[1753] Step 3:

[1754] Using a smart device, users enter detailed career information such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. The device then sends the input data and supporting documents to a server. The server then reviews the received data, confirms its authenticity, and stores it in a database. At this point, a data analysis algorithm checks for any irregularities or inconsistencies, and if there are no problems, the data is reflected in the matching algorithm.

[1755] Step 4:

[1756] Users use their smart devices to send support requests, such as profile improvements or dating advice. The server receives the request and notifies the matchmaking advisor. The matchmaking advisor provides specific advice for the support content and registers it on the server. The server notifies the registered advice to the user and also stores it in a database. During this process, the advice may also reflect the results of sentiment analysis.

[1757] Step 5:

[1758] After getting married, users request support for wedding preparations and their new life. They input the request using a smart device and send it from the terminal to a server. The server then forwards the request to a specialist and manages the progress. The status of the service provided by the specialist is notified to the user via the server. The input request details are tracked by a progress management system, and updates are sent to the server as needed and displayed to the user.

[1759] Step 6:

[1760] Users input detailed personal data such as hobbies, preferences, frequency of contact, and financial sense, and approve linkage with related services. The device sends this input data to the server, which then retrieves the necessary data from the related services. The server analyzes this data and generates a detailed personal profile of the user. The generated profile is reflected in the next matching algorithm, helping the user choose a partner based on their individual needs and preferences.

[1761] Step 7:

[1762] The server uses the generative AI model to generate prompts in response to support requests from users. For example, in response to a request such as "I want to make my self-introduction more appealing," the server sends specific advice such as "To improve your self-introduction, it would be good to talk specifically about your hobbies and interests." The generated prompts are notified to the user in real time, and are linked to the results of sentiment analysis to provide optimal advice.

[1763] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1764] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1765] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1766] [Fourth embodiment]

[1767] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1768] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1769] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1770] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1771] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1772] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1773] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1774] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1775] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1776] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1777] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1778] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1779] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1780] The system of the present invention is designed to achieve low-cost, high-quality matching in marriage consultation services. This system is composed of elements including users, terminals, and servers, and performs the following specific operations.

[1781] User registration and initial data entry

[1782] 1. Users

[1783] When starting the service, users register an account to enter basic information such as name, gender, age, occupation, location, etc. For example, a user enters information such as "Yamada Taro," a 30-year-old male engineer.

[1784] 2. Terminal

[1785] The terminal displays the data entered by the user on the screen, and when the user presses the send button, the data is sent to the server.

[1786] 3. Server

[1787] The server processes the received initial data and stores it in a database for each user, thereby registering the user's basic information in the system.

[1788] Video Review Process

[1789] 1. Users

[1790] A user can record a self-introduction video and upload it to the system. For example, the user can say in the self-introduction video, "My hobbies are reading and traveling."

[1791] 2. Terminal

[1792] The device sends the captured video to the server.

[1793] 3. Server

[1794] The server uses AI technology to analyze the uploaded video, analysing the user's speaking style and personality, and then generates a matching profile based on the analysis results, which is stored in a database.

[1795] Background Check Process

[1796] 1. Users

[1797] Users enter detailed information such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. For example, a user may provide information such as "I graduated from the University of Tokyo and am currently working for an IT company."

[1798] 2. Terminal

[1799] The terminal sends the entered information and certificate documents to the server.

[1800] 3. Server

[1801] The server reviews the received background information, stores it in a database as reliable information, and notifies the user if any fraud or violation is detected.

[1802] Providing manned support

[1803] 1. Users

[1804] Users request support such as profile improvement or dating advice. For example, "How can I make my profile more appealing?"

[1805] 2. Server

[1806] Transfer support requests to matchmaking advisors and manage their progress.

[1807] 3. Marriage Advisor

[1808] The marriage advisor provides advice based on the user's request and registers the content on the server.

[1809] 4. Server

[1810] The server notifies the user of the advice and stores it in a database.

[1811] Post-marriage support

[1812] 1. Users

[1813] If the marriage is successful, you can request support with wedding preparations, ring selection, etc. For example, you can ask for recommendations on wedding venues.

[1814] 2. Terminal

[1815] Sends the request to the server.

[1816] 3. Server

[1817] The server forwards the request to a suitable specialist and manages the progress.

[1818] 4. Specialist

[1819] The specialists report the status of service provision to the server, and based on the report, notify the user of the latest information.

[1820] Detailed personal analysis

[1821] 1. Users

[1822] Detailed personal data such as hobbies, preferences, frequency of contact, and financial sense is entered and linked to related services. For example, detailed information such as "I like watching movies and go to the cinema once a week" is provided.

[1823] 2. Terminal

[1824] The input data is sent to the server, and necessary data is obtained from the related services.

[1825] 3. Server

[1826] Based on the collected data, personal profiles are analyzed in detail and the results are reflected in the next matching algorithm.

[1827] In this way, the "Marriage AI" system aggregates basic and detailed information about users and uses AI technology to provide optimal matches and high-quality support, allowing users to effectively find a partner at low cost.

[1828] The processing flow will be explained below.

[1829] Step 1:

[1830] Users access an account registration form and enter initial data such as name, gender, age, occupation, and location.

[1831] Step 2:

[1832] The terminal displays the initial data entered by the user on the screen, and after confirmation, the data is sent to the server by pressing the send button.

[1833] Step 3:

[1834] The server analyzes the received initial data and stores the user's account in a database.

[1835] Step 4:

[1836] The user shoots a self-introduction video on the terminal and uploads the video including the self-introduction content to the system.

[1837] Step 5:

[1838] The terminal transmits the captured video file to the server.

[1839] Step 6:

[1840] The server analyzes the received video file using AI technology to determine the user's speaking style and personality.

[1841] Step 7:

[1842] The server generates a matching profile based on the analysis results and stores it in a database.

[1843] Step 8:

[1844] The user inputs detailed career information such as educational background, work history, hobbies, and preferences from the terminal.

[1845] Step 9:

[1846] The terminal transmits the entered history information to the server.

[1847] Step 10:

[1848] The server reviews the received background information, stores it in a database as reliable information, and notifies the user if there is anything suspicious.

[1849] Step 11:

[1850] Users can submit support requests from their devices, asking for things like profile improvement or dating advice.

[1851] Step 12:

[1852] The server transfers the support request to the matchmaking advisor and manages the progress of the request.

[1853] Step 13:

[1854] The marriage advisor provides specific advice to the user and registers the details on the server.

[1855] Step 14:

[1856] The server notifies the user of the advice and stores it in a database.

[1857] Step 15:

[1858] After getting married, users can request support with wedding preparations and ring selection.

[1859] Step 16:

[1860] The terminal transmits a request for support after marriage to the server.

[1861] Step 17:

[1862] The server transfers the request to the specialist and manages the progress.

[1863] Step 18:

[1864] The specialists report the status of service provision to the server, and the server notifies the user of the details.

[1865] Step 19:

[1866] Users enter detailed personal data such as hobbies, preferences, frequency of contact, and financial sense on their devices and approve integration with related services.

[1867] Step 20:

[1868] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[1869] Step 21:

[1870] The server performs a detailed analysis of the user's personal profile based on the collected data and reflects the results of the analysis in the next matching algorithm.

[1871] Step 22:

[1872] The server uses an improved matching algorithm to present the best possible matches to the user.

[1873] Example 1

[1874] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1875] A major challenge facing modern marriage consultation services is the high cost and effort required to achieve efficient, high-quality matching. There is a particular need for a system that can provide users with a self-introduction video, detailed analysis of personal information, reliable information, and even post-marriage support. However, existing systems struggle to provide these services effectively and at low cost. Furthermore, there is a lack of appropriate advice and support for users, making it necessary to improve the user experience.

[1876] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1877] In this invention, the server includes a means for storing the user's initial data in a database, a means for analyzing the self-introduction video using prompt sentences in a generative AI model to generate a matching profile, and a means for analyzing the personal profile based on the collected data and reflecting this in the matching algorithm. This enables efficient registration of initial data, reliable profile generation, detailed personal data analysis, and optimal matching based on that data, all at low cost and effectively. It is also possible to provide users with appropriate advice and post-match support, which is expected to improve the overall user experience.

[1878] "Initial data" refers to basic information such as the user's name, gender, age, occupation, and location.

[1879] A "terminal" is a device used by a user to input data and send it to a server, and includes smartphones, personal computers, etc.

[1880] "Server" refers to a computer system that receives, processes, and stores data submitted by users.

[1881] A "database" is a system that allows a server to systematically store user information.

[1882] A "self-introduction video" is a video in which a user introduces themselves.

[1883] A "generative AI model" refers to an algorithm or system that uses artificial intelligence techniques to analyze data and extract meaning and patterns.

[1884] A "prompt" is text containing instructions or questions to be given to a generative AI model.

[1885] A "matching profile" is profile information generated based on a user's characteristics and preferences to help them find the perfect partner candidate.

[1886] "Career information" refers to detailed information entered by the user, such as educational background, work history, hobbies, and preferences.

[1887] "Reliability" means that information or data is accurate and free from falsehoods or errors.

[1888] A "support request" is a request submitted by a user for profile improvement, dating advice, post-marriage assistance, etc.

[1889] A "marriage advisor" refers to an expert who provides consultation and advice to users in a marriage consultation service.

[1890] "Specialist companies" refer to companies that provide post-marriage support services such as wedding preparations and ring selection.

[1891] "Personal data" refers to detailed personal information such as a user's hobbies, preferences, frequency of contact, and financial sense.

[1892] "Related services" are external services that are used in conjunction with the user's detailed personal data.

[1893] A "matching algorithm" refers to a calculation method or rule for finding the best partner candidate based on user information.

[1894] The system of the present invention uses the elements of users, terminals, and servers to achieve low-cost, high-quality matching in a marriage consultation service. This system performs the following specific processes.

[1895] User registration and initial data entry

[1896] 1. Users

[1897] A user registers an account through an application or website by entering initial data such as name, gender, age, occupation, location, etc. For example, a user enters information as "Taro Yamada," a male, 30-year-old engineer.

[1898] 2. Terminal

[1899] The terminal displays the entered initial data on the screen and sends the data to the server by pressing the send button. The data is sent securely using the HTTPS protocol.

[1900] 3. Server

[1901] The server validates the received initial data and stores it in the database after confirming that there are no errors. This registers the user's basic information in the system.

[1902] Video Review Process

[1903] 1. Users

[1904] Users can use the camera on their smartphone or PC to shoot a self-introduction video and upload it to the system using the "Video Upload" function. For example, in the self-introduction video, they can say, "My hobbies are reading and traveling."

[1905] 2. Terminal

[1906] The device sends the captured video to the server using the HTTP POST method, with the video file sent in MP4 format or similar.

[1907] 3. Server

[1908] The server receives the video file and analyzes it using a generative AI model, with a prompt such as "Analyze the content spoken in this video and the speaker's personality." Based on the analysis results, a matching profile for the user is generated and stored in a database.

[1909] Background Check Process

[1910] 1. Users

[1911] Users enter detailed information such as their educational background, work history, hobbies, and preferences, and upload supporting documents in PDF or image file format if necessary. For example, they can provide information such as "I graduated from the University of Tokyo and am currently working for an IT company."

[1912] 2. Terminal

[1913] The device sends the entered information and credentials to the server. The information is serialized in JSON format, and files are sent as multipart form data.

[1914] 3. Server

[1915] The server verifies the received information and certificates, performs necessary checks and analyses, then stores the information in a database as reliable information and notifies the user if any fraud is detected.

[1916] Providing manned support

[1917] 1. Users

[1918] Users can request profile improvement or dating advice through the application's support function, such as "How can I make my profile more appealing?"

[1919] 2. Server

[1920] The server transfers the support request to the matchmaking advisor and manages the progress of the request.

[1921] 3. Marriage Advisor

[1922] Based on the request, the matchmaking advisor creates advice and registers it on the server. For example, they can provide specific advice such as, "In your self-introduction, it's a good idea to include your strengths and specific anecdotes."

[1923] 4. Server

[1924] The server notifies the user of the advice and stores the content in a database.

[1925] Post-marriage support

[1926] 1. Users

[1927] If the marriage is successful, you can request support with wedding preparations, ring selection, etc. For example, you can ask for recommendations on wedding venues.

[1928] 2. Terminal

[1929] The device sends the request to the server in JSON format using HTTPS to ensure secure communication.

[1930] 3. Server

[1931] The server forwards the request to a suitable specialist and manages the progress.

[1932] 4. Specialist

[1933] The specialists report the status of service provision to the server, and the server notifies the user of the latest information based on the content of the reports.

[1934] Detailed personal analysis

[1935] 1. Users

[1936] Users input detailed personal data such as their hobbies, preferences, contact frequency, and financial sense, and then link it to external related services. For example, users can provide information such as "I like watching movies and go to the cinema once a week."

[1937] 2. Terminal

[1938] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[1939] 3. Server

[1940] The server generates a personal profile based on the collected data and applies it to the matching algorithm, using a generative AI model to analyze the data and generate a profile that will enable highly accurate matching.

[1941] As a complete system, the present invention efficiently aggregates basic and detailed user information and then uses generative AI models to provide optimal matching and high-quality support. Specific examples of prompts include:

[1942] "Please use AI to analyze the self-introduction videos of users in a marriage consultation service and generate optimal matching profiles."

[1943] "We review the authenticity of the biographical information provided by users to ensure there is no fraud."

[1944] This allows users to enjoy effective and reliable matchmaking services at low cost.

[1945] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1946] User registration and initial data entry

[1947] Step 1:

[1948] A user enters initial data such as "name," "gender," "age," "occupation," and "location" through an application or website. For example, a user enters information such as "Yamada Taro," a male, 30-year-old engineer.

[1949] Input: Basic information entered by the user (name, gender, age, occupation, location)

[1950] Output: User profile initial data

[1951] Step 2:

[1952] The terminal displays the entered initial data on the screen for the user to confirm. When the user presses the "Send" button, the terminal sends the data to the server using the HTTPS protocol.

[1953] Input: Basic information entered by the user, and pressing the submit button

[1954] Output: Basic information sent to the server

[1955] Step 3:

[1956] The initial data received by the server is validated to ensure there are no errors in the content and then saved to the database. For example, it checks whether the age is an integer or whether the email address is in the correct format.

[1957] Input: User basic information sent to the server

[1958] Output: User profile information stored in a database

[1959] Video Review Process

[1960] Step 1:

[1961] The user shoots a self-introduction video using the camera on their smartphone or PC. After filming, the video is uploaded to the system using the application's "Video Upload" function. For example, a user may film a video saying, "My hobbies are reading and traveling."

[1962] Input: Self-introduction video

[1963] Output: Video file saved on device

[1964] Step 2:

[1965] The device temporarily saves the uploaded video, and when the user presses the "Send" button, the video file is sent to the server. The HTTP POST method is used to send the video file in MP4 format.

[1966] Input: Video file, press send button

[1967] Output: Video file sent to the server

[1968] Step 3:

[1969] The server receives the video file and creates a prompt for the generative AI model, such as "Analyze the content of what is being said in this video and the speaker's personality."The server then generates a matching profile for the user based on the analysis results obtained from the generative AI model and stores it in a database.

[1970] Input: Video file sent to the server

[1971] Output: Generated matching profile, analysis results stored in database

[1972] Background Check Process

[1973] Step 1:

[1974] Users enter detailed information such as their educational background, work history, hobbies, and preferences into the application's input form, and upload supporting documents in PDF or image format if necessary. For example, they can provide information such as "graduated from the University of Tokyo and currently works for an IT company."

[1975] Input: Detailed information such as educational background, work history, hobbies and interests, and supporting documents

[1976] Output: Details and supporting documents stored on your device

[1977] Step 2:

[1978] The device sends the entered details and supporting documents to the server, where the information is serialized in JSON format and the files are sent as multipart form data.

[1979] Input: Detailed information, supporting documents, click submit button

[1980] Output: Details and proof sent to the server

[1981] Step 3:

[1982] The server verifies the details and certificates received, performs necessary checks and analyses, stores the information in a database as reliable information, and notifies the user if any irregularities are detected.

[1983] Input: Details and supporting documents sent to the server

[1984] Output: reliable information stored in a database, notification to the user

[1985] Providing manned support

[1986] Step 1:

[1987] A user requests profile improvement or dating advice from the application's support function, for example, "How can I make my profile more appealing?"

[1988] Input: Support request details

[1989] Output: Support request saved on device

[1990] Step 2:

[1991] The server transfers the support request to the matchmaking advisor and manages the progress of the request.

[1992] Input: Support request from user

[1993] Output: Transfer request to matchmaking advisor

[1994] Step 3:

[1995] Based on the request, the matchmaking consultant will create advice and register it on the server. For example, they can provide specific advice such as, "In your self-introduction, it's a good idea to include your strengths and specific anecdotes."

[1996] Input: Support request details

[1997] Output: Created advice, registered details on the server

[1998] Step 4:

[1999] The server notifies the user of the advice and stores the contents in a database.

[2000] Input: Advice content

[2001] Output: Notify user, save advice to database

[2002] Post-marriage support

[2003] Step 1:

[2004] If the user gets married, they can request support for wedding preparations, ring selection, etc. For example, they can ask, "Please recommend a wedding venue."

[2005] Input: Post-marriage support request

[2006] Output: Support request saved on device

[2007] Step 2:

[2008] The device sends the request to the server in JSON format using HTTPS to ensure secure communication.

[2009] Input: Support request details, click the send button

[2010] Output: Support request sent to the server

[2011] Step 3:

[2012] The server forwards the request to a suitable specialist and manages the progress.

[2013] Input: Support request details

[2014] Output: Request for transfer to specialist company, progress management

[2015] Step 4:

[2016] The specialists report the status of service provision to the server, and the server notifies the user of the latest information based on the content of the reports.

[2017] Input: Service availability from specialist vendors

[2018] Output: Notify user of latest information

[2019] Detailed personal analysis

[2020] Step 1:

[2021] Users input detailed personal data such as "interests and preferences," "frequency of contact," and "money sense," and link it to external related services. For example, it provides information such as "I like watching movies and go to the cinema once a week."

[2022] Input: Detailed information such as hobbies, preferences, frequency of contact, and financial sense

[2023] Output: Details saved on the device

[2024] Step 2:

[2025] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[2026] Input: Detailed information, press the submit button

[2027] Output: Details sent to the server, data retrieved from related services

[2028] Step 3:

[2029] The server generates a personal profile based on the collected data and applies it to the matching algorithm, which uses a generative AI model to analyze the data and achieve high-precision matching.

[2030] Input: Collected detailed data, generative AI model

[2031] Output: Generated personal profile, fed into the matching algorithm

[2032] The system efficiently and accurately collects basic and detailed user information and utilizes generative AI models to provide optimal matching and high-quality support.

[2033] (Application example 1)

[2034] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2035] In recent years, there has been a demand for virtual stores to efficiently analyze users' purchasing behavior and provide optimal products and services. However, conventional systems have had difficulty in analyzing users' individual preferences and purchasing behavior in detail and making personalized recommendations. In addition, user support and advice are not provided in real time, which has led to low satisfaction.

[2036] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2037] In this invention, the server includes: a means for a user to input initial data and transmit it from the terminal; a means for the server to save the user's initial data in a database; a means for a user to film a self-introduction video and upload it from the terminal; a means for the server to analyze the uploaded video using AI technology and generate a matching profile; a means for a user to input detailed career information and transmit it from the terminal; a means for the server to review the received career information and store it in a database as reliable information; a means for a user to submit a support request; a means for the server to notify an expert of the request and notify the user of advice; a means for a user to request specific support; a means for the server to forward the request to the expert and notify the user of progress; a means for a user to input detailed personal data and link with related services; a means for the server to analyze a personal profile based on collected data and reflect it in a matching algorithm; a means for a user to input purchasing behavior data and transmit it from the terminal; and a means for the server to analyze the received purchasing behavior data and generate individual recommendations using a recommendation algorithm. This enables detailed analysis of users' individual preferences and purchasing behavior and makes personalized recommendations in real time.

[2038] "User" refers to an individual who uses the system to receive services.

[2039] "Initial data" refers to basic information that a user first enters when using the system.

[2040] "Terminal" refers to a digital device used by a user, such as a computer, smartphone, or tablet.

[2041] "Server" refers to the central computer that processes and stores data and manages the entire system.

[2042] A "database" is a storage area within a system for organizing and storing information obtained from users.

[2043] A "self-introduction video" is video content that a user has filmed to introduce basic information about themselves and their hobbies and preferences.

[2044] "Uploading" refers to the act of a user sending digital data from a terminal to a server.

[2045] "AI technology" refers to the use of artificial intelligence techniques, including machine learning and data analysis, to analyze data and make inferences and predictions.

[2046] A "matching profile" is a user profile created based on the user's attributes and personality information analyzed using AI technology.

[2047] "Career information" is detailed user information such as educational background, work history, hobbies, and preferences.

[2048] "Verification" is the process by which the server verifies the reliability and accuracy of the data it receives.

[2049] A "support request" is an action by a user to communicate through the system that they require support.

[2050] An "expert" is a person with the expertise to respond to a support request submitted by a user.

[2051] "Professional" refers to a company or organization that provides a specific service or product.

[2052] "Integration" refers to the sharing of data and functions between different systems.

[2053] A "matching algorithm" is an algorithm that calculates and provides the best match based on a user's profile and data.

[2054] "Purchasing behavior data" is information about products and services purchased by a user in the past.

[2055] A "recommendation algorithm" is an algorithm that suggests optimal products and services based on a user's preferences and behavioral history.

[2056] This invention relates to a personalized recommendation system for a virtual store used by a user. This system includes functions for a user to input initial data and send it from a terminal, a server to save the user's initial data in a database, a user to film a self-introduction video and upload it from a terminal, a server to analyze the uploaded video using AI technology and generate a matching profile, a user to input detailed career information and send it from a terminal, a server to review the received career information and save it in a database as reliable information, a user to submit a support request, a server to notify an expert of the request and notify the user of advice, a user to request specific support, a server to forward the request to an expert and notify the user of progress, a user to input detailed personal data and link with related services, a server to analyze the personal profile based on the collected data and reflect it in a matching algorithm, a user to input purchasing behavior data and send it from a terminal, and a server to analyze the received purchasing behavior data and generate individual recommendations using a recommendation algorithm.

[2057] Hardware and software used

[2058] The system is implemented using the following hardware and software:

[2059] User devices: computers, smartphones, tablets, etc.

[2060] Server: A central computer for data processing and storage, a cloud service (e.g. AWS, Google Cloud).

[2061] Database: A system for storing user information and analytical data (e.g., MySQL, MongoDB).

[2062] AI technologies: Machine learning frameworks (e.g., TensorFlow, PyTorch) for data analysis, video analysis, and recommendation algorithms.

[2063] Data processing and calculation

[2064] The server processes and calculates the data in the following steps:

[2065] 1. Initial data sent from the user's device is stored in the database, including name, gender, age, occupation, location, etc.

[2066] 2. When a user uploads a self-introduction video, the server uses AI technology to analyze the video and generate a matching profile based on the user's speaking style and personality.

[2067] 3. The user enters detailed background information, and the server examines the data sent from the device and stores it in a database as reliable information. If any fraudulent data or violations are detected, the server notifies the user.

[2068] 4. When a user submits a support request, the server notifies an expert of the request and provides advice to the user. For example, a request might be "I want to choose a new outdoor jacket."

[2069] 5. When a user requests specific support, the server forwards the request to a specialist and notifies the user of the status of the service. Specific support may include wedding preparations, etc.

[2070] 6. Once the user enters detailed personal data, the server will connect with related services to perform a detailed analysis of the personal profile and reflect this in the next matching algorithm.

[2071] 7. The user inputs purchasing behavior data, the server analyzes the data sent from the device, and generates personalized recommendations using a recommendation algorithm.

[2072] Specific examples (prompt sentence examples)

[2073] 1. "I'm looking for a new tent for camping. Which one do you recommend?"

[2074] 2. "What are the best snacks for a weekend movie night?"

[2075] 3. "Please suggest a fashion outfit for going to a jazz concert."

[2076] In this way, the system according to the present invention can provide personalized recommendations and real-time advice based on detailed analysis of users' individual preferences and purchasing behavior, thereby improving the user experience in the virtual store.

[2077] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2078] Step 1:

[2079] The user enters initial data (such as name, gender, age, occupation, and location) and sends it from the terminal. The entered data is sent from the terminal to the server. The server saves this initial data in a database. In this process, the server checks the data format and stores the initial data in the database as structured data.

[2080] Step 2:

[2081] The user films a self-introduction video and uploads it from their device. The device then sends the video data to the server. The server then analyzes the received video using AI technology (e.g., TensorFlow) to determine the user's speaking style and personality. Based on the analysis results, the server generates a matching profile and stores it in a database.

[2082] Step 3:

[2083] The user enters detailed career information (educational background, work history, hobbies, preferences, etc.) and submits it from the device. The device then sends the career information to the server. The server reviews the received career information and stores it in a database as reliable information. The review includes validating the input data and checking supporting documents as necessary. If any fraud or violation is detected, the server notifies the user.

[2084] Step 4:

[2085] A user submits a support request. For example, a user might request, "I want to choose a new outdoor jacket." The device then sends the request to the server. The server then notifies an expert of the request, who then provides advice. The advice is then sent to the user via the server. This allows the user to receive personalized advice from the expert.

[2086] Step 5:

[2087] The user requests specific support (e.g., wedding preparations). The device sends the request to the server. The server forwards the request to a specialist, who reports the status of the service provided to the server. The server notifies the user of the progress. This process allows the user to receive specialized support.

[2088] Step 6:

[2089] The user enters detailed personal data (hobbies, preferences, frequency of contact, financial sense, etc.) and sends it from their device. The device then sends the data to the server. The server then performs a detailed analysis of the personal profile based on the data and connects with related services. The profile results are reflected in the next matching algorithm, making it possible to provide personalized services to the user.

[2090] Step 7:

[2091] The user enters purchasing behavior data (past purchase history and browsing history) and sends it from the device. The device then sends the data to the server. The server analyzes the received purchasing behavior data and generates individual recommendations using a generative AI model. The recommendation results are notified to the user, allowing them to receive personalized product and service suggestions.

[2092] In each step, a personalized recommendation system in the virtual store is realized through specific actions taken by the server, the terminal, and the user.

[2093] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2094] The system of this invention utilizes AI technology and an emotion engine to provide a low-cost, high-quality marriage consultation service. It includes the main elements of the user, terminal, and server, each of which performs the following specific operations.

[2095] User registration and initial data entry

[2096] 1. Users

[2097] When starting the service, a user registers an account to enter basic information such as name, gender, age, occupation, location, etc. For example, a user enters basic information such as the name "Yamada Taro," gender, and age.

[2098] 2. Terminal

[2099] The terminal displays the initial data entered by the user on the screen, asks for confirmation, and then sends the data to the server by pressing a send button.

[2100] 3. Server

[2101] The server stores the received initial data in a database and creates an account for the user.

[2102] Video Review Process

[2103] 1. Users

[2104] Users can record a self-introduction video on their device and upload it to the system. For example, they can introduce themselves by saying, "My hobbies are reading and traveling."

[2105] 2. Terminal

[2106] The device sends the captured video file to the server.

[2107] 3. Server

[2108] The server analyzes the uploaded video file using AI technology to determine the user's speaking style, personality, and emotions. The emotion engine analyzes the user's facial expressions and tone of voice to obtain emotional data.

[2109] The server generates a matching profile based on the analysis results and stores it in a database.

[2110] Background Check Process

[2111] 1. Users

[2112] Users enter detailed career information such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. For example, a user may provide information such as "I graduated from the University of Tokyo and am currently working for an IT company."

[2113] 2. Terminal

[2114] The terminal transmits the entered history information to the server.

[2115] 3. Server

[2116] The server reviews the received background information, stores it in a database as reliable information, checks for fraud or violations, and notifies the user if there is anything suspicious.

[2117] Providing manned support

[2118] 1. Users

[2119] Users request support such as profile improvement or dating advice. For example, "How can I make my profile more appealing?"

[2120] 2. Server

[2121] The server forwards the support request to a matchmaking advisor.

[2122] 3. Marriage Advisor

[2123] The marriage advisor provides specific advice to the user and registers the details on the server.

[2124] 4. Server

[2125] The server notifies the user of the advice and stores it in a database. The emotion engine analyzes the user's emotions in real time and provides the results to the advisor.

[2126] Post-marriage support

[2127] 1. Users

[2128] After getting married, users can request support for wedding preparations, ring selection, etc. For example, they can ask for recommendations for wedding venues.

[2129] 2. Terminal

[2130] The terminal transmits a request for support after marriage to the server.

[2131] 3. Server

[2132] The server transfers the request to the specialist and manages the progress.

[2133] 4. Specialist

[2134] The specialists report the status of service provision to the server, and the server notifies the user of the details.

[2135] Detailed personal analysis

[2136] 1. Users

[2137] Users input detailed personal data such as their hobbies, preferences, frequency of contact, and financial sense, and then approve the connection to related services. For example, they provide detailed information such as "I like watching movies and go to the cinema once a week."

[2138] 2. Terminal

[2139] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[2140] 3. Server

[2141] The server performs a detailed analysis of the user's personal profile based on the collected data and reflects the results of the analysis in the next matching algorithm.

[2142] The emotion engine simultaneously analyzes the user's emotional data and incorporates it into a personal profile.

[2143] In this way, the system of the present invention utilizes AI technology and an emotion engine to provide users with optimal matches and high-quality support, allowing them to effectively pursue their matchmaking at low cost.

[2144] The processing flow will be explained below.

[2145] Step 1:

[2146] Users access an account registration form and enter initial data such as name, gender, age, occupation, and location.

[2147] Step 2:

[2148] The terminal displays the initial data entered by the user on a confirmation screen, and when the user presses the send button, the data is sent to the server.

[2149] Step 3:

[2150] The server stores the received initial data in a database.

[2151] Step 4:

[2152] Users film a self-introduction video on their device and upload it to the system, introducing themselves, for example, "My hobbies are reading and traveling."

[2153] Step 5:

[2154] The terminal transmits the captured video file to the server.

[2155] Step 6:

[2156] The server analyzes the received video file using AI technology to determine the user's speaking style and personality, and then uses an emotion engine to analyze the user's facial expressions and tone of voice to obtain emotional data.

[2157] Step 7:

[2158] The server generates a matching profile based on the analysis results and emotional data and stores it in a database.

[2159] Step 8:

[2160] Users enter detailed career information such as their educational background, work history, hobbies, and preferences into the terminal, providing information such as "graduated from the University of Tokyo and currently works for an IT company."

[2161] Step 9:

[2162] The terminal sends the entered biographical information and certificate documents to the server.

[2163] Step 10:

[2164] The server reviews the received background information, stores it in a database as reliable information, and notifies the user if there is anything suspicious.

[2165] Step 11:

[2166] Users submit support requests, such as profile improvements and dating advice, right from their devices. For example, they might ask, "How can I make my profile more appealing?"

[2167] Step 12:

[2168] The server forwards the support request to a matchmaking advisor.

[2169] Step 13:

[2170] The marriage advisor provides specific advice to the user and registers the details on the server.

[2171] Step 14:

[2172] The server notifies the user of the advice and stores it in a database. The emotion engine analyzes the user's emotional changes and provides them to the advisor.

[2173] Step 15:

[2174] After getting married, users can request support for wedding preparations, ring selection, etc. For example, they can ask for recommendations for wedding venues.

[2175] Step 16:

[2176] The terminal transmits a request for support after marriage to the server.

[2177] Step 17:

[2178] The server transfers the request to the specialist and manages the progress.

[2179] Step 18:

[2180] The specialists report the status of service provision to the server, and the server notifies the user of the details.

[2181] Step 19:

[2182] Users input detailed personal data such as their hobbies, preferences, frequency of contact, and financial sense on their devices, and then approve the connection to related services. For example, they may provide detailed information such as "I like watching movies and go to the cinema once a week."

[2183] Step 20:

[2184] The terminal transmits the input data to the server and obtains the necessary data from the related service.

[2185] Step 21:

[2186] The server performs a detailed analysis of the user's personal profile based on the collected data and emotional data, and reflects the results in the next matching algorithm.

[2187] Step 22:

[2188] The server uses an improved matching algorithm to present the best possible matches to the user.

[2189] Example 2

[2190] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2191] Conventional marriage consultation services have had problems such as the time and cost required for the user information gathering and matching process, as well as the difficulty of finding the perfect partner for the user. Furthermore, matching based on simple information input does not take into account the user's personality or emotions, making effective matching difficult.

[2192] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2193] In this invention, the server includes: means for a user to input initial data and send it from the terminal; means for the server to save the user's initial data in a database; means for a user to film a self-introduction video and upload it from the terminal; means for the server to analyze the uploaded video using AI technology and generate a matching profile; means for a user to input detailed career information and send it from the terminal; means for the server to review the received career information and save it in a database as highly reliable information; means for a user to submit a support request; means for the server to notify a matchmaking advisor of the request and notify the user of advice; means for a user to request post-marriage support; means for the server to forward the request to a specialist and notify the user of progress; means for a user to input detailed personal data and link with related services; means for the server to analyze a personal profile based on the collected data and reflect the results in a matching algorithm; means for the server to use an emotion engine to analyze the user's emotional data in real time; means for the server to provide the user's emotional data to the matchmaking advisor; and means for the server to review suspicious career information and notify the user. This will enable high-quality matching and support that takes into account the user's personality and emotions.

[2194] "Initial data" refers to basic information that is initially entered when using the service, such as the user's name, gender, age, occupation, and location.

[2195] "Terminal" refers to an electronic device that a user uses to input information and transmit data to a server.

[2196] "Server" refers to a central computer system for receiving, processing, and storing data submitted by users.

[2197] "Database" refers to a digital information storage system in which a server organizes and permanently stores information.

[2198] "Self-introduction video" refers to a video file that a user shoots to introduce themselves and uploads to the system.

[2199] "AI technology" refers to technology that uses artificial intelligence to analyze data and perform specific tasks.

[2200] "Matching profile" refers to profile data generated based on information such as a user's personality, preferences, and emotions analyzed using AI technology.

[2201] "Career information" refers to detailed personal information entered by the user, such as educational background, work history, hobbies, and preferences.

[2202] A "marriage advisor" refers to an expert who provides users with advice and support regarding marriage hunting.

[2203] "Specialist providers" refer to those who handle post-wedding support requests and provide services such as wedding planning and ring selection.

[2204] An "emotion engine" refers to an analysis system that analyzes a user's facial expressions, tone of voice, etc. to obtain emotional data.

[2205] "Suspicious background information" refers to background information provided by a user that is unreliable or may be false.

[2206] The system of the present invention includes the main elements of a user, a terminal, and a server, and utilizes AI technology and an emotion engine to provide marriage consultation services at low cost and with high quality.

[2207] When starting the service, the user uses a terminal to enter basic initial data such as name, gender, age, occupation, and location. The data entered by the user is sent to the server by the terminal. The server stores the received initial data in a database and creates an account for the user.

[2208] Next, the user films a self-introduction video on their device and uploads it to the system. For example, they might introduce themselves by saying, "My hobbies are reading and traveling." This video file is also sent to the server via the device. The server uses a generative AI model to analyze the uploaded video and determine the user's speaking style, personality, and emotions. An emotion engine analyzes the user's facial expressions and tone of voice to obtain emotional data. Based on the analysis results, the server generates a matching profile and stores it in a database.

[2209] Users also enter detailed career information such as their educational background, work history, hobbies, and preferences, and upload supporting documents as needed. For example, they may provide information such as "graduated from the University of Tokyo and currently works for an IT company." The device then sends this information to the server, which then reviews the received career information and stores it in a database as reliable information. At this time, the server checks for any fraud or violations, and notifies the user if anything suspicious is found.

[2210] Additionally, users can request support such as profile improvement and dating advice. For example, they can request, "How can I make my self-introduction more appealing?" The server forwards this request to a matchmaking advisor. The matchmaking advisor provides specific advice to the user and registers it on the server. The server notifies the user of the advice and stores it in a database. The emotion engine also analyzes the user's emotions in real time and provides the results to the advisor.

[2211] After getting married, the user can request support for wedding preparations, ring selection, etc. For example, they can ask for "recommended wedding venues." The device sends this support request to the server, which then forwards the request to a specialist and manages the progress. The specialist reports the status of the service provided to the server, and the server notifies the user of the details.

[2212] For detailed personal analysis, the user enters detailed personal data such as hobbies, preferences, frequency of contact, and financial sense, and approves data sharing with other related services. For example, a user may provide information such as "I like watching movies and go to the cinema once a week." The device then sends this data to the server, which retrieves the necessary data from related services. The server then performs a detailed analysis of the user's personal profile based on the retrieved data and reflects the results in the next matching algorithm. In parallel, the emotion engine analyzes the user's emotional data and incorporates it into the personal profile.

[2213] Examples of specific prompt sentences include, "Please explain in detail the user registration procedure for the matchmaking system" and "Please tell me in detail the flow of the video review process for the matchmaking system."

[2214] In this way, this system, which utilizes AI technology, enables users to effectively pursue their matchmaking at low cost, and receives high-quality support and matching.

[2215] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2216] Step 1:

[2217] The user enters the initial data and sends it from the terminal.

[2218] The user enters basic initial data such as name, gender, age, occupation, and location into the terminal. This data includes information such as "Yamada Taro, male, 30 years old, engineer, living in Tokyo." The terminal then sends the entered data to the server. The server stores the received data in a database and creates an account for the user.

[2219] Input: Basic data such as name, gender, age, occupation, location, etc.

[2220] Output: User accounts stored in the database

[2221] Step 2: ...

Claims

1. A means for a user to input initial data and transmit it from a terminal; a means for the server to store the user's initial data in a database; A means for users to film a self-introduction video and upload it from their device; The server analyzes the uploaded videos using AI technology and generates a matching profile. a means for the user to input detailed biographical information and transmit it from the terminal; a means for reviewing the received biographical information by the server and storing it in a database as reliable information; a means for users to submit support requests; A means for the server to notify a matchmaking advisor of the request and notify the user of the advice; a means for users to request post-marriage support; a means by which the server forwards the request to the specialist and notifies the user of progress; A means for users to enter detailed personal data and connect with related services; A means for analyzing personal profiles based on the data collected by the server and reflecting this in the matching algorithm; A system including:

2. 2. The system according to claim 1, wherein the server utilizes a video analysis engine to automatically analyze the user's speaking style and personality.

3. 2. The system according to claim 1, wherein the server stores the advice provided by the marriage advisor to the user in a database and notifies the user of the advice.

Images