system

Abstract

We provide the system. [Solution] A means of verifying the user's identity using public authentication information, A means of transforming a user's facial photograph into a 2.5-dimensional object using image processing technology, A means for maintaining a database containing generated facial images and user profile information, A method for selecting compatible users based on the user's hobbies and personality information, A means by which selected users can date in a virtual space, A system that includes means of using artificial intelligence technology to support communication between users.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Currently, there are many matching apps, but many of them have problems with user privacy protection and the reliability of identity verification. In particular, the risks of leakage of face photos and personal information, and the problem of fake accounts are prominent. Also, problems include inaccurate user compatibility diagnosis and the lack of a virtual communication space before actually meeting. The present invention aims to solve these problems and provide a safe and effective matching experience.

Means for Solving the Problems

[0005] The present invention solves the above-mentioned problems by a system that includes the following means. First, it provides a means for verifying the user's identity using public authentication information. This prevents the creation of fraudulent accounts and enables highly reliable identity verification. Second, by introducing a means for converting the user's facial photograph into 2.5 dimensions using image processing technology, it is possible to provide visual information to the other party while protecting privacy.

[0006] The system provides a means of maintaining a database containing generated facial images and user profile information, and implements a means of selecting compatible users based on the user's hobbies and personality information. It also provides a metaverse dating function that allows selected users to date in a virtual space. Furthermore, it incorporates means of using artificial intelligence technology to support communication between users, thereby enabling smooth communication.

[0007] These measures can simultaneously provide safety, privacy protection, matching accuracy, and a virtual dating experience, thereby contributing to an increase in the marriage rate.

[0008] "Official authentication information" refers to personal identification information issued by public institutions such as national or local governments, and examples include My Number cards and driver's licenses.

[0009] A "user" refers to an individual who uses this system. They create a profile within the system and use it for the purpose of matching with other users.

[0010] A "profile picture" refers to an image of the user's face, which is used for identity verification and profile display.

[0011] "Image processing technology" refers to the technology for analyzing, transforming, and correcting digital images, and in this invention, it is used to transform facial photographs into 2.5-dimensional images.

[0012] "2.5D rendering" refers to a technology that adds depth information to a flat, two-dimensional image to display it in a semi-three-dimensional way. This allows for the provision of visual information while protecting the privacy of the user's facial image.

[0013] A "database" refers to a structured collection of information used to manage and store data used within a system. User profile information and generated facial images are stored in it.

[0014] "Profile information" refers to basic information, hobbies, personality traits, and other details that users enter. This information is used for compatibility assessments and matching.

[0015] "Compatibility assessment" refers to the process of evaluating and determining compatibility between users based on the profile information they have entered. This then presents suitable matching candidates.

[0016] A "virtual space" refers to a three-dimensional virtual environment created by a computer. Users can date each other within this space.

[0017] "Metaverse dating" refers to a dating experience where users interact with each other in a virtual space. It allows for virtual interaction before meeting in real life.

[0018] "Artificial intelligence technology" refers to technology that allows machines to analyze data and perform learning, reasoning, and judgment like humans, and in this invention, it is used to support communication and compatibility assessment.

[0019] "Communication support" refers to the process of using artificial intelligence technology to suggest and generate appropriate messages and responses in order to facilitate smooth interactions between users. [Brief explanation of the drawing]

[0020] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] [[ID=*37]]It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Mode for Carrying Out the Invention

[0021] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0022] First, let's explain the terminology used in the following explanation.

[0023] In the following embodiments, the signed processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include CPU (Central Processing Unit), GPU (Graphics Processing Unit), GPGPU (General-Purpose computing on Graphics Processing Units), and APU (Accelerated Processing Unit).

[0024] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.

[0025] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0026] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0027] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0028] [First Embodiment]

[0029] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0030] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0031] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0032] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0033] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0034] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0035] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0036] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0037] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0038] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0039] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0040] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0041] This invention relates to a system that includes identity verification using public authentication information, 2.5-dimensional rendering of facial photographs using image processing technology, a compatibility diagnosis engine, a metaverse dating function, and communication support using artificial intelligence technology.

[0042] 1. Implementation of Identity Verification

[0043] The user installs and launches the app. The device requests the reading of official authentication information (e.g., My Number Card). The user holds their My Number Card over the device's reader. The device encrypts the information it reads and sends it to the server. The server verifies the user's identity by comparing it against the official authentication database. The verification result is sent back to the device and displayed to the user.

[0044] As a concrete example, the user opens the app and selects "Identity Verification." The device displays "Please read your card," and the user holds their My Number Card over the reader. The device sends the read information to a server and verifies it against a public database. If successful, "Identity verification complete" is displayed.

[0045] 2. Embodiment of 2.5D rendering of facial photographs

[0046] The user uploads a profile picture on their profile screen. The device sends the photo to a server for image processing, and an image generation AI connected to the server performs 2.5D conversion. The generated 2.5D image is saved on the server and displayed on the user's profile.

[0047] As a concrete example, a user opens the profile editing screen, selects a profile picture, and presses the upload button. The device automatically sends the photo to the server, and the image generation AI begins processing. Once processing is complete, a 2.5D image is reflected in the user's profile.

[0048] 3. Implementation of Compatibility Diagnosis

[0049] The user enters information such as their hobbies, personality, and interests. The device sends this information to the server, and a ChatGPT®-based compatibility engine generates matching candidates. A list of candidates is sent back to the device and displayed to the user.

[0050] As a concrete example, a user opens the "Hobbies & Interests" tab and fills in details about their hobbies and personality. After completing the input, they press the "Compatibility Test" button, the device sends the information, and a list of compatible candidates is displayed a few seconds later.

[0051] 4. Embodiment of Metaverse Date

[0052] Based on the compatibility test results, the user sets up a date in the metaverse. The device sends the set date, time, and location to the server, and a virtual session is established. The user accesses the virtual space at the set time and interacts with other users.

[0053] As a concrete example, the user selects a partner from a list of candidates and sets the date, time, and location for the metaverse date. After the setup is complete, the device displays a confirmation message and sends a reminder notification on the day of the date. The user then accesses the virtual space and enjoys the virtual date.

[0054] 5. Implementation Examples of Communication Support

[0055] When a user sends a message to someone, the device sends the content to the server, and AI generates an appropriate reply. The suggested reply is displayed on the device, and the user reviews, modifies, and sends it.

[0056] As a concrete example, a user types a message in the chat screen and presses the send button. The device sends the message to the AI, and after a few seconds, the AI ​​generates a reply. The device displays reply options to the user, who then selects and sends the reply.

[0057] Through the above configuration, the present invention simultaneously provides safety, privacy protection, matching accuracy, and a virtual dating experience, thereby achieving its objectives.

[0058] The following describes the processing flow.

[0059] Identity verification process

[0060] Step 1:

[0061] The user installs the matching app and launches it.

[0062] Step 2:

[0063] The terminal displays an interface requesting the user to read their My Number Card.

[0064] Step 3:

[0065] The user holds their My Number Card over the terminal's reader.

[0066] Step 4:

[0067] The device reads the information from the My Number Card and encrypts the acquired data.

[0068] Step 5:

[0069] The device sends encrypted card information to the server.

[0070] Step 6:

[0071] The server sends the received information to a public authentication database to perform identity verification.

[0072] Step 7:

[0073] The server generates the result of the identity verification (success or failure) and sends it back to the device.

[0074] Step 8:

[0075] The device displays the results of the identity verification to the user.

[0076] Profile creation process

[0077] Step 1:

[0078] The user opens the profile creation screen.

[0079] Step 2:

[0080] The user selects a photo of their face and presses the upload button.

[0081] Step 3:

[0082] The device sends the selected facial image to the image generation AI and requests 2.5-dimensional processing.

[0083] Step 4:

[0084] An image generation AI connected to the server processes facial images by converting them into 2.5D.

[0085] Step 5:

[0086] The server saves the generated 2.5D image to a database and links it to the user ID.

[0087] Step 6:

[0088] The server sends a URL for the 2.5D image back to the terminal and displays it to the user.

[0089] Compatibility assessment process

[0090] Step 1:

[0091] The user enters their profile information (hobbies, personality, interests, etc.).

[0092] Step 2:

[0093] The device sends the entered profile information to the server.

[0094] Step 3:

[0095] The server passes the profile information stored in the ChatGPT-based compatibility engine.

[0096] Step 4:

[0097] The server performs a compatibility check and generates a list of matching candidates.

[0098] Step 5:

[0099] The server sends a list of potential matches back to the terminal and displays it to the user.

[0100] Metaverse dating process

[0101] Step 1:

[0102] Users select someone they are interested in based on compatibility test results and set the time and place for a metaverse date.

[0103] Step 2:

[0104] The device sends information about the set time and location to the server.

[0105] Step 3:

[0106] The server sets up a dating session in a virtual space and saves the necessary data to the database.

[0107] Step 4:

[0108] The user logs in to access the virtual space at a time they have set.

[0109] Step 5:

[0110] The server authenticates access and sends the data necessary for the virtual space dating session.

[0111] Step 6:

[0112] Users enjoy dating other users in a virtual space.

[0113] Communication support process

[0114] Step 1:

[0115] The user enters a message in the chat screen.

[0116] Step 2:

[0117] The terminal sends the entered message to the server.

[0118] Step 3:

[0119] The server passes the message content to the AI ​​engine, which then generates appropriate replies and other responses.

[0120] Step 4:

[0121] The server sends the generated reply message to the terminal.

[0122] Step 5:

[0123] The device displays the reply to the user and asks for confirmation or correction.

[0124] Step 6:

[0125] The user sends the revised message and continues the chat.

[0126] (Example 1)

[0127] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0128] In modern online dating and communication systems, user identity verification, privacy protection, advanced compatibility assessment, virtual dating experiences, and communication support are critical challenges. In particular, there is a need to simultaneously provide secure handling of personal information and a realistic virtual experience. Currently, no system exists that integrates these functions, resulting in user inconvenience.

[0129] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0130] In this invention, the server includes means for verifying the user's identity using public authentication information, means for converting the user's facial image into 2.5 dimensions using image processing technology, means for maintaining a database containing the generated facial image and the user's profile information, means for selecting other compatible users based on the user's hobbies and personality information, means for enabling selected users to date in a virtual space, means for using artificial intelligence technology to support communication between users, means including technology for encrypting user input information and transmitting it to the server, means for the server to compare the information entered by the user with a public authentication database, means for transmitting a facial image to the server and for the server to convert it into 2.5 dimensions using image generation AI, means for a compatibility diagnosis engine to generate compatible matching candidates from user data, means for setting up a virtual space session and connecting users, and means for the server to analyze the message content with AI and generate an appropriate reply. This makes it possible for users to enjoy matching and communication to a high degree in a safe and privacy-protected environment.

[0131] "Official authentication information" refers to information issued by the government or public institutions to prove an individual's identity.

[0132] A "user" refers to an individual user who utilizes the system, and is the entity that performs various operations through a terminal.

[0133] A "terminal" is an electronic device that a user operates to input and display information, and includes smartphones and personal computers.

[0134] A "server" is a computer device that forms the core of a system, processing and storing data, and communicating with other terminals.

[0135] A "face photo" is image data of the user's own face.

[0136] "Image processing technology" refers to all technologies used to analyze and process image data such as photographs and videos.

[0137] "2.5-dimensionalization" is a technique that adds depth and a sense of three-dimensionality to two-dimensional image data, processing it to make it appear nearly three-dimensional.

[0138] "Profile information" refers to information that includes data such as the individual user's characteristics, attributes, and interests.

[0139] A "database" is an electronic data storage system for systematically storing and managing information.

[0140] "Hobbies and personality information" refers to information that represents a user's everyday interests and personality traits.

[0141] "Compatibility assessment" is a process that evaluates how well a user is compatible with other users based on their hobbies and personality information.

[0142] A "virtual space" is a digital space created with computer graphics that, while not real, offers a sense of realism.

[0143] "Going on a date" refers to an activity where selected users meet and interact with each other in a virtual space.

[0144] "Communication support" refers to technologies and systems that facilitate the exchange of messages between users.

[0145] "Artificial intelligence technology" refers to technology that imitates human intelligence and possesses functions such as learning, reasoning, and problem-solving.

[0146] "Encryption" is a technology that transforms information using a specific algorithm, making it incomprehensible to third parties.

[0147] A "compatibility diagnosis engine" is a general term for algorithms and systems that select other users who are compatible with the user based on the user's input information.

[0148] A "session" refers to a series of activities or periods in which a user utilizes a system or service.

[0149] "Generating a reply" refers to the process of creating an appropriate response to a received message.

[0150] This invention is an integrated system that enables identity verification using public authentication information, 2.5-dimensional rendering of facial images, compatibility diagnosis, metaverse dating, and communication support. Specific embodiments of this system are described below.

[0151] Implementation method of identity verification

[0152] First, the user installs and launches the app. The device prompts the user to read official authentication information (e.g., My Number Card). When the user holds the My Number Card over the device's reader, the device encrypts the information it reads and sends it to the server. The server verifies the user's identity by comparing it with the public authentication database, sends the result back to the device, and displays it to the user. As a specific example, the user launches the app, selects "Identity Verification," and holds the My Number Card over the reader. The device sends the encrypted information to the server, which is then compared with the public database. If successful, "Identity verification complete" is displayed.

[0153] Embodiment of 2.5D rendering of facial photographs

[0154] The user uploads a profile picture on their profile screen. The device sends the photo to a server, where a generative AI connected to the server performs a 2.5-dimensional transformation. The generated 2.5-dimensional image is stored on the server and displayed on the user's profile. For example, the user selects a profile picture on the profile editing screen and presses the upload button. The device sends the photo to the server, and the image generation AI performs the 2.5-dimensional transformation. Once the process is complete, the image is displayed on the user's profile.

[0155] Compatibility assessment method

[0156] The user enters information such as hobbies, personality, and interests within the app. The device sends this information to a server, and a ChatGPT-based compatibility engine generates matching candidates. The generated candidate list is sent back to the device and displayed to the user. For example, the user opens the "Hobbies & Interests" tab, enters information, and runs the "Compatibility Test." The device sends the information to the server, and a list of compatible candidates is displayed a few seconds later.

[0157] Metaverse Date Implementation

[0158] Based on compatibility test results, the user sets up a date in the metaverse. The device sends the set date, time, and location information to the server, and the server sets up a virtual session. The user accesses the virtual space at the set time and interacts with other users. For example, the user selects a partner from a candidate list and sets the date, time, and location for the metaverse date. The device displays a confirmation message and sends a reminder notification as the time approaches. At the set time, the user accesses the virtual space and enjoys the virtual date.

[0159] Implementation Examples of Communication Support

[0160] When a user types a message to another person, the device sends the message to a server, and AI generates an appropriate reply. The suggested reply is displayed on the device, and the user reviews or modifies it before finally sending it. For example, a user types a message in the chat screen and presses the send button. The device sends the message to the server, and after a few seconds, the AI ​​generates a reply. The device displays the suggested reply options to the user, who then reviews and sends it.

[0161] Example prompts for a generative AI model

[0162] The following are examples of prompt statements related to a series of processes:

[0163] Prompt message regarding identity verification:

[0164] Please explain the step-by-step process for users to authenticate their identity by holding their My Number Card over a reader.

[0165] Prompt message regarding 2.5D conversion of facial images:

[0166] Please provide a detailed explanation of the processing flow for converting a user's profile picture to 2.5D.

[0167] Prompt message regarding compatibility assessment:

[0168] Please describe the process by which users input information about their hobbies and interests to perform a compatibility assessment.

[0169] Prompt message regarding metaverse dating:

[0170] Please provide detailed instructions on how users can set up and enjoy a metaverse date.

[0171] Prompt messages regarding communication support:

[0172] Please describe in detail the process by which AI is used to generate replies when a user sends a message.

[0173] In the above configuration, the present invention enables users to receive multiple high-performance services in a safe and privacy-protected environment. This significantly improves user convenience and enhances overall satisfaction.

[0174] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0175] Implementation method of identity verification

[0176] Step 1:

[0177] The user installs and launches the app.

[0178] Input: App installation and launch operations.

[0179] Output: The app launches and the initial screen is displayed.

[0180] Specifically, the user downloads the app from their smartphone's app store and completes the installation. After installation, the user taps the app icon to launch the app.

[0181] Step 2:

[0182] The device requests to read public authentication information.

[0183] Input: Initial screen after launching the app.

[0184] Output: A screen prompting the preparation of official authentication information.

[0185] Specifically, the device will display the message "Please have your My Number Card ready" on the screen.

[0186] Step 3:

[0187] The user holds their My Number Card over the terminal's reader.

[0188] Input: User's My Number Card.

[0189] Output: Data that the device reads from public authentication information.

[0190] Specifically, the user holds their My Number Card over the NFC reader on the terminal. The terminal scans the information on the card and converts it into digital data.

[0191] Step 4:

[0192] The device encrypts the information it reads and sends it to the server.

[0193] Input: Public authentication information read from the document.

[0194] Output: Encrypted public authentication information.

[0195] Specifically, the terminal encrypts the data using AES256 and sends it to the server using the HTTPS protocol.

[0196] Step 5:

[0197] The server verifies the user's identity by matching them against a public authentication database.

[0198] Input: Encrypted public authentication information.

[0199] Output: Matching result.

[0200] Specifically, the server decrypts the received data and accesses a public authentication database to perform verification.

[0201] Step 6:

[0202] The server sends the verification result back to the terminal and displays it to the user.

[0203] Input: Matching result.

[0204] Output: Display of identity verification results.

[0205] Specifically, the server sends the verification result back to the terminal, and the terminal displays "Identity verification complete."

[0206] Embodiment of 2.5D rendering of facial photographs

[0207] Step 1:

[0208] The user uploads a profile picture on their profile screen.

[0209] Input: User's profile picture.

[0210] Output: Upload instruction.

[0211] Specifically, the user presses the "Select Photo" button on the profile editing screen, selects a photo of their face from their smartphone's gallery, and uploads it.

[0212] Step 2:

[0213] The device sends the photo data to the server.

[0214] Input: User's profile picture.

[0215] Output: Sending photo data to the server.

[0216] Specifically, the terminal compresses the selected image data and sends it to the server in JPEG format.

[0217] Step 3:

[0218] The generation AI connected to the server performs the 2.5-dimensional transformation.

[0219] Input: Face photo data.

[0220] Output: 2.5-dimensional image data.

[0221] Specifically, the server receives a facial image, passes it to an image generation AI (such as StyleGAN), and performs a 2.5-dimensional transformation.

[0222] Step 4:

[0223] The server saves the generated 2.5D image, sends it back to the terminal, and displays it to the user.

[0224] Input: 2.5-dimensional image.

[0225] Output: The image displayed in the user's profile.

[0226] Specifically, the server saves the generated image to a database and sends it to the terminal. The terminal receives the image and displays it in the user's profile.

[0227] Compatibility assessment method

[0228] Step 1:

[0229] Users enter information such as their hobbies, personality, and interests.

[0230] Input: Hobbies, personality, and interests.

[0231] Output: Input completion information.

[0232] In terms of specific actions, the user enters information into a form on the app's "Hobbies & Interests" tab (e.g., watching movies, reading, traveling, etc.).

[0233] Step 2:

[0234] The device sends this information to the server.

[0235] Input: Hobbies, personality, and interests.

[0236] Output: Sending information to the server.

[0237] Specifically, the terminal sends the input data to the server in JSON format.

[0238] Step 3:

[0239] A compatibility diagnostic engine connected to the server generates matching candidates.

[0240] Input: User information.

[0241] Output: Matching candidate list.

[0242] Specifically, the server launches a ChatGPT-based compatibility assessment engine and lists compatible candidates based on the information received.

[0243] Step 4:

[0244] The server sends a list of matching candidates back to the terminal and displays it to the user.

[0245] Input: Matching candidate list.

[0246] Output: Display of candidate list.

[0247] Specifically, the server sends a list of candidates to the terminal, and the terminal displays it on the user's screen.

[0248] Metaverse Date Implementation

[0249] Step 1:

[0250] Users set up dates in the metaverse based on their compatibility test results.

[0251] Input: Compatibility test results, date settings.

[0252] Output: Configuration details.

[0253] Specifically, the user selects a partner from a list of candidates and sets the date, time, and location for the date.

[0254] Step 2:

[0255] The device sends information about the configured date, time, and location to the server.

[0256] Input: Date settings information.

[0257] Output: Sending configuration information to the server.

[0258] Specifically, the device sends configuration information to the server.

[0259] Step 3:

[0260] The server sets up a session in the virtual space.

[0261] Input: Date settings information.

[0262] Output: URL and access information for the virtual space session.

[0263] Specifically, the server creates a virtual session at the specified date and time and generates access information.

[0264] Step 4:

[0265] Users access the virtual space at a set date and time and interact with other users.

[0266] Input: Access information for the virtual space.

[0267] Output: Interaction in a virtual space.

[0268] As a specific action, the user accesses the virtual space and interacts with others through conversations and avatar operations.

[0269] Embodiment of communication support

[0270] Step 1:

[0271] The user inputs a message to the other party.

[0272] Input: Message content.

[0273] Output: Ready to send.

[0274] As a specific action, the user inputs a message on the chat screen and presses the send button.

[0275] Step 2:

[0276] The terminal sends the message to the server.

[0277] Input: Message content.

[0278] Output: Message sent to the server.

[0279] As a specific action, the terminal sends the message to the server.

[0280] Step 3:

[0281] [[ID=!51]] The AI in the server generates an appropriate reply.

[0282] Input: The user's message.

[0283] Output: Generated reply candidates. [[ID=6i]]

[0284] As a specific action, the AI in the server (e.g., ChatGPT) analyzes the received message and generates the reply content.

[0285] Step 4: It should be noted that there seems to be a small error in the original text where "

[0284] " is incorrect. I have corrected it to "

[0284] " in the translation for consistency. Also, " " was misspelled as " " in the original, which I've left as is in the translation as per the requirement to preserve all 7 - digit tags exactly.

[0286] The server sends the proposed reply to the terminal, and the user checks, modifies, and then sends it.

[0287] Input: The generated reply candidates.

[0288] Output: Sending of the final reply.

[0289] As a specific operation, the server sends the generated reply candidates to the terminal, and the terminal displays them to the user. After the user checks the reply content and modifies it if necessary, the user sends it.

[0290] The above are the specific steps of each program process of this system.

[0291] (Application Example 1)

[0292] Next, Application Example 1 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart device 14 is referred to as the "terminal".

[0293] Conventional dating applications have insufficient identity verification, privacy protection, and compatibility diagnosis functions, lacking reliability and security for users. Also, in systems that provide dating and adventure experiences in virtual spaces, the integration of devices used by users and the support for communication are insufficient, and the real communication experience is impaired.

[0294] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following respective means.

[0295] This invention includes a server that provides means for verifying the user's identity using public authentication information, means for transforming the user's facial photograph into a 2.5-dimensional image using image processing technology, means for maintaining a database containing the generated facial image and the user's profile information, means for selecting compatible users based on the user's hobbies and personality information, means for enabling selected users to date in a virtual space, means for using artificial intelligence technology to support communication between users, and means for providing virtual dating and adventures via smartphones and head-mounted displays. As a result, users can receive reliable identity verification in a safe and private environment, and enjoy a near-realistic virtual experience through smartphones and head-mounted displays while receiving advanced communication support using AI.

[0296] "Official authentication information" refers to information issued by public institutions and used to verify an individual's identity.

[0297] "Identity verification" is the process of confirming that a user is indeed who they claim to be, using official authentication information.

[0298] "2.5-dimensionalization" is a process that uses image processing technology to add some three-dimensional elements to a flat, two-dimensional image of a user's face, giving it a sense of depth.

[0299] "Profile information" refers to data that includes basic user information, such as facial images, hobbies, and personality.

[0300] "Compatibility assessment" is a process that selects other users who are compatible with the user based on the hobbies and personality information entered by the user.

[0301] A "virtual space" is a digital, three-dimensional environment created by a computer, where users interact through avatars.

[0302] "Artificial intelligence technology" refers to technology in which a computer has knowledge and skills like a human and can perform learning, inference, judgment, etc.

[0303] "Head-mounted display" refers to a display device that a user wears on the head and is a device for visually experiencing a virtual space.

[0304] This invention relates to a virtual entertainment application for users to enjoy dates and adventures in a virtual space. This application has various functions such as identity verification using public authentication information, 2.5D conversion of face photos, compatibility diagnosis, metaverse dating, and communication support by AI.

[0305] The server performs identity verification using public authentication information. When the user launches the application on the smartphone and reads the public authentication information (e.g., My Number card), the information is encrypted and sent to the server. The server checks it against the public database for identity verification and returns the result to the terminal for display to the user.

[0306] Next, image processing for 2.5D conversion of the user's face photo is performed. When the user uploads a face photo on the profile screen, the photo is sent to the server. The image generation AI connected to the server processes the face photo to generate a 2.5D image. The generated image is saved on the server and displayed on the user's profile.

[0307] After that, a compatibility diagnosis is carried out based on the user's hobby and personality information. When the user inputs information regarding hobbies and personality, the information is sent to the server. The ChatGPT-based compatibility diagnosis engine analyzes the information and selects other users with good compatibility. The selected candidate list is returned to the terminal and displayed to the user.

[0308] Selected users can arrange dates in a virtual space. Once users set the date, time, and location for a metaverse date, that information is sent to the server, and a virtual space session is established. Users can access the virtual space at the scheduled time and enjoy dates and adventures with other users. This can be done using smartphones or head-mounted displays.

[0309] Furthermore, artificial intelligence technology is used to support communication between users. When a user sends a chat or voice message, its content is sent to the server. The AI ​​generates an appropriate reply, and the suggestion is displayed on the user's device. The user can review, modify, and send the suggested reply.

[0310] As a concrete example, by inputting the following prompt sentences into the AI ​​model, it is possible to provide specific guidance on how the user should use the application:

[0311] Design a virtual entertainment app that allows users to set up dates using 2.5D avatars in a virtual space. The system will include identity verification using public authentication information, 2.5D rendering of facial images using image processing technology, a compatibility diagnosis engine, a metaverse dating function, and communication support using artificial intelligence technology. Technologies to be used: face_recognition, OpenCV, PIL, requests, Python.

[0312] Thus, this invention is a comprehensive system that allows users to enjoy virtual dating and adventure experiences in a safe and reliable environment.

[0313] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0314] Step 1:

[0315] The user launches the application and reads their public authentication information. The user holds their My Number Card over the reader on their smartphone. This input reads the user's public authentication information. The device encrypts the read information and sends it to the server. In this process, the data is encrypted before transmission, ensuring security.

[0316] Step 2:

[0317] The server compares the received public authentication information with a public database. Based on the comparison, it determines whether or not identity verification is successful and sends the result back to the terminal. The information sent back includes whether or not authentication was successful. The terminal displays the result to the user, and identity verification is completed.

[0318] Step 3:

[0319] The user uploads a profile picture on their profile screen. This input sends the image data of the profile picture from the device to the server. An image generation AI connected to the server processes the received image data to generate a 2.5D image. This process transforms a flat 2D image into a three-dimensional 2.5D image. The generated image is saved on the server and displayed on the user's profile.

[0320] Step 4:

[0321] The user enters information about their hobbies and personality to begin the compatibility assessment. This input data is sent from the terminal to the server. A ChatGPT-based compatibility assessment engine connected to the server analyzes the user's information and selects other compatible users. This analysis generates a list of users that match the user's hobbies and personality. The selected list of candidates is sent back to the terminal and displayed to the user.

[0322] Step 5:

[0323] The user sets the date, time, and location for the metaverse date. This setting information is sent from the device to the server. The server uses this information to set up the virtual space session. This process prepares the virtual date. At the set date and time, the user accesses the virtual space using a smartphone or head-mounted display and enjoys the date.

[0324] Step 6:

[0325] When a user communicates with another user, they input messages or voice data. The input data is sent from the device to a server, which uses AI to generate appropriate replies. This process enables natural conversation. The generated reply is sent back to the device and displayed to the user. The user can review, modify, and send the suggested reply.

[0326] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0327] This invention relates to a system that combines identity verification using public authentication information, 2.5-dimensional rendering of facial photographs using image processing technology, a compatibility diagnosis engine, a metaverse date function, communication support using artificial intelligence technology, and an emotion engine.

[0328] 1. Implementation of Identity Verification

[0329] The user installs and launches the app. The device displays an interface requesting the reading of public authentication information, and the user holds their authentication card over the reader. The device encrypts the information it reads and sends it to the server. The server verifies the user's identity using the public authentication database and sends the result back to the device. The device displays the authentication result to the user.

[0330] As a concrete example, a user opens the app, selects "Identity Verification," and holds their My Number Card over the device. The device reads the information, encrypts it, sends it to the server, and after matching it with a public database, displays "Identity verification complete."

[0331] 2. Embodiment of 2.5D rendering of facial photographs

[0332] The user uploads a photo of their face on the profile creation screen. The device sends the photo to the server, where an image generation AI transforms it into a 2.5D image. The generated image is stored on the server and displayed on the user's profile.

[0333] As a concrete example, a user selects a photo of their face and presses the upload button. The device sends the photo to the server, and an image generation AI generates a 2.5D image. The generated image is then reflected in the user's profile.

[0334] 3. Implementation of Compatibility Diagnosis

[0335] The user enters profile information such as hobbies, personality, and interests. The device sends this information to the server, and a ChatGPT-based compatibility engine generates matching candidates. The candidate list is sent back to the device and displayed to the user. Additionally, an emotion engine recognizes the user's emotions and reflects them in the diagnosis results.

[0336] As a concrete example, a user enters detailed profile information and starts a "compatibility test." The device sends the information to the server, the compatibility test engine generates a list of candidates, the emotion engine analyzes the user's emotions, and the most suitable list of candidates is displayed.

[0337] 4. Embodiment of Metaverse Date

[0338] The user sets the time and place for a date based on the compatibility assessment results. The device sends the setting information to the server, and a virtual dating session is set up. The user accesses the virtual space at the specified time and interacts with other users. The emotion engine analyzes the user's emotions in real time and suggests appropriate dating scenarios and activities.

[0339] As a concrete example, the user selects a partner from a candidate list and sets the date, time, and location for the metaverse date. The device sends the information to the server and sends a reminder notification on the day of the date. The user accesses the virtual space, and during the date, an emotion engine analyzes the user's emotions and suggests the most suitable activities.

[0340] 5. Implementation Examples of Communication Support

[0341] When a user sends a message, the device sends the content to the server, and the AI ​​generates an appropriate reply. The generated reply is displayed on the device, and the user reviews, modifies, and sends it. In addition, the emotion engine analyzes the message content and the user's facial expressions to suggest an appropriate response based on their emotions.

[0342] As a concrete example, a user types and sends a message in the chat screen. The device sends the message to the server, and the AI ​​generates a reply. The emotion engine analyzes the message content and the user's emotions, and an appropriate reply is displayed on the device. The user then modifies and sends the reply.

[0343] Through the above configuration, the present invention simultaneously provides reliable identity verification, privacy protection, and compatibility diagnosis and communication support utilizing emotion recognition, thereby realizing a safe and effective matching experience.

[0344] The following describes the processing flow.

[0345] Identity verification process

[0346] Step 1:

[0347] The user installs the matching app and launches it.

[0348] Step 2:

[0349] The terminal displays an interface requesting the user to read their My Number Card.

[0350] Step 3:

[0351] The user holds their My Number Card over the terminal's reader.

[0352] Step 4:

[0353] The device reads the information from the My Number Card and encrypts the acquired data.

[0354] Step 5:

[0355] The device sends encrypted card information to the server.

[0356] Step 6:

[0357] The server sends the received information to a public authentication database to perform identity verification.

[0358] Step 7:

[0359] The server generates the result of the identity verification (success or failure) and sends it back to the device.

[0360] Step 8:

[0361] The device displays the results of the identity verification to the user.

[0362] Profile creation process

[0363] Step 1:

[0364] The user opens the profile creation screen.

[0365] Step 2:

[0366] The user selects a photo of their face and presses the upload button.

[0367] Step 3:

[0368] The device sends the selected facial image to the image generation AI and requests 2.5-dimensional processing.

[0369] Step 4:

[0370] An image generation AI connected to the server processes facial images by converting them into 2.5D.

[0371] Step 5:

[0372] The server saves the generated 2.5D image to a database and links it to the user ID.

[0373] Step 6:

[0374] The server sends a URL for the 2.5D image back to the terminal and displays it to the user.

[0375] Compatibility assessment process

[0376] Step 1:

[0377] The user enters their profile information (hobbies, personality, interests, etc.).

[0378] Step 2:

[0379] The device sends the entered profile information to the server.

[0380] Step 3:

[0381] The server passes the registered profile information to a ChatGPT-based compatibility assessment engine.

[0382] Step 4:

[0383] The server performs a compatibility check and generates a list of matching candidates.

[0384] Step 5:

[0385] The server sends a list of potential matches back to the terminal and displays it to the user.

[0386] Step 6:

[0387] The server uses an emotion engine to recognize the user's emotions and reflect them in the diagnostic results.

[0388] Metaverse dating process

[0389] Step 1:

[0390] Users select someone they are interested in based on compatibility test results and set the time and place for a metaverse date.

[0391] Step 2:

[0392] The device sends information about the set time and location to the server.

[0393] Step 3:

[0394] The server sets up a dating session in a virtual space and saves the necessary data to the database.

[0395] Step 4:

[0396] The user logs in to access the virtual space at a time they have set.

[0397] Step 5:

[0398] The server authenticates access and sends the data necessary for the virtual space dating session.

[0399] Step 6:

[0400] Users enjoy dating other users in a virtual space.

[0401] Step 7:

[0402] The server uses an emotion engine to analyze the user's emotions in real time and suggest appropriate dating scenarios and activities.

[0403] Communication support process

[0404] Step 1:

[0405] The user enters a message in the chat screen.

[0406] Step 2:

[0407] The terminal sends the entered message to the server.

[0408] Step 3:

[0409] The server passes the message content to the AI ​​engine, which then generates appropriate replies and other responses.

[0410] Step 4:

[0411] The server sends the generated reply message to the terminal.

[0412] Step 5:

[0413] The device displays the reply to the user and asks for confirmation or correction.

[0414] Step 6:

[0415] The user sends the revised message and continues the chat.

[0416] Step 7:

[0417] The server uses an emotion engine to analyze the message content and the user's facial expressions, and then suggests an appropriate response based on those emotions.

[0418] (Example 2)

[0419] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0420] While online matching systems have become commonplace in modern society, they face numerous challenges in terms of protecting user privacy, accurate identity verification, secure information transmission, and communication support. For example, traditional systems have a high risk of users' personal information being leaked to third parties, and suffer from low accuracy in compatibility assessments and poor communication quality. Furthermore, virtual interactions lack real-time emotion recognition and optimal activity suggestions, resulting in insufficient improvements to the user experience. There is a need to solve these problems and provide safer and more reliable online matching systems.

[0421] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0422] In this invention, the server includes means for verifying the user's identity using public authentication information; means for creating a 2.5-dimensional representation of the user's facial image using image processing technology; means for maintaining a database containing the generated facial image and the user's profile information; means for selecting compatible users based on the user's hobbies and personality information; means for enabling the selected users to interact with each other in a virtual space; means for using artificial intelligence technology to support communication between users; means for analyzing the user's emotions using an emotion analysis engine and reflecting this in the diagnosis results and interaction content; means for securely transmitting authentication information using encryption technology; and means for analyzing the user's activities in the virtual space in real time and suggesting optimal actions. This enables accurate identity verification and secure information transmission while protecting user privacy, and also realizes emotion recognition and optimal activity suggestions to improve the user experience.

[0423] "Official authentication information" refers to authentication information issued by a public institution that is used to verify the user's identity. Examples include My Number cards and driver's licenses.

[0424] "2.5-dimensionalization" is a process that adds depth information to conventional 2D images, giving them a pseudo-three-dimensional appearance. This makes the image appear more three-dimensional.

[0425] "User profile information" refers to information such as hobbies, personality, and interests that users enter, and is used for matching and providing personalized services.

[0426] "Selecting compatible other users" means identifying other users who are deemed to be mutually compatible, based on user profile information and using statistical or learning models.

[0427] A "virtual space" is a three-dimensional virtual environment created by a computer, a space in which users can interact with each other.

[0428] "Artificial intelligence technology" refers to technologies that allow computers to mimic the workings of human intelligence, and includes natural language processing, machine learning, and deep learning.

[0429] An "emotion analysis engine" is an algorithm or software that analyzes a user's facial expressions and message content to estimate their emotional state.

[0430] "Encryption technology" is a technique that transforms transmitted information so that it cannot be read by a third party, and is used for secure information transmission. Examples of encryption methods include AES and RSA.

[0431] "Suggesting the optimal action" means analyzing the user's activities and emotional state and presenting the most appropriate action or option in real time. This improves the user experience.

[0432] Modes for carrying out the invention

[0433] This invention relates to a system that combines identity verification using public authentication information, 2.5-dimensional rendering of facial images using image processing technology, a compatibility diagnosis engine, a virtual space interaction function, communication support using artificial intelligence technology, and an emotion analysis engine. The configuration and operation for realizing each of these technological elements with specific hardware and software will be described in detail below.

[0434] Implementation method of identity verification

[0435] The user installs and launches a dedicated application. The application displays an interface for reading official authentication information using the authentication card reader built into the device. Examples include My Number cards and driver's licenses. When the user holds the authentication card over the reader, the device encrypts the information using AES encryption and sends it to the server. The server accesses the public authentication database, verifies the user's identity, and sends the result back to the device. The device then displays the authentication result to the user.

[0436] Embodiment of 2.5D rendering of facial photographs

[0437] The user uploads a profile picture on the profile creation screen. The device sends the photo to the server, where a generative AI model (e.g., StyleGAN) is used to convert it into a 2.5-dimensional image. The generated image is stored in the server's database and reflected in the user's profile.

[0438] Compatibility assessment method

[0439] The user enters profile information such as hobbies, personality, and interests. The device sends this information to the server, and a ChatGPT-based compatibility engine generates matching candidates. Furthermore, an emotion analysis engine recognizes the user's emotions and reflects them in the diagnosis results, creating a more accurate candidate list. Finally, the candidate list is displayed to the user.

[0440] Implementation of interaction in virtual space

[0441] The user sets the time and place for a date based on the compatibility assessment results. The device sends this setting information to the server, and a virtual dating session is set up. When the user accesses the virtual space at the specified date and time, they can interact with other users. An emotion analysis engine analyzes the user's emotions in real time and suggests appropriate dating scenarios and activities.

[0442] Implementation Examples of Communication Support

[0443] When a user sends a message, the device sends its content to the server, and the AI ​​generates an appropriate reply. The generated reply is displayed on the device, and the user reviews, modifies, and sends it. In addition, an emotion analysis engine analyzes the message content and the user's facial expressions to suggest an appropriate response based on their emotions.

[0444] Examples of specific cases and prompt statements

[0445] The following are specific examples of the system of the present invention.

[0446] Examples of identity verification:

[0447] The user opens the app, selects "Identity Verification," and holds their My Number Card over the reader. The device reads the information, encrypts it, sends it to the server, and after matching it with the public database, displays "Identity verification complete."

[0448] Examples of prompts for a generative AI model:

[0449] "The user sets the date, time, and location for a metaverse date, and the device sends this information to the server. The user accesses the metaverse at the specified time and begins dating other users. The sentiment analysis engine should analyze the user's emotions and suggest the most suitable activities."

[0450] This invention is a system that prioritizes user privacy protection and provides a superior user experience by combining accurate identity verification, secure information transmission, highly accurate compatibility assessment, and real-time sentiment analysis.

[0451] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0452] Implementation method of identity verification

[0453] Step 1:

[0454] The user launches the app.

[0455] Input: Tap the application icon or touch the screen.

[0456] Output: Startup screen displayed

[0457] Step 2:

[0458] The device displays an interface requesting the reading of public authentication information.

[0459] Input: Application initialization information

[0460] Output: Display of the My Number Card or driver's license reading screen.

[0461] Step 3:

[0462] The user holds their authentication card over the reader.

[0463] Input: Authentication card (My Number Card or driver's license)

[0464] Output: Read authentication information

[0465] Step 4:

[0466] The device encrypts the information it reads and sends it to the server.

[0467] Input: Authentication information

[0468] Data processing: Apply AES encryption.

[0469] Output: Encrypted credentials

[0470] Step 5:

[0471] The server uses a public authentication database to verify the user's identity.

[0472] Input: Encrypted credentials

[0473] Data processing: Database matching

[0474] Output: Authentication result (success / failure)

[0475] Step 6:

[0476] The server sends the results back to the terminal.

[0477] Input: Authentication result

[0478] Output: Sending results to the terminal

[0479] Step 7:

[0480] The device displays the authentication result to the user.

[0481] Input: Authentication result

[0482] Output: Display of authentication result screen (e.g., "Identity verification complete," "Identity verification failed")

[0483] Embodiment of 2.5D rendering of facial photographs

[0484] Step 1:

[0485] The user accesses the profile creation screen.

[0486] Input: Menu Selection

[0487] Output: Display of the profile creation screen

[0488] Step 2:

[0489] The user uploads a photo of their face.

[0490] Input: Face photo file

[0491] Output: Photo selection and preparation for uploading.

[0492] Step 3:

[0493] The device sends the photo to the server.

[0494] Input: Uploaded profile picture

[0495] Output: Sending photo data to the server

[0496] Step 4:

[0497] The generated AI model on the server undergoes 2.5-dimensional transformation.

[0498] Input: Face photo data

[0499] Data processing: 2.5-dimensionalization using image generation AI (e.g., StyleGAN)

[0500] Output: Generated 2.5D image

[0501] Step 5:

[0502] The server saves the generated image.

[0503] Input: Generated 2.5D image

[0504] Data processing: Saving image files and linking them to profiles.

[0505] Output: Notification that saving to the database is complete.

[0506] Step 6:

[0507] Display the generated image on the user's profile.

[0508] Input: Path to the generated image stored in the database

[0509] Output: Image displayed on profile screen

[0510] Compatibility assessment method

[0511] Step 1:

[0512] Users enter profile information such as their hobbies, personality, and interests.

[0513] Input: Profile information (text input field)

[0514] Output: Entered profile information

[0515] Step 2:

[0516] The device sends information to the server.

[0517] Input: Profile information

[0518] Output: Data to send to the server

[0519] Step 3:

[0520] The server uses a compatibility diagnostic engine to generate matching candidates.

[0521] Input: Submitted profile information

[0522] Data processing: Candidate generation using a ChatGPT-based compatibility diagnostic engine.

[0523] Output: Matching candidate list

[0524] Step 4:

[0525] The server's emotion analysis engine recognizes the user's emotions and reflects them in the diagnostic results.

[0526] Input: User sentiment data

[0527] Data processing: Candidate adjustment based on sentiment analysis

[0528] Output: Adjusted matching candidate list

[0529] Step 5:

[0530] The server sends the candidate list back to the terminal.

[0531] Input: Final candidate list

[0532] Output: Send candidate list to terminal

[0533] Step 6:

[0534] The device displays a list of suggestions to the user.

[0535] Input: Received candidate list

[0536] Output: Displaying the list

[0537] Implementation of interaction in virtual space

[0538] Step 1:

[0539] The user sets the time and place for the date.

[0540] Input: Date, time, and location information for the date

[0541] Output: Confirmation of configuration information

[0542] Step 2:

[0543] The device sends configuration information to the server.

[0544] Input: Configuration information

[0545] Output: Sending configuration data to the server

[0546] Step 3:

[0547] The server sets up a virtual dating session.

[0548] Input: Received configuration information

[0549] Data processing: Setting up a dating session in a virtual space

[0550] Output: Session setup complete notification

[0551] Step 4:

[0552] The server sends a reminder notification to the user.

[0553] Input: Date and time of the date

[0554] Output: Reminder notification

[0555] Step 5:

[0556] The user accesses the virtual space at the specified time.

[0557] Input: Login information and date / time

[0558] Output: Access to the virtual space

[0559] Step 6:

[0560] The emotion analysis engine analyzes the user's emotions in real time and suggests appropriate dating scenarios and activities.

[0561] Input: User sentiment data

[0562] Data processing: Real-time sentiment analysis and scenario generation

[0563] Output: Proposed dating scenarios and activities

[0564] Implementation Examples of Communication Support

[0565] Step 1:

[0566] The user enters a message and presses the send button.

[0567] Input: Message text

[0568] Output: Message sending command

[0569] Step 2:

[0570] The terminal sends the content to the server.

[0571] Input: Message text

[0572] Output: Sending a message to the server

[0573] Step 3:

[0574] The server uses AI to generate appropriate responses.

[0575] Input: Received message

[0576] Data processing: AI-powered response generation (e.g., GPT-3® model)

[0577] Output: Generated reply

[0578] Step 4:

[0579] The generated reply will be displayed on your device.

[0580] Input: Generated reply data

[0581] Output: Display of reply text

[0582] Step 5:

[0583] The user reviews the reply, makes any necessary corrections, and then sends it.

[0584] Input: Confirmation and Correction

[0585] Output: Sending the revised reply

[0586] Step 6:

[0587] The emotion analysis engine analyzes the message content and the user's facial expressions, and suggests an appropriate response based on their emotions.

[0588] Input: Message text and facial expression data

[0589] Data processing: Sentiment analysis and response generation

[0590] Output: Proposed response

[0591] (Application Example 2)

[0592] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0593] Traditional virtual store systems lacked sufficient user identity verification and privacy protection, and had limited communication and emotional recognition capabilities between users. As a result, it was difficult for users to feel secure while using virtual stores, and the systems failed to provide an engaging shopping experience.

[0594] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for verifying the user's identity using public authentication information, means for converting the user's facial photograph into 2.5 dimensions using image processing technology, and means for analyzing the user's emotions in real time using an emotion engine and providing appropriate product recommendations and activity suggestions. This makes it possible to enhance user identity verification and privacy protection, and to provide the user with the most suitable activities by analyzing emotions in real time.

[0595] "Official authentication information" refers to information issued by a government or certification body to prove an individual's identity.

[0596] "Identity verification" is the process of confirming a user's identity using publicly available authentication information.

[0597] "2.5D rendering of facial photographs" is a technology that represents a user's facial photograph not as a flat image, but as a semi-three-dimensional image with added depth information.

[0598] "Image processing technology" refers to the technology used to analyze, transform, and process digital images.

[0599] A "virtual store" is a virtual shopping space that exists on the internet.

[0600] "Profile information" refers to data that includes personal information such as the user's hobbies, personality, and interests.

[0601] A "database" is a system for storing and managing user profile information, generated facial images, and other data.

[0602] "Compatibility assessment" is a process that selects other users who are a good match for a given user based on their profile information.

[0603] "Artificial intelligence technology" is a technology that enables machines to imitate intelligent human behavior.

[0604] An "emotion engine" is a system that analyzes a user's emotions based on their facial expressions, statements, and other factors.

[0605] A "virtual space" is a real-time, three-dimensional virtual environment built on the internet.

[0606] "Appropriately representing the individual's characteristics" means processing facial photos while protecting privacy, without losing the user's individuality or identifying information.

[0607] "Communication encryption technology" is a technology that converts data into an unreadable format in order to securely send and receive data.

[0608] "Product recommendation" is the process of suggesting products and services that are suitable for a user based on their profile information and emotional state.

[0609] "Activity suggestion" is the process of suggesting enjoyable activities and experiences based on the user's interests and emotional state.

[0610] This invention provides a system that includes user identity verification, privacy protection, 2.5D rendering of facial images, compatibility assessment, emotion recognition, and communication support using artificial intelligence within a virtual store. Each function is described below in turn.

[0611] Implementation of identity verification

[0612] The user launches the app using a device such as a smartphone or tablet. First, identity verification is performed using public authentication information. The user holds their public authentication information (such as a My Number Card) over the device's reader, and the device reads the information. This information is securely transmitted to the server using encryption technology. The server verifies the user's identity by comparing it with the public authentication database and sends the result back to the device.

[0613] 2.5-dimensional rendering of facial photographs

[0614] Next, when a user creates a profile, they upload a photo of their face. The device sends the uploaded photo to the server, which uses image processing technology and generative AI models (such as TENSORFLOW®) to transform the photo into a 2.5-dimensional image. This 2.5-dimensional image is processed to appropriately represent the person's features while protecting their privacy, and is stored in the database as the user's profile information.

[0615] Compatibility assessment method

[0616] When a user enters profile information such as hobbies, personality, and interests, a compatibility engine (ChatGPT-based) generates matching candidates based on that information. The server analyzes the collected information and also considers the user's emotions using an emotion engine. As a result, appropriate matching candidates are selected, and the results are displayed on the device.

[0617] Customer service support within the metaverse

[0618] When a user accesses the virtual store's virtual space at a specified time, an emotion engine analyzes the user's emotions in real time and suggests optimal product recommendations and activities. Artificial intelligence technology is used to facilitate smooth communication between users. The AI ​​analyzes user statements and chat messages to provide appropriate responses and assistance.

[0619] Hardware and software to use

[0620] Hardware: Smartphones, tablets, reader devices

[0621] Software: Python, Flask (for server processing), TensorFlow, OpenCV (for image processing and emotion recognition), Amazon Web Services (for database and authentication processing), ChatGPT (for natural language processing and communication support)

[0622] Specific example

[0623] When a user attempts to access the virtual mall, their identity is first verified using official authentication information. Afterward, the user uploads a photo of their face, which the app then transforms into a 2.5D image and displays in their profile. The user inputs their hobbies and personality information, and the AI ​​selects compatible users. When users enjoy dating in the virtual space, an emotion engine analyzes their emotions and suggests the most suitable activities. For example, if a user is interested in a new product exhibition, the emotion engine can use that information to suggest, "Why not check out the latest summer collection?"

[0624] Example of a prompt

[0625] "User 1's profile information: Name: Taro, Age: 30, Hobbies: Outdoors, Reading, Personality: Sociable. User 2's profile information: Name: Hanako, Age: 28, Hobbies: Cooking, Traveling, Personality: Introverted. Based on this information, perform a compatibility assessment between these users and generate an estimate of how likely a match is to occur."

[0626] This invention provides a system that allows users to enjoy shopping and communication in virtual stores in a safe and private environment.

[0627] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0628] Step 1: Identity Verification

[0629] The user launches the app on a device such as a smartphone or tablet and holds their official authentication information (e.g., My Number Card) over the device's reader. The device securely transmits this information to a server using encryption technology. The server verifies the user's identity by comparing it with the official authentication database. The result is sent back to the device and displayed to the user.

[0630] (Input: Official authentication information, Output: Identity verification result)

[0631] Step 2: Upload a photo and convert it to 2.5D.

[0632] The user uploads a profile picture on the profile creation screen. The device sends the picture to the server, which uses image processing technology and a generative AI model (e.g., TensorFlow) to transform the picture into a 2.5-dimensional image. The generated image is stored in a database and reflected in the user's profile.

[0633] (Input: facial photograph, Output: 2.5-dimensional facial image)

[0634] Step 3: Enter and submit profile information

[0635] The user enters profile information such as hobbies, personality, and interests into the device. The device sends this information to the server, which stores it in a database.

[0636] (Input: Profile information, Output: Sending to server complete)

[0637] Step 4: Compatibility assessment and emotional analysis

[0638] The server generates matching candidates using a compatibility assessment engine (ChatGPT-based) based on the user's profile information. Simultaneously, an emotion engine analyzes the user's profile information and past behavioral data to determine their emotional state. The results of the compatibility assessment and emotion analysis are combined to select the most suitable matching candidate.

[0639] (Input: Profile information, Output: Matching candidate list)

[0640] Step 5: Activities within the virtual store

[0641] Users access the virtual space of a virtual store at a time they specify. An emotion engine analyzes the user's emotions in real time and recommends appropriate products and activities. Artificial intelligence technology (ChatGPT) is used to analyze chats and messages between users and provide appropriate responses and communication support.

[0642] (Input: Real-time sentiment data, Output: Product recommendations and activity suggestions)

[0643] Step 6: Communication Support

[0644] When a user chats or makes a statement in the virtual space, the terminal sends the content to the server, where AI analyzes it and generates an appropriate response. An emotion engine also analyzes the content simultaneously, suggesting responses based on the user's emotional state. This facilitates smooth communication between users.

[0645] (Input: Chat message, Output: AI response)

[0646] By following the steps outlined above, users can enjoy safe and personalized shopping and communication within the virtual store.

[0647] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0648] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0649] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0650] [Second Embodiment]

[0651] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0652] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0653] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0654] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0655] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0656] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0657] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0658] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0659] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0660] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0661] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0662] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0663] This invention relates to a system that includes identity verification using public authentication information, 2.5-dimensional rendering of facial photographs using image processing technology, a compatibility diagnosis engine, a metaverse dating function, and communication support using artificial intelligence technology.

[0664] 1. Implementation of Identity Verification

[0665] The user installs and launches the app. The device requests the reading of official authentication information (e.g., My Number Card). The user holds their My Number Card over the device's reader. The device encrypts the information it reads and sends it to the server. The server verifies the user's identity by comparing it against the official authentication database. The verification result is sent back to the device and displayed to the user.

[0666] As a concrete example, the user opens the app and selects "Identity Verification." The device displays "Please read your card," and the user holds their My Number Card over the reader. The device sends the read information to a server and verifies it against a public database. If successful, "Identity verification complete" is displayed.

[0667] 2. Embodiment of 2.5D rendering of facial photographs

[0668] The user uploads a profile picture on their profile screen. The device sends the photo to a server for image processing, and an image generation AI connected to the server performs 2.5D conversion. The generated 2.5D image is saved on the server and displayed on the user's profile.

[0669] As a concrete example, a user opens the profile editing screen, selects a profile picture, and presses the upload button. The device automatically sends the photo to the server, and the image generation AI begins processing. Once processing is complete, a 2.5D image is reflected in the user's profile.

[0670] 3. Implementation of Compatibility Diagnosis

[0671] The user enters information such as their hobbies, personality, and interests. The device sends this information to the server, and a ChatGPT-based compatibility engine generates matching candidates. A list of candidates is sent back to the device and displayed to the user.

[0672] As a concrete example, a user opens the "Hobbies & Interests" tab and fills in details about their hobbies and personality. After completing the input, they press the "Compatibility Test" button, the device sends the information, and a list of compatible candidates is displayed a few seconds later.

[0673] 4. Embodiment of Metaverse Date

[0674] Based on the compatibility test results, the user sets up a date in the metaverse. The device sends the set date, time, and location to the server, and a virtual session is established. The user accesses the virtual space at the set time and interacts with other users.

[0675] As a concrete example, the user selects a partner from a list of candidates and sets the date, time, and location for the metaverse date. After the setup is complete, the device displays a confirmation message and sends a reminder notification on the day of the date. The user then accesses the virtual space and enjoys the virtual date.

[0676] 5. Implementation Examples of Communication Support

[0677] When a user sends a message to someone, the device sends the content to the server, and AI generates an appropriate reply. The suggested reply is displayed on the device, and the user reviews, modifies, and sends it.

[0678] As a concrete example, a user types a message in the chat screen and presses the send button. The device sends the message to the AI, and after a few seconds, the AI ​​generates a reply. The device displays reply options to the user, who then selects and sends the reply.

[0679] Through the above configuration, the present invention simultaneously provides safety, privacy protection, matching accuracy, and a virtual dating experience, thereby achieving its objectives.

[0680] The following describes the processing flow.

[0681] Identity verification process

[0682] Step 1:

[0683] The user installs the matching app and launches it.

[0684] Step 2:

[0685] The terminal displays an interface requesting the user to read their My Number Card.

[0686] Step 3:

[0687] The user holds their My Number Card over the terminal's reader.

[0688] Step 4:

[0689] The device reads the information from the My Number Card and encrypts the acquired data.

[0690] Step 5:

[0691] The device sends encrypted card information to the server.

[0692] Step 6:

[0693] The server sends the received information to a public authentication database to perform identity verification.

[0694] Step 7:

[0695] The server generates the result of the identity verification (success or failure) and sends it back to the device.

[0696] Step 8:

[0697] The device displays the results of the identity verification to the user.

[0698] Profile creation process

[0699] Step 1:

[0700] The user opens the profile creation screen.

[0701] Step 2:

[0702] The user selects a photo of their face and presses the upload button.

[0703] Step 3:

[0704] The device sends the selected facial image to the image generation AI and requests 2.5-dimensional processing.

[0705] Step 4:

[0706] An image generation AI connected to the server processes facial images by converting them into 2.5D.

[0707] Step 5:

[0708] The server saves the generated 2.5D image to a database and links it to the user ID.

[0709] Step 6:

[0710] The server sends a URL for the 2.5D image back to the terminal and displays it to the user.

[0711] Compatibility assessment process

[0712] Step 1:

[0713] The user enters their profile information (hobbies, personality, interests, etc.).

[0714] Step 2:

[0715] The device sends the entered profile information to the server.

[0716] Step 3:

[0717] The server passes the profile information stored in the ChatGPT-based compatibility engine.

[0718] Step 4:

[0719] The server performs a compatibility check and generates a list of matching candidates.

[0720] Step 5:

[0721] The server sends a list of potential matches back to the terminal and displays it to the user.

[0722] Metaverse dating process

[0723] Step 1:

[0724] Users select someone they are interested in based on compatibility test results and set the time and place for a metaverse date.

[0725] Step 2:

[0726] The device sends information about the set time and location to the server.

[0727] Step 3:

[0728] The server sets up a dating session in a virtual space and saves the necessary data to the database.

[0729] Step 4:

[0730] The user logs in to access the virtual space at a time they have set.

[0731] Step 5:

[0732] The server authenticates access and sends the data necessary for the virtual space dating session.

[0733] Step 6:

[0734] Users enjoy dating other users in a virtual space.

[0735] Communication support process

[0736] Step 1:

[0737] The user enters a message in the chat screen.

[0738] Step 2:

[0739] The terminal sends the entered message to the server.

[0740] Step 3:

[0741] The server passes the message content to the AI ​​engine, which then generates appropriate replies and other responses.

[0742] Step 4:

[0743] The server sends the generated reply message to the terminal.

[0744] Step 5:

[0745] The device displays the reply to the user and asks for confirmation or correction.

[0746] Step 6:

[0747] The user sends the revised message and continues the chat.

[0748] (Example 1)

[0749] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0750] In modern online dating and communication systems, user identity verification, privacy protection, advanced compatibility assessment, virtual dating experiences, and communication support are critical challenges. In particular, there is a need to simultaneously provide secure handling of personal information and a realistic virtual experience. Currently, no system exists that integrates these functions, resulting in user inconvenience.

[0751] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0752] In this invention, the server includes means for verifying the user's identity using public authentication information, means for converting the user's facial image into 2.5 dimensions using image processing technology, means for maintaining a database containing the generated facial image and the user's profile information, means for selecting other compatible users based on the user's hobbies and personality information, means for enabling selected users to date in a virtual space, means for using artificial intelligence technology to support communication between users, means including technology for encrypting user input information and transmitting it to the server, means for the server to compare the information entered by the user with a public authentication database, means for transmitting a facial image to the server and for the server to convert it into 2.5 dimensions using image generation AI, means for a compatibility diagnosis engine to generate compatible matching candidates from user data, means for setting up a virtual space session and connecting users, and means for the server to analyze the message content with AI and generate an appropriate reply. This makes it possible for users to enjoy matching and communication to a high degree in a safe and privacy-protected environment.

[0753] "Official authentication information" refers to information issued by the government or public institutions to prove an individual's identity.

[0754] A "user" refers to an individual user who utilizes the system, and is the entity that performs various operations through a terminal.

[0755] A "terminal" is an electronic device that a user operates to input and display information, and includes smartphones and personal computers.

[0756] A "server" is a computer device that forms the core of a system, processing and storing data, and communicating with other terminals.

[0757] A "face photo" is image data of the user's own face.

[0758] "Image processing technology" refers to all technologies used to analyze and process image data such as photographs and videos.

[0759] "2.5-dimensionalization" is a technique that adds depth and a sense of three-dimensionality to two-dimensional image data, processing it to make it appear nearly three-dimensional.

[0760] "Profile information" refers to information that includes data such as the individual user's characteristics, attributes, and interests.

[0761] A "database" is an electronic data storage system for systematically storing and managing information.

[0762] "Hobbies and personality information" refers to information that represents a user's everyday interests and personality traits.

[0763] "Compatibility assessment" is a process that evaluates how well a user is compatible with other users based on their hobbies and personality information.

[0764] A "virtual space" is a digital space created with computer graphics that, while not real, offers a sense of realism.

[0765] "Going on a date" refers to an activity where selected users meet and interact with each other in a virtual space.

[0766] "Communication support" refers to technologies and systems that facilitate the exchange of messages between users.

[0767] "Artificial intelligence technology" refers to technology that imitates human intelligence and possesses functions such as learning, reasoning, and problem-solving.

[0768] "Encryption" is a technology that transforms information using a specific algorithm, making it incomprehensible to third parties.

[0769] A "compatibility diagnosis engine" is a general term for algorithms and systems that select other users who are compatible with the user based on the user's input information.

[0770] A "session" refers to a series of activities or periods in which a user utilizes a system or service.

[0771] "Generating a reply" refers to the process of creating an appropriate response to a received message.

[0772] This invention is an integrated system that enables identity verification using public authentication information, 2.5-dimensional rendering of facial images, compatibility diagnosis, metaverse dating, and communication support. Specific embodiments of this system are described below.

[0773] Implementation method of identity verification

[0774] First, the user installs and launches the app. The device prompts the user to read official authentication information (e.g., My Number Card). When the user holds the My Number Card over the device's reader, the device encrypts the information it reads and sends it to the server. The server verifies the user's identity by comparing it with the public authentication database, sends the result back to the device, and displays it to the user. As a specific example, the user launches the app, selects "Identity Verification," and holds the My Number Card over the reader. The device sends the encrypted information to the server, which is then compared with the public database. If successful, "Identity verification complete" is displayed.

[0775] Embodiment of 2.5D rendering of facial photographs

[0776] The user uploads a profile picture on their profile screen. The device sends the photo to a server, where a generative AI connected to the server performs a 2.5-dimensional transformation. The generated 2.5-dimensional image is stored on the server and displayed on the user's profile. For example, the user selects a profile picture on the profile editing screen and presses the upload button. The device sends the photo to the server, and the image generation AI performs the 2.5-dimensional transformation. Once the process is complete, the image is displayed on the user's profile.

[0777] Compatibility assessment method

[0778] The user enters information such as hobbies, personality, and interests within the app. The device sends this information to a server, and a ChatGPT-based compatibility engine generates matching candidates. The generated candidate list is sent back to the device and displayed to the user. For example, the user opens the "Hobbies & Interests" tab, enters information, and runs the "Compatibility Test." The device sends the information to the server, and a list of compatible candidates is displayed a few seconds later.

[0779] Metaverse Date Implementation

[0780] Based on compatibility test results, the user sets up a date in the metaverse. The device sends the set date, time, and location information to the server, and the server sets up a virtual session. The user accesses the virtual space at the set time and interacts with other users. For example, the user selects a partner from a candidate list and sets the date, time, and location for the metaverse date. The device displays a confirmation message and sends a reminder notification as the time approaches. At the set time, the user accesses the virtual space and enjoys the virtual date.

[0781] Implementation Examples of Communication Support

[0782] When a user types a message to another person, the device sends the message to a server, and AI generates an appropriate reply. The suggested reply is displayed on the device, and the user reviews or modifies it before finally sending it. For example, a user types a message in the chat screen and presses the send button. The device sends the message to the server, and after a few seconds, the AI ​​generates a reply. The device displays the suggested reply options to the user, who then reviews and sends it.

[0783] Example prompts for a generative AI model

[0784] The following are examples of prompt statements related to a series of processes:

[0785] Prompt message regarding identity verification:

[0786] Please explain the step-by-step process for users to authenticate their identity by holding their My Number Card over a reader.

[0787] Prompt message regarding 2.5D conversion of facial images:

[0788] Please provide a detailed explanation of the processing flow for converting a user's profile picture to 2.5D.

[0789] Prompt message regarding compatibility assessment:

[0790] Please describe the process by which users input information about their hobbies and interests to perform a compatibility assessment.

[0791] Prompt message regarding metaverse dating:

[0792] Please provide detailed instructions on how users can set up and enjoy a metaverse date.

[0793] Prompt messages regarding communication support:

[0794] Please describe in detail the process by which AI is used to generate replies when a user sends a message.

[0795] In the above configuration, the present invention enables users to receive multiple high-performance services in a safe and privacy-protected environment. This significantly improves user convenience and enhances overall satisfaction.

[0796] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0797] Implementation method of identity verification

[0798] Step 1:

[0799] The user installs and launches the app.

[0800] Input: App installation and launch operations.

[0801] Output: The app launches and the initial screen is displayed.

[0802] Specifically, the user downloads the app from their smartphone's app store and completes the installation. After installation, the user taps the app icon to launch the app.

[0803] Step 2:

[0804] The device requests to read public authentication information.

[0805] Input: Initial screen after launching the app.

[0806] Output: A screen prompting the preparation of official authentication information.

[0807] Specifically, the device will display the message "Please have your My Number Card ready" on the screen.

[0808] Step 3:

[0809] The user holds their My Number Card over the terminal's reader.

[0810] Input: User's My Number Card.

[0811] Output: Data that the device reads from public authentication information.

[0812] Specifically, the user holds their My Number Card over the NFC reader on the terminal. The terminal scans the information on the card and converts it into digital data.

[0813] Step 4:

[0814] The device encrypts the information it reads and sends it to the server.

[0815] Input: Public authentication information read from the document.

[0816] Output: Encrypted public authentication information.

[0817] Specifically, the terminal encrypts the data using AES256 and sends it to the server using the HTTPS protocol.

[0818] Step 5:

[0819] The server verifies the user's identity by matching them against a public authentication database.

[0820] Input: Encrypted public authentication information.

[0821] Output: Matching result.

[0822] Specifically, the server decrypts the received data and accesses a public authentication database to perform verification.

[0823] Step 6:

[0824] The server sends the verification result back to the terminal and displays it to the user.

[0825] Input: Matching result.

[0826] Output: Display of identity verification results.

[0827] Specifically, the server sends the verification result back to the terminal, and the terminal displays "Identity verification complete."

[0828] Embodiment of 2.5D rendering of facial photographs

[0829] Step 1:

[0830] The user uploads a profile picture on their profile screen.

[0831] Input: User's profile picture.

[0832] Output: Upload instruction.

[0833] Specifically, the user presses the "Select Photo" button on the profile editing screen, selects a photo of their face from their smartphone's gallery, and uploads it.

[0834] Step 2:

[0835] The device sends the photo data to the server.

[0836] Input: User's profile picture.

[0837] Output: Sending photo data to the server.

[0838] Specifically, the terminal compresses the selected image data and sends it to the server in JPEG format.

[0839] Step 3:

[0840] The generation AI connected to the server performs the 2.5-dimensional transformation.

[0841] Input: Face photo data.

[0842] Output: 2.5-dimensional image data.

[0843] Specifically, the server receives a facial image, passes it to an image generation AI (such as StyleGAN), and performs a 2.5-dimensional transformation.

[0844] Step 4:

[0845] The server saves the generated 2.5D image, sends it back to the terminal, and displays it to the user.

[0846] Input: 2.5-dimensional image.

[0847] Output: The image displayed in the user's profile.

[0848] Specifically, the server saves the generated image to a database and sends it to the terminal. The terminal receives the image and displays it in the user's profile.

[0849] Compatibility assessment method

[0850] Step 1:

[0851] Users enter information such as their hobbies, personality, and interests.

[0852] Input: Hobbies, personality, and interests.

[0853] Output: Input completion information.

[0854] In terms of specific actions, the user enters information into a form on the app's "Hobbies & Interests" tab (e.g., watching movies, reading, traveling, etc.).

[0855] Step 2:

[0856] The device sends this information to the server.

[0857] Input: Hobbies, personality, and interests.

[0858] Output: Sending information to the server.

[0859] Specifically, the terminal sends the input data to the server in JSON format.

[0860] Step 3:

[0861] A compatibility diagnostic engine connected to the server generates matching candidates.

[0862] Input: User information.

[0863] Output: Matching candidate list.

[0864] Specifically, the server launches a ChatGPT-based compatibility assessment engine and lists compatible candidates based on the information received.

[0865] Step 4:

[0866] The server sends a list of matching candidates back to the terminal and displays it to the user.

[0867] Input: Matching candidate list.

[0868] Output: Display of candidate list.

[0869] Specifically, the server sends a list of candidates to the terminal, and the terminal displays it on the user's screen.

[0870] Metaverse Date Implementation

[0871] Step 1:

[0872] Users set up dates in the metaverse based on their compatibility test results.

[0873] Input: Compatibility test results, date settings.

[0874] Output: Configuration details.

[0875] Specifically, the user selects a partner from a list of candidates and sets the date, time, and location for the date.

[0876] Step 2:

[0877] The device sends information about the configured date, time, and location to the server.

[0878] Input: Date settings information.

[0879] Output: Sending configuration information to the server.

[0880] Specifically, the device sends configuration information to the server.

[0881] Step 3:

[0882] The server sets up a session in the virtual space.

[0883] Input: Date settings information.

[0884] Output: URL and access information for the virtual space session.

[0885] Specifically, the server creates a virtual session at the specified date and time and generates access information.

[0886] Step 4:

[0887] Users access the virtual space at a set date and time and interact with other users.

[0888] Input: Access information for the virtual space.

[0889] Output: Interaction in a virtual space.

[0890] In concrete terms, the user accesses a virtual space and interacts with others through conversation and avatar control.

[0891] Implementation Examples of Communication Support

[0892] Step 1:

[0893] The user enters a message for the other party.

[0894] Input: Message content.

[0895] Output: Ready to send.

[0896] Specifically, the user types a message in the chat screen and presses the send button.

[0897] Step 2:

[0898] The terminal sends a message to the server.

[0899] Input: Message content.

[0900] Output: Sending a message to the server.

[0901] Specifically, the terminal sends a message to the server.

[0902] Step 3:

[0903] The AI ​​on the server generates an appropriate response.

[0904] Input: User's message.

[0905] Output: Generated reply suggestions.

[0906] Specifically, the AI ​​on the server (e.g., ChatGPT) analyzes the received message and generates a reply.

[0907] Step 4:

[0908] The server sends the suggested reply back to the terminal, and the user reviews, corrects, and submits it.

[0909] Input: Generated reply suggestions.

[0910] Output: Sending the final reply.

[0911] Specifically, the server sends the generated reply options to the terminal, which then displays them to the user. The user reviews the reply, makes any necessary corrections, and then sends it.

[0912] The above outlines the specific steps involved in each program process of this system.

[0913] (Application Example 1)

[0914] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0915] Traditional dating applications lacked sufficient identity verification, privacy protection, and compatibility assessment features, resulting in a lack of trust and security for users. Furthermore, systems offering virtual dating and adventure experiences often suffered from inadequate device integration and communication support, diminishing the real-world interaction experience.

[0916] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0917] This invention includes a server that provides means for verifying the user's identity using public authentication information, means for transforming the user's facial photograph into a 2.5-dimensional image using image processing technology, means for maintaining a database containing the generated facial image and the user's profile information, means for selecting compatible users based on the user's hobbies and personality information, means for enabling selected users to date in a virtual space, means for using artificial intelligence technology to support communication between users, and means for providing virtual dating and adventures via smartphones and head-mounted displays. As a result, users can receive reliable identity verification in a safe and private environment, and enjoy a near-realistic virtual experience through smartphones and head-mounted displays while receiving advanced communication support using AI.

[0918] "Official authentication information" refers to information issued by public institutions and used to verify an individual's identity.

[0919] "Identity verification" is the process of confirming that a user is indeed who they claim to be, using official authentication information.

[0920] "2.5-dimensionalization" is a process that uses image processing technology to add some three-dimensional elements to a flat, two-dimensional image of a user's face, giving it a sense of depth.

[0921] "Profile information" refers to data that includes basic user information, such as facial images, hobbies, and personality.

[0922] "Compatibility assessment" is a process that selects other users who are compatible with the user based on the hobbies and personality information entered by the user.

[0923] A "virtual space" is a digital, three-dimensional environment created by a computer, where users interact through avatars.

[0924] "Artificial intelligence technology" refers to technology that enables computers to possess knowledge and skills like humans, and to perform tasks such as learning, reasoning, and judgment.

[0925] A "head-mounted display" is a display device worn on the user's head, used to visually experience a virtual space.

[0926] This invention relates to a virtual entertainment application that allows users to enjoy dating and adventures in a virtual space. This application has a variety of functions, including identity verification, 2.5D rendering of facial images, compatibility diagnosis, metaverse dating, and AI-powered communication support.

[0927] The server performs identity verification using public authentication information. When a user launches a smartphone application and reads their public authentication information (e.g., My Number Card), the information is encrypted and sent to the server. The server verifies the user's identity by comparing it with a public database, and then sends the result back to the device for display to the user.

[0928] Next, image processing is performed to convert the user's facial image into a 2.5D image. When a user uploads a facial image on their profile screen, the image is sent to the server. An image generation AI connected to the server processes the facial image and generates a 2.5D image. The generated image is stored on the server and displayed on the user's profile.

[0929] Subsequently, a compatibility assessment is conducted based on the user's hobbies and personality information. When the user enters information about their hobbies and personality, that information is sent to the server. A ChatGPT-based compatibility assessment engine analyzes the information and selects other compatible users. The list of selected candidates is returned to the device and displayed to the user.

[0930] Selected users can arrange dates in a virtual space. Once users set the date, time, and location for a metaverse date, that information is sent to the server, and a virtual space session is established. Users can access the virtual space at the scheduled time and enjoy dates and adventures with other users. This can be done using smartphones or head-mounted displays.

[0931] Furthermore, artificial intelligence technology is used to support communication between users. When a user sends a chat or voice message, its content is sent to the server. The AI ​​generates an appropriate reply, and the suggestion is displayed on the user's device. The user can review, modify, and send the suggested reply.

[0932] As a concrete example, by inputting the following prompt sentences into the AI ​​model, it is possible to provide specific guidance on how the user should use the application:

[0933] Design a virtual entertainment app that allows users to set up dates using 2.5D avatars in a virtual space. The system will include identity verification using public authentication information, 2.5D rendering of facial images using image processing technology, a compatibility diagnosis engine, a metaverse dating function, and communication support using artificial intelligence technology. Technologies to be used: face_recognition, OpenCV, PIL, requests, Python.

[0934] Thus, this invention is a comprehensive system that allows users to enjoy virtual dating and adventure experiences in a safe and reliable environment.

[0935] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0936] Step 1:

[0937] The user launches the application and reads their public authentication information. The user holds their My Number Card over the reader on their smartphone. This input reads the user's public authentication information. The device encrypts the read information and sends it to the server. In this process, the data is encrypted before transmission, ensuring security.

[0938] Step 2:

[0939] The server compares the received public authentication information with a public database. Based on the comparison, it determines whether or not identity verification is successful and sends the result back to the terminal. The information sent back includes whether or not authentication was successful. The terminal displays the result to the user, and identity verification is completed.

[0940] Step 3:

[0941] The user uploads a profile picture on their profile screen. This input sends the image data of the profile picture from the device to the server. An image generation AI connected to the server processes the received image data to generate a 2.5D image. This process transforms a flat 2D image into a three-dimensional 2.5D image. The generated image is saved on the server and displayed on the user's profile.

[0942] Step 4:

[0943] The user enters information about their hobbies and personality to begin the compatibility assessment. This input data is sent from the terminal to the server. A ChatGPT-based compatibility assessment engine connected to the server analyzes the user's information and selects other compatible users. This analysis generates a list of users that match the user's hobbies and personality. The selected list of candidates is sent back to the terminal and displayed to the user.

[0944] Step 5:

[0945] The user sets the date, time, and location for the metaverse date. This setting information is sent from the device to the server. The server uses this information to set up the virtual space session. This process prepares the virtual date. At the set date and time, the user accesses the virtual space using a smartphone or head-mounted display and enjoys the date.

[0946] Step 6:

[0947] When a user communicates with another user, they input messages or voice data. The input data is sent from the device to a server, which uses AI to generate appropriate replies. This process enables natural conversation. The generated reply is sent back to the device and displayed to the user. The user can review, modify, and send the suggested reply.

[0948] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0949] This invention relates to a system that combines identity verification using public authentication information, 2.5-dimensional rendering of facial photographs using image processing technology, a compatibility diagnosis engine, a metaverse date function, communication support using artificial intelligence technology, and an emotion engine.

[0950] 1. Implementation of Identity Verification

[0951] The user installs and launches the app. The device displays an interface requesting the reading of public authentication information, and the user holds their authentication card over the reader. The device encrypts the information it reads and sends it to the server. The server verifies the user's identity using the public authentication database and sends the result back to the device. The device displays the authentication result to the user.

[0952] As a concrete example, a user opens the app, selects "Identity Verification," and holds their My Number Card over the device. The device reads the information, encrypts it, sends it to the server, and after matching it with a public database, displays "Identity verification complete."

[0953] 2. Embodiment of 2.5D rendering of facial photographs

[0954] The user uploads a photo of their face on the profile creation screen. The device sends the photo to the server, where an image generation AI transforms it into a 2.5D image. The generated image is stored on the server and displayed on the user's profile.

[0955] As a concrete example, a user selects a photo of their face and presses the upload button. The device sends the photo to the server, and an image generation AI generates a 2.5D image. The generated image is then reflected in the user's profile.

[0956] 3. Implementation of Compatibility Diagnosis

[0957] The user enters profile information such as hobbies, personality, and interests. The device sends this information to the server, and a ChatGPT-based compatibility engine generates matching candidates. The candidate list is sent back to the device and displayed to the user. Additionally, an emotion engine recognizes the user's emotions and reflects them in the diagnosis results.

[0958] As a concrete example, a user enters detailed profile information and starts a "compatibility test." The device sends the information to the server, the compatibility test engine generates a list of candidates, the emotion engine analyzes the user's emotions, and the most suitable list of candidates is displayed.

[0959] 4. Embodiment of Metaverse Date

[0960] The user sets the time and place for a date based on the compatibility assessment results. The device sends the setting information to the server, and a virtual dating session is set up. The user accesses the virtual space at the specified time and interacts with other users. The emotion engine analyzes the user's emotions in real time and suggests appropriate dating scenarios and activities.

[0961] As a concrete example, the user selects a partner from a candidate list and sets the date, time, and location for the metaverse date. The device sends the information to the server and sends a reminder notification on the day of the date. The user accesses the virtual space, and during the date, an emotion engine analyzes the user's emotions and suggests the most suitable activities.

[0962] 5. Implementation Examples of Communication Support

[0963] When a user sends a message, the device sends the content to the server, and the AI ​​generates an appropriate reply. The generated reply is displayed on the device, and the user reviews, modifies, and sends it. In addition, the emotion engine analyzes the message content and the user's facial expressions to suggest an appropriate response based on their emotions.

[0964] As a concrete example, a user types and sends a message in the chat screen. The device sends the message to the server, and the AI ​​generates a reply. The emotion engine analyzes the message content and the user's emotions, and an appropriate reply is displayed on the device. The user then modifies and sends the reply.

[0965] Through the above configuration, the present invention simultaneously provides reliable identity verification, privacy protection, and compatibility diagnosis and communication support utilizing emotion recognition, thereby realizing a safe and effective matching experience.

[0966] The following describes the processing flow.

[0967] Identity verification process

[0968] Step 1:

[0969] The user installs the matching app and launches it.

[0970] Step 2:

[0971] The terminal displays an interface requesting the user to read their My Number Card.

[0972] Step 3:

[0973] The user holds their My Number Card over the terminal's reader.

[0974] Step 4:

[0975] The device reads the information from the My Number Card and encrypts the acquired data.

[0976] Step 5:

[0977] The device sends encrypted card information to the server.

[0978] Step 6:

[0979] The server sends the received information to a public authentication database to perform identity verification.

[0980] Step 7:

[0981] The server generates the result of the identity verification (success or failure) and sends it back to the device.

[0982] Step 8:

[0983] The device displays the results of the identity verification to the user.

[0984] Profile creation process

[0985] Step 1:

[0986] The user opens the profile creation screen.

[0987] Step 2:

[0988] The user selects a photo of their face and presses the upload button.

[0989] Step 3:

[0990] The device sends the selected facial image to the image generation AI and requests 2.5-dimensional processing.

[0991] Step 4:

[0992] An image generation AI connected to the server processes facial images by converting them into 2.5D.

[0993] Step 5:

[0994] The server saves the generated 2.5D image to a database and links it to the user ID.

[0995] Step 6:

[0996] The server sends a URL for the 2.5D image back to the terminal and displays it to the user.

[0997] Compatibility assessment process

[0998] Step 1:

[0999] The user enters their profile information (hobbies, personality, interests, etc.).

[1000] Step 2:

[1001] The device sends the entered profile information to the server.

[1002] Step 3:

[1003] The server passes the registered profile information to a ChatGPT-based compatibility assessment engine.

[1004] Step 4:

[1005] The server performs a compatibility check and generates a list of matching candidates.

[1006] Step 5:

[1007] The server sends a list of potential matches back to the terminal and displays it to the user.

[1008] Step 6:

[1009] The server uses an emotion engine to recognize the user's emotions and reflect them in the diagnostic results.

[1010] Metaverse dating process

[1011] Step 1:

[1012] Users select someone they are interested in based on compatibility test results and set the time and place for a metaverse date.

[1013] Step 2:

[1014] The device sends information about the set time and location to the server.

[1015] Step 3:

[1016] The server sets up a dating session in a virtual space and saves the necessary data to the database.

[1017] Step 4:

[1018] The user logs in to access the virtual space at a time they have set.

[1019] Step 5:

[1020] The server authenticates access and sends the data necessary for the virtual space dating session.

[1021] Step 6:

[1022] Users enjoy dating other users in a virtual space.

[1023] Step 7:

[1024] The server uses an emotion engine to analyze the user's emotions in real time and suggest appropriate dating scenarios and activities.

[1025] Communication support process

[1026] Step 1:

[1027] The user enters a message in the chat screen.

[1028] Step 2:

[1029] The terminal sends the entered message to the server.

[1030] Step 3:

[1031] The server passes the message content to the AI ​​engine, which then generates appropriate replies and other responses.

[1032] Step 4:

[1033] The server sends the generated reply message to the terminal.

[1034] Step 5:

[1035] The device displays the reply to the user and asks for confirmation or correction.

[1036] Step 6:

[1037] The user sends the revised message and continues the chat.

[1038] Step 7:

[1039] The server uses an emotion engine to analyze the message content and the user's facial expressions, and then suggests an appropriate response based on those emotions.

[1040] (Example 2)

[1041] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[1042] While online matching systems have become commonplace in modern society, they face numerous challenges in terms of protecting user privacy, accurate identity verification, secure information transmission, and communication support. For example, traditional systems have a high risk of users' personal information being leaked to third parties, and suffer from low accuracy in compatibility assessments and poor communication quality. Furthermore, virtual interactions lack real-time emotion recognition and optimal activity suggestions, resulting in insufficient improvements to the user experience. There is a need to solve these problems and provide safer and more reliable online matching systems.

[1043] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1044] In this invention, the server includes means for verifying the user's identity using public authentication information; means for creating a 2.5-dimensional representation of the user's facial image using image processing technology; means for maintaining a database containing the generated facial image and the user's profile information; means for selecting compatible users based on the user's hobbies and personality information; means for enabling the selected users to interact with each other in a virtual space; means for using artificial intelligence technology to support communication between users; means for analyzing the user's emotions using an emotion analysis engine and reflecting this in the diagnosis results and interaction content; means for securely transmitting authentication information using encryption technology; and means for analyzing the user's activities in the virtual space in real time and suggesting optimal actions. This enables accurate identity verification and secure information transmission while protecting user privacy, and also realizes emotion recognition and optimal activity suggestions to improve the user experience.

[1045] "Official authentication information" refers to authentication information issued by a public institution that is used to verify the user's identity. Examples include My Number cards and driver's licenses.

[1046] "2.5-dimensionalization" is a process that adds depth information to conventional 2D images, giving them a pseudo-three-dimensional appearance. This makes the image appear more three-dimensional.

[1047] "User profile information" refers to information such as hobbies, personality, and interests that users enter, and is used for matching and providing personalized services.

[1048] "Selecting compatible other users" means identifying other users who are deemed to be mutually compatible, based on user profile information and using statistical or learning models.

[1049] A "virtual space" is a three-dimensional virtual environment created by a computer, a space in which users can interact with each other.

[1050] "Artificial intelligence technology" refers to technologies that allow computers to mimic the workings of human intelligence, and includes natural language processing, machine learning, and deep learning.

[1051] An "emotion analysis engine" is an algorithm or software that analyzes a user's facial expressions and message content to estimate their emotional state.

[1052] "Encryption technology" is a technique that transforms transmitted information so that it cannot be read by a third party, and is used for secure information transmission. Examples of encryption methods include AES and RSA.

[1053] "Suggesting the optimal action" means analyzing the user's activities and emotional state and presenting the most appropriate action or option in real time. This improves the user experience.

[1054] Modes for carrying out the invention

[1055] This invention relates to a system that combines identity verification using public authentication information, 2.5-dimensional rendering of facial images using image processing technology, a compatibility diagnosis engine, a virtual space interaction function, communication support using artificial intelligence technology, and an emotion analysis engine. The configuration and operation for realizing each of these technological elements with specific hardware and software will be described in detail below.

[1056] Implementation method of identity verification

[1057] The user installs and launches a dedicated application. The application displays an interface for reading official authentication information using the authentication card reader built into the device. Examples include My Number cards and driver's licenses. When the user holds the authentication card over the reader, the device encrypts the information using AES encryption and sends it to the server. The server accesses the public authentication database, verifies the user's identity, and sends the result back to the device. The device then displays the authentication result to the user.

[1058] Embodiment of 2.5D rendering of facial photographs

[1059] The user uploads a profile picture on the profile creation screen. The device sends the photo to the server, where a generative AI model (e.g., StyleGAN) is used to convert it into a 2.5-dimensional image. The generated image is stored in the server's database and reflected in the user's profile.

[1060] Compatibility assessment method

[1061] The user enters profile information such as hobbies, personality, and interests. The device sends this information to the server, and a ChatGPT-based compatibility engine generates matching candidates. Furthermore, an emotion analysis engine recognizes the user's emotions and reflects them in the diagnosis results, creating a more accurate candidate list. Finally, the candidate list is displayed to the user.

[1062] Implementation of interaction in virtual space

[1063] The user sets the time and place for a date based on the compatibility assessment results. The device sends this setting information to the server, and a virtual dating session is set up. When the user accesses the virtual space at the specified date and time, they can interact with other users. An emotion analysis engine analyzes the user's emotions in real time and suggests appropriate dating scenarios and activities.

[1064] Implementation Examples of Communication Support

[1065] When a user sends a message, the device sends its content to the server, and the AI ​​generates an appropriate reply. The generated reply is displayed on the device, and the user reviews, modifies, and sends it. In addition, an emotion analysis engine analyzes the message content and the user's facial expressions to suggest an appropriate response based on their emotions.

[1066] Examples of specific cases and prompt statements

[1067] The following are specific examples of the system of the present invention.

[1068] Examples of identity verification:

[1069] The user opens the app, selects "Identity Verification," and holds their My Number Card over the reader. The device reads the information, encrypts it, sends it to the server, and after matching it with the public database, displays "Identity verification complete."

[1070] Examples of prompts for a generative AI model:

[1071] "The user sets the date, time, and location for a metaverse date, and the device sends this information to the server. The user accesses the metaverse at the specified time and begins dating other users. The sentiment analysis engine should analyze the user's emotions and suggest the most suitable activities."

[1072] This invention is a system that prioritizes user privacy protection and provides a superior user experience by combining accurate identity verification, secure information transmission, highly accurate compatibility assessment, and real-time sentiment analysis.

[1073] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1074] Implementation method of identity verification

[1075] Step 1:

[1076] The user launches the app.

[1077] Input: Tap the application icon or touch the screen.

[1078] Output: Startup screen displayed

[1079] Step 2:

[1080] The device displays an interface requesting the reading of public authentication information.

[1081] Input: Application initialization information

[1082] Output: Display of the My Number Card or driver's license reading screen.

[1083] Step 3:

[1084] The user holds their authentication card over the reader.

[1085] Input: Authentication card (My Number Card or driver's license)

[1086] Output: Read authentication information

[1087] Step 4:

[1088] The device encrypts the information it reads and sends it to the server.

[1089] Input: Authentication information

[1090] Data processing: Apply AES encryption.

[1091] Output: Encrypted credentials

[1092] Step 5:

[1093] The server uses a public authentication database to verify the user's identity.

[1094] Input: Encrypted credentials

[1095] Data processing: Database matching

[1096] Output: Authentication result (success / failure)

[1097] Step 6:

[1098] The server sends the results back to the terminal.

[1099] Input: Authentication result

[1100] Output: Sending results to the terminal

[1101] Step 7:

[1102] The device displays the authentication result to the user.

[1103] Input: Authentication result

[1104] Output: Display of authentication result screen (e.g., "Identity verification complete," "Identity verification failed")

[1105] Embodiment of 2.5D rendering of facial photographs

[1106] Step 1:

[1107] The user accesses the profile creation screen.

[1108] Input: Menu Selection

[1109] Output: Display of the profile creation screen

[1110] Step 2:

[1111] The user uploads a photo of their face.

[1112] Input: Face photo file

[1113] Output: Photo selection and preparation for uploading.

[1114] Step 3:

[1115] The device sends the photo to the server.

[1116] Input: Uploaded profile picture

[1117] Output: Sending photo data to the server

[1118] Step 4:

[1119] The generated AI model on the server undergoes 2.5-dimensional transformation.

[1120] Input: Face photo data

[1121] Data processing: 2.5-dimensionalization using image generation AI (e.g., StyleGAN)

[1122] Output: Generated 2.5D image

[1123] Step 5:

[1124] The server saves the generated image.

[1125] Input: Generated 2.5D image

[1126] Data processing: Saving image files and linking them to profiles.

[1127] Output: Notification that saving to the database is complete.

[1128] Step 6:

[1129] Display the generated image on the user's profile.

[1130] Input: Path to the generated image stored in the database

[1131] Output: Image displayed on profile screen

[1132] Compatibility assessment method

[1133] Step 1:

[1134] Users enter profile information such as their hobbies, personality, and interests.

[1135] Input: Profile information (text input field)

[1136] Output: Entered profile information

[1137] Step 2:

[1138] The device sends information to the server.

[1139] Input: Profile information

[1140] Output: Data to send to the server

[1141] Step 3:

[1142] The server uses a compatibility diagnostic engine to generate matching candidates.

[1143] Input: Submitted profile information

[1144] Data processing: Candidate generation using a ChatGPT-based compatibility diagnostic engine.

[1145] Output: Matching candidate list

[1146] Step 4:

[1147] The server's emotion analysis engine recognizes the user's emotions and reflects them in the diagnostic results.

[1148] Input: User sentiment data

[1149] Data processing: Candidate adjustment based on sentiment analysis

[1150] Output: Adjusted matching candidate list

[1151] Step 5:

[1152] The server sends the candidate list back to the terminal.

[1153] Input: Final candidate list

[1154] Output: Send candidate list to terminal

[1155] Step 6:

[1156] The device displays a list of suggestions to the user.

[1157] Input: Received candidate list

[1158] Output: Displaying the list

[1159] Implementation of interaction in virtual space

[1160] Step 1:

[1161] The user sets the time and place for the date.

[1162] Input: Date, time, and location information for the date

[1163] Output: Confirmation of configuration information

[1164] Step 2:

[1165] The device sends configuration information to the server.

[1166] Input: Configuration information

[1167] Output: Sending configuration data to the server

[1168] Step 3:

[1169] The server sets up a virtual dating session.

[1170] Input: Received configuration information

[1171] Data processing: Setting up a dating session in a virtual space

[1172] Output: Session setup complete notification

[1173] Step 4:

[1174] The server sends a reminder notification to the user.

[1175] Input: Date and time of the date

[1176] Output: Reminder notification

[1177] Step 5:

[1178] The user accesses the virtual space at the specified time.

[1179] Input: Login information and date / time

[1180] Output: Access to the virtual space

[1181] Step 6:

[1182] The emotion analysis engine analyzes the user's emotions in real time and suggests appropriate dating scenarios and activities.

[1183] Input: User sentiment data

[1184] Data processing: Real-time sentiment analysis and scenario generation

[1185] Output: Proposed dating scenarios and activities

[1186] Implementation Examples of Communication Support

[1187] Step 1:

[1188] The user enters a message and presses the send button.

[1189] Input: Message text

[1190] Output: Message sending command

[1191] Step 2:

[1192] The terminal sends the content to the server.

[1193] Input: Message text

[1194] Output: Sending a message to the server

[1195] Step 3:

[1196] The server uses AI to generate appropriate responses.

[1197] Input: Received message

[1198] Data processing: AI-driven response generation (e.g., GPT-3 model)

[1199] Output: Generated reply

[1200] Step 4:

[1201] The generated reply will be displayed on your device.

[1202] Input: Generated reply data

[1203] Output: Display of reply text

[1204] Step 5:

[1205] The user reviews the reply, makes any necessary corrections, and then sends it.

[1206] Input: Confirmation and Correction

[1207] Output: Sending the revised reply

[1208] Step 6:

[1209] The emotion analysis engine analyzes the message content and the user's facial expressions, and suggests an appropriate response based on their emotions.

[1210] Input: Message text and facial expression data

[1211] Data processing: Sentiment analysis and response generation

[1212] Output: Proposed response

[1213] (Application Example 2)

[1214] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[1215] Traditional virtual store systems lacked sufficient user identity verification and privacy protection, and had limited communication and emotional recognition capabilities between users. As a result, it was difficult for users to feel secure while using virtual stores, and the systems failed to provide an engaging shopping experience.

[1216] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for verifying the user's identity using public authentication information, means for converting the user's facial photograph into 2.5 dimensions using image processing technology, and means for analyzing the user's emotions in real time using an emotion engine and providing appropriate product recommendations and activity suggestions. This makes it possible to enhance user identity verification and privacy protection, and to provide the user with the most suitable activities by analyzing emotions in real time.

[1217] "Official authentication information" refers to information issued by a government or certification body to prove an individual's identity.

[1218] "Identity verification" is the process of confirming a user's identity using publicly available authentication information.

[1219] "2.5D rendering of facial photographs" is a technology that represents a user's facial photograph not as a flat image, but as a semi-three-dimensional image with added depth information.

[1220] "Image processing technology" refers to the technology used to analyze, transform, and process digital images.

[1221] A "virtual store" is a virtual shopping space that exists on the internet.

[1222] "Profile information" refers to data that includes personal information such as the user's hobbies, personality, and interests.

[1223] A "database" is a system for storing and managing user profile information, generated facial images, and other data.

[1224] "Compatibility assessment" is a process that selects other users who are a good match for a given user based on their profile information.

[1225] "Artificial intelligence technology" is a technology that enables machines to imitate intelligent human behavior.

[1226] An "emotion engine" is a system that analyzes a user's emotions based on their facial expressions, statements, and other factors.

[1227] A "virtual space" is a real-time, three-dimensional virtual environment built on the internet.

[1228] "Appropriately representing the individual's characteristics" means processing facial photos while protecting privacy, without losing the user's individuality or identifying information.

[1229] "Communication encryption technology" is a technology that converts data into an unreadable format in order to securely send and receive data.

[1230] "Product recommendation" is the process of suggesting products and services that are suitable for a user based on their profile information and emotional state.

[1231] "Activity suggestion" is the process of suggesting enjoyable activities and experiences based on the user's interests and emotional state.

[1232] This invention provides a system that includes user identity verification, privacy protection, 2.5D rendering of facial images, compatibility assessment, emotion recognition, and communication support using artificial intelligence within a virtual store. Each function is described below in turn.

[1233] Implementation of identity verification

[1234] The user launches the app using a device such as a smartphone or tablet. First, identity verification is performed using public authentication information. The user holds their public authentication information (such as a My Number Card) over the device's reader, and the device reads the information. This information is securely transmitted to the server using encryption technology. The server verifies the user's identity by comparing it with the public authentication database and sends the result back to the device.

[1235] 2.5-dimensional rendering of facial photographs

[1236] Next, when a user creates a profile, they upload a photo of their face. The device sends the uploaded photo to the server, which uses image processing technology and generative AI models (such as TensorFlow) to transform the photo into a 2.5-dimensional image. This 2.5-dimensional image is processed to appropriately represent the person's features while protecting their privacy, and is stored in the database as the user's profile information.

[1237] Compatibility assessment method

[1238] When a user enters profile information such as hobbies, personality, and interests, a compatibility engine (ChatGPT-based) generates matching candidates based on that information. The server analyzes the collected information and also considers the user's emotions using an emotion engine. As a result, appropriate matching candidates are selected, and the results are displayed on the device.

[1239] Customer service support within the metaverse

[1240] When a user accesses the virtual store's virtual space at a specified time, an emotion engine analyzes the user's emotions in real time and suggests optimal product recommendations and activities. Artificial intelligence technology is used to facilitate smooth communication between users. The AI ​​analyzes user statements and chat messages to provide appropriate responses and assistance.

[1241] Hardware and software to use

[1242] Hardware: Smartphones, tablets, reader devices

[1243] Software: Python, Flask (for server processing), TensorFlow, OpenCV (for image processing and emotion recognition), Amazon Web Services (for database and authentication processing), ChatGPT (for natural language processing and communication support)

[1244] Specific example

[1245] When a user attempts to access the virtual mall, their identity is first verified using official authentication information. Afterward, the user uploads a photo of their face, which the app then transforms into a 2.5D image and displays in their profile. The user inputs their hobbies and personality information, and the AI ​​selects compatible users. When users enjoy dating in the virtual space, an emotion engine analyzes their emotions and suggests the most suitable activities. For example, if a user is interested in a new product exhibition, the emotion engine can use that information to suggest, "Why not check out the latest summer collection?"

[1246] Example of a prompt

[1247] "User 1's profile information: Name: Taro, Age: 30, Hobbies: Outdoors, Reading, Personality: Sociable. User 2's profile information: Name: Hanako, Age: 28, Hobbies: Cooking, Traveling, Personality: Introverted. Based on this information, perform a compatibility assessment between these users and generate an estimate of how likely a match is to occur."

[1248] This invention provides a system that allows users to enjoy shopping and communication in virtual stores in a safe and private environment.

[1249] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1250] Step 1: Identity Verification

[1251] The user launches the app on a device such as a smartphone or tablet and holds their official authentication information (e.g., My Number Card) over the device's reader. The device securely transmits this information to a server using encryption technology. The server verifies the user's identity by comparing it with the official authentication database. The result is sent back to the device and displayed to the user.

[1252] (Input: Official authentication information, Output: Identity verification result)

[1253] Step 2: Upload a photo and convert it to 2.5D.

[1254] The user uploads a profile picture on the profile creation screen. The device sends the picture to the server, which uses image processing technology and a generative AI model (e.g., TensorFlow) to transform the picture into a 2.5-dimensional image. The generated image is stored in a database and reflected in the user's profile.

[1255] (Input: facial photograph, Output: 2.5-dimensional facial image)

[1256] Step 3: Enter and submit profile information

[1257] The user enters profile information such as hobbies, personality, and interests into the device. The device sends this information to the server, which stores it in a database.

[1258] (Input: Profile information, Output: Sending to server complete)

[1259] Step 4: Compatibility assessment and emotional analysis

[1260] The server generates matching candidates using a compatibility assessment engine (ChatGPT-based) based on the user's profile information. Simultaneously, an emotion engine analyzes the user's profile information and past behavioral data to determine their emotional state. The results of the compatibility assessment and emotion analysis are combined to select the most suitable matching candidate.

[1261] (Input: Profile information, Output: Matching candidate list)

[1262] Step 5: Activities within the virtual store

[1263] Users access the virtual space of a virtual store at a time they specify. An emotion engine analyzes the user's emotions in real time and recommends appropriate products and activities. Artificial intelligence technology (ChatGPT) is used to analyze chats and messages between users and provide appropriate responses and communication support.

[1264] (Input: Real-time sentiment data, Output: Product recommendations and activity suggestions)

[1265] Step 6: Communication Support

[1266] When a user chats or makes a statement in the virtual space, the terminal sends the content to the server, where AI analyzes it and generates an appropriate response. An emotion engine also analyzes the content simultaneously, suggesting responses based on the user's emotional state. This facilitates smooth communication between users.

[1267] (Input: Chat message, Output: AI response)

[1268] By following the steps outlined above, users can enjoy safe and personalized shopping and communication within the virtual store.

[1269] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1270] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1271] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[1272] [Third Embodiment]

[1273] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[1274] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1275] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1276] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[1277] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1278] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1279] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1280] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1281] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1282] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1283] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1284] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[1285] This invention relates to a system that includes identity verification using public authentication information, 2.5-dimensional rendering of facial photographs using image processing technology, a compatibility diagnosis engine, a metaverse dating function, and communication support using artificial intelligence technology.

[1286] 1. Implementation of Identity Verification

[1287] The user installs and launches the app. The device requests the reading of official authentication information (e.g., My Number Card). The user holds their My Number Card over the device's reader. The device encrypts the information it reads and sends it to the server. The server verifies the user's identity by comparing it against the official authentication database. The verification result is sent back to the device and displayed to the user.

[1288] As a concrete example, the user opens the app and selects "Identity Verification." The device displays "Please read your card," and the user holds their My Number Card over the reader. The device sends the read information to a server and verifies it against a public database. If successful, "Identity verification complete" is displayed.

[1289] 2. Embodiment of 2.5D rendering of facial photographs

[1290] The user uploads a profile picture on their profile screen. The device sends the photo to a server for image processing, and an image generation AI connected to the server performs 2.5D conversion. The generated 2.5D image is saved on the server and displayed on the user's profile.

[1291] As a concrete example, a user opens the profile editing screen, selects a profile picture, and presses the upload button. The device automatically sends the photo to the server, and the image generation AI begins processing. Once processing is complete, a 2.5D image is reflected in the user's profile.

[1292] 3. Implementation of Compatibility Diagnosis

[1293] The user enters information such as their hobbies, personality, and interests. The device sends this information to the server, and a ChatGPT-based compatibility engine generates matching candidates. A list of candidates is sent back to the device and displayed to the user.

[1294] As a concrete example, a user opens the "Hobbies & Interests" tab and fills in details about their hobbies and personality. After completing the input, they press the "Compatibility Test" button, the device sends the information, and a list of compatible candidates is displayed a few seconds later.

[1295] 4. Embodiment of Metaverse Date

[1296] Based on the compatibility test results, the user sets up a date in the metaverse. The device sends the set date, time, and location to the server, and a virtual session is established. The user accesses the virtual space at the set time and interacts with other users.

[1297] As a concrete example, the user selects a partner from a list of candidates and sets the date, time, and location for the metaverse date. After the setup is complete, the device displays a confirmation message and sends a reminder notification on the day of the date. The user then accesses the virtual space and enjoys the virtual date.

[1298] 5. Implementation Examples of Communication Support

[1299] When a user sends a message to someone, the device sends the content to the server, and AI generates an appropriate reply. The suggested reply is displayed on the device, and the user reviews, modifies, and sends it.

[1300] As a concrete example, a user types a message in the chat screen and presses the send button. The device sends the message to the AI, and after a few seconds, the AI ​​generates a reply. The device displays reply options to the user, who then selects and sends the reply.

[1301] Through the above configuration, the present invention simultaneously provides safety, privacy protection, matching accuracy, and a virtual dating experience, thereby achieving its objectives.

[1302] The following describes the processing flow.

[1303] Identity verification process

[1304] Step 1:

[1305] The user installs the matching app and launches it.

[1306] Step 2:

[1307] The terminal displays an interface requesting the user to read their My Number Card.

[1308] Step 3:

[1309] The user holds their My Number Card over the terminal's reader.

[1310] Step 4:

[1311] The device reads the information from the My Number Card and encrypts the acquired data.

[1312] Step 5:

[1313] The device sends encrypted card information to the server.

[1314] Step 6:

[1315] The server sends the received information to a public authentication database to perform identity verification.

[1316] Step 7:

[1317] The server generates the result of the identity verification (success or failure) and sends it back to the device.

[1318] Step 8:

[1319] The device displays the results of the identity verification to the user.

[1320] Profile creation process

[1321] Step 1:

[1322] The user opens the profile creation screen.

[1323] Step 2:

[1324] The user selects a photo of their face and presses the upload button.

[1325] Step 3:

[1326] The device sends the selected facial image to the image generation AI and requests 2.5-dimensional processing.

[1327] Step 4:

[1328] An image generation AI connected to the server processes facial images by converting them into 2.5D.

[1329] Step 5:

[1330] The server saves the generated 2.5D image to a database and links it to the user ID.

[1331] Step 6:

[1332] The server sends a URL for the 2.5D image back to the terminal and displays it to the user.

[1333] Compatibility assessment process

[1334] Step 1:

[1335] The user enters their profile information (hobbies, personality, interests, etc.).

[1336] Step 2:

[1337] The device sends the entered profile information to the server.

[1338] Step 3:

[1339] The server passes the profile information stored in the ChatGPT-based compatibility engine.

[1340] Step 4:

[1341] The server performs a compatibility check and generates a list of matching candidates.

[1342] Step 5:

[1343] The server sends a list of potential matches back to the terminal and displays it to the user.

[1344] Metaverse dating process

[1345] Step 1:

[1346] Users select someone they are interested in based on compatibility test results and set the time and place for a metaverse date.

[1347] Step 2:

[1348] The device sends information about the set time and location to the server.

[1349] Step 3:

[1350] The server sets up a dating session in a virtual space and saves the necessary data to the database.

[1351] Step 4:

[1352] The user logs in to access the virtual space at a time they have set.

[1353] Step 5:

[1354] The server authenticates access and sends the data necessary for the virtual space dating session.

[1355] Step 6:

[1356] Users enjoy dating other users in a virtual space.

[1357] Communication support process

[1358] Step 1:

[1359] The user enters a message in the chat screen.

[1360] Step 2:

[1361] The terminal sends the entered message to the server.

[1362] Step 3:

[1363] The server passes the message content to the AI ​​engine, which then generates appropriate replies and other responses.

[1364] Step 4:

[1365] The server sends the generated reply message to the terminal.

[1366] Step 5:

[1367] The device displays the reply to the user and asks for confirmation or correction.

[1368] Step 6:

[1369] The user sends the revised message and continues the chat.

[1370] (Example 1)

[1371] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1372] In modern online dating and communication systems, user identity verification, privacy protection, advanced compatibility assessment, virtual dating experiences, and communication support are critical challenges. In particular, there is a need to simultaneously provide secure handling of personal information and a realistic virtual experience. Currently, no system exists that integrates these functions, resulting in user inconvenience.

[1373] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1374] In this invention, the server includes means for verifying the user's identity using public authentication information, means for converting the user's facial image into 2.5 dimensions using image processing technology, means for maintaining a database containing the generated facial image and the user's profile information, means for selecting other compatible users based on the user's hobbies and personality information, means for enabling selected users to date in a virtual space, means for using artificial intelligence technology to support communication between users, means including technology for encrypting user input information and transmitting it to the server, means for the server to compare the information entered by the user with a public authentication database, means for transmitting a facial image to the server and for the server to convert it into 2.5 dimensions using image generation AI, means for a compatibility diagnosis engine to generate compatible matching candidates from user data, means for setting up a virtual space session and connecting users, and means for the server to analyze the message content with AI and generate an appropriate reply. This makes it possible for users to enjoy matching and communication to a high degree in a safe and privacy-protected environment.

[1375] "Official authentication information" refers to information issued by the government or public institutions to prove an individual's identity.

[1376] A "user" refers to an individual user who utilizes the system, and is the entity that performs various operations through a terminal.

[1377] A "terminal" is an electronic device that a user operates to input and display information, and includes smartphones and personal computers.

[1378] A "server" is a computer device that forms the core of a system, processing and storing data, and communicating with other terminals.

[1379] A "face photo" is image data of the user's own face.

[1380] "Image processing technology" refers to all technologies used to analyze and process image data such as photographs and videos.

[1381] "2.5-dimensionalization" is a technique that adds depth and a sense of three-dimensionality to two-dimensional image data, processing it to make it appear nearly three-dimensional.

[1382] "Profile information" refers to information that includes data such as the individual user's characteristics, attributes, and interests.

[1383] A "database" is an electronic data storage system for systematically storing and managing information.

[1384] "Hobbies and personality information" refers to information that represents a user's everyday interests and personality traits.

[1385] "Compatibility assessment" is a process that evaluates how well a user is compatible with other users based on their hobbies and personality information.

[1386] A "virtual space" is a digital space created with computer graphics that, while not real, offers a sense of realism.

[1387] "Going on a date" refers to an activity where selected users meet and interact with each other in a virtual space.

[1388] "Communication support" refers to technologies and systems that facilitate the exchange of messages between users.

[1389] "Artificial intelligence technology" refers to technology that imitates human intelligence and possesses functions such as learning, reasoning, and problem-solving.

[1390] "Encryption" is a technology that transforms information using a specific algorithm, making it incomprehensible to third parties.

[1391] A "compatibility diagnosis engine" is a general term for algorithms and systems that select other users who are compatible with the user based on the user's input information.

[1392] A "session" refers to a series of activities or periods in which a user utilizes a system or service.

[1393] "Generating a reply" refers to the process of creating an appropriate response to a received message.

[1394] This invention is an integrated system that enables identity verification using public authentication information, 2.5-dimensional rendering of facial images, compatibility diagnosis, metaverse dating, and communication support. Specific embodiments of this system are described below.

[1395] Implementation method of identity verification

[1396] First, the user installs and launches the app. The device prompts the user to read official authentication information (e.g., My Number Card). When the user holds the My Number Card over the device's reader, the device encrypts the information it reads and sends it to the server. The server verifies the user's identity by comparing it with the public authentication database, sends the result back to the device, and displays it to the user. As a specific example, the user launches the app, selects "Identity Verification," and holds the My Number Card over the reader. The device sends the encrypted information to the server, which is then compared with the public database. If successful, "Identity verification complete" is displayed.

[1397] Embodiment of 2.5D rendering of facial photographs

[1398] The user uploads a profile picture on their profile screen. The device sends the photo to a server, where a generative AI connected to the server performs a 2.5-dimensional transformation. The generated 2.5-dimensional image is stored on the server and displayed on the user's profile. For example, the user selects a profile picture on the profile editing screen and presses the upload button. The device sends the photo to the server, and the image generation AI performs the 2.5-dimensional transformation. Once the process is complete, the image is displayed on the user's profile.

[1399] Compatibility assessment method

[1400] The user enters information such as hobbies, personality, and interests within the app. The device sends this information to a server, and a ChatGPT-based compatibility engine generates matching candidates. The generated candidate list is sent back to the device and displayed to the user. For example, the user opens the "Hobbies & Interests" tab, enters information, and runs the "Compatibility Test." The device sends the information to the server, and a list of compatible candidates is displayed a few seconds later.

[1401] Metaverse Date Implementation

[1402] Based on compatibility test results, the user sets up a date in the metaverse. The device sends the set date, time, and location information to the server, and the server sets up a virtual session. The user accesses the virtual space at the set time and interacts with other users. For example, the user selects a partner from a candidate list and sets the date, time, and location for the metaverse date. The device displays a confirmation message and sends a reminder notification as the time approaches. At the set time, the user accesses the virtual space and enjoys the virtual date.

[1403] Implementation Examples of Communication Support

[1404] When a user types a message to another person, the device sends the message to a server, and AI generates an appropriate reply. The suggested reply is displayed on the device, and the user reviews or modifies it before finally sending it. For example, a user types a message in the chat screen and presses the send button. The device sends the message to the server, and after a few seconds, the AI ​​generates a reply. The device displays the suggested reply options to the user, who then reviews and sends it.

[1405] Example prompts for a generative AI model

[1406] The following are examples of prompt statements related to a series of processes:

[1407] Prompt message regarding identity verification:

[1408] Please explain the step-by-step process for users to authenticate their identity by holding their My Number Card over a reader.

[1409] Prompt message regarding 2.5D conversion of facial images:

[1410] Please provide a detailed explanation of the processing flow for converting a user's profile picture to 2.5D.

[1411] Prompt message regarding compatibility assessment:

[1412] Please describe the process by which users input information about their hobbies and interests to perform a compatibility assessment.

[1413] Prompt message regarding metaverse dating:

[1414] Please provide detailed instructions on how users can set up and enjoy a metaverse date.

[1415] Prompt messages regarding communication support:

[1416] Please describe in detail the process by which AI is used to generate replies when a user sends a message.

[1417] In the above configuration, the present invention enables users to receive multiple high-performance services in a safe and privacy-protected environment. This significantly improves user convenience and enhances overall satisfaction.

[1418] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1419] Implementation method of identity verification

[1420] Step 1:

[1421] The user installs and launches the app.

[1422] Input: App installation and launch operations.

[1423] Output: The app launches and the initial screen is displayed.

[1424] Specifically, the user downloads the app from their smartphone's app store and completes the installation. After installation, the user taps the app icon to launch the app.

[1425] Step 2:

[1426] The device requests to read public authentication information.

[1427] Input: Initial screen after launching the app.

[1428] Output: A screen prompting the preparation of official authentication information.

[1429] Specifically, the device will display the message "Please have your My Number Card ready" on the screen.

[1430] Step 3:

[1431] The user holds their My Number Card over the terminal's reader.

[1432] Input: User's My Number Card.

[1433] Output: Data that the device reads from public authentication information.

[1434] Specifically, the user holds their My Number Card over the NFC reader on the terminal. The terminal scans the information on the card and converts it into digital data.

[1435] Step 4:

[1436] The device encrypts the information it reads and sends it to the server.

[1437] Input: Public authentication information read from the document.

[1438] Output: Encrypted public authentication information.

[1439] Specifically, the terminal encrypts the data using AES256 and sends it to the server using the HTTPS protocol.

[1440] Step 5:

[1441] The server verifies the user's identity by matching them against a public authentication database.

[1442] Input: Encrypted public authentication information.

[1443] Output: Matching result.

[1444] Specifically, the server decrypts the received data and accesses a public authentication database to perform verification.

[1445] Step 6:

[1446] The server sends the verification result back to the terminal and displays it to the user.

[1447] Input: Matching result.

[1448] Output: Display of identity verification results.

[1449] Specifically, the server sends the verification result back to the terminal, and the terminal displays "Identity verification complete."

[1450] Embodiment of 2.5D rendering of facial photographs

[1451] Step 1:

[1452] The user uploads a profile picture on their profile screen.

[1453] Input: User's profile picture.

[1454] Output: Upload instruction.

[1455] Specifically, the user presses the "Select Photo" button on the profile editing screen, selects a photo of their face from their smartphone's gallery, and uploads it.

[1456] Step 2:

[1457] The device sends the photo data to the server.

[1458] Input: User's profile picture.

[1459] Output: Sending photo data to the server.

[1460] Specifically, the terminal compresses the selected image data and sends it to the server in JPEG format.

[1461] Step 3:

[1462] The generation AI connected to the server performs the 2.5-dimensional transformation.

[1463] Input: Face photo data.

[1464] Output: 2.5-dimensional image data.

[1465] Specifically, the server receives a facial image, passes it to an image generation AI (such as StyleGAN), and performs a 2.5-dimensional transformation.

[1466] Step 4:

[1467] The server saves the generated 2.5D image, sends it back to the terminal, and displays it to the user.

[1468] Input: 2.5-dimensional image.

[1469] Output: The image displayed in the user's profile.

[1470] Specifically, the server saves the generated image to a database and sends it to the terminal. The terminal receives the image and displays it in the user's profile.

[1471] Compatibility assessment method

[1472] Step 1:

[1473] Users enter information such as their hobbies, personality, and interests.

[1474] Input: Hobbies, personality, and interests.

[1475] Output: Input completion information.

[1476] In terms of specific actions, the user enters information into a form on the app's "Hobbies & Interests" tab (e.g., watching movies, reading, traveling, etc.).

[1477] Step 2:

[1478] The device sends this information to the server.

[1479] Input: Hobbies, personality, and interests.

[1480] Output: Sending information to the server.

[1481] Specifically, the terminal sends the input data to the server in JSON format.

[1482] Step 3:

[1483] A compatibility diagnostic engine connected to the server generates matching candidates.

[1484] Input: User information.

[1485] Output: Matching candidate list.

[1486] Specifically, the server launches a ChatGPT-based compatibility assessment engine and lists compatible candidates based on the information received.

[1487] Step 4:

[1488] The server sends a list of matching candidates back to the terminal and displays it to the user.

[1489] Input: Matching candidate list.

[1490] Output: Display of candidate list.

[1491] Specifically, the server sends a list of candidates to the terminal, and the terminal displays it on the user's screen.

[1492] Metaverse Date Implementation

[1493] Step 1:

[1494] Users set up dates in the metaverse based on their compatibility test results.

[1495] Input: Compatibility test results, date settings.

[1496] Output: Configuration details.

[1497] Specifically, the user selects a partner from a list of candidates and sets the date, time, and location for the date.

[1498] Step 2:

[1499] The device sends information about the configured date, time, and location to the server.

[1500] Input: Date settings information.

[1501] Output: Sending configuration information to the server.

[1502] Specifically, the device sends configuration information to the server.

[1503] Step 3:

[1504] The server sets up a session in the virtual space.

[1505] Input: Date settings information.

[1506] Output: URL and access information for the virtual space session.

[1507] Specifically, the server creates a virtual session at the specified date and time and generates access information.

[1508] Step 4:

[1509] Users access the virtual space at a set date and time and interact with other users.

[1510] Input: Access information for the virtual space.

[1511] Output: Interaction in a virtual space.

[1512] In concrete terms, the user accesses a virtual space and interacts with others through conversation and avatar control.

[1513] Implementation Examples of Communication Support

[1514] Step 1:

[1515] The user enters a message for the other party.

[1516] Input: Message content.

[1517] Output: Ready to send.

[1518] Specifically, the user types a message in the chat screen and presses the send button.

[1519] Step 2:

[1520] The terminal sends a message to the server.

[1521] Input: Message content.

[1522] Output: Sending a message to the server.

[1523] Specifically, the terminal sends a message to the server.

[1524] Step 3:

[1525] The AI ​​on the server generates an appropriate response.

[1526] Input: User's message.

[1527] Output: Generated reply suggestions.

[1528] Specifically, the AI ​​on the server (e.g., ChatGPT) analyzes the received message and generates a reply.

[1529] Step 4:

[1530] The server sends the suggested reply back to the terminal, and the user reviews, corrects, and submits it.

[1531] Input: Generated reply suggestions.

[1532] Output: Sending the final reply.

[1533] Specifically, the server sends the generated reply options to the terminal, which then displays them to the user. The user reviews the reply, makes any necessary corrections, and then sends it.

[1534] The above outlines the specific steps involved in each program process of this system.

[1535] (Application Example 1)

[1536] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1537] Traditional dating applications lacked sufficient identity verification, privacy protection, and compatibility assessment features, resulting in a lack of trust and security for users. Furthermore, systems offering virtual dating and adventure experiences often suffered from inadequate device integration and communication support, diminishing the real-world interaction experience.

[1538] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1539] This invention includes a server that provides means for verifying the user's identity using public authentication information, means for transforming the user's facial photograph into a 2.5-dimensional image using image processing technology, means for maintaining a database containing the generated facial image and the user's profile information, means for selecting compatible users based on the user's hobbies and personality information, means for enabling selected users to date in a virtual space, means for using artificial intelligence technology to support communication between users, and means for providing virtual dating and adventures via smartphones and head-mounted displays. As a result, users can receive reliable identity verification in a safe and private environment, and enjoy a near-realistic virtual experience through smartphones and head-mounted displays while receiving advanced communication support using AI.

[1540] "Official authentication information" refers to information issued by public institutions and used to verify an individual's identity.

[1541] "Identity verification" is the process of confirming that a user is indeed who they claim to be, using official authentication information.

[1542] "2.5-dimensionalization" is a process that uses image processing technology to add some three-dimensional elements to a flat, two-dimensional image of a user's face, giving it a sense of depth.

[1543] "Profile information" refers to data that includes basic user information, such as facial images, hobbies, and personality.

[1544] "Compatibility assessment" is a process that selects other users who are compatible with the user based on the hobbies and personality information entered by the user.

[1545] A "virtual space" is a digital, three-dimensional environment created by a computer, where users interact through avatars.

[1546] "Artificial intelligence technology" refers to technology that enables computers to possess knowledge and skills like humans, and to perform tasks such as learning, reasoning, and judgment.

[1547] A "head-mounted display" is a display device worn on the user's head, used to visually experience a virtual space.

[1548] This invention relates to a virtual entertainment application that allows users to enjoy dating and adventures in a virtual space. This application has a variety of functions, including identity verification, 2.5D rendering of facial images, compatibility diagnosis, metaverse dating, and AI-powered communication support.

[1549] The server performs identity verification using public authentication information. When a user launches a smartphone application and reads their public authentication information (e.g., My Number Card), the information is encrypted and sent to the server. The server verifies the user's identity by comparing it with a public database, and then sends the result back to the device for display to the user.

[1550] Next, image processing is performed to convert the user's facial image into a 2.5D image. When a user uploads a facial image on their profile screen, the image is sent to the server. An image generation AI connected to the server processes the facial image and generates a 2.5D image. The generated image is stored on the server and displayed on the user's profile.

[1551] Subsequently, a compatibility assessment is conducted based on the user's hobbies and personality information. When the user enters information about their hobbies and personality, that information is sent to the server. A ChatGPT-based compatibility assessment engine analyzes the information and selects other compatible users. The list of selected candidates is returned to the device and displayed to the user.

[1552] Selected users can arrange dates in a virtual space. Once users set the date, time, and location for a metaverse date, that information is sent to the server, and a virtual space session is established. Users can access the virtual space at the scheduled time and enjoy dates and adventures with other users. This can be done using smartphones or head-mounted displays.

[1553] Furthermore, artificial intelligence technology is used to support communication between users. When a user sends a chat or voice message, its content is sent to the server. The AI ​​generates an appropriate reply, and the suggestion is displayed on the user's device. The user can review, modify, and send the suggested reply.

[1554] As a concrete example, by inputting the following prompt sentences into the AI ​​model, it is possible to provide specific guidance on how the user should use the application:

[1555] Design a virtual entertainment app that allows users to set up dates using 2.5D avatars in a virtual space. The system will include identity verification using public authentication information, 2.5D rendering of facial images using image processing technology, a compatibility diagnosis engine, a metaverse dating function, and communication support using artificial intelligence technology. Technologies to be used: face_recognition, OpenCV, PIL, requests, Python.

[1556] Thus, this invention is a comprehensive system that allows users to enjoy virtual dating and adventure experiences in a safe and reliable environment.

[1557] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1558] Step 1:

[1559] The user launches the application and reads their public authentication information. The user holds their My Number Card over the reader on their smartphone. This input reads the user's public authentication information. The device encrypts the read information and sends it to the server. In this process, the data is encrypted before transmission, ensuring security.

[1560] Step 2:

[1561] The server compares the received public authentication information with a public database. Based on the comparison, it determines whether or not identity verification is successful and sends the result back to the terminal. The information sent back includes whether or not authentication was successful. The terminal displays the result to the user, and identity verification is completed.

[1562] Step 3:

[1563] The user uploads a profile picture on their profile screen. This input sends the image data of the profile picture from the device to the server. An image generation AI connected to the server processes the received image data to generate a 2.5D image. This process transforms a flat 2D image into a three-dimensional 2.5D image. The generated image is saved on the server and displayed on the user's profile.

[1564] Step 4:

[1565] The user enters information about their hobbies and personality to begin the compatibility assessment. This input data is sent from the terminal to the server. A ChatGPT-based compatibility assessment engine connected to the server analyzes the user's information and selects other compatible users. This analysis generates a list of users that match the user's hobbies and personality. The selected list of candidates is sent back to the terminal and displayed to the user.

[1566] Step 5:

[1567] The user sets the date, time, and location for the metaverse date. This setting information is sent from the device to the server. The server uses this information to set up the virtual space session. This process prepares the virtual date. At the set date and time, the user accesses the virtual space using a smartphone or head-mounted display and enjoys the date.

[1568] Step 6:

[1569] When a user communicates with another user, they input messages or voice data. The input data is sent from the device to a server, which uses AI to generate appropriate replies. This process enables natural conversation. The generated reply is sent back to the device and displayed to the user. The user can review, modify, and send the suggested reply.

[1570] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1571] This invention relates to a system that combines identity verification using public authentication information, 2.5-dimensional rendering of facial photographs using image processing technology, a compatibility diagnosis engine, a metaverse date function, communication support using artificial intelligence technology, and an emotion engine.

[1572] 1. Implementation of Identity Verification

[1573] The user installs and launches the app. The device displays an interface requesting the reading of public authentication information, and the user holds their authentication card over the reader. The device encrypts the information it reads and sends it to the server. The server verifies the user's identity using the public authentication database and sends the result back to the device. The device displays the authentication result to the user.

[1574] As a concrete example, a user opens the app, selects "Identity Verification," and holds their My Number Card over the device. The device reads the information, encrypts it, sends it to the server, and after matching it with a public database, displays "Identity verification complete."

[1575] 2. Embodiment of 2.5D rendering of facial photographs

[1576] The user uploads a photo of their face on the profile creation screen. The device sends the photo to the server, where an image generation AI transforms it into a 2.5D image. The generated image is stored on the server and displayed on the user's profile.

[1577] As a concrete example, a user selects a photo of their face and presses the upload button. The device sends the photo to the server, and an image generation AI generates a 2.5D image. The generated image is then reflected in the user's profile.

[1578] 3. Implementation of Compatibility Diagnosis

[1579] The user enters profile information such as hobbies, personality, and interests. The device sends this information to the server, and a ChatGPT-based compatibility engine generates matching candidates. The candidate list is sent back to the device and displayed to the user. Additionally, an emotion engine recognizes the user's emotions and reflects them in the diagnosis results.

[1580] As a concrete example, a user enters detailed profile information and starts a "compatibility test." The device sends the information to the server, the compatibility test engine generates a list of candidates, the emotion engine analyzes the user's emotions, and the most suitable list of candidates is displayed.

[1581] 4. Embodiment of Metaverse Date

[1582] The user sets the time and place for a date based on the compatibility assessment results. The device sends the setting information to the server, and a virtual dating session is set up. The user accesses the virtual space at the specified time and interacts with other users. The emotion engine analyzes the user's emotions in real time and suggests appropriate dating scenarios and activities.

[1583] As a concrete example, the user selects a partner from a candidate list and sets the date, time, and location for the metaverse date. The device sends the information to the server and sends a reminder notification on the day of the date. The user accesses the virtual space, and during the date, an emotion engine analyzes the user's emotions and suggests the most suitable activities.

[1584] 5. Implementation Examples of Communication Support

[1585] When a user sends a message, the device sends the content to the server, and the AI ​​generates an appropriate reply. The generated reply is displayed on the device, and the user reviews, modifies, and sends it. In addition, the emotion engine analyzes the message content and the user's facial expressions to suggest an appropriate response based on their emotions.

[1586] As a concrete example, a user types and sends a message in the chat screen. The device sends the message to the server, and the AI ​​generates a reply. The emotion engine analyzes the message content and the user's emotions, and an appropriate reply is displayed on the device. The user then modifies and sends the reply.

[1587] Through the above configuration, the present invention simultaneously provides reliable identity verification, privacy protection, and compatibility diagnosis and communication support utilizing emotion recognition, thereby realizing a safe and effective matching experience.

[1588] The following describes the processing flow.

[1589] Identity verification process

[1590] Step 1:

[1591] The user installs the matching app and launches it.

[1592] Step 2:

[1593] The terminal displays an interface requesting the user to read their My Number Card.

[1594] Step 3:

[1595] The user holds their My Number Card over the terminal's reader.

[1596] Step 4:

[1597] The device reads the information from the My Number Card and encrypts the acquired data.

[1598] Step 5:

[1599] The device sends encrypted card information to the server.

[1600] Step 6:

[1601] The server sends the received information to a public authentication database to perform identity verification.

[1602] Step 7:

[1603] The server generates the result of the identity verification (success or failure) and sends it back to the device.

[1604] Step 8:

[1605] The device displays the results of the identity verification to the user.

[1606] Profile creation process

[1607] Step 1:

[1608] The user opens the profile creation screen.

[1609] Step 2:

[1610] The user selects a photo of their face and presses the upload button.

[1611] Step 3:

[1612] The device sends the selected facial image to the image generation AI and requests 2.5-dimensional processing.

[1613] Step 4:

[1614] An image generation AI connected to the server processes facial images by converting them into 2.5D.

[1615] Step 5:

[1616] The server saves the generated 2.5D image to a database and links it to the user ID.

[1617] Step 6:

[1618] The server sends a URL for the 2.5D image back to the terminal and displays it to the user.

[1619] Compatibility assessment process

[1620] Step 1:

[1621] The user enters their profile information (hobbies, personality, interests, etc.).

[1622] Step 2:

[1623] The device sends the entered profile information to the server.

[1624] Step 3:

[1625] The server passes the registered profile information to a ChatGPT-based compatibility assessment engine.

[1626] Step 4:

[1627] The server performs a compatibility check and generates a list of matching candidates.

[1628] Step 5:

[1629] The server sends a list of potential matches back to the terminal and displays it to the user.

[1630] Step 6:

[1631] The server uses an emotion engine to recognize the user's emotions and reflect them in the diagnostic results.

[1632] Metaverse dating process

[1633] Step 1:

[1634] Users select someone they are interested in based on compatibility test results and set the time and place for a metaverse date.

[1635] Step 2:

[1636] The device sends information about the set time and location to the server.

[1637] Step 3:

[1638] The server sets up a dating session in a virtual space and saves the necessary data to the database.

[1639] Step 4:

[1640] The user logs in to access the virtual space at a time they have set.

[1641] Step 5:

[1642] The server authenticates access and sends the data necessary for the virtual space dating session.

[1643] Step 6:

[1644] Users enjoy dating other users in a virtual space.

[1645] Step 7:

[1646] The server uses an emotion engine to analyze the user's emotions in real time and suggest appropriate dating scenarios and activities.

[1647] Communication support process

[1648] Step 1:

[1649] The user enters a message in the chat screen.

[1650] Step 2:

[1651] The terminal sends the entered message to the server.

[1652] Step 3:

[1653] The server passes the message content to the AI ​​engine, which then generates appropriate replies and other responses.

[1654] Step 4:

[1655] The server sends the generated reply message to the terminal.

[1656] Step 5:

[1657] The device displays the reply to the user and asks for confirmation or correction.

[1658] Step 6:

[1659] The user sends the revised message and continues the chat.

[1660] Step 7:

[1661] The server uses an emotion engine to analyze the message content and the user's facial expressions, and then suggests an appropriate response based on those emotions.

[1662] (Example 2)

[1663] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1664] While online matching systems have become commonplace in modern society, they face numerous challenges in terms of protecting user privacy, accurate identity verification, secure information transmission, and communication support. For example, traditional systems have a high risk of users' personal information being leaked to third parties, and suffer from low accuracy in compatibility assessments and poor communication quality. Furthermore, virtual interactions lack real-time emotion recognition and optimal activity suggestions, resulting in insufficient improvements to the user experience. There is a need to solve these problems and provide safer and more reliable online matching systems.

[1665] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1666] In this invention, the server includes means for verifying the user's identity using public authentication information; means for creating a 2.5-dimensional representation of the user's facial image using image processing technology; means for maintaining a database containing the generated facial image and the user's profile information; means for selecting compatible users based on the user's hobbies and personality information; means for enabling the selected users to interact with each other in a virtual space; means for using artificial intelligence technology to support communication between users; means for analyzing the user's emotions using an emotion analysis engine and reflecting this in the diagnosis results and interaction content; means for securely transmitting authentication information using encryption technology; and means for analyzing the user's activities in the virtual space in real time and suggesting optimal actions. This enables accurate identity verification and secure information transmission while protecting user privacy, and also realizes emotion recognition and optimal activity suggestions to improve the user experience.

[1667] "Official authentication information" refers to authentication information issued by a public institution that is used to verify the user's identity. Examples include My Number cards and driver's licenses.

[1668] "2.5-dimensionalization" is a process that adds depth information to conventional 2D images, giving them a pseudo-three-dimensional appearance. This makes the image appear more three-dimensional.

[1669] "User profile information" refers to information such as hobbies, personality, and interests that users enter, and is used for matching and providing personalized services.

[1670] "Selecting compatible other users" means identifying other users who are deemed to be mutually compatible, based on user profile information and using statistical or learning models.

[1671] A "virtual space" is a three-dimensional virtual environment created by a computer, a space in which users can interact with each other.

[1672] "Artificial intelligence technology" refers to technologies that allow computers to mimic the workings of human intelligence, and includes natural language processing, machine learning, and deep learning.

[1673] An "emotion analysis engine" is an algorithm or software that analyzes a user's facial expressions and message content to estimate their emotional state.

[1674] "Encryption technology" is a technique that transforms transmitted information so that it cannot be read by a third party, and is used for secure information transmission. Examples of encryption methods include AES and RSA.

[1675] "Suggesting the optimal action" means analyzing the user's activities and emotional state and presenting the most appropriate action or option in real time. This improves the user experience.

[1676] Modes for carrying out the invention

[1677] This invention relates to a system that combines identity verification using public authentication information, 2.5-dimensional rendering of facial images using image processing technology, a compatibility diagnosis engine, a virtual space interaction function, communication support using artificial intelligence technology, and an emotion analysis engine. The configuration and operation for realizing each of these technological elements with specific hardware and software will be described in detail below.

[1678] Implementation method of identity verification

[1679] The user installs and launches a dedicated application. The application displays an interface for reading official authentication information using the authentication card reader built into the device. Examples include My Number cards and driver's licenses. When the user holds the authentication card over the reader, the device encrypts the information using AES encryption and sends it to the server. The server accesses the public authentication database, verifies the user's identity, and sends the result back to the device. The device then displays the authentication result to the user.

[1680] Embodiment of 2.5D rendering of facial photographs

[1681] The user uploads a profile picture on the profile creation screen. The device sends the photo to the server, where a generative AI model (e.g., StyleGAN) is used to convert it into a 2.5-dimensional image. The generated image is stored in the server's database and reflected in the user's profile.

[1682] Compatibility assessment method

[1683] The user enters profile information such as hobbies, personality, and interests. The device sends this information to the server, and a ChatGPT-based compatibility engine generates matching candidates. Furthermore, an emotion analysis engine recognizes the user's emotions and reflects them in the diagnosis results, creating a more accurate candidate list. Finally, the candidate list is displayed to the user.

[1684] Implementation of interaction in virtual space

[1685] The user sets the time and place for a date based on the compatibility assessment results. The device sends this setting information to the server, and a virtual dating session is set up. When the user accesses the virtual space at the specified date and time, they can interact with other users. An emotion analysis engine analyzes the user's emotions in real time and suggests appropriate dating scenarios and activities.

[1686] Implementation Examples of Communication Support

[1687] When a user sends a message, the device sends its content to the server, and the AI ​​generates an appropriate reply. The generated reply is displayed on the device, and the user reviews, modifies, and sends it. In addition, an emotion analysis engine analyzes the message content and the user's facial expressions to suggest an appropriate response based on their emotions.

[1688] Examples of specific cases and prompt statements

[1689] The following are specific examples of the system of the present invention.

[1690] Examples of identity verification:

[1691] The user opens the app, selects "Identity Verification," and holds their My Number Card over the reader. The device reads the information, encrypts it, sends it to the server, and after matching it with the public database, displays "Identity verification complete."

[1692] Examples of prompts for a generative AI model:

[1693] "The user sets the date, time, and location for a metaverse date, and the device sends this information to the server. The user accesses the metaverse at the specified time and begins dating other users. The sentiment analysis engine should analyze the user's emotions and suggest the most suitable activities."

[1694] This invention is a system that prioritizes user privacy protection and provides a superior user experience by combining accurate identity verification, secure information transmission, highly accurate compatibility assessment, and real-time sentiment analysis.

[1695] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1696] Implementation method of identity verification

[1697] Step 1:

[1698] The user launches the app.

[1699] Input: Tap the application icon or touch the screen.

[1700] Output: Startup screen displayed

[1701] Step 2:

[1702] The device displays an interface requesting the reading of public authentication information.

[1703] Input: Application initialization information

[1704] Output: Display of the My Number Card or driver's license reading screen.

[1705] Step 3:

[1706] The user holds their authentication card over the reader.

[1707] Input: Authentication card (My Number Card or driver's license)

[1708] Output: Read authentication information

[1709] Step 4:

[1710] The device encrypts the information it reads and sends it to the server.

[1711] Input: Authentication information

[1712] Data processing: Apply AES encryption.

[1713] Output: Encrypted credentials

[1714] Step 5:

[1715] The server uses a public authentication database to verify the user's identity.

[1716] Input: Encrypted credentials

[1717] Data processing: Database matching

[1718] Output: Authentication result (success / failure)

[1719] Step 6:

[1720] The server sends the results back to the terminal.

[1721] Input: Authentication result

[1722] Output: Sending results to the terminal

[1723] Step 7:

[1724] The device displays the authentication result to the user.

[1725] Input: Authentication result

[1726] Output: Display of authentication result screen (e.g., "Identity verification complete," "Identity verification failed")

[1727] Embodiment of 2.5D rendering of facial photographs

[1728] Step 1:

[1729] The user accesses the profile creation screen.

[1730] Input: Menu Selection

[1731] Output: Display of the profile creation screen

[1732] Step 2:

[1733] The user uploads a photo of their face.

[1734] Input: Face photo file

[1735] Output: Photo selection and preparation for uploading.

[1736] Step 3:

[1737] The device sends the photo to the server.

[1738] Input: Uploaded profile picture

[1739] Output: Sending photo data to the server

[1740] Step 4:

[1741] The generated AI model on the server undergoes 2.5-dimensional transformation.

[1742] Input: Face photo data

[1743] Data processing: 2.5-dimensionalization using image generation AI (e.g., StyleGAN)

[1744] Output: Generated 2.5D image

[1745] Step 5:

[1746] The server saves the generated image.

[1747] Input: Generated 2.5D image

[1748] Data processing: Saving image files and linking them to profiles.

[1749] Output: Notification that saving to the database is complete.

[1750] Step 6:

[1751] Display the generated image on the user's profile.

[1752] Input: Path to the generated image stored in the database

[1753] Output: Image displayed on profile screen

[1754] Compatibility assessment method

[1755] Step 1:

[1756] Users enter profile information such as their hobbies, personality, and interests.

[1757] Input: Profile information (text input field)

[1758] Output: Entered profile information

[1759] Step 2:

[1760] The device sends information to the server.

[1761] Input: Profile information

[1762] Output: Data to send to the server

[1763] Step 3:

[1764] The server uses a compatibility diagnostic engine to generate matching candidates.

[1765] Input: Submitted profile information

[1766] Data processing: Candidate generation using a ChatGPT-based compatibility diagnostic engine.

[1767] Output: Matching candidate list

[1768] Step 4:

[1769] The server's emotion analysis engine recognizes the user's emotions and reflects them in the diagnostic results.

[1770] Input: User sentiment data

[1771] Data processing: Candidate adjustment based on sentiment analysis

[1772] Output: Adjusted matching candidate list

[1773] Step 5:

[1774] The server sends the candidate list back to the terminal.

[1775] Input: Final candidate list

[1776] Output: Send candidate list to terminal

[1777] Step 6:

[1778] The device displays a list of suggestions to the user.

[1779] Input: Received candidate list

[1780] Output: Displaying the list

[1781] Implementation of interaction in virtual space

[1782] Step 1:

[1783] The user sets the time and place for the date.

[1784] Input: Date, time, and location information for the date

[1785] Output: Confirmation of configuration information

[1786] Step 2:

[1787] The device sends configuration information to the server.

[1788] Input: Configuration information

[1789] Output: Sending configuration data to the server

[1790] Step 3:

[1791] The server sets up a virtual dating session.

[1792] Input: Received configuration information

[1793] Data processing: Setting up a dating session in a virtual space

[1794] Output: Session setup complete notification

[1795] Step 4:

[1796] The server sends a reminder notification to the user.

[1797] Input: Date and time of the date

[1798] Output: Reminder notification

[1799] Step 5:

[1800] The user accesses the virtual space at the specified time.

[1801] Input: Login information and date / time

[1802] Output: Access to the virtual space

[1803] Step 6:

[1804] The emotion analysis engine analyzes the user's emotions in real time and suggests appropriate dating scenarios and activities.

[1805] Input: User sentiment data

[1806] Data processing: Real-time sentiment analysis and scenario generation

[1807] Output: Proposed dating scenarios and activities

[1808] Implementation Examples of Communication Support

[1809] Step 1:

[1810] The user enters a message and presses the send button.

[1811] Input: Message text

[1812] Output: Message sending command

[1813] Step 2:

[1814] The terminal sends the content to the server.

[1815] Input: Message text

[1816] Output: Sending a message to the server

[1817] Step 3:

[1818] The server uses AI to generate appropriate responses.

[1819] Input: Received message

[1820] Data processing: AI-driven response generation (e.g., GPT-3 model)

[1821] Output: Generated reply

[1822] Step 4:

[1823] The generated reply will be displayed on your device.

[1824] Input: Generated reply data

[1825] Output: Display of reply text

[1826] Step 5:

[1827] The user reviews the reply, makes any necessary corrections, and then sends it.

[1828] Input: Confirmation and Correction

[1829] Output: Sending the revised reply

[1830] Step 6:

[1831] The emotion analysis engine analyzes the message content and the user's facial expressions, and suggests an appropriate response based on their emotions.

[1832] Input: Message text and facial expression data

[1833] Data processing: Sentiment analysis and response generation

[1834] Output: Proposed response

[1835] (Application Example 2)

[1836] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1837] Traditional virtual store systems lacked sufficient user identity verification and privacy protection, and had limited communication and emotional recognition capabilities between users. As a result, it was difficult for users to feel secure while using virtual stores, and the systems failed to provide an engaging shopping experience.

[1838] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for verifying the user's identity using public authentication information, means for converting the user's facial photograph into 2.5 dimensions using image processing technology, and means for analyzing the user's emotions in real time using an emotion engine and providing appropriate product recommendations and activity suggestions. This makes it possible to enhance user identity verification and privacy protection, and to provide the user with the most suitable activities by analyzing emotions in real time.

[1839] "Official authentication information" refers to information issued by a government or certification body to prove an individual's identity.

[1840] "Identity verification" is the process of confirming a user's identity using publicly available authentication information.

[1841] "2.5D rendering of facial photographs" is a technology that represents a user's facial photograph not as a flat image, but as a semi-three-dimensional image with added depth information.

[1842] "Image processing technology" refers to the technology used to analyze, transform, and process digital images.

[1843] A "virtual store" is a virtual shopping space that exists on the internet.

[1844] "Profile information" refers to data that includes personal information such as the user's hobbies, personality, and interests.

[1845] A "database" is a system for storing and managing user profile information, generated facial images, and other data.

[1846] "Compatibility assessment" is a process that selects other users who are a good match for a given user based on their profile information.

[1847] "Artificial intelligence technology" is a technology that enables machines to imitate intelligent human behavior.

[1848] An "emotion engine" is a system that analyzes a user's emotions based on their facial expressions, statements, and other factors.

[1849] A "virtual space" is a real-time, three-dimensional virtual environment built on the internet.

[1850] "Appropriately representing the individual's characteristics" means processing facial photos while protecting privacy, without losing the user's individuality or identifying information.

[1851] "Communication encryption technology" is a technology that converts data into an unreadable format in order to securely send and receive data.

[1852] "Product recommendation" is the process of suggesting products and services that are suitable for a user based on their profile information and emotional state.

[1853] "Activity suggestion" is the process of suggesting enjoyable activities and experiences based on the user's interests and emotional state.

[1854] This invention provides a system that includes user identity verification, privacy protection, 2.5D rendering of facial images, compatibility assessment, emotion recognition, and communication support using artificial intelligence within a virtual store. Each function is described below in turn.

[1855] Implementation of identity verification

[1856] The user launches the app using a device such as a smartphone or tablet. First, identity verification is performed using public authentication information. The user holds their public authentication information (such as a My Number Card) over the device's reader, and the device reads the information. This information is securely transmitted to the server using encryption technology. The server verifies the user's identity by comparing it with the public authentication database and sends the result back to the device.

[1857] 2.5-dimensional rendering of facial photographs

[1858] Next, when a user creates a profile, they upload a photo of their face. The device sends the uploaded photo to the server, which uses image processing technology and generative AI models (such as TensorFlow) to transform the photo into a 2.5-dimensional image. This 2.5-dimensional image is processed to appropriately represent the person's features while protecting their privacy, and is stored in the database as the user's profile information.

[1859] Compatibility assessment method

[1860] When a user enters profile information such as hobbies, personality, and interests, a compatibility engine (ChatGPT-based) generates matching candidates based on that information. The server analyzes the collected information and also considers the user's emotions using an emotion engine. As a result, appropriate matching candidates are selected, and the results are displayed on the device.

[1861] Customer service support within the metaverse

[1862] When a user accesses the virtual store's virtual space at a specified time, an emotion engine analyzes the user's emotions in real time and suggests optimal product recommendations and activities. Artificial intelligence technology is used to facilitate smooth communication between users. The AI ​​analyzes user statements and chat messages to provide appropriate responses and assistance.

[1863] Hardware and software to use

[1864] Hardware: Smartphones, tablets, reader devices

[1865] Software: Python, Flask (for server processing), TensorFlow, OpenCV (for image processing and emotion recognition), Amazon Web Services (for database and authentication processing), ChatGPT (for natural language processing and communication support)

[1866] Specific example

[1867] When a user attempts to access the virtual mall, their identity is first verified using official authentication information. Afterward, the user uploads a photo of their face, which the app then transforms into a 2.5D image and displays in their profile. The user inputs their hobbies and personality information, and the AI ​​selects compatible users. When users enjoy dating in the virtual space, an emotion engine analyzes their emotions and suggests the most suitable activities. For example, if a user is interested in a new product exhibition, the emotion engine can use that information to suggest, "Why not check out the latest summer collection?"

[1868] Example of a prompt

[1869] "User 1's profile information: Name: Taro, Age: 30, Hobbies: Outdoors, Reading, Personality: Sociable. User 2's profile information: Name: Hanako, Age: 28, Hobbies: Cooking, Traveling, Personality: Introverted. Based on this information, perform a compatibility assessment between these users and generate an estimate of how likely a match is to occur."

[1870] This invention provides a system that allows users to enjoy shopping and communication in virtual stores in a safe and private environment.

[1871] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1872] Step 1: Identity Verification

[1873] The user launches the app on a device such as a smartphone or tablet and holds their official authentication information (e.g., My Number Card) over the device's reader. The device securely transmits this information to a server using encryption technology. The server verifies the user's identity by comparing it with the official authentication database. The result is sent back to the device and displayed to the user.

[1874] (Input: Official authentication information, Output: Identity verification result)

[1875] Step 2: Upload a photo and convert it to 2.5D.

[1876] The user uploads a profile picture on the profile creation screen. The device sends the picture to the server, which uses image processing technology and a generative AI model (e.g., TensorFlow) to transform the picture into a 2.5-dimensional image. The generated image is stored in a database and reflected in the user's profile.

[1877] (Input: facial photograph, Output: 2.5-dimensional facial image)

[1878] Step 3: Enter and submit profile information

[1879] The user enters profile information such as hobbies, personality, and interests into the device. The device sends this information to the server, which stores it in a database.

[1880] (Input: Profile information, Output: Sending to server complete)

[1881] Step 4: Compatibility assessment and emotional analysis

[1882] The server generates matching candidates using a compatibility assessment engine (ChatGPT-based) based on the user's profile information. Simultaneously, an emotion engine analyzes the user's profile information and past behavioral data to determine their emotional state. The results of the compatibility assessment and emotion analysis are combined to select the most suitable matching candidate.

[1883] (Input: Profile information, Output: Matching candidate list)

[1884] Step 5: Activities within the virtual store

[1885] Users access the virtual space of a virtual store at a time they specify. An emotion engine analyzes the user's emotions in real time and recommends appropriate products and activities. Artificial intelligence technology (ChatGPT) is used to analyze chats and messages between users and provide appropriate responses and communication support.

[1886] (Input: Real-time sentiment data, Output: Product recommendations and activity suggestions)

[1887] Step 6: Communication Support

[1888] When a user chats or makes a statement in the virtual space, the terminal sends the content to the server, where AI analyzes it and generates an appropriate response. An emotion engine also analyzes the content simultaneously, suggesting responses based on the user's emotional state. This facilitates smooth communication between users.

[1889] (Input: Chat message, Output: AI response)

[1890] By following the steps outlined above, users can enjoy safe and personalized shopping and communication within the virtual store.

[1891] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1892] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1893] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1894] [Fourth Embodiment]

[1895] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1896] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1897] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1898] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1899] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1900] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1901] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1902] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1903] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1904] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1905] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1906] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1907] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1908] This invention relates to a system that includes identity verification using public authentication information, 2.5-dimensional rendering of facial photographs using image processing technology, a compatibility diagnosis engine, a metaverse dating function, and communication support using artificial intelligence technology.

[1909] 1. Implementation of Identity Verification

[1910] The user installs and launches the app. The device requests the reading of official authentication information (e.g., My Number Card). The user holds their My Number Card over the device's reader. The device encrypts the information it reads and sends it to the server. The server verifies the user's identity by comparing it against the official authentication database. The verification result is sent back to the device and displayed to the user.

[1911] As a concrete example, the user opens the app and selects "Identity Verification." The device displays "Please read your card," and the user holds their My Number Card over the reader. The device sends the read information to a server and verifies it against a public database. If successful, "Identity verification complete" is displayed.

[1912] 2. Embodiment of 2.5D rendering of facial photographs

[1913] The user uploads a profile picture on their profile screen. The device sends the photo to a server for image processing, and an image generation AI connected to the server performs 2.5D conversion. The generated 2.5D image is saved on the server and displayed on the user's profile.

[1914] As a concrete example, a user opens the profile editing screen, selects a profile picture, and presses the upload button. The device automatically sends the photo to the server, and the image generation AI begins processing. Once processing is complete, a 2.5D image is reflected in the user's profile.

[1915] 3. Implementation of Compatibility Diagnosis

[1916] The user enters information such as their hobbies, personality, and interests. The device sends this information to the server, and a ChatGPT-based compatibility engine generates matching candidates. A list of candidates is sent back to the device and displayed to the user.

[1917] As a concrete example, a user opens the "Hobbies & Interests" tab and fills in details about their hobbies and personality. After completing the input, they press the "Compatibility Test" button, the device sends the information, and a list of compatible candidates is displayed a few seconds later.

[1918] 4. Embodiment of Metaverse Date

[1919] Based on the compatibility test results, the user sets up a date in the metaverse. The device sends the set date, time, and location to the server, and a virtual session is established. The user accesses the virtual space at the set time and interacts with other users.

[1920] As a concrete example, the user selects a partner from a list of candidates and sets the date, time, and location for the metaverse date. After the setup is complete, the device displays a confirmation message and sends a reminder notification on the day of the date. The user then accesses the virtual space and enjoys the virtual date.

[1921] 5. Implementation Examples of Communication Support

[1922] When a user sends a message to someone, the device sends the content to the server, and AI generates an appropriate reply. The suggested reply is displayed on the device, and the user reviews, modifies, and sends it.

[1923] As a concrete example, a user types a message in the chat screen and presses the send button. The device sends the message to the AI, and after a few seconds, the AI ​​generates a reply. The device displays reply options to the user, who then selects and sends the reply.

[1924] Through the above configuration, the present invention simultaneously provides safety, privacy protection, matching accuracy, and a virtual dating experience, thereby achieving its objectives.

[1925] The following describes the processing flow.

[1926] Identity verification process

[1927] Step 1:

[1928] The user installs the matching app and launches it.

[1929] Step 2:

[1930] The terminal displays an interface requesting the user to read their My Number Card.

[1931] Step 3:

[1932] The user holds their My Number Card over the terminal's reader.

[1933] Step 4:

[1934] The device reads the information from the My Number Card and encrypts the acquired data.

[1935] Step 5:

[1936] The device sends encrypted card information to the server.

[1937] Step 6:

[1938] The server sends the received information to a public authentication database to perform identity verification.

[1939] Step 7:

[1940] The server generates the result of the identity verification (success or failure) and sends it back to the device.

[1941] Step 8:

[1942] The device displays the results of the identity verification to the user.

[1943] Profile creation process

[1944] Step 1:

[1945] The user opens the profile creation screen.

[1946] Step 2:

[1947] The user selects a photo of their face and presses the upload button.

[1948] Step 3:

[1949] The device sends the selected facial image to the image generation AI and requests 2.5-dimensional processing.

[1950] Step 4:

[1951] An image generation AI connected to the server processes facial images by converting them into 2.5D.

[1952] Step 5:

[1953] The server saves the generated 2.5D image to a database and links it to the user ID.

[1954] Step 6:

[1955] The server sends a URL for the 2.5D image back to the terminal and displays it to the user.

[1956] Compatibility assessment process

[1957] Step 1:

[1958] The user enters their profile information (hobbies, personality, interests, etc.).

[1959] Step 2:

[1960] The device sends the entered profile information to the server.

[1961] Step 3:

[1962] The server passes the profile information stored in the ChatGPT-based compatibility engine.

[1963] Step 4:

[1964] The server performs a compatibility check and generates a list of matching candidates.

[1965] Step 5:

[1966] The server sends a list of potential matches back to the terminal and displays it to the user.

[1967] Metaverse dating process

[1968] Step 1:

[1969] Users select someone they are interested in based on compatibility test results and set the time and place for a metaverse date.

[1970] Step 2:

[1971] The device sends information about the set time and location to the server.

[1972] Step 3:

[1973] The server sets up a dating session in a virtual space and saves the necessary data to the database.

[1974] Step 4:

[1975] The user logs in to access the virtual space at a time they have set.

[1976] Step 5:

[1977] The server authenticates access and sends the data necessary for the virtual space dating session.

[1978] Step 6:

[1979] Users enjoy dating other users in a virtual space.

[1980] Communication support process

[1981] Step 1:

[1982] The user enters a message in the chat screen.

[1983] Step 2:

[1984] The terminal sends the entered message to the server.

[1985] Step 3:

[1986] The server passes the message content to the AI ​​engine, which then generates appropriate replies and other responses.

[1987] Step 4:

[1988] The server sends the generated reply message to the terminal.

[1989] Step 5:

[1990] The device displays the reply to the user and asks for confirmation or correction.

[1991] Step 6:

[1992] The user sends the revised message and continues the chat.

[1993] (Example 1)

[1994] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1995] In modern online dating and communication systems, user identity verification, privacy protection, advanced compatibility assessment, virtual dating experiences, and communication support are critical challenges. In particular, there is a need to simultaneously provide secure handling of personal information and a realistic virtual experience. Currently, no system exists that integrates these functions, resulting in user inconvenience.

[1996] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1997] In this invention, the server includes means for verifying the user's identity using public authentication information, means for converting the user's facial image into 2.5 dimensions using image processing technology, means for maintaining a database containing the generated facial image and the user's profile information, means for selecting other compatible users based on the user's hobbies and personality information, means for enabling selected users to date in a virtual space, means for using artificial intelligence technology to support communication between users, means including technology for encrypting user input information and transmitting it to the server, means for the server to compare the information entered by the user with a public authentication database, means for transmitting a facial image to the server and for the server to convert it into 2.5 dimensions using image generation AI, means for a compatibility diagnosis engine to generate compatible matching candidates from user data, means for setting up a virtual space session and connecting users, and means for the server to analyze the message content with AI and generate an appropriate reply. This makes it possible for users to enjoy matching and communication to a high degree in a safe and privacy-protected environment.

[1998] "Official authentication information" refers to information issued by the government or public institutions to prove an individual's identity.

[1999] A "user" refers to an individual user who utilizes the system, and is the entity that performs various operations through a terminal.

[2000] A "terminal" is an electronic device that a user operates to input and display information, and includes smartphones and personal computers.

[2001] A "server" is a computer device that forms the core of a system, processing and storing data, and communicating with other terminals.

[2002] A "face photo" is image data of the user's own face.

[2003] "Image processing technology" refers to all technologies used to analyze and process image data such as photographs and videos.

[2004] "2.5-dimensionalization" is a technique that adds depth and a sense of three-dimensionality to two-dimensional image data, processing it to make it appear nearly three-dimensional.

[2005] "Profile information" refers to information that includes data such as the individual user's characteristics, attributes, and interests.

[2006] A "database" is an electronic data storage system for systematically storing and managing information.

[2007] "Hobbies and personality information" refers to information that represents a user's everyday interests and personality traits.

[2008] "Compatibility assessment" is a process that evaluates how well a user is compatible with other users based on their hobbies and personality information.

[2009] A "virtual space" is a digital space created with computer graphics that, while not real, offers a sense of realism.

[2010] "Going on a date" refers to an activity where selected users meet and interact with each other in a virtual space.

[2011] "Communication support" refers to technologies and systems that facilitate the exchange of messages between users.

[2012] "Artificial intelligence technology" refers to technology that imitates human intelligence and possesses functions such as learning, reasoning, and problem-solving.

[2013] "Encryption" is a technology that transforms information using a specific algorithm, making it incomprehensible to third parties.

[2014] A "compatibility diagnosis engine" is a general term for algorithms and systems that select other users who are compatible with the user based on the user's input information.

[2015] A "session" refers to a series of activities or periods in which a user utilizes a system or service.

[2016] "Generating a reply" refers to the process of creating an appropriate response to a received message.

[2017] This invention is an integrated system that enables identity verification using public authentication information, 2.5-dimensional rendering of facial images, compatibility diagnosis, metaverse dating, and communication support. Specific embodiments of this system are described below.

[2018] Implementation method of identity verification

[2019] First, the user installs and launches the app. The device prompts the user to read official authentication information (e.g., My Number Card). When the user holds the My Number Card over the device's reader, the device encrypts the information it reads and sends it to the server. The server verifies the user's identity by comparing it with the public authentication database, sends the result back to the device, and displays it to the user. As a specific example, the user launches the app, selects "Identity Verification," and holds the My Number Card over the reader. The device sends the encrypted information to the server, which is then compared with the public database. If successful, "Identity verification complete" is displayed.

[2020] Embodiment of 2.5D rendering of facial photographs

[2021] The user uploads a profile picture on their profile screen. The device sends the photo to a server, where a generative AI connected to the server performs a 2.5-dimensional transformation. The generated 2.5-dimensional image is stored on the server and displayed on the user's profile. For example, the user selects a profile picture on the profile editing screen and presses the upload button. The device sends the photo to the server, and the image generation AI performs the 2.5-dimensional transformation. Once the process is complete, the image is displayed on the user's profile.

[2022] Compatibility assessment method

[2023] The user enters information such as hobbies, personality, and interests within the app. The device sends this information to a server, and a ChatGPT-based compatibility engine generates matching candidates. The generated candidate list is sent back to the device and displayed to the user. For example, the user opens the "Hobbies & Interests" tab, enters information, and runs the "Compatibility Test." The device sends the information to the server, and a list of compatible candidates is displayed a few seconds later.

[2024] Metaverse Date Implementation

[2025] Based on compatibility test results, the user sets up a date in the metaverse. The device sends the set date, time, and location information to the server, and the server sets up a virtual session. The user accesses the virtual space at the set time and interacts with other users. For example, the user selects a partner from a candidate list and sets the date, time, and location for the metaverse date. The device displays a confirmation message and sends a reminder notification as the time approaches. At the set time, the user accesses the virtual space and enjoys the virtual date.

[2026] Implementation Examples of Communication Support

[2027] When a user types a message to another person, the device sends the message to a server, and AI generates an appropriate reply. The suggested reply is displayed on the device, and the user reviews or modifies it before finally sending it. For example, a user types a message in the chat screen and presses the send button. The device sends the message to the server, and after a few seconds, the AI ​​generates a reply. The device displays the suggested reply options to the user, who then reviews and sends it.

[2028] Example prompts for a generative AI model

[2029] The following are examples of prompt statements related to a series of processes:

[2030] Prompt message regarding identity verification:

[2031] Please explain the step-by-step process for users to authenticate their identity by holding their My Number Card over a reader.

[2032] Prompt message regarding 2.5D conversion of facial images:

[2033] Please provide a detailed explanation of the processing flow for converting a user's profile picture to 2.5D.

[2034] Prompt message regarding compatibility assessment:

[2035] Please describe the process by which users input information about their hobbies and interests to perform a compatibility assessment.

[2036] Prompt message regarding metaverse dating:

[2037] Please provide detailed instructions on how users can set up and enjoy a metaverse date.

[2038] Prompt messages regarding communication support:

[2039] Please describe in detail the process by which AI is used to generate replies when a user sends a message.

[2040] In the above configuration, the present invention enables users to receive multiple high-performance services in a safe and privacy-protected environment. This significantly improves user convenience and enhances overall satisfaction.

[2041] The flow of the specific processing in Example 1 will be explained using Figure 11.

[2042] Implementation method of identity verification

[2043] Step 1:

[2044] The user installs and launches the app.

[2045] Input: App installation and launch operations.

[2046] Output: The app launches and the initial screen is displayed.

[2047] Specifically, the user downloads the app from their smartphone's app store and completes the installation. After installation, the user taps the app icon to launch the app.

[2048] Step 2:

[2049] The device requests to read public authentication information.

[2050] Input: Initial screen after launching the app.

[2051] Output: A screen prompting the preparation of official authentication information.

[2052] Specifically, the device will display the message "Please have your My Number Card ready" on the screen.

[2053] Step 3:

[2054] The user holds their My Number Card over the terminal's reader.

[2055] Input: User's My Number Card.

[2056] Output: Data that the device reads from public authentication information.

[2057] Specifically, the user holds their My Number Card over the NFC reader on the terminal. The terminal scans the information on the card and converts it into digital data.

[2058] Step 4:

[2059] The device encrypts the information it reads and sends it to the server.

[2060] Input: Public authentication information read from the document.

[2061] Output: Encrypted public authentication information.

[2062] Specifically, the terminal encrypts the data using AES256 and sends it to the server using the HTTPS protocol.

[2063] Step 5:

[2064] The server verifies the user's identity by matching them against a public authentication database.

[2065] Input: Encrypted public authentication information.

[2066] Output: Matching result.

[2067] Specifically, the server decrypts the received data and accesses a public authentication database to perform verification.

[2068] Step 6:

[2069] The server sends the verification result back to the terminal and displays it to the user.

[2070] Input: Matching result.

[2071] Output: Display of identity verification results.

[2072] Specifically, the server sends the verification result back to the terminal, and the terminal displays "Identity verification complete."

[2073] Embodiment of 2.5D rendering of facial photographs

[2074] Step 1:

[2075] The user uploads a profile picture on their profile screen.

[2076] Input: User's profile picture.

[2077] Output: Upload instruction.

[2078] Specifically, the user presses the "Select Photo" button on the profile editing screen, selects a photo of their face from their smartphone's gallery, and uploads it.

[2079] Step 2:

[2080] The device sends the photo data to the server.

[2081] Input: User's profile picture.

[2082] Output: Sending photo data to the server.

[2083] Specifically, the terminal compresses the selected image data and sends it to the server in JPEG format.

[2084] Step 3:

[2085] The generation AI connected to the server performs the 2.5-dimensional transformation.

[2086] Input: Face photo data.

[2087] Output: 2.5-dimensional image data.

[2088] Specifically, the server receives a facial image, passes it to an image generation AI (such as StyleGAN), and performs a 2.5-dimensional transformation.

[2089] Step 4:

[2090] The server saves the generated 2.5D image, sends it back to the terminal, and displays it to the user.

[2091] Input: 2.5-dimensional image.

[2092] Output: The image displayed in the user's profile.

[2093] Specifically, the server saves the generated image to a database and sends it to the terminal. The terminal receives the image and displays it in the user's profile.

[2094] Compatibility assessment method

[2095] Step 1:

[2096] Users enter information such as their hobbies, personality, and interests.

[2097] Input: Hobbies, personality, and interests.

[2098] Output: Input completion information.

[2099] In terms of specific actions, the user enters information into a form on the app's "Hobbies & Interests" tab (e.g., watching movies, reading, traveling, etc.).

[2100] Step 2:

[2101] The device sends this information to the server.

[2102] Input: Hobbies, personality, and interests.

[2103] Output: Sending information to the server.

[2104] Specifically, the terminal sends the input data to the server in JSON format.

[2105] Step 3:

[2106] A compatibility diagnostic engine connected to the server generates matching candidates.

[2107] Input: User information.

[2108] Output: Matching candidate list.

[2109] Specifically, the server launches a ChatGPT-based compatibility assessment engine and lists compatible candidates based on the information received.

[2110] Step 4:

[2111] The server sends a list of matching candidates back to the terminal and displays it to the user.

[2112] Input: Matching candidate list.

[2113] Output: Display of candidate list.

[2114] Specifically, the server sends a list of candidates to the terminal, and the terminal displays it on the user's screen.

[2115] Metaverse Date Implementation

[2116] Step 1:

[2117] Users set up dates in the metaverse based on their compatibility test results.

[2118] Input: Compatibility test results, date settings.

[2119] Output: Configuration details.

[2120] Specifically, the user selects a partner from a list of candidates and sets the date, time, and location for the date.

[2121] Step 2:

[2122] The device sends information about the configured date, time, and location to the server.

[2123] Input: Date settings information.

[2124] Output: Sending configuration information to the server.

[2125] Specifically, the device sends configuration information to the server.

[2126] Step 3:

[2127] The server sets up a session in the virtual space.

[2128] Input: Date settings information.

[2129] Output: URL and access information for the virtual space session.

[2130] Specifically, the server creates a virtual session at the specified date and time and generates access information.

[2131] Step 4:

[2132] Users access the virtual space at a set date and time and interact with other users.

[2133] Input: Access information for the virtual space.

[2134] Output: Interaction in a virtual space.

[2135] In concrete terms, the user accesses a virtual space and interacts with others through conversation and avatar control.

[2136] Implementation Examples of Communication Support

[2137] Step 1:

[2138] The user enters a message for the other party.

[2139] Input: Message content.

[2140] Output: Ready to send.

[2141] Specifically, the user types a message in the chat screen and presses the send button.

[2142] Step 2:

[2143] The terminal sends a message to the server.

[2144] Input: Message content.

[2145] Output: Sending a message to the server.

[2146] Specifically, the terminal sends a message to the server.

[2147] Step 3:

[2148] The AI ​​on the server generates an appropriate response.

[2149] Input: User's message.

[2150] Output: Generated reply suggestions.

[2151] Specifically, the AI ​​on the server (e.g., ChatGPT) analyzes the received message and generates a reply.

[2152] Step 4:

[2153] The server sends the suggested reply back to the terminal, and the user reviews, corrects, and submits it.

[2154] Input: Generated reply suggestions.

[2155] Output: Sending the final reply.

[2156] Specifically, the server sends the generated reply options to the terminal, which then displays them to the user. The user reviews the reply, makes any necessary corrections, and then sends it.

[2157] The above outlines the specific steps involved in each program process of this system.

[2158] (Application Example 1)

[2159] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2160] Traditional dating applications lacked sufficient identity verification, privacy protection, and compatibility assessment features, resulting in a lack of trust and security for users. Furthermore, systems offering virtual dating and adventure experiences often suffered from inadequate device integration and communication support, diminishing the real-world interaction experience.

[2161] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[2162] This invention includes a server that provides means for verifying the user's identity using public authentication information, means for transforming the user's facial photograph into a 2.5-dimensional image using image processing technology, means for maintaining a database containing the generated facial image and the user's profile information, means for selecting compatible users based on the user's hobbies and personality information, means for enabling selected users to date in a virtual space, means for using artificial intelligence technology to support communication between users, and means for providing virtual dating and adventures via smartphones and head-mounted displays. As a result, users can receive reliable identity verification in a safe and private environment, and enjoy a near-realistic virtual experience through smartphones and head-mounted displays while receiving advanced communication support using AI.

[2163] "Official authentication information" refers to information issued by public institutions and used to verify an individual's identity.

[2164] "Identity verification" is the process of confirming that a user is indeed who they claim to be, using official authentication information.

[2165] "2.5-dimensionalization" is a process that uses image processing technology to add some three-dimensional elements to a flat, two-dimensional image of a user's face, giving it a sense of depth.

[2166] "Profile information" refers to data that includes basic user information, such as facial images, hobbies, and personality.

[2167] "Compatibility assessment" is a process that selects other users who are compatible with the user based on the hobbies and personality information entered by the user.

[2168] A "virtual space" is a digital, three-dimensional environment created by a computer, where users interact through avatars.

[2169] "Artificial intelligence technology" refers to technology that enables computers to possess knowledge and skills like humans, and to perform tasks such as learning, reasoning, and judgment.

[2170] A "head-mounted display" is a display device worn on the user's head, used to visually experience a virtual space.

[2171] This invention relates to a virtual entertainment application that allows users to enjoy dating and adventures in a virtual space. This application has a variety of functions, including identity verification, 2.5D rendering of facial images, compatibility diagnosis, metaverse dating, and AI-powered communication support.

[2172] The server performs identity verification using public authentication information. When a user launches a smartphone application and reads their public authentication information (e.g., My Number Card), the information is encrypted and sent to the server. The server verifies the user's identity by comparing it with a public database, and then sends the result back to the device for display to the user.

[2173] Next, image processing is performed to convert the user's facial image into a 2.5D image. When a user uploads a facial image on their profile screen, the image is sent to the server. An image generation AI connected to the server processes the facial image and generates a 2.5D image. The generated image is stored on the server and displayed on the user's profile.

[2174] Subsequently, a compatibility assessment is conducted based on the user's hobbies and personality information. When the user enters information about their hobbies and personality, that information is sent to the server. A ChatGPT-based compatibility assessment engine analyzes the information and selects other compatible users. The list of selected candidates is returned to the device and displayed to the user.

[2175] Selected users can arrange dates in a virtual space. Once users set the date, time, and location for a metaverse date, that information is sent to the server, and a virtual space session is established. Users can access the virtual space at the scheduled time and enjoy dates and adventures with other users. This can be done using smartphones or head-mounted displays.

[2176] Furthermore, artificial intelligence technology is used to support communication between users. When a user sends a chat or voice message, its content is sent to the server. The AI ​​generates an appropriate reply, and the suggestion is displayed on the user's device. The user can review, modify, and send the suggested reply.

[2177] As a concrete example, by inputting the following prompt sentences into the AI ​​model, it is possible to provide specific guidance on how the user should use the application:

[2178] Design a virtual entertainment app that allows users to set up dates using 2.5D avatars in a virtual space. The system will include identity verification using public authentication information, 2.5D rendering of facial images using image processing technology, a compatibility diagnosis engine, a metaverse dating function, and communication support using artificial intelligence technology. Technologies to be used: face_recognition, OpenCV, PIL, requests, Python.

[2179] Thus, this invention is a comprehensive system that allows users to enjoy virtual dating and adventure experiences in a safe and reliable environment.

[2180] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[2181] Step 1:

[2182] The user launches the application and reads their public authentication information. The user holds their My Number Card over the reader on their smartphone. This input reads the user's public authentication information. The device encrypts the read information and sends it to the server. In this process, the data is encrypted before transmission, ensuring security.

[2183] Step 2:

[2184] The server compares the received public authentication information with a public database. Based on the comparison, it determines whether or not identity verification is successful and sends the result back to the terminal. The information sent back includes whether or not authentication was successful. The terminal displays the result to the user, and identity verification is completed.

[2185] Step 3:

[2186] The user uploads a profile picture on their profile screen. This input sends the image data of the profile picture from the device to the server. An image generation AI connected to the server processes the received image data to generate a 2.5D image. This process transforms a flat 2D image into a three-dimensional 2.5D image. The generated image is saved on the server and displayed on the user's profile.

[2187] Step 4:

[2188] The user enters information about their hobbies and personality to begin the compatibility assessment. This input data is sent from the terminal to the server. A ChatGPT-based compatibility assessment engine connected to the server analyzes the user's information and selects other compatible users. This analysis generates a list of users that match the user's hobbies and personality. The selected list of candidates is sent back to the terminal and displayed to the user.

[2189] Step 5:

[2190] The user sets the date, time, and location for the metaverse date. This setting information is sent from the device to the server. The server uses this information to set up the virtual space session. This process prepares the virtual date. At the set date and time, the user accesses the virtual space using a smartphone or head-mounted display and enjoys the date.

[2191] Step 6:

[2192] When a user communicates with another user, they input messages or voice data. The input data is sent from the device to a server, which uses AI to generate appropriate replies. This process enables natural conversation. The generated reply is sent back to the device and displayed to the user. The user can review, modify, and send the suggested reply.

[2193] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[2194] This invention relates to a system that combines identity verification using public authentication information, 2.5-dimensional rendering of facial photographs using image processing technology, a compatibility diagnosis engine, a metaverse date function, communication support using artificial intelligence technology, and an emotion engine.

[2195] 1. Implementation of Identity Verification

[2196] The user installs and launches the app. The device displays an interface requesting the reading of public authentication information, and the user holds their authentication card over the reader. The device encrypts the information it reads and sends it to the server. The server verifies the user's identity using the public authentication database and sends the result back to the device. The device displays the authentication result to the user.

[2197] As a concrete example, a user opens the app, selects "Identity Verification," and holds their My Number Card over the device. The device reads the information, encrypts it, sends it to the server, and after matching it with a public database, displays "Identity verification complete."

[2198] 2. Embodiment of 2.5D rendering of facial photographs

[2199] The user uploads a photo of their face on the profile creation screen. The device sends the photo to the server, where an image generation AI transforms it into a 2.5D image. The generated image is stored on the server and displayed on the user's profile.

[2200] As a concrete example, a user selects a photo of their face and presses the upload button. The device sends the photo to the server, and an image generation AI generates a 2.5D image. The generated image is then reflected in the user's profile.

[2201] 3. Implementation of Compatibility Diagnosis

[2202] The user enters profile information such as hobbies, personality, and interests. The device sends this information to the server, and a ChatGPT-based compatibility engine generates matching candidates. The candidate list is sent back to the device and displayed to the user. Additionally, an emotion engine recognizes the user's emotions and reflects them in the diagnosis results.

[2203] As a concrete example, a user enters detailed profile information and starts a "compatibility test." The device sends the information to the server, the compatibility test engine generates a list of candidates, the emotion engine analyzes the user's emotions, and the most suitable list of candidates is displayed.

[2204] 4. Embodiment of Metaverse Date

[2205] The user sets the time and place for a date based on the compatibility assessment results. The device sends the setting information to the server, and a virtual dating session is set up. The user accesses the virtual space at the specified time and interacts with other users. The emotion engine analyzes the user's emotions in real time and suggests appropriate dating scenarios and activities.

[2206] As a concrete example, the user selects a partner from a candidate list and sets the date, time, and location for the metaverse date. The device sends the information to the server and sends a reminder notification on the day of the date. The user accesses the virtual space, and during the date, an emotion engine analyzes the user's emotions and suggests the most suitable activities.

[2207] 5. Implementation Examples of Communication Support

[2208] When a user sends a message, the device sends the content to the server, and the AI ​​generates an appropriate reply. The generated reply is displayed on the device, and the user reviews, modifies, and sends it. In addition, the emotion engine analyzes the message content and the user's facial expressions to suggest an appropriate response based on their emotions.

[2209] As a concrete example, a user types and sends a message in the chat screen. The device sends the message to the server, and the AI ​​generates a reply. The emotion engine analyzes the message content and the user's emotions, and an appropriate reply is displayed on the device. The user then modifies and sends the reply.

[2210] Through the above configuration, the present invention simultaneously provides reliable identity verification, privacy protection, and compatibility diagnosis and communication support utilizing emotion recognition, thereby realizing a safe and effective matching experience.

[2211] The following describes the processing flow.

[2212] Identity verification process

[2213] Step 1:

[2214] The user installs the matching app and launches it.

[2215] Step 2:

[2216] The terminal displays an interface requesting the user to read their My Number Card.

[2217] Step 3:

[2218] The user holds their My Number Card over the terminal's reader.

[2219] Step 4:

[2220] The device reads the information from the My Number Card and encrypts the acquired data.

[2221] Step 5:

[2222] The device sends encrypted card information to the server.

[2223] Step 6:

[2224] The server sends the received information to a public authentication database to perform identity verification.

[2225] Step 7:

[2226] The server generates the result of the identity verification (success or failure) and sends it back to the device.

[2227] Step 8:

[2228] The device displays the results of the identity verification to the user.

[2229] Profile creation process

[2230] Step 1:

[2231] The user opens the profile creation screen.

[2232] Step 2:

[2233] The user selects a photo of their face and presses the upload button.

[2234] Step 3:

[2235] The device sends the selected facial image to the image generation AI and requests 2.5-dimensional processing.

[2236] Step 4:

[2237] An image generation AI connected to the server processes facial images by converting them into 2.5D.

[2238] Step 5:

[2239] The server saves the generated 2.5D image to a database and links it to the user ID.

[2240] Step 6:

[2241] The server sends a URL for the 2.5D image back to the terminal and displays it to the user.

[2242] Compatibility assessment process

[2243] Step 1:

[2244] The user enters their profile information (hobbies, personality, interests, etc.).

[2245] Step 2:

[2246] The device sends the entered profile information to the server.

[2247] Step 3:

[2248] The server passes the registered profile information to a ChatGPT-based compatibility assessment engine.

[2249] Step 4:

[2250] The server performs a compatibility check and generates a list of matching candidates.

[2251] Step 5:

[2252] The server sends a list of potential matches back to the terminal and displays it to the user.

[2253] Step 6:

[2254] The server uses an emotion engine to recognize the user's emotions and reflect them in the diagnostic results.

[2255] Metaverse dating process

[2256] Step 1:

[2257] Users select someone they are interested in based on compatibility test results and set the time and place for a metaverse date.

[2258] Step 2:

[2259] The device sends information about the set time and location to the server.

[2260] Step 3:

[2261] The server sets up a dating session in a virtual space and saves the necessary data to the database.

[2262] Step 4:

[2263] The user logs in to access the virtual space at a time they have set.

[2264] Step 5:

[2265] The server authenticates access and sends the data necessary for the virtual space dating session.

[2266] Step 6:

[2267] Users enjoy dating other users in a virtual space.

[2268] Step 7:

[2269] The server uses an emotion engine to analyze the user's emotions in real time and suggest appropriate dating scenarios and activities.

[2270] Communication support process

[2271] Step 1:

[2272] The user enters a message in the chat screen.

[2273] Step 2:

[2274] The terminal sends the entered message to the server.

[2275] Step 3:

[2276] The server passes the message content to the AI ​​engine, which then generates appropriate replies and other responses.

[2277] Step 4:

[2278] The server sends the generated reply message to the terminal.

[2279] Step 5:

[2280] The device displays the reply to the user and asks for confirmation or correction.

[2281] Step 6:

[2282] The user sends the revised message and continues the chat.

[2283] Step 7:

[2284] The server uses an emotion engine to analyze the message content and the user's facial expressions, and then suggests an appropriate response based on those emotions.

[2285] (Example 2)

[2286] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2287] While online matching systems have become commonplace in modern society, they face numerous challenges in terms of protecting user privacy, accurate identity verification, secure information transmission, and communication support. For example, traditional systems have a high risk of users' personal information being leaked to third parties, and suffer from low accuracy in compatibility assessments and poor communication quality. Furthermore, virtual interactions lack real-time emotion recognition and optimal activity suggestions, resulting in insufficient improvements to the user experience. There is a need to solve these problems and provide safer and more reliable online matching systems.

[2288] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[2289] In this invention, the server includes means for verifying the user's identity using public authentication information; means for creating a 2.5-dimensional representation of the user's facial image using image processing technology; means for maintaining a database containing the generated facial image and the user's profile information; means for selecting compatible users based on the user's hobbies and personality information; means for enabling the selected users to interact with each other in a virtual space; means for using artificial intelligence technology to support communication between users; means for analyzing the user's emotions using an emotion analysis engine and reflecting this in the diagnosis results and interaction content; means for securely transmitting authentication information using encryption technology; and means for analyzing the user's activities in the virtual space in real time and suggesting optimal actions. This enables accurate identity verification and secure information transmission while protecting user privacy, and also realizes emotion recognition and optimal activity suggestions to improve the user experience.

[2290] "Official authentication information" refers to authentication information issued by a public institution that is used to verify the user's identity. Examples include My Number cards and driver's licenses.

[2291] "2.5-dimensionalization" is a process that adds depth information to conventional 2D images, giving them a pseudo-three-dimensional appearance. This makes the image appear more three-dimensional.

[2292] "User profile information" refers to information such as hobbies, personality, and interests that users enter, and is used for matching and providing personalized services.

[2293] "Selecting compatible other users" means identifying other users who are deemed to be mutually compatible, based on user profile information and using statistical or learning models.

[2294] A "virtual space" is a three-dimensional virtual environment created by a computer, a space in which users can interact with each other.

[2295] "Artificial intelligence technology" refers to technologies that allow computers to mimic the workings of human intelligence, and includes natural language processing, machine learning, and deep learning.

[2296] An "emotion analysis engine" is an algorithm or software that analyzes a user's facial expressions and message content to estimate their emotional state.

[2297] "Encryption technology" is a technique that transforms transmitted information so that it cannot be read by a third party, and is used for secure information transmission. Examples of encryption methods include AES and RSA.

[2298] "Suggesting the optimal action" means analyzing the user's activities and emotional state and presenting the most appropriate action or option in real time. This improves the user experience.

[2299] Modes for carrying out the invention

[2300] This invention relates to a system that combines identity verification using public authentication information, 2.5-dimensional rendering of facial images using image processing technology, a compatibility diagnosis engine, a virtual space interaction function, communication support using artificial intelligence technology, and an emotion analysis engine. The configuration and operation for realizing each of these technological elements with specific hardware and software will be described in detail below.

[2301] Implementation method of identity verification

[2302] The user installs and launches a dedicated application. The application displays an interface for reading official authentication information using the authentication card reader built into the device. Examples include My Number cards and driver's licenses. When the user holds the authentication card over the reader, the device encrypts the information using AES encryption and sends it to the server. The server accesses the public authentication database, verifies the user's identity, and sends the result back to the device. The device then displays the authentication result to the user.

[2303] Embodiment of 2.5D rendering of facial photographs

[2304] The user uploads a profile picture on the profile creation screen. The device sends the photo to the server, where a generative AI model (e.g., StyleGAN) is used to convert it into a 2.5-dimensional image. The generated image is stored in the server's database and reflected in the user's profile.

[2305] Compatibility assessment method

[2306] The user enters profile information such as hobbies, personality, and interests. The device sends this information to the server, and a ChatGPT-based compatibility engine generates matching candidates. Furthermore, an emotion analysis engine recognizes the user's emotions and reflects them in the diagnosis results, creating a more accurate candidate list. Finally, the candidate list is displayed to the user.

[2307] Implementation of interaction in virtual space

[2308] The user sets the time and place for a date based on the compatibility assessment results. The device sends this setting information to the server, and a virtual dating session is set up. When the user accesses the virtual space at the specified date and time, they can interact with other users. An emotion analysis engine analyzes the user's emotions in real time and suggests appropriate dating scenarios and activities.

[2309] Implementation Examples of Communication Support

[2310] When a user sends a message, the device sends its content to the server, and the AI ​​generates an appropriate reply. The generated reply is displayed on the device, and the user reviews, modifies, and sends it. In addition, an emotion analysis engine analyzes the message content and the user's facial expressions to suggest an appropriate response based on their emotions.

[2311] Examples of specific cases and prompt statements

[2312] The following are specific examples of the system of the present invention.

[2313] Examples of identity verification:

[2314] The user opens the app, selects "Identity Verification," and holds their My Number Card over the reader. The device reads the information, encrypts it, sends it to the server, and after matching it with the public database, displays "Identity verification complete."

[2315] Examples of prompts for a generative AI model:

[2316] "The user sets the date, time, and location for a metaverse date, and the device sends this information to the server. The user accesses the metaverse at the specified time and begins dating other users. The sentiment analysis engine should analyze the user's emotions and suggest the most suitable activities."

[2317] This invention is a system that prioritizes user privacy protection and provides a superior user experience by combining accurate identity verification, secure information transmission, highly accurate compatibility assessment, and real-time sentiment analysis.

[2318] The flow of the specific processing in Example 2 will be explained using Figure 13.

[2319] Implementation method of identity verification

[2320] Step 1:

[2321] The user launches the app.

[2322] Input: Tap the application icon or touch the screen.

[2323] Output: Startup screen displayed

[2324] Step 2:

[2325] The device displays an interface requesting the reading of public authentication information.

[2326] Input: Application initialization information

[2327] Output: Display of the My Number Card or driver's license reading screen.

[2328] Step 3:

[2329] The user holds their authentication card over the reader.

[2330] Input: Authentication card (My Number Card or driver's license)

[2331] Output: Read authentication information

[2332] Step 4:

[2333] The device encrypts the information it reads and sends it to the server.

[2334] Input: Authentication information

[2335] Data processing: Apply AES encryption.

[2336] Output: Encrypted credentials

[2337] Step 5:

[2338] The server uses a public authentication database to verify the user's identity.

[2339] Input: Encrypted credentials

[2340] Data processing: Database matching

[2341] Output: Authentication result (success / failure)

[2342] Step 6:

[2343] The server sends the results back to the terminal.

[2344] Input: Authentication result

[2345] Output: Sending results to the terminal

[2346] Step 7:

[2347] The device displays the authentication result to the user.

[2348] Input: Authentication result

[2349] Output: Display of authentication result screen (e.g., "Identity verification complete," "Identity verification failed")

[2350] Embodiment of 2.5D rendering of facial photographs

[2351] Step 1:

[2352] The user accesses the profile creation screen.

[2353] Input: Menu Selection

[2354] Output: Display of the profile creation screen

[2355] Step 2:

[2356] The user uploads a photo of their face.

[2357] Input: Face photo file

[2358] Output: Photo selection and preparation for u...

Claims

1. A means of verifying the user's identity using public authentication information, A means of transforming a user's facial photograph into a 2.5-dimensional object using image processing technology, A means for maintaining a database containing generated facial images and user profile information, A method for selecting compatible users based on the user's hobbies and personality information, A means by which selected users can date in a virtual space, A system that includes means of using artificial intelligence technology to support communication between users.

2. The system according to claim 1, wherein when a user enters public authentication information, the information is securely transmitted using encryption technology.

3. The system according to claim 1, which uses image generation technology to appropriately represent the characteristics of a person while protecting their privacy when converting a facial photograph into a 2.5-dimensional image.

Images