System

Abstract

To provide a system for allowing a user to easily select an appropriate cosmetic surgery option, compare prices and information of clinics, and receive a treatment with peace of mind.SOLUTION: A means for inputting basic information of a user, a means for acquiring 3D scan data of a face of the user, a means for transmitting the acquired 3D scan data to a server, a means for the server analyzing the 3D scan data and generating cosmetic surgery options, a means for the server transmitting the cosmetic surgery options to a terminal, a means for the user selecting from the options and transmitting the selection data to the server, and a means for the server generating hospital and price information based on the selected options; The system includes a means for transmitting to a terminal, a means for performing a reservation procedure on the basis of a finally selected clinic and price information by a user, and a means for collecting evaluation data of the user by a server providing after-care information after medical treatment.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Despite interest in cosmetic surgery, a lack of information about procedures and options makes it difficult for the general public to easily access and make reliable decisions. Furthermore, there are few ways to easily compare prices and clinics, making it difficult to make the best choice. [Means for solving the problem]

[0005] A means for inputting basic user information;

[0006] a means for obtaining a 3D scan of the user's face;

[0007] A means for transmitting the acquired 3D scan data to a server;

[0008] A means by which the server analyzes the 3D scan data and generates cosmetic surgery options;

[0009] a means for the server to transmit cosmetic surgery options to the terminal;

[0010] means for the user to select from the options and transmit the selection to the server;

[0011] means for the server to generate clinic and price information based on the selected options and transmit the information to the terminal;

[0012] A means for the user to make a reservation based on the clinic and price information they have finally selected;

[0013] A means for the server to provide aftercare information after the treatment and collect user evaluation data;

[0014] By providing a system including this, we will create an environment where users can easily select appropriate cosmetic surgery options, compare prices and clinic information, and receive treatment with peace of mind.

[0015] "Basic User Information" means basic information necessary to identify an individual, such as the user's name, age, gender, and contact information.

[0016] "3D scan data" is digital data that captures the shape and features of a user's face in three dimensions.

[0017] "Server" means the computer system that analyzes the 3D scan data, generates cosmetic surgery options, and stores and transmits information.

[0018] "Analysis" refers to the process of analyzing facial features based on the acquired 3D scan data and generating specific cosmetic surgery options.

[0019] "Cosmetic Surgery Options" are various cosmetic surgery procedures and plans suggested to you based on your specific facial features and needs.

[0020] "Terminal" means a smartphone, tablet, or other device operated by a user.

[0021] "Preference Data" refers to information about the treatment plan a user selects from among cosmetic surgery options.

[0022] "Clinic and Pricing Information" provides detailed information about the clinics offering each cosmetic surgery option and the costs associated with the procedure.

[0023] The "booking process" is the process by which a user confirms the clinic and date / time for the cosmetic surgery procedure they have selected.

[0024] "Aftercare information" refers to information regarding care and precautions after a treatment, including instructions that the user needs after the treatment.

[0025] "Evaluation data" refers to data collected after a treatment regarding user impressions, satisfaction, and other feedback. [Brief explanation of the drawings]

[0026] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0027] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0028] First, the terms used in the following description will be explained.

[0029] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0030] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0031] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0032] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0033] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0034] [First embodiment]

[0035] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0036] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0037] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0038] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0039] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0040] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0041] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0042] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0043] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0044] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0045] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0046] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0047] The present invention relates to a system that simplifies the process of selecting and booking cosmetic surgery procedures. The system allows users to obtain detailed data about their face through 3D scanning, and then suggests appropriate cosmetic surgery options based on that data, allowing them to make the booking.

[0048] System Overview

[0049] The system mainly consists of a terminal used by the user, a server that analyzes and stores data, and a clinic that provides suggested cosmetic surgery options.

[0050] Program processing

[0051] Initial Data Entry

[0052] Using the device, the user enters their initial basic information (name, age, gender, contact details, etc.), which is then sent to the server and stored.

[0053] Performing a 3D scan

[0054] Users use the camera on their smartphone or tablet to perform a 3D facial scan. The device provides lead instructions to guide the user through the precise scan and captures the 3D data in real time. Once the scan is complete, the data is compressed and sent to a server.

[0055] Data analysis and options presentation

[0056] The server uses an algorithm to analyze the received 3D scan data, performing a detailed analysis of the facial shape, bone structure, skin condition, etc. Based on the analysis results, it generates the optimal cosmetic surgery options for the user and sends them to the device.

[0057] Consulting and plan selection

[0058] The device displays the analysis results and cosmetic surgery options sent from the server to the user. The user can select the plan they are interested in from the options presented and check detailed information and treatment examples. The selection data is sent to the server.

[0059] Clinic and price information provided

[0060] The server generates a list of affiliated clinics and pricing information for treatments based on the cosmetic surgery plan selected by the user, and sends this information to the terminal and presents it to the user.

[0061] Final selection and booking

[0062] The user checks the clinic and price information provided, and finally selects the desired clinic and treatment date and time. The terminal sends the reservation information to the server, and the server completes the reservation procedure with the clinic based on that data. A confirmation message confirming the reservation is complete is displayed on the terminal.

[0063] Aftercare and evaluation

[0064] After the treatment, the server provides the user with aftercare information, allowing the user to check post-treatment care methods. After checking the aftercare, the user also enters evaluation data, which is sent to the server for analysis. The server uses the collected evaluation data to improve its services.

[0065] Specific examples

[0066] For example, if a user is using the system for the first time and considering cosmetic surgery, they can register through a smartphone app and take a 3D scan of their face. The scan data is then analyzed by the server, which suggests multiple options, such as hyaluronic acid injections and facelifts. The user selects hyaluronic acid injections, checks a list of available clinics and pricing information, and then confirms an appointment at a convenient date and time. After the procedure, they receive appropriate care based on the aftercare information provided, and then enters a rating to provide feedback to the system.

[0067] In this way, the system helps users easily obtain information about cosmetic surgery and make the best choice with confidence.

[0068] The processing flow will be explained below.

[0069] Step 1:

[0070] The user launches the application on the device and proceeds to the new registration screen. The user enters basic information such as name, age, gender, and email address. The device then checks the input for any input errors. Once the check is complete, the device sends this data to the server.

[0071] Step 2:

[0072] The device displays a screen prompting the user to prepare for a 3D facial scan. The user prepares their face for a 3D facial scan and follows the device's instructions to rotate their face 360 ​​degrees to perform the 3D scan. The device captures, corrects, and compresses the scanned data in real time. Once the scan is completed accurately, the device sends the data to the server.

[0073] Step 3:

[0074] The server receives the 3D scan data sent from the device, checks the data for consistency and quality, stores the data in a database, and runs an analysis algorithm that analyzes facial shape, bone structure, skin condition, and other factors to generate optimal cosmetic surgery options.

[0075] Step 4:

[0076] Once the analysis is complete, the server creates a list of cosmetic surgery options and sends it to the device. The device displays the analysis results and the list of cosmetic surgery options received from the server to the user. The user can then review the details of the options and select the plan that best suits them.

[0077] Step 5:

[0078] When a user selects a plan from the cosmetic surgery options, the device sends the selection data to the server, which generates a list of affiliated clinics and prices based on the selected options.

[0079] Step 6:

[0080] The server sends the generated list of clinics and prices to the terminal. The terminal then presents this information to the user, who compares the list of clinics and prices. The user then selects the most suitable clinic and treatment plan and confirms the desired appointment date and time.

[0081] Step 7:

[0082] Once the selection is complete, the terminal sends the reservation information to the server. The server then sends the reservation information to the clinic and returns a confirmation of whether the reservation has been accepted to the terminal. The terminal then displays a notification to the user that the reservation has been completed.

[0083] Step 8:

[0084] After the treatment is completed, the server provides the user with aftercare information, and the terminal displays the provided aftercare guide to the user, who then provides appropriate care based on it.

[0085] Step 9:

[0086] After the user has completed the appropriate treatment, the device displays a questionnaire to evaluate the treatment. The user answers the questionnaire, and the device sends the data to the server. The server analyzes the evaluation data and uses it to improve the service in the future.

[0087] Example 1

[0088] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0089] The traditional cosmetic surgery selection and booking process required users to visit a clinic in person for consultations and procedures, which was time-consuming and tedious. Additionally, users lacked the information they needed to select the best cosmetic surgery option for themselves, making it difficult to make the right choice.

[0090] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0091] In this invention, the server includes means for inputting basic user information, means for acquiring 3D scan data of the user's face, means for transmitting the acquired 3D scan data to the server, means for the server to analyze the 3D scan data and generate cosmetic surgery options, means for the server to transmit data to a terminal to display the cosmetic surgery options to the user, means for the user to select from the options and transmit the selected data to the server, means for the server to generate clinic and price information based on the selected options and transmit this information to the terminal, means for booking an appointment based on the clinic and treatment date and time finally selected by the user, means for the server to provide aftercare information and collect user evaluation data after the treatment, means for capturing 3D scan data of the user's face in real time, and means for transmitting the user evaluation data to the server, which then analyzes the evaluation data and uses it to improve services. This allows users to quickly and easily select the cosmetic surgery options that are best suited to them online and to consistently complete the entire process from booking to aftercare.

[0092] "User" refers to a person who uses the system to select and book cosmetic surgery procedures.

[0093] "Basic information" refers to data necessary to identify an individual, such as the user's name, age, gender, and contact information.

[0094] "3D facial scan data" refers to digital data that represents detailed information about a user's face, such as their facial shape, bone structure, and skin condition, in three dimensions.

[0095] "Terminal" refers to an electronic device used by a user, such as a smartphone, tablet, or computer.

[0096] "Server" refers to the computer system used to analyze 3D scan data, generate cosmetic surgery options, store data, process reservations, etc.

[0097] "Cosmetic surgery options" refers to the specific cosmetic surgery procedures offered to users (e.g., hyaluronic acid injections, facelifts, etc.).

[0098] "Acquisition means" refers to the technological process or equipment used to collect a 3D scan of the user's face.

[0099] "Means for analysis" refers to the algorithms and software used to analyze the acquired 3D scan data and recommend the most appropriate cosmetic surgery options to the user.

[0100] "Selection Data" refers to information about the specific procedures selected by a user from among the cosmetic surgery options presented to them.

[0101] "Clinic" refers to a medical institution that provides cosmetic surgery procedures.

[0102] "Price Information" refers to information regarding the cost of the procedure corresponding to the selected cosmetic surgery option.

[0103] "Reservation procedure" refers to the series of processes for completing a reservation for the desired date and time for the cosmetic surgery procedure selected by the user.

[0104] "Aftercare information" refers to instructions and advice provided to users to help them take appropriate care after treatment.

[0105] "Evaluation data" refers to feedback information in which a user evaluates the service or treatment content after the treatment.

[0106] "Real-time capture means" refers to the technological process or equipment used to instantly acquire and process a 3D scan of a user's face in real time.

[0107] MODE FOR CARRYING OUT THE INVENTION

[0108] The present invention relates to a system that simplifies the process of selecting and booking cosmetic surgery treatments by allowing users to obtain detailed data of their own face through 3D scanning, suggesting appropriate cosmetic surgery options based on that data, and even allowing them to make reservations. The system mainly consists of a device used by the user, a server that analyzes and stores the data, and a medical institution that provides the suggested cosmetic surgery options.

[0109] Initial Data Entry

[0110] The user uses the device to input basic information (such as name, age, gender, and contact details), which is then sent to the server, where it is stored.

[0111] Performing a 3D scan

[0112] Users use the camera on their smartphone or tablet to perform a 3D scan of their face. The device provides lead instructions, directing the user to accurately scan their face. For example, instructions such as "Please slowly turn your face left and right" are given in real time. Once the scan is complete, the device compresses the 3D data and sends it to the server.

[0113] Data analysis and options presentation

[0114] The server uses algorithms (such as OpenCV or TENSORFLOW®) to analyze the received 3D scan data and perform a detailed analysis of the facial shape, bone structure, and skin condition. Based on the analysis results, the server generates optimal cosmetic surgery options for the user and sends them to the device.

[0115] Consulting and plan selection

[0116] The device displays the analysis results and cosmetic surgery options sent from the server to the user. The user can select the plan they are interested in from the options presented and check detailed information and treatment examples. For example, options such as "hyaluronic acid injection" and "facelift" are presented.

[0117] Clinic and price information provided

[0118] Once the user selects a plan, the device sends the selection data to the server, which generates a list of affiliated clinics and their treatment prices based on the user's selection. This information is sent to the device and presented to the user.

[0119] Final selection and booking

[0120] The user checks the list of clinics and treatment price information provided, and finally selects the desired clinic and treatment date and time. The reservation information from the terminal is sent to the server, which completes the reservation procedure with the affiliated medical institution. A message indicating reservation completion is displayed on the terminal. For example, a message such as "Reservation completed. Please come to the clinic at 12:00 on XX month XX day" is displayed.

[0121] Aftercare and evaluation

[0122] After the treatment, the server provides the user with aftercare information. For example, it may provide care instructions such as "Please keep the area cool and rest for 24 hours after the treatment." The user can then confirm this information and provide appropriate care at home. The user also inputs their post-treatment evaluation via their device, and this evaluation data is sent to the server. The server analyzes the evaluation data and uses it to improve the service.

[0123] Examples of concrete examples and prompts

[0124] For example, when a user uses the system for the first time to consider cosmetic surgery, they register through a smartphone app and take a 3D scan of their face. The scan data is then analyzed by the server, and multiple options, such as hyaluronic acid injections and facelifts, are presented. The user selects hyaluronic acid injections, checks a list of available clinics and pricing information, and then confirms an appointment at a convenient date and time. After the procedure, they provide appropriate care based on the aftercare information provided, and enter a rating to provide feedback to the system.

[0125] Example prompt sentence:

[0126] "Users use a smartphone app to initially register for cosmetic surgery and then take a 3D scan of their face. Based on the scan data, the app recommends the most appropriate cosmetic surgery options. For example, hyaluronic acid injections, facelift, etc."

[0127] As described above, this system allows users to quickly and easily select the cosmetic surgery option that best suits them online, and to complete the entire process from booking to aftercare.

[0128] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0129] Step 1:

[0130] The user enters basic information.

[0131] Users use devices such as smartphones and tablets to enter their basic information (name, age, gender, contact details, etc.) into a dedicated application. The entered basic information is temporarily saved by the device.

[0132] Step 2:

[0133] The terminal sends the input data to the server.

[0134] The terminal sends the basic information entered by the user to the server using the HTTPS protocol, which receives this data, stores it in a database, and generates a unique ID for the user, which allows the user to be identified in subsequent processes.

[0135] Step 3:

[0136] The user performs a 3D scan of their face.

[0137] The user initiates a 3D scan of their face using the device's camera. The device provides lead instructions, such as slowly rotating the user's face left and right, in real time. The device captures and temporarily stores the 3D data of the face through the camera.

[0138] Step 4:

[0139] The device sends the scanned data to the server.

[0140] Once the scan is complete, the device compresses the captured 3D data and sends it over HTTPS to a server, which receives it and stores it for analysis.

[0141] Step 5:

[0142] The server analyzes the 3D scan data.

[0143] The server then analyzes the received 3D scan data using algorithms such as OpenCV and TensorFlow to extract detailed data such as facial shape, bone structure, and skin condition. The analysis results are then temporarily stored.

[0144] Step 6:

[0145] A server generates cosmetic surgery options.

[0146] Based on the analysis results, the server generates the optimal cosmetic surgery options for the user (e.g., hyaluronic acid injection, facelift, etc.). The generated options are temporarily stored.

[0147] Step 7:

[0148] The server sends the option data to the terminal.

[0149] The server sends the generated cosmetic surgery options to the terminal, which receives this data and displays it to the user, who then selects the plan they are interested in from the presented options.

[0150] Step 8:

[0151] The user selects a plan.

[0152] The user uses the device to select the plan they are interested in from the presented cosmetic surgery options, and check detailed information and treatment examples. When the user selects a plan, selection data is generated.

[0153] Step 9:

[0154] The terminal transmits the selection data to the server.

[0155] The device sends the user's selected plan information to the server using the HTTPS protocol, which receives this data and generates clinic and price information based on the selected cosmetic surgery plan.

[0156] Step 10:

[0157] The server generates a list of clinics and pricing information.

[0158] The server generates a list of affiliated clinics and treatment price information and sends it to the terminal, which receives the information and displays it to the user.

[0159] Step 11:

[0160] The user selects the clinic and treatment date and time.

[0161] The user checks the list of clinics and price information displayed on the terminal, and finally selects the desired clinic and treatment date and time. Selection data is generated.

[0162] Step 12:

[0163] The terminal transmits the reservation information to the server.

[0164] The device sends the selected clinic and treatment date and time information to the server using the HTTPS protocol. The server receives this data and completes the reservation procedure.

[0165] Step 13:

[0166] The server completes the reservation process.

[0167] The server sends a reservation request to the affiliated clinic and completes the reservation procedure. A confirmation message is generated and sent to the terminal.

[0168] Step 14:

[0169] The device will display a confirmation message that the reservation is complete.

[0170] The terminal displays the reservation completion confirmation message received from the server to the user. For example, a message such as "Reservation completed. Please come to the hospital at 12:00 on XX month XX day" is displayed.

[0171] Step 15:

[0172] The server provides aftercare information.

[0173] After the treatment, the server provides the user with detailed aftercare information. For example, instructions such as "Please keep the area iced and rest for 24 hours after the treatment" are sent. The device receives this information and displays it to the user.

[0174] Step 16:

[0175] The user checks the aftercare information and provides care.

[0176] The user checks the provided aftercare information and provides appropriate care at home.

[0177] Step 17:

[0178] The user enters the evaluation data.

[0179] After the treatment, the user inputs their evaluation through the terminal, and evaluation data is generated.

[0180] Step 18:

[0181] The terminal transmits the evaluation data to the server.

[0182] The device sends the user-entered rating data to the server using the HTTPS protocol, which receives and stores the data for use in improving the service.

[0183] The above are the specific processing steps of this system.

[0184] (Application example 1)

[0185] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0186] For users considering cosmetic surgery, selecting the most suitable cosmetic surgery option and booking the appointment are time-consuming and cumbersome tasks. It is also important to provide information on aftercare after the procedure and efficiently collect user feedback to use in improving services. However, traditional methods for these processes are fragmented, limiting the ability to improve user experience and optimize services.

[0187] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0188] In this invention, the server includes a means for improving services using a generative AI model based on user evaluation data, a means for capturing 3D facial scan data in real time, and a means for transmitting the user's post-treatment evaluation data to the server and using the generative AI model to improve services. This allows users to quickly and accurately select the optimal cosmetic surgery option and easily complete the reservation process. Furthermore, the provision of aftercare information and the collection of evaluation data after treatment also enable continuous improvement of services.

[0189] "Basic information" refers to data necessary to identify an individual, such as the user's name, age, gender, and contact information.

[0190] "3D scan data" is digital data that captures the three-dimensional shape of a user's face.

[0191] "Server" means a computer system for analyzing 3D scan data, generating cosmetic surgery options, and storing and providing relevant information to users.

[0192] "Analysis" is the process of examining the facial shape, bone structure, skin condition, etc. in detail based on the acquired 3D scan data.

[0193] "Cosmetic surgery options" are treatment options suggested by analyzing 3D scan data of the user's face.

[0194] A "terminal" is a device used by a user, such as a smartphone or tablet.

[0195] "Selection data" refers to information about the procedure selected by the user from among the cosmetic surgery options.

[0196] "Medical facility" means a hospital or clinic that provides cosmetic surgery.

[0197] The "reservation procedure" is the process of confirming a treatment date and time with a medical facility based on the cosmetic surgery option selected by the user.

[0198] "Aftercare information" refers to information about care methods and precautions to take after treatment.

[0199] "Evaluation data" is feedback information provided by the user after the treatment.

[0200] A "generative AI model" is an artificial intelligence model that analyzes user evaluation data and improves and optimizes services.

[0201] The system embodying the present invention simplifies the process of selecting and booking cosmetic surgery procedures. Specifically, the user uses a device such as a smartphone or tablet to acquire 3D facial scan data, which is then sent to a server where it is analyzed, the system recommends optimal cosmetic surgery options, and assists with the booking process.

[0202] Hardware and software used

[0203] Hardware: smartphones, tablets, servers

[0204] Software: Flask (server-side framework), face_recognition (face analysis library), Flutter (registered trademark) (client application framework), generative AI model

[0205] System action

[0206] The server receives the user's basic information and 3D scan data, and performs a detailed analysis of the face's shape, bone structure, and skin condition. The analysis uses the face_recognition library to obtain facial landmarks and shape data. Based on this analysis data, cosmetic surgery options are generated and sent to the user's device.

[0207] The terminal displays cosmetic surgery options to the user and transmits the option selected by the user to the server, which generates affiliated medical facilities and price information based on the selected option and transmits it to the terminal, allowing the user to complete the reservation procedure.

[0208] After the procedure, the server provides aftercare information and collects user evaluation data. The collected evaluation data is analyzed using a generative AI model and used to improve the service, thereby continuously providing users with the most suitable cosmetic surgery options.

[0209] Specific examples

[0210] Let's take the example of a user named Hanako considering cosmetic surgery. Hanako first uses a smartphone app to enter basic information and take a 3D scan of her face. This 3D scan data is sent to a server for analysis. The server then suggests cosmetic surgery options such as hyaluronic acid injections and facelifts. Hanako selects hyaluronic acid injections, checks medical facilities and pricing information, and then confirms an appointment for her desired date and time. After the procedure, she follows the aftercare information provided, and then enters her evaluation and provides feedback to the system. This feedback data is analyzed by a generative AI model and used to improve the system's services.

[0211] Prompt Sentence Examples

[0212] "I'm considering cosmetic surgery. I've entered the following basic information: Name: Hanako, Age: 30, Gender: Female, Contact Information: [email address]. I've then had a 3D scan of my face. Please analyze my facial shape and skin condition and recommend the best cosmetic surgery options for me. How do I choose the options I want and complete my appointment?"

[0213] This embodiment of the invention allows users to easily find the cosmetic surgery options that are best for them and receive the treatment with peace of mind.

[0214] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0215] Step 1:

[0216] The terminal inputs the user's basic information.

[0217] (Input): Basic information such as the user's name, age, gender, and contact details.

[0218] (Specific operation): When a user enters data into the input form displayed on the terminal and presses the submit button, this information is sent to the server in JSON format.

[0219] (Output): Basic information sent to the server.

[0220] Step 2:

[0221] The device acquires a 3D scan of the user's face.

[0222] (Input): Face scan using your smartphone or tablet camera.

[0223] (Specific operation): The device uses the camera to initiate a 3D scan of the face, capturing data in real time, which is then compressed and sent to the server.

[0224] (Output): The 3D scan data sent to the server.

[0225] Step 3:

[0226] The server analyzes the 3D scan data and generates cosmetic surgery options.

[0227] (Input): 3D scan data stored on the server.

[0228] (Specific operation): The server uses the face_recognition library to analyze the face shape, bone structure, skin condition, etc.

[0229] , to generate optimal cosmetic surgery options.

[0230] (Output): Generated cosmetic surgery options.

[0231] Step 4:

[0232] The server sends cosmetic surgery options to the device.

[0233] (Input): Generated cosmetic surgery options.

[0234] (Specific operation): The server sends the generated cosmetic surgery options in JSON format to the terminal.

[0235] (Output): Cosmetic surgery options displayed on the device.

[0236] Step 5:

[0237] The user selects from the options and sends the selection to the server.

[0238] (Input): Cosmetic surgery options displayed on the device.

[0239] (Specific operation): The user selects the desired option on the terminal and presses the select button. This selection data is sent to the server.

[0240] (Output): The selection data sent to the server.

[0241] Step 6:

[0242] The server generates medical facility and price information based on the selected options and transmits it to the terminal.

[0243] (Input): Selection data stored on the server.

[0244] (Specific operation): The server generates affiliated medical facilities and their price information based on the selected data and sends it to the terminal in JSON format.

[0245] (Output): Medical facility and pricing information displayed on the terminal.

[0246] Step 7:

[0247] The user then makes a reservation based on the medical facility and price information that he or she has finally selected.

[0248] (Input): Medical facility and price information displayed on the terminal.

[0249] (Specific operation): The user selects the desired medical facility and treatment date and time, and presses the reservation button. The reservation information is sent to the server, and the reservation procedure is completed on the server side.

[0250] (Output): A confirmation message that the reservation is complete.

[0251] Step 8:

[0252] After the treatment, the server provides aftercare information and collects user evaluation data.

[0253] (Input): User after reservation is completed.

[0254] (Specific operation): After the treatment, the server sends aftercare information to the terminal and receives evaluation data entered by the user.

[0255] (Output): Rating data stored on the server.

[0256] Step 9:

[0257] The service is improved using a generative AI model based on the evaluation data acquired by the server.

[0258] (Input): Rating data stored on the server.

[0259] (Specific operation): The server inputs the evaluation data into the generative AI model and improves the service based on the analysis results.

[0260] (Output): Service improvement.

[0261] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0262] The present invention relates to a system that simplifies the cosmetic surgery selection and booking process by obtaining detailed data of the user's face through 3D scanning, suggesting appropriate cosmetic surgery options based on that data, and using an emotion engine to recognize the user's emotions and help provide more appropriate choices.

[0263] System Overview

[0264] The system consists of a terminal operated by the user, a server that analyzes and stores data, a clinic that provides suggested cosmetic surgery options, and an emotion engine that recognizes the user's emotions.

[0265] Program processing

[0266] Initial Data Entry

[0267] Using the device, the user enters their initial basic information (name, age, gender, contact details, etc.), which is then sent to the server and stored.

[0268] Performing a 3D scan

[0269] Users use the camera on their smartphone or tablet to perform a 3D facial scan. The device provides lead instructions to guide the device in accurately scanning the face, capturing the 3D data in real time. Once the scan is complete, the data is compressed and sent to a server.

[0270] Data analysis and emotion recognition

[0271] The server analyzes the received 3D scan data and performs a detailed analysis of the facial shape, bone structure, skin condition, etc. It then uses an emotion engine to analyze the user's emotions from the facial expression data. The emotion engine detects changes in micro-expressions and identifies the user's current feelings (e.g., joy, sadness, surprise, etc.).

[0272] Options and customization

[0273] The server generates cosmetic surgery options based on the analysis results and the emotion engine results, and customizes the options that best suit the user. This information is sent to the terminal and presented to the user.

[0274] Consulting and plan selection

[0275] The device displays the analysis results, emotion results, and list of cosmetic surgery options sent from the server to the user. The user checks the details of the options and selects the plan that best suits them. The selected data is then sent to the server.

[0276] Clinic and price information provided

[0277] The server generates a list of affiliated clinics and prices based on the cosmetic surgery plan selected by the user, and this information is sent to the terminal and presented to the user.

[0278] Final selection and booking

[0279] The user checks the clinic and price information provided, and finally selects the desired clinic and treatment date and time. The terminal sends the reservation information to the server, and the server completes the reservation procedure with the clinic based on that data. A confirmation message confirming the reservation is complete is displayed on the terminal.

[0280] Aftercare and evaluation

[0281] After the treatment is completed, the server provides the user with aftercare information. The terminal displays the provided aftercare guide to the user, who then provides appropriate care. After confirming the aftercare, the user also enters evaluation data, which is sent to the server for analysis. The server uses the collected evaluation data to improve its services.

[0282] Specific examples

[0283] For example, if a user is considering cosmetic surgery, they can register through a smartphone app and have their face scanned in 3D. The scan data is then analyzed by the server, and the emotion engine detects "anxiety" from the user's facial expression. Based on this, the server suggests cosmetic surgery options that provide a sense of security and reduce anxiety. After the user selects hyaluronic acid injection and checks the list of available clinics and pricing information, they can schedule an appointment for a convenient date and time. After the procedure, they can provide appropriate care based on the aftercare information provided, and enter their evaluation to provide feedback to the system.

[0284] In this way, the system helps users easily obtain information about cosmetic surgery and make optimal choices that take into account their emotional state.

[0285] The processing flow will be explained below.

[0286] Step 1:

[0287] The user launches the application on the device and proceeds to the new registration screen. The user enters basic information such as name, age, gender, and email address. The device then checks the input for any input errors. Once the check is complete, the device sends this data to the server.

[0288] Step 2:

[0289] The device displays a screen prompting the user to prepare for a 3D facial scan. The user prepares their face for a 3D facial scan and follows the device's instructions to rotate their face 360 ​​degrees to perform the 3D scan. The device captures, corrects, and compresses the scanned data in real time. Once the scan is completed accurately, the device sends the data to the server.

[0290] Step 3:

[0291] The server receives the 3D scan data sent from the device, checks the data integrity and quality, stores the data in a database, and runs an analysis algorithm that analyzes facial shape, bone structure, skin condition, etc.

[0292] Step 4:

[0293] The server activates an emotion engine to recognize the user's emotions based on the 3D facial scan data. The emotion engine analyzes the user's facial expression data and identifies the user's emotional state. For example, if the user is smiling, it recognizes the emotion as "joy," and if they are frowning, it recognizes the emotion as "anxiety."

[0294] Step 5:

[0295] The server generates cosmetic surgery options based on the facial analysis and emotion engine results. If the analysis result is "a facelift is appropriate" and the emotion is "anxiety," the server customizes the options with detailed explanations about facelifts and additional information to alleviate the user's anxiety.

[0296] Step 6:

[0297] The server sends the analyzed data and cosmetic surgery options to the device. The device displays a detailed list of options to the user. The user checks the details of each option and selects the plan that best suits them. The selected data is then sent from the device to the server.

[0298] Step 7:

[0299] The server generates a list of affiliated clinics and pricing information for the procedures based on the selected cosmetic surgery options. This information is sent to the terminal and presented to the user, who can then compare the presented list and prices.

[0300] Step 8:

[0301] The user finally selects the most suitable clinic and treatment plan, and confirms the desired reservation date and time. The terminal sends this reservation information to the server. The server sends the reservation information to the clinic, and upon receiving confirmation from the clinic, returns it to the terminal. The terminal displays a notification to the user that the reservation has been completed.

[0302] Step 9:

[0303] After the treatment is completed, the server sends an aftercare guide to the terminal to provide the user with aftercare information. The terminal displays this guide to the user, and the user follows the instructions to provide appropriate care.

[0304] Step 10:

[0305] After the user completes the aftercare, the device displays a questionnaire to evaluate the treatment. The user answers the questionnaire, and the device sends the data to the server. The server receives the evaluation data and analyzes it to improve the service.

[0306] Specific examples

[0307] For example, if a user is interested in cosmetic surgery, they can register through a smartphone app and have their face scanned in 3D. The scan data is analyzed by the server, and an emotion engine detects "anxiety" from the user's facial expression. Based on this, the server suggests options such as hyaluronic acid injections to provide a sense of security. The user selects an option, confirms clinic and price information, and then confirms the appointment. After the procedure, the user receives appropriate care based on the aftercare information provided, and enters an evaluation that is fed back to the system. In this way, the system helps users easily obtain information about cosmetic surgery and make the best choice, taking their emotional state into consideration.

[0308] Example 2

[0309] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0310] The process of selecting and booking cosmetic surgery is complex and time-consuming for users, making it difficult to obtain appropriate information. Furthermore, the user's emotional state is not taken into consideration, which may result in an inadequate selection. This risks reducing user satisfaction. Furthermore, the provision of aftercare information and collection of evaluation data after the procedure are not effectively implemented.

[0311] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting basic information about the user, means for acquiring 3D scan data of the user's face, means for transmitting the acquired 3D scan data to the server, means for the server to analyze the 3D scan data and generate cosmetic surgery options, means for the server to transmit the cosmetic surgery options to the terminal, means for the user to select from the options and transmit the selected data to the server, means for the server to generate facility and price information based on the selected options and transmit this information to the terminal, means for completing the reservation procedure based on the facility and price information finally selected by the user, means for the server to provide aftercare information and collect user evaluation data after the procedure, and means for providing cosmetic surgery options based on the user's emotions using an emotion engine that recognizes the user's emotions. This allows the user to select the optimal cosmetic surgery option taking into account their emotional state, making it possible to efficiently complete the entire process from reservation to aftercare.

[0312] "Basic user information" refers to information that identifies a user and constitutes a basic profile, such as name, age, gender, and contact information.

[0313] "Three-dimensional scan data" refers to data that captures the shape and expression of a user's face in three dimensions, and includes information such as the overall shape of the face, bone structure, and skin condition.

[0314] A "server" is a device that is composed of a computer and a storage device for analyzing and storing received data, and generating and providing necessary information.

[0315] An "emotion engine" is an algorithm and software for recognizing and analyzing emotions from a user's facial expressions.

[0316] "Cosmetic surgery options" are options for cosmetic surgery or procedures suggested to users based on their cosmetic needs, including hyaluronic acid injections, Botox injections, facelifts, etc.

[0317] A "terminal" is a device operated by a user, such as a smartphone, tablet, or PC, which is an electronic device with input and display functions.

[0318] A "facility" is a doctor's office or clinic that offers the proposed cosmetic surgery options.

[0319] "Aftercare information" refers to guidelines and support information provided to users regarding post-treatment care methods and precautions.

[0320] "Evaluation data" refers to feedback information provided by the user after a treatment, and includes evaluations of the appropriateness of aftercare and the results of the treatment.

[0321] The present invention is a system that simplifies the cosmetic surgery selection and booking process. The system consists of a user-operated terminal, a server that analyzes and stores data, a facility that provides suggested cosmetic surgery options, and an emotion engine that recognizes the user's emotions.

[0322] Initial Data Entry

[0323] Using a device, the user enters their initial basic information (such as name, age, gender, and contact details). This data is sent from the device to a server and stored. Specifically, the user accesses an application on their smartphone or tablet, enters the required information into a form, and submits it.

[0324] Performing a 3D scan

[0325] Users use the camera on their smartphone or tablet to perform a 3D scan of their face. The device provides lead instructions to guide the user through the precise scan and captures the 3D data in real time. Once the scan is complete, the data is compressed and sent to a server. For example, this can be done using Photogrammetry software.

[0326] Data analysis and emotion recognition

[0327] The server performs a detailed analysis of the received 3D scan data. This analysis includes analyzing the facial shape, bone structure, and skin condition. It then uses an emotion engine (e.g., Emotion AI) to analyze the user's emotions from their facial expression data. The emotion engine detects changes in micro-expressions and identifies the user's current emotion (e.g., joy, sadness, surprise, etc.).

[0328] Options and customization

[0329] The server generates cosmetic surgery options based on the analysis results and the emotion engine results, and customizes the options that best suit the user. This information is sent to the device and presented to the user. The cosmetic surgery options include hyaluronic acid injections, Botox injections, and facelifts.

[0330] Consulting and plan selection

[0331] The device displays the analysis results, emotion results, and list of cosmetic surgery options sent from the server to the user. The user checks the details of the options and selects the plan that best suits them. The selected data is then sent to the server.

[0332] Clinic and price information provided

[0333] The server generates a list of affiliated facilities and prices based on the user's cosmetic surgery plan selection. This information is sent to the device and presented to the user. For example, the server may automatically search a database of relevant cosmetic surgery facilities and display results based on the user's location and preferences.

[0334] Final selection and booking

[0335] The user checks the facilities and price information provided, and finally selects the desired facility and treatment date and time. The terminal sends the reservation information to the server, and the server completes the reservation procedure with the facility based on that data. A confirmation message confirming the reservation is complete is displayed on the terminal.

[0336] Aftercare and evaluation

[0337] After the treatment is completed, the server provides the user with aftercare information. The terminal displays the provided aftercare guide to the user, who then provides appropriate care based on it. After confirming the aftercare, the user also enters evaluation data, which is sent to the server. The server uses the collected evaluation data to improve its services.

[0338] Specific examples

[0339] For example, if a user is considering cosmetic surgery, they can register through a smartphone application and have their face scanned in 3D. The scan data is then analyzed by the server, and an emotion engine detects "anxiety" from the user's facial expression. Based on this, the server suggests cosmetic surgery options that provide superior peace of mind to alleviate anxiety. After the user selects hyaluronic acid injection and checks the list of corresponding facilities and pricing information, they can confirm an appointment at a convenient date and time. After the procedure, they can provide appropriate care based on the aftercare information provided, and enter their evaluation to provide feedback to the system.

[0340] Prompt Sentence Examples

[0341] "We will take into account your current emotional state and recommend the best cosmetic surgery options for you. We will perform a three-dimensional scan of your face and provide you with detailed data."

[0342] In this way, the system helps users easily obtain information about cosmetic surgery and make optimal choices that take into account their emotional state.

[0343] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0344] Step 1: Initial data entry

[0345] A user accesses an application on a smartphone or tablet and enters basic information (name, age, gender, contact details). Once this data is entered, the device sends the entered data to the server. The server stores the received basic information in a database and prepares it for the next step. Specific operations include the display of an input form, the user filling in the fields, and pressing the submit button. Input: Name, age, gender, contact details. Output: Basic information is saved in the database.

[0346] Step 2: Perform a 3D scan

[0347] The user uses the device's camera to perform a 3D scan of their face. The device displays lead instructions to guide the user to scan accurately. During the scan, 3D data is captured in real time. Once the scan is complete, the device compresses this data and sends it to the server. Once the server receives the data, it stores it and prepares it for the next analysis step. Input: 3D scan data. Output: Compressed scan data sent to the server.

[0348] Step 3: Data analysis and emotion recognition

[0349] The server analyzes the received 3D scan data. Specifically, it uses Photogrammetry software to perform a detailed analysis of facial shape, bone structure, skin condition, and other factors. It then uses Emotion AI to recognize emotions from the user's facial expression data. The emotion engine analyzes changes in micro-expressions and identifies emotions such as "happiness," "sadness," and "surprise." Input: 3D scan data. Output: Detailed facial shape data and emotion recognition results.

[0350] Step 4: Present options and customize

[0351] The server generates cosmetic surgery options based on the analysis results and the emotion engine results. Specifically, it lists treatment options (e.g., hyaluronic acid injection, Botox injection, facelift, etc.) tailored to the user's skin condition and bone structure. These options are sent to the device in a customizable format. Guides and explanations are also provided to help the user select the best option. Input: Detailed face shape data and emotion recognition results. Output: List of cosmetic surgery options and guide.

[0352] Step 5: Consultation and plan selection

[0353] The device displays the analysis results received from the server, cosmetic surgery options, and a recommended list of beauty facilities to the user. The user reviews the details of the options and selects the plan that suits them. Once the selection is complete, the device sends the information to the server. The server records the selection data and proceeds to present the next facility and price information. Input: Cosmetic surgery option selected by the user. Output: Selection data sent to the server.

[0354] Step 6: Present your facilities and pricing information

[0355] The server generates beauty salons and their pricing information based on the plan selected by the user. In particular, the server searches the relevant database to create a list of salons and pricing information based on the user's location and desired conditions. This information is sent to the terminal and presented to the user. Input: User's selection data and location information. Output: List of salons and pricing information.

[0356] Step 7: Final selection and booking

[0357] The user checks the provided facility and price information, and selects the desired beauty facility and treatment date and time. The device sends this information to the server. The server automatically completes the reservation procedure and generates reservation confirmation data with the clinic. A confirmation message indicating the reservation is complete is then displayed on the device. Input: User's facility and date and time selection information. Output: Completion of reservation procedure and confirmation message.

[0358] Step 8: Aftercare and evaluation

[0359] After the treatment is completed, the server provides the user with the necessary aftercare information. This information is sent to the terminal, and the user provides appropriate care based on that information. The user then inputs the results and evaluation of the aftercare, and this data is sent from the terminal to the server. The server analyzes the evaluation data and uses it to improve services in the future. Input: User evaluation data. Output: Analysis data for service improvement.

[0360] (Application example 2)

[0361] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0362] In the conventional cosmetic surgery selection and booking process, it was difficult for users to accurately understand their facial data and select the appropriate cosmetic surgery option. Furthermore, cosmetic surgery recommendations rarely took into account users' emotional state, which left users unable to alleviate their psychological anxiety. Furthermore, information about the booking procedure and aftercare was insufficient, resulting in poor overall service quality.

[0363] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0364] In this invention, the server includes means for analyzing 3D scan data of the user's face, analyzing the user's emotional state with an emotion engine, and generating cosmetic surgery options, means for the server to transmit the cosmetic surgery options to the terminal, and means for the user to select from the options and transmit the selected data to the server. This allows the user to select the optimal cosmetic surgery option based on their own facial data, taking into account their emotional state, and simplifies the reservation process while reducing psychological anxiety.

[0365] "Basic information" refers to the user's name, age, gender, contact information, etc.

[0366] "3D scan data" is data that measures the shape and features of a user's face in three dimensions and saves it as digital data.

[0367] A "server" is a computer system that analyzes, stores, and transmits and receives data over a network.

[0368] An "emotion engine" is a system that includes algorithms and software for analyzing emotions from a user's facial expression data and identifying the user's state of mind.

[0369] "Cosmetic surgery options" are suggested cosmetic procedures and treatment options based on the user's facial features and emotional state.

[0370] "Terminal" refers to a personal computer such as a smartphone or tablet used by a user.

[0371] A "clinic" is a medical institution or clinic that provides cosmetic surgery procedures.

[0372] "Price information" is information about the cost of cosmetic surgery procedures.

[0373] The "reservation procedure" refers to the operations and steps for booking a treatment at a clinic based on the cosmetic surgery options selected by the user.

[0374] "Aftercare information" is information that includes instructions and guidelines regarding care after a procedure.

[0375] "Evaluation data" refers to data regarding user satisfaction and feedback after treatment.

[0376] "Real-time capture" refers to instantly acquiring 3D scan data of the user's face and processing it on the spot.

[0377] This invention is a system that simplifies the cosmetic surgery selection and booking process by obtaining detailed data of the user's face through 3D scanning, suggesting appropriate cosmetic surgery options based on that data, and using an emotion engine to recognize the user's emotions and help provide more appropriate choices.

[0378] System Overview

[0379] The system consists of a device operated by the user, a server that analyzes and stores data, a medical institution that provides suggested cosmetic surgery options, and an emotion engine that recognizes the user's emotions.

[0380] Program processing

[0381] Initial Data Entry

[0382] The user uses the device to input basic information (such as name, age, gender, and contact details), which is then sent to the server and stored.

[0383] Performing a 3D scan

[0384] Users use the camera on their smartphone or tablet to perform a 3D facial scan. The device provides lead instructions to guide the device in accurately scanning the face, capturing the 3D data in real time. Once the scan is complete, the data is compressed and sent to a server.

[0385] Data analysis and emotion recognition

[0386] The server analyzes the received 3D scan data and performs a detailed analysis of the facial shape, bone structure, skin condition, etc. It then uses an emotion engine to analyze the user's emotions from the facial expression data. The emotion engine detects changes in micro-expressions and identifies the user's current feelings (e.g., joy, sadness, surprise, etc.).

[0387] Options and customization

[0388] The server generates cosmetic surgery options based on the analysis results and the emotion engine results, and customizes the options that best suit the user. This information is sent to the terminal and presented to the user.

[0389] Consulting and plan selection

[0390] The device displays the analysis results, emotion results, and list of cosmetic surgery options sent from the server to the user. The user checks the details of the options and selects the plan that best suits them. The selected data is then sent to the server.

[0391] Presenting medical institutions and pricing information

[0392] The server generates a list of affiliated medical institutions and prices based on the cosmetic surgery plan selected by the user, and this information is sent to the terminal and presented to the user.

[0393] Final selection and booking

[0394] The user checks the presented medical institution and price information, and finally selects the desired medical institution and treatment date and time. The terminal sends the reservation information to the server, and the server completes the reservation procedure with the medical institution based on that data. A confirmation message that the reservation has been completed is displayed on the terminal.

[0395] Aftercare and evaluation

[0396] After the treatment is completed, the server provides the user with aftercare information. The terminal displays the provided aftercare guide to the user, who then provides appropriate care. After confirming the aftercare, the user also enters evaluation data, which is sent to the server for analysis. The server uses the collected evaluation data to improve its services.

[0397] Specific examples

[0398] For example, if a user is considering cosmetic surgery, they can register through a smartphone app and have their face scanned in 3D. The scan data is then analyzed by the server, and an emotion engine detects "anxiety" from the user's facial expression. Based on this, the server suggests cosmetic surgery options that provide a sense of security and reduce anxiety. After selecting a treatment option and checking the list of corresponding medical institutions and price information, the user can confirm an appointment for a convenient date and time. After the treatment, they can provide appropriate care based on the aftercare information provided, and enter their evaluation to provide feedback to the system. An example of this prompt is as follows:

[0399] Example prompt sentence:

[0400] Name: Yamada Hanako

[0401] Age: 29

[0402] Gender: Female

[0403] Face data: face_scan_data_in_base64_or_other_format

[0404] In this way, the system helps users easily obtain information about cosmetic surgery and make optimal choices that take into account their emotional state.

[0405] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0406] Step 1:

[0407] The terminal accepts basic information (such as name, age, gender, and contact details) from the user.

[0408] Input: User's basic information (name, age, gender, contact details)

[0409] How it works: A user uses a dedicated application on a smartphone or tablet to fill out a form to enter basic information.

[0410] Output: Basic information is saved on the device and sent to the server.

[0411] Step 2:

[0412] The device prompts the user to take a 3D scan of their face and provides lead instructions to ensure the facial scan is accurate.

[0413] Input: User's face data, camera footage

[0414] How it works: Using your smartphone or tablet's camera, the device captures a 3D scan of your face in real time and prompts you to reposition it as needed.

[0415] Output: 3D scan data is stored on the device and sent to a server.

[0416] Step 3:

[0417] The server analyzes the received 3D scan data and performs a detailed analysis of facial shape, bone structure, skin condition, etc.

[0418] Input: 3D scan data

[0419] How it works: Analysis software on the server processes the 3D scan data and extracts facial features and parameters.

[0420] Output: Detailed facial data as a result of analysis (shape, bone structure, skin condition, etc.)

[0421] Step 4:

[0422] The server analyzes the user's emotional state using an emotion engine based on the analyzed face data.

[0423] Input: detailed face data

[0424] How it works: The emotion engine on the server analyzes facial expression data, detects micro-expressions from the user's facial expressions, and determines their emotional state (e.g., joy, sadness, surprise, etc.) based on those expressions.

[0425] Output: Emotional state data

[0426] Step 5:

[0427] The server generates cosmetic surgery options based on the analysis and the emotional state data and presents customized options to the user.

[0428] Input: facial details, emotional state data

[0429] How it works: A generative AI model on the server uses the subject's data to determine available cosmetic surgery options and lists suitable suggestions for the user.

[0430] Output: Cosmetic surgery options list

[0431] Step 6:

[0432] The terminal displays the analysis results, emotion results, and list of cosmetic surgery options sent from the server to the user.

[0433] Enter: Cosmetic Surgery Options List

[0434] How it works: A smartphone or tablet application displays a list and the user interacts with the UI to make a selection.

[0435] Output: User selection data

[0436] Step 7:

[0437] The server generates a list of affiliated medical institutions and prices based on the user's selection data and transmits it to the terminal.

[0438] Input: User selection data, affiliated medical institution data

[0439] How it works: The server generates appropriate candidates from the information of affiliated medical institutions based on the selected data and creates a list with price information.

[0440] Output: List of providers and pricing information

[0441] Step 8:

[0442] The user checks the presented medical institutions and price information, and finally selects the desired medical institution and treatment date and time.

[0443] Input: List of providers and pricing information

[0444] How it works: The user selects the desired option from the list displayed on their smartphone or tablet and sets the date and time of the treatment.

[0445] Output: Reservation data

[0446] Step 9:

[0447] The server completes the reservation procedure with the medical institution based on the reservation data, and displays a confirmation message on the terminal that the reservation has been completed.

[0448] Input: Reservation data

[0449] Operation: The server connects to the medical institution's reservation system, completes the reservation procedure, generates a confirmation message, and sends it to the terminal.

[0450] Output: Reservation confirmation message

[0451] Step 10:

[0452] After the treatment, the server provides the user with aftercare information, which is displayed on the terminal. The user then performs the aftercare and submits evaluation data.

[0453] Input: None (after treatment is completed)

[0454] Operation: The server sends a prepared aftercare guide to the terminal, which displays it to the user. The user performs care according to the aftercare guide and then enters evaluation data into the terminal. The evaluation data is then sent to the server.

[0455] Output: Aftercare information, user evaluation data

[0456] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0457] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0458] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0459] [Second embodiment]

[0460] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0461] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0462] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0463] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0464] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0465] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0466] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0467] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0468] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0469] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0470] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0471] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0472] The present invention relates to a system that simplifies the process of selecting and booking cosmetic surgery procedures. The system allows users to obtain detailed data about their face through 3D scanning, and then suggests appropriate cosmetic surgery options based on that data, allowing them to make the booking.

[0473] System Overview

[0474] The system mainly consists of a terminal used by the user, a server that analyzes and stores data, and a clinic that provides suggested cosmetic surgery options.

[0475] Program processing

[0476] Initial Data Entry

[0477] Using the device, the user enters their initial basic information (name, age, gender, contact details, etc.), which is then sent to the server and stored.

[0478] Performing a 3D scan

[0479] Users use the camera on their smartphone or tablet to perform a 3D facial scan. The device provides lead instructions to guide the user through the precise scan and captures the 3D data in real time. Once the scan is complete, the data is compressed and sent to a server.

[0480] Data analysis and options presentation

[0481] The server uses an algorithm to analyze the received 3D scan data, performing a detailed analysis of the facial shape, bone structure, skin condition, etc. Based on the analysis results, it generates the optimal cosmetic surgery options for the user and sends them to the device.

[0482] Consulting and plan selection

[0483] The device displays the analysis results and cosmetic surgery options sent from the server to the user. The user can select the plan they are interested in from the options presented and check detailed information and treatment examples. The selection data is sent to the server.

[0484] Clinic and price information provided

[0485] The server generates a list of affiliated clinics and pricing information for treatments based on the cosmetic surgery plan selected by the user, and sends this information to the terminal and presents it to the user.

[0486] Final selection and booking

[0487] The user checks the clinic and price information provided, and finally selects the desired clinic and treatment date and time. The terminal sends the reservation information to the server, and the server completes the reservation procedure with the clinic based on that data. A confirmation message confirming the reservation is complete is displayed on the terminal.

[0488] Aftercare and evaluation

[0489] After the treatment, the server provides the user with aftercare information, allowing the user to check post-treatment care methods. After checking the aftercare, the user also enters evaluation data, which is sent to the server for analysis. The server uses the collected evaluation data to improve its services.

[0490] Specific examples

[0491] For example, if a user is using the system for the first time and considering cosmetic surgery, they can register through a smartphone app and take a 3D scan of their face. The scan data is then analyzed by the server, which suggests multiple options, such as hyaluronic acid injections and facelifts. The user selects hyaluronic acid injections, checks a list of available clinics and pricing information, and then confirms an appointment at a convenient date and time. After the procedure, they receive appropriate care based on the aftercare information provided, and then enters a rating to provide feedback to the system.

[0492] In this way, the system helps users easily obtain information about cosmetic surgery and make the best choice with confidence.

[0493] The processing flow will be explained below.

[0494] Step 1:

[0495] The user launches the application on the device and proceeds to the new registration screen. The user enters basic information such as name, age, gender, and email address. The device then checks the input for any input errors. Once the check is complete, the device sends this data to the server.

[0496] Step 2:

[0497] The device displays a screen prompting the user to prepare for a 3D facial scan. The user prepares their face for a 3D facial scan and follows the device's instructions to rotate their face 360 ​​degrees to perform the 3D scan. The device captures, corrects, and compresses the scanned data in real time. Once the scan is completed accurately, the device sends the data to the server.

[0498] Step 3:

[0499] The server receives the 3D scan data sent from the device, checks the data for consistency and quality, stores the data in a database, and runs an analysis algorithm that analyzes facial shape, bone structure, skin condition, and other factors to generate optimal cosmetic surgery options.

[0500] Step 4:

[0501] Once the analysis is complete, the server creates a list of cosmetic surgery options and sends it to the device. The device displays the analysis results and the list of cosmetic surgery options received from the server to the user. The user can then review the details of the options and select the plan that best suits them.

[0502] Step 5:

[0503] When a user selects a plan from the cosmetic surgery options, the device sends the selection data to the server, which generates a list of affiliated clinics and prices based on the selected options.

[0504] Step 6:

[0505] The server sends the generated list of clinics and prices to the terminal. The terminal then presents this information to the user, who compares the list of clinics and prices. The user then selects the most suitable clinic and treatment plan and confirms the desired appointment date and time.

[0506] Step 7:

[0507] Once the selection is complete, the terminal sends the reservation information to the server. The server then sends the reservation information to the clinic and returns a confirmation of whether the reservation has been accepted to the terminal. The terminal then displays a notification to the user that the reservation has been completed.

[0508] Step 8:

[0509] After the treatment is completed, the server provides the user with aftercare information, and the terminal displays the provided aftercare guide to the user, who then provides appropriate care based on it.

[0510] Step 9:

[0511] After the user has completed the appropriate treatment, the device displays a questionnaire to evaluate the treatment. The user answers the questionnaire, and the device sends the data to the server. The server analyzes the evaluation data and uses it to improve the service in the future.

[0512] Example 1

[0513] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0514] The traditional cosmetic surgery selection and booking process required users to visit a clinic in person for consultations and procedures, which was time-consuming and tedious. Additionally, users lacked the information they needed to select the best cosmetic surgery option for themselves, making it difficult to make the right choice.

[0515] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0516] In this invention, the server includes means for inputting basic user information, means for acquiring 3D scan data of the user's face, means for transmitting the acquired 3D scan data to the server, means for the server to analyze the 3D scan data and generate cosmetic surgery options, means for the server to transmit data to a terminal to display the cosmetic surgery options to the user, means for the user to select from the options and transmit the selected data to the server, means for the server to generate clinic and price information based on the selected options and transmit this information to the terminal, means for booking an appointment based on the clinic and treatment date and time finally selected by the user, means for the server to provide aftercare information and collect user evaluation data after the treatment, means for capturing 3D scan data of the user's face in real time, and means for transmitting the user evaluation data to the server, which then analyzes the evaluation data and uses it to improve services. This allows users to quickly and easily select the cosmetic surgery options that are best suited to them online and to consistently complete the entire process from booking to aftercare.

[0517] "User" refers to a person who uses the system to select and book cosmetic surgery procedures.

[0518] "Basic information" refers to data necessary to identify an individual, such as the user's name, age, gender, and contact information.

[0519] "3D facial scan data" refers to digital data that represents detailed information about a user's face, such as their facial shape, bone structure, and skin condition, in three dimensions.

[0520] "Terminal" refers to an electronic device used by a user, such as a smartphone, tablet, or computer.

[0521] "Server" refers to the computer system used to analyze 3D scan data, generate cosmetic surgery options, store data, process reservations, etc.

[0522] "Cosmetic surgery options" refers to the specific cosmetic surgery procedures offered to users (e.g., hyaluronic acid injections, facelifts, etc.).

[0523] "Acquisition means" refers to the technological process or equipment used to collect a 3D scan of the user's face.

[0524] "Means for analysis" refers to the algorithms and software used to analyze the acquired 3D scan data and recommend the most appropriate cosmetic surgery options to the user.

[0525] "Selection Data" refers to information about the specific procedures selected by a user from among the cosmetic surgery options presented to them.

[0526] "Clinic" refers to a medical institution that provides cosmetic surgery procedures.

[0527] "Price Information" refers to information regarding the cost of the procedure corresponding to the selected cosmetic surgery option.

[0528] "Reservation procedure" refers to the series of processes for completing a reservation for the desired date and time for the cosmetic surgery procedure selected by the user.

[0529] "Aftercare information" refers to instructions and advice provided to users to help them take appropriate care after treatment.

[0530] "Evaluation data" refers to feedback information in which a user evaluates the service or treatment content after the treatment.

[0531] "Real-time capture means" refers to the technological process or equipment used to instantly acquire and process a 3D scan of a user's face in real time.

[0532] MODE FOR CARRYING OUT THE INVENTION

[0533] The present invention relates to a system that simplifies the process of selecting and booking cosmetic surgery treatments by allowing users to obtain detailed data of their own face through 3D scanning, suggesting appropriate cosmetic surgery options based on that data, and even allowing them to make reservations. The system mainly consists of a device used by the user, a server that analyzes and stores the data, and a medical institution that provides the suggested cosmetic surgery options.

[0534] Initial Data Entry

[0535] The user uses the device to input basic information (such as name, age, gender, and contact details), which is then sent to the server, where it is stored.

[0536] Performing a 3D scan

[0537] Users use the camera on their smartphone or tablet to perform a 3D scan of their face. The device provides lead instructions, directing the user to accurately scan their face. For example, instructions such as "Please slowly turn your face left and right" are given in real time. Once the scan is complete, the device compresses the 3D data and sends it to the server.

[0538] Data analysis and options presentation

[0539] The server uses algorithms (such as OpenCV and TensorFlow) to analyze the received 3D scan data and perform a detailed analysis of the facial shape, bone structure, and skin condition. Based on the analysis results, the server generates the optimal cosmetic surgery options for the user and sends them to the device.

[0540] Consulting and plan selection

[0541] The device displays the analysis results and cosmetic surgery options sent from the server to the user. The user can select the plan they are interested in from the options presented and check detailed information and treatment examples. For example, options such as "hyaluronic acid injection" and "facelift" are presented.

[0542] Clinic and price information provided

[0543] Once the user selects a plan, the device sends the selection data to the server, which generates a list of affiliated clinics and their treatment prices based on the user's selection. This information is sent to the device and presented to the user.

[0544] Final selection and booking

[0545] The user checks the list of clinics and treatment price information provided, and finally selects the desired clinic and treatment date and time. The reservation information from the terminal is sent to the server, which completes the reservation procedure with the affiliated medical institution. A message indicating reservation completion is displayed on the terminal. For example, a message such as "Reservation completed. Please come to the clinic at 12:00 on XX month XX day" is displayed.

[0546] Aftercare and evaluation

[0547] After the treatment, the server provides the user with aftercare information. For example, it may provide care instructions such as "Please keep the area cool and rest for 24 hours after the treatment." The user can then confirm this information and provide appropriate care at home. The user also inputs their post-treatment evaluation via their device, and this evaluation data is sent to the server. The server analyzes the evaluation data and uses it to improve the service.

[0548] Examples of concrete examples and prompts

[0549] For example, when a user uses the system for the first time to consider cosmetic surgery, they register through a smartphone app and take a 3D scan of their face. The scan data is then analyzed by the server, and multiple options, such as hyaluronic acid injections and facelifts, are presented. The user selects hyaluronic acid injections, checks a list of available clinics and pricing information, and then confirms an appointment at a convenient date and time. After the procedure, they provide appropriate care based on the aftercare information provided, and enter a rating to provide feedback to the system.

[0550] Example prompt sentence:

[0551] "Users use a smartphone app to initially register for cosmetic surgery and then take a 3D scan of their face. Based on the scan data, the app recommends the most appropriate cosmetic surgery options. For example, hyaluronic acid injections, facelift, etc."

[0552] As described above, this system allows users to quickly and easily select the cosmetic surgery option that best suits them online, and to complete the entire process from booking to aftercare.

[0553] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0554] Step 1:

[0555] The user enters basic information.

[0556] Users use devices such as smartphones and tablets to enter their basic information (name, age, gender, contact details, etc.) into a dedicated application. The entered basic information is temporarily saved by the device.

[0557] Step 2:

[0558] The terminal sends the input data to the server.

[0559] The terminal sends the basic information entered by the user to the server using the HTTPS protocol, which receives this data, stores it in a database, and generates a unique ID for the user, which allows the user to be identified in subsequent processes.

[0560] Step 3:

[0561] The user performs a 3D scan of their face.

[0562] The user initiates a 3D scan of their face using the device's camera. The device provides lead instructions, such as slowly rotating the user's face left and right, in real time. The device captures and temporarily stores the 3D data of the face through the camera.

[0563] Step 4:

[0564] The device sends the scanned data to the server.

[0565] Once the scan is complete, the device compresses the captured 3D data and sends it over HTTPS to a server, which receives it and stores it for analysis.

[0566] Step 5:

[0567] The server analyzes the 3D scan data.

[0568] The server then analyzes the received 3D scan data using algorithms such as OpenCV and TensorFlow to extract detailed data such as facial shape, bone structure, and skin condition. The analysis results are then temporarily stored.

[0569] Step 6:

[0570] A server generates cosmetic surgery options.

[0571] Based on the analysis results, the server generates the optimal cosmetic surgery options for the user (e.g., hyaluronic acid injection, facelift, etc.). The generated options are temporarily stored.

[0572] Step 7:

[0573] The server sends the option data to the terminal.

[0574] The server sends the generated cosmetic surgery options to the terminal, which receives this data and displays it to the user, who then selects the plan they are interested in from the presented options.

[0575] Step 8:

[0576] The user selects a plan.

[0577] The user uses the device to select the plan they are interested in from the presented cosmetic surgery options, and check detailed information and treatment examples. When the user selects a plan, selection data is generated.

[0578] Step 9:

[0579] The terminal transmits the selection data to the server.

[0580] The device sends the user's selected plan information to the server using the HTTPS protocol, which receives this data and generates clinic and price information based on the selected cosmetic surgery plan.

[0581] Step 10:

[0582] The server generates a list of clinics and pricing information.

[0583] The server generates a list of affiliated clinics and treatment price information and sends it to the terminal, which receives the information and displays it to the user.

[0584] Step 11:

[0585] The user selects the clinic and treatment date and time.

[0586] The user checks the list of clinics and price information displayed on the terminal, and finally selects the desired clinic and treatment date and time. Selection data is generated.

[0587] Step 12:

[0588] The terminal transmits the reservation information to the server.

[0589] The device sends the selected clinic and treatment date and time information to the server using the HTTPS protocol. The server receives this data and completes the reservation procedure.

[0590] Step 13:

[0591] The server completes the reservation process.

[0592] The server sends a reservation request to the affiliated clinic and completes the reservation procedure. A confirmation message is generated and sent to the terminal.

[0593] Step 14:

[0594] The device will display a confirmation message that the reservation is complete.

[0595] The terminal displays the reservation completion confirmation message received from the server to the user. For example, a message such as "Reservation completed. Please come to the hospital at 12:00 on XX month XX day" is displayed.

[0596] Step 15:

[0597] The server provides aftercare information.

[0598] After the treatment, the server provides the user with detailed aftercare information. For example, instructions such as "Please keep the area iced and rest for 24 hours after the treatment" are sent. The device receives this information and displays it to the user.

[0599] Step 16:

[0600] The user checks the aftercare information and provides care.

[0601] The user checks the provided aftercare information and provides appropriate care at home.

[0602] Step 17:

[0603] The user enters the evaluation data.

[0604] After the treatment, the user inputs their evaluation through the terminal, and evaluation data is generated.

[0605] Step 18:

[0606] The terminal transmits the evaluation data to the server.

[0607] The device sends the user-entered rating data to the server using the HTTPS protocol, which receives and stores the data for use in improving the service.

[0608] The above are the specific processing steps of this system.

[0609] (Application example 1)

[0610] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0611] For users considering cosmetic surgery, selecting the most suitable cosmetic surgery option and booking the appointment are time-consuming and cumbersome tasks. It is also important to provide information on aftercare after the procedure and efficiently collect user feedback to use in improving services. However, traditional methods for these processes are fragmented, limiting the ability to improve user experience and optimize services.

[0612] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0613] In this invention, the server includes a means for improving services using a generative AI model based on user evaluation data, a means for capturing 3D facial scan data in real time, and a means for transmitting the user's post-treatment evaluation data to the server and using the generative AI model to improve services. This allows users to quickly and accurately select the optimal cosmetic surgery option and easily complete the reservation process. Furthermore, the provision of aftercare information and the collection of evaluation data after treatment also enable continuous improvement of services.

[0614] "Basic information" refers to data necessary to identify an individual, such as the user's name, age, gender, and contact information.

[0615] "3D scan data" is digital data that captures the three-dimensional shape of a user's face.

[0616] "Server" means a computer system for analyzing 3D scan data, generating cosmetic surgery options, and storing and providing relevant information to users.

[0617] "Analysis" is the process of examining the facial shape, bone structure, skin condition, etc. in detail based on the acquired 3D scan data.

[0618] "Cosmetic surgery options" are treatment options suggested by analyzing 3D scan data of the user's face.

[0619] A "terminal" is a device used by a user, such as a smartphone or tablet.

[0620] "Selection data" refers to information about the procedure selected by the user from among the cosmetic surgery options.

[0621] "Medical facility" means a hospital or clinic that provides cosmetic surgery.

[0622] The "reservation procedure" is the process of confirming a treatment date and time with a medical facility based on the cosmetic surgery option selected by the user.

[0623] "Aftercare information" refers to information about care methods and precautions to take after treatment.

[0624] "Evaluation data" is feedback information provided by the user after the treatment.

[0625] A "generative AI model" is an artificial intelligence model that analyzes user evaluation data and improves and optimizes services.

[0626] The system embodying the present invention simplifies the process of selecting and booking cosmetic surgery procedures. Specifically, the user uses a device such as a smartphone or tablet to acquire 3D facial scan data, which is then sent to a server where it is analyzed, the system recommends optimal cosmetic surgery options, and assists with the booking process.

[0627] Hardware and software used

[0628] Hardware: smartphones, tablets, servers

[0629] Software: Flask (server-side framework), face_recognition (face analysis library), Flutter (client app framework), generative AI model

[0630] System action

[0631] The server receives the user's basic information and 3D scan data, and performs a detailed analysis of the face's shape, bone structure, and skin condition. The analysis uses the face_recognition library to obtain facial landmarks and shape data. Based on this analysis data, cosmetic surgery options are generated and sent to the user's device.

[0632] The terminal displays cosmetic surgery options to the user and transmits the option selected by the user to the server, which generates affiliated medical facilities and price information based on the selected option and transmits it to the terminal, allowing the user to complete the reservation procedure.

[0633] After the procedure, the server provides aftercare information and collects user evaluation data. The collected evaluation data is analyzed using a generative AI model and used to improve the service, thereby continuously providing users with the most suitable cosmetic surgery options.

[0634] Specific examples

[0635] Let's take the example of a user named Hanako considering cosmetic surgery. Hanako first uses a smartphone app to enter basic information and take a 3D scan of her face. This 3D scan data is sent to a server for analysis. The server then suggests cosmetic surgery options such as hyaluronic acid injections and facelifts. Hanako selects hyaluronic acid injections, checks medical facilities and pricing information, and then confirms an appointment for her desired date and time. After the procedure, she follows the aftercare information provided, and then enters her evaluation and provides feedback to the system. This feedback data is analyzed by a generative AI model and used to improve the system's services.

[0636] Prompt Sentence Examples

[0637] "I'm considering cosmetic surgery. I've entered the following basic information: Name: Hanako, Age: 30, Gender: Female, Contact Information: [email address]. I've then had a 3D scan of my face. Please analyze my facial shape and skin condition and recommend the best cosmetic surgery options for me. How do I choose the options I want and complete my appointment?"

[0638] This embodiment of the invention allows users to easily find the cosmetic surgery options that are best for them and receive the treatment with peace of mind.

[0639] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0640] Step 1:

[0641] The terminal inputs the user's basic information.

[0642] (Input): Basic information such as the user's name, age, gender, and contact details.

[0643] (Specific operation): When a user enters data into the input form displayed on the terminal and presses the submit button, this information is sent to the server in JSON format.

[0644] (Output): Basic information sent to the server.

[0645] Step 2:

[0646] The device acquires a 3D scan of the user's face.

[0647] (Input): Face scan using your smartphone or tablet camera.

[0648] (Specific operation): The device uses the camera to initiate a 3D scan of the face, capturing data in real time, which is then compressed and sent to the server.

[0649] (Output): The 3D scan data sent to the server.

[0650] Step 3:

[0651] The server analyzes the 3D scan data and generates cosmetic surgery options.

[0652] (Input): 3D scan data stored on the server.

[0653] (Specific operation): The server uses the face_recognition library to analyze the face shape, bone structure, skin condition, etc.

[0654] , to generate optimal cosmetic surgery options.

[0655] (Output): Generated cosmetic surgery options.

[0656] Step 4:

[0657] The server sends cosmetic surgery options to the device.

[0658] (Input): Generated cosmetic surgery options.

[0659] (Specific operation): The server sends the generated cosmetic surgery options in JSON format to the terminal.

[0660] (Output): Cosmetic surgery options displayed on the device.

[0661] Step 5:

[0662] The user selects from the options and sends the selection to the server.

[0663] (Input): Cosmetic surgery options displayed on the device.

[0664] (Specific operation): The user selects the desired option on the terminal and presses the select button. This selection data is sent to the server.

[0665] (Output): The selection data sent to the server.

[0666] Step 6:

[0667] The server generates medical facility and price information based on the selected options and transmits it to the terminal.

[0668] (Input): Selection data stored on the server.

[0669] (Specific operation): The server generates affiliated medical facilities and their price information based on the selected data and sends it to the terminal in JSON format.

[0670] (Output): Medical facility and pricing information displayed on the terminal.

[0671] Step 7:

[0672] The user then makes a reservation based on the medical facility and price information that he or she has finally selected.

[0673] (Input): Medical facility and price information displayed on the terminal.

[0674] (Specific operation): The user selects the desired medical facility and treatment date and time, and presses the reservation button. The reservation information is sent to the server, and the reservation procedure is completed on the server side.

[0675] (Output): A confirmation message that the reservation is complete.

[0676] Step 8:

[0677] After the treatment, the server provides aftercare information and collects user evaluation data.

[0678] (Input): User after reservation is completed.

[0679] (Specific operation): After the treatment, the server sends aftercare information to the terminal and receives evaluation data entered by the user.

[0680] (Output): Rating data stored on the server.

[0681] Step 9:

[0682] The service is improved using a generative AI model based on the evaluation data acquired by the server.

[0683] (Input): Rating data stored on the server.

[0684] (Specific operation): The server inputs the evaluation data into the generative AI model and improves the service based on the analysis results.

[0685] (Output): Service improvement.

[0686] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0687] The present invention relates to a system that simplifies the cosmetic surgery selection and booking process by obtaining detailed data of the user's face through 3D scanning, suggesting appropriate cosmetic surgery options based on that data, and using an emotion engine to recognize the user's emotions and help provide more appropriate choices.

[0688] System Overview

[0689] The system consists of a terminal operated by the user, a server that analyzes and stores data, a clinic that provides suggested cosmetic surgery options, and an emotion engine that recognizes the user's emotions.

[0690] Program processing

[0691] Initial Data Entry

[0692] Using the device, the user enters their initial basic information (name, age, gender, contact details, etc.), which is then sent to the server and stored.

[0693] Performing a 3D scan

[0694] Users use the camera on their smartphone or tablet to perform a 3D facial scan. The device provides lead instructions to guide the device in accurately scanning the face, capturing the 3D data in real time. Once the scan is complete, the data is compressed and sent to a server.

[0695] Data analysis and emotion recognition

[0696] The server analyzes the received 3D scan data and performs a detailed analysis of the facial shape, bone structure, skin condition, etc. It then uses an emotion engine to analyze the user's emotions from the facial expression data. The emotion engine detects changes in micro-expressions and identifies the user's current feelings (e.g., joy, sadness, surprise, etc.).

[0697] Options and customization

[0698] The server generates cosmetic surgery options based on the analysis results and the emotion engine results, and customizes the options that best suit the user. This information is sent to the terminal and presented to the user.

[0699] Consulting and plan selection

[0700] The device displays the analysis results, emotion results, and list of cosmetic surgery options sent from the server to the user. The user checks the details of the options and selects the plan that best suits them. The selected data is then sent to the server.

[0701] Clinic and price information provided

[0702] The server generates a list of affiliated clinics and prices based on the cosmetic surgery plan selected by the user, and this information is sent to the terminal and presented to the user.

[0703] Final selection and booking

[0704] The user checks the clinic and price information provided, and finally selects the desired clinic and treatment date and time. The terminal sends the reservation information to the server, and the server completes the reservation procedure with the clinic based on that data. A confirmation message confirming the reservation is complete is displayed on the terminal.

[0705] Aftercare and evaluation

[0706] After the treatment is completed, the server provides the user with aftercare information. The terminal displays the provided aftercare guide to the user, who then provides appropriate care. After confirming the aftercare, the user also enters evaluation data, which is sent to the server for analysis. The server uses the collected evaluation data to improve its services.

[0707] Specific examples

[0708] For example, if a user is considering cosmetic surgery, they can register through a smartphone app and have their face scanned in 3D. The scan data is then analyzed by the server, and the emotion engine detects "anxiety" from the user's facial expression. Based on this, the server suggests cosmetic surgery options that provide a sense of security and reduce anxiety. After the user selects hyaluronic acid injection and checks the list of available clinics and pricing information, they can schedule an appointment for a convenient date and time. After the procedure, they can provide appropriate care based on the aftercare information provided, and enter their evaluation to provide feedback to the system.

[0709] In this way, the system helps users easily obtain information about cosmetic surgery and make optimal choices that take into account their emotional state.

[0710] The processing flow will be explained below.

[0711] Step 1:

[0712] The user launches the application on the device and proceeds to the new registration screen. The user enters basic information such as name, age, gender, and email address. The device then checks the input for any input errors. Once the check is complete, the device sends this data to the server.

[0713] Step 2:

[0714] The device displays a screen prompting the user to prepare for a 3D facial scan. The user prepares their face for a 3D facial scan and follows the device's instructions to rotate their face 360 ​​degrees to perform the 3D scan. The device captures, corrects, and compresses the scanned data in real time. Once the scan is completed accurately, the device sends the data to the server.

[0715] Step 3:

[0716] The server receives the 3D scan data sent from the device, checks the data integrity and quality, stores the data in a database, and runs an analysis algorithm that analyzes facial shape, bone structure, skin condition, etc.

[0717] Step 4:

[0718] The server activates an emotion engine to recognize the user's emotions based on the 3D facial scan data. The emotion engine analyzes the user's facial expression data and identifies the user's emotional state. For example, if the user is smiling, it recognizes the emotion as "joy," and if they are frowning, it recognizes the emotion as "anxiety."

[0719] Step 5:

[0720] The server generates cosmetic surgery options based on the facial analysis and emotion engine results. If the analysis result is "a facelift is appropriate" and the emotion is "anxiety," the server customizes the options with detailed explanations about facelifts and additional information to alleviate the user's anxiety.

[0721] Step 6:

[0722] The server sends the analyzed data and cosmetic surgery options to the device. The device displays a detailed list of options to the user. The user checks the details of each option and selects the plan that best suits them. The selected data is then sent from the device to the server.

[0723] Step 7:

[0724] The server generates a list of affiliated clinics and pricing information for the procedures based on the selected cosmetic surgery options. This information is sent to the terminal and presented to the user, who can then compare the presented list and prices.

[0725] Step 8:

[0726] The user finally selects the most suitable clinic and treatment plan, and confirms the desired reservation date and time. The terminal sends this reservation information to the server. The server sends the reservation information to the clinic, and upon receiving confirmation from the clinic, returns it to the terminal. The terminal displays a notification to the user that the reservation has been completed.

[0727] Step 9:

[0728] After the treatment is completed, the server sends an aftercare guide to the terminal to provide the user with aftercare information. The terminal displays this guide to the user, and the user follows the instructions to provide appropriate care.

[0729] Step 10:

[0730] After the user completes the aftercare, the device displays a questionnaire to evaluate the treatment. The user answers the questionnaire, and the device sends the data to the server. The server receives the evaluation data and analyzes it to improve the service.

[0731] Specific examples

[0732] For example, if a user is interested in cosmetic surgery, they can register through a smartphone app and have their face scanned in 3D. The scan data is analyzed by the server, and an emotion engine detects "anxiety" from the user's facial expression. Based on this, the server suggests options such as hyaluronic acid injections to provide a sense of security. The user selects an option, confirms clinic and price information, and then confirms the appointment. After the procedure, the user receives appropriate care based on the aftercare information provided, and enters an evaluation that is fed back to the system. In this way, the system helps users easily obtain information about cosmetic surgery and make the best choice, taking their emotional state into consideration.

[0733] Example 2

[0734] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0735] The process of selecting and booking cosmetic surgery is complex and time-consuming for users, making it difficult to obtain appropriate information. Furthermore, the user's emotional state is not taken into consideration, which may result in an inadequate selection. This risks reducing user satisfaction. Furthermore, the provision of aftercare information and collection of evaluation data after the procedure are not effectively implemented.

[0736] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting basic information about the user, means for acquiring 3D scan data of the user's face, means for transmitting the acquired 3D scan data to the server, means for the server to analyze the 3D scan data and generate cosmetic surgery options, means for the server to transmit the cosmetic surgery options to the terminal, means for the user to select from the options and transmit the selected data to the server, means for the server to generate facility and price information based on the selected options and transmit this information to the terminal, means for completing the reservation procedure based on the facility and price information finally selected by the user, means for the server to provide aftercare information and collect user evaluation data after the procedure, and means for providing cosmetic surgery options based on the user's emotions using an emotion engine that recognizes the user's emotions. This allows the user to select the optimal cosmetic surgery option taking into account their emotional state, making it possible to efficiently complete the entire process from reservation to aftercare.

[0737] "Basic user information" refers to information that identifies a user and constitutes a basic profile, such as name, age, gender, and contact information.

[0738] "Three-dimensional scan data" refers to data that captures the shape and expression of a user's face in three dimensions, and includes information such as the overall shape of the face, bone structure, and skin condition.

[0739] A "server" is a device that is composed of a computer and a storage device for analyzing and storing received data, and generating and providing necessary information.

[0740] An "emotion engine" is an algorithm and software for recognizing and analyzing emotions from a user's facial expressions.

[0741] "Cosmetic surgery options" are options for cosmetic surgery or procedures suggested to users based on their cosmetic needs, including hyaluronic acid injections, Botox injections, facelifts, etc.

[0742] A "terminal" is a device operated by a user, such as a smartphone, tablet, or PC, which is an electronic device with input and display functions.

[0743] A "facility" is a doctor's office or clinic that offers the proposed cosmetic surgery options.

[0744] "Aftercare information" refers to guidelines and support information provided to users regarding post-treatment care methods and precautions.

[0745] "Evaluation data" refers to feedback information provided by the user after a treatment, and includes evaluations of the appropriateness of aftercare and the results of the treatment.

[0746] The present invention is a system that simplifies the cosmetic surgery selection and booking process. The system consists of a user-operated terminal, a server that analyzes and stores data, a facility that provides suggested cosmetic surgery options, and an emotion engine that recognizes the user's emotions.

[0747] Initial Data Entry

[0748] Using a device, the user enters their initial basic information (such as name, age, gender, and contact details). This data is sent from the device to a server and stored. Specifically, the user accesses an application on their smartphone or tablet, enters the required information into a form, and submits it.

[0749] Performing a 3D scan

[0750] Users use the camera on their smartphone or tablet to perform a 3D scan of their face. The device provides lead instructions to guide the user through the precise scan and captures the 3D data in real time. Once the scan is complete, the data is compressed and sent to a server. For example, this can be done using Photogrammetry software.

[0751] Data analysis and emotion recognition

[0752] The server performs a detailed analysis of the received 3D scan data. This analysis includes analyzing the facial shape, bone structure, and skin condition. It then uses an emotion engine (e.g., Emotion AI) to analyze the user's emotions from their facial expression data. The emotion engine detects changes in micro-expressions and identifies the user's current emotion (e.g., joy, sadness, surprise, etc.).

[0753] Options and customization

[0754] The server generates cosmetic surgery options based on the analysis results and the emotion engine results, and customizes the options that best suit the user. This information is sent to the device and presented to the user. The cosmetic surgery options include hyaluronic acid injections, Botox injections, and facelifts.

[0755] Consulting and plan selection

[0756] The device displays the analysis results, emotion results, and list of cosmetic surgery options sent from the server to the user. The user checks the details of the options and selects the plan that best suits them. The selected data is then sent to the server.

[0757] Clinic and price information provided

[0758] The server generates a list of affiliated facilities and prices based on the user's cosmetic surgery plan selection. This information is sent to the device and presented to the user. For example, the server may automatically search a database of relevant cosmetic surgery facilities and display results based on the user's location and preferences.

[0759] Final selection and booking

[0760] The user checks the facilities and price information provided, and finally selects the desired facility and treatment date and time. The terminal sends the reservation information to the server, and the server completes the reservation procedure with the facility based on that data. A confirmation message confirming the reservation is complete is displayed on the terminal.

[0761] Aftercare and evaluation

[0762] After the treatment is completed, the server provides the user with aftercare information. The terminal displays the provided aftercare guide to the user, who then provides appropriate care based on it. After confirming the aftercare, the user also enters evaluation data, which is sent to the server. The server uses the collected evaluation data to improve its services.

[0763] Specific examples

[0764] For example, if a user is considering cosmetic surgery, they can register through a smartphone application and have their face scanned in 3D. The scan data is then analyzed by the server, and an emotion engine detects "anxiety" from the user's facial expression. Based on this, the server suggests cosmetic surgery options that provide superior peace of mind to alleviate anxiety. After the user selects hyaluronic acid injection and checks the list of corresponding facilities and pricing information, they can confirm an appointment at a convenient date and time. After the procedure, they can provide appropriate care based on the aftercare information provided, and enter their evaluation to provide feedback to the system.

[0765] Prompt Sentence Examples

[0766] "We will take into account your current emotional state and recommend the best cosmetic surgery options for you. We will perform a three-dimensional scan of your face and provide you with detailed data."

[0767] In this way, the system helps users easily obtain information about cosmetic surgery and make optimal choices that take into account their emotional state.

[0768] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0769] Step 1: Initial data entry

[0770] A user accesses an application on a smartphone or tablet and enters basic information (name, age, gender, contact details). Once this data is entered, the device sends the entered data to the server. The server stores the received basic information in a database and prepares it for the next step. Specific operations include the display of an input form, the user filling in the fields, and pressing the submit button. Input: Name, age, gender, contact details. Output: Basic information is saved in the database.

[0771] Step 2: Perform a 3D scan

[0772] The user uses the device's camera to perform a 3D scan of their face. The device displays lead instructions to guide the user to scan accurately. During the scan, 3D data is captured in real time. Once the scan is complete, the device compresses this data and sends it to the server. Once the server receives the data, it stores it and prepares it for the next analysis step. Input: 3D scan data. Output: Compressed scan data sent to the server.

[0773] Step 3: Data analysis and emotion recognition

[0774] The server analyzes the received 3D scan data. Specifically, it uses Photogrammetry software to perform a detailed analysis of facial shape, bone structure, skin condition, and other factors. It then uses Emotion AI to recognize emotions from the user's facial expression data. The emotion engine analyzes changes in micro-expressions and identifies emotions such as "happiness," "sadness," and "surprise." Input: 3D scan data. Output: Detailed facial shape data and emotion recognition results.

[0775] Step 4: Present options and customize

[0776] The server generates cosmetic surgery options based on the analysis results and the emotion engine results. Specifically, it lists treatment options (e.g., hyaluronic acid injection, Botox injection, facelift, etc.) tailored to the user's skin condition and bone structure. These options are sent to the device in a customizable format. Guides and explanations are also provided to help the user select the best option. Input: Detailed face shape data and emotion recognition results. Output: List of cosmetic surgery options and guide.

[0777] Step 5: Consultation and plan selection

[0778] The device displays the analysis results received from the server, cosmetic surgery options, and a recommended list of beauty facilities to the user. The user reviews the details of the options and selects the plan that suits them. Once the selection is complete, the device sends the information to the server. The server records the selection data and proceeds to present the next facility and price information. Input: Cosmetic surgery option selected by the user. Output: Selection data sent to the server.

[0779] Step 6: Present your facilities and pricing information

[0780] The server generates beauty salons and their pricing information based on the plan selected by the user. In particular, the server searches the relevant database to create a list of salons and pricing information based on the user's location and desired conditions. This information is sent to the terminal and presented to the user. Input: User's selection data and location information. Output: List of salons and pricing information.

[0781] Step 7: Final selection and booking

[0782] The user checks the provided facility and price information, and selects the desired beauty facility and treatment date and time. The device sends this information to the server. The server automatically completes the reservation procedure and generates reservation confirmation data with the clinic. A confirmation message indicating the reservation is complete is then displayed on the device. Input: User's facility and date and time selection information. Output: Completion of reservation procedure and confirmation message.

[0783] Step 8: Aftercare and evaluation

[0784] After the treatment is completed, the server provides the user with the necessary aftercare information. This information is sent to the terminal, and the user provides appropriate care based on that information. The user then inputs the results and evaluation of the aftercare, and this data is sent from the terminal to the server. The server analyzes the evaluation data and uses it to improve services in the future. Input: User evaluation data. Output: Analysis data for service improvement.

[0785] (Application example 2)

[0786] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0787] In the conventional cosmetic surgery selection and booking process, it was difficult for users to accurately understand their facial data and select the appropriate cosmetic surgery option. Furthermore, cosmetic surgery recommendations rarely took into account users' emotional state, which left users unable to alleviate their psychological anxiety. Furthermore, information about the booking procedure and aftercare was insufficient, resulting in poor overall service quality.

[0788] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0789] In this invention, the server includes means for analyzing 3D scan data of the user's face, analyzing the user's emotional state with an emotion engine, and generating cosmetic surgery options, means for the server to transmit the cosmetic surgery options to the terminal, and means for the user to select from the options and transmit the selected data to the server. This allows the user to select the optimal cosmetic surgery option based on their own facial data, taking into account their emotional state, and simplifies the reservation process while reducing psychological anxiety.

[0790] "Basic information" refers to the user's name, age, gender, contact information, etc.

[0791] "3D scan data" is data that measures the shape and features of a user's face in three dimensions and saves it as digital data.

[0792] A "server" is a computer system that analyzes, stores, and transmits and receives data over a network.

[0793] An "emotion engine" is a system that includes algorithms and software for analyzing emotions from a user's facial expression data and identifying the user's state of mind.

[0794] "Cosmetic surgery options" are suggested cosmetic procedures and treatment options based on the user's facial features and emotional state.

[0795] "Terminal" refers to a personal computer such as a smartphone or tablet used by a user.

[0796] A "clinic" is a medical institution or clinic that provides cosmetic surgery procedures.

[0797] "Price information" is information about the cost of cosmetic surgery procedures.

[0798] The "reservation procedure" refers to the operations and steps for booking a treatment at a clinic based on the cosmetic surgery options selected by the user.

[0799] "Aftercare information" is information that includes instructions and guidelines regarding care after a procedure.

[0800] "Evaluation data" refers to data regarding user satisfaction and feedback after treatment.

[0801] "Real-time capture" refers to instantly acquiring 3D scan data of the user's face and processing it on the spot.

[0802] This invention is a system that simplifies the cosmetic surgery selection and booking process by obtaining detailed data of the user's face through 3D scanning, suggesting appropriate cosmetic surgery options based on that data, and using an emotion engine to recognize the user's emotions and help provide more appropriate choices.

[0803] System Overview

[0804] The system consists of a device operated by the user, a server that analyzes and stores data, a medical institution that provides suggested cosmetic surgery options, and an emotion engine that recognizes the user's emotions.

[0805] Program processing

[0806] Initial Data Entry

[0807] The user uses the device to input basic information (such as name, age, gender, and contact details), which is then sent to the server and stored.

[0808] Performing a 3D scan

[0809] Users use the camera on their smartphone or tablet to perform a 3D facial scan. The device provides lead instructions to guide the device in accurately scanning the face, capturing the 3D data in real time. Once the scan is complete, the data is compressed and sent to a server.

[0810] Data analysis and emotion recognition

[0811] The server analyzes the received 3D scan data and performs a detailed analysis of the facial shape, bone structure, skin condition, etc. It then uses an emotion engine to analyze the user's emotions from the facial expression data. The emotion engine detects changes in micro-expressions and identifies the user's current feelings (e.g., joy, sadness, surprise, etc.).

[0812] Options and customization

[0813] The server generates cosmetic surgery options based on the analysis results and the emotion engine results, and customizes the options that best suit the user. This information is sent to the terminal and presented to the user.

[0814] Consulting and plan selection

[0815] The device displays the analysis results, emotion results, and list of cosmetic surgery options sent from the server to the user. The user checks the details of the options and selects the plan that best suits them. The selected data is then sent to the server.

[0816] Presenting medical institutions and pricing information

[0817] The server generates a list of affiliated medical institutions and prices based on the cosmetic surgery plan selected by the user, and this information is sent to the terminal and presented to the user.

[0818] Final selection and booking

[0819] The user checks the presented medical institution and price information, and finally selects the desired medical institution and treatment date and time. The terminal sends the reservation information to the server, and the server completes the reservation procedure with the medical institution based on that data. A confirmation message that the reservation has been completed is displayed on the terminal.

[0820] Aftercare and evaluation

[0821] After the treatment is completed, the server provides the user with aftercare information. The terminal displays the provided aftercare guide to the user, who then provides appropriate care. After confirming the aftercare, the user also enters evaluation data, which is sent to the server for analysis. The server uses the collected evaluation data to improve its services.

[0822] Specific examples

[0823] For example, if a user is considering cosmetic surgery, they can register through a smartphone app and have their face scanned in 3D. The scan data is then analyzed by the server, and an emotion engine detects "anxiety" from the user's facial expression. Based on this, the server suggests cosmetic surgery options that provide a sense of security and reduce anxiety. After selecting a treatment option and checking the list of corresponding medical institutions and price information, the user can confirm an appointment for a convenient date and time. After the treatment, they can provide appropriate care based on the aftercare information provided, and enter their evaluation to provide feedback to the system. An example of this prompt is as follows:

[0824] Example prompt sentence:

[0825] Name: Yamada Hanako

[0826] Age: 29

[0827] Gender: Female

[0828] Face data: face_scan_data_in_base64_or_other_format

[0829] In this way, the system helps users easily obtain information about cosmetic surgery and make optimal choices that take into account their emotional state.

[0830] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0831] Step 1:

[0832] The terminal accepts basic information (such as name, age, gender, and contact details) from the user.

[0833] Input: User's basic information (name, age, gender, contact details)

[0834] How it works: A user uses a dedicated application on a smartphone or tablet to fill out a form to enter basic information.

[0835] Output: Basic information is saved on the device and sent to the server.

[0836] Step 2:

[0837] The device prompts the user to take a 3D scan of their face and provides lead instructions to ensure the facial scan is accurate.

[0838] Input: User's face data, camera footage

[0839] How it works: Using your smartphone or tablet's camera, the device captures a 3D scan of your face in real time and prompts you to reposition it as needed.

[0840] Output: 3D scan data is stored on the device and sent to a server.

[0841] Step 3:

[0842] The server analyzes the received 3D scan data and performs a detailed analysis of facial shape, bone structure, skin condition, etc.

[0843] Input: 3D scan data

[0844] How it works: Analysis software on the server processes the 3D scan data and extracts facial features and parameters.

[0845] Output: Detailed facial data as a result of analysis (shape, bone structure, skin condition, etc.)

[0846] Step 4:

[0847] The server analyzes the user's emotional state using an emotion engine based on the analyzed face data.

[0848] Input: detailed face data

[0849] How it works: The emotion engine on the server analyzes facial expression data, detects micro-expressions from the user's facial expressions, and determines their emotional state (e.g., joy, sadness, surprise, etc.) based on those expressions.

[0850] Output: Emotional state data

[0851] Step 5:

[0852] The server generates cosmetic surgery options based on the analysis and the emotional state data and presents customized options to the user.

[0853] Input: facial details, emotional state data

[0854] How it works: A generative AI model on the server uses the subject's data to determine available cosmetic surgery options and lists suitable suggestions for the user.

[0855] Output: Cosmetic surgery options list

[0856] Step 6:

[0857] The terminal displays the analysis results, emotion results, and list of cosmetic surgery options sent from the server to the user.

[0858] Enter: Cosmetic Surgery Options List

[0859] How it works: A smartphone or tablet application displays a list and the user interacts with the UI to make a selection.

[0860] Output: User selection data

[0861] Step 7:

[0862] The server generates a list of affiliated medical institutions and prices based on the user's selection data and transmits it to the terminal.

[0863] Input: User selection data, affiliated medical institution data

[0864] How it works: The server generates appropriate candidates from the information of affiliated medical institutions based on the selected data and creates a list with price information.

[0865] Output: List of providers and pricing information

[0866] Step 8:

[0867] The user checks the presented medical institutions and price information, and finally selects the desired medical institution and treatment date and time.

[0868] Input: List of providers and pricing information

[0869] How it works: The user selects the desired option from the list displayed on their smartphone or tablet and sets the date and time of the treatment.

[0870] Output: Reservation data

[0871] Step 9:

[0872] The server completes the reservation procedure with the medical institution based on the reservation data, and displays a confirmation message on the terminal that the reservation has been completed.

[0873] Input: Reservation data

[0874] Operation: The server connects to the medical institution's reservation system, completes the reservation procedure, generates a confirmation message, and sends it to the terminal.

[0875] Output: Reservation confirmation message

[0876] Step 10:

[0877] After the treatment, the server provides the user with aftercare information, which is displayed on the terminal. The user then performs the aftercare and submits evaluation data.

[0878] Input: None (after treatment is completed)

[0879] Operation: The server sends a prepared aftercare guide to the terminal, which displays it to the user. The user performs care according to the aftercare guide and then enters evaluation data into the terminal. The evaluation data is then sent to the server.

[0880] Output: Aftercare information, user evaluation data

[0881] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0882] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0883] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0884] [Third embodiment]

[0885] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0886] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0887] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0888] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0889] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0890] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0891] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0892] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0893] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0894] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0895] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0896] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0897] The present invention relates to a system that simplifies the process of selecting and booking cosmetic surgery procedures. The system allows users to obtain detailed data about their face through 3D scanning, and then suggests appropriate cosmetic surgery options based on that data, allowing them to make the booking.

[0898] System Overview

[0899] The system mainly consists of a terminal used by the user, a server that analyzes and stores data, and a clinic that provides suggested cosmetic surgery options.

[0900] Program processing

[0901] Initial Data Entry

[0902] Using the device, the user enters their initial basic information (name, age, gender, contact details, etc.), which is then sent to the server and stored.

[0903] Performing a 3D scan

[0904] Users use the camera on their smartphone or tablet to perform a 3D facial scan. The device provides lead instructions to guide the user through the precise scan and captures the 3D data in real time. Once the scan is complete, the data is compressed and sent to a server.

[0905] Data analysis and options presentation

[0906] The server uses an algorithm to analyze the received 3D scan data, performing a detailed analysis of the facial shape, bone structure, skin condition, etc. Based on the analysis results, it generates the optimal cosmetic surgery options for the user and sends them to the device.

[0907] Consulting and plan selection

[0908] The device displays the analysis results and cosmetic surgery options sent from the server to the user. The user can select the plan they are interested in from the options presented and check detailed information and treatment examples. The selection data is sent to the server.

[0909] Clinic and price information provided

[0910] The server generates a list of affiliated clinics and pricing information for treatments based on the cosmetic surgery plan selected by the user, and sends this information to the terminal and presents it to the user.

[0911] Final selection and booking

[0912] The user checks the clinic and price information provided, and finally selects the desired clinic and treatment date and time. The terminal sends the reservation information to the server, and the server completes the reservation procedure with the clinic based on that data. A confirmation message confirming the reservation is complete is displayed on the terminal.

[0913] Aftercare and evaluation

[0914] After the treatment, the server provides the user with aftercare information, allowing the user to check post-treatment care methods. After checking the aftercare, the user also enters evaluation data, which is sent to the server for analysis. The server uses the collected evaluation data to improve its services.

[0915] Specific examples

[0916] For example, if a user is using the system for the first time and considering cosmetic surgery, they can register through a smartphone app and take a 3D scan of their face. The scan data is then analyzed by the server, which suggests multiple options, such as hyaluronic acid injections and facelifts. The user selects hyaluronic acid injections, checks a list of available clinics and pricing information, and then confirms an appointment at a convenient date and time. After the procedure, they receive appropriate care based on the aftercare information provided, and then enters a rating to provide feedback to the system.

[0917] In this way, the system helps users easily obtain information about cosmetic surgery and make the best choice with confidence.

[0918] The processing flow will be explained below.

[0919] Step 1:

[0920] The user launches the application on the device and proceeds to the new registration screen. The user enters basic information such as name, age, gender, and email address. The device then checks the input for any input errors. Once the check is complete, the device sends this data to the server.

[0921] Step 2:

[0922] The device displays a screen prompting the user to prepare for a 3D facial scan. The user prepares their face for a 3D facial scan and follows the device's instructions to rotate their face 360 ​​degrees to perform the 3D scan. The device captures, corrects, and compresses the scanned data in real time. Once the scan is completed accurately, the device sends the data to the server.

[0923] Step 3:

[0924] The server receives the 3D scan data sent from the device, checks the data for consistency and quality, stores the data in a database, and runs an analysis algorithm that analyzes facial shape, bone structure, skin condition, and other factors to generate optimal cosmetic surgery options.

[0925] Step 4:

[0926] Once the analysis is complete, the server creates a list of cosmetic surgery options and sends it to the device. The device displays the analysis results and the list of cosmetic surgery options received from the server to the user. The user can then review the details of the options and select the plan that best suits them.

[0927] Step 5:

[0928] When a user selects a plan from the cosmetic surgery options, the device sends the selection data to the server, which generates a list of affiliated clinics and prices based on the selected options.

[0929] Step 6:

[0930] The server sends the generated list of clinics and prices to the terminal. The terminal then presents this information to the user, who compares the list of clinics and prices. The user then selects the most suitable clinic and treatment plan and confirms the desired appointment date and time.

[0931] Step 7:

[0932] Once the selection is complete, the terminal sends the reservation information to the server. The server then sends the reservation information to the clinic and returns a confirmation of whether the reservation has been accepted to the terminal. The terminal then displays a notification to the user that the reservation has been completed.

[0933] Step 8:

[0934] After the treatment is completed, the server provides the user with aftercare information, and the terminal displays the provided aftercare guide to the user, who then provides appropriate care based on it.

[0935] Step 9:

[0936] After the user has completed the appropriate treatment, the device displays a questionnaire to evaluate the treatment. The user answers the questionnaire, and the device sends the data to the server. The server analyzes the evaluation data and uses it to improve the service in the future.

[0937] Example 1

[0938] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0939] The traditional cosmetic surgery selection and booking process required users to visit a clinic in person for consultations and procedures, which was time-consuming and tedious. Additionally, users lacked the information they needed to select the best cosmetic surgery option for themselves, making it difficult to make the right choice.

[0940] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0941] In this invention, the server includes means for inputting basic user information, means for acquiring 3D scan data of the user's face, means for transmitting the acquired 3D scan data to the server, means for the server to analyze the 3D scan data and generate cosmetic surgery options, means for the server to transmit data to a terminal to display the cosmetic surgery options to the user, means for the user to select from the options and transmit the selected data to the server, means for the server to generate clinic and price information based on the selected options and transmit this information to the terminal, means for booking an appointment based on the clinic and treatment date and time finally selected by the user, means for the server to provide aftercare information and collect user evaluation data after the treatment, means for capturing 3D scan data of the user's face in real time, and means for transmitting the user evaluation data to the server, which then analyzes the evaluation data and uses it to improve services. This allows users to quickly and easily select the cosmetic surgery options that are best suited to them online and to consistently complete the entire process from booking to aftercare.

[0942] "User" refers to a person who uses the system to select and book cosmetic surgery procedures.

[0943] "Basic information" refers to data necessary to identify an individual, such as the user's name, age, gender, and contact information.

[0944] "3D facial scan data" refers to digital data that represents detailed information about a user's face, such as their facial shape, bone structure, and skin condition, in three dimensions.

[0945] "Terminal" refers to an electronic device used by a user, such as a smartphone, tablet, or computer.

[0946] "Server" refers to the computer system used to analyze 3D scan data, generate cosmetic surgery options, store data, process reservations, etc.

[0947] "Cosmetic surgery options" refers to the specific cosmetic surgery procedures offered to users (e.g., hyaluronic acid injections, facelifts, etc.).

[0948] "Acquisition means" refers to the technological process or equipment used to collect a 3D scan of the user's face.

[0949] "Means for analysis" refers to the algorithms and software used to analyze the acquired 3D scan data and recommend the most appropriate cosmetic surgery options to the user.

[0950] "Selection Data" refers to information about the specific procedures selected by a user from among the cosmetic surgery options presented to them.

[0951] "Clinic" refers to a medical institution that provides cosmetic surgery procedures.

[0952] "Price Information" refers to information regarding the cost of the procedure corresponding to the selected cosmetic surgery option.

[0953] "Reservation procedure" refers to the series of processes for completing a reservation for the desired date and time for the cosmetic surgery procedure selected by the user.

[0954] "Aftercare information" refers to instructions and advice provided to users to help them take appropriate care after treatment.

[0955] "Evaluation data" refers to feedback information in which a user evaluates the service or treatment content after the treatment.

[0956] "Real-time capture means" refers to the technological process or equipment used to instantly acquire and process a 3D scan of a user's face in real time.

[0957] MODE FOR CARRYING OUT THE INVENTION

[0958] The present invention relates to a system that simplifies the process of selecting and booking cosmetic surgery treatments by allowing users to obtain detailed data of their own face through 3D scanning, suggesting appropriate cosmetic surgery options based on that data, and even allowing them to make reservations. The system mainly consists of a device used by the user, a server that analyzes and stores the data, and a medical institution that provides the suggested cosmetic surgery options.

[0959] Initial Data Entry

[0960] The user uses the device to input basic information (such as name, age, gender, and contact details), which is then sent to the server, where it is stored.

[0961] Performing a 3D scan

[0962] Users use the camera on their smartphone or tablet to perform a 3D scan of their face. The device provides lead instructions, directing the user to accurately scan their face. For example, instructions such as "Please slowly turn your face left and right" are given in real time. Once the scan is complete, the device compresses the 3D data and sends it to the server.

[0963] Data analysis and options presentation

[0964] The server uses algorithms (such as OpenCV and TensorFlow) to analyze the received 3D scan data and perform a detailed analysis of the facial shape, bone structure, and skin condition. Based on the analysis results, the server generates the optimal cosmetic surgery options for the user and sends them to the device.

[0965] Consulting and plan selection

[0966] The device displays the analysis results and cosmetic surgery options sent from the server to the user. The user can select the plan they are interested in from the options presented and check detailed information and treatment examples. For example, options such as "hyaluronic acid injection" and "facelift" are presented.

[0967] Clinic and price information provided

[0968] Once the user selects a plan, the device sends the selection data to the server, which generates a list of affiliated clinics and their treatment prices based on the user's selection. This information is sent to the device and presented to the user.

[0969] Final selection and booking

[0970] The user checks the list of clinics and treatment price information provided, and finally selects the desired clinic and treatment date and time. The reservation information from the terminal is sent to the server, which completes the reservation procedure with the affiliated medical institution. A message indicating reservation completion is displayed on the terminal. For example, a message such as "Reservation completed. Please come to the clinic at 12:00 on XX month XX day" is displayed.

[0971] Aftercare and evaluation

[0972] After the treatment, the server provides the user with aftercare information. For example, it may provide care instructions such as "Please keep the area cool and rest for 24 hours after the treatment." The user can then confirm this information and provide appropriate care at home. The user also inputs their post-treatment evaluation via their device, and this evaluation data is sent to the server. The server analyzes the evaluation data and uses it to improve the service.

[0973] Examples of concrete examples and prompts

[0974] For example, when a user uses the system for the first time to consider cosmetic surgery, they register through a smartphone app and take a 3D scan of their face. The scan data is then analyzed by the server, and multiple options, such as hyaluronic acid injections and facelifts, are presented. The user selects hyaluronic acid injections, checks a list of available clinics and pricing information, and then confirms an appointment at a convenient date and time. After the procedure, they provide appropriate care based on the aftercare information provided, and enter a rating to provide feedback to the system.

[0975] Example prompt sentence:

[0976] "Users use a smartphone app to initially register for cosmetic surgery and then take a 3D scan of their face. Based on the scan data, the app recommends the most appropriate cosmetic surgery options. For example, hyaluronic acid injections, facelift, etc."

[0977] As described above, this system allows users to quickly and easily select the cosmetic surgery option that best suits them online, and to complete the entire process from booking to aftercare.

[0978] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0979] Step 1:

[0980] The user enters basic information.

[0981] Users use devices such as smartphones and tablets to enter their basic information (name, age, gender, contact details, etc.) into a dedicated application. The entered basic information is temporarily saved by the device.

[0982] Step 2:

[0983] The terminal sends the input data to the server.

[0984] The terminal sends the basic information entered by the user to the server using the HTTPS protocol, which receives this data, stores it in a database, and generates a unique ID for the user, which allows the user to be identified in subsequent processes.

[0985] Step 3:

[0986] The user performs a 3D scan of their face.

[0987] The user initiates a 3D scan of their face using the device's camera. The device provides lead instructions, such as slowly rotating the user's face left and right, in real time. The device captures and temporarily stores the 3D data of the face through the camera.

[0988] Step 4:

[0989] The device sends the scanned data to the server.

[0990] Once the scan is complete, the device compresses the captured 3D data and sends it over HTTPS to a server, which receives it and stores it for analysis.

[0991] Step 5:

[0992] The server analyzes the 3D scan data.

[0993] The server then analyzes the received 3D scan data using algorithms such as OpenCV and TensorFlow to extract detailed data such as facial shape, bone structure, and skin condition. The analysis results are then temporarily stored.

[0994] Step 6:

[0995] A server generates cosmetic surgery options.

[0996] Based on the analysis results, the server generates the optimal cosmetic surgery options for the user (e.g., hyaluronic acid injection, facelift, etc.). The generated options are temporarily stored.

[0997] Step 7:

[0998] The server sends the option data to the terminal.

[0999] The server sends the generated cosmetic surgery options to the terminal, which receives this data and displays it to the user, who then selects the plan they are interested in from the presented options.

[1000] Step 8:

[1001] The user selects a plan.

[1002] The user uses the device to select the plan they are interested in from the presented cosmetic surgery options, and check detailed information and treatment examples. When the user selects a plan, selection data is generated.

[1003] Step 9:

[1004] The terminal transmits the selection data to the server.

[1005] The device sends the user's selected plan information to the server using the HTTPS protocol, which receives this data and generates clinic and price information based on the selected cosmetic surgery plan.

[1006] Step 10:

[1007] The server generates a list of clinics and pricing information.

[1008] The server generates a list of affiliated clinics and treatment price information and sends it to the terminal, which receives the information and displays it to the user.

[1009] Step 11:

[1010] The user selects the clinic and treatment date and time.

[1011] The user checks the list of clinics and price information displayed on the terminal, and finally selects the desired clinic and treatment date and time. Selection data is generated.

[1012] Step 12:

[1013] The terminal transmits the reservation information to the server.

[1014] The device sends the selected clinic and treatment date and time information to the server using the HTTPS protocol. The server receives this data and completes the reservation procedure.

[1015] Step 13:

[1016] The server completes the reservation process.

[1017] The server sends a reservation request to the affiliated clinic and completes the reservation procedure. A confirmation message is generated and sent to the terminal.

[1018] Step 14:

[1019] The device will display a confirmation message that the reservation is complete.

[1020] The terminal displays the reservation completion confirmation message received from the server to the user. For example, a message such as "Reservation completed. Please come to the hospital at 12:00 on XX month XX day" is displayed.

[1021] Step 15:

[1022] The server provides aftercare information.

[1023] After the treatment, the server provides the user with detailed aftercare information. For example, instructions such as "Please keep the area iced and rest for 24 hours after the treatment" are sent. The device receives this information and displays it to the user.

[1024] Step 16:

[1025] The user checks the aftercare information and provides care.

[1026] The user checks the provided aftercare information and provides appropriate care at home.

[1027] Step 17:

[1028] The user enters the evaluation data.

[1029] After the treatment, the user inputs their evaluation through the terminal, and evaluation data is generated.

[1030] Step 18:

[1031] The terminal transmits the evaluation data to the server.

[1032] The device sends the user-entered rating data to the server using the HTTPS protocol, which receives and stores the data for use in improving the service.

[1033] The above are the specific processing steps of this system.

[1034] (Application example 1)

[1035] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1036] For users considering cosmetic surgery, selecting the most suitable cosmetic surgery option and booking the appointment are time-consuming and cumbersome tasks. It is also important to provide information on aftercare after the procedure and efficiently collect user feedback to use in improving services. However, traditional methods for these processes are fragmented, limiting the ability to improve user experience and optimize services.

[1037] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1038] In this invention, the server includes a means for improving services using a generative AI model based on user evaluation data, a means for capturing 3D facial scan data in real time, and a means for transmitting the user's post-treatment evaluation data to the server and using the generative AI model to improve services. This allows users to quickly and accurately select the optimal cosmetic surgery option and easily complete the reservation process. Furthermore, the provision of aftercare information and the collection of evaluation data after treatment also enable continuous improvement of services.

[1039] "Basic information" refers to data necessary to identify an individual, such as the user's name, age, gender, and contact information.

[1040] "3D scan data" is digital data that captures the three-dimensional shape of a user's face.

[1041] "Server" means a computer system for analyzing 3D scan data, generating cosmetic surgery options, and storing and providing relevant information to users.

[1042] "Analysis" is the process of examining the facial shape, bone structure, skin condition, etc. in detail based on the acquired 3D scan data.

[1043] "Cosmetic surgery options" are treatment options suggested by analyzing 3D scan data of the user's face.

[1044] A "terminal" is a device used by a user, such as a smartphone or tablet.

[1045] "Selection data" refers to information about the procedure selected by the user from among the cosmetic surgery options.

[1046] "Medical facility" means a hospital or clinic that provides cosmetic surgery.

[1047] The "reservation procedure" is the process of confirming a treatment date and time with a medical facility based on the cosmetic surgery option selected by the user.

[1048] "Aftercare information" refers to information about care methods and precautions to take after treatment.

[1049] "Evaluation data" is feedback information provided by the user after the treatment.

[1050] A "generative AI model" is an artificial intelligence model that analyzes user evaluation data and improves and optimizes services.

[1051] The system embodying the present invention simplifies the process of selecting and booking cosmetic surgery procedures. Specifically, the user uses a device such as a smartphone or tablet to acquire 3D facial scan data, which is then sent to a server where it is analyzed, the system recommends optimal cosmetic surgery options, and assists with the booking process.

[1052] Hardware and software used

[1053] Hardware: smartphones, tablets, servers

[1054] Software: Flask (server-side framework), face_recognition (face analysis library), Flutter (client app framework), generative AI model

[1055] System action

[1056] The server receives the user's basic information and 3D scan data, and performs a detailed analysis of the face's shape, bone structure, and skin condition. The analysis uses the face_recognition library to obtain facial landmarks and shape data. Based on this analysis data, cosmetic surgery options are generated and sent to the user's device.

[1057] The terminal displays cosmetic surgery options to the user and transmits the option selected by the user to the server, which generates affiliated medical facilities and price information based on the selected option and transmits it to the terminal, allowing the user to complete the reservation procedure.

[1058] After the procedure, the server provides aftercare information and collects user evaluation data. The collected evaluation data is analyzed using a generative AI model and used to improve the service, thereby continuously providing users with the most suitable cosmetic surgery options.

[1059] Specific examples

[1060] Let's take the example of a user named Hanako considering cosmetic surgery. Hanako first uses a smartphone app to enter basic information and take a 3D scan of her face. This 3D scan data is sent to a server for analysis. The server then suggests cosmetic surgery options such as hyaluronic acid injections and facelifts. Hanako selects hyaluronic acid injections, checks medical facilities and pricing information, and then confirms an appointment for her desired date and time. After the procedure, she follows the aftercare information provided, and then enters her evaluation and provides feedback to the system. This feedback data is analyzed by a generative AI model and used to improve the system's services.

[1061] Prompt Sentence Examples

[1062] "I'm considering cosmetic surgery. I've entered the following basic information: Name: Hanako, Age: 30, Gender: Female, Contact Information: [email address]. I've then had a 3D scan of my face. Please analyze my facial shape and skin condition and recommend the best cosmetic surgery options for me. How do I choose the options I want and complete my appointment?"

[1063] This embodiment of the invention allows users to easily find the cosmetic surgery options that are best for them and receive the treatment with peace of mind.

[1064] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1065] Step 1:

[1066] The terminal inputs the user's basic information.

[1067] (Input): Basic information such as the user's name, age, gender, and contact details.

[1068] (Specific operation): When a user enters data into the input form displayed on the terminal and presses the submit button, this information is sent to the server in JSON format.

[1069] (Output): Basic information sent to the server.

[1070] Step 2:

[1071] The device acquires a 3D scan of the user's face.

[1072] (Input): Face scan using your smartphone or tablet camera.

[1073] (Specific operation): The device uses the camera to initiate a 3D scan of the face, capturing data in real time, which is then compressed and sent to the server.

[1074] (Output): The 3D scan data sent to the server.

[1075] Step 3:

[1076] The server analyzes the 3D scan data and generates cosmetic surgery options.

[1077] (Input): 3D scan data stored on the server.

[1078] (Specific operation): The server uses the face_recognition library to analyze the face shape, bone structure, skin condition, etc.

[1079] , to generate optimal cosmetic surgery options.

[1080] (Output): Generated cosmetic surgery options.

[1081] Step 4:

[1082] The server sends cosmetic surgery options to the device.

[1083] (Input): Generated cosmetic surgery options.

[1084] (Specific operation): The server sends the generated cosmetic surgery options in JSON format to the terminal.

[1085] (Output): Cosmetic surgery options displayed on the device.

[1086] Step 5:

[1087] The user selects from the options and sends the selection to the server.

[1088] (Input): Cosmetic surgery options displayed on the device.

[1089] (Specific operation): The user selects the desired option on the terminal and presses the select button. This selection data is sent to the server.

[1090] (Output): The selection data sent to the server.

[1091] Step 6:

[1092] The server generates medical facility and price information based on the selected options and transmits it to the terminal.

[1093] (Input): Selection data stored on the server.

[1094] (Specific operation): The server generates affiliated medical facilities and their price information based on the selected data and sends it to the terminal in JSON format.

[1095] (Output): Medical facility and pricing information displayed on the terminal.

[1096] Step 7:

[1097] The user then makes a reservation based on the medical facility and price information that he or she has finally selected.

[1098] (Input): Medical facility and price information displayed on the terminal.

[1099] (Specific operation): The user selects the desired medical facility and treatment date and time, and presses the reservation button. The reservation information is sent to the server, and the reservation procedure is completed on the server side.

[1100] (Output): A confirmation message that the reservation is complete.

[1101] Step 8:

[1102] After the treatment, the server provides aftercare information and collects user evaluation data.

[1103] (Input): User after reservation is completed.

[1104] (Specific operation): After the treatment, the server sends aftercare information to the terminal and receives evaluation data entered by the user.

[1105] (Output): Rating data stored on the server.

[1106] Step 9:

[1107] The service is improved using a generative AI model based on the evaluation data acquired by the server.

[1108] (Input): Rating data stored on the server.

[1109] (Specific operation): The server inputs the evaluation data into the generative AI model and improves the service based on the analysis results.

[1110] (Output): Service improvement.

[1111] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1112] The present invention relates to a system that simplifies the cosmetic surgery selection and booking process by obtaining detailed data of the user's face through 3D scanning, suggesting appropriate cosmetic surgery options based on that data, and using an emotion engine to recognize the user's emotions and help provide more appropriate choices.

[1113] System Overview

[1114] The system consists of a terminal operated by the user, a server that analyzes and stores data, a clinic that provides suggested cosmetic surgery options, and an emotion engine that recognizes the user's emotions.

[1115] Program processing

[1116] Initial Data Entry

[1117] Using the device, the user enters their initial basic information (name, age, gender, contact details, etc.), which is then sent to the server and stored.

[1118] Performing a 3D scan

[1119] Users use the camera on their smartphone or tablet to perform a 3D facial scan. The device provides lead instructions to guide the device in accurately scanning the face, capturing the 3D data in real time. Once the scan is complete, the data is compressed and sent to a server.

[1120] Data analysis and emotion recognition

[1121] The server analyzes the received 3D scan data and performs a detailed analysis of the facial shape, bone structure, skin condition, etc. It then uses an emotion engine to analyze the user's emotions from the facial expression data. The emotion engine detects changes in micro-expressions and identifies the user's current feelings (e.g., joy, sadness, surprise, etc.).

[1122] Options and customization

[1123] The server generates cosmetic surgery options based on the analysis results and the emotion engine results, and customizes the options that best suit the user. This information is sent to the terminal and presented to the user.

[1124] Consulting and plan selection

[1125] The device displays the analysis results, emotion results, and list of cosmetic surgery options sent from the server to the user. The user checks the details of the options and selects the plan that best suits them. The selected data is then sent to the server.

[1126] Clinic and price information provided

[1127] The server generates a list of affiliated clinics and prices based on the cosmetic surgery plan selected by the user, and this information is sent to the terminal and presented to the user.

[1128] Final selection and booking

[1129] The user checks the clinic and price information provided, and finally selects the desired clinic and treatment date and time. The terminal sends the reservation information to the server, and the server completes the reservation procedure with the clinic based on that data. A confirmation message confirming the reservation is complete is displayed on the terminal.

[1130] Aftercare and evaluation

[1131] After the treatment is completed, the server provides the user with aftercare information. The terminal displays the provided aftercare guide to the user, who then provides appropriate care. After confirming the aftercare, the user also enters evaluation data, which is sent to the server for analysis. The server uses the collected evaluation data to improve its services.

[1132] Specific examples

[1133] For example, if a user is considering cosmetic surgery, they can register through a smartphone app and have their face scanned in 3D. The scan data is then analyzed by the server, and the emotion engine detects "anxiety" from the user's facial expression. Based on this, the server suggests cosmetic surgery options that provide a sense of security and reduce anxiety. After the user selects hyaluronic acid injection and checks the list of available clinics and pricing information, they can schedule an appointment for a convenient date and time. After the procedure, they can provide appropriate care based on the aftercare information provided, and enter their evaluation to provide feedback to the system.

[1134] In this way, the system helps users easily obtain information about cosmetic surgery and make optimal choices that take into account their emotional state.

[1135] The processing flow will be explained below.

[1136] Step 1:

[1137] The user launches the application on the device and proceeds to the new registration screen. The user enters basic information such as name, age, gender, and email address. The device then checks the input for any input errors. Once the check is complete, the device sends this data to the server.

[1138] Step 2:

[1139] The device displays a screen prompting the user to prepare for a 3D facial scan. The user prepares their face for a 3D facial scan and follows the device's instructions to rotate their face 360 ​​degrees to perform the 3D scan. The device captures, corrects, and compresses the scanned data in real time. Once the scan is completed accurately, the device sends the data to the server.

[1140] Step 3:

[1141] The server receives the 3D scan data sent from the device, checks the data integrity and quality, stores the data in a database, and runs an analysis algorithm that analyzes facial shape, bone structure, skin condition, etc.

[1142] Step 4:

[1143] The server activates an emotion engine to recognize the user's emotions based on the 3D facial scan data. The emotion engine analyzes the user's facial expression data and identifies the user's emotional state. For example, if the user is smiling, it recognizes the emotion as "joy," and if they are frowning, it recognizes the emotion as "anxiety."

[1144] Step 5:

[1145] The server generates cosmetic surgery options based on the facial analysis and emotion engine results. If the analysis result is "a facelift is appropriate" and the emotion is "anxiety," the server customizes the options with detailed explanations about facelifts and additional information to alleviate the user's anxiety.

[1146] Step 6:

[1147] The server sends the analyzed data and cosmetic surgery options to the device. The device displays a detailed list of options to the user. The user checks the details of each option and selects the plan that best suits them. The selected data is then sent from the device to the server.

[1148] Step 7:

[1149] The server generates a list of affiliated clinics and pricing information for the procedures based on the selected cosmetic surgery options. This information is sent to the terminal and presented to the user, who can then compare the presented list and prices.

[1150] Step 8:

[1151] The user finally selects the most suitable clinic and treatment plan, and confirms the desired reservation date and time. The terminal sends this reservation information to the server. The server sends the reservation information to the clinic, and upon receiving confirmation from the clinic, returns it to the terminal. The terminal displays a notification to the user that the reservation has been completed.

[1152] Step 9:

[1153] After the treatment is completed, the server sends an aftercare guide to the terminal to provide the user with aftercare information. The terminal displays this guide to the user, and the user follows the instructions to provide appropriate care.

[1154] Step 10:

[1155] After the user completes the aftercare, the device displays a questionnaire to evaluate the treatment. The user answers the questionnaire, and the device sends the data to the server. The server receives the evaluation data and analyzes it to improve the service.

[1156] Specific examples

[1157] For example, if a user is interested in cosmetic surgery, they can register through a smartphone app and have their face scanned in 3D. The scan data is analyzed by the server, and an emotion engine detects "anxiety" from the user's facial expression. Based on this, the server suggests options such as hyaluronic acid injections to provide a sense of security. The user selects an option, confirms clinic and price information, and then confirms the appointment. After the procedure, the user receives appropriate care based on the aftercare information provided, and enters an evaluation that is fed back to the system. In this way, the system helps users easily obtain information about cosmetic surgery and make the best choice, taking their emotional state into consideration.

[1158] Example 2

[1159] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1160] The process of selecting and booking cosmetic surgery is complex and time-consuming for users, making it difficult to obtain appropriate information. Furthermore, the user's emotional state is not taken into consideration, which may result in an inadequate selection. This risks reducing user satisfaction. Furthermore, the provision of aftercare information and collection of evaluation data after the procedure are not effectively implemented.

[1161] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting basic information about the user, means for acquiring 3D scan data of the user's face, means for transmitting the acquired 3D scan data to the server, means for the server to analyze the 3D scan data and generate cosmetic surgery options, means for the server to transmit the cosmetic surgery options to the terminal, means for the user to select from the options and transmit the selected data to the server, means for the server to generate facility and price information based on the selected options and transmit this information to the terminal, means for completing the reservation procedure based on the facility and price information finally selected by the user, means for the server to provide aftercare information and collect user evaluation data after the procedure, and means for providing cosmetic surgery options based on the user's emotions using an emotion engine that recognizes the user's emotions. This allows the user to select the optimal cosmetic surgery option taking into account their emotional state, making it possible to efficiently complete the entire process from reservation to aftercare.

[1162] "Basic user information" refers to information that identifies a user and constitutes a basic profile, such as name, age, gender, and contact information.

[1163] "Three-dimensional scan data" refers to data that captures the shape and expression of a user's face in three dimensions, and includes information such as the overall shape of the face, bone structure, and skin condition.

[1164] A "server" is a device that is composed of a computer and a storage device for analyzing and storing received data, and generating and providing necessary information.

[1165] An "emotion engine" is an algorithm and software for recognizing and analyzing emotions from a user's facial expressions.

[1166] "Cosmetic surgery options" are options for cosmetic surgery or procedures suggested to users based on their cosmetic needs, including hyaluronic acid injections, Botox injections, facelifts, etc.

[1167] A "terminal" is a device operated by a user, such as a smartphone, tablet, or PC, which is an electronic device with input and display functions.

[1168] A "facility" is a doctor's office or clinic that offers the proposed cosmetic surgery options.

[1169] "Aftercare information" refers to guidelines and support information provided to users regarding post-treatment care methods and precautions.

[1170] "Evaluation data" refers to feedback information provided by the user after a treatment, and includes evaluations of the appropriateness of aftercare and the results of the treatment.

[1171] The present invention is a system that simplifies the cosmetic surgery selection and booking process. The system consists of a user-operated terminal, a server that analyzes and stores data, a facility that provides suggested cosmetic surgery options, and an emotion engine that recognizes the user's emotions.

[1172] Initial Data Entry

[1173] Using a device, the user enters their initial basic information (such as name, age, gender, and contact details). This data is sent from the device to a server and stored. Specifically, the user accesses an application on their smartphone or tablet, enters the required information into a form, and submits it.

[1174] Performing a 3D scan

[1175] Users use the camera on their smartphone or tablet to perform a 3D scan of their face. The device provides lead instructions to guide the user through the precise scan and captures the 3D data in real time. Once the scan is complete, the data is compressed and sent to a server. For example, this can be done using Photogrammetry software.

[1176] Data analysis and emotion recognition

[1177] The server performs a detailed analysis of the received 3D scan data. This analysis includes analyzing the facial shape, bone structure, and skin condition. It then uses an emotion engine (e.g., Emotion AI) to analyze the user's emotions from their facial expression data. The emotion engine detects changes in micro-expressions and identifies the user's current emotion (e.g., joy, sadness, surprise, etc.).

[1178] Options and customization

[1179] The server generates cosmetic surgery options based on the analysis results and the emotion engine results, and customizes the options that best suit the user. This information is sent to the device and presented to the user. The cosmetic surgery options include hyaluronic acid injections, Botox injections, and facelifts.

[1180] Consulting and plan selection

[1181] The device displays the analysis results, emotion results, and list of cosmetic surgery options sent from the server to the user. The user checks the details of the options and selects the plan that best suits them. The selected data is then sent to the server.

[1182] Clinic and price information provided

[1183] The server generates a list of affiliated facilities and prices based on the user's cosmetic surgery plan selection. This information is sent to the device and presented to the user. For example, the server may automatically search a database of relevant cosmetic surgery facilities and display results based on the user's location and preferences.

[1184] Final selection and booking

[1185] The user checks the facilities and price information provided, and finally selects the desired facility and treatment date and time. The terminal sends the reservation information to the server, and the server completes the reservation procedure with the facility based on that data. A confirmation message confirming the reservation is complete is displayed on the terminal.

[1186] Aftercare and evaluation

[1187] After the treatment is completed, the server provides the user with aftercare information. The terminal displays the provided aftercare guide to the user, who then provides appropriate care based on it. After confirming the aftercare, the user also enters evaluation data, which is sent to the server. The server uses the collected evaluation data to improve its services.

[1188] Specific examples

[1189] For example, if a user is considering cosmetic surgery, they can register through a smartphone application and have their face scanned in 3D. The scan data is then analyzed by the server, and an emotion engine detects "anxiety" from the user's facial expression. Based on this, the server suggests cosmetic surgery options that provide superior peace of mind to alleviate anxiety. After the user selects hyaluronic acid injection and checks the list of corresponding facilities and pricing information, they can confirm an appointment at a convenient date and time. After the procedure, they can provide appropriate care based on the aftercare information provided, and enter their evaluation to provide feedback to the system.

[1190] Prompt Sentence Examples

[1191] "We will take into account your current emotional state and recommend the best cosmetic surgery options for you. We will perform a three-dimensional scan of your face and provide you with detailed data."

[1192] In this way, the system helps users easily obtain information about cosmetic surgery and make optimal choices that take into account their emotional state.

[1193] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1194] Step 1: Initial data entry

[1195] A user accesses an application on a smartphone or tablet and enters basic information (name, age, gender, contact details). Once this data is entered, the device sends the entered data to the server. The server stores the received basic information in a database and prepares it for the next step. Specific operations include the display of an input form, the user filling in the fields, and pressing the submit button. Input: Name, age, gender, contact details. Output: Basic information is saved in the database.

[1196] Step 2: Perform a 3D scan

[1197] The user uses the device's camera to perform a 3D scan of their face. The device displays lead instructions to guide the user to scan accurately. During the scan, 3D data is captured in real time. Once the scan is complete, the device compresses this data and sends it to the server. Once the server receives the data, it stores it and prepares it for the next analysis step. Input: 3D scan data. Output: Compressed scan data sent to the server.

[1198] Step 3: Data analysis and emotion recognition

[1199] The server analyzes the received 3D scan data. Specifically, it uses Photogrammetry software to perform a detailed analysis of facial shape, bone structure, skin condition, and other factors. It then uses Emotion AI to recognize emotions from the user's facial expression data. The emotion engine analyzes changes in micro-expressions and identifies emotions such as "happiness," "sadness," and "surprise." Input: 3D scan data. Output: Detailed facial shape data and emotion recognition results.

[1200] Step 4: Present options and customize

[1201] The server generates cosmetic surgery options based on the analysis results and the emotion engine results. Specifically, it lists treatment options (e.g., hyaluronic acid injection, Botox injection, facelift, etc.) tailored to the user's skin condition and bone structure. These options are sent to the device in a customizable format. Guides and explanations are also provided to help the user select the best option. Input: Detailed face shape data and emotion recognition results. Output: List of cosmetic surgery options and guide.

[1202] Step 5: Consultation and plan selection

[1203] The device displays the analysis results received from the server, cosmetic surgery options, and a recommended list of beauty facilities to the user. The user reviews the details of the options and selects the plan that suits them. Once the selection is complete, the device sends the information to the server. The server records the selection data and proceeds to present the next facility and price information. Input: Cosmetic surgery option selected by the user. Output: Selection data sent to the server.

[1204] Step 6: Present your facilities and pricing information

[1205] The server generates beauty salons and their pricing information based on the plan selected by the user. In particular, the server searches the relevant database to create a list of salons and pricing information based on the user's location and desired conditions. This information is sent to the terminal and presented to the user. Input: User's selection data and location information. Output: List of salons and pricing information.

[1206] Step 7: Final selection and booking

[1207] The user checks the provided facility and price information, and selects the desired beauty facility and treatment date and time. The device sends this information to the server. The server automatically completes the reservation procedure and generates reservation confirmation data with the clinic. A confirmation message indicating the reservation is complete is then displayed on the device. Input: User's facility and date and time selection information. Output: Completion of reservation procedure and confirmation message.

[1208] Step 8: Aftercare and evaluation

[1209] After the treatment is completed, the server provides the user with the necessary aftercare information. This information is sent to the terminal, and the user provides appropriate care based on that information. The user then inputs the results and evaluation of the aftercare, and this data is sent from the terminal to the server. The server analyzes the evaluation data and uses it to improve services in the future. Input: User evaluation data. Output: Analysis data for service improvement.

[1210] (Application example 2)

[1211] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1212] In the conventional cosmetic surgery selection and booking process, it was difficult for users to accurately understand their facial data and select the appropriate cosmetic surgery option. Furthermore, cosmetic surgery recommendations rarely took into account users' emotional state, which left users unable to alleviate their psychological anxiety. Furthermore, information about the booking procedure and aftercare was insufficient, resulting in poor overall service quality.

[1213] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1214] In this invention, the server includes means for analyzing 3D scan data of the user's face, analyzing the user's emotional state with an emotion engine, and generating cosmetic surgery options, means for the server to transmit the cosmetic surgery options to the terminal, and means for the user to select from the options and transmit the selected data to the server. This allows the user to select the optimal cosmetic surgery option based on their own facial data, taking into account their emotional state, and simplifies the reservation process while reducing psychological anxiety.

[1215] "Basic information" refers to the user's name, age, gender, contact information, etc.

[1216] "3D scan data" is data that measures the shape and features of a user's face in three dimensions and saves it as digital data.

[1217] A "server" is a computer system that analyzes, stores, and transmits and receives data over a network.

[1218] An "emotion engine" is a system that includes algorithms and software for analyzing emotions from a user's facial expression data and identifying the user's state of mind.

[1219] "Cosmetic surgery options" are suggested cosmetic procedures and treatment options based on the user's facial features and emotional state.

[1220] "Terminal" refers to a personal computer such as a smartphone or tablet used by a user.

[1221] A "clinic" is a medical institution or clinic that provides cosmetic surgery procedures.

[1222] "Price information" is information about the cost of cosmetic surgery procedures.

[1223] The "reservation procedure" refers to the operations and steps for booking a treatment at a clinic based on the cosmetic surgery options selected by the user.

[1224] "Aftercare information" is information that includes instructions and guidelines regarding care after a procedure.

[1225] "Evaluation data" refers to data regarding user satisfaction and feedback after treatment.

[1226] "Real-time capture" refers to instantly acquiring 3D scan data of the user's face and processing it on the spot.

[1227] This invention is a system that simplifies the cosmetic surgery selection and booking process by obtaining detailed data of the user's face through 3D scanning, suggesting appropriate cosmetic surgery options based on that data, and using an emotion engine to recognize the user's emotions and help provide more appropriate choices.

[1228] System Overview

[1229] The system consists of a device operated by the user, a server that analyzes and stores data, a medical institution that provides suggested cosmetic surgery options, and an emotion engine that recognizes the user's emotions.

[1230] Program processing

[1231] Initial Data Entry

[1232] The user uses the device to input basic information (such as name, age, gender, and contact details), which is then sent to the server and stored.

[1233] Performing a 3D scan

[1234] Users use the camera on their smartphone or tablet to perform a 3D facial scan. The device provides lead instructions to guide the device in accurately scanning the face, capturing the 3D data in real time. Once the scan is complete, the data is compressed and sent to a server.

[1235] Data analysis and emotion recognition

[1236] The server analyzes the received 3D scan data and performs a detailed analysis of the facial shape, bone structure, skin condition, etc. It then uses an emotion engine to analyze the user's emotions from the facial expression data. The emotion engine detects changes in micro-expressions and identifies the user's current feelings (e.g., joy, sadness, surprise, etc.).

[1237] Options and customization

[1238] The server generates cosmetic surgery options based on the analysis results and the emotion engine results, and customizes the options that best suit the user. This information is sent to the terminal and presented to the user.

[1239] Consulting and plan selection

[1240] The device displays the analysis results, emotion results, and list of cosmetic surgery options sent from the server to the user. The user checks the details of the options and selects the plan that best suits them. The selected data is then sent to the server.

[1241] Presenting medical institutions and pricing information

[1242] The server generates a list of affiliated medical institutions and prices based on the cosmetic surgery plan selected by the user, and this information is sent to the terminal and presented to the user.

[1243] Final selection and booking

[1244] The user checks the presented medical institution and price information, and finally selects the desired medical institution and treatment date and time. The terminal sends the reservation information to the server, and the server completes the reservation procedure with the medical institution based on that data. A confirmation message that the reservation has been completed is displayed on the terminal.

[1245] Aftercare and evaluation

[1246] After the treatment is completed, the server provides the user with aftercare information. The terminal displays the provided aftercare guide to the user, who then provides appropriate care. After confirming the aftercare, the user also enters evaluation data, which is sent to the server for analysis. The server uses the collected evaluation data to improve its services.

[1247] Specific examples

[1248] For example, if a user is considering cosmetic surgery, they can register through a smartphone app and have their face scanned in 3D. The scan data is then analyzed by the server, and an emotion engine detects "anxiety" from the user's facial expression. Based on this, the server suggests cosmetic surgery options that provide a sense of security and reduce anxiety. After selecting a treatment option and checking the list of corresponding medical institutions and price information, the user can confirm an appointment for a convenient date and time. After the treatment, they can provide appropriate care based on the aftercare information provided, and enter their evaluation to provide feedback to the system. An example of this prompt is as follows:

[1249] Example prompt sentence:

[1250] Name: Yamada Hanako

[1251] Age: 29

[1252] Gender: Female

[1253] Face data: face_scan_data_in_base64_or_other_format

[1254] In this way, the system helps users easily obtain information about cosmetic surgery and make optimal choices that take into account their emotional state.

[1255] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1256] Step 1:

[1257] The terminal accepts basic information (such as name, age, gender, and contact details) from the user.

[1258] Input: User's basic information (name, age, gender, contact details)

[1259] How it works: A user uses a dedicated application on a smartphone or tablet to fill out a form to enter basic information.

[1260] Output: Basic information is saved on the device and sent to the server.

[1261] Step 2:

[1262] The device prompts the user to take a 3D scan of their face and provides lead instructions to ensure the facial scan is accurate.

[1263] Input: User's face data, camera footage

[1264] How it works: Using your smartphone or tablet's camera, the device captures a 3D scan of your face in real time and prompts you to reposition it as needed.

[1265] Output: 3D scan data is stored on the device and sent to a server.

[1266] Step 3:

[1267] The server analyzes the received 3D scan data and performs a detailed analysis of facial shape, bone structure, skin condition, etc.

[1268] Input: 3D scan data

[1269] How it works: Analysis software on the server processes the 3D scan data and extracts facial features and parameters.

[1270] Output: Detailed facial data as a result of analysis (shape, bone structure, skin condition, etc.)

[1271] Step 4:

[1272] The server analyzes the user's emotional state using an emotion engine based on the analyzed face data.

[1273] Input: detailed face data

[1274] How it works: The emotion engine on the server analyzes facial expression data, detects micro-expressions from the user's facial expressions, and determines their emotional state (e.g., joy, sadness, surprise, etc.) based on those expressions.

[1275] Output: Emotional state data

[1276] Step 5:

[1277] The server generates cosmetic surgery options based on the analysis and the emotional state data and presents customized options to the user.

[1278] Input: facial details, emotional state data

[1279] How it works: A generative AI model on the server uses the subject's data to determine available cosmetic surgery options and lists suitable suggestions for the user.

[1280] Output: Cosmetic surgery options list

[1281] Step 6:

[1282] The terminal displays the analysis results, emotion results, and list of cosmetic surgery options sent from the server to the user.

[1283] Enter: Cosmetic Surgery Options List

[1284] How it works: A smartphone or tablet application displays a list and the user interacts with the UI to make a selection.

[1285] Output: User selection data

[1286] Step 7:

[1287] The server generates a list of affiliated medical institutions and prices based on the user's selection data and transmits it to the terminal.

[1288] Input: User selection data, affiliated medical institution data

[1289] How it works: The server generates appropriate candidates from the information of affiliated medical institutions based on the selected data and creates a list with price information.

[1290] Output: List of providers and pricing information

[1291] Step 8:

[1292] The user checks the presented medical institutions and price information, and finally selects the desired medical institution and treatment date and time.

[1293] Input: List of providers and pricing information

[1294] How it works: The user selects the desired option from the list displayed on their smartphone or tablet and sets the date and time of the treatment.

[1295] Output: Reservation data

[1296] Step 9:

[1297] The server completes the reservation procedure with the medical institution based on the reservation data, and displays a confirmation message on the terminal that the reservation has been completed.

[1298] Input: Reservation data

[1299] Operation: The server connects to the medical institution's reservation system, completes the reservation procedure, generates a confirmation message, and sends it to the terminal.

[1300] Output: Reservation confirmation message

[1301] Step 10:

[1302] After the treatment, the server provides the user with aftercare information, which is displayed on the terminal. The user then performs the aftercare and submits evaluation data.

[1303] Input: None (after treatment is completed)

[1304] Operation: The server sends a prepared aftercare guide to the terminal, which displays it to the user. The user performs care according to the aftercare guide and then enters evaluation data into the terminal. The evaluation data is then sent to the server.

[1305] Output: Aftercare information, user evaluation data

[1306] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1307] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1308] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1309] [Fourth embodiment]

[1310] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1311] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1312] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1313] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1314] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1315] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1316] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1317] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1318] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1319] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1320] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1321] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1322] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1323] The present invention relates to a system that simplifies the process of selecting and booking cosmetic surgery procedures. The system allows users to obtain detailed data about their face through 3D scanning, and then suggests appropriate cosmetic surgery options based on that data, allowing them to make the booking.

[1324] System Overview

[1325] The system mainly consists of a terminal used by the user, a server that analyzes and stores data, and a clinic that provides suggested cosmetic surgery options.

[1326] Program processing

[1327] Initial Data Entry

[1328] Using the device, the user enters their initial basic information (name, age, gender, contact details, etc.), which is then sent to the server and stored.

[1329] Performing a 3D scan

[1330] Users use the camera on their smartphone or tablet to perform a 3D facial scan. The device provides lead instructions to guide the user through the precise scan and captures the 3D data in real time. Once the scan is complete, the data is compressed and sent to a server.

[1331] Data analysis and options presentation

[1332] The server uses an algorithm to analyze the received 3D scan data, performing a detailed analysis of the facial shape, bone structure, skin condition, etc. Based on the analysis results, it generates the optimal cosmetic surgery options for the user and sends them to the device.

[1333] Consulting and plan selection

[1334] The device displays the analysis results and cosmetic surgery options sent from the server to the user. The user can select the plan they are interested in from the options presented and check detailed information and treatment examples. The selection data is sent to the server.

[1335] Clinic and price information provided

[1336] The server generates a list of affiliated clinics and pricing information for treatments based on the cosmetic surgery plan selected by the user, and sends this information to the terminal and presents it to the user.

[1337] Final selection and booking

[1338] The user checks the clinic and price information provided, and finally selects the desired clinic and treatment date and time. The terminal sends the reservation information to the server, and the server completes the reservation procedure with the clinic based on that data. A confirmation message confirming the reservation is complete is displayed on the terminal.

[1339] Aftercare and evaluation

[1340] After the treatment, the server provides the user with aftercare information, allowing the user to check post-treatment care methods. After checking the aftercare, the user also enters evaluation data, which is sent to the server for analysis. The server uses the collected evaluation data to improve its services.

[1341] Specific examples

[1342] For example, if a user is using the system for the first time and considering cosmetic surgery, they can register through a smartphone app and take a 3D scan of their face. The scan data is then analyzed by the server, which suggests multiple options, such as hyaluronic acid injections and facelifts. The user selects hyaluronic acid injections, checks a list of available clinics and pricing information, and then confirms an appointment at a convenient date and time. After the procedure, they receive appropriate care based on the aftercare information provided, and then enters a rating to provide feedback to the system.

[1343] In this way, the system helps users easily obtain information about cosmetic surgery and make the best choice with confidence.

[1344] The processing flow will be explained below.

[1345] Step 1:

[1346] The user launches the application on the device and proceeds to the new registration screen. The user enters basic information such as name, age, gender, and email address. The device then checks the input for any input errors. Once the check is complete, the device sends this data to the server.

[1347] Step 2:

[1348] The device displays a screen prompting the user to prepare for a 3D facial scan. The user prepares their face for a 3D facial scan and follows the device's instructions to rotate their face 360 ​​degrees to perform the 3D scan. The device captures, corrects, and compresses the scanned data in real time. Once the scan is completed accurately, the device sends the data to the server.

[1349] Step 3:

[1350] The server receives the 3D scan data sent from the device, checks the data for consistency and quality, stores the data in a database, and runs an analysis algorithm that analyzes facial shape, bone structure, skin condition, and other factors to generate optimal cosmetic surgery options.

[1351] Step 4:

[1352] Once the analysis is complete, the server creates a list of cosmetic surgery options and sends it to the device. The device displays the analysis results and the list of cosmetic surgery options received from the server to the user. The user can then review the details of the options and select the plan that best suits them.

[1353] Step 5:

[1354] When a user selects a plan from the cosmetic surgery options, the device sends the selection data to the server, which generates a list of affiliated clinics and prices based on the selected options.

[1355] Step 6:

[1356] The server sends the generated list of clinics and prices to the terminal. The terminal then presents this information to the user, who compares the list of clinics and prices. The user then selects the most suitable clinic and treatment plan and confirms the desired appointment date and time.

[1357] Step 7:

[1358] Once the selection is complete, the terminal sends the reservation information to the server. The server then sends the reservation information to the clinic and returns a confirmation of whether the reservation has been accepted to the terminal. The terminal then displays a notification to the user that the reservation has been completed.

[1359] Step 8:

[1360] After the treatment is completed, the server provides the user with aftercare information, and the terminal displays the provided aftercare guide to the user, who then provides appropriate care based on it.

[1361] Step 9:

[1362] After the user has completed the appropriate treatment, the device displays a questionnaire to evaluate the treatment. The user answers the questionnaire, and the device sends the data to the server. The server analyzes the evaluation data and uses it to improve the service in the future.

[1363] Example 1

[1364] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1365] The traditional cosmetic surgery selection and booking process required users to visit a clinic in person for consultations and procedures, which was time-consuming and tedious. Additionally, users lacked the information they needed to select the best cosmetic surgery option for themselves, making it difficult to make the right choice.

[1366] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1367] In this invention, the server includes means for inputting basic user information, means for acquiring 3D scan data of the user's face, means for transmitting the acquired 3D scan data to the server, means for the server to analyze the 3D scan data and generate cosmetic surgery options, means for the server to transmit data to a terminal to display the cosmetic surgery options to the user, means for the user to select from the options and transmit the selected data to the server, means for the server to generate clinic and price information based on the selected options and transmit this information to the terminal, means for booking an appointment based on the clinic and treatment date and time finally selected by the user, means for the server to provide aftercare information and collect user evaluation data after the treatment, means for capturing 3D scan data of the user's face in real time, and means for transmitting the user evaluation data to the server, which then analyzes the evaluation data and uses it to improve services. This allows users to quickly and easily select the cosmetic surgery options that are best suited to them online and to consistently complete the entire process from booking to aftercare.

[1368] "User" refers to a person who uses the system to select and book cosmetic surgery procedures.

[1369] "Basic information" refers to data necessary to identify an individual, such as the user's name, age, gender, and contact information.

[1370] "3D facial scan data" refers to digital data that represents detailed information about a user's face, such as their facial shape, bone structure, and skin condition, in three dimensions.

[1371] "Terminal" refers to an electronic device used by a user, such as a smartphone, tablet, or computer.

[1372] "Server" refers to the computer system used to analyze 3D scan data, generate cosmetic surgery options, store data, process reservations, etc.

[1373] "Cosmetic surgery options" refers to the specific cosmetic surgery procedures offered to users (e.g., hyaluronic acid injections, facelifts, etc.).

[1374] "Acquisition means" refers to the technological process or equipment used to collect a 3D scan of the user's face.

[1375] "Means for analysis" refers to the algorithms and software used to analyze the acquired 3D scan data and recommend the most appropriate cosmetic surgery options to the user.

[1376] "Selection Data" refers to information about the specific procedures selected by a user from among the cosmetic surgery options presented to them.

[1377] "Clinic" refers to a medical institution that provides cosmetic surgery procedures.

[1378] "Price Information" refers to information regarding the cost of the procedure corresponding to the selected cosmetic surgery option.

[1379] "Reservation procedure" refers to the series of processes for completing a reservation for the desired date and time for the cosmetic surgery procedure selected by the user.

[1380] "Aftercare information" refers to instructions and advice provided to users to help them take appropriate care after treatment.

[1381] "Evaluation data" refers to feedback information in which a user evaluates the service or treatment content after the treatment.

[1382] "Real-time capture means" refers to the technological process or equipment used to instantly acquire and process a 3D scan of a user's face in real time.

[1383] MODE FOR CARRYING OUT THE INVENTION

[1384] The present invention relates to a system that simplifies the process of selecting and booking cosmetic surgery treatments by allowing users to obtain detailed data of their own face through 3D scanning, suggesting appropriate cosmetic surgery options based on that data, and even allowing them to make reservations. The system mainly consists of a device used by the user, a server that analyzes and stores the data, and a medical institution that provides the suggested cosmetic surgery options.

[1385] Initial Data Entry

[1386] The user uses the device to input basic information (such as name, age, gender, and contact details), which is then sent to the server, where it is stored.

[1387] Performing a 3D scan

[1388] Users use the camera on their smartphone or tablet to perform a 3D scan of their face. The device provides lead instructions, directing the user to accurately scan their face. For example, instructions such as "Please slowly turn your face left and right" are given in real time. Once the scan is complete, the device compresses the 3D data and sends it to the server.

[1389] Data analysis and options presentation

[1390] The server uses algorithms (such as OpenCV and TensorFlow) to analyze the received 3D scan data and perform a detailed analysis of the facial shape, bone structure, and skin condition. Based on the analysis results, the server generates the optimal cosmetic surgery options for the user and sends them to the device.

[1391] Consulting and plan selection

[1392] The device displays the analysis results and cosmetic surgery options sent from the server to the user. The user can select the plan they are interested in from the options presented and check detailed information and treatment examples. For example, options such as "hyaluronic acid injection" and "facelift" are presented.

[1393] Clinic and price information provided

[1394] Once the user selects a plan, the device sends the selection data to the server, which generates a list of affiliated clinics and their treatment prices based on the user's selection. This information is sent to the device and presented to the user.

[1395] Final selection and booking

[1396] The user checks the list of clinics and treatment price information provided, and finally selects the desired clinic and treatment date and time. The reservation information from the terminal is sent to the server, which completes the reservation procedure with the affiliated medical institution. A message indicating reservation completion is displayed on the terminal. For example, a message such as "Reservation completed. Please come to the clinic at 12:00 on XX month XX day" is displayed.

[1397] Aftercare and evaluation

[1398] After the treatment, the server provides the user with aftercare information. For example, it may provide care instructions such as "Please keep the area cool and rest for 24 hours after the treatment." The user can then confirm this information and provide appropriate care at home. The user also inputs their post-treatment evaluation via their device, and this evaluation data is sent to the server. The server analyzes the evaluation data and uses it to improve the service.

[1399] Examples of concrete examples and prompts

[1400] For example, when a user uses the system for the first time to consider cosmetic surgery, they register through a smartphone app and take a 3D scan of their face. The scan data is then analyzed by the server, and multiple options, such as hyaluronic acid injections and facelifts, are presented. The user selects hyaluronic acid injections, checks a list of available clinics and pricing information, and then confirms an appointment at a convenient date and time. After the procedure, they provide appropriate care based on the aftercare information provided, and enter a rating to provide feedback to the system.

[1401] Example prompt sentence:

[1402] "Users use a smartphone app to initially register for cosmetic surgery and then take a 3D scan of their face. Based on the scan data, the app recommends the most appropriate cosmetic surgery options. For example, hyaluronic acid injections, facelift, etc."

[1403] As described above, this system allows users to quickly and easily select the cosmetic surgery option that best suits them online, and to complete the entire process from booking to aftercare.

[1404] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1405] Step 1:

[1406] The user enters basic information.

[1407] Users use devices such as smartphones and tablets to enter their basic information (name, age, gender, contact details, etc.) into a dedicated application. The entered basic information is temporarily saved by the device.

[1408] Step 2:

[1409] The terminal sends the input data to the server.

[1410] The terminal sends the basic information entered by the user to the server using the HTTPS protocol, which receives this data, stores it in a database, and generates a unique ID for the user, which allows the user to be identified in subsequent processes.

[1411] Step 3:

[1412] The user performs a 3D scan of their face.

[1413] The user initiates a 3D scan of their face using the device's camera. The device provides lead instructions, such as slowly rotating the user's face left and right, in real time. The device captures and temporarily stores the 3D data of the face through the camera.

[1414] Step 4:

[1415] The device sends the scanned data to the server.

[1416] Once the scan is complete, the device compresses the captured 3D data and sends it over HTTPS to a server, which receives it and stores it for analysis.

[1417] Step 5:

[1418] The server analyzes the 3D scan data.

[1419] The server then analyzes the received 3D scan data using algorithms such as OpenCV and TensorFlow to extract detailed data such as facial shape, bone structure, and skin condition. The analysis results are then temporarily stored.

[1420] Step 6:

[1421] A server generates cosmetic surgery options.

[1422] Based on the analysis results, the server generates the optimal cosmetic surgery options for the user (e.g., hyaluronic acid injection, facelift, etc.). The generated options are temporarily stored.

[1423] Step 7:

[1424] The server sends the option data to the terminal.

[1425] The server sends the generated cosmetic surgery options to the terminal, which receives this data and displays it to the user, who then selects the plan they are interested in from the presented options.

[1426] Step 8:

[1427] The user selects a plan.

[1428] The user uses the device to select the plan they are interested in from the presented cosmetic surgery options, and check detailed information and treatment examples. When the user selects a plan, selection data is generated.

[1429] Step 9:

[1430] The terminal transmits the selection data to the server.

[1431] The device sends the user's selected plan information to the server using the HTTPS protocol, which receives this data and generates clinic and price information based on the selected cosmetic surgery plan.

[1432] Step 10:

[1433] The server generates a list of clinics and pricing information.

[1434] The server generates a list of affiliated clinics and treatment price information and sends it to the terminal, which receives the information and displays it to the user.

[1435] Step 11:

[1436] The user selects the clinic and treatment date and time.

[1437] The user checks the list of clinics and price information displayed on the terminal, and finally selects the desired clinic and treatment date and time. Selection data is generated.

[1438] Step 12:

[1439] The terminal transmits the reservation information to the server.

[1440] The device sends the selected clinic and treatment date and time information to the server using the HTTPS protocol. The server receives this data and completes the reservation procedure.

[1441] Step 13:

[1442] The server completes the reservation process.

[1443] The server sends a reservation request to the affiliated clinic and completes the reservation procedure. A confirmation message is generated and sent to the terminal.

[1444] Step 14:

[1445] The device will display a confirmation message that the reservation is complete.

[1446] The terminal displays the reservation completion confirmation message received from the server to the user. For example, a message such as "Reservation completed. Please come to the hospital at 12:00 on XX month XX day" is displayed.

[1447] Step 15:

[1448] The server provides aftercare information.

[1449] After the treatment, the server provides the user with detailed aftercare information. For example, instructions such as "Please keep the area iced and rest for 24 hours after the treatment" are sent. The device receives this information and displays it to the user.

[1450] Step 16:

[1451] The user checks the aftercare information and provides care.

[1452] The user checks the provided aftercare information and provides appropriate care at home.

[1453] Step 17:

[1454] The user enters the evaluation data.

[1455] After the treatment, the user inputs their evaluation through the terminal, and evaluation data is generated.

[1456] Step 18:

[1457] The terminal transmits the evaluation data to the server.

[1458] The device sends the user-entered rating data to the server using the HTTPS protocol, which receives and stores the data for use in improving the service.

[1459] The above are the specific processing steps of this system.

[1460] (Application example 1)

[1461] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1462] For users considering cosmetic surgery, selecting the most suitable cosmetic surgery option and booking the appointment are time-consuming and cumbersome tasks. It is also important to provide information on aftercare after the procedure and efficiently collect user feedback to use in improving services. However, traditional methods for these processes are fragmented, limiting the ability to improve user experience and optimize services.

[1463] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1464] In this invention, the server includes a means for improving services using a generative AI model based on user evaluation data, a means for capturing 3D facial scan data in real time, and a means for transmitting the user's post-treatment evaluation data to the server and using the generative AI model to improve services. This allows users to quickly and accurately select the optimal cosmetic surgery option and easily complete the reservation process. Furthermore, the provision of aftercare information and the collection of evaluation data after treatment also enable continuous improvement of services.

[1465] "Basic information" refers to data necessary to identify an individual, such as the user's name, age, gender, and contact information.

[1466] "3D scan data" is digital data that captures the three-dimensional shape of a user's face.

[1467] "Server" means a computer system for analyzing 3D scan data, generating cosmetic surgery options, and storing and providing relevant information to users.

[1468] "Analysis" is the process of examining the facial shape, bone structure, skin condition, etc. in detail based on the acquired 3D scan data.

[1469] "Cosmetic surgery options" are treatment options suggested by analyzing 3D scan data of the user's face.

[1470] A "terminal" is a device used by a user, such as a smartphone or tablet.

[1471] "Selection data" refers to information about the procedure selected by the user from among the cosmetic surgery options.

[1472] "Medical facility" means a hospital or clinic that provides cosmetic surgery.

[1473] The "reservation procedure" is the process of confirming a treatment date and time with a medical facility based on the cosmetic surgery option selected by the user.

[1474] "Aftercare information" refers to information about care methods and precautions to take after treatment.

[1475] "Evaluation data" is feedback information provided by the user after the treatment.

[1476] A "generative AI model" is an artificial intelligence model that analyzes user evaluation data and improves and optimizes services.

[1477] The system embodying the present invention simplifies the process of selecting and booking cosmetic surgery procedures. Specifically, the user uses a device such as a smartphone or tablet to acquire 3D facial scan data, which is then sent to a server where it is analyzed, the system recommends optimal cosmetic surgery options, and assists with the booking process.

[1478] Hardware and software used

[1479] Hardware: smartphones, tablets, servers

[1480] Software: Flask (server-side framework), face_recognition (face analysis library), Flutter (client app framework), generative AI model

[1481] System action

[1482] The server receives the user's basic information and 3D scan data, and performs a detailed analysis of the face's shape, bone structure, and skin condition. The analysis uses the face_recognition library to obtain facial landmarks and shape data. Based on this analysis data, cosmetic surgery options are generated and sent to the user's device.

[1483] The terminal displays cosmetic surgery options to the user and transmits the option selected by the user to the server, which generates affiliated medical facilities and price information based on the selected option and transmits it to the terminal, allowing the user to complete the reservation procedure.

[1484] After the procedure, the server provides aftercare information and collects user evaluation data. The collected evaluation data is analyzed using a generative AI model and used to improve the service, thereby continuously providing users with the most suitable cosmetic surgery options.

[1485] Specific examples

[1486] Let's take the example of a user named Hanako considering cosmetic surgery. Hanako first uses a smartphone app to enter basic information and take a 3D scan of her face. This 3D scan data is sent to a server for analysis. The server then suggests cosmetic surgery options such as hyaluronic acid injections and facelifts. Hanako selects hyaluronic acid injections, checks medical facilities and pricing information, and then confirms an appointment for her desired date and time. After the procedure, she follows the aftercare information provided, and then enters her evaluation and provides feedback to the system. This feedback data is analyzed by a generative AI model and used to improve the system's services.

[1487] Prompt Sentence Examples

[1488] "I'm considering cosmetic surgery. I've entered the following basic information: Name: Hanako, Age: 30, Gender: Female, Contact Information: [email address]. I've then had a 3D scan of my face. Please analyze my facial shape and skin condition and recommend the best cosmetic surgery options for me. How do I choose the options I want and complete my appointment?"

[1489] This embodiment of the invention allows users to easily find the cosmetic surgery options that are best for them and receive the treatment with peace of mind.

[1490] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1491] Step 1:

[1492] The terminal inputs the user's basic information.

[1493] (Input): Basic information such as the user's name, age, gender, and contact details.

[1494] (Specific operation): When a user enters data into the input form displayed on the terminal and presses the submit button, this information is sent to the server in JSON format.

[1495] (Output): Basic information sent to the server.

[1496] Step 2:

[1497] The device acquires a 3D scan of the user's face.

[1498] (Input): Face scan using your smartphone or tablet camera.

[1499] (Specific operation): The device uses the camera to initiate a 3D scan of the face, capturing data in real time, which is then compressed and sent to the server.

[1500] (Output): The 3D scan data sent to the server.

[1501] Step 3:

[1502] The server analyzes the 3D scan data and generates cosmetic surgery options.

[1503] (Input): 3D scan data stored on the server.

[1504] (Specific operation): The server uses the face_recognition library to analyze the face shape, bone structure, skin condition, etc.

[1505] , to generate optimal cosmetic surgery options.

[1506] (Output): Generated cosmetic surgery options.

[1507] Step 4:

[1508] The server sends cosmetic surgery options to the device.

[1509] (Input): Generated cosmetic surgery options.

[1510] (Specific operation): The server sends the generated cosmetic surgery options in JSON format to the terminal.

[1511] (Output): Cosmetic surgery options displayed on the device.

[1512] Step 5:

[1513] The user selects from the options and sends the selection to the server.

[1514] (Input): Cosmetic surgery options displayed on the device.

[1515] (Specific operation): The user selects the desired option on the terminal and presses the select button. This selection data is sent to the server.

[1516] (Output): The selection data sent to the server.

[1517] Step 6:

[1518] The server generates medical facility and price information based on the selected options and transmits it to the terminal.

[1519] (Input): Selection data stored on the server.

[1520] (Specific operation): The server generates affiliated medical facilities and their price information based on the selected data and sends it to the terminal in JSON format.

[1521] (Output): Medical facility and pricing information displayed on the terminal.

[1522] Step 7:

[1523] The user then makes a reservation based on the medical facility and price information that he or she has finally selected.

[1524] (Input): Medical facility and price information displayed on the terminal.

[1525] (Specific operation): The user selects the desired medical facility and treatment date and time, and presses the reservation button. The reservation information is sent to the server, and the reservation procedure is completed on the server side.

[1526] (Output): A confirmation message that the reservation is complete.

[1527] Step 8:

[1528] After the treatment, the server provides aftercare information and collects user evaluation data.

[1529] (Input): User after reservation is completed.

[1530] (Specific operation): After the treatment, the server sends aftercare information to the terminal and receives evaluation data entered by the user.

[1531] (Output): Rating data stored on the server.

[1532] Step 9:

[1533] The service is improved using a generative AI model based on the evaluation data acquired by the server.

[1534] (Input): Rating data stored on the server.

[1535] (Specific operation): The server inputs the evaluation data into the generative AI model and improves the service based on the analysis results.

[1536] (Output): Service improvement.

[1537] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1538] The present invention relates to a system that simplifies the cosmetic surgery selection and booking process by obtaining detailed data of the user's face through 3D scanning, suggesting appropriate cosmetic surgery options based on that data, and using an emotion engine to recognize the user's emotions and help provide more appropriate choices.

[1539] System Overview

[1540] The system consists of a terminal operated by the user, a server that analyzes and stores data, a clinic that provides suggested cosmetic surgery options, and an emotion engine that recognizes the user's emotions.

[1541] Program processing

[1542] Initial Data Entry

[1543] Using the device, the user enters their initial basic information (name, age, gender, contact details, etc.), which is then sent to the server and stored.

[1544] Performing a 3D scan

[1545] Users use the camera on their smartphone or tablet to perform a 3D facial scan. The device provides lead instructions to guide the device in accurately scanning the face, capturing the 3D data in real time. Once the scan is complete, the data is compressed and sent to a server.

[1546] Data analysis and emotion recognition

[1547] The server analyzes the received 3D scan data and performs a detailed analysis of the facial shape, bone structure, skin condition, etc. It then uses an emotion engine to analyze the user's emotions from the facial expression data. The emotion engine detects changes in micro-expressions and identifies the user's current feelings (e.g., joy, sadness, surprise, etc.).

[1548] Options and customization

[1549] The server generates cosmetic surgery options based on the analysis results and the emotion engine results, and customizes the options that best suit the user. This information is sent to the terminal and presented to the user.

[1550] Consulting and plan selection

[1551] The device displays the analysis results, emotion results, and list of cosmetic surgery options sent from the server to the user. The user checks the details of the options and selects the plan that best suits them. The selected data is then sent to the server.

[1552] Clinic and price information provided

[1553] The server generates a list of affiliated clinics and prices based on the cosmetic surgery plan selected by the user, and this information is sent to the terminal and presented to the user.

[1554] Final selection and booking

[1555] The user checks the clinic and price information provided, and finally selects the desired clinic and treatment date and time. The terminal sends the reservation information to the server, and the server completes the reservation procedure with the clinic based on that data. A confirmation message confirming the reservation is complete is displayed on the terminal.

[1556] Aftercare and evaluation

[1557] After the treatment is completed, the server provides the user with aftercare information. The terminal displays the provided aftercare guide to the user, who then provides appropriate care. After confirming the aftercare, the user also enters evaluation data, which is sent to the server for analysis. The server uses the collected evaluation data to improve its services.

[1558] Specific examples

[1559] For example, if a user is considering cosmetic surgery, they can register through a smartphone app and have their face scanned in 3D. The scan data is then analyzed by the server, and the emotion engine detects "anxiety" from the user's facial expression. Based on this, the server suggests cosmetic surgery options that provide a sense of security and reduce anxiety. After the user selects hyaluronic acid injection and checks the list of available clinics and pricing information, they can schedule an appointment for a convenient date and time. After the procedure, they can provide appropriate care based on the aftercare information provided, and enter their evaluation to provide feedback to the system.

[1560] In this way, the system helps users easily obtain information about cosmetic surgery and make optimal choices that take into account their emotional state.

[1561] The processing flow will be explained below.

[1562] Step 1:

[1563] The user launches the application on the device and proceeds to the new registration screen. The user enters basic information such as name, age, gender, and email address. The device then checks the input for any input errors. Once the check is complete, the device sends this data to the server.

[1564] Step 2:

[1565] The device displays a screen prompting the user to prepare for a 3D facial scan. The user prepares their face for a 3D facial scan and follows the device's instructions to rotate their face 360 ​​degrees to perform the 3D scan. The device captures, corrects, and compresses the scanned data in real time. Once the scan is completed accurately, the device sends the data to the server.

[1566] Step 3:

[1567] The server receives the 3D scan data sent from the device, checks the data integrity and quality, stores the data in a database, and runs an analysis algorithm that analyzes facial shape, bone structure, skin condition, etc.

[1568] Step 4:

[1569] The server activates an emotion engine to recognize the user's emotions based on the 3D facial scan data. The emotion engine analyzes the user's facial expression data and identifies the user's emotional state. For example, if the user is smiling, it recognizes the emotion as "joy," and if they are frowning, it recognizes the emotion as "anxiety."

[1570] Step 5:

[1571] The server generates cosmetic surgery options based on the facial analysis and emotion engine results. If the analysis result is "a facelift is appropriate" and the emotion is "anxiety," the server customizes the options with detailed explanations about facelifts and additional information to alleviate the user's anxiety.

[1572] Step 6:

[1573] The server sends the analyzed data and cosmetic surgery options to the device. The device displays a detailed list of options to the user. The user checks the details of each option and selects the plan that best suits them. The selected data is then sent from the device to the server.

[1574] Step 7:

[1575] The server generates a list of affiliated clinics and pricing information for the procedures based on the selected cosmetic surgery options. This information is sent to the terminal and presented to the user, who can then compare the presented list and prices.

[1576] Step 8:

[1577] The user finally selects the most suitable clinic and treatment plan, and confirms the desired reservation date and time. The terminal sends this reservation information to the server. The server sends the reservation information to the clinic, and upon receiving confirmation from the clinic, returns it to the terminal. The terminal displays a notification to the user that the reservation has been completed.

[1578] Step 9:

[1579] After the treatment is completed, the server sends an aftercare guide to the terminal to provide the user with aftercare information. The terminal displays this guide to the user, and the user follows the instructions to provide appropriate care.

[1580] Step 10:

[1581] After the user completes the aftercare, the device displays a questionnaire to evaluate the treatment. The user answers the questionnaire, and the device sends the data to the server. The server receives the evaluation data and analyzes it to improve the service.

[1582] Specific examples

[1583] For example, if a user is interested in cosmetic surgery, they can register through a smartphone app and have their face scanned in 3D. The scan data is analyzed by the server, and an emotion engine detects "anxiety" from the user's facial expression. Based on this, the server suggests options such as hyaluronic acid injections to provide a sense of security. The user selects an option, confirms clinic and price information, and then confirms the appointment. After the procedure, the user receives appropriate care based on the aftercare information provided, and enters an evaluation that is fed back to the system. In this way, the system helps users easily obtain information about cosmetic surgery and make the best choice, taking their emotional state into consideration.

[1584] Example 2

[1585] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1586] The process of selecting and booking cosmetic surgery is complex and time-consuming for users, making it difficult to obtain appropriate information. Furthermore, the user's emotional state is not taken into consideration, which may result in an inadequate selection. This risks reducing user satisfaction. Furthermore, the provision of aftercare information and collection of evaluation data after the procedure are not effectively implemented.

[1587] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting basic information about the user, means for acquiring 3D scan data of the user's face, means for transmitting the acquired 3D scan data to the server, means for the server to analyze the 3D scan data and generate cosmetic surgery options, means for the server to transmit the cosmetic surgery options to the terminal, means for the user to select from the options and transmit the selected data to the server, means for the server to generate facility and price information based on the selected options and transmit this information to the terminal, means for completing the reservation procedure based on the facility and price information finally selected by the user, means for the server to provide aftercare information and collect user evaluation data after the procedure, and means for providing cosmetic surgery options based on the user's emotions using an emotion engine that recognizes the user's emotions. This allows the user to select the optimal cosmetic surgery option taking into account their emotional state, making it possible to efficiently complete the entire process from reservation to aftercare.

[1588] "Basic user information" refers to information that identifies a user and constitutes a basic profile, such as name, age, gender, and contact information.

[1589] "Three-dimensional scan data" refers to data that captures the shape and expression of a user's face in three dimensions, and includes information such as the overall shape of the face, bone structure, and skin condition.

[1590] A "server" is a device that is composed of a computer and a storage device for analyzing and storing received data, and generating and providing necessary information.

[1591] An "emotion engine" is an algorithm and software for recognizing and analyzing emotions from a user's facial expressions.

[1592] "Cosmetic surgery options" are options for cosmetic surgery or procedures suggested to users based on their cosmetic needs, including hyaluronic acid injections, Botox injections, facelifts, etc.

[1593] A "terminal" is a device operated by a user, such as a smartphone, tablet, or PC, which is an electronic device with input and display functions.

[1594] A "facility" is a doctor's office or clinic that offers the proposed cosmetic surgery options.

[1595] "Aftercare information" refers to guidelines and support information provided to users regarding post-treatment care methods and precautions.

[1596] "Evaluation data" refers to feedback information provided by the user after a treatment, and includes evaluations of the appropriateness of aftercare and the results of the treatment.

[1597] The present invention is a system that simplifies the cosmetic surgery selection and booking process. The system consists of a user-operated terminal, a server that analyzes and stores data, a facility that provides suggested cosmetic surgery options, and an emotion engine that recognizes the user's emotions.

[1598] Initial Data Entry

[1599] Using a device, the user enters their initial basic information (such as name, age, gender, and contact details). This data is sent from the device to a server and stored. Specifically, the user accesses an application on their smartphone or tablet, enters the required information into a form, and submits it.

[1600] Performing a 3D scan

[1601] Users use the camera on their smartphone or tablet to perform a 3D scan of their face. The device provides lead instructions to guide the user through the precise scan and captures the 3D data in real time. Once the scan is complete, the data is compressed and sent to a server. For example, this can be done using Photogrammetry software.

[1602] Data analysis and emotion recognition

[1603] The server performs a detailed analysis of the received 3D scan data. This analysis includes analyzing the facial shape, bone structure, and skin condition. It then uses an emotion engine (e.g., Emotion AI) to analyze the user's emotions from their facial expression data. The emotion engine detects changes in micro-expressions and identifies the user's current emotion (e.g., joy, sadness, surprise, etc.).

[1604] Options and customization

[1605] The server generates cosmetic surgery options based on the analysis results and the emotion engine results, and customizes the options that best suit the user. This information is sent to the device and presented to the user. The cosmetic surgery options include hyaluronic acid injections, Botox injections, and facelifts.

[1606] Consulting and plan selection

[1607] The device displays the analysis results, emotion results, and list of cosmetic surgery options sent from the server to the user. The user checks the details of the options and selects the plan that best suits them. The selected data is then sent to the server.

[1608] Clinic and price information provided

[1609] The server generates a list of affiliated facilities and prices based on the user's cosmetic surgery plan selection. This information is sent to the device and presented to the user. For example, the server may automatically search a database of relevant cosmetic surgery facilities and display results based on the user's location and preferences.

[1610] Final selection and booking

[1611] The user checks the facilities and price information provided, and finally selects the desired facility and treatment date and time. The terminal sends the reservation information to the server, and the server completes the reservation procedure with the facility based on that data. A confirmation message confirming the reservation is complete is displayed on the terminal.

[1612] Aftercare and evaluation

[1613] After the treatment is completed, the server provides the user with aftercare information. The terminal displays the provided aftercare guide to the user, who then provides appropriate care based on it. After confirming the aftercare, the user also enters evaluation data, which is sent to the server. The server uses the collected evaluation data to improve its services.

[1614] Specific examples

[1615] For example, if a user is considering cosmetic surgery, they can register through a smartphone application and have their face scanned in 3D. The scan data is then analyzed by the server, and an emotion engine detects "anxiety" from the user's facial expression. Based on this, the server suggests cosmetic surgery options that provide superior peace of mind to alleviate anxiety. After the user selects hyaluronic acid injection and checks the list of corresponding facilities and pricing information, they can confirm an appointment at a convenient date and time. After the procedure, they can provide appropriate care based on the aftercare information provided, and enter their evaluation to provide feedback to the system.

[1616] Prompt Sentence Examples

[1617] "We will take into account your current emotional state and recommend the best cosmetic surgery options for you. We will perform a three-dimensional scan of your face and provide you with detailed data."

[1618] In this way, the system helps users easily obtain information about cosmetic surgery and make optimal choices that take into account their emotional state.

[1619] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1620] Step 1: Initial data entry

[1621] A user accesses an application on a smartphone or tablet and enters basic information (name, age, gender, contact details). Once this data is entered, the device sends the entered data to the server. The server stores the received basic information in a database and prepares it for the next step. Specific operations include the display of an input form, the user filling in the fields, and pressing the submit button. Input: Name, age, gender, contact details. Output: Basic information is saved in the database.

[1622] Step 2: Perform a 3D scan

[1623] The user uses the device's camera to perform a 3D scan of their face. The device displays lead instructions to guide the user to scan accurately. During the scan, 3D data is captured in real time. Once the scan is complete, the device compresses this data and sends it to the server. Once the server receives the data, it stores it and prepares it for the next analysis step. Input: 3D scan data. Output: Compressed scan data sent to the server.

[1624] Step 3: Data analysis and emotion recognition

[1625] The server analyzes the received 3D scan data. Specifically, it uses Photogrammetry software to perform a detailed analysis of facial shape, bone structure, skin condition, and other factors. It then uses Emotion AI to recognize emotions from the user's facial expression data. The emotion engine analyzes changes in micro-expressions and identifies emotions such as "happiness," "sadness," and "surprise." Input: 3D scan data. Output: Detailed facial shape data and emotion recognition results.

[1626] Step 4: Present options and customize

[1627] The server generates cosmetic surgery options based on the analysis results and the emotion engine results. Specifically, it lists treatment options (e.g., hyaluronic acid injection, Botox injection, facelift, etc.) tailored to the user's skin condition and bone structure. These options are sent to the device in a customizable format. Guides and explanations are also provided to help the user select the best option. Input: Detailed face shape data and emotion recognition results. Output: List of cosmetic surgery options and guide.

[1628] Step 5: Consultation and plan selection

[1629] The device displays the analysis results received from the server, cosmetic surgery options, and a recommended list of beauty facilities to the user. The user reviews the details of the options and selects the plan that suits them. Once the selection is complete, the device sends the information to the server. The server records the selection data and proceeds to present the next facility and price information. Input: Cosmetic surgery option selected by the user. Output: Selection data sent to the server.

[1630] Step 6: Present your facilities and pricing information

[1631] The server generates beauty salons and their pricing information based on the plan selected by the user. In particular, the server searches the relevant database to create a list of salons and pricing information based on the user's location and desired conditions. This information is sent to the terminal and presented to the user. Input: User's selection data and location information. Output: List of salons and pricing information.

[1632] Step 7: Final selection and booking

[1633] The user checks the provided facility and price information, and selects the desired beauty facility and treatment date and time. The device sends this information to the server. The server automatically completes the reservation procedure and generates reservation confirmation data with the clinic. A confirmation message indicating the reservation is complete is then displayed on the device. Input: User's facility and date and time selection information. Output: Completion of reservation procedure and confirmation message.

[1634] Step 8: Aftercare and evaluation

[1635] After the treatment is completed, the server provides the user with the necessary aftercare information. This information is sent to the terminal, and the user provides appropriate care based on that information. The user then inputs the results and evaluation of the aftercare, and this data is sent from the terminal to the server. The server analyzes the evaluation data and uses it to improve services in the future. Input: User evaluation data. Output: Analysis data for service improvement.

[1636] (Application example 2)

[1637] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1638] In the conventional cosmetic surgery selection and booking process, it was difficult for users to accurately understand their facial data and select the appropriate cosmetic surgery option. Furthermore, cosmetic surgery recommendations rarely took into account users' emotional state, which left users unable to alleviate their psychological anxiety. Furthermore, information about the booking procedure and aftercare was insufficient, resulting in poor overall service quality.

[1639] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1640] In this invention, the server includes means for analyzing 3D scan data of the user's face, analyzing the user's emotional state with an emotion engine, and generating cosmetic surgery options, means for the server to transmit the cosmetic surgery options to the terminal, and means for the user to select from the options and transmit the selected data to the server. This allows the user to select the optimal cosmetic surgery option based on their own facial data, taking into account their emotional state, and simplifies the reservation process while reducing psychological anxiety.

[1641] "Basic information" refers to the user's name, age, gender, contact information, etc.

[1642] "3D scan data" is data that measures the shape and features of a user's face in three dimensions and saves it as digital data.

[1643] A "server" is a computer system that analyzes, stores, and transmits and receives data over a network.

[1644] An "emotion engine" is a system that includes algorithms and software for analyzing emotions from a user's facial expression data and identifying the user's state of mind.

[1645] "Cosmetic surgery options" are suggested cosmetic procedures and treatment options based on the user's facial features and emotional state.

[1646] "Terminal" refers to a personal computer such as a smartphone or tablet used by a user.

[1647] A "clinic" is a medical institution or clinic that provides cosmetic surgery procedures.

[1648] "Price information" is information about the cost of cosmetic surgery procedures.

[1649] The "reservation procedure" refers to the operations and steps for booking a treatment at a clinic based on the cosmetic surgery options selected by the user.

[1650] "Aftercare information" is information that includes instructions and guidelines regarding care after a procedure.

[1651] "Evaluation data" refers to data regarding user satisfaction and feedback after treatment.

[1652] "Real-time capture" refers to instantly acquiring 3D scan data of the user's face and processing it on the spot.

[1653] This invention is a system that simplifies the cosmetic surgery selection and booking process by obtaining detailed data of the user's face through 3D scanning, suggesting appropriate cosmetic surgery options based on that data, and using an emotion engine to recognize the user's emotions and help provide more appropriate choices.

[1654] System Overview

[1655] The system consists of a device operated by the user, a server that analyzes and stores data, a medical institution that provides suggested cosmetic surgery options, and an emotion engine that recognizes the user's emotions.

[1656] Program processing

[1657] Initial Data Entry

[1658] The user uses the device to input basic information (such as name, age, gender, and contact details), which is then sent to the server and stored.

[1659] Performing a 3D scan

[1660] Users use the camera on their smartphone or tablet to perform a 3D facial scan. The device provides lead instructions to guide the device in accurately scanning the face, capturing the 3D data in real time. Once the scan is complete, the data is compressed and sent to a server.

[1661] Data analysis and emotion recognition

[1662] The server analyzes the received 3D scan data and performs a detailed analysis of the facial shape, bone structure, skin condition, etc. It then uses an emotion engine to analyze the user's emotions from the facial expression data. The emotion engine detects changes in micro-expressions and identifies the user's current feelings (e.g., joy, sadness, surprise, etc.).

[1663] Options and customization

[1664] The server generates cosmetic surgery options based on the analysis results and the emotion engine results, and customizes the options that best suit the user. This information is sent to the terminal and presented to the user.

[1665] Consulting and plan selection

[1666] The device displays the analysis results, emotion results, and list of cosmetic surgery options sent from the server to the user. The user checks the details of the options and selects the plan that best suits them. The selected data is then sent to the server.

[1667] Presenting medical institutions and pricing information

[1668] The server generates a list of affiliated medical institutions and prices based on the cosmetic surgery plan selected by the user, and this information is sent to the terminal and presented to the user.

[1669] Final selection and booking

[1670] The user checks the presented medical institution and price information, and finally selects the desired medical institution and treatment date and time. The terminal sends the reservation information to the server, and the server completes the reservation procedure with the medical institution based on that data. A confirmation message that the reservation has been completed is displayed on the terminal.

[1671] Aftercare and evaluation

[1672] After the treatment is completed, the server provides the user with aftercare information. The terminal displays the provided aftercare guide to the user, who then provides appropriate care. After confirming the aftercare, the user also enters evaluation data, which is sent to the server for analysis. The server uses the collected evaluation data to improve its services.

[1673] Specific examples

[1674] For example, if a user is considering cosmetic surgery, they can register through a smartphone app and have their face scanned in 3D. The scan data is then analyzed by the server, and an emotion engine detects "anxiety" from the user's facial expression. Based on this, the server suggests cosmetic surgery options that provide a sense of security and reduce anxiety. After selecting a treatment option and checking the list of corresponding medical institutions and price information, the user can confirm an appointment for a convenient date and time. After the treatment, they can provide appropriate care based on the aftercare information provided, and enter their evaluation to provide feedback to the system. An example of this prompt is as follows:

[1675] Example prompt sentence:

[1676] Name: Yamada Hanako

[1677] Age: 29

[1678] Gender: Female

[1679] Face data: face_scan_data_in_base64_or_other_format

[1680] In this way, the system helps users easily obtain information about cosmetic surgery and make optimal choices that take into account their emotional state.

[1681] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1682] Step 1:

[1683] The terminal accepts basic information (such as name, age, gender, and contact details) from the user.

[1684] Input: User's basic information (name, age, gender, contact details)

[1685] How it works: A user uses a dedicated application on a smartphone or tablet to fill out a form to enter basic information.

[1686] Output: Basic information is saved on the device and sent to the server.

[1687] Step 2:

[1688] The device prompts the user to take a 3D scan of their face and provides lead instructions to ensure the facial scan is accurate.

[1689] Input: User's face data, camera footage

[1690] How it works: Using your smartphone or tablet's camera, the device captures a 3D scan of your face in real time and prompts you to reposition it as needed.

[1691] Output: 3D scan data is stored on the device and sent to a server.

[1692] Step 3:

[1693] The server analyzes the received 3D scan data and performs a detailed analysis of facial shape, bone structure, skin condition, etc.

[1694] Input: 3D scan data

[1695] How it works: Analysis software on the server processes the 3D scan data and extracts facial features and parameters.

[1696] Output: Detailed facial data as a result of analysis (shape, bone structure, skin condition, etc.)

[1697] Step 4:

[1698] The server analyzes the user's emotional state using an emotion engine based on the analyzed face data.

[1699] Input: detailed face data

[1700] How it works: The emotion engine on the server analyzes facial expression data, detects micro-expressions from the user's facial expressions, and determines their emotional state (e.g., joy, sadness, surprise, etc.) based on those expressions.

[1701] Output: Emotional state data

[1702] Step 5:

[1703] The server generates cosmetic surgery options based on the analysis and the emotional state data and presents customized options to the user.

[1704] Input: facial details, emotional state data

[1705] How it works: A generative AI model on the server uses the subject's data to determine available cosmetic surgery options and lists suitable suggestions for the user.

[1706] Output: Cosmetic surgery options list

[1707] Step 6:

[1708] The terminal displays the analysis results, emotion results, and list of cosmetic surgery options sent from the server to the user.

[1709] Enter: Cosmetic Surgery Options List

[1710] How it works: A smartphone or tablet application displays a list and the user interacts with the UI to make a selection.

[1711] Output: User selection data

[1712] Step 7:

[1713] The server generates a list of affiliated medical institutions and prices based on the user's selection data and transmits it to the terminal.

[1714] Input: User selection data, affiliated medical institution data

[1715] How it works: The server generates appropriate candidates from the information of affiliated medical institutions based on the selected data and creates a list with price information.

[1716] Output: List of providers and pricing information

[1717] Step 8:

[1718] The user checks the presented medical institutions and price information, and finally selects the desired medical institution and treatment date and time.

[1719] Input: List of providers and pricing information

[1720] How it works: The user selects the desired option from the list displayed on their smartphone or tablet and sets the date and time of the treatment.

[1721] Output: Reservation data

[1722] Step 9:

[1723] The server completes the reservation procedure with the medical institution based on the reservation data, and displays a confirmation message on the terminal that the reservation has been completed.

[1724] Input: Reservation data

[1725] Operation: The server connects to the medical institution's reservation system, completes the reservation procedure, generates a confirmation message, and sends it to the terminal.

[1726] Output: Reservation confirmation message

[1727] Step 10:

[1728] After the treatment, the server provides the user with aftercare information, which is displayed on the terminal. The user then performs the aftercare and submits evaluation data.

[1729] Input: None (after treatment is completed)

[1730] Operation: The server sends a prepared aftercare guide to the terminal, which displays it to the user. The user performs care according to the aftercare guide and then enters evaluation data into the terminal. The evaluation data is then sent to the server.

[1731] Output: Aftercare information, user evaluation data

[1732] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1733] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1734] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1735] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1736] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1737] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1738] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1739] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1740] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1741] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1742] The system according to the present disclosure has been described above mainly with respect to the functions of the data pr...

Claims

1. a means for inputting basic information about a user; a means for obtaining a 3D scan of a user's face; A means for transmitting the acquired 3D scan data to a server; A means for the server to analyze the 3D scan data and generate cosmetic surgery options; a means for the server to transmit cosmetic surgery options to the terminal; means for a user to select from the options and transmit the selection to a server; means for the server to generate clinic and price information based on the selected options and transmit the information to the terminal; A means for the user to make a reservation based on the clinic and price information finally selected by the user; A means for the server to provide aftercare information after the treatment and collect user evaluation data; A system including:

2. 10. The system of claim 1, wherein the system captures 3D facial scan data in real time.

3. 2. The system according to claim 1, wherein evaluation data of the user after the treatment is transmitted to the server and used to improve the service.

Images