System

Abstract

A system is provided.SOLUTION: A system comprising: means for a user to create an account and upload clinical information and health history; means for a healthcare provider to securely access and proactively review patient information; and means for a user and a healthcare provider to share clinical data online.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In current health checkups and medical examinations, healthcare providers often lack sufficient knowledge of a patient's past medical information and health history. This makes it difficult to share information appropriately and make efficient diagnoses, especially when a new or unfamiliar healthcare provider is present. This can lead to delays in patient health management and a decline in the quality of care. Furthermore, data cannot be shared in real time, preventing patients from fully understanding their own health status. There is a need to resolve these issues and improve the efficiency of the medical process and the effective sharing of data between patients and healthcare providers. [Means for solving the problem]

[0005] The present invention solves the above-mentioned problems by providing the following means: A means is provided for users to create an account and upload medical information and health history. This means that a patient's past medical information is centrally managed and accessible when needed. Second, a means is provided for healthcare providers to securely access and review patient information in advance. This means allows healthcare providers to understand a patient's past health data before treatment, enabling more accurate treatment. Furthermore, a means is provided for users and healthcare providers to share medical data online, enabling real-time data review during treatment and advanced collaboration. Additionally, a means is provided for healthcare providers to input patient data in real time during treatment and instantly update and share it. This means enables rapid updating and sharing of medical data. Furthermore, an AI means is provided for analyzing collected medical data and generating diagnostic suggestions based on the latest medical guidelines. This provides accurate and prompt treatment guidelines, improving the quality of medical treatment. Finally, a means is provided for patients to manage their personal health data and provide preventive measures and health management plans, thereby increasing patients' awareness and implementation of health management. These means realize an optimal medical treatment process for both patients and healthcare providers.

[0006] "Creating an account" is the process by which a user registers their personal information on the platform and makes it available for use.

[0007] "Uploading medical information or health history" means the act of a user inputting or sending file-based data relating to past medical records or health conditions to the platform.

[0008] "Secure access to patient information by healthcare providers" refers to the process by which healthcare providers can use the platform to view patient medical information after appropriate authentication procedures.

[0009] "Users and healthcare providers sharing medical data online" means that users and healthcare providers can view and edit medical data in real time via the Internet.

[0010] "Real-time patient data entry" means that a healthcare provider immediately enters new patient information into the system at the time of consultation, and that information is reflected immediately.

[0011] "AI means for analyzing collected medical data" refers to a system that uses artificial intelligence technology to analyze data based on past medical data and make diagnoses and treatment suggestions.

[0012] "Managing health data" refers to the act of a patient centrally organizing, recording, and updating information about their own health condition.

[0013] "Providing preventative measures and health management plans" means providing specific guidelines and schedules for actions to maintain and improve a patient's health. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0022] [First embodiment]

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0035] The present invention provides a platform that allows users to centrally manage their personal health data and efficiently share information with healthcare providers. The following is a detailed description of embodiments of the present invention.

[0036] 1. Electronic medical record sharing platform

[0037] Creating a user account and uploading information

[0038] User (Patient): Accesses the system and creates a new account. Enters name, email address, and password, receives a confirmation email to activate the account, and then uploads past medical examination information and medical history data to the system.

[0039] Server: Encrypts and stores user account information and uploaded data, granting access to healthcare providers as needed. Data is stored securely and can be accessed by both users and healthcare providers when needed.

[0040] 2. Real-time data update app

[0041] Real-time data entry and sharing during medical treatment

[0042] User (healthcare provider): Uses a dedicated app during consultation to input patient medical data in real time. The input data is immediately sent to the system.

[0043] Server: Rapidly updates the received data and associates it with the patient's account, so that the data is displayed in real time and can be viewed and reviewed by the patient at the same time.

[0044] 3. AI-Supported Medical Treatment Guide

[0045] Analysis of medical data and diagnostic suggestions

[0046] Server: Collected past medical data is input into the AI ​​system and analyzed. The AI ​​then generates diagnostic suggestions based on the latest medical guidelines.

[0047] User (healthcare provider): Logs in to the platform and checks the diagnostic suggestions generated by the AI. Based on these suggestions, the user can develop an appropriate medical treatment and treatment plan.

[0048] 4. Patient Empowerment App

[0049] Managing health data and taking preventative measures

[0050] User (patient): Uses the app to input and manage daily health data, including weight, blood pressure, and exercise records.

[0051] Server: Updates patient data periodically and provides timely health care plans.

[0052] Patient actions: Carry out daily health management according to the plan provided by the app. If necessary, the patient can consult and exchange opinions with their healthcare provider through the app.

[0053] Specific examples

[0054] To give a specific example, patient A creates a new account on the platform and uploads his or her past medical history. A then visits healthcare provider B for a regular checkup. B uses a dedicated app to input the medical data and updates A's data in real time with the results. The AI ​​system analyzes A's past data and generates diagnostic suggestions based on the medical guidelines, which are then provided to B. A can manage his or her own health data through the app and follow the submitted health management plan to live a healthier life.

[0055] In this way, the present invention can realize effective information sharing between patients and healthcare providers, improving the quality of medical care. It can also improve diagnostic accuracy by utilizing AI.

[0056] The processing flow will be explained below.

[0057] Processing steps of the electronic medical record sharing platform

[0058] Step 1: Create a user account

[0059] User: Accesses the platform, enters their name, email address and password in the registration form and presses the "Create Account" button.

[0060] Server: Receives registration information and stores it in a database. Generates and sends a confirmation email to the user's email address.

[0061] Users: Click the link in the confirmation email they receive to activate their account.

[0062] Step 2: Upload your medical information and health history

[0063] User: After logging in, select the file containing past medical information and health history and press the "Upload" button.

[0064] Server: Receives the file, encrypts the data, stores it in the database, and notifies the user when the data has been saved.

[0065] Step 3: Provider Access

[0066] User (healthcare provider): Logs in to the platform with a dedicated account.

[0067] Server: Verifies the healthcare provider's authorization and provides accessible patient data.

[0068] User (healthcare provider): View the patient's past medical information and understand the information necessary for treatment in advance.

[0069] Processing steps of the real-time data update app

[0070] Step 1: Enter your medical data

[0071] User (healthcare provider): Uses a dedicated app during consultation to input patient medical results, such as blood pressure, electrocardiogram results, and other findings, in real time.

[0072] Terminal (provider's device): The entered data is immediately sent to the server.

[0073] Step 2: Update and notify data

[0074] Server: Immediately updates the received medical data in the database and associates it with the patient's account. Sends a notification to the user (healthcare provider) that the update is complete.

[0075] User (Patient): Logs in to the app and checks medical data updated in real time. Data can be checked immediately after the consultation.

[0076] AI-supported medical treatment guide processing steps

[0077] Step 1: Collect and analyze medical data

[0078] Server: Inputs the patient's past and current medical data into the AI ​​system.

[0079] AI system: Analyzes data and generates diagnostic suggestions based on the latest medical guidelines.

[0080] Step 2: Providing diagnostic suggestions

[0081] Server: Sends AI-generated diagnostic suggestions to healthcare provider accounts.

[0082] User (healthcare provider): Logs in to the platform, checks the AI's diagnostic suggestions, and uses the suggestions to diagnose the patient.

[0083] Patient Empowerment App Processing Steps

[0084] Step 1: Enter and manage your health data

[0085] User (patient): Logs in to the app and enters daily health data (weight, blood pressure, diet, exercise, etc.).

[0086] Terminal (patient's device): Sends the entered data to the server.

[0087] Step 2: Provide a health care plan

[0088] Server: Analyzes the patient's health data, generates preventative measures and health management plans, and sends the plans to the patient's account.

[0089] User (patient): Check the health management plan provided through the app and incorporate it into their daily life.

[0090] Step 3: Collaborate with your healthcare provider

[0091] Users (patients): If they have health questions or concerns, they can contact their healthcare provider through the app.

[0092] User (healthcare provider): Responds to patient questions and provides necessary advice and treatment plans.

[0093] Through these processing steps, the Health Quality Connect system enables efficient data sharing between patients and healthcare providers and improves medical quality.

[0094] Example 1

[0095] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0096] In today's world, the management and sharing of medical information is extremely important, but traditional systems make it difficult to efficiently share information between patients and healthcare providers, which can affect the quality of medical care and the accuracy of diagnoses. Another issue is the lack of effective ways for patients to manage their own health data on a daily basis and collaborate with healthcare providers to manage their health.

[0097] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0098] In this invention, the server includes a means for users to create an account and upload medical information and health history, a means for healthcare providers to securely access and confirm patient information in advance, a means for users and healthcare providers to share medical data online, a means for users to input and manage daily health data using a dedicated app, and a means for encrypting and storing collected patient data. This allows patients and healthcare providers to efficiently share information and improve the quality of medical care, and also enables patients to manage their own health data on a daily basis and effectively manage their health.

[0099] "User" means a person or individual who accesses this system, creates an account, and inputs and manages medical information and health data.

[0100] A "healthcare provider" is a person or entity that is a medical professional providing medical care or services, inputs patient medical data, and uses AI-based diagnostic suggestions.

[0101] An "account" is a set of dedicated identification and login information that allows a user to access the system and manage personal and medical information.

[0102] "Medical information" refers to detailed data about a patient, such as diagnostic results, symptoms, and medical history, that is used by healthcare providers during consultations.

[0103] "Health history" is data including the user's past health condition, medical history, test results, and the like.

[0104] "Upload" is the operation by which a user sends and stores data from their device to the system.

[0105] A "dedicated app" is a software application for a specific purpose that allows users to input and manage their daily health data.

[0106] "Encryption" is a technology that converts data so that it cannot be deciphered by third parties, and is a means of storing it safely.

[0107] "Sharing medical data online" means that users and medical providers can instantly view and use information with each other via the Internet.

[0108] "Real-time updates" refers to the process by which a system instantly reflects data and keeps it up to date.

[0109] "Artificial intelligence (AI)" refers to a computer system that analyzes large amounts of data, learns, infers, and generates decisions such as diagnostic suggestions.

[0110] "Diagnostic suggestions" are specific recommendations for diagnoses and treatment plans presented to healthcare providers based on data analyzed by AI.

[0111] A "health management plan" is a specific action plan or advice provided to a user to maintain or improve their daily health.

[0112] The "system" is a platform that includes all of the above elements and functions, enabling patients and healthcare providers to effectively share information and improve the quality of medical care.

[0113] The present invention provides a platform that allows users to centrally manage their personal health data and efficiently share information with healthcare providers. The system consists of the following four main modules:

[0114] 1. Creating a user account and uploading information

[0115] The user (patient) accesses the system's registration page using a web browser. They create an account by entering their name, email address, and password, and receive a confirmation email from the system. They click the link in the confirmation email to activate their account. After their account is activated, they upload their past health checkup information and medical history data to the system in file format. The server encrypts the received files and stores them securely in a database.

[0116] 2. Real-time data update app

[0117] The user (healthcare provider) uses a dedicated app to enter the patient's medical data during medical treatment. The input form includes fields for the patient's basic information, symptoms, and diagnosis results. The device immediately sends the entered data to the server. The server immediately analyzes the received data and updates it by linking it to the patient's account. This allows the medical data to be displayed in real time, and the user (patient) can immediately check the updated medical data by logging in to their account.

[0118] 3. AI-Supported Medical Treatment Guide

[0119] The server inputs the collected past medical data into the generative AI model system. The generative AI model generates a diagnostic proposal based on the analyzed data and the latest medical guidelines. The server stores the generated diagnostic proposal within the system and provides it to the user (healthcare provider). The healthcare provider logs in to the platform to check the diagnostic proposal and, based on it, develops an appropriate medical examination and treatment plan.

[0120] For example, you might input the following prompt into a generative AI model:

[0121] "A 40-year-old man has been diagnosed with diabetes and high blood pressure in the past. His current symptoms are frequent urination and mild chest pain. I would like a diagnosis based on his blood sugar and blood pressure data from the past year."

[0122] 4. Patient Empowerment App

[0123] Users (patients) use a dedicated app to input and manage their daily health data (e.g., weight, blood pressure, exercise records). The server periodically updates the input data and reflects it in the patient's profile. The generative AI model analyzes the latest input data and generates preventive measures and a health management plan. Users (patients) receive the health management plan through the app and carry out daily health management according to that plan. Furthermore, users (patients) can send consultations and questions to healthcare providers through the app, and the server notifies the healthcare provider of the contents.

[0124] In this way, the present invention enables efficient information sharing between patients and healthcare providers, improving the quality of medical care. Furthermore, by utilizing AI, diagnostic accuracy can be improved, enabling patients to manage their own health on a daily basis.

[0125] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0126] 1. Creating a user account and uploading information

[0127] Step 1:

[0128] The user (patient) opens a web browser and accesses the system's registration page. The user enters their name, email address, and password and clicks the "Create Account" button.

[0129] Input: Name, Email Address, Password

[0130] Output: Account creation request

[0131] Step 2:

[0132] The server receives the account creation request, generates a confirmation email, and sends it to the specified email address, including an account activation link.

[0133] Input: User information

[0134] Output:Confirmation email

[0135] Step 3:

[0136] The user (patient) opens the confirmation email sent to them and clicks on the activation link.

[0137] Input: Link in confirmation email

[0138] Output: Account activation request

[0139] Step 4:

[0140] The server verifies the validity of the link and activates the account, allowing the user to log in and access their profile page.

[0141] Input: Account activation request

[0142] Output: Activated accounts

[0143] Step 5:

[0144] The user (patient) logs in and uploads files of past health checkup information and medical history data.

[0145] Input: Health checkup information and medical history data

[0146] Output: Data upload request

[0147] Step 6:

[0148] The server encrypts the received file and stores it in a database.

[0149] Input: Data upload request

[0150] Output: Encrypted database entries

[0151] 2. Real-time data update app

[0152] Step 1:

[0153] During medical treatment, the user (healthcare provider) launches a dedicated app and enters the patient's basic information, symptoms, and diagnosis results into a medical data input form.

[0154] Input: Patient basic information, symptoms, diagnosis

[0155] Output: Medical data entry request

[0156] Step 2:

[0157] The terminal transmits the input data to the server.

[0158] Input: Medical data input request

[0159] Output: Medical data transmission request

[0160] Step 3:

[0161] The server analyzes the received data, registers the correct location, and updates the patient's account information.

[0162] Input: Medical data transmission request

[0163] Output: Updated patient data

[0164] Step 4:

[0165] The user (patient) logs in to their account and checks medical data updated in real time on the app.

[0166] Input: Login request

[0167] Output: Displayed update data

[0168] 3. AI-Supported Medical Treatment Guide

[0169] Step 1:

[0170] The server inputs the collected past medical data into the generative AI model.

[0171] Input: Past medical data

[0172] Output: Parse request

[0173] Step 2:

[0174] A generative AI model analyzes the data and generates diagnostic suggestions based on the latest medical guidelines.

[0175] Input: Parse request

[0176] Output: Diagnostic suggestions

[0177] Step 3:

[0178] The server maintains the generated diagnostic suggestions within the system and provides them to healthcare providers.

[0179] Input: Diagnostic suggestion

[0180] Output: Diagnostic suggestion display request

[0181] Step 4:

[0182] The user (healthcare provider) logs into the platform and checks the diagnostic suggestions generated by the AI.

[0183] Input: Login request

[0184] Output: Displayed diagnostic suggestions

[0185] For example, you might input the following prompt into a generative AI model:

[0186] "A 40-year-old man has been diagnosed with diabetes and high blood pressure in the past. His current symptoms are frequent urination and mild chest pain. I would like a diagnosis based on his blood sugar and blood pressure data from the past year."

[0187] 4. Patient Empowerment App

[0188] Step 1:

[0189] The user (patient) uses a dedicated app to enter daily health data (e.g., weight, blood pressure, exercise records).

[0190] Input: Health data

[0191] Output: Data entry request

[0192] Step 2:

[0193] The server periodically updates the entered data to reflect the patient's profile.

[0194] Input: Data Entry Request

[0195] Output: Updated profile data

[0196] Step 3:

[0197] A generative AI model analyzes the latest input data and generates a health management plan.

[0198] Input: Updated profile data

[0199] Output: Health management plan proposal

[0200] Step 4:

[0201] The user (patient) receives and executes a health management plan through the app.

[0202] Input: Health Care Plan Proposal

[0203] Output: Implemented health care plan

[0204] Step 5:

[0205] The user (patient) sends inquiries or questions to the healthcare provider through the app.

[0206] Input: Consultation details

[0207] Output: Consultation request

[0208] Step 6:

[0209] The server notifies the medical provider of the consultation details and takes the necessary action.

[0210] Input: Consultation request

[0211] Output: Notifications and their responses

[0212] The above are the specific processing steps and operations of this system.

[0213] (Application example 1)

[0214] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0215] Conventional medical platforms lack sufficient information sharing between patients and healthcare providers, making it difficult to update health data in real time or provide appropriate advice. Communication with pharmacists in brick-and-mortar stores is particularly limited, resulting in a lack of consistent support for patients' health management. This has led to issues such as patients being unable to receive the medical services they need accurately and in a timely manner.

[0216] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0217] In this invention, the server includes a means for a user to create an account and upload medical information and health history, a means for a healthcare provider to securely access and confirm patient information in advance, a means for the user and healthcare provider to share medical data online, and a means for a pharmacist at a store to share health data with the patient and provide advice in real time, thereby enabling effective and prompt information sharing between the patient, healthcare provider, and in-store pharmacist, and enabling appropriate advice to be provided.

[0218] "User" means an individual who creates an account and manages their own health information and medical history.

[0219] "Healthcare Provider" means a professional who is authorized to access a patient's medical data and to diagnose and treat the patient.

[0220] "Medical information" refers to data about a patient's health condition and treatment that is recorded by a doctor or other healthcare provider.

[0221] "Health history" refers to the overall record of a patient's past medical treatments and medical examinations.

[0222] "Uploading" refers to the act of a user sending and storing their own data on an online platform.

[0223] "Access" means that a healthcare provider has the authority or means to view a patient's data.

[0224] "Real-time updates" means that data is updated immediately and is always up-to-date.

[0225] "Store" means a physical retail establishment, such as a drugstore or pharmacy.

[0226] A "pharmacist" is a professional who dispenses and sells medicines and provides appropriate medication and health advice to patients.

[0227] "Artificial intelligence (AI)" refers to a computer system that automatically analyzes and makes decisions based on large amounts of data.

[0228] "Diagnostic suggestions" refers to treatment and diagnostic recommendations generated by AI based on analysis results and the latest medical guidelines.

[0229] A "smartphone" refers to a mobile phone that can connect to the Internet and use multifunctional applications.

[0230] This invention provides a system that allows users to create an account, centrally manage their medical information and health history, and smoothly share information with healthcare providers. This system places emphasis on communication with pharmacists in physical stores.

[0231] The program to realize this system uses the following hardware and software.

[0232] Hardware and software used

[0233] Smartphone: A device that allows users to create an account and manage their health data.

[0234] Server: A central system that securely stores and shares user data with healthcare providers and pharmacists.

[0235] Provider application: Software that allows providers to enter and update clinical data in real time.

[0236] Pharmacist application: Software that allows pharmacists in physical stores to view patient data in real time and suggest appropriate advice and medications.

[0237] Artificial intelligence (AI) systems: Software used to analyze collected patient data and generate diagnostic suggestions.

[0238] Data processing and calculation

[0239] The server performs the following data processing and calculations:

[0240] 1. Create a user account and upload data:

[0241] Users create an account using their smartphone and upload their medical information and health history to the server, where the data is encrypted and stored securely.

[0242] 2. Real-time data updates and sharing:

[0243] Healthcare providers use a dedicated application to enter medical data and send it to a server, which updates the data in real time and associates it with the patient's account.

[0244] 3. Data sharing and advice in physical stores:

[0245] Pharmacists use a dedicated application to view patients' health data in real time, allowing them to provide appropriate medications and health advice.

[0246] 4. AI-based diagnostic suggestions:

[0247] The collected medical data is analyzed by the AI ​​system to generate diagnostic suggestions, which are then provided to healthcare providers to help them develop appropriate treatment plans.

[0248] Specific examples

[0249] 1. Patient B interacts with a pharmacist at a drugstore:

[0250] Patient B uses his / her smartphone to enter his / her health data (e.g., blood pressure, weight, medication history, etc.) into the application and uploads it to the server.

[0251] The pharmacist opens a dedicated application and views Patient B's health data in real time. Based on this data, the pharmacist provides advice on appropriate medications and lifestyle habits. The information entered by the pharmacist is immediately sent to the server, and Patient B's data is updated.

[0252] 2. Example prompt for the generative AI model:

[0253] My name is B and my health data for the past month is as follows:

[0254] Weight: 70kg

[0255] Blood pressure: 130 / 80

[0256] Health checkup revealed: High blood sugar level

[0257] Based on this data, please give me some health advice and recommended supplements. Also, please let me know if there are any points I should check.

[0258] By implementing the invention in this manner, effective information sharing between patients, healthcare providers, and pharmacists is achieved, enabling appropriate advice to be received promptly.

[0259] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0260] Step 1:

[0261] Users create accounts and upload medical information and health histories

[0262] Input: Your name, email address, password, and medical and health history data

[0263] How it works: A user accesses the account creation screen on a dedicated application using a smartphone. They enter their name, email address, and password and press the Create Account button. They then upload their medical information and past health history to the application.

[0264] Data processing: Information entered on the terminal is encrypted.

[0265] Output: The encrypted data is sent to the server and stored securely in a database.

[0266] Step 2:

[0267] Your healthcare provider will have access to your account and will review it in advance.

[0268] Input: Provider credentials and access credentials

[0269] How it works: A healthcare provider logs into a dedicated application and enters their credentials, which the server authenticates and grants the healthcare provider access.

[0270] Data calculation: The server finds the user's account information based on the received access authentication information and generates a token for secure access.

[0271] Output: Healthcare providers can access and proactively review patient medical information and health history.

[0272] Step 3:

[0273] Users and healthcare providers share medical data online

[0274] Input: User and provider credentials, clinical data

[0275] How it works: Users use their smartphones to enter medical data and send it to a server, while healthcare providers also enter data using a dedicated application.

[0276] Data processing: The server associates both sets of data with the corresponding user accounts and updates the database in real time.

[0277] Output: Updated clinical data is accessible in real time to both users and healthcare providers.

[0278] Step 4:

[0279] In-store pharmacists share health data with patients and provide real-time advice

[0280] Input: Patient health data, pharmacist credentials

[0281] How it works: Pharmacists log in to a dedicated application to access patient health data, conduct face-to-face consultations with patients, and provide appropriate medications and advice in real time based on the health data.

[0282] Data calculation: The server associates the advice entered by the pharmacist with the patient account and updates the data.

[0283] Output: Patients can check the pharmacist's advice in real time on their smartphones.

[0284] Step 5:

[0285] AI analyzes the collected data and generates diagnostic suggestions

[0286] Inputs: Patient medical data, health history, latest medical guidelines

[0287] How it works: The server inputs collected patient data into the AI ​​system, analyzes the data based on medical guidelines, and the AI ​​follows a process to generate diagnostic suggestions and makes an appropriate diagnosis.

[0288] Data computation: The AI ​​system analyzes the data and generates new diagnostic suggestions based on the generative AI model used.

[0289] Output: The generated diagnostic suggestions are provided to the healthcare provider to help develop an appropriate treatment plan.

[0290] Step 6:

[0291] Patients can check AI-generated health advice on their smartphones

[0292] Input: AI-generated diagnostic suggestions and health advice

[0293] How it works: The server sends the AI-generated diagnostic suggestions to the user's smartphone app. The user opens the app and checks the health advice and diagnostic suggestions provided by the AI.

[0294] Data processing: The server associates the diagnostic proposal with the user account and sends it.

[0295] Output: Users can instantly check diagnostic suggestions on their smartphones and use them to help manage their daily health.

[0296] In this way, the system is realized through the specific process steps of the invention.

[0297] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0298] The present invention provides a system for efficiently sharing medical information between medical providers and patients, and for recognizing the emotional state of patients to further improve the medical process. Hereinafter, embodiments of the present invention will be described in detail.

[0299] 1. Electronic medical record sharing platform

[0300] Creating a user account and uploading information

[0301] User (Patient): Accesses the system and creates a new account. Enters name, email address, and password, receives a confirmation email to activate the account, and then uploads past medical examination information and medical history data to the system.

[0302] Server: Encrypts and stores user account information and uploaded data, granting access to healthcare providers as needed. Data is stored securely and can be accessed by both users and healthcare providers when needed.

[0303] 2. Real-time data update app

[0304] Real-time data entry and sharing during medical treatment

[0305] User (healthcare provider): Uses a dedicated app during consultation and inputs patient medical data in real time, such as blood pressure, electrocardiogram results, and findings.

[0306] Terminal (provider's device): The entered data is immediately sent to the server.

[0307] Server: Rapidly updates the received data and associates it with the patient's account, so that the data is displayed in real time and can be viewed and reviewed by the patient at the same time.

[0308] 3. AI-Supported Medical Treatment Guide

[0309] Analysis of medical data and diagnostic suggestions

[0310] Server: Collected past and current medical data is input into the AI ​​system, which then analyzes the data. The AI ​​then generates diagnostic suggestions based on the latest medical guidelines.

[0311] User (healthcare provider): Logs in to the platform and checks the diagnostic suggestions generated by the AI. Based on these suggestions, the user can develop an appropriate medical treatment and treatment plan.

[0312] 4. Patient Empowerment App

[0313] Managing health data and taking preventative measures

[0314] User (patient): Uses the app to input and manage daily health data, including weight, blood pressure, and exercise records.

[0315] Server: Updates patient data periodically and provides timely health care plans.

[0316] Patient Actions: Maintain and improve the patient's health by following the plan provided by the app and carrying out daily health management.

[0317] 5. Emotion engine integration

[0318] User sentiment analysis and notification

[0319] User (patient): Uses the app to input health data and emotional feedback. Emotional data is also collected through voice and facial recognition.

[0320] Terminal (patient's device): Sends collected emotion data to the server.

[0321] Server: The emotion engine analyzes the emotion data and evaluates the patient's emotional state. The result of this evaluation is then sent to the healthcare provider.

[0322] User (healthcare provider): Receives notifications from the emotion engine and conducts consultations while taking into account the patient's emotional state. If necessary, provides counseling or medical advice to the patient.

[0323] Specific examples

[0324] To give a specific example, patient A creates a new account in the system and uploads his or her past medical information. When visiting healthcare provider B for a regular checkup, B uses a dedicated app to enter the medical data and updates the results in real time. The AI ​​system analyzes A's data and provides diagnostic suggestions based on the latest medical guidelines. A manages his or her own health data through the app and improves lifestyle habits according to a health management plan. In addition, the emotion engine analyzes A's voice and facial expressions and notifies healthcare provider B of his or her emotional state, such as stress or anxiety. B then provides appropriate counseling and advice.

[0325] The system enables efficient information sharing between patients and healthcare providers and utilizes an emotion engine to comprehensively manage patients' physical and mental health.

[0326] The processing flow will be explained below.

[0327] Processing steps of the electronic medical record sharing platform

[0328] Step 1: Create a user account

[0329] User: Accesses the platform, enters their name, email address and password in the registration form and presses the "Create Account" button.

[0330] Server: Receives registration information and stores it in a database. Generates and sends a confirmation email to the user's email address.

[0331] Users: Click the link in the confirmation email they receive to activate their account.

[0332] Step 2: Upload your medical information and health history

[0333] User: After logging in, select the file containing past medical information and health history and press the "Upload" button.

[0334] Server: Receives the file, encrypts the data, stores it in the database, and notifies the user when the data has been saved.

[0335] Step 3: Provider Access

[0336] User (healthcare provider): Logs in to the platform with a dedicated account.

[0337] Server: Verifies the healthcare provider's authorization and provides accessible patient data.

[0338] User (healthcare provider): View the patient's past medical information and understand the information necessary for treatment in advance.

[0339] Processing steps of the real-time data update app

[0340] Step 1: Enter your medical data

[0341] User (healthcare provider): Uses a dedicated app during consultation to input patient medical results, such as blood pressure, electrocardiogram results, and other findings, in real time.

[0342] Terminal (provider's device): The entered data is immediately sent to the server.

[0343] Step 2: Update and notify data

[0344] Server: Immediately updates the received medical data in the database and associates it with the patient's account. Sends a notification to the user (healthcare provider) that the update is complete.

[0345] User (Patient): Logs in to the app and checks medical data updated in real time. Data can be checked immediately after the consultation.

[0346] AI-supported medical treatment guide processing steps

[0347] Step 1: Collect and analyze medical data

[0348] Server: Inputs the patient's past and current medical data into the AI ​​system.

[0349] AI system: Analyzes data and generates diagnostic suggestions based on the latest medical guidelines.

[0350] Step 2: Providing diagnostic suggestions

[0351] Server: Sends AI-generated diagnostic suggestions to healthcare provider accounts.

[0352] User (healthcare provider): Logs in to the platform, checks the AI's diagnostic suggestions, and uses the suggestions to diagnose the patient.

[0353] Patient Empowerment App Processing Steps

[0354] Step 1: Enter and manage your health data

[0355] User (patient): Logs in to the app and enters daily health data (weight, blood pressure, diet, exercise, etc.).

[0356] Terminal (patient's device): Sends the entered data to the server.

[0357] Step 2: Provide a health care plan

[0358] Server: Analyzes the patient's health data, generates preventative measures and health management plans, and sends the plans to the patient's account.

[0359] User (patient): Check the health management plan provided through the app and incorporate it into their daily life.

[0360] Step 3: Collaborate with your healthcare provider

[0361] Users (patients): If they have health questions or concerns, they can contact their healthcare provider through the app.

[0362] User (healthcare provider): Responds to patient questions and provides necessary advice and treatment plans.

[0363] Emotion Engine Processing Steps

[0364] Step 1: Collecting emotion data

[0365] User (patient): Uses the app to input health data and emotional feedback. Emotional data is recorded using voice input and facial recognition.

[0366] Terminal (patient's device): Sends collected emotion data to the server.

[0367] Step 2: Analyze the emotion data

[0368] Server: Analyzes the transmitted emotion data using the emotion engine, assessing the emotional state (e.g., stress, joy, anxiety).

[0369] Step 3: Informing and leveraging emotion data

[0370] Server: Sends analysis results to the healthcare provider's account, including a detailed assessment of the patient's emotional state.

[0371] User (healthcare provider): Based on the notification, understand the patient's emotional state and use it as a reference for medical treatment and counseling. If necessary, provide additional counseling or medical advice to the patient.

[0372] Through these processing steps, the Health Quality Connect system enables efficient data sharing between patients and healthcare providers, diagnostic support using AI, and comprehensive health management through the use of an emotion engine.

[0373] Example 2

[0374] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0375] In modern medical settings, efficient sharing of medical information between patients and healthcare providers is important, but information sharing is often not smooth. Furthermore, there is a lack of means to accurately grasp a patient's emotional state and provide appropriate medical treatment and counseling based on that information. Furthermore, there is a need for a system that can efficiently manage daily health data and provide appropriate health management plans.

[0376] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for a user to create an account and upload medical information and health history; a means for a healthcare provider to securely access and confirm patient information in advance; a means for a user and a healthcare provider to share medical data online; a means for inputting the user's emotional data and transmitting it to the server via a terminal; and a means for an artificial intelligence (AI) to analyze the emotional data and notify the healthcare provider of the results. This enables efficient sharing of medical information and provision of detailed medical care that takes the patient's emotional state into consideration. The system also includes: a means for a healthcare provider to input patient data in real time during medical care; a means for updating the shared medical data in real time and providing it to the patient and healthcare provider; a means for an AI to analyze the medical data and generate a diagnostic suggestion based on the latest medical guidelines; and a means for providing the generated diagnostic suggestion to the healthcare provider. This results in improved quality of medical care and faster diagnostic suggestions. The system also includes: a means for a user to input daily health data and transmit it to the server; and a means for the server to periodically update the health data and provide a health management plan. This will make daily health management more efficient and is expected to help maintain and improve patients' health.

[0377] "User" refers to a person who accesses the system, creates an account, and uploads medical information and health history.

[0378] "Healthcare provider" refers to a professional who provides medical treatment and counseling to patients, who accesses patient information through the system, and who inputs and checks medical data.

[0379] "Server" refers to a computer system that stores data entered by users and healthcare providers and analyzes and updates the data as needed.

[0380] "Account creation" refers to the process by which a new user accessing the system enters information such as name, email address, and password and registers with the system.

[0381] "Medical information" refers to all data related to medical treatment, such as patient medical records, test results, and treatment history.

[0382] "Health history" refers to all records related to a patient's health status, including past medical examination results and medical history.

[0383] "Upload" refers to the act of a user sending data from their local device to the system.

[0384] "Online medical data sharing" refers to a state in which users and medical providers can check and update medical data in real time via the Internet.

[0385] "Emotional data" refers to information that indicates a patient's emotional state, and is collected through self-input feedback or through voice and facial recognition.

[0386] "Terminal" refers to the device (e.g., smartphone, tablet, or PC) used by a user or healthcare provider to access the system.

[0387] "Artificial intelligence" refers to computer programs that contain machine learning algorithms to analyze input data and provide diagnostic suggestions or assessments of emotional states.

[0388] "Diagnostic suggestions" refers to the presentation of recommendations regarding medical examinations and treatments based on data analyzed by artificial intelligence.

[0389] "Health data" refers to various data related to a patient's health condition, such as daily weight, blood pressure, and exercise records.

[0390] A "health management plan" refers to providing a plan based on collected health data that includes appropriate preventive measures and instructions for lifestyle improvements.

[0391] The present invention provides a system for enabling users and healthcare providers to efficiently share medical information and recognize the emotional state of patients to improve the medical process. Hereinafter, embodiments of the present invention will be described in detail.

[0392] 1. Electronic medical record sharing platform

[0393] Creating a user account and uploading information

[0394] User (Patient):

[0395] A user accesses the system and clicks the "Create a new account" button. Next, they enter their name, email address, and password in the form to create an account. Once the account is created, a confirmation email is sent to the user's email address. The user clicks the link in the email to activate the account. After that, they upload past health checkup results and medical history data to the system. For example, they select a PDF or image file and click the "Upload" button.

[0396] server:

[0397] The server encrypts the entered account information and stores it in a database. All data uploaded by users is also encrypted and stored securely, with appropriate access rights set to allow healthcare providers to access it as needed.

[0398] 2. Real-time data update app

[0399] Real-time data entry and sharing during medical treatment

[0400] User (healthcare provider):

[0401] During consultations, healthcare providers open a dedicated app and input patient data in real time, including blood pressure, electrocardiogram results, and clinical findings.

[0402] Terminal (provider device):

[0403] The device immediately sends this data to the server. The data is sent by clicking the "Send" button in the app.

[0404] server:

[0405] The server rapidly updates the received data with the corresponding patient account information, making the data visible to both patients and healthcare providers in real time.

[0406] 3. AI-Supported Medical Treatment Guide

[0407] Analysis of medical data and diagnostic suggestions

[0408] server:

[0409] The server collects past and current medical data and inputs it into an artificial intelligence (AI) system, which generates diagnostic suggestions based on the latest medical guidelines.

[0410] User (healthcare provider):

[0411] Healthcare providers log in to the platform and view diagnostic suggestions generated by the AI, which they then use to develop optimal treatment plans.

[0412] 4. Patient Empowerment App

[0413] Managing health data and taking preventative measures

[0414] User (Patient):

[0415] Users use the app to input their daily health data, including weight, blood pressure, exercise records, etc. The data is saved by pressing the "Save" button.

[0416] server:

[0417] The server periodically updates this data and provides users with appropriate health management plans, such as suggesting specific exercise plans based on data indicating a lack of exercise.

[0418] 5. Emotion engine integration

[0419] User sentiment analysis and notification

[0420] User (Patient):

[0421] Users input their emotional feedback within the app, and emotional data is automatically collected using voice and facial recognition.

[0422] Terminal (patient device):

[0423] The device transmits the collected emotion data to the server.

[0424] server:

[0425] The server analyzes the emotion data using an emotion engine and notifies the healthcare provider of the results of the emotion assessment.

[0426] User (healthcare provider):

[0427] Healthcare providers receive notifications from the emotion engine and take the patient's emotional state into consideration as they conduct consultations, providing counseling and appropriate medical advice as needed.

[0428] Specific examples

[0429] Patients create a new account on the system and upload their past medical information. During regular checkups, healthcare providers use a dedicated app to enter medical data and update results in real time. The AI ​​system analyzes the data and generates diagnostic suggestions based on the latest medical guidelines. Patients manage their health data through the app and work to improve their lifestyle based on a health management plan. In addition, an emotion engine analyzes voice and facial expression data and notifies healthcare providers of stress and anxiety. Healthcare providers then provide appropriate counseling and advice to the patient.

[0430] Examples of suitable prompts for the AI ​​model

[0431] "Please explain in detail how a system allows you to upload a patient's past medical records and use AI to generate diagnostic suggestions based on the latest medical guidelines."

[0432] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0433] Electronic medical record sharing platform

[0434] Creating a user account and uploading information

[0435] Step 1:

[0436] User (patient): The user accesses the system and clicks the "Create a new account" button. Input includes name, email address, and password. Enter this information and press the "Submit" button.

[0437] Input: Name, Email Address, Password

[0438] Output: Send information to the server

[0439] Step 2:

[0440] Server: The server automatically generates a confirmation email based on the received information and sends it to the user's email address. The user clicks on the link in the email to activate their account.

[0441] Input: User's name, email address, and password

[0442] Data processing: Confirmation email generation

[0443] Output: Send confirmation email

[0444] Step 3:

[0445] User (Patient): After the account is activated, the user uploads their past medical examination information and medical history data to the system, for example, by selecting a PDF file or image file and clicking the "Upload" button.

[0446] Input: Health checkup information, medical history data

[0447] Output: Send data to the server

[0448] Step 4:

[0449] Server: The server encrypts the uploaded data and stores it in a secure database, granting access rights to healthcare providers as needed.

[0450] Input: Uploaded medical examination information, medical history data

[0451] Data processing: Data encryption

[0452] Output: Data stored in a secure database

[0453] Real-time data update app

[0454] Real-time data entry and sharing during medical treatment

[0455] Step 1:

[0456] User (healthcare provider): The healthcare provider opens the dedicated app and inputs the patient's medical data (blood pressure, electrocardiogram results, findings, etc.) in real time. After inputting, he / she presses the "Send" button.

[0457] Input: Medical data

[0458] Output: Data input to the terminal

[0459] Step 2:

[0460] Terminal (provider's device): The terminal immediately transmits the entered data to the server. This process occurs in real time using a network connection.

[0461] Input: Medical data

[0462] Output: Send data to the server

[0463] Step 3:

[0464] Server: The server rapidly updates the received data and associates it with the appropriate patient account, making the data available in real time and accessible to patients via their own devices.

[0465] Input: Medical data

[0466] Data processing: Data update

[0467] Output: Save and display the updated data

[0468] AI-supported medical treatment guide

[0469] Analysis of medical data and diagnostic suggestions

[0470] Step 1:

[0471] Server: The server inputs collected past and current medical data into the AI ​​system.

[0472] Input: Past and current medical data

[0473] Output: Sending data to an AI system

[0474] Step 2:

[0475] AI system: AI generates diagnostic suggestions based on the latest medical guidelines and past clinical data.

[0476] Input: Clinical data and medical guidelines

[0477] Data processing: Data analysis and generation of diagnostic suggestions

[0478] Output: Diagnostic suggestions

[0479] Step 3:

[0480] User (healthcare provider): The healthcare provider logs in to the platform and checks the diagnostic suggestions generated by the AI. Based on these suggestions, the healthcare provider decides on the final treatment plan.

[0481] Input: Diagnostic suggestion

[0482] Output: Treatment plan

[0483] Patient Empowerment App

[0484] Managing health data and taking preventative measures

[0485] Step 1:

[0486] User (patient): The user uses the app to enter daily health data (weight, blood pressure, exercise records, etc.), enters the data, and presses the "Save" button.

[0487] Input: Health data

[0488] Output: Data input to the app

[0489] Step 2:

[0490] Server: The server periodically updates and securely stores the entered data.

[0491] Input: Health data

[0492] Data processing: updating and saving data

[0493] Output: Save the updated data

[0494] Step 3:

[0495] Server: The server performs health checks based on the recorded data and provides appropriate health management plans. For example, it suggests specific exercise plans if the user is not getting enough exercise.

[0496] Input: Updated health data

[0497] Data processing: generating health management plans

[0498] Output: Healthcare plan

[0499] Emotion engine integration

[0500] User sentiment analysis and notification

[0501] Step 1:

[0502] User (patient): The user enters their own emotional feedback within the app. In addition, emotional data is automatically collected using voice and facial recognition.

[0503] Input: Emotional feedback, voice data, facial expression data

[0504] Output: Data input to the app

[0505] Step 2:

[0506] Terminal (patient's device): The terminal transmits the collected emotion data to the server.

[0507] Input: Emotion data

[0508] Output: Send data to the server

[0509] Step 3:

[0510] Server: The server uses an emotion engine to analyze the emotion data and evaluate the emotional state.

[0511] Input: Emotion data

[0512] Data processing: Emotion data analysis

[0513] Output: Sentiment rating

[0514] Step 4:

[0515] Server: The server notifies the healthcare provider of the results of the emotion assessment.

[0516] Input: Emotion rating

[0517] Output: Notification of emotion evaluation result

[0518] Step 5:

[0519] User (healthcare provider): The healthcare provider receives notifications from the emotion engine and examines the patient while taking into account their emotional state. If necessary, they provide counseling or appropriate medical advice.

[0520] Input: Emotion evaluation result

[0521] Output: consultation plan, counselling and medical advice

[0522] (Application example 2)

[0523] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0524] With conventional systems, it was difficult to grasp the emotional state of patients and customers in real time in medical and customer service settings, making it difficult to respond appropriately and quickly. This made it difficult to provide services that met individual needs, and improving customer satisfaction was an issue.

[0525] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a user to create an account and upload medical information and health history, a means for a healthcare provider to securely access and confirm patient information in advance, a means for the user and healthcare provider to share medical data online, a means for capturing a customer's facial expression using smart glasses and analyzing their emotions, and a means for storing the analyzed customer's emotional data in a database and making service suggestions. This makes it possible to grasp the customer's emotional state in real time and suggest appropriate services based on that.

[0526] A "user account" is individual identification information assigned to each user who uses the system.

[0527] "Medical information" is health-related data collected by healthcare providers, such as patient consultations and medical records.

[0528] "Health history" refers to records relating to an individual's health, including the patient's past medical examination results, medical history, and treatment history.

[0529] "Healthcare providers" are professionals who provide health care services, such as doctors, nurses, and pharmacists.

[0530] "Online" medical data sharing refers to the ability to view and update patient information in real time via the Internet.

[0531] "Smart glasses" are eyeglass-type wearable devices worn by users that have camera and display functions.

[0532] "Customer's facial expression" is information that indicates the emotional state through changes in facial expression.

[0533] "Emotion analysis" is the process of identifying individual emotional states from facial expressions and vocal acoustic patterns using image processing techniques and machine learning.

[0534] A "database" is a system for storing and managing data in digital form, and is a means for quickly retrieving data when needed.

[0535] A "service proposal" is a specific proposal to provide appropriate products or services based on the customer's needs and emotional state.

[0536] "Real-time" refers to instant data transmission and processing without delay, meaning that current information is reflected and processed immediately.

[0537] "Artificial intelligence (AI)" is a technology that enables computer systems to mimic human intelligence and learn, reason, perceive, and make decisions.

[0538] The present invention provides a system that efficiently shares medical information between healthcare providers and patients, recognizes patients' emotional states, and further improves the medical process. It also integrates emotion recognition and service suggestion functions using smart glasses to improve customer service in brick-and-mortar stores.

[0539] 1. Overview of the entire system

[0540] The system includes the following main measures:

[0541] A means for users to create accounts and upload medical information and health history

[0542] A means for healthcare providers to securely access and proactively review patient information

[0543] A means for users and healthcare providers to share medical data online

[0544] A method to capture customer facial expressions and analyze their emotions using smart glasses

[0545] A means of storing analyzed customer emotion data in a database and making service suggestions

[0546] 2. Hardware and Software Used

[0547] The system uses the following hardware and software:

[0548] Hardware:

[0549] Smart glasses (e.g. Google Glass)

[0550] Camera (built into smart glasses)

[0551] Server (operating database and AI model)

[0552] Devices (used by healthcare providers and store employees)

[0553] software:

[0554] OpenCV (camera operation and image processing)

[0555] Keras (emotion recognition model)

[0556] TensorFlow (deep learning such as sentiment analysis)

[0557] SQLite (database management)

[0558] 3. Data processing and calculation procedures

[0559] The server acquires facial expression data captured by the smart glasses and performs emotion analysis using natural language processing and image processing technologies. This involves camera operation and image processing using OpenCV, and deep learning models using Keras and TensorFlow. The analysis results are stored in an SQLite database, and service proposals for the customer are generated at specific times and displayed on the smart glasses display.

[0560] 4. Specific Examples

[0561] For example, while a customer is browsing products in a physical store, a salesperson wearing smart glasses can capture the customer's face and analyze their emotions in real time. If the customer is smiling, the system will display a notification on the salesperson's smart glasses saying, "Please suggest a new promotion." On the other hand, if the customer is sad, the system will suggest, "Provide special service." This entire process is appropriately carried out by the analysis of an AI model.

[0562] 5. Example prompts to be input to the generative AI model

[0563] "Develop an application that uses smart glasses to assist in customer service in brick-and-mortar stores. This application will provide optimal service to customers by capturing customer facial expressions in real time and analyzing their emotional state. Specifically, the application will take a photo of the customer's face with a camera, analyze the results with an emotion recognition model, and store the results in an SQLite database. Based on the analysis results, the application will suggest appropriate services to staff."

[0564] This system is expected to improve customer service in brick-and-mortar stores, and also to streamline medical procedures and empower patients in medical settings.

[0565] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0566] Step 1:

[0567] The server creates user accounts and uploads medical information and health history. Users access the system, create an account, enter their name, email address, and password, and receive a confirmation email to activate their account. They then upload past medical examination information and medical history data to the system. The server encrypts and stores the uploaded data, allowing secure access to healthcare providers.

[0568] Step 2:

[0569] The device inputs patient data in real time during medical examinations and sends it to a server. Healthcare providers use a dedicated app to input patient medical data (e.g., blood pressure, electrocardiogram results, findings, etc.) in real time. The input data is immediately sent to the server, which stores the data in a database and updates it promptly.

[0570] Step 3:

[0571] The server analyzes the collected data using artificial intelligence (AI) and generates a diagnostic suggestion. The server inputs the collected past and current medical data into the AI ​​system, which then analyzes the data. The AI ​​generates a diagnostic suggestion based on the latest medical guidelines and provides the results to healthcare providers.

[0572] Step 4:

[0573] The device captures the customer's facial expression through the smart glasses and sends the data to the server.The smart glasses' camera captures the customer's face and sends it to the server as image data.

[0574] Step 5:

[0575] The server analyzes the image data and determines the customer's emotional state. The received image data is preprocessed using OpenCV and analyzed using an emotion recognition model using Keras and TensorFlow. The emotional state (e.g., happy, sad, surprised, etc.) is determined.

[0576] Step 6:

[0577] The server saves the analysis results in a database and generates appropriate service proposals. The analyzed emotion data is stored in an SQLite database and appropriate service proposals are generated based on the customer's state. For example, if the customer is determined to be happy, a proposal such as "Propose a new promotion" is generated, and if the customer is determined to be sad, a proposal such as "Provide a special service" is generated.

[0578] Step 7:

[0579] The device notifies the smart glasses of the proposed service, which then displays the notification of the proposed service sent from the server, allowing store employees to provide the service to the customer at the appropriate time.

[0580] Through the above steps, the present invention realizes a system that improves medical and brick-and-mortar store services.

[0581] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0582] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0583] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0584] [Second embodiment]

[0585] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0586] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0587] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0588] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0589] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0590] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0591] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0592] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0593] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0594] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0595] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0596] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0597] The present invention provides a platform that allows users to centrally manage their personal health data and efficiently share information with healthcare providers. The following is a detailed description of embodiments of the present invention.

[0598] 1. Electronic medical record sharing platform

[0599] Creating a user account and uploading information

[0600] User (Patient): Accesses the system and creates a new account. Enters name, email address, and password, receives a confirmation email to activate the account, and then uploads past medical examination information and medical history data to the system.

[0601] Server: Encrypts and stores user account information and uploaded data, granting access to healthcare providers as needed. Data is stored securely and can be accessed by both users and healthcare providers when needed.

[0602] 2. Real-time data update app

[0603] Real-time data entry and sharing during medical treatment

[0604] User (healthcare provider): Uses a dedicated app during consultation to input patient medical data in real time. The input data is immediately sent to the system.

[0605] Server: Rapidly updates the received data and associates it with the patient's account, so that the data is displayed in real time and can be viewed and reviewed by the patient at the same time.

[0606] 3. AI-Supported Medical Treatment Guide

[0607] Analysis of medical data and diagnostic suggestions

[0608] Server: Collected past medical data is input into the AI ​​system and analyzed. The AI ​​then generates diagnostic suggestions based on the latest medical guidelines.

[0609] User (healthcare provider): Logs in to the platform and checks the diagnostic suggestions generated by the AI. Based on these suggestions, the user can develop an appropriate medical treatment and treatment plan.

[0610] 4. Patient Empowerment App

[0611] Managing health data and taking preventative measures

[0612] User (patient): Uses the app to input and manage daily health data, including weight, blood pressure, and exercise records.

[0613] Server: Updates patient data periodically and provides timely health care plans.

[0614] Patient actions: Carry out daily health management according to the plan provided by the app. If necessary, the patient can consult and exchange opinions with their healthcare provider through the app.

[0615] Specific examples

[0616] To give a specific example, patient A creates a new account on the platform and uploads his or her past medical history. A then visits healthcare provider B for a regular checkup. B uses a dedicated app to input the medical data and updates A's data in real time with the results. The AI ​​system analyzes A's past data and generates diagnostic suggestions based on the medical guidelines, which are then provided to B. A can manage his or her own health data through the app and follow the submitted health management plan to live a healthier life.

[0617] In this way, the present invention can realize effective information sharing between patients and healthcare providers, improving the quality of medical care. It can also improve diagnostic accuracy by utilizing AI.

[0618] The processing flow will be explained below.

[0619] Processing steps of the electronic medical record sharing platform

[0620] Step 1: Create a user account

[0621] User: Accesses the platform, enters their name, email address and password in the registration form and presses the "Create Account" button.

[0622] Server: Receives registration information and stores it in a database. Generates and sends a confirmation email to the user's email address.

[0623] Users: Click the link in the confirmation email they receive to activate their account.

[0624] Step 2: Upload your medical information and health history

[0625] User: After logging in, select the file containing past medical information and health history and press the "Upload" button.

[0626] Server: Receives the file, encrypts the data, stores it in the database, and notifies the user when the data has been saved.

[0627] Step 3: Provider Access

[0628] User (healthcare provider): Logs in to the platform with a dedicated account.

[0629] Server: Verifies the healthcare provider's authorization and provides accessible patient data.

[0630] User (healthcare provider): View the patient's past medical information and understand the information necessary for treatment in advance.

[0631] Processing steps of the real-time data update app

[0632] Step 1: Enter your medical data

[0633] User (healthcare provider): Uses a dedicated app during consultation to input patient medical results, such as blood pressure, electrocardiogram results, and other findings, in real time.

[0634] Terminal (provider's device): The entered data is immediately sent to the server.

[0635] Step 2: Update and notify data

[0636] Server: Immediately updates the received medical data in the database and associates it with the patient's account. Sends a notification to the user (healthcare provider) that the update is complete.

[0637] User (Patient): Logs in to the app and checks medical data updated in real time. Data can be checked immediately after the consultation.

[0638] AI-supported medical treatment guide processing steps

[0639] Step 1: Collect and analyze medical data

[0640] Server: Inputs the patient's past and current medical data into the AI ​​system.

[0641] AI system: Analyzes data and generates diagnostic suggestions based on the latest medical guidelines.

[0642] Step 2: Providing diagnostic suggestions

[0643] Server: Sends AI-generated diagnostic suggestions to healthcare provider accounts.

[0644] User (healthcare provider): Logs in to the platform, checks the AI's diagnostic suggestions, and uses the suggestions to diagnose the patient.

[0645] Patient Empowerment App Processing Steps

[0646] Step 1: Enter and manage your health data

[0647] User (patient): Logs in to the app and enters daily health data (weight, blood pressure, diet, exercise, etc.).

[0648] Terminal (patient's device): Sends the entered data to the server.

[0649] Step 2: Provide a health care plan

[0650] Server: Analyzes the patient's health data, generates preventative measures and health management plans, and sends the plans to the patient's account.

[0651] User (patient): Check the health management plan provided through the app and incorporate it into their daily life.

[0652] Step 3: Collaborate with your healthcare provider

[0653] Users (patients): If they have health questions or concerns, they can contact their healthcare provider through the app.

[0654] User (healthcare provider): Responds to patient questions and provides necessary advice and treatment plans.

[0655] Through these processing steps, the Health Quality Connect system enables efficient data sharing between patients and healthcare providers and improves medical quality.

[0656] Example 1

[0657] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0658] In today's world, the management and sharing of medical information is extremely important, but traditional systems make it difficult to efficiently share information between patients and healthcare providers, which can affect the quality of medical care and the accuracy of diagnoses. Another issue is the lack of effective ways for patients to manage their own health data on a daily basis and collaborate with healthcare providers to manage their health.

[0659] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0660] In this invention, the server includes a means for users to create an account and upload medical information and health history, a means for healthcare providers to securely access and confirm patient information in advance, a means for users and healthcare providers to share medical data online, a means for users to input and manage daily health data using a dedicated app, and a means for encrypting and storing collected patient data. This allows patients and healthcare providers to efficiently share information and improve the quality of medical care, and also enables patients to manage their own health data on a daily basis and effectively manage their health.

[0661] "User" means a person or individual who accesses this system, creates an account, and inputs and manages medical information and health data.

[0662] A "healthcare provider" is a person or entity that is a medical professional providing medical care or services, inputs patient medical data, and uses AI-based diagnostic suggestions.

[0663] An "account" is a set of dedicated identification and login information that allows a user to access the system and manage personal and medical information.

[0664] "Medical information" refers to detailed data about a patient, such as diagnostic results, symptoms, and medical history, that is used by healthcare providers during consultations.

[0665] "Health history" is data including the user's past health condition, medical history, test results, and the like.

[0666] "Upload" is the operation by which a user sends and stores data from their device to the system.

[0667] A "dedicated app" is a software application for a specific purpose that allows users to input and manage their daily health data.

[0668] "Encryption" is a technology that converts data so that it cannot be deciphered by third parties, and is a means of storing it safely.

[0669] "Sharing medical data online" means that users and medical providers can instantly view and use information with each other via the Internet.

[0670] "Real-time updates" refers to the process by which a system instantly reflects data and keeps it up to date.

[0671] "Artificial intelligence (AI)" refers to a computer system that analyzes large amounts of data, learns, infers, and generates decisions such as diagnostic suggestions.

[0672] "Diagnostic suggestions" are specific recommendations for diagnoses and treatment plans presented to healthcare providers based on data analyzed by AI.

[0673] A "health management plan" is a specific action plan or advice provided to a user to maintain or improve their daily health.

[0674] The "system" is a platform that includes all of the above elements and functions, enabling patients and healthcare providers to effectively share information and improve the quality of medical care.

[0675] The present invention provides a platform that allows users to centrally manage their personal health data and efficiently share information with healthcare providers. The system consists of the following four main modules:

[0676] 1. Creating a user account and uploading information

[0677] The user (patient) accesses the system's registration page using a web browser. They create an account by entering their name, email address, and password, and receive a confirmation email from the system. They click the link in the confirmation email to activate their account. After their account is activated, they upload their past health checkup information and medical history data to the system in file format. The server encrypts the received files and stores them securely in a database.

[0678] 2. Real-time data update app

[0679] The user (healthcare provider) uses a dedicated app to enter the patient's medical data during medical treatment. The input form includes fields for the patient's basic information, symptoms, and diagnosis results. The device immediately sends the entered data to the server. The server immediately analyzes the received data and updates it by linking it to the patient's account. This allows the medical data to be displayed in real time, and the user (patient) can immediately check the updated medical data by logging in to their account.

[0680] 3. AI-Supported Medical Treatment Guide

[0681] The server inputs the collected past medical data into the generative AI model system. The generative AI model generates a diagnostic proposal based on the analyzed data and the latest medical guidelines. The server stores the generated diagnostic proposal within the system and provides it to the user (healthcare provider). The healthcare provider logs in to the platform to check the diagnostic proposal and, based on it, develops an appropriate medical examination and treatment plan.

[0682] For example, you might input the following prompt into a generative AI model:

[0683] "A 40-year-old man has been diagnosed with diabetes and high blood pressure in the past. His current symptoms are frequent urination and mild chest pain. I would like a diagnosis based on his blood sugar and blood pressure data from the past year."

[0684] 4. Patient Empowerment App

[0685] Users (patients) use a dedicated app to input and manage their daily health data (e.g., weight, blood pressure, exercise records). The server periodically updates the input data and reflects it in the patient's profile. The generative AI model analyzes the latest input data and generates preventive measures and a health management plan. Users (patients) receive the health management plan through the app and carry out daily health management according to that plan. Furthermore, users (patients) can send consultations and questions to healthcare providers through the app, and the server notifies the healthcare provider of the contents.

[0686] In this way, the present invention enables efficient information sharing between patients and healthcare providers, improving the quality of medical care. Furthermore, by utilizing AI, diagnostic accuracy can be improved, enabling patients to manage their own health on a daily basis.

[0687] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0688] 1. Creating a user account and uploading information

[0689] Step 1:

[0690] The user (patient) opens a web browser and accesses the system's registration page. The user enters their name, email address, and password and clicks the "Create Account" button.

[0691] Input: Name, Email Address, Password

[0692] Output: Account creation request

[0693] Step 2:

[0694] The server receives the account creation request, generates a confirmation email, and sends it to the specified email address, including an account activation link.

[0695] Input: User information

[0696] Output:Confirmation email

[0697] Step 3:

[0698] The user (patient) opens the confirmation email sent to them and clicks on the activation link.

[0699] Input: Link in confirmation email

[0700] Output: Account activation request

[0701] Step 4:

[0702] The server verifies the validity of the link and activates the account, allowing the user to log in and access their profile page.

[0703] Input: Account activation request

[0704] Output: Activated accounts

[0705] Step 5:

[0706] The user (patient) logs in and uploads files of past health checkup information and medical history data.

[0707] Input: Health checkup information and medical history data

[0708] Output: Data upload request

[0709] Step 6:

[0710] The server encrypts the received file and stores it in a database.

[0711] Input: Data upload request

[0712] Output: Encrypted database entries

[0713] 2. Real-time data update app

[0714] Step 1:

[0715] During medical treatment, the user (healthcare provider) launches a dedicated app and enters the patient's basic information, symptoms, and diagnosis results into a medical data input form.

[0716] Input: Patient basic information, symptoms, diagnosis

[0717] Output: Medical data entry request

[0718] Step 2:

[0719] The terminal transmits the input data to the server.

[0720] Input: Medical data input request

[0721] Output: Medical data transmission request

[0722] Step 3:

[0723] The server analyzes the received data, registers the correct location, and updates the patient's account information.

[0724] Input: Medical data transmission request

[0725] Output: Updated patient data

[0726] Step 4:

[0727] The user (patient) logs in to their account and checks medical data updated in real time on the app.

[0728] Input: Login request

[0729] Output: Displayed update data

[0730] 3. AI-Supported Medical Treatment Guide

[0731] Step 1:

[0732] The server inputs the collected past medical data into the generative AI model.

[0733] Input: Past medical data

[0734] Output: Parse request

[0735] Step 2:

[0736] A generative AI model analyzes the data and generates diagnostic suggestions based on the latest medical guidelines.

[0737] Input: Parse request

[0738] Output: Diagnostic suggestions

[0739] Step 3:

[0740] The server maintains the generated diagnostic suggestions within the system and provides them to healthcare providers.

[0741] Input: Diagnostic suggestion

[0742] Output: Diagnostic suggestion display request

[0743] Step 4:

[0744] The user (healthcare provider) logs into the platform and checks the diagnostic suggestions generated by the AI.

[0745] Input: Login request

[0746] Output: Displayed diagnostic suggestions

[0747] For example, you might input the following prompt into a generative AI model:

[0748] "A 40-year-old man has been diagnosed with diabetes and high blood pressure in the past. His current symptoms are frequent urination and mild chest pain. I would like a diagnosis based on his blood sugar and blood pressure data from the past year."

[0749] 4. Patient Empowerment App

[0750] Step 1:

[0751] The user (patient) uses a dedicated app to enter daily health data (e.g., weight, blood pressure, exercise records).

[0752] Input: Health data

[0753] Output: Data entry request

[0754] Step 2:

[0755] The server periodically updates the entered data to reflect the patient's profile.

[0756] Input: Data Entry Request

[0757] Output: Updated profile data

[0758] Step 3:

[0759] A generative AI model analyzes the latest input data and generates a health management plan.

[0760] Input: Updated profile data

[0761] Output: Health management plan proposal

[0762] Step 4:

[0763] The user (patient) receives and executes a health management plan through the app.

[0764] Input: Health Care Plan Proposal

[0765] Output: Implemented health care plan

[0766] Step 5:

[0767] The user (patient) sends inquiries or questions to the healthcare provider through the app.

[0768] Input: Consultation details

[0769] Output: Consultation request

[0770] Step 6:

[0771] The server notifies the medical provider of the consultation details and takes the necessary action.

[0772] Input: Consultation request

[0773] Output: Notifications and their responses

[0774] The above are the specific processing steps and operations of this system.

[0775] (Application example 1)

[0776] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0777] Conventional medical platforms lack sufficient information sharing between patients and healthcare providers, making it difficult to update health data in real time or provide appropriate advice. Communication with pharmacists in brick-and-mortar stores is particularly limited, resulting in a lack of consistent support for patients' health management. This has led to issues such as patients being unable to receive the medical services they need accurately and in a timely manner.

[0778] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0779] In this invention, the server includes a means for a user to create an account and upload medical information and health history, a means for a healthcare provider to securely access and confirm patient information in advance, a means for the user and healthcare provider to share medical data online, and a means for a pharmacist at a store to share health data with the patient and provide advice in real time, thereby enabling effective and prompt information sharing between the patient, healthcare provider, and in-store pharmacist, and enabling appropriate advice to be provided.

[0780] "User" means an individual who creates an account and manages their own health information and medical history.

[0781] "Healthcare Provider" means a professional who is authorized to access a patient's medical data and to diagnose and treat the patient.

[0782] "Medical information" refers to data about a patient's health condition and treatment that is recorded by a doctor or other healthcare provider.

[0783] "Health history" refers to the overall record of a patient's past medical treatments and medical examinations.

[0784] "Uploading" refers to the act of a user sending and storing their own data on an online platform.

[0785] "Access" means that a healthcare provider has the authority or means to view a patient's data.

[0786] "Real-time updates" means that data is updated immediately and is always up-to-date.

[0787] "Store" means a physical retail establishment, such as a drugstore or pharmacy.

[0788] A "pharmacist" is a professional who dispenses and sells medicines and provides appropriate medication and health advice to patients.

[0789] "Artificial intelligence (AI)" refers to a computer system that automatically analyzes and makes decisions based on large amounts of data.

[0790] "Diagnostic suggestions" refers to treatment and diagnostic recommendations generated by AI based on analysis results and the latest medical guidelines.

[0791] A "smartphone" refers to a mobile phone that can connect to the Internet and use multifunctional applications.

[0792] This invention provides a system that allows users to create an account, centrally manage their medical information and health history, and smoothly share information with healthcare providers. This system places emphasis on communication with pharmacists in physical stores.

[0793] The program to realize this system uses the following hardware and software.

[0794] Hardware and software used

[0795] Smartphone: A device that allows users to create an account and manage their health data.

[0796] Server: A central system that securely stores and shares user data with healthcare providers and pharmacists.

[0797] Provider application: Software that allows providers to enter and update clinical data in real time.

[0798] Pharmacist application: Software that allows pharmacists in physical stores to view patient data in real time and suggest appropriate advice and medications.

[0799] Artificial intelligence (AI) systems: Software used to analyze collected patient data and generate diagnostic suggestions.

[0800] Data processing and calculation

[0801] The server performs the following data processing and calculations:

[0802] 1. Create a user account and upload data:

[0803] Users create an account using their smartphone and upload their medical information and health history to the server, where the data is encrypted and stored securely.

[0804] 2. Real-time data updates and sharing:

[0805] Healthcare providers use a dedicated application to enter medical data and send it to a server, which updates the data in real time and associates it with the patient's account.

[0806] 3. Data sharing and advice in physical stores:

[0807] Pharmacists use a dedicated application to view patients' health data in real time, allowing them to provide appropriate medications and health advice.

[0808] 4. AI-based diagnostic suggestions:

[0809] The collected medical data is analyzed by the AI ​​system to generate diagnostic suggestions, which are then provided to healthcare providers to help them develop appropriate treatment plans.

[0810] Specific examples

[0811] 1. Patient B interacts with a pharmacist at a drugstore:

[0812] Patient B uses his / her smartphone to enter his / her health data (e.g., blood pressure, weight, medication history, etc.) into the application and uploads it to the server.

[0813] The pharmacist opens a dedicated application and views Patient B's health data in real time. Based on this data, the pharmacist provides advice on appropriate medications and lifestyle habits. The information entered by the pharmacist is immediately sent to the server, and Patient B's data is updated.

[0814] 2. Example prompt for the generative AI model:

[0815] My name is B and my health data for the past month is as follows:

[0816] Weight: 70kg

[0817] Blood pressure: 130 / 80

[0818] Health checkup revealed: High blood sugar level

[0819] Based on this data, please give me some health advice and recommended supplements. Also, please let me know if there are any points I should check.

[0820] By implementing the invention in this manner, effective information sharing between patients, healthcare providers, and pharmacists is achieved, enabling appropriate advice to be received promptly.

[0821] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0822] Step 1:

[0823] Users create accounts and upload medical information and health histories

[0824] Input: Your name, email address, password, and medical and health history data

[0825] How it works: A user accesses the account creation screen on a dedicated application using a smartphone. They enter their name, email address, and password and press the Create Account button. They then upload their medical information and past health history to the application.

[0826] Data processing: Information entered on the terminal is encrypted.

[0827] Output: The encrypted data is sent to the server and stored securely in a database.

[0828] Step 2:

[0829] Your healthcare provider will have access to your account and will review it in advance.

[0830] Input: Provider credentials and access credentials

[0831] How it works: A healthcare provider logs into a dedicated application and enters their credentials, which the server authenticates and grants the healthcare provider access.

[0832] Data calculation: The server finds the user's account information based on the received access authentication information and generates a token for secure access.

[0833] Output: Healthcare providers can access and proactively review patient medical information and health history.

[0834] Step 3:

[0835] Users and healthcare providers share medical data online

[0836] Input: User and provider credentials, clinical data

[0837] How it works: Users use their smartphones to enter medical data and send it to a server, while healthcare providers also enter data using a dedicated application.

[0838] Data processing: The server associates both sets of data with the corresponding user accounts and updates the database in real time.

[0839] Output: Updated clinical data is accessible in real time to both users and healthcare providers.

[0840] Step 4:

[0841] In-store pharmacists share health data with patients and provide real-time advice

[0842] Input: Patient health data, pharmacist credentials

[0843] How it works: Pharmacists log in to a dedicated application to access patient health data, conduct face-to-face consultations with patients, and provide appropriate medications and advice in real time based on the health data.

[0844] Data calculation: The server associates the advice entered by the pharmacist with the patient account and updates the data.

[0845] Output: Patients can check the pharmacist's advice in real time on their smartphones.

[0846] Step 5:

[0847] AI analyzes the collected data and generates diagnostic suggestions

[0848] Inputs: Patient medical data, health history, latest medical guidelines

[0849] How it works: The server inputs collected patient data into the AI ​​system, analyzes the data based on medical guidelines, and the AI ​​follows a process to generate diagnostic suggestions and makes an appropriate diagnosis.

[0850] Data computation: The AI ​​system analyzes the data and generates new diagnostic suggestions based on the generative AI model used.

[0851] Output: The generated diagnostic suggestions are provided to the healthcare provider to help develop an appropriate treatment plan.

[0852] Step 6:

[0853] Patients can check AI-generated health advice on their smartphones

[0854] Input: AI-generated diagnostic suggestions and health advice

[0855] How it works: The server sends the AI-generated diagnostic suggestions to the user's smartphone app. The user opens the app and checks the health advice and diagnostic suggestions provided by the AI.

[0856] Data processing: The server associates the diagnostic proposal with the user account and sends it.

[0857] Output: Users can instantly check diagnostic suggestions on their smartphones and use them to help manage their daily health.

[0858] In this way, the system is realized through the specific process steps of the invention.

[0859] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0860] The present invention provides a system for efficiently sharing medical information between medical providers and patients, and for recognizing the emotional state of patients to further improve the medical process. Hereinafter, embodiments of the present invention will be described in detail.

[0861] 1. Electronic medical record sharing platform

[0862] Creating a user account and uploading information

[0863] User (Patient): Accesses the system and creates a new account. Enters name, email address, and password, receives a confirmation email to activate the account, and then uploads past medical examination information and medical history data to the system.

[0864] Server: Encrypts and stores user account information and uploaded data, granting access to healthcare providers as needed. Data is stored securely and can be accessed by both users and healthcare providers when needed.

[0865] 2. Real-time data update app

[0866] Real-time data entry and sharing during medical treatment

[0867] User (healthcare provider): Uses a dedicated app during consultation and inputs patient medical data in real time, such as blood pressure, electrocardiogram results, and findings.

[0868] Terminal (provider's device): The entered data is immediately sent to the server.

[0869] Server: Rapidly updates the received data and associates it with the patient's account, so that the data is displayed in real time and can be viewed and reviewed by the patient at the same time.

[0870] 3. AI-Supported Medical Treatment Guide

[0871] Analysis of medical data and diagnostic suggestions

[0872] Server: Collected past and current medical data is input into the AI ​​system, which then analyzes the data. The AI ​​then generates diagnostic suggestions based on the latest medical guidelines.

[0873] User (healthcare provider): Logs in to the platform and checks the diagnostic suggestions generated by the AI. Based on these suggestions, the user can develop an appropriate medical treatment and treatment plan.

[0874] 4. Patient Empowerment App

[0875] Managing health data and taking preventative measures

[0876] User (patient): Uses the app to input and manage daily health data, including weight, blood pressure, and exercise records.

[0877] Server: Updates patient data periodically and provides timely health care plans.

[0878] Patient Actions: Maintain and improve the patient's health by following the plan provided by the app and carrying out daily health management.

[0879] 5. Emotion engine integration

[0880] User sentiment analysis and notification

[0881] User (patient): Uses the app to input health data and emotional feedback. Emotional data is also collected through voice and facial recognition.

[0882] Terminal (patient's device): Sends collected emotion data to the server.

[0883] Server: The emotion engine analyzes the emotion data and evaluates the patient's emotional state. The result of this evaluation is then sent to the healthcare provider.

[0884] User (healthcare provider): Receives notifications from the emotion engine and conducts consultations while taking into account the patient's emotional state. If necessary, provides counseling or medical advice to the patient.

[0885] Specific examples

[0886] To give a specific example, patient A creates a new account in the system and uploads his or her past medical information. When visiting healthcare provider B for a regular checkup, B uses a dedicated app to enter the medical data and updates the results in real time. The AI ​​system analyzes A's data and provides diagnostic suggestions based on the latest medical guidelines. A manages his or her own health data through the app and improves lifestyle habits according to a health management plan. In addition, the emotion engine analyzes A's voice and facial expressions and notifies healthcare provider B of his or her emotional state, such as stress or anxiety. B then provides appropriate counseling and advice.

[0887] The system enables efficient information sharing between patients and healthcare providers and utilizes an emotion engine to comprehensively manage patients' physical and mental health.

[0888] The processing flow will be explained below.

[0889] Processing steps of the electronic medical record sharing platform

[0890] Step 1: Create a user account

[0891] User: Accesses the platform, enters their name, email address and password in the registration form and presses the "Create Account" button.

[0892] Server: Receives registration information and stores it in a database. Generates and sends a confirmation email to the user's email address.

[0893] Users: Click the link in the confirmation email they receive to activate their account.

[0894] Step 2: Upload your medical information and health history

[0895] User: After logging in, select the file containing past medical information and health history and press the "Upload" button.

[0896] Server: Receives the file, encrypts the data, stores it in the database, and notifies the user when the data has been saved.

[0897] Step 3: Provider Access

[0898] User (healthcare provider): Logs in to the platform with a dedicated account.

[0899] Server: Verifies the healthcare provider's authorization and provides accessible patient data.

[0900] User (healthcare provider): View the patient's past medical information and understand the information necessary for treatment in advance.

[0901] Processing steps of the real-time data update app

[0902] Step 1: Enter your medical data

[0903] User (healthcare provider): Uses a dedicated app during consultation to input patient medical results, such as blood pressure, electrocardiogram results, and other findings, in real time.

[0904] Terminal (provider's device): The entered data is immediately sent to the server.

[0905] Step 2: Update and notify data

[0906] Server: Immediately updates the received medical data in the database and associates it with the patient's account. Sends a notification to the user (healthcare provider) that the update is complete.

[0907] User (Patient): Logs in to the app and checks medical data updated in real time. Data can be checked immediately after the consultation.

[0908] AI-supported medical treatment guide processing steps

[0909] Step 1: Collect and analyze medical data

[0910] Server: Inputs the patient's past and current medical data into the AI ​​system.

[0911] AI system: Analyzes data and generates diagnostic suggestions based on the latest medical guidelines.

[0912] Step 2: Providing diagnostic suggestions

[0913] Server: Sends AI-generated diagnostic suggestions to healthcare provider accounts.

[0914] User (healthcare provider): Logs in to the platform, checks the AI's diagnostic suggestions, and uses the suggestions to diagnose the patient.

[0915] Patient Empowerment App Processing Steps

[0916] Step 1: Enter and manage your health data

[0917] User (patient): Logs in to the app and enters daily health data (weight, blood pressure, diet, exercise, etc.).

[0918] Terminal (patient's device): Sends the entered data to the server.

[0919] Step 2: Provide a health care plan

[0920] Server: Analyzes the patient's health data, generates preventative measures and health management plans, and sends the plans to the patient's account.

[0921] User (patient): Check the health management plan provided through the app and incorporate it into their daily life.

[0922] Step 3: Collaborate with your healthcare provider

[0923] Users (patients): If they have health questions or concerns, they can contact their healthcare provider through the app.

[0924] User (healthcare provider): Responds to patient questions and provides necessary advice and treatment plans.

[0925] Emotion Engine Processing Steps

[0926] Step 1: Collecting emotion data

[0927] User (patient): Uses the app to input health data and emotional feedback. Emotional data is recorded using voice input and facial recognition.

[0928] Terminal (patient's device): Sends collected emotion data to the server.

[0929] Step 2: Analyze the emotion data

[0930] Server: Analyzes the transmitted emotion data using the emotion engine, assessing the emotional state (e.g., stress, joy, anxiety).

[0931] Step 3: Informing and leveraging emotion data

[0932] Server: Sends analysis results to the healthcare provider's account, including a detailed assessment of the patient's emotional state.

[0933] User (healthcare provider): Based on the notification, understand the patient's emotional state and use it as a reference for medical treatment and counseling. If necessary, provide additional counseling or medical advice to the patient.

[0934] Through these processing steps, the Health Quality Connect system enables efficient data sharing between patients and healthcare providers, diagnostic support using AI, and comprehensive health management through the use of an emotion engine.

[0935] Example 2

[0936] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0937] In modern medical settings, efficient sharing of medical information between patients and healthcare providers is important, but information sharing is often not smooth. Furthermore, there is a lack of means to accurately grasp a patient's emotional state and provide appropriate medical treatment and counseling based on that information. Furthermore, there is a need for a system that can efficiently manage daily health data and provide appropriate health management plans.

[0938] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for a user to create an account and upload medical information and health history; a means for a healthcare provider to securely access and confirm patient information in advance; a means for a user and a healthcare provider to share medical data online; a means for inputting the user's emotional data and transmitting it to the server via a terminal; and a means for an artificial intelligence (AI) to analyze the emotional data and notify the healthcare provider of the results. This enables efficient sharing of medical information and provision of detailed medical care that takes the patient's emotional state into consideration. The system also includes: a means for a healthcare provider to input patient data in real time during medical care; a means for updating the shared medical data in real time and providing it to the patient and healthcare provider; a means for an AI to analyze the medical data and generate a diagnostic suggestion based on the latest medical guidelines; and a means for providing the generated diagnostic suggestion to the healthcare provider. This results in improved quality of medical care and faster diagnostic suggestions. The system also includes: a means for a user to input daily health data and transmit it to the server; and a means for the server to periodically update the health data and provide a health management plan. This will make daily health management more efficient and is expected to help maintain and improve patients' health.

[0939] "User" refers to a person who accesses the system, creates an account, and uploads medical information and health history.

[0940] "Healthcare provider" refers to a professional who provides medical treatment and counseling to patients, who accesses patient information through the system, and who inputs and checks medical data.

[0941] "Server" refers to a computer system that stores data entered by users and healthcare providers and analyzes and updates the data as needed.

[0942] "Account creation" refers to the process by which a new user accessing the system enters information such as name, email address, and password and registers with the system.

[0943] "Medical information" refers to all data related to medical treatment, such as patient medical records, test results, and treatment history.

[0944] "Health history" refers to all records related to a patient's health status, including past medical examination results and medical history.

[0945] "Upload" refers to the act of a user sending data from their local device to the system.

[0946] "Online medical data sharing" refers to a state in which users and medical providers can check and update medical data in real time via the Internet.

[0947] "Emotional data" refers to information that indicates a patient's emotional state, and is collected through self-input feedback or through voice and facial recognition.

[0948] "Terminal" refers to the device (e.g., smartphone, tablet, or PC) used by a user or healthcare provider to access the system.

[0949] "Artificial intelligence" refers to computer programs that contain machine learning algorithms to analyze input data and provide diagnostic suggestions or assessments of emotional states.

[0950] "Diagnostic suggestions" refers to the presentation of recommendations regarding medical examinations and treatments based on data analyzed by artificial intelligence.

[0951] "Health data" refers to various data related to a patient's health condition, such as daily weight, blood pressure, and exercise records.

[0952] A "health management plan" refers to providing a plan based on collected health data that includes appropriate preventive measures and instructions for lifestyle improvements.

[0953] The present invention provides a system for enabling users and healthcare providers to efficiently share medical information and recognize the emotional state of patients to improve the medical process. Hereinafter, embodiments of the present invention will be described in detail.

[0954] 1. Electronic medical record sharing platform

[0955] Creating a user account and uploading information

[0956] User (Patient):

[0957] A user accesses the system and clicks the "Create a new account" button. Next, they enter their name, email address, and password in the form to create an account. Once the account is created, a confirmation email is sent to the user's email address. The user clicks the link in the email to activate the account. After that, they upload past health checkup results and medical history data to the system. For example, they select a PDF or image file and click the "Upload" button.

[0958] server:

[0959] The server encrypts the entered account information and stores it in a database. All data uploaded by users is also encrypted and stored securely, with appropriate access rights set to allow healthcare providers to access it as needed.

[0960] 2. Real-time data update app

[0961] Real-time data entry and sharing during medical treatment

[0962] User (healthcare provider):

[0963] During consultations, healthcare providers open a dedicated app and input patient data in real time, including blood pressure, electrocardiogram results, and clinical findings.

[0964] Terminal (provider device):

[0965] The device immediately sends this data to the server. The data is sent by clicking the "Send" button in the app.

[0966] server:

[0967] The server rapidly updates the received data with the corresponding patient account information, making the data visible to both patients and healthcare providers in real time.

[0968] 3. AI-Supported Medical Treatment Guide

[0969] Analysis of medical data and diagnostic suggestions

[0970] server:

[0971] The server collects past and current medical data and inputs it into an artificial intelligence (AI) system, which generates diagnostic suggestions based on the latest medical guidelines.

[0972] User (healthcare provider):

[0973] Healthcare providers log in to the platform and view diagnostic suggestions generated by the AI, which they then use to develop optimal treatment plans.

[0974] 4. Patient Empowerment App

[0975] Managing health data and taking preventative measures

[0976] User (Patient):

[0977] Users use the app to input their daily health data, including weight, blood pressure, exercise records, etc. The data is saved by pressing the "Save" button.

[0978] server:

[0979] The server periodically updates this data and provides users with appropriate health management plans, such as suggesting specific exercise plans based on data indicating a lack of exercise.

[0980] 5. Emotion engine integration

[0981] User sentiment analysis and notification

[0982] User (Patient):

[0983] Users input their emotional feedback within the app, and emotional data is automatically collected using voice and facial recognition.

[0984] Terminal (patient device):

[0985] The device transmits the collected emotion data to the server.

[0986] server:

[0987] The server analyzes the emotion data using an emotion engine and notifies the healthcare provider of the results of the emotion assessment.

[0988] User (healthcare provider):

[0989] Healthcare providers receive notifications from the emotion engine and take the patient's emotional state into consideration as they conduct consultations, providing counseling and appropriate medical advice as needed.

[0990] Specific examples

[0991] Patients create a new account on the system and upload their past medical information. During regular checkups, healthcare providers use a dedicated app to enter medical data and update results in real time. The AI ​​system analyzes the data and generates diagnostic suggestions based on the latest medical guidelines. Patients manage their health data through the app and work to improve their lifestyle based on a health management plan. In addition, an emotion engine analyzes voice and facial expression data and notifies healthcare providers of stress and anxiety. Healthcare providers then provide appropriate counseling and advice to the patient.

[0992] Examples of suitable prompts for the AI ​​model

[0993] "Please explain in detail how a system allows you to upload a patient's past medical records and use AI to generate diagnostic suggestions based on the latest medical guidelines."

[0994] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0995] Electronic medical record sharing platform

[0996] Creating a user account and uploading information

[0997] Step 1:

[0998] User (patient): The user accesses the system and clicks the "Create a new account" button. Input includes name, email address, and password. Enter this information and press the "Submit" button.

[0999] Input: Name, Email Address, Password

[1000] Output: Send information to the server

[1001] Step 2:

[1002] Server: The server automatically generates a confirmation email based on the received information and sends it to the user's email address. The user clicks on the link in the email to activate their account.

[1003] Input: User's name, email address, and password

[1004] Data processing: Confirmation email generation

[1005] Output: Send confirmation email

[1006] Step 3:

[1007] User (Patient): After the account is activated, the user uploads their past medical examination information and medical history data to the system, for example, by selecting a PDF file or image file and clicking the "Upload" button.

[1008] Input: Health checkup information, medical history data

[1009] Output: Send data to the server

[1010] Step 4:

[1011] Server: The server encrypts the uploaded data and stores it in a secure database, granting access rights to healthcare providers as needed.

[1012] Input: Uploaded medical examination information, medical history data

[1013] Data processing: Data encryption

[1014] Output: Data stored in a secure database

[1015] Real-time data update app

[1016] Real-time data entry and sharing during medical treatment

[1017] Step 1:

[1018] User (healthcare provider): The healthcare provider opens the dedicated app and inputs the patient's medical data (blood pressure, electrocardiogram results, findings, etc.) in real time. After inputting, he / she presses the "Send" button.

[1019] Input: Medical data

[1020] Output: Data input to the terminal

[1021] Step 2:

[1022] Terminal (provider's device): The terminal immediately transmits the entered data to the server. This process occurs in real time using a network connection.

[1023] Input: Medical data

[1024] Output: Send data to the server

[1025] Step 3:

[1026] Server: The server rapidly updates the received data and associates it with the appropriate patient account, making the data available in real time and accessible to patients via their own devices.

[1027] Input: Medical data

[1028] Data processing: Data update

[1029] Output: Save and display the updated data

[1030] AI-supported medical treatment guide

[1031] Analysis of medical data and diagnostic suggestions

[1032] Step 1:

[1033] Server: The server inputs collected past and current medical data into the AI ​​system.

[1034] Input: Past and current medical data

[1035] Output: Sending data to an AI system

[1036] Step 2:

[1037] AI system: AI generates diagnostic suggestions based on the latest medical guidelines and past clinical data.

[1038] Input: Clinical data and medical guidelines

[1039] Data processing: Data analysis and generation of diagnostic suggestions

[1040] Output: Diagnostic suggestions

[1041] Step 3:

[1042] User (healthcare provider): The healthcare provider logs in to the platform and checks the diagnostic suggestions generated by the AI. Based on these suggestions, the healthcare provider decides on the final treatment plan.

[1043] Input: Diagnostic suggestion

[1044] Output: Treatment plan

[1045] Patient Empowerment App

[1046] Managing health data and taking preventative measures

[1047] Step 1:

[1048] User (patient): The user uses the app to enter daily health data (weight, blood pressure, exercise records, etc.), enters the data, and presses the "Save" button.

[1049] Input: Health data

[1050] Output: Data input to the app

[1051] Step 2:

[1052] Server: The server periodically updates and securely stores the entered data.

[1053] Input: Health data

[1054] Data processing: updating and saving data

[1055] Output: Save the updated data

[1056] Step 3:

[1057] Server: The server performs health checks based on the recorded data and provides appropriate health management plans. For example, it suggests specific exercise plans if the user is not getting enough exercise.

[1058] Input: Updated health data

[1059] Data processing: generating health management plans

[1060] Output: Healthcare plan

[1061] Emotion engine integration

[1062] User sentiment analysis and notification

[1063] Step 1:

[1064] User (patient): The user enters their own emotional feedback within the app. In addition, emotional data is automatically collected using voice and facial recognition.

[1065] Input: Emotional feedback, voice data, facial expression data

[1066] Output: Data input to the app

[1067] Step 2:

[1068] Terminal (patient's device): The terminal transmits the collected emotion data to the server.

[1069] Input: Emotion data

[1070] Output: Send data to the server

[1071] Step 3:

[1072] Server: The server uses an emotion engine to analyze the emotion data and evaluate the emotional state.

[1073] Input: Emotion data

[1074] Data processing: Emotion data analysis

[1075] Output: Sentiment rating

[1076] Step 4:

[1077] Server: The server notifies the healthcare provider of the results of the emotion assessment.

[1078] Input: Emotion rating

[1079] Output: Notification of emotion evaluation result

[1080] Step 5:

[1081] User (healthcare provider): The healthcare provider receives notifications from the emotion engine and examines the patient while taking into account their emotional state. If necessary, they provide counseling or appropriate medical advice.

[1082] Input: Emotion evaluation result

[1083] Output: consultation plan, counselling and medical advice

[1084] (Application example 2)

[1085] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1086] With conventional systems, it was difficult to grasp the emotional state of patients and customers in real time in medical and customer service settings, making it difficult to respond appropriately and quickly. This made it difficult to provide services that met individual needs, and improving customer satisfaction was an issue.

[1087] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a user to create an account and upload medical information and health history, a means for a healthcare provider to securely access and confirm patient information in advance, a means for the user and healthcare provider to share medical data online, a means for capturing a customer's facial expression using smart glasses and analyzing their emotions, and a means for storing the analyzed customer's emotional data in a database and making service suggestions. This makes it possible to grasp the customer's emotional state in real time and suggest appropriate services based on that.

[1088] A "user account" is individual identification information assigned to each user who uses the system.

[1089] "Medical information" is health-related data collected by healthcare providers, such as patient consultations and medical records.

[1090] "Health history" refers to records relating to an individual's health, including the patient's past medical examination results, medical history, and treatment history.

[1091] "Healthcare providers" are professionals who provide health care services, such as doctors, nurses, and pharmacists.

[1092] "Online" medical data sharing refers to the ability to view and update patient information in real time via the Internet.

[1093] "Smart glasses" are eyeglass-type wearable devices worn by users that have camera and display functions.

[1094] "Customer's facial expression" is information that indicates the emotional state through changes in facial expression.

[1095] "Emotion analysis" is the process of identifying individual emotional states from facial expressions and vocal acoustic patterns using image processing techniques and machine learning.

[1096] A "database" is a system for storing and managing data in digital form, and is a means for quickly retrieving data when needed.

[1097] A "service proposal" is a specific proposal to provide appropriate products or services based on the customer's needs and emotional state.

[1098] "Real-time" refers to instant data transmission and processing without delay, meaning that current information is reflected and processed immediately.

[1099] "Artificial intelligence (AI)" is a technology that enables computer systems to mimic human intelligence and learn, reason, perceive, and make decisions.

[1100] The present invention provides a system that efficiently shares medical information between healthcare providers and patients, recognizes patients' emotional states, and further improves the medical process. It also integrates emotion recognition and service suggestion functions using smart glasses to improve customer service in brick-and-mortar stores.

[1101] 1. Overview of the entire system

[1102] The system includes the following main measures:

[1103] A means for users to create accounts and upload medical information and health history

[1104] A means for healthcare providers to securely access and proactively review patient information

[1105] A means for users and healthcare providers to share medical data online

[1106] A method to capture customer facial expressions and analyze their emotions using smart glasses

[1107] A means of storing analyzed customer emotion data in a database and making service suggestions

[1108] 2. Hardware and Software Used

[1109] The system uses the following hardware and software:

[1110] Hardware:

[1111] Smart glasses (e.g. Google Glass)

[1112] Camera (built into smart glasses)

[1113] Server (operating database and AI model)

[1114] Devices (used by healthcare providers and store employees)

[1115] software:

[1116] OpenCV (camera operation and image processing)

[1117] Keras (emotion recognition model)

[1118] TensorFlow (deep learning such as sentiment analysis)

[1119] SQLite (database management)

[1120] 3. Data processing and calculation procedures

[1121] The server acquires facial expression data captured by the smart glasses and performs emotion analysis using natural language processing and image processing technologies. This involves camera operation and image processing using OpenCV, and deep learning models using Keras and TensorFlow. The analysis results are stored in an SQLite database, and service proposals for the customer are generated at specific times and displayed on the smart glasses display.

[1122] 4. Specific Examples

[1123] For example, while a customer is browsing products in a physical store, a salesperson wearing smart glasses can capture the customer's face and analyze their emotions in real time. If the customer is smiling, the system will display a notification on the salesperson's smart glasses saying, "Please suggest a new promotion." On the other hand, if the customer is sad, the system will suggest, "Provide special service." This entire process is appropriately carried out by the analysis of an AI model.

[1124] 5. Example prompts to be input to the generative AI model

[1125] "Develop an application that uses smart glasses to assist in customer service in brick-and-mortar stores. This application will provide optimal service to customers by capturing customer facial expressions in real time and analyzing their emotional state. Specifically, the application will take a photo of the customer's face with a camera, analyze the results with an emotion recognition model, and store the results in an SQLite database. Based on the analysis results, the application will suggest appropriate services to staff."

[1126] This system is expected to improve customer service in brick-and-mortar stores, and also to streamline medical procedures and empower patients in medical settings.

[1127] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1128] Step 1:

[1129] The server creates user accounts and uploads medical information and health history. Users access the system, create an account, enter their name, email address, and password, and receive a confirmation email to activate their account. They then upload past medical examination information and medical history data to the system. The server encrypts and stores the uploaded data, allowing secure access to healthcare providers.

[1130] Step 2:

[1131] The device inputs patient data in real time during medical examinations and sends it to a server. Healthcare providers use a dedicated app to input patient medical data (e.g., blood pressure, electrocardiogram results, findings, etc.) in real time. The input data is immediately sent to the server, which stores the data in a database and updates it promptly.

[1132] Step 3:

[1133] The server analyzes the collected data using artificial intelligence (AI) and generates a diagnostic suggestion. The server inputs the collected past and current medical data into the AI ​​system, which then analyzes the data. The AI ​​generates a diagnostic suggestion based on the latest medical guidelines and provides the results to healthcare providers.

[1134] Step 4:

[1135] The device captures the customer's facial expression through the smart glasses and sends the data to the server.The smart glasses' camera captures the customer's face and sends it to the server as image data.

[1136] Step 5:

[1137] The server analyzes the image data and determines the customer's emotional state. The received image data is preprocessed using OpenCV and analyzed using an emotion recognition model using Keras and TensorFlow. The emotional state (e.g., happy, sad, surprised, etc.) is determined.

[1138] Step 6:

[1139] The server saves the analysis results in a database and generates appropriate service proposals. The analyzed emotion data is stored in an SQLite database and appropriate service proposals are generated based on the customer's state. For example, if the customer is determined to be happy, a proposal such as "Propose a new promotion" is generated, and if the customer is determined to be sad, a proposal such as "Provide a special service" is generated.

[1140] Step 7:

[1141] The device notifies the smart glasses of the proposed service, which then displays the notification of the proposed service sent from the server, allowing store employees to provide the service to the customer at the appropriate time.

[1142] Through the above steps, the present invention realizes a system that improves medical and brick-and-mortar store services.

[1143] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1144] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1145] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1146] [Third embodiment]

[1147] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1148] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1149] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1150] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1151] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1152] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1153] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1154] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1155] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1156] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1157] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1158] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1159] The present invention provides a platform that allows users to centrally manage their personal health data and efficiently share information with healthcare providers. The following is a detailed description of embodiments of the present invention.

[1160] 1. Electronic medical record sharing platform

[1161] Creating a user account and uploading information

[1162] User (Patient): Accesses the system and creates a new account. Enters name, email address, and password, receives a confirmation email to activate the account, and then uploads past medical examination information and medical history data to the system.

[1163] Server: Encrypts and stores user account information and uploaded data, granting access to healthcare providers as needed. Data is stored securely and can be accessed by both users and healthcare providers when needed.

[1164] 2. Real-time data update app

[1165] Real-time data entry and sharing during medical treatment

[1166] User (healthcare provider): Uses a dedicated app during consultation to input patient medical data in real time. The input data is immediately sent to the system.

[1167] Server: Rapidly updates the received data and associates it with the patient's account, so that the data is displayed in real time and can be viewed and reviewed by the patient at the same time.

[1168] 3. AI-Supported Medical Treatment Guide

[1169] Analysis of medical data and diagnostic suggestions

[1170] Server: Collected past medical data is input into the AI ​​system and analyzed. The AI ​​then generates diagnostic suggestions based on the latest medical guidelines.

[1171] User (healthcare provider): Logs in to the platform and checks the diagnostic suggestions generated by the AI. Based on these suggestions, the user can develop an appropriate medical treatment and treatment plan.

[1172] 4. Patient Empowerment App

[1173] Managing health data and taking preventative measures

[1174] User (patient): Uses the app to input and manage daily health data, including weight, blood pressure, and exercise records.

[1175] Server: Updates patient data periodically and provides timely health care plans.

[1176] Patient actions: Carry out daily health management according to the plan provided by the app. If necessary, the patient can consult and exchange opinions with their healthcare provider through the app.

[1177] Specific examples

[1178] To give a specific example, patient A creates a new account on the platform and uploads his or her past medical history. A then visits healthcare provider B for a regular checkup. B uses a dedicated app to input the medical data and updates A's data in real time with the results. The AI ​​system analyzes A's past data and generates diagnostic suggestions based on the medical guidelines, which are then provided to B. A can manage his or her own health data through the app and follow the submitted health management plan to live a healthier life.

[1179] In this way, the present invention can realize effective information sharing between patients and healthcare providers, improving the quality of medical care. It can also improve diagnostic accuracy by utilizing AI.

[1180] The processing flow will be explained below.

[1181] Processing steps of the electronic medical record sharing platform

[1182] Step 1: Create a user account

[1183] User: Accesses the platform, enters their name, email address and password in the registration form and presses the "Create Account" button.

[1184] Server: Receives registration information and stores it in a database. Generates and sends a confirmation email to the user's email address.

[1185] Users: Click the link in the confirmation email they receive to activate their account.

[1186] Step 2: Upload your medical information and health history

[1187] User: After logging in, select the file containing past medical information and health history and press the "Upload" button.

[1188] Server: Receives the file, encrypts the data, stores it in the database, and notifies the user when the data has been saved.

[1189] Step 3: Provider Access

[1190] User (healthcare provider): Logs in to the platform with a dedicated account.

[1191] Server: Verifies the healthcare provider's authorization and provides accessible patient data.

[1192] User (healthcare provider): View the patient's past medical information and understand the information necessary for treatment in advance.

[1193] Processing steps of the real-time data update app

[1194] Step 1: Enter your medical data

[1195] User (healthcare provider): Uses a dedicated app during consultation to input patient medical results, such as blood pressure, electrocardiogram results, and other findings, in real time.

[1196] Terminal (provider's device): The entered data is immediately sent to the server.

[1197] Step 2: Update and notify data

[1198] Server: Immediately updates the received medical data in the database and associates it with the patient's account. Sends a notification to the user (healthcare provider) that the update is complete.

[1199] User (Patient): Logs in to the app and checks medical data updated in real time. Data can be checked immediately after the consultation.

[1200] AI-supported medical treatment guide processing steps

[1201] Step 1: Collect and analyze medical data

[1202] Server: Inputs the patient's past and current medical data into the AI ​​system.

[1203] AI system: Analyzes data and generates diagnostic suggestions based on the latest medical guidelines.

[1204] Step 2: Providing diagnostic suggestions

[1205] Server: Sends AI-generated diagnostic suggestions to healthcare provider accounts.

[1206] User (healthcare provider): Logs in to the platform, checks the AI's diagnostic suggestions, and uses the suggestions to diagnose the patient.

[1207] Patient Empowerment App Processing Steps

[1208] Step 1: Enter and manage your health data

[1209] User (patient): Logs in to the app and enters daily health data (weight, blood pressure, diet, exercise, etc.).

[1210] Terminal (patient's device): Sends the entered data to the server.

[1211] Step 2: Provide a health care plan

[1212] Server: Analyzes the patient's health data, generates preventative measures and health management plans, and sends the plans to the patient's account.

[1213] User (patient): Check the health management plan provided through the app and incorporate it into their daily life.

[1214] Step 3: Collaborate with your healthcare provider

[1215] Users (patients): If they have health questions or concerns, they can contact their healthcare provider through the app.

[1216] User (healthcare provider): Responds to patient questions and provides necessary advice and treatment plans.

[1217] Through these processing steps, the Health Quality Connect system enables efficient data sharing between patients and healthcare providers and improves medical quality.

[1218] Example 1

[1219] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1220] In today's world, the management and sharing of medical information is extremely important, but traditional systems make it difficult to efficiently share information between patients and healthcare providers, which can affect the quality of medical care and the accuracy of diagnoses. Another issue is the lack of effective ways for patients to manage their own health data on a daily basis and collaborate with healthcare providers to manage their health.

[1221] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1222] In this invention, the server includes a means for users to create an account and upload medical information and health history, a means for healthcare providers to securely access and confirm patient information in advance, a means for users and healthcare providers to share medical data online, a means for users to input and manage daily health data using a dedicated app, and a means for encrypting and storing collected patient data. This allows patients and healthcare providers to efficiently share information and improve the quality of medical care, and also enables patients to manage their own health data on a daily basis and effectively manage their health.

[1223] "User" means a person or individual who accesses this system, creates an account, and inputs and manages medical information and health data.

[1224] A "healthcare provider" is a person or entity that is a medical professional providing medical care or services, inputs patient medical data, and uses AI-based diagnostic suggestions.

[1225] An "account" is a set of dedicated identification and login information that allows a user to access the system and manage personal and medical information.

[1226] "Medical information" refers to detailed data about a patient, such as diagnostic results, symptoms, and medical history, that is used by healthcare providers during consultations.

[1227] "Health history" is data including the user's past health condition, medical history, test results, and the like.

[1228] "Upload" is the operation by which a user sends and stores data from their device to the system.

[1229] A "dedicated app" is a software application for a specific purpose that allows users to input and manage their daily health data.

[1230] "Encryption" is a technology that converts data so that it cannot be deciphered by third parties, and is a means of storing it safely.

[1231] "Sharing medical data online" means that users and medical providers can instantly view and use information with each other via the Internet.

[1232] "Real-time updates" refers to the process by which a system instantly reflects data and keeps it up to date.

[1233] "Artificial intelligence (AI)" refers to a computer system that analyzes large amounts of data, learns, infers, and generates decisions such as diagnostic suggestions.

[1234] "Diagnostic suggestions" are specific recommendations for diagnoses and treatment plans presented to healthcare providers based on data analyzed by AI.

[1235] A "health management plan" is a specific action plan or advice provided to a user to maintain or improve their daily health.

[1236] The "system" is a platform that includes all of the above elements and functions, enabling patients and healthcare providers to effectively share information and improve the quality of medical care.

[1237] The present invention provides a platform that allows users to centrally manage their personal health data and efficiently share information with healthcare providers. The system consists of the following four main modules:

[1238] 1. Creating a user account and uploading information

[1239] The user (patient) accesses the system's registration page using a web browser. They create an account by entering their name, email address, and password, and receive a confirmation email from the system. They click the link in the confirmation email to activate their account. After their account is activated, they upload their past health checkup information and medical history data to the system in file format. The server encrypts the received files and stores them securely in a database.

[1240] 2. Real-time data update app

[1241] The user (healthcare provider) uses a dedicated app to enter the patient's medical data during medical treatment. The input form includes fields for the patient's basic information, symptoms, and diagnosis results. The device immediately sends the entered data to the server. The server immediately analyzes the received data and updates it by linking it to the patient's account. This allows the medical data to be displayed in real time, and the user (patient) can immediately check the updated medical data by logging in to their account.

[1242] 3. AI-Supported Medical Treatment Guide

[1243] The server inputs the collected past medical data into the generative AI model system. The generative AI model generates a diagnostic proposal based on the analyzed data and the latest medical guidelines. The server stores the generated diagnostic proposal within the system and provides it to the user (healthcare provider). The healthcare provider logs in to the platform to check the diagnostic proposal and, based on it, develops an appropriate medical examination and treatment plan.

[1244] For example, you might input the following prompt into a generative AI model:

[1245] "A 40-year-old man has been diagnosed with diabetes and high blood pressure in the past. His current symptoms are frequent urination and mild chest pain. I would like a diagnosis based on his blood sugar and blood pressure data from the past year."

[1246] 4. Patient Empowerment App

[1247] Users (patients) use a dedicated app to input and manage their daily health data (e.g., weight, blood pressure, exercise records). The server periodically updates the input data and reflects it in the patient's profile. The generative AI model analyzes the latest input data and generates preventive measures and a health management plan. Users (patients) receive the health management plan through the app and carry out daily health management according to that plan. Furthermore, users (patients) can send consultations and questions to healthcare providers through the app, and the server notifies the healthcare provider of the contents.

[1248] In this way, the present invention enables efficient information sharing between patients and healthcare providers, improving the quality of medical care. Furthermore, by utilizing AI, diagnostic accuracy can be improved, enabling patients to manage their own health on a daily basis.

[1249] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1250] 1. Creating a user account and uploading information

[1251] Step 1:

[1252] The user (patient) opens a web browser and accesses the system's registration page. The user enters their name, email address, and password and clicks the "Create Account" button.

[1253] Input: Name, Email Address, Password

[1254] Output: Account creation request

[1255] Step 2:

[1256] The server receives the account creation request, generates a confirmation email, and sends it to the specified email address, including an account activation link.

[1257] Input: User information

[1258] Output:Confirmation email

[1259] Step 3:

[1260] The user (patient) opens the confirmation email sent to them and clicks on the activation link.

[1261] Input: Link in confirmation email

[1262] Output: Account activation request

[1263] Step 4:

[1264] The server verifies the validity of the link and activates the account, allowing the user to log in and access their profile page.

[1265] Input: Account activation request

[1266] Output: Activated accounts

[1267] Step 5:

[1268] The user (patient) logs in and uploads files of past health checkup information and medical history data.

[1269] Input: Health checkup information and medical history data

[1270] Output: Data upload request

[1271] Step 6:

[1272] The server encrypts the received file and stores it in a database.

[1273] Input: Data upload request

[1274] Output: Encrypted database entries

[1275] 2. Real-time data update app

[1276] Step 1:

[1277] During medical treatment, the user (healthcare provider) launches a dedicated app and enters the patient's basic information, symptoms, and diagnosis results into a medical data input form.

[1278] Input: Patient basic information, symptoms, diagnosis

[1279] Output: Medical data entry request

[1280] Step 2:

[1281] The terminal transmits the input data to the server.

[1282] Input: Medical data input request

[1283] Output: Medical data transmission request

[1284] Step 3:

[1285] The server analyzes the received data, registers the correct location, and updates the patient's account information.

[1286] Input: Medical data transmission request

[1287] Output: Updated patient data

[1288] Step 4:

[1289] The user (patient) logs in to their account and checks medical data updated in real time on the app.

[1290] Input: Login request

[1291] Output: Displayed update data

[1292] 3. AI-Supported Medical Treatment Guide

[1293] Step 1:

[1294] The server inputs the collected past medical data into the generative AI model.

[1295] Input: Past medical data

[1296] Output: Parse request

[1297] Step 2:

[1298] A generative AI model analyzes the data and generates diagnostic suggestions based on the latest medical guidelines.

[1299] Input: Parse request

[1300] Output: Diagnostic suggestions

[1301] Step 3:

[1302] The server maintains the generated diagnostic suggestions within the system and provides them to healthcare providers.

[1303] Input: Diagnostic suggestion

[1304] Output: Diagnostic suggestion display request

[1305] Step 4:

[1306] The user (healthcare provider) logs into the platform and checks the diagnostic suggestions generated by the AI.

[1307] Input: Login request

[1308] Output: Displayed diagnostic suggestions

[1309] For example, you might input the following prompt into a generative AI model:

[1310] "A 40-year-old man has been diagnosed with diabetes and high blood pressure in the past. His current symptoms are frequent urination and mild chest pain. I would like a diagnosis based on his blood sugar and blood pressure data from the past year."

[1311] 4. Patient Empowerment App

[1312] Step 1:

[1313] The user (patient) uses a dedicated app to enter daily health data (e.g., weight, blood pressure, exercise records).

[1314] Input: Health data

[1315] Output: Data entry request

[1316] Step 2:

[1317] The server periodically updates the entered data to reflect the patient's profile.

[1318] Input: Data Entry Request

[1319] Output: Updated profile data

[1320] Step 3:

[1321] A generative AI model analyzes the latest input data and generates a health management plan.

[1322] Input: Updated profile data

[1323] Output: Health management plan proposal

[1324] Step 4:

[1325] The user (patient) receives and executes a health management plan through the app.

[1326] Input: Health Care Plan Proposal

[1327] Output: Implemented health care plan

[1328] Step 5:

[1329] The user (patient) sends inquiries or questions to the healthcare provider through the app.

[1330] Input: Consultation details

[1331] Output: Consultation request

[1332] Step 6:

[1333] The server notifies the medical provider of the consultation details and takes the necessary action.

[1334] Input: Consultation request

[1335] Output: Notifications and their responses

[1336] The above are the specific processing steps and operations of this system.

[1337] (Application example 1)

[1338] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1339] Conventional medical platforms lack sufficient information sharing between patients and healthcare providers, making it difficult to update health data in real time or provide appropriate advice. Communication with pharmacists in brick-and-mortar stores is particularly limited, resulting in a lack of consistent support for patients' health management. This has led to issues such as patients being unable to receive the medical services they need accurately and in a timely manner.

[1340] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1341] In this invention, the server includes a means for a user to create an account and upload medical information and health history, a means for a healthcare provider to securely access and confirm patient information in advance, a means for the user and healthcare provider to share medical data online, and a means for a pharmacist at a store to share health data with the patient and provide advice in real time, thereby enabling effective and prompt information sharing between the patient, healthcare provider, and in-store pharmacist, and enabling appropriate advice to be provided.

[1342] "User" means an individual who creates an account and manages their own health information and medical history.

[1343] "Healthcare Provider" means a professional who is authorized to access a patient's medical data and to diagnose and treat the patient.

[1344] "Medical information" refers to data about a patient's health condition and treatment that is recorded by a doctor or other healthcare provider.

[1345] "Health history" refers to the overall record of a patient's past medical treatments and medical examinations.

[1346] "Uploading" refers to the act of a user sending and storing their own data on an online platform.

[1347] "Access" means that a healthcare provider has the authority or means to view a patient's data.

[1348] "Real-time updates" means that data is updated immediately and is always up-to-date.

[1349] "Store" means a physical retail establishment, such as a drugstore or pharmacy.

[1350] A "pharmacist" is a professional who dispenses and sells medicines and provides appropriate medication and health advice to patients.

[1351] "Artificial intelligence (AI)" refers to a computer system that automatically analyzes and makes decisions based on large amounts of data.

[1352] "Diagnostic suggestions" refers to treatment and diagnostic recommendations generated by AI based on analysis results and the latest medical guidelines.

[1353] A "smartphone" refers to a mobile phone that can connect to the Internet and use multifunctional applications.

[1354] This invention provides a system that allows users to create an account, centrally manage their medical information and health history, and smoothly share information with healthcare providers. This system places emphasis on communication with pharmacists in physical stores.

[1355] The program to realize this system uses the following hardware and software.

[1356] Hardware and software used

[1357] Smartphone: A device that allows users to create an account and manage their health data.

[1358] Server: A central system that securely stores and shares user data with healthcare providers and pharmacists.

[1359] Provider application: Software that allows providers to enter and update clinical data in real time.

[1360] Pharmacist application: Software that allows pharmacists in physical stores to view patient data in real time and suggest appropriate advice and medications.

[1361] Artificial intelligence (AI) systems: Software used to analyze collected patient data and generate diagnostic suggestions.

[1362] Data processing and calculation

[1363] The server performs the following data processing and calculations:

[1364] 1. Create a user account and upload data:

[1365] Users create an account using their smartphone and upload their medical information and health history to the server, where the data is encrypted and stored securely.

[1366] 2. Real-time data updates and sharing:

[1367] Healthcare providers use a dedicated application to enter medical data and send it to a server, which updates the data in real time and associates it with the patient's account.

[1368] 3. Data sharing and advice in physical stores:

[1369] Pharmacists use a dedicated application to view patients' health data in real time, allowing them to provide appropriate medications and health advice.

[1370] 4. AI-based diagnostic suggestions:

[1371] The collected medical data is analyzed by the AI ​​system to generate diagnostic suggestions, which are then provided to healthcare providers to help them develop appropriate treatment plans.

[1372] Specific examples

[1373] 1. Patient B interacts with a pharmacist at a drugstore:

[1374] Patient B uses his / her smartphone to enter his / her health data (e.g., blood pressure, weight, medication history, etc.) into the application and uploads it to the server.

[1375] The pharmacist opens a dedicated application and views Patient B's health data in real time. Based on this data, the pharmacist provides advice on appropriate medications and lifestyle habits. The information entered by the pharmacist is immediately sent to the server, and Patient B's data is updated.

[1376] 2. Example prompt for the generative AI model:

[1377] My name is B and my health data for the past month is as follows:

[1378] Weight: 70kg

[1379] Blood pressure: 130 / 80

[1380] Health checkup revealed: High blood sugar level

[1381] Based on this data, please give me some health advice and recommended supplements. Also, please let me know if there are any points I should check.

[1382] By implementing the invention in this manner, effective information sharing between patients, healthcare providers, and pharmacists is achieved, enabling appropriate advice to be received promptly.

[1383] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1384] Step 1:

[1385] Users create accounts and upload medical information and health histories

[1386] Input: Your name, email address, password, and medical and health history data

[1387] How it works: A user accesses the account creation screen on a dedicated application using a smartphone. They enter their name, email address, and password and press the Create Account button. They then upload their medical information and past health history to the application.

[1388] Data processing: Information entered on the terminal is encrypted.

[1389] Output: The encrypted data is sent to the server and stored securely in a database.

[1390] Step 2:

[1391] Your healthcare provider will have access to your account and will review it in advance.

[1392] Input: Provider credentials and access credentials

[1393] How it works: A healthcare provider logs into a dedicated application and enters their credentials, which the server authenticates and grants the healthcare provider access.

[1394] Data calculation: The server finds the user's account information based on the received access authentication information and generates a token for secure access.

[1395] Output: Healthcare providers can access and proactively review patient medical information and health history.

[1396] Step 3:

[1397] Users and healthcare providers share medical data online

[1398] Input: User and provider credentials, clinical data

[1399] How it works: Users use their smartphones to enter medical data and send it to a server, while healthcare providers also enter data using a dedicated application.

[1400] Data processing: The server associates both sets of data with the corresponding user accounts and updates the database in real time.

[1401] Output: Updated clinical data is accessible in real time to both users and healthcare providers.

[1402] Step 4:

[1403] In-store pharmacists share health data with patients and provide real-time advice

[1404] Input: Patient health data, pharmacist credentials

[1405] How it works: Pharmacists log in to a dedicated application to access patient health data, conduct face-to-face consultations with patients, and provide appropriate medications and advice in real time based on the health data.

[1406] Data calculation: The server associates the advice entered by the pharmacist with the patient account and updates the data.

[1407] Output: Patients can check the pharmacist's advice in real time on their smartphones.

[1408] Step 5:

[1409] AI analyzes the collected data and generates diagnostic suggestions

[1410] Inputs: Patient medical data, health history, latest medical guidelines

[1411] How it works: The server inputs collected patient data into the AI ​​system, analyzes the data based on medical guidelines, and the AI ​​follows a process to generate diagnostic suggestions and makes an appropriate diagnosis.

[1412] Data computation: The AI ​​system analyzes the data and generates new diagnostic suggestions based on the generative AI model used.

[1413] Output: The generated diagnostic suggestions are provided to the healthcare provider to help develop an appropriate treatment plan.

[1414] Step 6:

[1415] Patients can check AI-generated health advice on their smartphones

[1416] Input: AI-generated diagnostic suggestions and health advice

[1417] How it works: The server sends the AI-generated diagnostic suggestions to the user's smartphone app. The user opens the app and checks the health advice and diagnostic suggestions provided by the AI.

[1418] Data processing: The server associates the diagnostic proposal with the user account and sends it.

[1419] Output: Users can instantly check diagnostic suggestions on their smartphones and use them to help manage their daily health.

[1420] In this way, the system is realized through the specific process steps of the invention.

[1421] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1422] The present invention provides a system for efficiently sharing medical information between medical providers and patients, and for recognizing the emotional state of patients to further improve the medical process. Hereinafter, embodiments of the present invention will be described in detail.

[1423] 1. Electronic medical record sharing platform

[1424] Creating a user account and uploading information

[1425] User (Patient): Accesses the system and creates a new account. Enters name, email address, and password, receives a confirmation email to activate the account, and then uploads past medical examination information and medical history data to the system.

[1426] Server: Encrypts and stores user account information and uploaded data, granting access to healthcare providers as needed. Data is stored securely and can be accessed by both users and healthcare providers when needed.

[1427] 2. Real-time data update app

[1428] Real-time data entry and sharing during medical treatment

[1429] User (healthcare provider): Uses a dedicated app during consultation and inputs patient medical data in real time, such as blood pressure, electrocardiogram results, and findings.

[1430] Terminal (provider's device): The entered data is immediately sent to the server.

[1431] Server: Rapidly updates the received data and associates it with the patient's account, so that the data is displayed in real time and can be viewed and reviewed by the patient at the same time.

[1432] 3. AI-Supported Medical Treatment Guide

[1433] Analysis of medical data and diagnostic suggestions

[1434] Server: Collected past and current medical data is input into the AI ​​system, which then analyzes the data. The AI ​​then generates diagnostic suggestions based on the latest medical guidelines.

[1435] User (healthcare provider): Logs in to the platform and checks the diagnostic suggestions generated by the AI. Based on these suggestions, the user can develop an appropriate medical treatment and treatment plan.

[1436] 4. Patient Empowerment App

[1437] Managing health data and taking preventative measures

[1438] User (patient): Uses the app to input and manage daily health data, including weight, blood pressure, and exercise records.

[1439] Server: Updates patient data periodically and provides timely health care plans.

[1440] Patient Actions: Maintain and improve the patient's health by following the plan provided by the app and carrying out daily health management.

[1441] 5. Emotion engine integration

[1442] User sentiment analysis and notification

[1443] User (patient): Uses the app to input health data and emotional feedback. Emotional data is also collected through voice and facial recognition.

[1444] Terminal (patient's device): Sends collected emotion data to the server.

[1445] Server: The emotion engine analyzes the emotion data and evaluates the patient's emotional state. The result of this evaluation is then sent to the healthcare provider.

[1446] User (healthcare provider): Receives notifications from the emotion engine and conducts consultations while taking into account the patient's emotional state. If necessary, provides counseling or medical advice to the patient.

[1447] Specific examples

[1448] To give a specific example, patient A creates a new account in the system and uploads his or her past medical information. When visiting healthcare provider B for a regular checkup, B uses a dedicated app to enter the medical data and updates the results in real time. The AI ​​system analyzes A's data and provides diagnostic suggestions based on the latest medical guidelines. A manages his or her own health data through the app and improves lifestyle habits according to a health management plan. In addition, the emotion engine analyzes A's voice and facial expressions and notifies healthcare provider B of his or her emotional state, such as stress or anxiety. B then provides appropriate counseling and advice.

[1449] The system enables efficient information sharing between patients and healthcare providers and utilizes an emotion engine to comprehensively manage patients' physical and mental health.

[1450] The processing flow will be explained below.

[1451] Processing steps of the electronic medical record sharing platform

[1452] Step 1: Create a user account

[1453] User: Accesses the platform, enters their name, email address and password in the registration form and presses the "Create Account" button.

[1454] Server: Receives registration information and stores it in a database. Generates and sends a confirmation email to the user's email address.

[1455] Users: Click the link in the confirmation email they receive to activate their account.

[1456] Step 2: Upload your medical information and health history

[1457] User: After logging in, select the file containing past medical information and health history and press the "Upload" button.

[1458] Server: Receives the file, encrypts the data, stores it in the database, and notifies the user when the data has been saved.

[1459] Step 3: Provider Access

[1460] User (healthcare provider): Logs in to the platform with a dedicated account.

[1461] Server: Verifies the healthcare provider's authorization and provides accessible patient data.

[1462] User (healthcare provider): View the patient's past medical information and understand the information necessary for treatment in advance.

[1463] Processing steps of the real-time data update app

[1464] Step 1: Enter your medical data

[1465] User (healthcare provider): Uses a dedicated app during consultation to input patient medical results, such as blood pressure, electrocardiogram results, and other findings, in real time.

[1466] Terminal (provider's device): The entered data is immediately sent to the server.

[1467] Step 2: Update and notify data

[1468] Server: Immediately updates the received medical data in the database and associates it with the patient's account. Sends a notification to the user (healthcare provider) that the update is complete.

[1469] User (Patient): Logs in to the app and checks medical data updated in real time. Data can be checked immediately after the consultation.

[1470] AI-supported medical treatment guide processing steps

[1471] Step 1: Collect and analyze medical data

[1472] Server: Inputs the patient's past and current medical data into the AI ​​system.

[1473] AI system: Analyzes data and generates diagnostic suggestions based on the latest medical guidelines.

[1474] Step 2: Providing diagnostic suggestions

[1475] Server: Sends AI-generated diagnostic suggestions to healthcare provider accounts.

[1476] User (healthcare provider): Logs in to the platform, checks the AI's diagnostic suggestions, and uses the suggestions to diagnose the patient.

[1477] Patient Empowerment App Processing Steps

[1478] Step 1: Enter and manage your health data

[1479] User (patient): Logs in to the app and enters daily health data (weight, blood pressure, diet, exercise, etc.).

[1480] Terminal (patient's device): Sends the entered data to the server.

[1481] Step 2: Provide a health care plan

[1482] Server: Analyzes the patient's health data, generates preventative measures and health management plans, and sends the plans to the patient's account.

[1483] User (patient): Check the health management plan provided through the app and incorporate it into their daily life.

[1484] Step 3: Collaborate with your healthcare provider

[1485] Users (patients): If they have health questions or concerns, they can contact their healthcare provider through the app.

[1486] User (healthcare provider): Responds to patient questions and provides necessary advice and treatment plans.

[1487] Emotion Engine Processing Steps

[1488] Step 1: Collecting emotion data

[1489] User (patient): Uses the app to input health data and emotional feedback. Emotional data is recorded using voice input and facial recognition.

[1490] Terminal (patient's device): Sends collected emotion data to the server.

[1491] Step 2: Analyze the emotion data

[1492] Server: Analyzes the transmitted emotion data using the emotion engine, assessing the emotional state (e.g., stress, joy, anxiety).

[1493] Step 3: Informing and leveraging emotion data

[1494] Server: Sends analysis results to the healthcare provider's account, including a detailed assessment of the patient's emotional state.

[1495] User (healthcare provider): Based on the notification, understand the patient's emotional state and use it as a reference for medical treatment and counseling. If necessary, provide additional counseling or medical advice to the patient.

[1496] Through these processing steps, the Health Quality Connect system enables efficient data sharing between patients and healthcare providers, diagnostic support using AI, and comprehensive health management through the use of an emotion engine.

[1497] Example 2

[1498] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1499] In modern medical settings, efficient sharing of medical information between patients and healthcare providers is important, but information sharing is often not smooth. Furthermore, there is a lack of means to accurately grasp a patient's emotional state and provide appropriate medical treatment and counseling based on that information. Furthermore, there is a need for a system that can efficiently manage daily health data and provide appropriate health management plans.

[1500] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for a user to create an account and upload medical information and health history; a means for a healthcare provider to securely access and confirm patient information in advance; a means for a user and a healthcare provider to share medical data online; a means for inputting the user's emotional data and transmitting it to the server via a terminal; and a means for an artificial intelligence (AI) to analyze the emotional data and notify the healthcare provider of the results. This enables efficient sharing of medical information and provision of detailed medical care that takes the patient's emotional state into consideration. The system also includes: a means for a healthcare provider to input patient data in real time during medical care; a means for updating the shared medical data in real time and providing it to the patient and healthcare provider; a means for an AI to analyze the medical data and generate a diagnostic suggestion based on the latest medical guidelines; and a means for providing the generated diagnostic suggestion to the healthcare provider. This results in improved quality of medical care and faster diagnostic suggestions. The system also includes: a means for a user to input daily health data and transmit it to the server; and a means for the server to periodically update the health data and provide a health management plan. This will make daily health management more efficient and is expected to help maintain and improve patients' health.

[1501] "User" refers to a person who accesses the system, creates an account, and uploads medical information and health history.

[1502] "Healthcare provider" refers to a professional who provides medical treatment and counseling to patients, who accesses patient information through the system, and who inputs and checks medical data.

[1503] "Server" refers to a computer system that stores data entered by users and healthcare providers and analyzes and updates the data as needed.

[1504] "Account creation" refers to the process by which a new user accessing the system enters information such as name, email address, and password and registers with the system.

[1505] "Medical information" refers to all data related to medical treatment, such as patient medical records, test results, and treatment history.

[1506] "Health history" refers to all records related to a patient's health status, including past medical examination results and medical history.

[1507] "Upload" refers to the act of a user sending data from their local device to the system.

[1508] "Online medical data sharing" refers to a state in which users and medical providers can check and update medical data in real time via the Internet.

[1509] "Emotional data" refers to information that indicates a patient's emotional state, and is collected through self-input feedback or through voice and facial recognition.

[1510] "Terminal" refers to the device (e.g., smartphone, tablet, or PC) used by a user or healthcare provider to access the system.

[1511] "Artificial intelligence" refers to computer programs that contain machine learning algorithms to analyze input data and provide diagnostic suggestions or assessments of emotional states.

[1512] "Diagnostic suggestions" refers to the presentation of recommendations regarding medical examinations and treatments based on data analyzed by artificial intelligence.

[1513] "Health data" refers to various data related to a patient's health condition, such as daily weight, blood pressure, and exercise records.

[1514] A "health management plan" refers to providing a plan based on collected health data that includes appropriate preventive measures and instructions for lifestyle improvements.

[1515] The present invention provides a system for enabling users and healthcare providers to efficiently share medical information and recognize the emotional state of patients to improve the medical process. Hereinafter, embodiments of the present invention will be described in detail.

[1516] 1. Electronic medical record sharing platform

[1517] Creating a user account and uploading information

[1518] User (Patient):

[1519] A user accesses the system and clicks the "Create a new account" button. Next, they enter their name, email address, and password in the form to create an account. Once the account is created, a confirmation email is sent to the user's email address. The user clicks the link in the email to activate the account. After that, they upload past health checkup results and medical history data to the system. For example, they select a PDF or image file and click the "Upload" button.

[1520] server:

[1521] The server encrypts the entered account information and stores it in a database. All data uploaded by users is also encrypted and stored securely, with appropriate access rights set to allow healthcare providers to access it as needed.

[1522] 2. Real-time data update app

[1523] Real-time data entry and sharing during medical treatment

[1524] User (healthcare provider):

[1525] During consultations, healthcare providers open a dedicated app and input patient data in real time, including blood pressure, electrocardiogram results, and clinical findings.

[1526] Terminal (provider device):

[1527] The device immediately sends this data to the server. The data is sent by clicking the "Send" button in the app.

[1528] server:

[1529] The server rapidly updates the received data with the corresponding patient account information, making the data visible to both patients and healthcare providers in real time.

[1530] 3. AI-Supported Medical Treatment Guide

[1531] Analysis of medical data and diagnostic suggestions

[1532] server:

[1533] The server collects past and current medical data and inputs it into an artificial intelligence (AI) system, which generates diagnostic suggestions based on the latest medical guidelines.

[1534] User (healthcare provider):

[1535] Healthcare providers log in to the platform and view diagnostic suggestions generated by the AI, which they then use to develop optimal treatment plans.

[1536] 4. Patient Empowerment App

[1537] Managing health data and taking preventative measures

[1538] User (Patient):

[1539] Users use the app to input their daily health data, including weight, blood pressure, exercise records, etc. The data is saved by pressing the "Save" button.

[1540] server:

[1541] The server periodically updates this data and provides users with appropriate health management plans, such as suggesting specific exercise plans based on data indicating a lack of exercise.

[1542] 5. Emotion engine integration

[1543] User sentiment analysis and notification

[1544] User (Patient):

[1545] Users input their emotional feedback within the app, and emotional data is automatically collected using voice and facial recognition.

[1546] Terminal (patient device):

[1547] The device transmits the collected emotion data to the server.

[1548] server:

[1549] The server analyzes the emotion data using an emotion engine and notifies the healthcare provider of the results of the emotion assessment.

[1550] User (healthcare provider):

[1551] Healthcare providers receive notifications from the emotion engine and take the patient's emotional state into consideration as they conduct consultations, providing counseling and appropriate medical advice as needed.

[1552] Specific examples

[1553] Patients create a new account on the system and upload their past medical information. During regular checkups, healthcare providers use a dedicated app to enter medical data and update results in real time. The AI ​​system analyzes the data and generates diagnostic suggestions based on the latest medical guidelines. Patients manage their health data through the app and work to improve their lifestyle based on a health management plan. In addition, an emotion engine analyzes voice and facial expression data and notifies healthcare providers of stress and anxiety. Healthcare providers then provide appropriate counseling and advice to the patient.

[1554] Examples of suitable prompts for the AI ​​model

[1555] "Please explain in detail how a system allows you to upload a patient's past medical records and use AI to generate diagnostic suggestions based on the latest medical guidelines."

[1556] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1557] Electronic medical record sharing platform

[1558] Creating a user account and uploading information

[1559] Step 1:

[1560] User (patient): The user accesses the system and clicks the "Create a new account" button. Input includes name, email address, and password. Enter this information and press the "Submit" button.

[1561] Input: Name, Email Address, Password

[1562] Output: Send information to the server

[1563] Step 2:

[1564] Server: The server automatically generates a confirmation email based on the received information and sends it to the user's email address. The user clicks on the link in the email to activate their account.

[1565] Input: User's name, email address, and password

[1566] Data processing: Confirmation email generation

[1567] Output: Send confirmation email

[1568] Step 3:

[1569] User (Patient): After the account is activated, the user uploads their past medical examination information and medical history data to the system, for example, by selecting a PDF file or image file and clicking the "Upload" button.

[1570] Input: Health checkup information, medical history data

[1571] Output: Send data to the server

[1572] Step 4:

[1573] Server: The server encrypts the uploaded data and stores it in a secure database, granting access rights to healthcare providers as needed.

[1574] Input: Uploaded medical examination information, medical history data

[1575] Data processing: Data encryption

[1576] Output: Data stored in a secure database

[1577] Real-time data update app

[1578] Real-time data entry and sharing during medical treatment

[1579] Step 1:

[1580] User (healthcare provider): The healthcare provider opens the dedicated app and inputs the patient's medical data (blood pressure, electrocardiogram results, findings, etc.) in real time. After inputting, he / she presses the "Send" button.

[1581] Input: Medical data

[1582] Output: Data input to the terminal

[1583] Step 2:

[1584] Terminal (provider's device): The terminal immediately transmits the entered data to the server. This process occurs in real time using a network connection.

[1585] Input: Medical data

[1586] Output: Send data to the server

[1587] Step 3:

[1588] Server: The server rapidly updates the received data and associates it with the appropriate patient account, making the data available in real time and accessible to patients via their own devices.

[1589] Input: Medical data

[1590] Data processing: Data update

[1591] Output: Save and display the updated data

[1592] AI-supported medical treatment guide

[1593] Analysis of medical data and diagnostic suggestions

[1594] Step 1:

[1595] Server: The server inputs collected past and current medical data into the AI ​​system.

[1596] Input: Past and current medical data

[1597] Output: Sending data to an AI system

[1598] Step 2:

[1599] AI system: AI generates diagnostic suggestions based on the latest medical guidelines and past clinical data.

[1600] Input: Clinical data and medical guidelines

[1601] Data processing: Data analysis and generation of diagnostic suggestions

[1602] Output: Diagnostic suggestions

[1603] Step 3:

[1604] User (healthcare provider): The healthcare provider logs in to the platform and checks the diagnostic suggestions generated by the AI. Based on these suggestions, the healthcare provider decides on the final treatment plan.

[1605] Input: Diagnostic suggestion

[1606] Output: Treatment plan

[1607] Patient Empowerment App

[1608] Managing health data and taking preventative measures

[1609] Step 1:

[1610] User (patient): The user uses the app to enter daily health data (weight, blood pressure, exercise records, etc.), enters the data, and presses the "Save" button.

[1611] Input: Health data

[1612] Output: Data input to the app

[1613] Step 2:

[1614] Server: The server periodically updates and securely stores the entered data.

[1615] Input: Health data

[1616] Data processing: updating and saving data

[1617] Output: Save the updated data

[1618] Step 3:

[1619] Server: The server performs health checks based on the recorded data and provides appropriate health management plans. For example, it suggests specific exercise plans if the user is not getting enough exercise.

[1620] Input: Updated health data

[1621] Data processing: generating health management plans

[1622] Output: Healthcare plan

[1623] Emotion engine integration

[1624] User sentiment analysis and notification

[1625] Step 1:

[1626] User (patient): The user enters their own emotional feedback within the app. In addition, emotional data is automatically collected using voice and facial recognition.

[1627] Input: Emotional feedback, voice data, facial expression data

[1628] Output: Data input to the app

[1629] Step 2:

[1630] Terminal (patient's device): The terminal transmits the collected emotion data to the server.

[1631] Input: Emotion data

[1632] Output: Send data to the server

[1633] Step 3:

[1634] Server: The server uses an emotion engine to analyze the emotion data and evaluate the emotional state.

[1635] Input: Emotion data

[1636] Data processing: Emotion data analysis

[1637] Output: Sentiment rating

[1638] Step 4:

[1639] Server: The server notifies the healthcare provider of the results of the emotion assessment.

[1640] Input: Emotion rating

[1641] Output: Notification of emotion evaluation result

[1642] Step 5:

[1643] User (healthcare provider): The healthcare provider receives notifications from the emotion engine and examines the patient while taking into account their emotional state. If necessary, they provide counseling or appropriate medical advice.

[1644] Input: Emotion evaluation result

[1645] Output: consultation plan, counselling and medical advice

[1646] (Application example 2)

[1647] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1648] With conventional systems, it was difficult to grasp the emotional state of patients and customers in real time in medical and customer service settings, making it difficult to respond appropriately and quickly. This made it difficult to provide services that met individual needs, and improving customer satisfaction was an issue.

[1649] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a user to create an account and upload medical information and health history, a means for a healthcare provider to securely access and confirm patient information in advance, a means for the user and healthcare provider to share medical data online, a means for capturing a customer's facial expression using smart glasses and analyzing their emotions, and a means for storing the analyzed customer's emotional data in a database and making service suggestions. This makes it possible to grasp the customer's emotional state in real time and suggest appropriate services based on that.

[1650] A "user account" is individual identification information assigned to each user who uses the system.

[1651] "Medical information" is health-related data collected by healthcare providers, such as patient consultations and medical records.

[1652] "Health history" refers to records relating to an individual's health, including the patient's past medical examination results, medical history, and treatment history.

[1653] "Healthcare providers" are professionals who provide health care services, such as doctors, nurses, and pharmacists.

[1654] "Online" medical data sharing refers to the ability to view and update patient information in real time via the Internet.

[1655] "Smart glasses" are eyeglass-type wearable devices worn by users that have camera and display functions.

[1656] "Customer's facial expression" is information that indicates the emotional state through changes in facial expression.

[1657] "Emotion analysis" is the process of identifying individual emotional states from facial expressions and vocal acoustic patterns using image processing techniques and machine learning.

[1658] A "database" is a system for storing and managing data in digital form, and is a means for quickly retrieving data when needed.

[1659] A "service proposal" is a specific proposal to provide appropriate products or services based on the customer's needs and emotional state.

[1660] "Real-time" refers to instant data transmission and processing without delay, meaning that current information is reflected and processed immediately.

[1661] "Artificial intelligence (AI)" is a technology that enables computer systems to mimic human intelligence and learn, reason, perceive, and make decisions.

[1662] The present invention provides a system that efficiently shares medical information between healthcare providers and patients, recognizes patients' emotional states, and further improves the medical process. It also integrates emotion recognition and service suggestion functions using smart glasses to improve customer service in brick-and-mortar stores.

[1663] 1. Overview of the entire system

[1664] The system includes the following main measures:

[1665] A means for users to create accounts and upload medical information and health history

[1666] A means for healthcare providers to securely access and proactively review patient information

[1667] A means for users and healthcare providers to share medical data online

[1668] A method to capture customer facial expressions and analyze their emotions using smart glasses

[1669] A means of storing analyzed customer emotion data in a database and making service suggestions

[1670] 2. Hardware and Software Used

[1671] The system uses the following hardware and software:

[1672] Hardware:

[1673] Smart glasses (e.g. Google Glass)

[1674] Camera (built into smart glasses)

[1675] Server (operating database and AI model)

[1676] Devices (used by healthcare providers and store employees)

[1677] software:

[1678] OpenCV (camera operation and image processing)

[1679] Keras (emotion recognition model)

[1680] TensorFlow (deep learning such as sentiment analysis)

[1681] SQLite (database management)

[1682] 3. Data processing and calculation procedures

[1683] The server acquires facial expression data captured by the smart glasses and performs emotion analysis using natural language processing and image processing technologies. This involves camera operation and image processing using OpenCV, and deep learning models using Keras and TensorFlow. The analysis results are stored in an SQLite database, and service proposals for the customer are generated at specific times and displayed on the smart glasses display.

[1684] 4. Specific Examples

[1685] For example, while a customer is browsing products in a physical store, a salesperson wearing smart glasses can capture the customer's face and analyze their emotions in real time. If the customer is smiling, the system will display a notification on the salesperson's smart glasses saying, "Please suggest a new promotion." On the other hand, if the customer is sad, the system will suggest, "Provide special service." This entire process is appropriately carried out by the analysis of an AI model.

[1686] 5. Example prompts to be input to the generative AI model

[1687] "Develop an application that uses smart glasses to assist in customer service in brick-and-mortar stores. This application will provide optimal service to customers by capturing customer facial expressions in real time and analyzing their emotional state. Specifically, the application will take a photo of the customer's face with a camera, analyze the results with an emotion recognition model, and store the results in an SQLite database. Based on the analysis results, the application will suggest appropriate services to staff."

[1688] This system is expected to improve customer service in brick-and-mortar stores, and also to streamline medical procedures and empower patients in medical settings.

[1689] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1690] Step 1:

[1691] The server creates user accounts and uploads medical information and health history. Users access the system, create an account, enter their name, email address, and password, and receive a confirmation email to activate their account. They then upload past medical examination information and medical history data to the system. The server encrypts and stores the uploaded data, allowing secure access to healthcare providers.

[1692] Step 2:

[1693] The device inputs patient data in real time during medical examinations and sends it to a server. Healthcare providers use a dedicated app to input patient medical data (e.g., blood pressure, electrocardiogram results, findings, etc.) in real time. The input data is immediately sent to the server, which stores the data in a database and updates it promptly.

[1694] Step 3:

[1695] The server analyzes the collected data using artificial intelligence (AI) and generates a diagnostic suggestion. The server inputs the collected past and current medical data into the AI ​​system, which then analyzes the data. The AI ​​generates a diagnostic suggestion based on the latest medical guidelines and provides the results to healthcare providers.

[1696] Step 4:

[1697] The device captures the customer's facial expression through the smart glasses and sends the data to the server.The smart glasses' camera captures the customer's face and sends it to the server as image data.

[1698] Step 5:

[1699] The server analyzes the image data and determines the customer's emotional state. The received image data is preprocessed using OpenCV and analyzed using an emotion recognition model using Keras and TensorFlow. The emotional state (e.g., happy, sad, surprised, etc.) is determined.

[1700] Step 6:

[1701] The server saves the analysis results in a database and generates appropriate service proposals. The analyzed emotion data is stored in an SQLite database and appropriate service proposals are generated based on the customer's state. For example, if the customer is determined to be happy, a proposal such as "Propose a new promotion" is generated, and if the customer is determined to be sad, a proposal such as "Provide a special service" is generated.

[1702] Step 7:

[1703] The device notifies the smart glasses of the proposed service, which then displays the notification of the proposed service sent from the server, allowing store employees to provide the service to the customer at the appropriate time.

[1704] Through the above steps, the present invention realizes a system that improves medical and brick-and-mortar store services.

[1705] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1706] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1707] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1708] [Fourth embodiment]

[1709] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1710] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1711] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1712] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1713] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1714] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1715] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1716] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1717] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1718] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1719] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1720] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1721] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1722] The present invention provides a platform that allows users to centrally manage their personal health data and efficiently share information with healthcare providers. The following is a detailed description of embodiments of the present invention.

[1723] 1. Electronic medical record sharing platform

[1724] Creating a user account and uploading information

[1725] User (Patient): Accesses the system and creates a new account. Enters name, email address, and password, receives a confirmation email to activate the account, and then uploads past medical examination information and medical history data to the system.

[1726] Server: Encrypts and stores user account information and uploaded data, granting access to healthcare providers as needed. Data is stored securely and can be accessed by both users and healthcare providers when needed.

[1727] 2. Real-time data update app

[1728] Real-time data entry and sharing during medical treatment

[1729] User (healthcare provider): Uses a dedicated app during consultation to input patient medical data in real time. The input data is immediately sent to the system.

[1730] Server: Rapidly updates the received data and associates it with the patient's account, so that the data is displayed in real time and can be viewed and reviewed by the patient at the same time.

[1731] 3. AI-Supported Medical Treatment Guide

[1732] Analysis of medical data and diagnostic suggestions

[1733] Server: Collected past medical data is input into the AI ​​system and analyzed. The AI ​​then generates diagnostic suggestions based on the latest medical guidelines.

[1734] User (healthcare provider): Logs in to the platform and checks the diagnostic suggestions generated by the AI. Based on these suggestions, the user can develop an appropriate medical treatment and treatment plan.

[1735] 4. Patient Empowerment App

[1736] Managing health data and taking preventative measures

[1737] User (patient): Uses the app to input and manage daily health data, including weight, blood pressure, and exercise records.

[1738] Server: Updates patient data periodically and provides timely health care plans.

[1739] Patient actions: Carry out daily health management according to the plan provided by the app. If necessary, the patient can consult and exchange opinions with their healthcare provider through the app.

[1740] Specific examples

[1741] To give a specific example, patient A creates a new account on the platform and uploads his or her past medical history. A then visits healthcare provider B for a regular checkup. B uses a dedicated app to input the medical data and updates A's data in real time with the results. The AI ​​system analyzes A's past data and generates diagnostic suggestions based on the medical guidelines, which are then provided to B. A can manage his or her own health data through the app and follow the submitted health management plan to live a healthier life.

[1742] In this way, the present invention can realize effective information sharing between patients and healthcare providers, improving the quality of medical care. It can also improve diagnostic accuracy by utilizing AI.

[1743] The processing flow will be explained below.

[1744] Processing steps of the electronic medical record sharing platform

[1745] Step 1: Create a user account

[1746] User: Accesses the platform, enters their name, email address and password in the registration form and presses the "Create Account" button.

[1747] Server: Receives registration information and stores it in a database. Generates and sends a confirmation email to the user's email address.

[1748] Users: Click the link in the confirmation email they receive to activate their account.

[1749] Step 2: Upload your medical information and health history

[1750] User: After logging in, select the file containing past medical information and health history and press the "Upload" button.

[1751] Server: Receives the file, encrypts the data, stores it in the database, and notifies the user when the data has been saved.

[1752] Step 3: Provider Access

[1753] User (healthcare provider): Logs in to the platform with a dedicated account.

[1754] Server: Verifies the healthcare provider's authorization and provides accessible patient data.

[1755] User (healthcare provider): View the patient's past medical information and understand the information necessary for treatment in advance.

[1756] Processing steps of the real-time data update app

[1757] Step 1: Enter your medical data

[1758] User (healthcare provider): Uses a dedicated app during consultation to input patient medical results, such as blood pressure, electrocardiogram results, and other findings, in real time.

[1759] Terminal (provider's device): The entered data is immediately sent to the server.

[1760] Step 2: Update and notify data

[1761] Server: Immediately updates the received medical data in the database and associates it with the patient's account. Sends a notification to the user (healthcare provider) that the update is complete.

[1762] User (Patient): Logs in to the app and checks medical data updated in real time. Data can be checked immediately after the consultation.

[1763] AI-supported medical treatment guide processing steps

[1764] Step 1: Collect and analyze medical data

[1765] Server: Inputs the patient's past and current medical data into the AI ​​system.

[1766] AI system: Analyzes data and generates diagnostic suggestions based on the latest medical guidelines.

[1767] Step 2: Providing diagnostic suggestions

[1768] Server: Sends AI-generated diagnostic suggestions to healthcare provider accounts.

[1769] User (healthcare provider): Logs in to the platform, checks the AI's diagnostic suggestions, and uses the suggestions to diagnose the patient.

[1770] Patient Empowerment App Processing Steps

[1771] Step 1: Enter and manage your health data

[1772] User (patient): Logs in to the app and enters daily health data (weight, blood pressure, diet, exercise, etc.).

[1773] Terminal (patient's device): Sends the entered data to the server.

[1774] Step 2: Provide a health care plan

[1775] Server: Analyzes the patient's health data, generates preventative measures and health management plans, and sends the plans to the patient's account.

[1776] User (patient): Check the health management plan provided through the app and incorporate it into their daily life.

[1777] Step 3: Collaborate with your healthcare provider

[1778] Users (patients): If they have health questions or concerns, they can contact their healthcare provider through the app.

[1779] User (healthcare provider): Responds to patient questions and provides necessary advice and treatment plans.

[1780] Through these processing steps, the Health Quality Connect system enables efficient data sharing between patients and healthcare providers and improves medical quality.

[1781] Example 1

[1782] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1783] In today's world, the management and sharing of medical information is extremely important, but traditional systems make it difficult to efficiently share information between patients and healthcare providers, which can affect the quality of medical care and the accuracy of diagnoses. Another issue is the lack of effective ways for patients to manage their own health data on a daily basis and collaborate with healthcare providers to manage their health.

[1784] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1785] In this invention, the server includes a means for users to create an account and upload medical information and health history, a means for healthcare providers to securely access and confirm patient information in advance, a means for users and healthcare providers to share medical data online, a means for users to input and manage daily health data using a dedicated app, and a means for encrypting and storing collected patient data. This allows patients and healthcare providers to efficiently share information and improve the quality of medical care, and also enables patients to manage their own health data on a daily basis and effectively manage their health.

[1786] "User" means a person or individual who accesses this system, creates an account, and inputs and manages medical information and health data.

[1787] A "healthcare provider" is a person or entity that is a medical professional providing medical care or services, inputs patient medical data, and uses AI-based diagnostic suggestions.

[1788] An "account" is a set of dedicated identification and login information that allows a user to access the system and manage personal and medical information.

[1789] "Medical information" refers to detailed data about a patient, such as diagnostic results, symptoms, and medical history, that is used by healthcare providers during consultations.

[1790] "Health history" is data including the user's past health condition, medical history, test results, and the like.

[1791] "Upload" is the operation by which a user sends and stores data from their device to the system.

[1792] A "dedicated app" is a software application for a specific purpose that allows users to input and manage their daily health data.

[1793] "Encryption" is a technology that converts data so that it cannot be deciphered by third parties, and is a means of storing it safely.

[1794] "Sharing medical data online" means that users and medical providers can instantly view and use information with each other via the Internet.

[1795] "Real-time updates" refers to the process by which a system instantly reflects data and keeps it up to date.

[1796] "Artificial intelligence (AI)" refers to a computer system that analyzes large amounts of data, learns, infers, and generates decisions such as diagnostic suggestions.

[1797] "Diagnostic suggestions" are specific recommendations for diagnoses and treatment plans presented to healthcare providers based on data analyzed by AI.

[1798] A "health management plan" is a specific action plan or advice provided to a user to maintain or improve their daily health.

[1799] The "system" is a platform that includes all of the above elements and functions, enabling patients and healthcare providers to effectively share information and improve the quality of medical care.

[1800] The present invention provides a platform that allows users to centrally manage their personal health data and efficiently share information with healthcare providers. The system consists of the following four main modules:

[1801] 1. Creating a user account and uploading information

[1802] The user (patient) accesses the system's registration page using a web browser. They create an account by entering their name, email address, and password, and receive a confirmation email from the system. They click the link in the confirmation email to activate their account. After their account is activated, they upload their past health checkup information and medical history data to the system in file format. The server encrypts the received files and stores them securely in a database.

[1803] 2. Real-time data update app

[1804] The user (healthcare provider) uses a dedicated app to enter the patient's medical data during medical treatment. The input form includes fields for the patient's basic information, symptoms, and diagnosis results. The device immediately sends the entered data to the server. The server immediately analyzes the received data and updates it by linking it to the patient's account. This allows the medical data to be displayed in real time, and the user (patient) can immediately check the updated medical data by logging in to their account.

[1805] 3. AI-Supported Medical Treatment Guide

[1806] The server inputs the collected past medical data into the generative AI model system. The generative AI model generates a diagnostic proposal based on the analyzed data and the latest medical guidelines. The server stores the generated diagnostic proposal within the system and provides it to the user (healthcare provider). The healthcare provider logs in to the platform to check the diagnostic proposal and, based on it, develops an appropriate medical examination and treatment plan.

[1807] For example, you might input the following prompt into a generative AI model:

[1808] "A 40-year-old man has been diagnosed with diabetes and high blood pressure in the past. His current symptoms are frequent urination and mild chest pain. I would like a diagnosis based on his blood sugar and blood pressure data from the past year."

[1809] 4. Patient Empowerment App

[1810] Users (patients) use a dedicated app to input and manage their daily health data (e.g., weight, blood pressure, exercise records). The server periodically updates the input data and reflects it in the patient's profile. The generative AI model analyzes the latest input data and generates preventive measures and a health management plan. Users (patients) receive the health management plan through the app and carry out daily health management according to that plan. Furthermore, users (patients) can send consultations and questions to healthcare providers through the app, and the server notifies the healthcare provider of the contents.

[1811] In this way, the present invention enables efficient information sharing between patients and healthcare providers, improving the quality of medical care. Furthermore, by utilizing AI, diagnostic accuracy can be improved, enabling patients to manage their own health on a daily basis.

[1812] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1813] 1. Creating a user account and uploading information

[1814] Step 1:

[1815] The user (patient) opens a web browser and accesses the system's registration page. The user enters their name, email address, and password and clicks the "Create Account" button.

[1816] Input: Name, Email Address, Password

[1817] Output: Account creation request

[1818] Step 2:

[1819] The server receives the account creation request, generates a confirmation email, and sends it to the specified email address, including an account activation link.

[1820] Input: User information

[1821] Output:Confirmation email

[1822] Step 3:

[1823] The user (patient) opens the confirmation email sent to them and clicks on the activation link.

[1824] Input: Link in confirmation email

[1825] Output: Account activation request

[1826] Step 4:

[1827] The server verifies the validity of the link and activates the account, allowing the user to log in and access their profile page.

[1828] Input: Account activation request

[1829] Output: Activated accounts

[1830] Step 5:

[1831] The user (patient) logs in and uploads files of past health checkup information and medical history data.

[1832] Input: Health checkup information and medical history data

[1833] Output: Data upload request

[1834] Step 6:

[1835] The server encrypts the received file and stores it in a database.

[1836] Input: Data upload request

[1837] Output: Encrypted database entries

[1838] 2. Real-time data update app

[1839] Step 1:

[1840] During medical treatment, the user (healthcare provider) launches a dedicated app and enters the patient's basic information, symptoms, and diagnosis results into a medical data input form.

[1841] Input: Patient basic information, symptoms, diagnosis

[1842] Output: Medical data entry request

[1843] Step 2:

[1844] The terminal transmits the input data to the server.

[1845] Input: Medical data input request

[1846] Output: Medical data transmission request

[1847] Step 3:

[1848] The server analyzes the received data, registers the correct location, and updates the patient's account information.

[1849] Input: Medical data transmission request

[1850] Output: Updated patient data

[1851] Step 4:

[1852] The user (patient) logs in to their account and checks medical data updated in real time on the app.

[1853] Input: Login request

[1854] Output: Displayed update data

[1855] 3. AI-Supported Medical Treatment Guide

[1856] Step 1:

[1857] The server inputs the collected past medical data into the generative AI model.

[1858] Input: Past medical data

[1859] Output: Parse request

[1860] Step 2:

[1861] A generative AI model analyzes the data and generates diagnostic suggestions based on the latest medical guidelines.

[1862] Input: Parse request

[1863] Output: Diagnostic suggestions

[1864] Step 3:

[1865] The server maintains the generated diagnostic suggestions within the system and provides them to healthcare providers.

[1866] Input: Diagnostic suggestion

[1867] Output: Diagnostic suggestion display request

[1868] Step 4:

[1869] The user (healthcare provider) logs into the platform and checks the diagnostic suggestions generated by the AI.

[1870] Input: Login request

[1871] Output: Displayed diagnostic suggestions

[1872] For example, you might input the following prompt into a generative AI model:

[1873] "A 40-year-old man has been diagnosed with diabetes and high blood pressure in the past. His current symptoms are frequent urination and mild chest pain. I would like a diagnosis based on his blood sugar and blood pressure data from the past year."

[1874] 4. Patient Empowerment App

[1875] Step 1:

[1876] The user (patient) uses a dedicated app to enter daily health data (e.g., weight, blood pressure, exercise records).

[1877] Input: Health data

[1878] Output: Data entry request

[1879] Step 2:

[1880] The server periodically updates the entered data to reflect the patient's profile.

[1881] Input: Data Entry Request

[1882] Output: Updated profile data

[1883] Step 3:

[1884] A generative AI model analyzes the latest input data and generates a health management plan.

[1885] Input: Updated profile data

[1886] Output: Health management plan proposal

[1887] Step 4:

[1888] The user (patient) receives and executes a health management plan through the app.

[1889] Input: Health Care Plan Proposal

[1890] Output: Implemented health care plan

[1891] Step 5:

[1892] The user (patient) sends inquiries or questions to the healthcare provider through the app.

[1893] Input: Consultation details

[1894] Output: Consultation request

[1895] Step 6:

[1896] The server notifies the medical provider of the consultation details and takes the necessary action.

[1897] Input: Consultation request

[1898] Output: Notifications and their responses

[1899] The above are the specific processing steps and operations of this system.

[1900] (Application example 1)

[1901] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1902] Conventional medical platforms lack sufficient information sharing between patients and healthcare providers, making it difficult to update health data in real time or provide appropriate advice. Communication with pharmacists in brick-and-mortar stores is particularly limited, resulting in a lack of consistent support for patients' health management. This has led to issues such as patients being unable to receive the medical services they need accurately and in a timely manner.

[1903] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1904] In this invention, the server includes a means for a user to create an account and upload medical information and health history, a means for a healthcare provider to securely access and confirm patient information in advance, a means for the user and healthcare provider to share medical data online, and a means for a pharmacist at a store to share health data with the patient and provide advice in real time, thereby enabling effective and prompt information sharing between the patient, healthcare provider, and in-store pharmacist, and enabling appropriate advice to be provided.

[1905] "User" means an individual who creates an account and manages their own health information and medical history.

[1906] "Healthcare Provider" means a professional who is authorized to access a patient's medical data and to diagnose and treat the patient.

[1907] "Medical information" refers to data about a patient's health condition and treatment that is recorded by a doctor or other healthcare provider.

[1908] "Health history" refers to the overall record of a patient's past medical treatments and medical examinations.

[1909] "Uploading" refers to the act of a user sending and storing their own data on an online platform.

[1910] "Access" means that a healthcare provider has the authority or means to view a patient's data.

[1911] "Real-time updates" means that data is updated immediately and is always up-to-date.

[1912] "Store" means a physical retail establishment, such as a drugstore or pharmacy.

[1913] A "pharmacist" is a professional who dispenses and sells medicines and provides appropriate medication and health advice to patients.

[1914] "Artificial intelligence (AI)" refers to a computer system that automatically analyzes and makes decisions based on large amounts of data.

[1915] "Diagnostic suggestions" refers to treatment and diagnostic recommendations generated by AI based on analysis results and the latest medical guidelines.

[1916] A "smartphone" refers to a mobile phone that can connect to the Internet and use multifunctional applications.

[1917] This invention provides a system that allows users to create an account, centrally manage their medical information and health history, and smoothly share information with healthcare providers. This system places emphasis on communication with pharmacists in physical stores.

[1918] The program to realize this system uses the following hardware and software.

[1919] Hardware and software used

[1920] Smartphone: A device that allows users to create an account and manage their health data.

[1921] Server: A central system that securely stores and shares user data with healthcare providers and pharmacists.

[1922] Provider application: Software that allows providers to enter and update clinical data in real time.

[1923] Pharmacist application: Software that allows pharmacists in physical stores to view patient data in real time and suggest appropriate advice and medications.

[1924] Artificial intelligence (AI) systems: Software used to analyze collected patient data and generate diagnostic suggestions.

[1925] Data processing and calculation

[1926] The server performs the following data processing and calculations:

[1927] 1. Create a user account and upload data:

[1928] Users create an account using their smartphone and upload their medical information and health history to the server, where the data is encrypted and stored securely.

[1929] 2. Real-time data updates and sharing:

[1930] Healthcare providers use a dedicated application to enter medical data and send it to a server, which updates the data in real time and associates it with the patient's account.

[1931] 3. Data sharing and advice in physical stores:

[1932] Pharmacists use a dedicated application to view patients' health data in real time, allowing them to provide appropriate medications and health advice.

[1933] 4. AI-based diagnostic suggestions:

[1934] The collected medical data is analyzed by the AI ​​system to generate diagnostic suggestions, which are then provided to healthcare providers to help them develop appropriate treatment plans.

[1935] Specific examples

[1936] 1. Patient B interacts with a pharmacist at a drugstore:

[1937] Patient B uses his / her smartphone to enter his / her health data (e.g., blood pressure, weight, medication history, etc.) into the application and uploads it to the server.

[1938] The pharmacist opens a dedicated application and views Patient B's health data in real time. Based on this data, the pharmacist provides advice on appropriate medications and lifestyle habits. The information entered by the pharmacist is immediately sent to the server, and Patient B's data is updated.

[1939] 2. Example prompt for the generative AI model:

[1940] My name is B and my health data for the past month is as follows:

[1941] Weight: 70kg

[1942] Blood pressure: 130 / 80

[1943] Health checkup revealed: High blood sugar level

[1944] Based on this data, please give me some health advice and recommended supplements. Also, please let me know if there are any points I should check.

[1945] By implementing the invention in this manner, effective information sharing between patients, healthcare providers, and pharmacists is achieved, enabling appropriate advice to be received promptly.

[1946] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1947] Step 1:

[1948] Users create accounts and upload medical information and health histories

[1949] Input: Your name, email address, password, and medical and health history data

[1950] How it works: A user accesses the account creation screen on a dedicated application using a smartphone. They enter their name, email address, and password and press the Create Account button. They then upload their medical information and past health history to the application.

[1951] Data processing: Information entered on the terminal is encrypted.

[1952] Output: The encrypted data is sent to the server and stored securely in a database.

[1953] Step 2:

[1954] Your healthcare provider will have access to your account and will review it in advance.

[1955] Input: Provider credentials and access credentials

[1956] How it works: A healthcare provider logs into a dedicated application and enters their credentials, which the server authenticates and grants the healthcare provider access.

[1957] Data calculation: The server finds the user's account information based on the received access authentication information and generates a token for secure access.

[1958] Output: Healthcare providers can access and proactively review patient medical information and health history.

[1959] Step 3:

[1960] Users and healthcare providers share medical data online

[1961] Input: User and provider credentials, clinical data

[1962] How it works: Users use their smartphones to enter medical data and send it to a server, while healthcare providers also enter data using a dedicated application.

[1963] Data processing: The server associates both sets of data with the corresponding user accounts and updates the database in real time.

[1964] Output: Updated clinical data is accessible in real time to both users and healthcare providers.

[1965] Step 4:

[1966] In-store pharmacists share health data with patients and provide real-time advice

[1967] Input: Patient health data, pharmacist credentials

[1968] How it works: Pharmacists log in to a dedicated application to access patient health data, conduct face-to-face consultations with patients, and provide appropriate medications and advice in real time based on the health data.

[1969] Data calculation: The server associates the advice entered by the pharmacist with the patient account and updates the data.

[1970] Output: Patients can check the pharmacist's advice in real time on their smartphones.

[1971] Step 5:

[1972] AI analyzes the collected data and generates diagnostic suggestions

[1973] Inputs: Patient medical data, health history, latest medical guidelines

[1974] How it works: The server inputs collected patient data into the AI ​​system, analyzes the data based on medical guidelines, and the AI ​​follows a process to generate diagnostic suggestions and makes an appropriate diagnosis.

[1975] Data computation: The AI ​​system analyzes the data and generates new diagnostic suggestions based on the generative AI model used.

[1976] Output: The generated diagnostic suggestions are provided to the healthcare provider to help develop an appropriate treatment plan.

[1977] Step 6:

[1978] Patients can check AI-generated health advice on their smartphones

[1979] Input: AI-generated diagnostic suggestions and health advice

[1980] How it works: The server sends the AI-generated diagnostic suggestions to the user's smartphone app. The user opens the app and checks the health advice and diagnostic suggestions provided by the AI.

[1981] Data processing: The server associates the diagnostic proposal with the user account and sends it.

[1982] Output: Users can instantly check diagnostic suggestions on their smartphones and use them to help manage their daily health.

[1983] In this way, the system is realized through the specific process steps of the invention.

[1984] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1985] The present invention provides a system for efficiently sharing medical information between medical providers and patients, and for recognizing the emotional state of patients to further improve the medical process. Hereinafter, embodiments of the present invention will be described in detail.

[1986] 1. Electronic medical record sharing platform

[1987] Creating a user account and uploading information

[1988] User (Patient): Accesses the system and creates a new account. Enters name, email address, and password, receives a confirmation email to activate the account, and then uploads past medical examination information and medical history data to the system.

[1989] Server: Encrypts and stores user account information and uploaded data, granting access to healthcare providers as needed. Data is stored securely and can be accessed by both users and healthcare providers when needed.

[1990] 2. Real-time data update app

[1991] Real-time data entry and sharing during medical treatment

[1992] User (healthcare provider): Uses a dedicated app during consultation and inputs patient medical data in real time, such as blood pressure, electrocardiogram results, and findings.

[1993] Terminal (provider's device): The entered data is immediately sent to the server.

[1994] Server: Rapidly updates the received data and associates it with the patient's account, so that the data is displayed in real time and can be viewed and reviewed by the patient at the same time.

[1995] 3. AI-Supported Medical Treatment Guide

[1996] Analysis of medical data and diagnostic suggestions

[1997] Server: Collected past and current medical data is input into the AI ​​system, which then analyzes the data. The AI ​​then generates diagnostic suggestions based on the latest medical guidelines.

[1998] User (healthcare provider): Logs in to the platform and checks the diagnostic suggestions generated by the AI. Based on these suggestions, the user can develop an appropriate medical treatment and treatment plan.

[1999] 4. Patient Empowerment App

[2000] Managing health data and taking preventative measures

[2001] User (patient): Uses the app to input and manage daily health data, including weight, blood pressure, and exercise records.

[2002] Server: Updates patient data periodically and provides timely health care plans.

[2003] Patient Actions: Maintain and improve the patient's health by following the plan provided by the app and carrying out daily health management.

[2004] 5. Emotion engine integration

[2005] User sentiment analysis and notification

[2006] User (patient): Uses the app to input health data and emotional feedback. Emotional data is also collected through voice and facial recognition.

[2007] Terminal (patient's device): Sends collected emotion data to the server.

[2008] Server: The emotion engine analyzes the emotion data and evaluates the patient's emotional state. The result of this evaluation is then sent to the healthcare provider.

[2009] User (healthcare provider): Receives notifications from the emotion engine and conducts consultations while taking into account the patient's emotional state. If necessary, provides counseling or medical advice to the patient.

[2010] Specific examples

[2011] To give a specific example, patient A creates a new account in the system and uploads his or her past medical information. When visiting healthcare provider B for a regular checkup, B uses a dedicated app to enter the medical data and updates the results in real time. The AI ​​system analyzes A's data and provides diagnostic suggestions based on the latest medical guidelines. A manages his or her own health data through the app and improves lifestyle habits according to a health management plan. In addition, the emotion engine analyzes A's voice and facial expressions and notifies healthcare provider B of his or her emotional state, such as stress or anxiety. B then provides appropriate counseling and advice.

[2012] The system enables efficient information sharing between patients and healthcare providers and utilizes an emotion engine to comprehensively manage patients' physical and mental health.

[2013] The processing flow will be explained below.

[2014] Processing steps of the electronic medical record sharing platform

[2015] Step 1: Create a user account

[2016] User: Accesses the platform, enters their name, email address and password in the registration form and presses the "Create Account" button.

[2017] Server: Receives registration information and stores it in a database. Generates and sends a confirmation email to the user's email address.

[2018] Users: Click the link in the confirmation email they receive to activate their account.

[2019] Step 2: Upload your medical information and health history

[2020] User: After logging in, select the file containing past medical information and health history and press the "Upload" button.

[2021] Server: Receives the file, encrypts the data, stores it in the database, and notifies the user when the data has been saved.

[2022] Step 3: Provider Access

[2023] User (healthcare provider): Logs in to the platform with a dedicated account.

[2024] Server: Verifies the healthcare provider's authorization and provides accessible patient data.

[2025] User (healthcare provider): View the patient's past medical information and understand the information necessary for treatment in advance.

[2026] Processing steps of the real-time data update app

[2027] Step 1: Enter your medical data

[2028] User (healthcare provider): Uses a dedicated app during consultation to input patient medical results, such as blood pressure, electrocardiogram results, and other findings, in real time.

[2029] Terminal (provider's device): The entered data is immediately sent to the server.

[2030] Step 2: Update and notify data

[2031] Server: Immediately updates the received medical data in the database and associates it with the patient's account. Sends a notification to the user (healthcare provider) that the update is complete.

[2032] User (Patient): Logs in to the app and checks medical data updated in real time. Data can be checked immediately after the consultation.

[2033] AI-supported medical treatment guide processing steps

[2034] Step 1: Collect and analyze medical data

[2035] Server: Inputs the patient's past and current medical data into the AI ​​system.

[2036] AI system: Analyzes data and generates diagnostic suggestions based on the latest medical guidelines.

[2037] Step 2: Providing diagnostic suggestions

[2038] Server: Sends AI-generated diagnostic suggestions to healthcare provider accounts.

[2039] User (healthcare provider): Logs in to the platform, checks the AI's diagnostic suggestions, and uses the suggestions to diagnose the patient.

[2040] Patient Empowerment App Processing Steps

[2041] Step 1: Enter and manage your health data

[2042] User (patient): Logs in to the app and enters daily health data (weight, blood pressure, diet, exercise, etc.).

[2043] Terminal (patient's device): Sends the entered data to the server.

[2044] Step 2: Provide a health care plan

[2045] Server: Analyzes the patient's health data, generates preventative measures and health management plans, and sends the plans to the patient's account.

[2046] User (patient): Check the health management plan provided through the app and incorporate it into their daily life.

[2047] Step 3: Collaborate with your healthcare provider

[2048] Users (patients): If they have health questions or concerns, they can contact their healthcare provider through the app.

[2049] User (healthcare provider): Responds to patient questions and provides necessary advice and treatment plans.

[2050] Emotion Engine Processing Steps

[2051] Step 1: Collecting emotion data

[2052] User (patient): Uses the app to input health data and emotional feedback. Emotional data is recorded using voice input and facial recognition.

[2053] Terminal (patient's device): Sends collected emotion data to the server.

[2054] Step 2: Analyze the emotion data

[2055] Server: Analyzes the transmitted emotion data using the emotion engine, assessing the emotional state (e.g., stress, joy, anxiety).

[2056] Step 3: Informing and leveraging emotion data

[2057] Server: Sends analysis results to the healthcare provider's account, including a detailed assessment of the patient's emotional state.

[2058] User (healthcare provider): Based on the notification, understand the patient's emotional state and use it as a reference for medical treatment and counseling. If necessary, provide additional counseling or medical advice to the patient.

[2059] Through these processing steps, the Health Quality Connect system enables efficient data sharing between patients and healthcare providers, diagnostic support using AI, and comprehensive health management through the use of an emotion engine.

[2060] Example 2

[2061] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2062] In modern medical settings, efficient sharing of medical information between patients and healthcare providers is important, but information sharing is often not smooth. Furthermore, there is a lack of means to accurately grasp a patient's emotional state and provide appropriate medical treatment and counseling based on that information. Furthermore, there is a need for a system that can efficiently manage daily health data and provide appropriate health management plans.

[2063] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for a user to create an account and upload medical information and health history; a means for a healthcare provider to securely access and confirm patient information in advance; a means for a user and a healthcare provider to share medical data online; a means for inputting the user's emotional data and transmitting it to the server via a terminal; and a means for an artificial intelligence (AI) to analyze the emotional data and notify the healthcare provider of the results. This enables efficient sharing of medical information and provision of detailed medical care that takes the patient's emotional state into consideration. The system also includes: a means for a healthcare provider to input patient data in real time during medical care; a means for updating the shared medical data in real time and providing it to the patient and healthcare provider; a means for an AI to analyze the medical data and generate a diagnostic suggestion based on the latest medical guidelines; and a means for providing the generated diagnostic suggestion to the healthcare provider. This results in improved quality of medical care and faster diagnostic suggestions. The system also includes: a means for a user to input daily health data and transmit it to the server; and a means for the server to periodically update the health data and provide a health management plan. This will make daily health management more efficient and is expected to help maintain and improve patients' health.

[2064] "User" refers to a person who accesses the system, creates an account, and uploads medical information and health history.

[2065] "Healthcare provider" refers to a professional who provides medical treatment and counseling to patients, who accesses patient information through the system, and who inputs and checks medical data.

[2066] "Server" refers to a computer system that stores data entered by users and healthcare providers and analyzes and updates the data as needed.

[2067] "Account creation" refers to the process by which a new user accessing the system enters information such as name, email address, and password and registers with the system.

[2068] "Medical information" refers to all data related to medical treatment, such as patient medical records, test results, and treatment history.

[2069] "Health history" refers to all records related to a patient's health status, including past medical examination results and medical history.

[2070] "Upload" refers to the act of a user sending data from their local device to the system.

[2071] "Online medical data sharing" refers to a state in which users and medical providers can check and update medical data in real time via the Internet.

[2072] "Emotional data" refers to information that indicates a patient's emotional state, and is collected through self-input feedback or through voice and facial recognition.

[2073] "Terminal" refers to the device (e.g., smartphone, tablet, or PC) used by a user or healthcare provider to access the system.

[2074] "Artificial intelligence" refers to computer programs that contain machine learning algorithms to analyze input data and provide diagnostic suggestions or assessments of emotional states.

[2075] "Diagnostic suggestions" refers to the presentation of recommendations regarding medical examinations and treatments based on data analyzed by artificial intelligence.

[2076] "Health data" refers to various data related to a patient's health condition, such as daily weight, blood pressure, and exercise records.

[2077] A "health management plan" refers to providing a plan based on collected health data that includes appropriate preventive measures and instructions for lifestyle improvements.

[2078] The present invention provides a system for enabling users and healthcare providers to efficiently share medical information and recognize the emotional state of patients to improve the medical process. Hereinafter, embodiments of the present invention will be described in detail.

[2079] 1. Electronic medical record sharing platform

[2080] Creating a user account and uploading information

[2081] User (Patient):

[2082] A user accesses the system and clicks the "Create a new account" button. Next, they enter their name, email address, and password in the form to create an account. Once the account is created, a confirmation email is sent to the user's email address. The user clicks the link in the email to activate the account. After that, they upload past health checkup results and medical history data to the system. For example, they select a PDF or image file and click the "Upload" button.

[2083] server:

[2084] The server encrypts the entered account information and stores it in a database. All data uploaded by users is also encrypted and stored securely, with appropriate access rights set to allow healthcare providers to access it as needed.

[2085] 2. Real-time data update app

[2086] Real-time data entry and sharing during medical treatment

[2087] User (healthcare provider):

[2088] During consultations, healthcare providers open a dedicated app and input patient data in real time, including blood pressure, electrocardiogram results, and clinical findings.

[2089] Terminal (provider device):

[2090] The device immediately sends this data to the server. The data is sent by clicking the "Send" button in the app.

[2091] server:

[2092] The server rapidly updates the received data with the corresponding patient account information, making the data visible to both patients and healthcare providers in real time.

[2093] 3. AI-Supported Medical Treatment Guide

[2094] Analysis of medical data and diagnostic suggestions

[2095] server:

[2096] The server collects past and current medical data and inputs it into an artificial intelligence (AI) system, which generates diagnostic suggestions based on the latest medical guidelines.

[2097] User (healthcare provider):

[2098] Healthcare providers log in to the platform and view diagnostic suggestions generated by the AI, which they then use to develop optimal treatment plans.

[2099] 4. Patient Empowerment App

[2100] Managing health data and taking preventative measures

[2101] User (Patient):

[2102] Users use the app to input their daily health data, including weight, blood pressure, exercise records, etc. The data is saved by pressing the "Save" button.

[2103] server:

[2104] The server periodically updates this data and provides users with appropriate health management plans, such as suggesting specific exercise plans based on data indicating a lack of exercise.

[2105] 5. Emotion engine integration

[2106] User sentiment analysis and notification

[2107] User (Patient):

[2108] Users input their emotional feedback within the app, and emotional data is automatically collected using voice and facial recognition.

[2109] Terminal (patient device):

[2110] The device transmits the collected emotion data to the server.

[2111] server:

[2112] The server analyzes the emotion data using an emotion engine and notifies the healthcare provider of the results of the emotion assessment.

[2113] User (healthcare provider):

[2114] Healthcare providers receive notifications from the emotion engine and take the patient's emotional state into consideration as they conduct consultations, providing counseling and appropriate medical advice as needed.

[2115] Specific examples

[2116] Patients create a new account on the system and upload their past medical information. During regular checkups, healthcare providers use a dedicated app to enter medical data and update results in real time. The AI ​​system analyzes the data and generates diagnostic suggestions based on the latest medical guidelines. Patients manage their health data through the app and work to improve their lifestyle based on a health management plan. In addition, an emotion engine analyzes voice and facial expression data and notifies healthcare providers of stress and anxiety. Healthcare providers then provide appropriate counseling and advice to the patient.

[2117] Examples of suitable prompts for the AI ​​model

[2118] "Please explain in detail how a system allows you to upload a patient's past medical records and use AI to generate diagnostic suggestions based on the latest medical guidelines."

[2119] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2120] Electronic medical record sharing platform

[2121] Creating a user account and uploading information

[2122] Step 1:

[2123] User (patient): The user accesses the system and clicks the "Create a new account" button. Input includes name, email address, and password. Enter this information and press the "Submit" button.

[2124] Input: Name, Email Address, Password

[2125] Output: Send information to the server

[2126] Step 2:

[2127] Server: The server automatically generates a confirmation email based on the received information and sends it to the user's email address. The user clicks on the link in the email to activate their account.

[2128] Input: User's name, email address, and password

[2129] Data processing: Confirmation email generation

[2130] Output: Send confirmation email

[2131] Step 3:

[2132] User (Patient): After the account is activated, the user uploads their past medical examination information and medical history data to the system, for example, by selecting a PDF file or image file and clicking the "Upload" button.

[2133] Input: Health checkup information, medical history data

[2134] Output: Send data to the server

[2135] Step 4:

[2136] Server: The server encrypts the uploaded data and stores it in a secure database, granting access rights to healthcare providers as needed.

[2137] Input: Uploaded medical examination information, medical history data

[2138] Data processing: Data encryption

[2139] Output: Data stored in a secure database

[2140] Real-time data update app

[2141] Real-time data entry and sharing during medical treatment

[2142] Step 1:

[2143] User (healthcare provider): The healthcare provider opens the dedicated app and inputs the patient's medical data (blood pressure, electrocardiogram results, findings, etc.) in real time. After inputting, he / she presses the "Send" button.

[2144] Input: Medical data

[2145] Output: Data input to the terminal

[2146] Step 2:

[2147] Terminal (provider's device): The terminal immediately transmits the entered data to the server. This process occurs in real time using a network connection.

[2148] Input: Medical data

[2149] Output: Send data to the server

[2150] Step 3:

[2151] Server: The server rapidly updates the received data and associates it with the appropriate patient account, making the data available in real time and accessible to patients via their own devices.

[2152] Input: Medical data

[2153] Data processing: Data update

[2154] Output: Save and display the updated data

[2155] AI-supported medical treatment guide

[2156] Analysis of medical data and diagnostic suggestions

[2157] Step 1:

[2158] Server: The server inputs collected past and current medical data into the AI ​​system.

[2159] Input: Past and current medical data

[2160] Output: Sending data to an AI system

[2161] Step 2:

[2162] AI system: AI generates diagnostic suggestions based on the latest medical guidelines and past clinical data.

[2163] Input: Clinical data and medical guidelines

[2164] Data processing: Data analysis and generation of diagnostic suggestions

[2165] Output: Diagnostic suggestions

[2166] Step 3:

[2167] User (healthcare provider): The healthcare provider logs in to the platform and checks the diagnostic suggestions generated by the AI. Based on these suggestions, the healthcare provider decides on the final treatment plan.

[2168] Input: Diagnostic suggestion

[2169] Output: Treatment plan

[2170] Patient Empowerment App

[2171] Managing health data and taking preventative measures

[2172] Step 1:

[2173] User (patient): The user uses the app to enter daily health data (weight, blood pressure, exercise records, etc.), enters the data, and presses the "Save" button.

[2174] Input: Health data

[2175] Output: Data input to the app

[2176] Step 2:

[2177] Server: The server periodically updates and securely stores the entered data.

[2178] Input: Health data

[2179] Data processing: updating and saving data

[2180] Output: Save the updated data

[2181] Step 3:

[2182] Server: The server performs health checks based on the recorded data and provides appropriate health management plans. For example, it suggests specific exercise plans if the user is not getting enough exercise.

[2183] Input: Updated health data

[2184] Data processing: generating health management plans

[2185] Output: Healthcare plan

[2186] Emotion engine integration

[2187] User sentiment analysis and notification

[2188] Step 1:

[2189] User (patient): The user enters their own emotional feedback within the app. In addition, emotional data is automatically collected using voice and facial recognition.

[2190] Input: Emotional feedback, voice data, facial expression data

[2191] Output: Data input to the app

[2192] Step 2:

[2193] Terminal (patient's device): The terminal transmits the collected emotion data to the server.

[2194] Input: Emotion data

[2195] Output: Send data to the server

[2196] Step 3:

[2197] Server: The server uses an emotion engine to analyze the emotion data and evaluate the emotional state.

[2198] Input: Emotion data

[2199] Data processing: Emotion data analysis

[2200] Output: Sentiment rating

[2201] Step 4:

[2202] Server: The server notifies the healthcare provider of the results of the emotion assessment.

[2203] Input: Emotion rating

[2204] Output: Notification of emotion evaluation result

[2205] Step 5:

[2206] User (healthcare provider): The healthcare provider receives notifications from the emotion engine and examines the patient while taking into account their emotional state. If necessary, they provide counseling or appropriate medical advice.

[2207] Input: Emotion evaluation result

[2208] Output: consultation plan, counselling and medical advice

[2209] (Application example 2)

[2210] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2211] With conventional systems, it was difficult to grasp the emotional state of patients and customers in real time in medical and customer service settings, making it difficult to respond appropriately and quickly. This made it difficult to provide services that met individual needs, and improving customer satisfaction was an issue.

[2212] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a user to create an account and upload medical information and health history, a means for a healthcare provider to securely access and confirm patient information in advance, a means for the user and healthcare provider to share medical data online, a means for capturing a customer's facial expression using smart glasses and analyzing their emotions, and a means for storing the analyzed customer's emotional data in a database and making service suggestions. This makes it possible to grasp the customer's emotional state in real time and suggest appropriate services based on that.

[2213] A "user account" is individual identification information assigned to each user who uses the system.

[2214] "Medical information" is health-related data collected by healthcare providers, such as patient consultations and medical records.

[2215] "Health history" refers to records relating to an individual's health, including the patient's past medical examination results, medical history, and treatment history.

[2216] "Healthcare providers" are professionals who provide health care services, such as doctors, nurses, and pharmacists.

[2217] "Online" medical data sharing refers to the ability to view and update patient information in real time via the Internet.

[2218] "Smart glasses" are eyeglass-type wearable devices worn by users that have camera and display functions.

[2219] "Customer's facial expression" is information that indicates the emotional state through changes in facial expression.

[2220] "Emotion analysis" is the process of identifying individual emotional states from facial expressions and vocal acoustic patterns using image processing techniques and machine learning.

[2221] A "database" is a system for storing and managing data in digital form, and is a means for quickly retrieving data when needed.

[2222] A "service proposal" is a specific proposal to provide appropriate products or services based on the customer's needs and emotional state.

[2223] "Real-time" refers to instant data transmission and processing without delay, meaning that current information is reflected and processed immediately.

[2224] "Artificial intelligence (AI)" is a technology that enables computer systems to mimic human intelligence and learn, reason, perceive, and make decisions.

[2225] The present invention provides a system that efficiently shares medical information between healthcare providers and patients, recognizes patients' emotional states, and further improves the medical process. It also integrates emotion recognition and service suggestion functions using smart glasses to improve customer service in brick-and-mortar stores.

[2226] 1. Overview of the entire system

[2227] The system includes the following main measures:

[2228] A means for users to create accounts and upload medical information and health history

[2229] A means for healthcare providers to securely access and proactively review patient information

[2230] A means for users and healthcare providers to share medical data online

[2231] A method to capture customer facial expressions and analyze their emotions using smart glasses

[2232] A means of storing analyzed customer emotion data in a database and making service suggestions

[2233] 2. Hardware and Software Used

[2234] The system uses the following hardware and software:

[2235] Hardware:

[2236] Smart glasses (e.g. Google Glass)

[2237] Camera (built into smart glasses)

[2238] Server (operating database and AI model)

[2239] Devices (used by healthcare providers and store employees)

[2240] software:

[2241] OpenCV (camera operation and image processing)

[2242] Keras (emotion recognition model)

[2243] TensorFlow (deep learning such as sentiment analysis)

[2244] SQLite (database management)

[2245] 3. Data processing and calculation procedures

[2246] The server acquires facial expression data captured by the smart glasses and performs emotion analysis using natural language processing and image processing technologies. This involves camera operation and image processing using OpenCV, and deep learning models using Keras and TensorFlow. The analysis results are stored in an SQLite database, and service proposals for the customer are generated at specific times and displayed on the smart glasses display.

[2247] 4. Specific Examples

[2248] For example, while a customer is browsing products in a physical store, a salesperson wearing smart glasses can capture the customer's face and analyze their emotions in real time. If the customer is smiling, the system will display a notification on the salesperson's smart glasses saying, "Please suggest a new promotion." On the other hand, if the customer is sad, the system will suggest, "Provide special service." This entire process is appropriately carried out by the analysis of an AI model.

[2249] 5. Example prompts to be input to the generative AI model

[2250] "Develop an application that uses smart glasses to assist in customer service in brick-and-mortar stores. This application will provide optimal service to customers by capturing customer facial expressions in real time and analyzing their emotional state. Specifically, the application will take a photo of the customer's face with a camera, analyze the results with an emotion recognition model, and store the results in an SQLite database. Based on the analysis results, the application will suggest appropriate services to staff."

[2251] This system is expected to improve customer service in brick-and-mortar stores, and also to streamline medical procedures and empower patients in medical settings.

[2252] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2253] Step 1:

[2254] The server creates user accounts and uploads medical information and health history. Users access the system, create an account, enter their name, email address, and password, and receive a confirmation email to activate their account. They then upload past medical examination information and medical history data to the system. The server encrypts and stores the uploaded data, allowing secure access to healthcare providers.

[2255] Step 2:

[2256] The device inputs patient data in real time during medical examinations and sends it to a server. Healthcare providers use a dedicated app to input patient medical data (e.g., blood pressure, electrocardiogram results, findings, etc.) in real time. The input data is immediately sent to the server, which stores the data in a database and updates it promptly.

[2257] Step 3:

[2258] The server analyzes the collected data using artificial intelligence (AI) and generates a diagnostic suggestion. The server inputs the collected past and current medical data into the AI ​​system, which then analyzes the data. The AI ​​generates a diagnostic suggestion based on the latest medical guidelines and provides the results to healthcare providers.

[2259] Step 4:

[2260] The device captures the customer's facial expression through the smart glasses and sends the data to the server.The smart glasses' camera captures the customer's face and sends it to the server as image data.

[2261] Step 5:

[2262] The server analyzes the image data and determines the customer's emotional state. The received image data is preprocessed using OpenCV and analyzed using an emotion recognition model using Keras and TensorFlow. The emotional state (e.g., happy, sad, surprised, etc.) is determined.

[2263] Step 6:

[2264] The server saves the analysis results in a database and generates appropriate service proposals. The analyzed emotion data is stored in an SQLite database and appropriate service proposals are generated based on the customer's state. For example, if the customer is determined to be happy, a proposal such as "Propose a new promotion" is generated, and if the customer is determined to be sad, a proposal such as "Provide a special service" is generated.

[2265] Step 7:

[2266] The device notifies the smart glasses of the proposed service, which then displays the notification of the proposed service sent from the server, allowing store employees to provide the service to the customer at the appropriate time.

[2267] Through the above steps, the present invention realizes a system that improves medical and brick-and-mortar store services.

[2268] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2269] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2270] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2271] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2272] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2273] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2274] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2275] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and moto...

Claims

1. A means for users to create an account and upload medical information and health history; A means for healthcare providers to securely access and proactively review patient information; A means for users and healthcare providers to share medical data online; A system including:

2. a means for healthcare providers to enter patient data in real time at the point of care; A means to update and provide shared clinical data to patients and providers in real time; The system of claim 1 , comprising:

3. Artificial intelligence (AI) means for analyzing collected patient clinical data; AI means to generate diagnostic suggestions based on the analysis results and the latest medical guidelines; a means for providing the generated diagnostic suggestions to a healthcare provider; The system of claim 1 , comprising:

4. A means for patients to manage, enter, and update their personal health data; a means of providing patients with preventative care and health management plans; A means for providers and patients to collaborate online; The system of claim 1 , comprising:

Images