Five-sense telemedicine system

Abstract

We provide a five-senses telemedicine system that utilizes sensory data to support smooth medical treatment. [Solution] The patient-side device 1 acquires visual, auditory, tactile, olfactory, and gustatory data, as well as vital signs. This data is integrated by the server 2 or the data processing unit 17 of the patient-side device 1 to generate differential diagnosis candidates. After automatically performing non-invasive physical examinations and tests, it supports automatic booking of medical appointments. The physician-side device 3 reproduces this sensory data and transmits movements and sensations bidirectionally. The physician operates the patient-side device in real time, utilizing the five-sensory data to perform physical examinations and tests such as palpation and joint range of motion assessment, thereby supporting diagnosis. H.265 / UDP is used for communication, supporting both low-speed and high-speed lines, ensuring stable operation even in sparsely populated areas.

Description

Technical Field

[0003] , , , , ,

[0001] The present invention belongs to the field of telemedicine, and relates to a tele-diagnosis system, an information processing device, a method, and a program that connect a patient and a doctor via a network and assist diagnosis by utilizing five-sense data.

Background Art

[0002] Conventional tele-diagnosis systems (Patent Documents 1 and 2) rely on visual and auditory data (video and audio), and the utilization of five-sense data such as touch, smell, and taste is insufficient. Although there are individual proposals such as touch (Patent Document 5), taste (Patent Document 4), and exhaled components (Patent Document 6), they do not support real-time processing and low-speed line compatibility. The same applies to biometric information acquisition technologies (Patent Documents 3 and 7) and image diagnosis support (Document 4). Although individual measurements of five-sense data and diagnostic guidelines are known, integration with tele-diagnosis has not been achieved. In particular, there is a need for support for low-speed lines (e.g., 1 Mbps or less) and the utilization of five-sense sensors that enable safety and differentiation.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Patent Document 3

Patent Document 4

Patent Document 5

Patent Document 6

Patent Document 7

Summary of the Invention

[0004] Current telemedicine systems are heavily reliant on visual and auditory information, lacking sufficient use of tactile, olfactory, and gustatory information, resulting in reduced diagnostic accuracy. Furthermore, stable operation over low-speed connections, secure data management, and informed consent mechanisms are not yet in place. In addition, the automation of medical support linked to non-invasive examinations has not yet been realized. The objective of this invention is to solve these problems, improve accuracy, and provide a five-sense telemedicine system that utilizes sensory data to support smooth medical treatment. [Means for solving the problem]

[0005] This invention provides a telemedicine system comprising a patient-side device 1, a server 2, and a physician-side device 3. It includes the following three configurations.

[0006] (1) First configuration (Patient-side device 1 and server 2 configuration) (Figures 1, 4, and 6) The patient-side device 1 is required to include a visual and auditory device 11, which includes at least one of the following: VR goggles, a PC with a camera, a smartphone, a tablet, or a wearable device, and also includes at least one of the following: a tactile device 12, an olfactory device 13, a gustatory device 14, a biometric information detector 15, and a medical image capture device 16 (Figure 4). Once the patient consents to data transmission (electronic signature, app authentication), the patient-side device 1 displays or provides voice guidance for the medical questionnaire questions, and the patient inputs the information (e.g., by typing or voice).

[0007] The patient-side device 1 instructs the patient on the measurement method via voice or screen display, and measures the patient's biometric information (e.g., body temperature, pulse, heart rate, blood pressure, respiratory rate, oxygen saturation, auscultation information, etc.) using the biometric information detector 15. The server 2 is equipped with an analysis unit 25 (e.g., artificial intelligence) in the calculation unit 23 (Figure 6). The analysis unit 25 integrates the medical history information and biometric information data to generate differential diagnosis candidates, selects the necessary non-invasive examination items to narrow down the differential diagnosis candidates, controls the patient-side device 1 to perform an automated physical examination and tests, narrows down the differential diagnosis candidates, and generates treatment options.

[0008] The system searches for and presents potential medical institutions based on differential diagnoses and proposed treatments, and automatically makes reservations after the patient selects an option. The analysis unit 25 identifies the appropriate medical department based on data obtained from the patient, presents medical institutions in conjunction with external or internal medical institution information databases, and performs the reservation process using an automated reservation system. This allows elderly people living in remote areas and those with limited access to information to quickly access the most suitable medical institution for multiple potential diagnoses.

[0009] (2) Second configuration (Patient-side device 1, server 2, and physician-side device 3) (Figures 2, 4, 6, and 7) In addition to the configuration described in item 1 above, the system includes a physician-side device 3. The physician-side device 3 is required to include a visual / auditory device 31, which includes at least one of the following: VR goggles, a PC with a camera, a smartphone, a tablet, or a wearable device, and also includes at least one of a tactile device 32, an olfactory device 33, and a gustatory device 34.

[0010] Patient information (medical history, biometric data, physical examination / test information, differential diagnoses, and proposed treatment) is sent from server 2 to physician-side device 3 at the medical institution where the appointment was made via automated booking, and the physician reviews it. The physician remotely operates physician-side device 3 to conduct additional medical history interviews, physical examinations, and tests on the patient and obtain additional information. Based on all the data, the physician makes a diagnosis, communicates the diagnosis to the patient, and discusses proposed treatment.

[0011] (3) Third configuration (Patient-side device 1 and physician-side device 3 configuration) (Figures 3, 5, and 7)

[0012] The system consists only of a patient-side device 1 and a physician-side device 3, with a calculation unit 173 and an analysis unit 175 mounted in the data processing unit 17 of the patient-side device 1. The patient-side device 1 is required to include a visual / auditory device 11, which includes at least one of a VR goggles, a PC with a camera, a smartphone, a tablet, or a wearable device, and also includes at least one of a tactile device 12, an olfactory device 13, a gustatory device 14, a biometric information detector 15, and a medical image capture device 16 (Figure 5).

[0013] In this configuration, server 2 is not included, and an analysis unit 175 (e.g., artificial intelligence) is installed within the calculation unit 173 of the data processing unit 17 of the patient-side device 1 (Figure 5). The analysis unit 175 integrates the medical history information and biometric data to generate differential diagnosis candidates, selects the necessary non-invasive examination items to narrow down the differential diagnosis candidates, controls the patient-side device 1 to perform an automated physical examination and tests, narrows down the differential diagnosis candidates, and generates treatment options. Based on the differential diagnosis candidates and treatment options, it searches for and presents potential medical institutions, and automatically makes a reservation after the patient makes a selection. The analysis unit 175 is characterized by identifying the appropriate medical department based on the data obtained from the patient, presenting medical institutions in cooperation with an external or internal medical institution information database, and performing the reservation process using an automated reservation means. As a result, even elderly people living in remote areas or those with limited access to information can quickly visit the optimal medical institution for multiple disease candidates.

[0014] The physician's device 3 is required to include a visual / auditory device 31, which includes at least one of the following: VR goggles, a PC with a camera, a smartphone, a tablet, or a wearable device, and also includes at least one of the following: a tactile device 32, an olfactory device 33, and a gustatory device 34. Patient information (medical history information, biometric information, physical examination / test information, differential diagnoses, and proposed treatment) is sent directly from the patient's device 1 to the physician's device 3 at the medical institution where the appointment was made via automated booking, and the physician reviews it. The physician remotely operates the physician's device 3 to conduct additional medical history interviews, physical examinations, and tests on the patient and obtain additional information. Based on all the data, the physician makes a diagnosis, communicates the diagnosis to the patient, and discusses proposed treatment.

[0015] When VR goggles are used as a visual and auditory device 11, they function as an interface for interaction between the patient and the system, providing, for example, a display in 3D space and acquiring visual data, as well as enabling audio input / output and the presentation of operational guidance. Furthermore, when only the patient uses VR goggles, a virtual conversation partner is displayed in 3D, allowing the patient to conduct a medical interview with that partner. Also, when both the patient and the doctor use VR goggles, two-way 3D communication becomes possible, allowing, for example, the doctor to examine the patient while viewing a 3D model of the patient in the VR space.

[0016] Furthermore, the tactile device 12 measures skin hardness, temperature, and movement, enabling remote physical examinations such as palpation and neurological examinations, thereby supporting detailed evaluation of tumors and inflammation and improving diagnostic accuracy. The olfactory device 13 analyzes body odor and reproduces a reference odor, supporting the early detection of olfactory abnormalities (e.g., acetone odor in diabetic ketoacidosis) and metabolic diseases, providing accuracy beyond conventional visual and auditory-only diagnoses. The gustatory device 14 analyzes salivary components and reproduces a reference taste, detecting taste abnormalities (e.g., impaired saltiness due to hyponatremia), providing accuracy beyond conventional visual and auditory-only diagnoses.

[0017] The communication employs compression technology (e.g., H.265) and protocols (e.g., UDP protocol) to ensure stable operation even on low-speed lines (e.g., 1 Mbps or less). Consent is obtained in accordance with the Personal Information Protection Act to ensure the security of medical data. The data processing unit 17 of server 2 or the patient-side device employs a hybrid configuration of on-premises and cloud servers (claim 19) or a cloud server configuration (claim 18). In the hybrid configuration, the on-premises server processes data from physical examinations and tests, while the cloud server is responsible for transmitting data to the physician-side device 3 and linking with external databases. The cloud server configuration ensures high-speed data processing and scalability. [Effects of the Invention]

[0018] The present invention integrates visual, auditory, tactile, olfactory, and gustatory data to provide diagnostic accuracy beyond that of conventional telemedicine systems. When the visual and auditory device 11 is a VR headset, 3D skin observation using the VR headset (e.g., stereoscopic photography of eczema, resolution 2064×2208 pixels / eye) enables accurate assessment of the degree of exudate and swelling, allowing for detailed diagnosis of skin symptoms that are easily overlooked in 2D images.

[0019] The tactile device 12 measures skin hardness (e.g., accuracy of 0.1 N) and temperature (e.g., accuracy of 0.1 °C) through remote palpation, improving the diagnostic accuracy of tumors and inflammation. Body odor analysis by the olfactory device 13 (e.g., detection of acetone odor at 0.01 ppm) and saliva component analysis by the gustatory device 14 (e.g., measurement of sodium concentration) assist in the diagnosis of metabolic diseases (e.g., diabetic ketoacidosis) and taste disorders (e.g., zinc deficiency).

[0020] Based on the highly accurate data obtained from the patient in this way, the appropriate medical department can be determined, and it is possible to present medical institutions in cooperation with external or internal medical institution information databases. Furthermore, reservation processing can be carried out by means of automatic reservation. As a result, even elderly people and information-disadvantaged people living in remote areas can quickly visit the optimal medical institution for multiple disease candidates. In addition, the diagnostic range, which was difficult with only conventional visual and auditory data, can be expanded, greatly contributing to the popularization of telemedicine, the qualitative improvement of diagnosis, and the equality of medical access.

[0021] When the visual and auditory device 11 on the patient side is a VR headset, it functions for the interaction between the patient and the system, and a virtual interaction partner is displayed in 3D, providing an intuitive operation and a sense of psychological comfort when the patient conducts a medical interview with the partner. When the visual and auditory devices 11 and 31 on both the patient side and the doctor side are VR headsets, through two-way 3D communication, the doctor can perform palpation, evaluation of joint range of motion, neurological examination, etc. while checking the patient's 3D model in the VR space, realizing a higher level of remote examination.

[0022] The physician's device 3 can remotely perform palpation and evaluate joint range of motion by operating the motion transmission unit 1222 of the tactile device 12 of the patient's device 1 via a visual / auditory device 31 (such as a VR goggle or smartphone) and a tactile device 32. Furthermore, by having a function to emit scents registered in the data processing unit 17 of the server 2 and the patient's device 1 using the odor-emitting unit 132 of the olfactory device 13 of the patient's device 1, it is possible to provide the patient with, for example, a scent with a relaxation effect and utilize it as part of diagnosis or treatment.

[0023] The analysis unit 25 within the calculation unit 23 of server 2, or the analysis unit 175 within the calculation unit 173 in the data processing unit 17 of patient-side device 1, generates differential diagnosis candidates from interview information and vital signs, and selects and performs non-invasive examination items (e.g., body odor analysis, skin observation) based on these differential diagnosis candidates, thereby reducing the burden on physicians and improving diagnostic efficiency.

[0024] Furthermore, the automation of generating differential diagnoses and treatment options, as well as hospital search and booking, enables patients to quickly access appropriate medical facilities, contributing to improved access to healthcare. In configurations where the patient-side device 1 includes a medical imaging device 16, at least one radiologist or clinical laboratory technologist is required. However, in configurations without the medical imaging device 16, unmanned operation eliminates the need for medical personnel, resulting in lower operating costs.

[0025] A hybrid configuration of Server 2 or the patient-side device's data processing unit 17 (a combination of an on-premises server and a cloud server) enables real-time data processing by the on-premises server and external database integration by the cloud server, improving processing speed and flexibility. A cloud server configuration of Server 2 or the patient-side device's data processing unit 17 ensures high-speed data processing and scalability.

[0026] Compression technology (e.g., H.265 / UDP communication) enables stable operation even on low-speed lines (e.g., 1 Mbps or less) in sparsely populated areas and developing countries, minimizing communication delays and data loss. Integration of PHR (Personal Health Record) data (e.g., medical history, medication history) supports continuous health management and improves the accuracy of long-term disease management. Furthermore, obtaining consent in accordance with the Personal Information Protection Act and using encryption technology (e.g., AES-256 encryption) ensures the security and reliability of medical data. [Brief explanation of the drawing]

[0027] [Figure 1] This is a block diagram showing the configuration of the five-sense remote medical consultation system 4 according to the first configuration of the present invention (configuration of patient-side device and server). [Figure 2] This is a block diagram showing the configuration of the second configuration of the five-sense remote medical consultation system 5 of the present invention (configuration of patient-side device, server, and physician-side device). [Figure 3] This is a block diagram showing the configuration of the third configuration of the five-sense remote medical consultation system 6 of the present invention (configuration of patient-side device and physician-side device). [Figure 4] This is a block diagram showing the configuration of patient-side device 1 (excluding the data processing unit). [Figure 5] This is a block diagram showing the configuration of patient-side device 1 (including the data processing unit). [Figure 6] This is a block diagram showing the configuration of Server 2. [Figure 7] This is a block diagram showing the configuration of the physician-side device 3. [Figure 8] This is a sequence diagram of the first embodiment (configuration of patient-side device 1 and server 2). [Figure 9] This is a sequence diagram of the second embodiment (configuration of patient-side device 1, server 2, and physician-side device 3). [Figure 10] This is a sequence diagram of the third embodiment (configuration of patient-side device 1 and physician-side device 3). [Modes for carrying out the invention]

[0028] The embodiments of the present invention will be described in detail below. The present invention provides a five-senses telemedicine system, information processing device, method, and program that remotely connects a patient and a physician and supports diagnosis by utilizing five-sense data. The five-senses telemedicine system consists of a patient-side device 1, a server 2, and a physician-side device 3. It encompasses the following three configurations (first configuration, second configuration, and third configuration).

[0029] (1) First configuration (first embodiment): Configuration of patient-side device 1 and server 2 The patient-side device 1 acquires medical interview information, sensory data, biometric information, and medical image data. The analysis unit 25 (described later) mounted on the calculation unit 23 (described later) of the server 2 integrates this information to generate differential diagnosis candidates, and performs non-invasive automated physical examinations and tests, as well as searching for and booking medical institutions. (2) Second configuration (second embodiment): configuration of patient-side device 1, server 2, and physician-side device 3 In addition to the first configuration described above, the physician can conduct additional interviews and examinations via the physician-side device 3 to support the physician's diagnosis. (3) Third configuration (third embodiment): Configuration of patient-side device 1 and physician-side device 3 Without going through Server 2, the analysis unit 175 (described later) installed in the calculation unit 173 (described later) within the data processing unit 17 (described later) of the patient-side device 1 integrates the acquired data to generate differential diagnosis candidates, and performs non-invasive automated physical examinations and tests, as well as searching for and booking medical institutions. Patient data is transmitted directly to the physician-side device 3, where the physician reviews the data and makes a diagnosis after conducting additional interviews, physical examinations, and tests through the physician-side device 3.

[0030] Furthermore, in configurations 1 to 3, the communication employs compression technologies (e.g., H.265) and protocols (e.g., UDP: User Datagram Protocol) that are compatible with low-speed lines (e.g., 1 Mbps or less), and stability is ensured through packet loss compensation and bandwidth adaptive control. Consent (electronic signature, application authentication) is obtained in accordance with the Personal Information Protection Act, and the security of medical data is ensured through encryption technology (e.g., AES-256) and access control (e.g., Role-Based Access Control (RBAC)).

[0031] Here, the five senses data refers to physical examination and testing data related to the five senses acquired by the five sense devices: the visual and auditory devices 11, the tactile device 12, the olfactory device 13, and the gustatory device 14. Physical examination and testing includes physical examination and testing using vision, hearing, touch, smell, and taste, biological information such as vital signs and blood glucose levels detected by the biometric information detector 15, and examinations using image data from the medical imaging device 16. Here, vital signs include body temperature, pulse, heart rate, blood pressure, respiratory rate, and oxygen saturation.

[0032] The data acquired by the patient-side device 1 (patient data) includes interview information, visual, auditory, tactile, olfactory, and gustatory data (hereinafter referred to as five-sense data), the patient's biometric information from the biometric information detector 15 (e.g., body temperature, pulse, heart rate, blood pressure, respiratory rate, oxygen saturation, auscultation information, etc.), image data from the medical imaging device 16, or physical examination / test information, differential diagnosis candidates, and treatment proposals. Once the patient consents to data transmission (electronic signature, app authentication), this data becomes available for transmission. All of this patient data is referred to as total patient data (sometimes called "all data" or "all historical data (current and past patient data)"). Additional data refers to additional physical examination / test data acquired by operating the patient-side device 1 from the physician-side device 3. The patient-side device 1 has the function of acquiring at least one piece of data relating to the patient's vision, hearing, touch, taste, or smell.

[0033] Medical history information includes symptoms, medical history, medication history, family history, lifestyle history, and interpretive models, entered by the patient via voice or text input. Medical history information is collected by displaying the questions on a display unit 112 or presenting them audibly via a speaker 114 on a visual / auditory device 11 (e.g., VR goggles, smartphone), and the patient inputting them via voice using a microphone unit 113 or text input via a touch panel. Embodiments also include collecting medical history information using an external device (e.g., a smartphone, tablet, or personal computer owned by the patient) and integrating it into the system via a data processing unit 17 of the server 2 or the patient-side device 1. When collected using an external device, the patient-side device 1 acquires sensory data, vital signs, and medical image data, and these data are integrated with the medical history information in the management unit 21 of the server 2 or the management unit 171 of the data processing unit 17 of the patient-side device 1.

[0034] PHR data (Personal Health Record) is stored in the recording unit 24 of server 2 or in the recording unit 174 within the data processing unit 17 of patient-side device 1, and is analyzed by the calculation unit 23 of server 2 or the calculation unit 173 of the data processing unit 17, and used for correcting differential diagnoses and for continuous health management.

[0035] <First Embodiment> The following describes the five-senses telemedicine system 4 according to the first embodiment. The five-senses telemedicine system 4 is a system that remotely connects a patient and a doctor using a patient-side device 1 and a server 2.

[0036] (1) Contents of the first configuration (first embodiment) (see Figures 1, 4, and 6): Configuration of patient-side device 1 and server 2

[0037] (Patient-side device 1) Patient-side device 1 is required to include a visual / auditory device 11, which includes at least one of the following: VR goggles, a PC with a camera, a smartphone, a tablet, or a wearable device. Patient-side device 1 also includes at least one of the following: a tactile device 12, an olfactory device 13, a gustatory device 14, a biometric information detector 15, and a medical image capture device 16 (Figure 4).

[0038] The visual and auditory device 11 is responsible for acquiring visual data (imaging unit 111), voice input (microphone unit 113), display (display unit 112), and audio output (speaker unit 114). It is used for video calls and data confirmation (e.g., displaying text of medical questionnaire information, viewing medical images) using VR goggles, smartphones, or tablets. Data is transmitted to and received from the server 2 or the physician-side device 3 via the transmission unit 115 and the reception unit 116.

[0039] When the visual and auditory device 11 is a VR goggle, the imaging unit 111 can capture 3D images of skin and eye movements (e.g., resolution of 2064 x 2208 pixels / eye or higher, horizontal field of view of 110 degrees or more, vertical field of view of 96 degrees or more, 4 or more tracking cameras). The VR goggle also displays operation guidance and a virtual conversation partner on the display unit 112, and allows voice input via the microphone unit 113 and audio output via the speaker unit 114. In embodiments where the visual and auditory device 11 uses a VR goggle, a 3D virtual conversation partner (e.g., a doctor's avatar) is displayed, and the patient can conduct a medical interview with this partner, providing intuitive operation and a sense of psychological security.

[0040] If the visual / auditory device 11 is a PC with a camera, smartphone, tablet, or wearable device, it similarly captures images with the camera, displays guidance on the display, and inputs / outputs audio with the microphone and speaker, improving ease of operation and portability. Data is transmitted to and received from the server 2 or the physician's device 3 via the transmitter 115 and receiver 116.

[0041] The tactile device 12 comprises a temperature sensing unit 1211, a pressure sensor unit 1213, and a motion sensor unit 1212. The temperature sensing unit 1211 senses the patient's skin temperature (e.g., 38.0°C, 0.1°C accuracy) and transmits the temperature data measured on the patient's side to the physician's device 3 for reproduction and display (e.g., temperature distribution graph). The pressure sensor unit 1213 measures the patient's skin hardness (e.g., 0.1N accuracy) and transmits the pressure data measured on the patient's side to the physician's device 3 for reproduction and display (e.g., grip strength measurement), enabling remote palpation.

[0042] The motion sensor unit 1212 senses the patient's movements (e.g., hand movements during palpation) and transmits the motion data measured on the patient's side to the physician's device 3 for reproduction and display. It can also perform evaluations including tendon reflexes, manual muscle testing (MMT), range of motion, and gait patterns (e.g., patellar tendon reflex angle change with 0.1 degree accuracy). This data is transmitted to the server 2 or the physician's device 3 via the transmission unit 123. The temperature sensing unit 1211, motion sensor unit 1212, and pressure sensor unit 1213 are collectively referred to as the tactile sensor unit 121, and the tactile sensor unit 121 includes at least one of the temperature sensing unit 1211, motion sensor unit 1212, and pressure sensor unit 1213.

[0043] The tactile device 12 receives temperature data transmitted from the physician's device 3 in the receiving unit 124, and the temperature transmission unit 1221 reproduces it (e.g., confirms the sensation of heat at the site of inflammation). The pressure transmission unit 1221 reproduces the pressure sensed by the pressure sensor unit 3213 of the physician's device 3. The motion transmission unit 1213 reproduces the motion sensed by the motion sensor unit 3212 of the physician's device 3. The temperature transmission unit 1221, motion transmission unit 1222, and pressure transmission unit 1223 are collectively referred to as the tactile transmission unit 122, and the tactile transmission unit 122 includes at least one of the temperature transmission unit 1221, motion transmission unit 1222, and pressure transmission unit 1223.

[0044] Data is transmitted to and received from server 2 or physician-side device 3 via the transmitting unit 123 and receiving unit 124. Furthermore, the temperature sensing unit 1211, motion sensor unit 1212, and pressure sensor unit 1213 may be omitted, and the configuration may be specialized for sensory reproduction using only the pressure transmission unit 135, temperature transmission unit 132, and motion transmission unit 134. Alternatively, each transmission unit may be omitted, and the configuration may be specialized for data acquisition using only the pressure sensor unit 136, temperature sensing unit 131, and motion sensor unit 133.

[0045] The olfactory device 13 acquires data through its odor collection unit 131, which automatically detects the patient's odor or when the patient breathes into it (e.g., for 10 seconds). It functions as an olfactory sensor for measuring body odor (e.g., acetone odor) with high precision (e.g., 0.01 ppm accuracy), supporting the diagnosis of metabolic diseases (e.g., acetone odor in diabetes) and infectious diseases. The odor generating unit 132 can reproduce a reference odor (e.g., lavender) and odors detected by the odor collection unit 331 of the olfactory device 33 on the physician's device 3, based on instructions from the physician, allowing the patient's sense of smell to be tested.

[0046] Furthermore, the system can emit a fragrance that provides a relaxation effect, based on the judgment of the physician and the analysis unit 25 of server 2 or the analysis unit 175 of patient-side device 1. Data is transmitted to and received from server 2 or physician-side device 3 via the transmission unit 133 and the reception unit 134. In addition, in some embodiments, the odor collection unit 131 may be omitted, and the system may be configured to reproduce odors from the physician's side using only the odor generation unit 132. Alternatively, the odor generation unit 132 may be omitted, and the system may be configured to be configured to acquire data using only the odor collection unit 131.

[0047] The taste device 14 measures saliva components (e.g., sodium concentration) and taste bud responses (e.g., 0.1 μA accuracy) in the taste collection unit 141 to support the evaluation of taste disorders and nutritional status. The taste reproduction unit 142 can reproduce a reference taste (e.g., saltiness) or a taste sensed by the taste collection unit 341 of the physician-side device 3's taste device 34 using electrical stimulation. Data is transmitted and received via the transmission unit 143 and the reception unit 144. In some embodiments, the taste collection unit 141 may be omitted, and the configuration may be specialized in reproducing taste from the physician's side using only the taste reproduction unit 142. Alternatively, the configuration may be specialized in acquiring patient-side data using only the taste collection unit 141, with the taste reproduction unit 142 omitted.

[0048] The biometric information detector 15 measures body temperature (e.g., 0.1°C accuracy), pulse rate (e.g., 1 bpm accuracy), blood pressure (e.g., 1 mmHg accuracy), respiratory rate (e.g., 1 breath / min accuracy), oxygen saturation (e.g., 1% accuracy), and auscultation information (e.g., 20 Hz to 2 kHz) using the detection unit 151. The data measured by the detection unit 151 is transmitted to the server 2 or the physician's device 3 via the transmission unit 152. In the future, it may be possible to measure data such as non-invasive blood glucose measurement (e.g., glucose concentration estimation using an optical sensor) and blood component analysis (e.g., estimation of red blood cell count and white blood cell count) in real time.

[0049] The medical imaging device 16 takes medical images, including portable X-rays (e.g., weighing 5 kg or less, with RI resolution (e.g., 1.5T, within 10 minutes)), under the direction of a physician. The data captured by the imaging unit 161 is transmitted via the transmission unit 162 to the server 2 or the physician's device 3.

[0050] (Server 2) As shown in Figure 6, Server 2 is configured to include a management unit 21, a receiving unit 22, a calculation unit 23, a recording unit 24, an analysis unit 25, a control unit 26, and a transmission unit 27. The management unit 21 controls the entire system and manages patient data, processes reservations, and schedules data transmission. The receiving unit 22 receives data from the patient device 1 and the physician device 3 and forwards it to the management unit 21. The calculation unit 23, including the analysis unit 25 (e.g., artificial intelligence), processes the received data and performs data integration and analysis as needed.

[0051] Specifically, the analysis unit 25 integrates the medical history information and biometric data to generate differential diagnosis candidates, selects the necessary non-invasive examination items to narrow down the differential diagnosis candidates, controls the patient-side device 1 to perform an automated physical examination and tests, narrows down the differential diagnosis candidates, and generates treatment options. Based on the differential diagnosis candidates and treatment options, it searches for and presents potential medical institutions, and automatically makes a reservation after the patient makes a selection. The analysis unit 25 is characterized by identifying the appropriate medical department based on the data obtained from the patient, presenting medical institutions in cooperation with an external or internal medical institution information database, and performing the reservation process using an automated reservation means. As a result, even elderly people living in remote areas or those with limited access to information can quickly receive treatment at the most suitable medical institution for multiple possible diseases.

[0052] Although processing in the analysis unit is possible even without artificial intelligence, entrusting the processing performed by the analysis unit to artificial intelligence can further improve processing speed and accuracy. The recording unit 24 stores data including patient data (medical interview information, sensory data, vital signs, PHR data), a list of medical institutions, and parameters of the artificial intelligence model. The control unit 26 combines the management unit 21 and the calculation unit 23. The transmission unit 27 transmits data to the patient-side device 1 and the physician-side device 3.

[0053] Server 2 employs a hybrid configuration of on-premises and cloud (claim 19) or a cloud-only configuration (claim 18). In the hybrid configuration, the on-premises server handles data processing and local communication with patient-side devices, while the cloud server handles communication with external devices (such as physician-side devices) and efficient data transmission.

[0054] Specifically, processes that are completed between patient-side device 1 and server 2 (e.g., sending consent data, collecting vital signs and non-invasive test data, processing within the on-premises server) are handled by the on-premises server. On the other hand, when patient-side device 1 exchanges data with physician-side device 3 (e.g., sending patient data, forwarding physician's test requests, sending additional test data), it goes through the cloud server, and the cloud server is used to streamline external communication even in sparsely populated or suburban areas. Communication between the physician-side device and the server is based on the assumption that physicians are generally located in urban areas, and the cloud server is used to achieve efficient data transmission utilizing high-speed lines (e.g., 5G or 10Gbps). The cloud configuration ensures high-speed processing and scalability.

[0055] (2) [Processing details of the Five Senses Telemedicine System 4] The processing details of the five-senses telemedicine system of the first configuration (first embodiment) will be described in detail below with reference to Figure 8. The patient enters the selected consent information for data transmission into patient-side device 1 using electronic signature and app authentication (Figure 9: Step S1; hereafter, "Step S~" will be referred to as "S~"). Patient-side device 1 then transfers the consent information to server 2 (S2: Patient-side device 1 → Server 2). Server 2 instructs patient-side device 1 to present the medical questionnaire (S3: Server 2 → Patient-side device 1). The medical questionnaire is presented via screen display or audio. The patient enters the medical questionnaire information via the interface (touch panel, microphone, etc.) that makes up patient-side device 1 (S4: Patient → Patient-side device 1).

[0056] Server 2 instructs patient-side device 1 on how to measure vital signs (e.g., body temperature, pulse, heart rate, blood pressure, respiratory rate, oxygen saturation, etc.) (S5: Server 2 → Patient-side device 1). Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and the biometric information detector 15 measures the vital signs (S6: Patient-side device 1 ⇔ Patient). Patient-side device 1 transmits the medical history information (information answered in response to the medical history) and the measured vital signs to server 2 (S7: Patient-side device 1 → Server 2).

[0057] Server 2 generates differential diagnosis candidates using the analysis unit 25 (for example, taking into account sensory data) (S8: Server 2 internal processing). Based on the generated differential diagnosis candidates, Server 2 instructs the patient-side device 1 to perform non-invasive examinations (S9: Server 2 → Patient-side device 1). Patient-side device 1 performs non-invasive physical examinations on the patient (S10: Patient-side device 1 ⇔ Patient). Patient-side device 1 transmits the results of the physical examinations to Server 2 (S11: Patient-side device 1 → Server 2).

[0058] Server 2 narrows down differential diagnoses and searches for medical institutions based on the received physical examination and test results (S12: Server 2 internal processing). Server 2 presents the searched medical institutions to the patient-side device 1 (S13: Server 2 → Patient-side device 1). The patient selects a medical institution via the patient-side device 1 (S14: Patient → Patient-side device 1). The patient-side device 1 sends the medical institution selection result to Server 2 (S15: Device 1 → Server 2). Server 2 executes the reservation for the selected medical institution (S16: Server 2 internal processing). The doctor at the medical institution reviews the data, makes a diagnosis, and contacts the patient to discuss the course of action (S17: Doctor at medical institution ⇔ Patient). According to the five-sense telemedicine system of the first embodiment described above, it is possible to integrate visual, auditory, tactile, olfactory, and gustatory data with a simple configuration and achieve diagnostic accuracy that surpasses conventional telemedicine systems.

[0059] <Second Embodiment (Second Configuration)> The following describes the second embodiment of the five-senses telemedicine system 5. The five-senses telemedicine system 5 is a system that remotely connects a patient and a doctor using a patient-side device 1, a server 2, and a doctor-side device 3. Note that the configuration of the patient-side device 1 and the server 2 is the same as in the first configuration, so it will be omitted here.

[0060] (Physician's device 3) The physician-side device 3 (Figure 7) is required to include a visual / auditory device 31, which includes at least one of the following: VR goggles, a PC with a camera, a smartphone, a tablet, or a wearable device, and also includes at least one of the following: a tactile device 32, an olfactory device 33, and a gustatory device 34. Patient information (medical history information, biometric information, physical examination / test information, differential diagnosis candidates, and proposed treatment) acquired via the patient-side device 1 is transmitted from the patient-side device 1 to the physician-side device 3 of the medical institution that has been automatically booked, and the physician reviews it. The physician remotely operates the physician-side device 3 to conduct additional medical history interviews, physical examinations, and tests on the patient, and acquires additional information via the patient-side device 1. Based on all the acquired data, the physician makes a diagnosis, communicates the diagnosis to the patient, and discusses proposed treatment.

[0061] For example, when a doctor uses a visual / auditory device 31 (VR goggles) to perform actions on a 3D model of a patient in a VR space, the motion tracking function detects those movements, and the motion transmission unit 1222 of the patient-side device 1 reproduces the actions, enabling remote palpation and evaluation of joint range of motion. In addition, the doctor-side device 3 can instruct the odor-emitting unit 132 of the olfactory device 13 of the patient-side device 1 to spray a relaxing scent (e.g., lavender), thereby enhancing the patient's psychological sense of security. The detailed configuration of the doctor-side device 3 is as follows.

[0062] The visual and auditory device 31 that constitutes the physician-side device 3 includes an imaging unit 311 for acquiring visual data, a display unit 312 for displaying data, a microphone unit 313 with voice input functionality, and a speaker unit 314 with audio output functionality. For example, in addition to acquiring visual data as described above using VR goggles, a smartphone, or a tablet as the visual and auditory device 31, it may also be used for video calls or data verification (e.g., displaying text of medical history information, viewing medical images).

[0063] The VR goggles display patient data in real time (e.g., 3D skin model, time-series graph of vital signs), and use motion tracking functionality (e.g., resolution of 2064 x 2208 pixels / eye or higher, 4 or more tracking cameras) to detect the doctor's movements. They can also remotely control the motion transmission unit 1222 of the patient-side device 1 to assist with palpation and joint range of motion assessment. Data is transmitted to and received from the server 2 or the doctor-side device 3 via the transmitter 3315 and receiver 316.

[0064] The temperature sensing unit 3211, which constitutes the tactile device 32, senses the doctor's skin temperature (e.g., 38.0°C, 0.1°C accuracy) and outputs temperature data. The pressure sensor unit 3213 senses the pressure applied by the doctor (e.g., 0.1N accuracy) and outputs pressure data. The motion sensor unit 3212 senses the doctor's movements (e.g., hand movements during palpation) and outputs motion data (0.1°C accuracy). This data is transmitted to the patient-side device 1 via the transmission unit 323. The temperature sensing unit 3211, motion sensor unit 3212, and pressure sensor unit 3213 are collectively referred to as the tactile sensor unit 321, and the tactile sensor unit 321 includes at least one of the temperature sensing unit 3211, motion sensor unit 3212, and pressure sensor unit 3213.

[0065] Similarly, the temperature transmission unit 3221, which also constitutes the tactile device 32, reproduces the temperature sensed by the temperature sensing unit 1211 of the patient-side device 1 (e.g., confirming the sensation of heat at the site of inflammation). The pressure transmission unit 3222 reproduces the pressure sensed by the pressure sensor unit 3213 of the patient-side device 1. The motion transmission unit 3222 reproduces the motion sensed by the motion sensor unit 1212 of the patient-side device 1. The temperature transmission unit 3221, motion transmission unit 3222, and pressure transmission unit 3223 are collectively referred to as the tactile transmission unit 322, and the tactile transmission unit 322 includes at least one of the temperature transmission unit 3221, motion transmission unit 3222, and pressure transmission unit 3223.

[0066] Data is transmitted to and received from server 2 or physician-side device 3 via the transmitting unit 323 and receiving unit 324. Furthermore, the temperature sensing unit 3211, motion sensor unit 3212, and pressure sensor unit 3213 may be omitted, and the configuration may be specialized in sensory reproduction using only the temperature transmission unit 3221, motion transmission unit 3222, and pressure transmission unit 3223. Alternatively, each transmission unit may be omitted, and the configuration may be specialized in data acquisition using only the temperature sensing unit 3211, motion sensor unit 3212, and pressure sensor unit 3213.

[0067] The odor-generating unit 332 of the olfactory device 33 reproduces an odor (e.g., acetone odor) based on body odor data transmitted from the patient-side device 1, and the physician can confirm the odor by smell (e.g., to support the diagnosis of diabetic ketoacidosis). The odor-collecting unit 331 senses the odor generated by the physician, converts it into a digital signal, and transmits it to the patient-side device 1, thereby testing the patient's sense of smell. Data is transmitted to and received from the server 2 or the physician-side device 3 via the transmitting unit 333 and the receiving unit 334. Furthermore, in some embodiments, the odor-collecting unit 331 may be omitted, and the configuration may be specialized in reproducing odors from the patient side using only the odor-generating unit 332. Alternatively, the odor-generating unit 332 may be omitted, and the configuration may be specialized in acquiring data using only the odor-collecting unit 331.

[0068] The taste reproduction unit 342, which constitutes the taste device 34, reproduces taste data transmitted from the patient-side device 1 to the physician using electrical stimulation, allowing the physician to confirm the taste (e.g., to support the diagnosis of hyponatremia). The taste collection unit 341 can reproduce the sensed taste to the patient using electrical stimulation via the taste reproduction unit 1142 of the taste device 14 on the patient-side device 1. Taste data is transmitted and received via the transmission unit 343 and the reception unit 344. In some embodiments, the taste collection unit 341 may be omitted, and the configuration may be specialized in reproducing taste from the physician's side using only the taste reproduction unit 342. Alternatively, the taste reproduction unit 342 may be omitted, and the configuration may be specialized in acquiring data from the patient's side using only the taste collection unit 341.

[0069] [Processing details of the Five Senses Telemedicine System 5] The processing details of the five-sense remote medical consultation system 5 according to the second embodiment will be described in detail below with reference to Figure 9. The patient's consent information for data transmission, selected using electronic signature and app authentication, is entered into the patient's device 1 (Figure 9: S1), and the patient's device 1 transfers the consent information to the server 2 (S2: Patient's device 1 → Server 2). The server 2 instructs the patient's device 1 to present the medical questionnaire (S3: Server 2 → Patient's device 1). The medical questionnaire is presented either on the screen or via audio. The patient enters the medical questionnaire information via the interface (touch panel, microphone, etc.) that makes up the patient's device 1 (S4: Patient → Patient's device 1).

[0070] Server 2 instructs patient-side device 1 on how to measure vital signs (e.g., body temperature, pulse, heart rate, blood pressure, respiratory rate, oxygen saturation, etc.) (Step S5: Server 2 → Patient-side device 1). Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and the biometric information detector 15 measures the vital signs (S6: Patient-side device 1 ⇔ Patient). Patient-side device 1 transmits the medical history information (information answered in response to the medical history) and the measured vital signs to Server 2 (S7: Patient-side device 1 → Server 2). Server 2 generates differential diagnosis candidates using the analysis unit 25 (for example, considering sensory data) (S8: Server 2 internal processing). Based on the generated differential diagnosis candidates, Server 2 instructs patient-side device 1 to perform non-invasive examinations (S9: Server 2 → Patient-side device 1). Patient-side device 1 performs non-invasive physical examinations on the patient (S10: Patient-side device 1 ⇔ Patient). Patient device 1 sends the physical examination and test results to server 2 (S11: Patient device 1 → Server 2).

[0071] Server 2 narrows down the differential diagnosis candidates and searches for medical institutions based on the received physical examination and test results (S12: Server 2 internal processing). Server 2 presents the searched medical institutions to the patient-side device 1 (S13: Server 2 → Patient-side device 1). The patient selects a medical institution via the patient-side device 1 (S14: Patient → Patient-side device 1). The patient-side device 1 sends the medical institution selection result to Server 2 (S15: Device 1 → Server 2). Server 2 makes a reservation for the selected medical institution (S16: Server 2 internal processing). Server 2 sends the patient data to the physician-side device 3 (S17: Server 2 → Physician-side device 3). Physician-side device 3 presents the patient data to the physician, who confirms it (S18: Physician-side device 3 → Physician). The physician requests additional questions, physical examinations, and tests via the physician-side device 3 (S19: Physician → Physician-side device 3).

[0072] Physician device 3 forwards the additional request to server 2 (S20: Physician device 3 → Server 2). Server 2 instructs patient device 1 to forward the additional request (S21: Server 2 → Patient device 1). Patient device 1 conducts additional interviews, physical examinations, and tests on the patient (S22: Patient device 1 ⇔ Patient). Patient device 1 sends additional data, such as additional interviews, physical examinations, and tests, to server 2 (S23: Patient device 1 → Server 2). Server 2 forwards all patient data (all of the patient's history data) to physician device 3 (S24: Server 2 → Physician device 3). Physician device 3 presents all patient data to the physician (S25: Physician device 3 → Physician). The physician and patient discuss the diagnosis and treatment plan via physician device 3, server 2, and patient device 1 (S26: Physician ⇔ Patient).

[0073] According to the five-sense telemedicine system of the second embodiment described above, visual, auditory, tactile, olfactory, and gustatory data are integrated, providing a diagnostic accuracy that surpasses that of conventional telemedicine systems.

[0074] <Third Embodiment (Third Configuration)> The following describes the five-senses telemedicine system 6 according to the third embodiment. The five-senses telemedicine system 6 is a system that remotely connects a patient and a doctor using a patient-side device 1 and a doctor-side device 3 (see Figures 3, 5, and 7). The configuration of the doctor-side device 3 is the same as in the second configuration, so it will be omitted here. The configuration of the patient-side device 1 is the same as in the first and second configurations except that a data processing unit 17 is added, so only the differences will be described here.

[0075] The data processing unit 17 of the patient-side device 1 consists of a management unit 171, a receiving unit 172, a calculation unit 173, a recording unit 174, an analysis unit 175, a control unit 176, and a transmission unit 177. The management unit 171 controls the entire system and manages patient data, processes reservations, and schedules data transmission. The receiving unit 172 receives data from the physician-side device 3 and transfers it to the management unit 171. The calculation unit 173, in this configuration, includes an analysis unit 175 (e.g., artificial intelligence), processes the received data, and performs data integration and analysis as needed.

[0076] Specifically, the analysis unit 175 integrates the medical history information and biometric data to generate differential diagnosis candidates, selects the necessary non-invasive examination items to narrow down these differential diagnosis candidates, and controls the patient-side device 1 to perform an automated physical examination and tests. Furthermore, the analysis unit 175 further narrows down the differential diagnosis candidates and generates treatment options. In addition, the analysis unit 175 searches for and presents candidate medical institutions based on the differential diagnosis candidates and treatment options, and automatically makes a reservation after the patient selects one. Based on the data obtained from the patient, the analysis unit 175 identifies the appropriate medical department, presents medical institutions in conjunction with an external or internal medical institution information database, and performs the reservation process using an automated reservation system.

[0077] This will allow elderly people living in remote areas and those with limited access to information to quickly access the most suitable medical facilities for multiple potential illnesses. While processing in the analysis department is possible without artificial intelligence, entrusting the processing performed by the analysis department to artificial intelligence will further improve processing speed and accuracy.

[0078] The recording unit 174 stores data including patient data (medical interview information, sensory data, vital signs, PHR data), a list of medical institutions, and parameters of the artificial intelligence model. The control unit 176 has a management unit 171 and a calculation unit 173. The transmission unit 177 transmits data to the patient-side device 1 and the physician-side device 3.

[0079] The data processing unit 17 employs a hybrid configuration of on-premises and cloud (claim 19) or a cloud-only configuration (claim 18). In the hybrid configuration, the on-premises system is responsible for data processing and local communication with the patient's device, while the cloud is responsible for communication with external devices (such as the physician's device) and efficient data transmission. Specifically, the on-premises server is responsible for processing that is completed between the patient's device and the server (e.g., sending consent data, collecting vital signs and non-invasive test data, processing within the on-premises server).

[0080] On the other hand, when patient devices exchange data with physician devices (e.g., sending patient data, forwarding physician's test requests, sending additional test data), the data is transmitted via a cloud server, streamlining external communication even in sparsely populated or suburban areas. The communication between physician devices and the server is based on the assumption that physicians are primarily located in urban areas, utilizing the cloud server and achieving efficient data transmission through high-speed connections (e.g., 5G or 10Gbps). The cloud configuration ensures high-speed processing and scalability.

[0081] [Processing details of the Five Senses Telemedicine System 6] The processing details of the five-sense remote medical consultation system 6 according to the third embodiment will be described in detail below with reference to Figure 10. The patient's consent information for data transmission, selected using electronic signature and app authentication, is entered into the patient-side device 1 (Figure 10: S1). The patient-side device 1 presents the medical questionnaire, which is presented via screen display or audio (S2: Patient-side device 1). The patient enters the medical questionnaire information via the interface (touch panel, microphone, etc.) that makes up the patient-side device 1 (S3: Patient ⇔ Patient-side device 1).

[0082] Patient-side device 1 provides instructions on how to measure vital signs (e.g., body temperature, pulse, heart rate, blood pressure, respiratory rate, oxygen saturation, etc.) (S4: Patient-side device 1). Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and the biometric information detector 15 measures the vital signs (S5: Patient-side device 1 ⇔ Patient). Based on the medical history information (information answered in response to the medical history) and the measured vital signs, patient-side device 1 uses its analysis unit 175 to generate differential diagnosis candidates (for example, considering sensory data) (S6: Internal processing of patient-side device 1). Based on the generated differential diagnosis candidates, patient-side device 1 instructs each device of patient-side device 1 to perform non-invasive examinations (S7: Patient-side device 1).

[0083] Patient-side device 1 performs a non-invasive physical examination and tests on the patient (S8: Patient-side device 1 ⇔ Patient). Based on the results of the physical examination and tests, patient-side device 1 narrows down the differential diagnosis candidates and searches for medical institutions (S9: Internal processing of patient-side device 1). Patient-side device 1 presents the searched medical institutions (S10: Patient-side device 1). The patient selects a medical institution via patient-side device 1 (S11: Patient → Patient-side device 1). Patient-side device 1 makes a reservation at the selected medical institution (S12: Internal processing of patient-side device 1). Patient-side device 1 transmits patient data to physician-side device 3 (S13: Patient-side device 1 → Physician-side device 3). Physician-side device 3 presents the patient data to the physician, who confirms it (S14: Physician-side device 3 → Physician). The physician requests additional questions, physical examinations, and tests via physician-side device 3 (S15: Physician → Physician-side device 3).

[0084] Specifically, physician device 3 forwards additional requests from the physician to patient device 1 (S16: Physician device 3 → Patient device 1). Patient device 1 instructs each device on patient device 1 to make additional requests (S17: Patient device). Patient device 1 conducts additional interviews, physical examinations, and tests on the patient (S18: Patient device 1 ⇔ Patient). Patient device 1 forwards all patient data to physician device 3 (S19: Patient device 1 → Physician device 3). Physician device 3 presents all patient data to the physician (S20: Physician device 3 → Physician). The physician and patient discuss the diagnosis and treatment plan via physician device 3 and patient device 1 (S21: Physician ⇔ Patient).

[0085] According to the five-sense remote medical consultation system of the third embodiment described above, it is possible to integrate visual, auditory, tactile, olfactory, and gustatory data with a simple configuration and achieve diagnostic accuracy that surpasses conventional remote medical consultation systems.

[0086] The communication employs compression technologies (e.g., H.265) and protocols (e.g., UDP) to support low-speed connections (e.g., 1 Mbps or less), and ensures stability through packet loss compensation (e.g., forward error correction) and bandwidth adaptive control. Security is guaranteed through consent (electronic signature, application authentication) in accordance with the Personal Information Protection Act, encryption technology (e.g., AES-256), and access control (e.g., role-based access control (RBAC)).

[0087] PHR data utilization PHR data is analyzed by an analysis unit 25 located within the calculation unit 23 of server 2, or by an analysis unit 175 located within the calculation unit 173 of the data processing unit 17 of the patient-side device, and used for correcting differential diagnoses and for ongoing health management. For example, past medical history (e.g., diabetes) is integrated with fever and body odor data (acetone odor) to prioritize the presentation of diabetic ketoacidosis. Medication history (e.g., steroid use) is considered to correct differential diagnoses for skin rashes, and drug-induced dermatitis is considered. For ongoing health management, long-term trends in blood pressure and blood glucose levels are analyzed to propose management plans for hypertension and diabetes. [Examples]

[0088] Below, an example of the first embodiment (configuration of patient-side device 1 and server 2) will be described with reference to Figure 8, using Examples 1 to 5 as specific examples. <Example 1> The patient's side consists only of a visual / auditory device 11 (VR goggles), a biometric information detector 15, and a server 2 (in urban areas). S1: A male patient in his 70s enters consent information for data transmission into patient-side device 1 (Patient → Patient-side device 1). S2: Patient device 1 transfers consent information to server 2 (patient device 1 → server 2). S3: Server 2 instructs patient-side device 1 to present the medical questionnaire (Server 2 → Patient-side device 1). S4: The patient enters the medical information (fever 38.0℃, cough) into patient-side device 1 (patient → patient-side device 1). S5: Server 2 instructs patient-side device 1 on how to measure vital signs (Server 2 → Patient-side device 1). S6: Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and measures vital signs using the biometric information detector 15 (body temperature 38.0°C, pulse 90 bpm, blood pressure 120 / 80 mmHg, oxygen saturation 95%) (patient-side device 1 ⇔ patient). S7: Patient device 1 sends medical history information and vital signs to server 2 (patient device 1 → server 2). S8: Server 2 generates differential diagnosis candidates using the analysis unit 25 (internal processing by Server 2). Based on the interview data (fever 38.0°C, cough), vital signs (body temperature 38.0°C, oxygen saturation 95%), and PHR data (history of respiratory disease), the analysis unit 25 generates five initial candidates: acute bronchitis, pneumonia, asthma, acute upper respiratory tract infection, and chronic obstructive pulmonary disease. S9: Server 2 instructs patient-side device 1 to perform a non-invasive test based on the differential diagnosis candidates (Server 2 → Patient-side device 1). S10: Patient-side device 1 performs a non-invasive physical examination and tests on the patient (recording breath sounds with microphone unit 113) (patient-side device 1 ⇔ patient). S11: Patient device 1 sends the physical examination and test results to server 2 (patient device 1 → server 2). S12: Server 2 narrows down the differential diagnosis candidates and searches for medical institutions (internal processing by Server 2). Analysis unit 25 integrates the additional data, prioritizing cough and fever of 38.0°C, and narrows the candidates down to acute bronchitis as the first choice and pneumonia as the second choice based on oxygen saturation of 95%. Internal medicine is recommended. S13: Server 2 presents medical institutions to patient device 1 (recommending Internal Medicine, N Clinic, O Hospital, and P Clinic) (Server 2 → Patient device 1). S14: The patient selects a healthcare facility via patient-side device 1 (Patient → Patient-side device 1). S15: Patient device 1 sends the medical institution selection result to server 2 (patient device 1 → server 2). S16: Server 2 executes the appointment booking for the medical institution (internal processing on Server 2). S17: A physician at the medical institution reviews the data, makes a diagnosis, and contacts the patient to discuss the course of action (Final diagnosis: Pneumonia. Course of action: Antibiotic treatment decided) (Physician at medical institution ⇔ Patient).

[0089] <Example 2> The patient's side consists only of a visual / auditory device 11 (smartphone), an olfactory device 13, a biometric information detector 15, and a server 2 (in a suburban area). S1: A female patient in her 40s enters consent information for data transmission into patient-side device 1 (Patient → Patient-side device 1). S2: Patient device 1 transfers consent information to server 2 (patient device 1 → server 2). S3: Server 2 instructs patient-side device 1 to present the medical questionnaire (Server 2 → Patient-side device 1). S4: The patient inputs the medical information (fever 37.5°C, decreased sense of smell) into patient-side device 1 (Patient → Patient-side device 1). S5: Server 2 instructs patient-side device 1 on how to measure vital signs (Server 2 → Patient-side device 1). S6: Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and measures vital signs using the vital signs detector 15 (body temperature 37.5°C, pulse 82 bpm, blood pressure 110 / 70 mmHg, oxygen saturation 96%) (patient-side device 1 ⇔ patient). S7: Patient device 1 sends medical history information and vital signs to server 2 (patient device 1 → server 2). S8: Server 2 generates differential diagnosis candidates using the analysis unit 25 (internal processing by Server 2). Based on the interview data (fever 37.5°C, decreased sense of smell), vital signs (body temperature 37.5°C, oxygen saturation 96%), and PHR data (history of infection), the analysis unit 25 generates five initial candidates: sinusitis, acute upper respiratory tract infection, influenza, allergic rhinitis, and complications of sinusitis. S9: Server 2 instructs patient-side device 1 to perform a non-invasive test based on the differential diagnosis candidates (Server 2 → Patient-side device 1). S10: Patient-side device 1 performs a non-invasive physical examination and tests on the patient (olfactory device 13 confirms decreased sense of smell) (patient-side device 1 ⇔ patient). S11: Patient device 1 sends the physical examination and test results to server 2 (patient device 1 → server 2). S12: Server 2 narrows down the differential diagnosis candidates and searches for medical institutions (internal processing by Server 2). Analysis unit 25 integrates the additional data, prioritizing decreased sense of smell, and narrows the candidates down to sinusitis as the first choice and acute upper respiratory tract infection as the second choice based on the oxygen saturation of 96%. It recommends an otolaryngologist. S13: Server 2 presents medical institutions to patient device 1 (recommending ENT clinics, O Clinic, P Hospital, and Q Clinic) (Server 2 → Patient device 1). S14: The patient selects a healthcare facility via patient-side device 1 (Patient → Patient-side device 1). S15: Patient device 1 sends the medical institution selection result to server 2 (patient device 1 → server 2). S16: Server 2 executes the appointment booking for the medical institution (internal processing on Server 2). S17: A physician at a medical institution reviews the data, makes a diagnosis, and contacts the patient to discuss the course of action (Final diagnosis: sinusitis. Course of action: antibiotic treatment is decided) (Physician at medical institution ⇔ Patient).

[0090] <Example 3> The patient's side only has a visual / auditory device 11 (tablet), a biometric information detector 15, and a server 2 (in a sparsely populated area). S1: A male patient in his 70s enters consent information for data transmission into patient-side device 1 (Patient → Patient-side device 1). S2: Patient device 1 transfers consent information to server 2 (patient device 1 → server 2). S3: Server 2 instructs patient-side device 1 to present the medical questionnaire (Server 2 → Patient-side device 1). S4: The patient enters the medical information (chest pain, shortness of breath) into patient-side device 1 (Patient → Patient-side device 1). S5: Server 2 instructs patient-side device 1 on how to measure vital signs (Server 2 → Patient-side device 1). S6: Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and measures vital signs using the vital signs detector 15 (body temperature 36.5℃, pulse 110 bpm, blood pressure 130 / 90 mmHg, oxygen saturation 92%, respiratory rate 20 breaths / min) (patient-side device 1 ⇔ patient). S7: Patient device 1 sends medical history information and vital signs to server 2 (patient device 1 → server 2). S8: Server 2 generates differential diagnosis candidates using the analysis unit 25 (internal processing by Server 2). Based on the interview data (chest pain, shortness of breath), vital signs (pulse rate 110 bpm, oxygen saturation 92%, respiratory rate 20 breaths / min), and PHR data (history of heart disease), the analysis unit 25 generates five initial candidates: arrhythmia, pulmonary embolism, myocardial infarction, acute coronary syndrome, and acute pericarditis. S9: Server 2 instructs patient-side device 1 to perform a non-invasive test based on the differential diagnosis candidates (Server 2 → Patient-side device 1). S10: Patient-side device 1 performs a non-invasive physical examination and tests on the patient (recording heart sounds and breath sounds with microphone unit 113) (patient-side device 1 ⇔ patient). S11: Patient device 1 sends the physical examination and test results to server 2 (patient device 1 → server 2). S12: Server 2 narrows down the differential diagnosis candidates and searches for medical institutions (internal processing by Server 2). Analysis unit 25 integrates the additional data, prioritizing chest pain and oxygen saturation of 92%, and narrows the candidates down to myocardial infarction as the first choice and arrhythmia as the second choice based on a pulse rate of 110 bpm. Cardiology is recommended. S13: Server 2 presents medical institutions to patient device 1 (recommending Cardiology, P Clinic, Q Hospital, and R Clinic) (Server 2 → Patient device 1). S14: The patient selects a healthcare facility via patient-side device 1 (Patient → Patient-side device 1). S15: Patient device 1 sends the medical institution selection result to server 2 (patient device 1 → server 2). S16: Server 2 executes the appointment booking for the medical institution (internal processing on Server 2). S17: A physician at the medical institution reviews the data, makes a diagnosis, and contacts the patient to discuss the course of action (Final diagnosis: Myocardial infarction. Course of action: Percutaneous coronary intervention is decided) (Physician at the medical institution ⇔ Patient).

[0091] <Example 4> The patient's side consists only of a visual / auditory device 11 (VR goggles), a haptic device 12, a biometric information detector 15, and a server 2 (in urban areas). S1: A female patient in her 50s enters consent information for data transmission into patient-side device 1 (Patient → Patient-side device 1). S2: Patient device 1 transfers consent information to server 2 (patient device 1 → server 2). S3: Server 2 instructs patient-side device 1 to present the medical questionnaire (Server 2 → Patient-side device 1). S4: The patient enters the medical information (joint pain, swelling) into patient-side device 1 (Patient → Patient-side device 1). S5: Server 2 instructs patient-side device 1 on how to measure vital signs (Server 2 → Patient-side device 1). S6: Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and measures vital signs using the vital signs detector 15 (body temperature 36.5°C, pulse 70 bpm, blood pressure 115 / 75 mmHg, oxygen saturation 98%) (patient-side device 1 ⇔ patient). S7: Patient device 1 sends medical history information and vital signs to server 2 (patient device 1 → server 2). S8: Server 2 generates differential diagnosis candidates using the analysis unit 25 (internal processing by Server 2). Based on the interview data (joint pain, swelling), vital signs (body temperature 36.5°C, oxygen saturation 98%), and PHR data (history of joint pain), the analysis unit 25 generates five initial candidates: rheumatoid arthritis, gout, osteoarthritis, arthritis, and polymyalgia rheumatica. S9: Server 2 instructs patient-side device 1 to perform a non-invasive test based on the differential diagnosis candidates (Server 2 → Patient-side device 1). S10: Patient-side device 1 performs a non-invasive physical examination and test on the patient (measuring joint stiffness with tactile device 12) (patient-side device 1 ⇔ patient). S11: Patient device 1 sends the physical examination and test results to server 2 (patient device 1 → server 2). S12: Server 2 narrows down the differential diagnosis candidates and searches for medical institutions (internal processing by Server 2). Analysis unit 25 integrates the additional data, prioritizing joint pain and swelling, and narrows the candidates down to osteoarthritis as the first choice and gout as the second choice based on the oxygen saturation of 98%. Orthopedics is recommended. S13: Server 2 presents medical institutions to patient device 1 (recommending Orthopedics, Q Hospital, R Clinic, and S Medical Clinic) (Server 2 → Patient device 1). S14: The patient selects a healthcare facility via patient-side device 1 (Patient → Patient-side device 1). S15: Patient device 1 sends the medical institution selection result to server 2 (patient device 1 → server 2). S16: Server 2 executes the appointment booking for the medical institution (internal processing on Server 2). S17: A physician at the medical institution reviews the data, makes a diagnosis, and contacts the patient to discuss the course of action (Final diagnosis: Osteoarthritis. Course of action: Physical therapy and anti-inflammatory pain medication are decided) (Physician at the medical institution ⇔ Patient).

[0092] <Example 5> The patient's side consists only of a visual / auditory device 11 (smartphone), a taste device 14, a biometric information detector 15, and a server 2 (in a suburban area). S1: A male patient in his 40s enters consent information for data transmission into patient-side device 1 (Patient → Patient-side device 1). S2: Patient device 1 transfers consent information to server 2 (patient device 1 → server 2). S3: Server 2 instructs patient-side device 1 to present the medical questionnaire (Server 2 → Patient-side device 1). S4: The patient inputs the medical information (taste abnormality, fever 37.0℃) into patient-side device 1 (Patient → Patient-side device 1). S5: Server 2 instructs patient-side device 1 on how to measure vital signs (Server 2 → Patient-side device 1). S6: Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and measures vital signs using the biometric information detector 15 (body temperature 37.0℃, pulse 78 bpm, blood pressure 110 / 70 mmHg, oxygen saturation 97%, blood glucose 120 mg / dL) (patient-side device 1 ⇔ patient). S7: Patient device 1 sends medical history information and vital signs to server 2 (patient device 1 → server 2). S8: Server 2 generates differential diagnosis candidates using the analysis unit 25 (internal processing by Server 2). Based on the interview data (taste abnormality, fever 37.0°C), vital signs (body temperature 37.0°C, blood glucose level 120 mg / dL), and PHR data (history of infectious diseases), the analysis unit 25 generates five initial candidates: COVID-19, diabetes-related disorder, sinusitis, influenza, and acute upper respiratory tract infection. S9: Server 2 instructs patient-side device 1 to perform a non-invasive test based on the differential diagnosis candidates (Server 2 → Patient-side device 1). S10: Patient-side device 1 performs a non-invasive physical examination and tests on the patient (taste abnormalities are measured with taste device 14) (patient-side device 1 ⇔ patient). S11: Patient device 1 sends the physical examination and test results to server 2 (patient device 1 → server 2). S12: Server 2 narrows down the differential diagnosis candidates and searches for medical institutions (internal processing by Server 2). Analysis unit 25 integrates the additional data, prioritizing taste abnormalities, and narrows the candidates down to COVID-19 as the first choice and diabetes-related disorders as the second choice based on the blood glucose level of 120 mg / dL. Internal medicine is recommended. S13: Server 2 presents medical institutions to patient device 1 (recommending Internal Medicine, R Clinic, S Hospital, and T Clinic) (Server 2 → Patient device 1). S14: The patient selects a healthcare facility via patient-side device 1 (Patient → Patient-side device 1). S15: Patient device 1 sends the medical institution selection result to server 2 (patient device 1 → server 2). S16: Server 2 executes the appointment booking for the medical institution (internal processing on Server 2). S17: A physician at a medical institution reviews the data, makes a diagnosis, and contacts the patient to discuss the course of action (Final diagnosis: COVID-19. Course of action: Symptomatic treatment is decided) (Physician at medical institution ⇔ Patient).

[0093] Examples of the second embodiment (configuration of patient-side device 1, server 2, and physician-side device 3) will be explained using Examples 1 to 5 as specific examples with reference to Figure 9. In Examples 1 to 5, the processing content will be explained in order from S1.

[0094] <Example 1> All devices are utilized (Patient side: Visual / auditory devices 11 (VR goggles), tactile devices 12, olfactory devices 13, gustatory devices 14, vital signs detector 15, medical imaging device 16; Doctor side: Visual / auditory devices 31 (VR goggles), tactile devices 32, olfactory devices 33, gustatory devices 34, sparsely populated area) S1: A male patient in his 40s enters consent information for data transmission into patient-side device 1 (Patient → Patient-side device 1). S2: Patient device 1 transfers consent information to server 2 (patient device 1 → server 2). S3: Server 2 instructs patient-side device 1 to present the medical questionnaire (Server 2 → Patient-side device 1). S4: The patient enters the medical information (fever 39.0℃, cough, sore throat, skin rash, taste disturbance, dizziness) into patient-side device 1 (Patient → Patient-side device 1). S5: Server 2 instructs patient-side device 1 on how to measure vital signs (Server 2 → Patient-side device 1). S6: Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and measures vital signs using the biometric information detector 15 (body temperature 39.0°C, pulse 90 bpm, blood pressure 120 / 80 mmHg, oxygen saturation 95%) (patient-side device 1 ⇔ patient). S7: Patient device 1 sends medical history information and vital signs to server 2 (patient device 1 → server 2). S8: Server 2 generates differential diagnosis candidates using the analysis unit 25 (internal processing by Server 2). Based on interview data (fever 39.0°C, taste disturbance, cough, sore throat, skin rash, dizziness), vital signs (body temperature 39.0°C, pulse 90 bpm, oxygen saturation 95%), and PHR data (history of diabetes), the analysis unit 25 generates five initial candidates: diabetic ketoacidosis, infection (cellulitis), viral pharyngitis, influenza, and sepsis. S9: Server 2 instructs patient-side device 1 to perform a non-invasive test based on the differential diagnosis candidates (Server 2 → Patient-side device 1). S10: Patient-side device 1 performs a non-invasive physical examination and tests on the patient (visual and auditory device 11 captures images of pharyngeal erythema and skin rash, microphone unit 113 records breath sounds, tactile device 12 measures skin hardness and temperature, olfactory device 13 detects acetone odor, and gustatory device 14 measures saliva components) (patient-side device 1 ⇔ patient). S11: Patient device 1 sends the physical examination and test results to server 2 (patient device 1 → server 2). S12: Server 2 narrows down the differential diagnosis candidates and searches for medical institutions (internal processing by Server 2). Analysis unit 25 integrates the additional data, prioritizing the acetone odor detected by olfactory device 13, and narrows it down to diabetic ketoacidosis as the first candidate, and infection (cellulitis) as the second candidate based on the skin rash and oxygen saturation of 95%. Internal medicine is recommended. S13: Server 2 presents medical institutions to patient device 1 (recommending Internal Medicine, General Hospital A, Clinic B, and Medical Clinic C) (Server 2 → Patient device 1). S14: The patient selects a healthcare facility via patient-side device 1 (Patient → Patient-side device 1). S15: Patient device 1 sends the medical institution selection result to server 2 (patient device 1 → server 2). S16: Server 2 executes the appointment booking for the medical institution (internal processing on Server 2). S17: Server 2 sends patient data to physician's device 3 (Server 2 → Physician's device 3). S18: Physician's device 3 presents the data to the physician, who then reviews it (Physician's device 3 → Physician). S19: The doctor requests additional questions, physical examinations, and tests via the doctor's device 3 (Doctor → Doctor's device 3). S20: Doctor's device 3 forwards the additional request to server 2 (Doctor's device 3 → Server 2). S21: Server 2 instructs patient-side device 1 to make an additional request (Server 2 → Patient-side device 1). S22: Patient-side device 1 conducts additional interviews, physical examinations, and tests on the patient (a radiologist takes X-rays with medical imaging machine 16) (patient-side device 1 ⇔ patient). S23: Patient device 1 sends additional data to server 2 (patient device 1 → server 2). S24: Server 2 transfers all data (history data) to physician-side device 3 (Server 2 → Physician-side device 3). S25: Doctor's device 3 presents all data to the doctor (Doctor's device 3 → Doctor). S26: The physician and patient discuss the diagnosis and treatment plan via physician-side device 3, server 2, and patient-side device 1 (Final diagnosis: Diabetic ketoacidosis and cellulitis. Treatment plan: Continuous intravenous insulin infusion and intravenous saline infusion for diabetic ketoacidosis, and antibiotics for cellulitis) (Physician-side device 3 ⇔ Patient-side device 1).

[0095] <Example 2> The patient's side uses a visual / auditory device 11 (VR goggles), a taste device 14, and a biometric information detector 15, while the doctor's side uses a visual / auditory device 31 (VR goggles) and a taste device 34 (sparsely populated area). S1: A female patient in her 50s enters consent information for data transmission into patient-side device 1 (Patient → Patient-side device 1). S2: Patient device 1 transfers consent information to server 2 (patient device 1 → server 2). S3: Server 2 instructs patient-side device 1 to present the medical questionnaire (Server 2 → Patient-side device 1). S4: The patient inputs the medical information (taste abnormality, fever 38.0℃) into patient-side device 1 (Patient → Patient-side device 1). S5: Server 2 instructs patient-side device 1 on how to measure vital signs (Server 2 → Patient-side device 1). S6: Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and measures vital signs using the vital signs detector 15 (body temperature 38.0°C, pulse 85 bpm, blood pressure 115 / 75 mmHg, oxygen saturation 96%) (patient-side device 1 ⇔ patient). S7: Patient device 1 sends medical history information and vital signs to server 2 (patient device 1 → server 2). S8: Server 2 generates differential diagnosis candidates using the analysis unit 25 (internal processing by Server 2). Based on the interview data (taste abnormality, fever 38.0°C), vital signs (body temperature 38.0°C, oxygen saturation 96%), and PHR data (history of infectious diseases), the analysis unit 25 generates five initial candidates: COVID-19, sinusitis, influenza, taste disorder, and acute upper respiratory tract infection. S9: Server 2 instructs patient-side device 1 to perform a non-invasive test based on the differential diagnosis candidates (Server 2 → Patient-side device 1). S10: Patient-side device 1 performs a non-invasive physical examination and tests on the patient (taste abnormalities are measured with taste device 14) (patient-side device 1 ⇔ patient). S11: Patient device 1 sends the physical examination and test results to server 2 (patient device 1 → server 2). S12: Server 2 narrows down the differential diagnosis candidates and searches for medical institutions (internal processing by Server 2). Analysis unit 25 integrates the additional data, prioritizing taste abnormalities, and narrows the candidates down to COVID-19 as the first choice and sinusitis as the second choice based on the oxygen saturation of 96%. Internal medicine is recommended. S13: Server 2 presents medical institutions to patient device 1 (recommending Internal Medicine, Clinic C, Medical Office D, and Hospital E) (Server 2 → Patient device 1). S14: The patient selects a healthcare facility via patient-side device 1 (Patient → Patient-side device 1). S15: Patient device 1 sends the medical institution selection result to server 2 (patient device 1 → server 2). S16: Server 2 executes the appointment booking for the medical institution (internal processing on Server 2). S17: Server 2 sends patient data to physician's device 3 (Server 2 → Physician's device 3). S18: Physician's device 3 presents the data to the physician, who then reviews it (Physician's device 3 → Physician). S19: The doctor requests additional questions, physical examinations, and tests via the doctor's device 3 (Doctor → Doctor's device 3). S20: Doctor's device 3 forwards the additional request to server 2 (Doctor's device 3 → Server 2). S21: Server 2 instructs patient-side device 1 to make an additional request (Server 2 → Patient-side device 1). S22: Patient-side device 1 conducts additional interviews, physical examinations, and tests on the patient (conducts additional interviews) (patient-side device 1 ⇔ patient). S23: Patient device 1 sends additional data to server 2 (patient device 1 → server 2). S24: Server 2 transfers all data to physician device 3 (Server 2 → Physician device 3). S25: Doctor's device 3 presents all data to the doctor (Doctor's device 3 → Doctor). S26: The doctor and patient discuss the diagnosis and treatment plan via doctor-side device 3, server 2, and patient-side device 1 (Final diagnosis: COVID-19. Treatment plan: Symptomatic treatment is decided) (Doctor-side device 3 ⇔ Patient-side device 1).

[0096] <Example 3> The patient's side uses a visual / auditory device 11 (smartphone), a tactile device 12, an olfactory device 13, a gustatory device 14, and a biometric information detector 15. The doctor's side uses a visual / auditory device 31 (smartphone), a tactile device 32, an olfactory device 33, and a gustatory device 34 (urban area). S1: A male patient in his 20s enters consent information for data transmission into patient-side device 1 (Patient → Patient-side device 1). S2: Patient device 1 transfers consent information to server 2 (patient device 1 → server 2). S3: Server 2 instructs patient-side device 1 to present the medical questionnaire (Server 2 → Patient-side device 1). S4: The patient enters the medical information (fever 39.0℃, cough, sore throat, skin rash) into patient-side device 1 (Patient → Patient-side device 1). S5: Server 2 instructs patient-side device 1 on how to measure vital signs (Server 2 → Patient-side device 1). S6: Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and measures vital signs using the vital signs detector 15 (body temperature 39.0°C, pulse 88 bpm, blood pressure 125 / 85 mmHg, oxygen saturation 94%) (patient-side device 1 ⇔ patient). S7: Patient device 1 sends medical history information and vital signs to server 2 (patient device 1 → server 2). S8: Server 2 generates differential diagnosis candidates using the analysis unit 25 (internal processing by Server 2). Based on the interview data (fever 39.0°C, cough, sore throat, skin rash), vital signs (body temperature 39.0°C, oxygen saturation 94%), and PHR data (history of infection), the analysis unit 25 generates five initial candidates: bacterial pharyngitis, scarlet fever, viral pharyngitis, influenza, and tonsillitis. S9: Server 2 instructs patient-side device 1 to perform a non-invasive test based on the differential diagnosis candidates (Server 2 → Patient-side device 1). S10: Patient-side device 1 performs a non-invasive physical examination and tests on the patient (visual and auditory device 11 captures pharyngeal erythema, microphone unit 113 records breath sounds, tactile device 12 measures skin hardness, olfactory device 13 detects body odor, and gustatory device 14 measures saliva components) (patient-side device 1 ⇔ patient). S11: Patient device 1 sends the physical examination and test results to server 2 (patient device 1 → server 2). S12: Server 2 narrows down the differential diagnosis candidates and searches for medical institutions (internal processing by Server 2). Analysis unit 25 integrates the additional data, prioritizing pharyngeal erythema and narrowing the candidates down to bacterial pharyngitis as the first choice and scarlet fever as the second choice based on the skin rash. Internal medicine is recommended. S13: Server 2 presents medical institutions to patient device 1 (recommending Internal Medicine, Clinic D, Hospital E, and Clinic F) (Server 2 → Patient device 1). S14: The patient selects a healthcare facility via patient-side device 1 (Patient → Patient-side device 1). S15: Patient device 1 sends the medical institution selection result to server 2 (patient device 1 → server 2). S16: Server 2 executes the appointment booking for the medical institution (internal processing on Server 2). S17: Server 2 sends patient data to physician's device 3 (Server 2 → Physician's device 3). S18: Physician's device 3 presents the data to the physician, who then reviews it (Physician's device 3 → Physician). S19: The doctor requests additional questions, physical examinations, and tests via the doctor's device 3 (Doctor → Doctor's device 3). S20: Doctor's device 3 forwards the additional request to server 2 (Doctor's device 3 → Server 2). S21: Server 2 instructs patient-side device 1 to make an additional request (Server 2 → Patient-side device 1). S22: Patient-side device 1 conducts additional interviews, physical examinations, and tests on the patient (additional interviews and blood tests are performed) (patient-side device 1 ⇔ patient). S23: Patient device 1 sends additional data to server 2 (patient device 1 → server 2). S24: Server 2 transfers all data to physician device 3 (Server 2 → Physician device 3). S25: Doctor's device 3 presents all data to the doctor (Doctor's device 3 → Doctor). S26: The doctor and patient discuss the diagnosis and treatment plan via doctor-side device 3, server 2, and patient-side device 1 (Final diagnosis: Scarlet fever. Treatment plan: Antibiotic treatment decided) (Doctor-side device 3 ⇔ Patient-side device 1).

[0097] <Example 4> The patient's side uses a visual / auditory device 11 (VR goggles), an olfactory device 13, and a biometric information detector 15, while the doctor's side uses a visual / auditory device 31 (VR goggles) and an olfactory device 33 (urban area). S1: A male patient in his 40s enters consent information for data transmission into patient-side device 1 (Patient → Patient-side device 1). S2: Patient device 1 transfers consent information to server 2 (patient device 1 → server 2). S3: Server 2 instructs patient-side device 1 to present the medical questionnaire (Server 2 → Patient-side device 1). S4: The patient inputs the medical information (fever 38.0℃, decreased sense of smell) into patient-side device 1 (Patient → Patient-side device 1). S5: Server 2 instructs patient-side device 1 on how to measure vital signs (Server 2 → Patient-side device 1). S6: Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and measures vital signs using the biometric information detector 15 (body temperature 38.0°C, pulse 80 bpm, blood pressure 110 / 70 mmHg, oxygen saturation 97%) (patient-side device 1 ⇔ patient). S7: Patient device 1 sends medical history information and vital signs to server 2 (patient device 1 → server 2). S8: Server 2 generates differential diagnosis candidates using the analysis unit 25 (internal processing by Server 2). Based on the interview data (fever 38.0°C, decreased sense of smell), vital signs (body temperature 38.0°C, oxygen saturation 97%), and PHR data (history of infection), the analysis unit 25 generates five initial candidates: sinusitis, acute upper respiratory tract infection, influenza, allergic rhinitis, and complications of sinusitis. S9: Server 2 instructs patient-side device 1 to perform a non-invasive test based on the differential diagnosis candidates (Server 2 → Patient-side device 1). S10: Patient-side device 1 performs a non-invasive physical examination and tests on the patient (olfactory device 13 confirms decreased sense of smell) (patient-side device 1 ⇔ patient). S11: Patient device 1 sends the physical examination and test results to server 2 (patient device 1 → server 2). S12: Server 2 narrows down the differential diagnosis candidates and searches for medical institutions (internal processing by Server 2). Analysis unit 25 integrates the additional data, prioritizing decreased sense of smell, and narrows it down to sinusitis as the first candidate and acute upper respiratory tract infection as the second candidate based on the oxygen saturation of 97%. It recommends an otolaryngologist. S13: Server 2 presents medical institutions to patient device 1 (recommending ENT clinics, E Clinic, F Hospital, and G Clinic) (Server 2 → Patient device 1). S14: The patient selects a healthcare facility via patient-side device 1 (Patient → Patient-side device 1). S15: Patient device 1 sends the medical institution selection result to server 2 (patient device 1 → server 2). S16: Server 2 executes the appointment booking for the medical institution (internal processing on Server 2). S17: Server 2 sends patient data to physician's device 3 (Server 2 → Physician's device 3). S18: Physician's device 3 presents the data to the physician, who then reviews it (Physician's device 3 → Physician). S19: The doctor requests additional questions, physical examinations, and tests via the doctor's device 3 (Doctor → Doctor's device 3). S20: Doctor's device 3 forwards the additional request to server 2 (Doctor's device 3 → Server 2). S21: Server 2 instructs patient-side device 1 to make an additional request (Server 2 → Patient-side device 1). S22: Patient-side device 1 conducts additional interviews, physical examinations, and tests on the patient (radiologist takes a head CT scan with medical imaging machine 16) (patient-side device 1 ⇔ patient). S23: Patient device 1 sends additional data to server 2 (patient device 1 → server 2). S24: Server 2 transfers all data to physician device 3 (Server 2 → Physician device 3). S25: Doctor's device 3 presents all data to the doctor (Doctor's device 3 → Doctor). S26: The doctor and patient discuss the diagnosis and treatment plan via doctor-side device 3, server 2, and patient-side device 1 (Final diagnosis: sinusitis. Treatment plan: decide on antibiotic therapy) (Doctor-side device 3 ⇔ Patient-side device 1).

[0098] <Example 5> The patient's side is equipped with a visual / auditory device 11 (VR goggles), a tactile device 12, a biometric information detector 15, and a medical image capture device 16. The doctor's side is equipped with a visual / auditory device 31 (VR goggles) and a tactile device 32 (suburbs). S1: A female patient in her 50s enters consent information for data transmission into patient-side device 1 (Patient → Patient-side device 1). S2: Patient device 1 transfers consent information to server 2 (patient device 1 → server 2). S3: Server 2 instructs patient-side device 1 to present the medical questionnaire (Server 2 → Patient-side device 1). S4: The patient enters the medical information (fever 37.5℃, joint pain) into patient-side device 1 (Patient → Patient-side device 1). S5: Server 2 instructs patient-side device 1 on how to measure vital signs (Server 2 → Patient-side device 1). S6: Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and measures vital signs using the vital signs detector 15 (body temperature 37.5°C, pulse 75 bpm, blood pressure 118 / 78 mmHg, oxygen saturation 98%) (patient-side device 1 ⇔ patient). S7: Patient device 1 sends medical history information and vital signs to server 2 (patient device 1 → server 2). S8: Server 2 generates differential diagnosis candidates using the analysis unit 25 (internal processing by Server 2). Based on the interview data (fever 37.5°C, joint pain), vital signs (body temperature 37.5°C, oxygen saturation 98%), and PHR data (history of joint pain), the analysis unit 25 generates five initial candidates: rheumatoid arthritis, gout, osteoarthritis, arthritis, and polymyalgia rheumatica. S9: Server 2 instructs patient-side device 1 to perform a non-invasive test based on the differential diagnosis candidates (Server 2 → Patient-side device 1). S10: Patient-side device 1 performs a non-invasive physical examination and test on the patient (measuring joint stiffness with tactile device 12) (patient-side device 1 ⇔ patient). S11: Patient device 1 sends the physical examination and test results to server 2 (patient device 1 → server 2). S12: Server 2 narrows down the differential diagnosis candidates and searches for medical institutions (internal processing by Server 2). Analysis unit 25 integrates the additional data, prioritizing joint pain and a fever of 37.5°C, and narrows the candidates down to rheumatoid arthritis as the first choice and gout as the second choice based on the oxygen saturation of 98%. Orthopedics is recommended. S13: Server 2 presents medical institutions to patient device 1 (recommending Orthopedics, F Hospital, G Clinic, and H Medical Clinic) (Server 2 → Patient device 1). S14: The patient selects a healthcare facility via patient-side device 1 (Patient → Patient-side device 1). S15: Patient device 1 sends the medical institution selection result to server 2 (patient device 1 → server 2). S16: Server 2 executes the appointment booking for the medical institution (internal processing on Server 2). S17: Server 2 sends patient data to physician's device 3 (Server 2 → Physician's device 3). S18: Physician's device 3 presents the data to the physician, who then reviews it (Physician's device 3 → Physician). S19: The doctor requests additional questions, physical examinations, and tests via the doctor's device 3 (Doctor → Doctor's device 3). S20: Doctor's device 3 forwards the additional request to server 2 (Doctor's device 3 → Server 2). S21: Server 2 instructs patient-side device 1 to make an additional request (Server 2 → Patient-side device 1). S22: Patient-side device 1 conducts additional interviews, physical examinations, and tests on the patient (a radiologist takes X-rays with medical imaging machine 16) (patient-side device 1 ⇔ patient). S23: Patient device 1 sends additional data to server 2 (patient device 1 → server 2). S24: Server 2 transfers all data to physician device 3 (Server 2 → Physician device 3). S25: Doctor's device 3 presents all data to the doctor (Doctor's device 3 → Doctor). S26: The doctor and patient discuss the diagnosis and treatment plan via the doctor's device 3, server 2, and patient's device 1 (Final diagnosis: Rheumatoid arthritis. Treatment plan: Methotrexate and NSAIDs treatment decided) (Doctor's device 3 ⇔ Patient's device 1).

[0099] Below, examples 1 to 5 of the third embodiment (configuration of patient-side device 1 and physician-side device 3) will be described with reference to Figure 10. <Example 1> All devices are utilized (Patient side: Visual / auditory devices 11 (VR goggles), tactile devices 12, olfactory devices 13, gustatory devices 14, vital signs detector 15, medical imaging device 16; Doctor side: Visual / auditory devices 31 (VR goggles), tactile devices 32, olfactory devices 33, gustatory devices 34, sparsely populated area) S1: A male patient in his 20s enters consent information for data transmission into patient-side device 1 (Patient → Patient-side device 1). S2: Patient-side device 1 presents the questionnaire (patient-side device 1). S3: The patient enters the medical information (fever 38.0℃, cough, sore throat, skin rash, taste disturbance, dizziness) into patient-side device 1 (Patient → Patient-side device 1). S4: Patient-side device 1 instructs on how to measure vital signs (patient-side device 1). S5: Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and measures vital signs using the biometric information detector 15 (body temperature 38.0°C, pulse 90 bpm, blood pressure 120 / 80 mmHg, oxygen saturation 95%) (patient-side device 1 ⇔ patient). S6: Patient-side device 1 integrates interview information and vital signs to generate differential diagnosis candidates (internal processing of patient-side device 1). Based on the interview data (fever 38.0°C, cough, sore throat, skin rash, taste disturbance, dizziness) and vital signs (body temperature 38.0°C, oxygen saturation 95%), the data processing unit 17 generates five initial candidates: benign paroxysmal positional vertigo (peripheral), vestibular neuritis (peripheral), stroke (central), Meniere's disease (peripheral), and labyrinthitis (peripheral). S7: Patient-side device 1 instructs each device on patient-side device 1 to perform non-invasive tests based on the differential diagnosis candidates (patient-side device 1). S8: Patient-side device 1 performs a non-invasive physical examination and tests on the patient (visual / auditory device 11 captures nystagmus, and tactile device 12 measures head tenderness) (patient-side device 1 ⇔ patient). S9: Patient-side device 1 narrows down differential diagnoses and searches for medical institutions (internal processing by patient-side device 1). Data processing unit 17 integrates additional data, prioritizing dizziness, and narrowing the possibilities down to benign paroxysmal positional vertigo as the first candidate based on nystagmus and head tenderness, and labyrinthitis as the second candidate based on fever of 38.0°C. An otolaryngologist is recommended. S10: Patient device 1 presents medical institutions (recommending ENT clinic, H General Hospital, I Clinic, and J Clinic) (Patient device 1). S11: The patient selects a healthcare facility via patient-side device 1 (Patient → Patient-side device 1). S12: Patient device 1 makes a reservation at a medical institution (internal processing by patient device 1). S13: Patient device 1 transmits patient data to physician device 3 (patient device 1 → physician device 3). S14: Physician's device 3 presents the data to the physician, who then reviews it (Physician's device 3 → Physician). S15: The doctor requests additional questions, physical examinations, and tests via the doctor's device 3 (Doctor → Doctor's device 3). S16: Physician device 3 forwards an additional request to patient device 1 (Physician device 3 → Patient device 1). S17: Patient-side device 1 instructs each device on patient-side device 1 to send an additional request (patient-side device 1). S18: Patient-side device 1 performs additional interviews, physical examinations, and tests on the patient (including blood tests) (Patient-side device 1 ⇔ Patient). S19: Patient device 1 transfers all data to physician device 3 (patient device 1 → physician device 3). S20: Doctor's device 3 presents all data to the doctor (Doctor's device 3 → Doctor). S21: The doctor and patient discuss the diagnosis and treatment plan via doctor-side device 3 and patient-side device 1 (Final diagnosis: Benign paroxysmal positional vertigo. Treatment plan: Vertigo training is decided) (Doctor-side device 3 ⇔ Patient-side device 1).

[0100] <Example 2> The patient uses a visual / auditory device 11 (VR goggles) and a biometric information detector 15, while the doctor uses a visual / auditory device 31 (VR goggles) (in a sparsely populated area). S1: A female patient in her 40s enters consent information for data transmission into patient-side device 1 (Patient → Patient-side device 1). S2: Patient-side device 1 presents the questionnaire (patient-side device 1). S3: The patient enters the medical information (skin rash, itching, fever 37.5°C) into patient-side device 1 (Patient → Patient-side device 1). S4: Patient-side device 1 instructs on how to measure vital signs (patient-side device 1). S5: Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and measures vital signs using the vital signs detector 15 (body temperature 37.5°C, pulse 80 bpm, blood pressure 110 / 70 mmHg, oxygen saturation 97%) (patient-side device 1 ⇔ patient). S6: Patient-side device 1 integrates interview information and vital signs to generate differential diagnosis candidates (internal processing by patient-side device 1). Based on the interview data (skin rash, itching, fever 37.5°C) and vital signs (body temperature 37.5°C, oxygen saturation 97%), the data processing unit 17 generates five initial candidates: eczema, allergic dermatitis, contact dermatitis, psoriasis, and drug eruption. S7: Patient-side device 1 instructs each device on patient-side device 1 to perform non-invasive tests based on the differential diagnosis candidates (patient-side device 1). S8: Patient-side device 1 performs a non-invasive physical examination and tests on the patient (skin rash is photographed with visual / auditory device 11) (patient-side device 1 ⇔ patient). S9: Patient-side device 1 narrows down differential diagnoses and searches for medical institutions (internal processing by patient-side device 1). Data processing unit 17 integrates additional data, prioritizing skin rash and fever of 37.5°C, narrowing the possibilities down to eczema as the first candidate and allergic dermatitis as the second candidate based on itching. Dermatology is recommended. S10: Patient device 1 presents medical institutions (recommending dermatology, I Hospital, J Clinic, and K Clinic) (Patient device 1). S11: The patient selects a healthcare facility via patient-side device 1 (Patient → Patient-side device 1). S12: Patient device 1 makes a reservation at a medical institution (internal processing by patient device 1). S13: Patient device 1 transmits patient data to physician device 3 (patient device 1 → physician device 3). S14: Physician's device 3 presents the data to the physician, who then reviews it (Physician's device 3 → Physician). S15: The doctor requests additional questions, physical examinations, and tests via the doctor's device 3 (Doctor → Doctor's device 3). S16: Physician device 3 forwards an additional request to patient device 1 (Physician device 3 → Patient device 1). S17: Patient-side device 1 instructs each device on patient-side device 1 to send an additional request (patient-side device 1). S18: Patient-side device 1 conducts additional interviews, physical examinations, and tests on the patient (conducts additional interviews) (patient-side device 1 ⇔ patient). S19: Patient device 1 transfers all data to physician device 3 (patient device 1 → physician device 3). S20: Doctor's device 3 presents all data to the doctor (Doctor's device 3 → Doctor). S21: The doctor and patient discuss the diagnosis and treatment plan via doctor-side device 3 and patient-side device 1 (Final diagnosis: Eczema. Treatment plan: Steroid ointment is decided) (Doctor-side device 3 ⇔ Patient-side device 1).

[0101] <Example 3> The patient's side uses a visual / auditory device 11 (smartphone), a tactile device 12, an olfactory device 13, a gustatory device 14, and a biometric information detector 15. The doctor's side uses a visual / auditory device 31 (smartphone), a tactile device 32, an olfactory device 33, and a gustatory device 34 (urban area). S1: A male patient in his 20s enters consent information for data transmission into patient-side device 1 (Patient → Patient-side device 1). S2: Patient-side device 1 presents the questionnaire (patient-side device 1). S3: The patient enters the medical information (fever 38.0℃, cough, sore throat, skin rash) into patient-side device 1 (Patient → Patient-side device 1). S4: Patient-side device 1 instructs on how to measure vital signs (patient-side device 1). S5: Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and measures vital signs using the vital signs detector 15 (body temperature 38.0℃, pulse 88 bpm, blood pressure 125 / 85 mmHg, oxygen saturation 94%) (patient-side device 1 ⇔ patient). S6: Patient-side device 1 integrates interview information and vital signs to generate differential diagnosis candidates (internal processing by patient-side device 1). Based on the interview data (fever 38.0°C, cough, sore throat, skin rash) and vital signs (body temperature 38.0°C, oxygen saturation 94%), the data processing unit 17 generates five initial candidates: bacterial pharyngitis, scarlet fever, viral pharyngitis, influenza, and acute tonsillitis. S7: Patient-side device 1 instructs each device on patient-side device 1 to perform non-invasive tests based on the differential diagnosis candidates (patient-side device 1). S8: Patient-side device 1 performs a non-invasive physical examination and tests on the patient (visual and auditory device 11 captures pharyngeal erythema, microphone unit 113 records breath sounds, tactile device 12 measures skin hardness, olfactory device 13 detects body odor, and gustatory device 14 measures saliva components) (patient-side device 1 ⇔ patient). S9: Patient-side device 1 narrows down differential diagnoses and searches for medical institutions (internal processing by patient-side device 1). Data processing unit 17 integrates additional data, prioritizing sore throat and fever of 38.0°C, and narrows the possibilities down to bacterial pharyngitis as the first candidate and scarlet fever as the second candidate based on the skin rash. Internal medicine is recommended. S10: Patient device 1 presents medical institutions (recommending Internal Medicine, J Hospital, K Clinic, and L Clinic) (Patient device 1). S11: The patient selects a healthcare facility via patient-side device 1 (Patient → Patient-side device 1). S12: Patient device 1 makes a reservation at a medical institution (internal processing by patient device 1). S13: Patient device 1 transmits patient data to physician device 3 (patient device 1 → physician device 3). S14: Physician's device 3 presents the data to the physician, who then reviews it (Physician's device 3 → Physician). S15: The doctor requests additional questions, physical examinations, and tests via the doctor's device 3 (Doctor → Doctor's device 3). S16: Physician device 3 forwards an additional request to patient device 1 (Physician device 3 → Patient device 1). S17: Patient-side device 1 instructs each device on patient-side device 1 to send an additional request (patient-side device 1). S18: Patient-side device 1 conducts additional interviews, physical examinations, and tests on the patient (conducts additional interviews) (patient-side device 1 ⇔ patient). S19: Patient device 1 transfers all data to physician device 3 (patient device 1 → physician device 3). S20: Doctor's device 3 presents all data to the doctor (Doctor's device 3 → Doctor). S21: The doctor and patient discuss the diagnosis and treatment plan via doctor-side device 3 and patient-side device 1 (Final diagnosis: Scarlet fever. Treatment plan: Antibiotic treatment decided) (Doctor-side device 3 ⇔ Patient-side device 1).

[0102] <Example 4> The patient's side uses a visual / auditory device 11 (smartphone), an olfactory device 13, a biometric information detector 15, and a medical imaging device 16. The doctor's side uses a visual / auditory device 31 (smartphone) and an olfactory device 33 (urban area). S1: A male patient in his 40s enters consent information for data transmission into patient-side device 1 (Patient → Patient-side device 1). S2: Patient-side device 1 presents the questionnaire (patient-side device 1). S3: The patient inputs the medical information (fever 38.0℃, abnormal body odor, decreased sense of smell) into patient-side device 1 (Patient → Patient-side device 1). S4: Patient-side device 1 instructs on how to measure vital signs (patient-side device 1). S5: Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and measures vital signs using the biometric information detector 15 (body temperature 38.0°C, pulse 82 bpm, blood pressure 115 / 75 mmHg, oxygen saturation 96%) (patient-side device 1 ⇔ patient). S6: Patient-side device 1 integrates interview information and vital signs to generate differential diagnosis candidates (internal processing by patient-side device 1). Based on the interview data (fever 38.0°C, decreased sense of smell, abnormal body odor) and vital signs (body temperature 38.0°C, oxygen saturation 96%), the data processing unit 17 generates five initial candidates: sinusitis, acute upper respiratory tract infection, influenza, allergic rhinitis, and complications of sinusitis. S7: Patient-side device 1 instructs each device on patient-side device 1 to perform non-invasive tests based on the differential diagnosis candidates (patient-side device 1). S8: Patient-side device 1 performs a non-invasive physical examination and tests on the patient (olfactory device 13 confirms decreased sense of smell) (patient-side device 1 ⇔ patient). S9: Patient-side device 1 narrows down differential diagnoses and searches for medical institutions (internal processing by patient-side device 1). Data processing unit 17 integrates additional data, prioritizing decreased sense of smell, and narrows the possibilities down to sinusitis as the first candidate and acute upper respiratory tract infection as the second candidate based on abnormal body odor. It recommends an otolaryngologist. S10: Patient device 1 presents medical institutions (recommending ENT clinic, K Clinic, L Hospital, and M Clinic) (Patient device 1). S11: The patient selects a healthcare facility via patient-side device 1 (Patient → Patient-side device 1). S12: Patient device 1 makes a reservation at a medical institution (internal processing by patient device 1). S13: Patient device 1 transmits patient data to physician device 3 (patient device 1 → physician device 3). S14: Physician's device 3 presents the data to the physician, who then reviews it (Physician's device 3 → Physician). S15: The doctor requests additional questions, physical examinations, and tests via the doctor's device 3 (Doctor → Doctor's device 3). S16: Physician device 3 forwards an additional request to patient device 1 (Physician device 3 → Patient device 1). S17: Patient-side device 1 instructs each device on patient-side device 1 to send an additional request (patient-side device 1). S18: Patient-side device 1 conducts additional interviews, physical examinations, and tests on the patient (a radiologist takes a head CT scan with medical imaging machine 16) (patient-side device 1 ⇔ patient). S19: Patient device 1 transfers all data to physician device 3 (patient device 1 → physician device 3). S20: Doctor's device 3 presents all data to the doctor (Doctor's device 3 → Doctor). S21: The doctor and patient discuss the diagnosis and treatment plan via doctor-side device 3 and patient-side device 1 (Final diagnosis: sinusitis. Treatment plan: antibiotic therapy decided) (Doctor-side device 3 ⇔ Patient-side device 1).

[0103] <Example 5> The patient's side uses a visual / auditory device 11 (tablet), a tactile device 12, and a biometric information detector 15, while the doctor's side uses a visual / auditory device 31 (tablet) and a tactile device 32 (suburbs). S1: A female patient in her 50s enters consent information for data transmission into patient-side device 1 (Patient → Patient-side device 1). S2: Patient-side device 1 presents the questionnaire (patient-side device 1). S3: The patient enters the medical information (joint pain, joint swelling) into patient-side device 1 (Patient → Patient-side device 1). S4: Patient-side device 1 instructs on how to measure vital signs (patient-side device 1). S5: Patient-side device 1 instructs the patient on how to measure vital signs via voice or screen display, and measures vital signs using the vital signs detector 15 (body temperature 36.5°C, pulse 72 bpm, blood pressure 118 / 78 mmHg, oxygen saturation 98%, respiratory rate 18 breaths / min) (patient-side device 1 ⇔ patient). S6: Patient-side device 1 integrates interview information and vital signs to generate differential diagnosis candidates (internal processing by patient-side device 1). Based on the interview data (joint pain, joint swelling) and vital signs (body temperature 36.5°C, oxygen saturation 98%), the data processing unit 17 generates five initial candidates: rheumatoid arthritis, gout, osteoarthritis, arthritis, and polymyalgia rheumatica. S7: Patient-side device 1 instructs each device on patient-side device 1 to perform non-invasive tests based on the differential diagnosis candidates (patient-side device 1). S8: Patient-side device 1 performs a non-invasive physical examination and test on the patient (measuring joint stiffness with tactile device 12) (patient-side device 1 ⇔ patient). S9: Patient-side device 1 narrows down differential diagnoses and searches for medical institutions (internal processing by patient-side device 1). Data processing unit 17 integrates additional data, prioritizing joint pain and swelling, and narrows the candidates down to rheumatoid arthritis as the first choice and gout as the second choice based on the oxygen saturation of 98%. Orthopedics is recommended. S10: Patient device 1 presents medical institutions (recommending Orthopedics, L Hospital, M Clinic, N Medical Clinic) (Patient device 1). S11: The patient selects a healthcare facility via patient-side device 1 (Patient → Patient-side device 1). S12: Patient device 1 makes a reservation at a medical institution (internal processing by patient device 1). S13: Patient device 1 transmits patient data to physician device 3 (patient device 1 → physician device 3). S14: Physician's device 3 presents the data to the physician, who then reviews it (Physician's device 3 → Physician). S15: The doctor requests additional questions, physical examinations, and tests via the doctor's device 3 (Doctor → Doctor's device 3). S16: Physician device 3 forwards an additional request to patient device 1 (Physician device 3 → Patient device 1). S17: Patient-side device 1 instructs each device on patient-side device 1 to send an additional request (patient-side device 1). S18: Patient-side device 1 conducts additional interviews, physical examinations, and tests on the patient (conducts additional interviews) (patient-side device 1 ⇔ patient). S19: Patient device 1 transfers all data to physician device 3 (patient device 1 → physician device 3). S20: Doctor's device 3 presents all data to the doctor (Doctor's device 3 → Doctor). S21: The doctor and patient discuss the diagnosis and treatment plan via doctor-side device 3 and patient-side device 1 (Final diagnosis: Rheumatoid arthritis. Treatment plan: Methotrexate and NSAIDs treatment decided) (Doctor-side device 3 ⇔ Patient-side device 1). In the above example, data transmission uses compression technology (e.g., H.265) and protocol (e.g., UDP) that enable stable operation even in low-speed network environments, and stability is ensured through packet loss compensation and bandwidth adaptive control.

[0104] Examples of visual and auditory devices 11 and 31 (VR goggles) <Example 1> Skin diseases (in sparsely populated areas) The display unit 112 of the patient's visual and auditory device 11 (VR goggles) presents a 3D avatar of the doctor, and the patient asks questions (e.g., "How long has the itching lasted?"). The imaging unit 111 takes 3D images of the facial eczema (with exudate), and the doctor's visual and auditory device 31 (VR goggles) allows the doctor to view an enlarged image of the 3D-captured eczema, making it easy to diagnose, for example, whether or not it is atopic dermatitis, and to decide on the course of action for topical steroid medication. <Example 2> Ophthalmic disease (suburban) The imaging unit 111 of the patient's visual and auditory device 11 (VR goggles) captures eye movements and analyzes nystagmus (horizontal). The physician's visual and auditory device 31 (VR goggles) confirms the horizontal nystagmus, making it easier to diagnose whether or not the patient has peripheral vertigo and to decide on the course of drug therapy. <Example 3> Two-way 3D communication (urban areas) The patient's visual and auditory device 11 (VR goggles) captures images of the patient's joints, and the physician's visual and auditory device 31 (VR goggles) displays a 3D model of the patient. The physician performs hand movements in the VR space, and the motion tracking function of the physician's device 3 detects the movements. The motion transmission unit 1222 of the patient's device 1 reproduces the movements, allowing for remote palpation and confirmation of joint swelling on the display unit of the physician's device 3, thus facilitating the diagnosis of rheumatoid arthritis.

[0105] Examples of visual and auditory devices 11 and 31 (camera-equipped devices other than VR goggles) <Example 1> Skin disease (suburban) The smartphone camera of the visual / auditory device 11 on the patient's device 1 captures images of the facial eczema, and the display shows medical questions (e.g., "How long has the itching lasted?"). The doctor can check the images of the eczema on the display unit 312 of the doctor's device 3, making it easy to diagnose atopic dermatitis and decide on a prescription strategy for topical steroids. <Example 2> Ophthalmic diseases (in sparsely populated areas) The tablet camera of the visual / auditory device 11 on the patient's device 1 captures eye movements and analyzes nystagmus (horizontal). The display unit 312 of the physician's device 3 confirms the nystagmus, making it easier to diagnose peripheral vertigo and determine the course of drug therapy.

[0106] Examples of haptic devices 12 and 32 <Example 1> Neurological diseases (in sparsely populated areas) The patellar tendon reflex was measured (no abnormality) using the motion sensor unit 1212 of the tactile device 12 on the patient-side device 1, and the physician's movements were reproduced using the motion transmission unit 1222 to perform MMT (Manual Muscle Testing) (left upper and lower limb muscle strength 3 / 5). The skin temperature was measured at 37.5°C using the temperature sensing unit 1211, and a central nervous system disorder was suspected, so an MRI scan was performed using the medical imaging machine 16, which facilitated a diagnosis of cerebral infarction (right side) and the decision on antithrombotic therapy. <Example 2> Skin disease (suburban) The pressure sensor 1213 of the tactile device 12 on the patient's device 1 measures normal skin hardness, and the temperature 1211 measures 38.0°C (inflammation site). Skin hardness data and skin temperature data are transmitted to the physician's device 3, facilitating the diagnosis of inflammatory skin disease and the decision-making process for topical steroid medication. <Example 3> Joint diseases (in sparsely populated areas) The patient wears a visual / auditory device 11 (VR goggles), and the motion sensor unit 1212 of the tactile device 12 measures the range of motion of the joint (flexion angle 90 degrees). The visual / auditory device 31 (VR goggles) of the physician's device 3 detects the physician's movements, and the motion transmission unit 1222 of the tactile device 12 of the patient's device 1 performs remote palpation. This facilitates the diagnosis of joint contracture and the determination of physical therapy strategies.

[0107] Examples of olfactory devices 13 and 33 <Example 1> Metabolic disease (urban area) The odor-collecting section 131 of the olfactory device 13 of the patient-side device 1 detects the acetone odor (0.01 ppm). The odor-emitting section 332 of the olfactory device 33 of the physician-side device 3 reproduces the acetone odor, allowing the physician to confirm the actual smell by smell and easily diagnose diabetic ketoacidosis. <Example 2> Relaxation support (suburbs) The physician selects the lavender scent using the visual and auditory device 31, which serves as the interface for the physician's device 3. The odor-emitting part 132 of the olfactory device 13 on the patient's device 1 then emits the lavender scent, making it easy to provide relaxation support so that the patient can experience a relaxing effect.

[0108] Examples of taste devices 14 and 34 <Example 1> Infectious diseases (in sparsely populated areas) The taste collection unit 141 of the taste device 14 on the patient's device 1 analyzes saliva components and detects taste disorders (inability to distinguish salty taste). The taste reproduction unit 342 of the taste device 34 on the physician's device 3 confirms the taste disorder, making it easier to diagnose COVID-19.

[0109] Example of a biometric information detector 15 <Example 1> Infectious diseases (in sparsely populated areas) The patient-side device 1's vital signs detector 15 measured body temperature at 38.5°C, pulse rate at 90 bpm, oxygen saturation at 95%, and respiratory rate at 22 breaths / min, and wheezing was confirmed with an electronic stethoscope. Since an infection was suspected, additional tests to determine whether or not the patient-side device 1 was infected could be easily performed. <Example 2> Cardiovascular disease (suburban) The patient-side device 1's vital signs detector 15 measures heart rate at 110 bpm and blood pressure at 150 / 95 mmHg, and an electronic stethoscope detects a heart murmur. Since heart failure is suspected, the patient-side device 1 can easily perform additional tests to further investigate whether or not heart failure is present. <Example 3> Future expansion (urban areas) The patient-side device 1's biometric information detector 15 may in the future perform non-invasive blood glucose measurement (e.g., glucose concentration estimation using an optical sensor) and blood component analysis (e.g., estimation of red blood cell count and white blood cell count) in real time. This will allow for assessment of the risk of diabetes and anemia, and facilitate the determination of appropriate tests and treatment strategies.

[0110] Embodiment of medical imaging device 16 <Example 1> Infectious diseases (in sparsely populated areas) A radiologist operates the portable X-ray device of the medical imaging machine 16 on the patient's side (device 1) to take a chest X-ray and confirm infiltrates in the lung field. This facilitates the diagnosis of pneumonia and the decision on antibiotic treatment. <Example 2> Abdominal diseases (suburbs) A clinical laboratory technician operates the ultrasound device on the patient's device 1 to image the abdomen and confirm the presence of gallstones in the gallbladder. This facilitates the diagnosis of gallstone disease and the determination of surgical indications. <Example 3> Neurological diseases (urban areas) Under the operation of a radiologic technologist, the MRI scanner on the patient-side device 1 (medical imaging machine 16) images the brain and confirms the presence of abnormal signals. This facilitates the diagnosis of cerebral infarction and the determination of antithrombotic therapy strategies.

[0111] Server 2 Example <Example 1> Hybrid configuration (sparsely populated areas) An on-premise server processes skin hardness (0.1N) and body odor (acetone odor 0.01ppm) measurements, while a cloud server connects with an external database to search for nearby hospitals. <Example 2> Cloud server configuration (suburbs) The cloud server processes all patient data (including nystagmus analysis and respiratory sound analysis) and transmits it to the physician's device 3 at high speed (within 1 second).

[0112] Example of physician-side device 3 <Example 1> Operation of the motion transmission unit 1222 (urban area) A physician wears a visual and auditory device 31 (VR goggles), views a 3D model of a patient also wearing VR goggles, performs actions on the patient's 3D model, and remotely palpates the patient via the motion transmission unit 1222 of the patient-side device 1. This allows for easy confirmation of joint swelling and reinforcement of the diagnosis. <Example 2> Odor manifestation (suburbs) The physician selects the lavender scent using the visual and auditory devices 31 of the physician-side device 3, which has an interface function. The odor-emitting part 132 of the olfactory device 13 of the patient-side device 1 then emits the lavender scent, allowing the patient to easily experience a relaxing effect. <Example 3> Smartphone use (in sparsely populated areas) A video call is conducted between the doctor and the patient via the smartphone of the doctor's device 3 (visual and auditory device 31) and the smartphone of the patient's device 1 (visual and auditory device 11). The doctor operates the imaging unit 111 (camera) of the patient's device 1's smartphone via the doctor's device 3 to take an image of the pharynx, making it easier to diagnose pharyngitis. [Industrial applicability]

[0113] This invention is applicable to the field of telemedicine and enables diagnostic support in a wide range of areas, from urban to sparsely populated regions. The need for telemedicine has increased due to the need to avoid crowded spaces during the COVID-19 pandemic, the uneven distribution of doctors in urban areas, and the shortage of doctors in rural areas, and this invention addresses that need. It can operate in a variety of communication environments, including low-speed and 2G connections (e.g., 1Mbps or less, 4G / 5G compatible), making it suitable for use in sparsely populated areas and developing countries. It allows patients in remote locations to connect to hospitals and clinics worldwide from nearby government offices or their homes, ensuring equal access to healthcare.

[0114] In configurations that do not include the medical imaging device 16, the system features an interface that can be operated independently by the patient, enabling low-cost operation with unmanned operation or by a single healthcare professional (e.g., a nurse, radiologist, or clinical laboratory technician), making it a sustainable system that provides cutting-edge medical care even in areas without hospitals or clinics. Automated physical examination and testing, differential diagnosis generation, and hospital search and booking by the analysis unit improve diagnostic efficiency, while PHR data integration supports continuous health management.

[0115] This invention also addresses the high demand in the international market. According to market research reports, the global telemedicine market is expected to grow at a compound annual growth rate (CAGR) of 17.55% from 2025 to 2030, with the adoption of telemedicine progressing particularly in the United States and the EU. Furthermore, there is a serious shortage of doctors in Africa and Asia, and the system of this invention, which can operate even in low-speed network environments, meets the needs of these regions.

[0116] This invention supports various communication standards (2G / 3G / 4G / 5G) and employs H.265 compression and the UDP protocol for data transmission, enabling stable operation even on low-speed lines (1Mbps or less). Regarding medical data protection, it employs a design compliant with the Personal Information Protection Act and GDPR (e.g., data encryption, consent acquisition protocol), and has the foundation for compliance with medical regulations such as FDA and CE marking. However, specific conformity testing and certification processes will need to be implemented in future development stages. It should be noted that this invention is not intended to replace physician diagnosis or treatment, but rather to assist physicians in diagnosis and support patients' health management, and is premised on not violating relevant laws and regulations such as the Medical Practitioners Act and the Ministry of Health, Labour and Welfare's telemedicine guidelines. [Explanation of Symbols]

[0117] 1: Patient-side device 2: Server 3: Physician's device 4: Five-sense telemedicine system 5: Five-sense telemedicine system 6: Five-sense telemedicine system 11: Visual and auditory devices 12: Haptic devices 13: Olfactory devices 14: Taste devices 15: Biometric Information Detector 16: Medical imaging machine 17: Data Processing Unit 21: Management Department 22: Receiving section 23: Calculation Section 24: Records Department 25:Analysis Department 26: Control Unit 27: Transmitter 31: Visual and auditory devices 32: Haptic devices 33: Olfactory devices 34: Taste devices 111: Imaging Department 112: Display section 113: Microphone section 114: Speaker section 115: Transmission unit 116: Reception unit 121: Tactile sensor unit 122: Tactile transmission unit 123: Transmission unit 124: Reception unit 131: Odor collection unit 132: Odor emission unit 133: Transmission unit 134: Reception unit 141: Taste collection unit 142: Taste reproduction unit 143: Transmission unit 144: Reception unit 151: Detection unit 152: Transmission unit 161: Photography unit 162: Transmission unit 171: Management unit 172: Reception unit 173: Calculation unit 174: Recording unit 175: Analysis unit 176: Control unit 177: Transmission unit 311: Imaging unit 312: Display unit 313: Microphone unit 314: Speaker unit 315: Transmission unit 316: Reception unit 321: Tactile sensor unit 322: Tactile transmission unit 323: Transmission unit S324: Reception unit 331: Odor collection unit 332: Odor emission unit 333: Transmission unit 334: Reception unit 341: Taste collection unit 342: Taste reproduction unit 343: Transmission unit 344: Reception unit 1211: Temperature sensing unit 1212: Motion sensor unit 1213: Pressure sensor unit 1221: Temperature transmission unit 1222: Motion transmission unit 1223: Pressure transmission section 3211: Temperature sensing part 3212: Motion sensor unit 3213: Pressure sensor section 3221: Temperature transfer section 3222: Motion transmission unit 3223: Pressure transmission section

Claims

1. A five-sense telemedicine system that remotely connects patients and doctors using patient-side devices and a server, The patient-side device has the function of acquiring the patient's visual and auditory data, as well as at least one data related to touch, smell, taste, biometric information, and medical images. The aforementioned server, The system displays or provides audio information to the patient's medical questionnaire questions and collects the questionnaire information through voice or text input. It has a calculation unit that integrates the five senses data related to sight, hearing, touch, smell, and taste acquired from the patient-side device and processes the five senses data simultaneously. The calculation unit described above, An integration process that integrates the medical data, including the medical interview information and vital signs, obtained from the patient-side device. A differential diagnosis candidate generation process that generates differential diagnosis candidates based on the aforementioned medical interview information and medical data including the aforementioned vital signs. Based on the generated differential diagnosis candidates, non-invasive physical examination and testing items are selected, and a measurement instruction process is performed to instruct the patient-side device to measure at least one data point of vision, hearing, touch, smell, or taste. The process of narrowing down the candidate differential diagnoses, A process for presenting proposed countermeasures for the narrowed-down differential disease candidates, A medical institution candidate search process that searches for medical institutions where physicians are located based on the narrowed-down differential disease candidates and the corresponding proposed solutions. A process for presenting the aforementioned candidate medical institutions to the aforementioned patient. The process of making a reservation at the medical institution selected by the aforementioned patient. The system performs a process to present the physician with all patient data, including the aforementioned medical history information, physical examination and test results, candidate differential diagnoses, and proposed treatment plans. A telemedicine system featuring five senses.

2. In the five-sense remote medical consultation system described in claim 1, The system further comprises a physician-side device that receives patient data from the server and allows the physician to acquire data from the patient-side device, Based on the aforementioned medical interview information, physical examination and test findings, candidate differential diagnoses, and the proposed response plan, the physician instructs the server and the patient-side device to perform additional interviews, physical examinations, and tests that he deems necessary. A telemedicine system featuring five senses.

3. A five-sense telemedicine system that remotely connects patients and doctors using patient-side devices and doctor-side devices, The patient-side device has the function of acquiring the patient's visual and auditory data, as well as at least one data related to touch, smell, taste, biometric information, and medical images. The data processing unit of the patient-side device is: The system displays or provides audio information to the patient's medical questionnaire questions and collects the questionnaire information through voice or text input. It has a calculation unit that integrates acquired sensory data related to sight, hearing, touch, smell, and taste, and processes the said sensory data simultaneously. The calculation unit described above, A process for integrating the aforementioned medical data, including the patient interview information and vital signs. A process for generating differential diagnosis candidates based on the aforementioned medical interview information and medical data including the aforementioned vital signs. Based on the generated differential diagnosis candidates, non-invasive physical examination and testing items are selected, and the patient is subjected to a process of measuring at least one data point of vision, hearing, touch, smell, or taste. The process of narrowing down the candidate differential diagnoses, A process of presenting proposed countermeasures for the narrowed-down differential disease candidates, A process to search for a medical institution where a physician is located based on the narrowed-down differential disease candidates and the corresponding treatment plan. A process of presenting the aforementioned medical institution candidates to the aforementioned patient. The process of making a reservation at the medical institution selected by the aforementioned patient. The physician is presented with the aforementioned medical history information, the findings of the physical examination and tests, the candidate differential diagnoses, and the proposed course of action. The system further comprises a physician-side device that receives patient data from the patient-side device and allows the physician to acquire data from the patient-side device. Based on the aforementioned medical interview information, physical examination and test findings, candidate differential diagnoses, and the proposed response plan, the physician instructs the patient-side device to perform additional interviews, physical examinations, and tests that he deems necessary. A telemedicine system featuring five senses.

4. A five-sense remote medical consultation system according to claim 1, The patient-side device includes a visual / auditory device and at least one of a tactile device, an olfactory device, a gustatory device, a biometric information detector, and a medical image capture device. A telemedicine system featuring five senses.

5. A telemedicine system using the five senses as described in claim 2, The patient-side device includes a visual / auditory device and at least one of a tactile device, an olfactory device, a gustatory device, a biometric information detector, and a medical image capture device. A telemedicine system featuring five senses.

6. A telemedicine system using the five senses as described in claim 3, The patient-side device includes a visual / auditory device and at least one of a tactile device, an olfactory device, a gustatory device, a biometric information detector, and a medical image capture device. A telemedicine system featuring five senses.

7. A telemedicine system using the five senses as described in claim 2, The physician-side device includes a visual / auditory device and at least one of a tactile device, an olfactory device, and a gustatory device. A telemedicine system featuring five senses.

8. A telemedicine system using the five senses as described in claim 3, The physician-side device includes a visual / auditory device and at least one of a tactile device, an olfactory device, and a gustatory device. A telemedicine system featuring five senses.

9. A five-sense remote medical consultation system according to any one of claims 4, 5, or 6, When the patient-side visual and auditory device of the aforementioned patient-side device is a VR goggle, a virtual conversation partner is displayed in 3D on the display of the VR goggle. A telemedicine system featuring five senses.

10. A telemedicine system using the five senses according to claim 5 or claim 6, When the patient's visual and auditory device is a VR goggle, and the doctor's device is also a VR goggle, images of the patient and the doctor are displayed on the display units of the patient's and doctor's VR goggles. Based on the displayed 3D images, the patient can realistically perceive the doctor as being face-to-face. Based on the displayed 3D images, the doctor's device outputs control instructions for the patient's visual and auditory device and at least one of the following: the tactile device, the olfactory device, the gustatory device, the biometric information detector, and the medical image capture device, allowing the doctor to operate intuitively. A telemedicine system featuring five senses.

11. A telemedicine system using the five senses according to claim 7 or claim 8, When the physician's visual and auditory device is a VR goggle, and the patient's device is also a VR goggle, images of the patient and the physician are displayed on the display units of the VR goggles on both sides. Based on the displayed 3D images, the patient can feel as if the physician is facing them, and based on the displayed 3D images, the physician's device outputs control instructions for the operation of the patient's device, allowing the physician to operate it intuitively. A telemedicine system featuring five senses.

12. A five-sense remote medical consultation system according to any one of claims 4, 5, or 6, The tactile device of the patient-side device comprises a tactile sensor unit including at least one of the following: a temperature sensing unit for sensing skin temperature; a motion sensor unit for performing a physical examination including tendon reflex testing, muscle strength testing, joint range of motion evaluation, or gait pattern analysis; and a pressure sensor unit for measuring pressure including skin hardness. In addition, the tactile device of the patient-side device comprises at least one of the following: a temperature transmission unit, a motion transmission unit, or a pressure transmission unit for transmitting tactile sensations from the physician's side. A telemedicine system featuring five senses.

13. A five-sense remote medical consultation system according to any one of claims 7 or 8, The tactile device of the physician-side device comprises a tactile sensor section including at least one of a temperature sensing section, an motion sensor section, and a pressure sensor section, and in addition, the tactile device of the physician-side device comprises at least one of a tactile transmission section including at least one of a temperature transmission section, an motion transmission section, and a pressure transmission section that transmits tactile sensations from the patient side. A telemedicine system featuring five senses.

14. A five-sense remote medical consultation system according to claim 4 or claim 5, wherein the olfactory device of the patient-side device comprises an odor collection unit for sensing the patient's odor, and in addition, the olfactory device of the patient-side device comprises at least one of the odor from data registered in the server or the odor detected by the physician-side odor collection unit. A telemedicine system featuring five senses.

15. A five-sense remote medical consultation system according to claim 6, wherein the olfactory device of the patient-side device comprises an odor collection unit for sensing the patient's odor, and in addition, the olfactory device of the patient-side device comprises at least one of the odors from data registered in the data processing unit or the odors sensed by the physician-side odor collection unit. A telemedicine system featuring five senses.

16. A five-sense remote medical consultation system according to claim 7, wherein the olfactory device of the physician-side device comprises an odor collection unit for sensing odors on the physician's side, and in addition, the olfactory device of the physician-side device comprises at least one of either an odor from data registered on the server or an odor generating unit for reproducing an odor sensed by the patient-side odor collection unit. A telemedicine system featuring five senses.

17. A five-sense remote medical consultation system according to claim 8, wherein the olfactory device of the physician-side device comprises an odor collection unit for sensing odors on the physician's side, and in addition, the olfactory device of the physician-side device comprises at least one of the following: an odor from data registered in the data processing unit or an odor generating unit for reproducing an odor sensed by the patient-side odor collection unit. A telemedicine system featuring five senses.

18. A five-sense remote medical consultation system according to claims 4 and 5, wherein the taste device of the patient-side device comprises a taste collection unit equipped with a taste sensor for analyzing salivary components or stimulating taste buds on the tongue to measure taste responses, and in addition, the taste device of the patient-side device comprises at least one of the following: a taste reproduction unit that reproduces taste data sensed by the physician-side taste collection unit or taste data from data registered in the server. A telemedicine system featuring five senses.

19. A five-sense remote medical consultation system according to claim 6, wherein the taste device of the patient-side device comprises a taste collection unit equipped with a taste sensor for analyzing salivary components or stimulating taste buds on the tongue to measure taste responses, and in addition, the taste device of the patient-side device comprises at least one of the following: a taste reproduction unit for reproducing taste data from taste data sensed by the physician-side taste collection unit or data registered in the data processing unit. A telemedicine system featuring five senses.

20. A five-sense remote medical consultation system according to claim 7, wherein the taste device of the physician-side device comprises a taste collection unit that senses physician-side taste data, and in addition, the taste device of the physician-side device comprises at least one of the taste data sensed by the patient-side taste collection unit or the taste data from data registered in the server. A telemedicine system featuring five senses.

21. A five-sense remote medical consultation system according to claim 8, wherein the taste device of the physician-side device comprises a taste collection unit that senses physician-side taste data, and in addition, the taste device of the physician-side device comprises at least one of the taste data sensed by the patient-side taste collection unit or the taste data registered in the data processing unit. A telemedicine system featuring five senses.

22. A five-sense remote medical consultation system according to any one of claims 4, 5, or 6, wherein the biometric information detector of the patient-side device is a terminal that measures in real time at least one of the following data as an indicator including the patient's biometric information: body temperature, pulse, blood pressure, respiratory rate, oxygen saturation, auscultation information, or blood glucose level or blood component analysis data. A telemedicine system featuring five senses.

23. A five-sense remote medical consultation system according to any one of claims 4, 5, or 6, wherein the medical imaging device of the patient-side device includes at least one of an X-ray imaging device, an ultrasound imaging device, or other medical imaging device. A telemedicine system featuring five senses.

24. A telemedicine system using the five senses according to claim 1 or 2, wherein the server acquires personal health record data including the patient's medical history, medication history, and past test results, and the physician or the server's calculation unit analyzes the personal health record data to correct the differential diagnosis candidates. A telemedicine system featuring five senses.

25. A five-sense remote medical consultation system according to claim 3, wherein the patient-side device acquires personal health record data including the patient's medical history, medication history, and past test results, and the physician or the calculation unit of the data processing unit analyzes the personal health record data to correct the differential diagnosis candidates. A telemedicine system featuring five senses.

26. A telemedicine system using the five senses according to claim 1 or 2, wherein the server acquires personal health record data including the patient's medical history, medication history, and past test results, and the physician or the server's calculation unit uses the personal health record data to support the patient's continuous health management. A telemedicine system featuring five senses.

27. A five-sense remote medical consultation system according to claim 3, wherein the patient-side device acquires personal health record data including the patient's medical history, medication history, and past test results, and the physician or the calculation unit of the patient-side device uses the personal health record data to support the patient's continuous health management. A telemedicine system featuring five senses.

28. A five-sense remote medical consultation system according to either claim 1 or 2, wherein the server is a cloud server. A telemedicine system featuring five senses.

29. A five-sense remote medical consultation system according to claim 3, wherein the patient-side device is a cloud server. A telemedicine system featuring five senses.

30. A five-sense remote medical consultation system according to claim 1 or 2, wherein the server consists of a hybrid configuration combining an on-premise server and a cloud server, the on-premise server performs data processing for physical examinations and tests, and the cloud server performs data transmission to the physician and linkage with an external database. A telemedicine system featuring five senses.

31. The five-sense remote medical consultation system according to claim 3, wherein the calculation unit of the patient-side device consists of a hybrid configuration combining an on-premise server and a cloud server, the on-premise server performs data processing for physical examinations and tests, and the cloud server transmits data to the physician and links with an external database. A telemedicine system featuring five senses.

32. A five-sense remote medical consultation system according to claim 1, wherein the data transmission means of the patient-side device or the server uses compression technology and protocols. A telemedicine system featuring five senses.

33. A telemedicine system using the five senses according to claim 2, wherein the data transmission means of the patient-side device, the server, or the physician-side device uses compression technology and protocols. A telemedicine system featuring five senses.

34. A five-sense remote medical consultation system according to claim 3, wherein the data transmission means of the patient-side device or the physician-side device uses compression technology and protocols. A telemedicine system featuring five senses.

35. A method for telemedicine using the five senses in a telemedicine system having a patient-side device and a server, The patient-side device is required to acquire the patient's visual and auditory data, and also has the function of acquiring at least one data related to touch, smell, taste, biometric information, and medical images. This is performed by the server having a calculation unit that integrates sensory data related to sight, hearing, touch, smell, and taste acquired from the patient-side device. A processing step which involves presenting consent information indicating whether or not the patient consents to the transmission of the patient's information data, and allowing the patient to select whether or not to consent, A processing step of presenting the medical questionnaire items via the patient-side device, A processing step of receiving response information to the medical questionnaire presented via the patient-side device, A processing step in which the patient is instructed by voice or on-screen display on how to measure vital signs using a vital signs detector, A processing step of generating differential diagnosis candidates based on the medical interview information and vital signs transmitted from the patient-side device, A processing step in which a non-invasive physical examination and tests are instructed to be performed on the patient-side device based on the candidate differential diagnoses, The processing steps include narrowing down the list of differential diagnoses and searching for medical institutions based on the narrowed-down list of differential diagnoses, A processing step of presenting the medical institution found through the search to the patient's device, A processing step that prompts the patient to select the presented medical institution via the patient-side device, A processing step of transmitting the selection result of the aforementioned medical institution, The process includes a step of making a reservation at the selected medical institution based on the selection result of the aforementioned medical institution. A method of telemedicine using the five senses, characterized by the following features.

36. In the five-sense remote medical consultation method described in claim 35, Furthermore, the system includes a processing step that presents a diagnosis and treatment plan based on all of the patient's historical data, via the patient-side device and the server. A method of telemedicine using the five senses, characterized by the following features.

37. A method for telemedicine using the five senses in a telemedicine system where the patient's device and the doctor's device are connected via a server, The patient-side device is required to acquire the patient's visual and auditory data, and also has the function of acquiring at least one data related to touch, smell, taste, biometric information, and medical images. This is performed by the server having a calculation unit that integrates sensory data related to sight, hearing, touch, smell, and taste acquired from the patient-side device. A processing step which involves presenting consent information indicating whether or not the patient consents to the transmission of the patient's information data, and allowing the patient to select whether or not to consent, A processing step of presenting the medical questionnaire items via the patient-side device, A processing step of receiving response information to the medical questionnaire presented via the patient-side device, A processing step in which the patient is instructed by voice or on-screen display on how to measure vital signs using a vital signs detector, A processing step of generating differential diagnosis candidates based on the medical interview information and vital signs transmitted from the patient-side device, A processing step in which a non-invasive physical examination and tests are instructed to be performed on the patient-side device based on the candidate differential diagnoses, The processing steps include narrowing down the list of differential diagnoses and searching for medical institutions based on the narrowed-down list of differential diagnoses, A processing step that presents the searched medical institution to the patient's device, A processing step that prompts the patient to select the medical institution presented via the patient-side device, A processing step of transmitting the selection result of the aforementioned medical institution, The process step of executing a reservation at the selected medical institution based on the selection result of the aforementioned medical institution, A processing step of transmitting the patient's information to the physician's device of the medical institution, A processing step in which the physician-side device requests the patient-side device to conduct additional interviews, physical examinations, and tests based on the patient information received by the physician-side device, A processing step of transmitting the additional data obtained in response to the request for additional medical interviews, physical examinations, and tests to the physician's device, The process includes a step of presenting all of the patient's historical data to the physician's device. A method of telemedicine using the five senses, characterized by the following features.

38. In the five-sense remote medical consultation method described in claim 37, Furthermore, the system includes a processing step that presents a diagnosis and treatment plan based on the historical data via the physician's device, the server, and the patient's device. A method of telemedicine using the five senses, characterized by the following features.

39. A method for telemedicine using the five senses in a telemedicine system having a patient-side device and a physician-side device, The patient-side device is required to acquire the patient's visual and auditory data, and also has the function of acquiring at least one data related to touch, smell, taste, biometric information, and medical images. This is performed by the patient-side device having a calculation unit that has the function of integrating acquired sensory data related to sight, hearing, touch, smell, and taste. Performed by the aforementioned patient-side device, A processing step which involves presenting consent information indicating whether or not the patient consents to the transmission of the patient's information data, and allowing the patient to select whether or not to consent, The processing step involves presenting the medical questionnaire, A processing step to receive response information for the presented medical questionnaire, A processing step in which the patient is instructed by voice or on-screen display on how to measure vital signs using a vital signs detector, A processing step that generates differential diagnosis candidates based on the medical history information and the vital signs, Based on the aforementioned differential diagnosis candidates, a processing step is performed to conduct a non-invasive physical examination and tests. The processing steps include narrowing down the list of differential diagnoses and searching for medical institutions based on the narrowed-down list of differential diagnoses, The processing steps include presenting the medical institutions found through the search, The processing step that prompts the selection of the aforementioned medical institution, The process step of executing a reservation at the selected medical institution based on the selection result of the aforementioned medical institution, A processing step of transmitting the patient's information to the physician's device of the medical institution, A processing step in which the physician-side device requests the patient-side device to conduct additional interviews, physical examinations, and tests based on the patient information received by the physician-side device, A processing step of transmitting the additional data obtained in response to the request for additional medical interviews, physical examinations, and tests to the physician's device, A processing step of presenting historical data to the physician's device, A method of telemedicine using the five senses, characterized by the following features.

40. In the five-sense remote medical consultation method described in claim 39, Furthermore, the system includes a processing step that presents a diagnosis and treatment plan based on the historical data via the physician's device and the patient's device. A method of telemedicine using the five senses, characterized by the following features.

41. A method of telemedicine involving the five senses as described in claims 35 to 38, The server acquires personal health record data, including the patient's medical history, medication history, and past test results, and the server uses the personal health record data to support the patient's ongoing health management. A telemedicine method using the five senses, characterized by the following features.

42. A method for remote medical consultation using the five senses according to claim 39 or 40, The patient-side device acquires personal health record data, including the patient's medical history, medication history, and past test results, and the patient-side device uses the personal health record data to support the patient's ongoing health management. A telemedicine method using the five senses, characterized by the following features.

Images