Telemedicine system

Abstract

To provide a remote medical system which can correctly evaluate and examine a patient in online medical care.SOLUTION: A remote medical system 100 comprises: three measurement devices 200, 210, 220; a patient-side arithmetic device 300 which generates 3D image data by using three-dimensional information of an affected portion image based on the measurement results acquired by the measurement device 200 and the like; a medical person-side arithmetic device 400 which outputs the 3D image data transmitted from the patient-side arithmetic device 300 via a network 700; and a display device 500 which displays the 3D image data output from an output unit 430. The 3D image data displayed on the display device 500 is based on a composite reality technique to be displayed so as to be superimposed on the actual scenery and is the 3D hologram that can be rotated in any angle and direction and freely expanded and contracted by an operation of a medical person. The system determines whether or not diagnosis of the disease is rheumatoid arthritis on the basis of information on at least one of wrinkles and tone of the affected portion.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a telemedicine system.

Background Art

[0002] In recent years, online medical treatment in which a doctor conducts medical treatment in real time using an information communication device from a location away from the patient has become known. According to online medical treatment, there is an advantage that patients in remote areas or patients who have difficulty visiting a hospital can receive medical treatment without visiting a medical institution. Furthermore, when an infectious disease or the like is prevalent, there is also an advantage that the infection risk associated with hospital visits can be reduced.

[0003] For example, the prior art literature discloses a medical treatment system capable of projecting the three-dimensional motion information of a patient in a remote location onto the head-mounted display of a medical professional in a remote location and performing medical treatment as if the patient were in front of the eyes.

Prior Art Documents

Non-Patent Documents

[0004]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the online medical treatment disclosed in the prior art documents, two measuring devices are used to scan the whole body of a patient and transmit three-dimensional motion information to a medical staff located at a remote place. Therefore, the three-dimensional images displayed on the medical staff's display may not necessarily have sufficient information regarding the detailed appearance of the body and may not be high-definition. For example, when a medical staff conducts a diagnosis of rheumatoid arthritis, it is difficult to observe the swelling and color tone details of the wrinkles on the patient's fingers, and there is a problem that accurate evaluation and medical treatment cannot be carried out.

[0006] Therefore, the present disclosure aims to solve the above problems and provides a telemedicine system capable of accurately evaluating and treating a patient in online medical treatment.

Means for Solving the Problems

[0007] A first aspect of the present disclosure is a telemedicine system for a medical staff to diagnose a disease based on an affected part image of a patient located at a remote place, comprising at least three or more measuring devices, an input unit for three-dimensional information of the affected part image based on measurement results obtained by the measuring devices, an information processing unit for generating 3D image data based on the three-dimensional information input from the input unit, a transmission unit for transmitting the 3D image data to the medical staff via a telecommunication line, a patient-side arithmetic device provided with these, a receiving unit for receiving the 3D image data transmitted from the patient-side arithmetic device via the telecommunication line, a medical staff-side arithmetic device provided with an output unit for outputting the 3D image data received by the receiving unit, and a display device for displaying the 3D image data output from the output unit. A processing device that analyzes and processes the 3D image data by software or artificial intelligence, Comprising wherein the affected part of the patient is a joint part from the patient's wrist to the fingertip, The 3D image data displayed on the display device is based on mixed reality technology that is displayed superimposed on the real scenery, and is a 3D hologram that can be rotated in any angle or direction and enlarged or reduced by the operation of the medical staff. the processing device is included in the 3D image data The affected part in Wrinkles the count value of and State of color tone and Based on this, determine whether it is rheumatoid arthritis to Discrimination do、relates to a remote medical system for rheumatoid arthritis.

Advantages of the Invention

[0008] According to the present disclosure, since at least three or more measuring devices are used to measure the affected part of the patient, a detailed three-dimensional image including wrinkles and color tone of the affected part of the patient can be obtained. Thereby, based on the diagnostic information of at least one of the wrinkles and color tone of the affected part of the patient, it is possible to determine whether the affected part of the patient is rheumatoid arthritis, so that rheumatoid arthritis in the affected part of the patient can be evaluated and diagnosed with higher accuracy and precision.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Modes for Carrying Out the Invention

[0010] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

[0011] [Configuration Example of Remote Medical System 100] FIG. 1 is a block diagram of a telemedicine system 100 according to the present embodiment. FIG. 2 is a view showing a support base 250 to which three measuring devices 200, 210, and 220 according to the present embodiment are attached.

[0012] The telemedicine system 100 is a system for diagnosing diseases, particularly rheumatoid arthritis, based on an affected part image of a patient whose medical staff is in a remote location (for example, a remote area). As shown in FIG. 1, the telemedicine system 100 includes three measuring devices 200, 210, and 220, a patient-side computing device 300, a medical staff-side computing device 400, a display device 500, and a server 600. As shown in FIG. 2, each of the three measuring devices 200, 210, and 220 is attached on a support base 250 arranged so as to surround a photographing position O for photographing an affected part of a patient. Note that four or more measuring devices 200, 210, and 220 may be provided.

[0013] The support base 250 is a device for fixedly attaching each of the three measuring devices 200, 210, and 220 at a predetermined position. As shown in FIG. 2, the support base 250 includes rod-shaped support portions 251a, 251b, and 251c, rod-shaped legs 252a, 252b, 252c, and 252d, and wheels 253a, 253b, 253c, and 253d.

[0014] In the present embodiment, as shown in FIG. 2, the length of the support portion 251c is formed to be longer than the lengths of the support portions 251a and 251b. The extending direction of the support portion 251c is defined as the longitudinal direction of the support base 250, and the extending directions of the support portions 251a and 251b are defined as the lateral direction of the support base 250. Also, in FIG. 2, an XYZ orthogonal coordinate system is set. The lateral direction (a predetermined direction in the horizontal plane) of the support base 250 is defined as the X-axis direction, the longitudinal direction (the horizontal plane and a direction orthogonal to the X-axis direction) of the support base 250 is defined as the Y-axis direction, and the direction (vertical direction) orthogonal to each of the X-axis direction and the Y-axis direction is defined as the Z-axis direction. Further, the support portion 251c side of the support base 250 is defined as the rear side of the support base 250, the opposite side is defined as the front side of the support base 250, the support portion 251a side of the support base 250 is defined as the left side of the support base 250, and the support portion 251b side of the support base 250 is defined as the right side of the support base 250.

[0015] Each of the support portions 251a and 251b extends in the X direction (lateral direction), and is arranged at a predetermined interval from each other and in parallel. The support portion 251c extends in the Y direction (longitudinal direction), the left end portion of the support portion 251c is attached to the rear end portion of the support portion 251a, and the right end portion of the support portion 251c is attached to the rear end portion of the support portion 251b. Thereby, the support portions 251a, 251b, and 251c are configured in a U-shaped (substantially U-shaped) manner when viewed in plan, and a space portion 250a is formed on the front side where the support portion is not provided. The patient provides a 3D image of the affected part to a medical staff who is remotely located by holding the affected part at the imaging position O set in the space portion 250a.

[0016] The leg portion 252a extends in the Z direction, and the upper end portion of the leg portion 252a is attached to the front end portion of the support portion 251a. A wheel 253a is rotatably attached to the lower end portion of the leg portion 252a. The leg portion 252b extends in the Z direction, and the upper end portion of the leg portion 252b is attached to the left end portion of the support portion 251c. A wheel 253b is rotatably attached to the lower end portion of the leg portion 252b.

[0017] The leg portion 252c extends in the Z direction, and the upper end portion of the leg portion 252c is attached to the front end portion of the support portion 251b. A wheel 253c is rotatably attached to the lower end portion of the leg portion 252c. The leg portion 252d extends in the Z direction, and the upper end portion of the leg portion 252d is attached to the right end portion of the support portion 251c. A wheel 253d is rotatably attached to the lower end portion of the leg portion 252d.

[0018] In FIG. 2, the wheels 253a and the like are configured to rotate in the traveling direction. However, by providing a turning portion between the wheels 253a and the like and the leg portions 252a and the like, the wheels 253a and the like may be configured to turn (rotate) in addition to rotating in the traveling direction. Further, in the support base 250, the wheels 253a, 253b, 253c, and 253d are provided so as to be movable in the X-Y plane. However, it may be a type that does not move without providing the wheels 253a, 253b, 253c, and 253d.

[0019] On the front end of the upper surface of the support portion 251a of the support base 250, the measuring device 200 is attached with the sensor (camera) facing the space portion 250a. On the central portion of the upper surface of the support portion 251c of the support base 250, the measuring device 210 is attached with the sensor facing the space portion 250a. On the front end of the upper surface of the support portion 251b of the support base 250, the measuring device 220 is attached with the sensor facing the space portion 250a.

[0020] In this embodiment, as an example, the measuring device 200 is arranged at a position of 0° with respect to the imaging position O, the measuring device 210 is arranged at a position of 90° with respect to the imaging position O, and the measuring device 220 is arranged at a position of 180° with respect to the imaging position O. Also, the distance L1 between the imaging position O where the hand as the affected part 800 of the patient is placed and the central portion C1 of the sensor of the measuring device 200, the distance L2 between the imaging position O and the central portion C2 of the sensor of the measuring device 210, and the distance L3 between the imaging position O and the central portion C3 of the sensor of the measuring device 220 are made to be approximately equal, and the measuring devices 200, 210, 220 are attached to the support base 250. The patient undergoes a diagnosis of rheumatoid arthritis by holding the affected part 800 at the imaging position O where the distances L1, L2, and L3 are approximately equal. Thereby, it is possible to image the entire range (entire surface) of the affected part 800 of the patient. Note that regarding the imaging position O, even when the distances L1, L2, and L3 are not equal, it can be corrected to some extent in software when generating the 3D image data of the affected part 800 described later.

[0021] In this embodiment, the support base 250 is configured in a U shape when viewed in plan, but it is not limited to this. For example, the support base 250 may be configured in a substantially V shape when viewed in plan, the measuring device 200 may be attached to the left end portion thereof, the measuring device 220 may be attached to the right end portion thereof, and the measuring device 210 may be attached to the bent portion thereof. Also, the support base 250 may be configured in a polygonal shape when viewed in plan.

[0022] As the affected part 800 of the patient, as shown in FIG. 2 and the like, for example, it is an area from the wrist to the fingertips of a rheumatoid arthritis patient, and in particular, the joint parts of the fingers can be mentioned. When the patient receives a diagnosis from a medical professional, the patient places a hand or the like, which is the affected part 800 to be diagnosed, at the imaging position O surrounded by the measuring devices 200, 210, and 220. In the present embodiment, although the patient cannot directly visually recognize the imaging position O, the patient aligns and places the affected part assuming the position (imaging position O) where the optical axes (dashed lines in FIG. 2) of the measuring devices 200, 210, and 220 intersect. Note that the image displayed on the display device 500 of the medical professional located remotely may be displayed on the display device in the room where the patient is, and the affected part may be moved to the imaging position O while checking the image, or the affected part may be moved to the imaging position O based on the instructions of the medical professional located remotely.

[0023] The measuring devices 200, 210, and 220 include depth sensors 202, 212, and 222. The depth sensors 202, 212, and 222 measure the distance between the affected part 800 of the patient held above the imaging position O and the measuring devices 200, 210, and 220 to obtain distance information (depth image), which is one of the three-dimensional information. Further, the measuring devices 200, 210, and 220 include RGB sensors (not shown). The RGB sensors measure the color values of the affected part 800 of the patient held above the imaging position O to obtain color information (color image), which is one of the three-dimensional information. The measuring devices 200, 210, and 220 are connected to the patient-side arithmetic unit 300 via a wired or wireless network, and transmit the three-dimensional information based on the measurement results of the patient's affected part to the input unit 310 of the patient-side arithmetic unit 300. The three-dimensional information of the affected part image includes the above-mentioned distance information and color information. As the network, for example, any communication method such as a wired LAN (Local Area Network), a wireless LAN, or Bluetooth (registered trademark) can be applied.

[0024] The patient-side arithmetic unit 300 includes an input unit 310, an information processing unit 320, and a transmission unit 330. The input unit 310 receives, via the network, the three-dimensional information of the affected part image based on the measurement results obtained by the measuring devices 200, 210, and 220.

[0025] The information processing unit 320 generates 3D image data of the affected part based on the three-dimensional information of the affected part image received by the input unit 310. The information processing unit 320 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory). The CPU controls the overall operations within the patient-side computing device 300 by executing various programs stored in the ROM using the RAM as a working area. Note that as the processor, in addition to the CPU, an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), etc. may also be used.

[0026] The transmission unit 330 transmits the 3D image data generated by the information processing unit 320 to each of the medical staff-side computing device 400 and the server 600 via the network (telecommunication line) 700. As the network 700, for example, any communication method such as various LANs (Local Area Networks) including Ethernet (registered trademark), WANs (Wide Area Networks), telephone line networks, or satellite communication networks, etc., can be applied.

[0027] The medical staff-side computing device 400 is connected to the patient-side computing device 300 via a wired or wireless network 700. The medical staff-side computing device 400 includes a receiving unit 410, an information processing unit 420, and an output unit 430.

[0028] The receiving unit 410 receives the 3D image data transmitted from the patient-side computing device 300 via the network 700.

[0029] The information processing unit 420 includes a CPU, a ROM, and a RAM, etc. The CPU controls the overall operations within the medical staff-side computing device 400 by executing various programs stored in the ROM using the RAM as a working area.

[0030] The output unit 430 is connected to the display device 500 via a wired or wireless network, and outputs the 3D image data received by the receiving unit 410 to the display device 500. As the network, for example, any communication method such as a wired LAN, a wireless LAN, or Bluetooth (registered trademark) can be applied.

[0031] The display device 500 is a device corresponding to stereoscopic vision, and is, for example, a three-dimensional display, a three-dimensional projector, or a head-mounted display. The display device 500 displays the 3D image data output by the output unit 430 of the medical staff side arithmetic unit 400 on the display. The 3D image data is based on augmented reality technology that is displayed superimposed on the real scenery, and is, for example, a 3D hologram that can be rotated in any angle and direction and enlarged and reduced by the operation of the medical staff.

[0032] The server 600 is a cloud server constructed on the network 700, and is connected to each of the patient side arithmetic unit 300 and the medical staff side arithmetic unit 400 via the network 700. The server 600 has at least an information processing unit 610. The information processing unit 610 has, for example, a CPU, a ROM, and a RAM. The CPU controls the overall operation in the server 600 by executing according to various programs stored in the ROM with the RAM as a work area. Note that as the processor, in addition to the CPU, an MPU, a GPU, etc. may also be used.

[0033] The information processing unit 610 of the server 600 analyzes and processes the 3D image data (three-dimensional information) transmitted from the patient side arithmetic unit 300 by software installed in advance. Specifically, for example, the information processing unit 610 acquires at least one piece of diagnostic information on wrinkles and color tone in the affected part 800 of the patient from the 3D image data, compares the acquired diagnostic information with the threshold values of the patient's wrinkles and color tone set in advance, and determines whether rheumatoid arthritis has occurred in the patient based on the comparison result.

[0034] The diagnostic criteria for rheumatoid arthritis indicate that it is essential for arthritis to be present in joints (such as finger and hand joints) with a high prevalence in rheumatoid arthritis. Arthritis caused by rheumatoid arthritis is perceived as joint swelling during joint examination, reflecting clinical synovitis. Therefore, in this embodiment, information on the wrinkles and color tone of the affected area related to joint swelling is used as an indicator for determining whether the affected area 800 of the patient is arthritis caused by rheumatoid arthritis. Regarding the wrinkles of the affected area 800 of the patient, when the number of wrinkles in the affected area 800 is small, it can be predicted that the skin of the affected area 800 is swollen and the affected area 800 is swollen, so there is a high possibility that rheumatoid arthritis has occurred. On the other hand, when the number of wrinkles in the affected area 800 is large, it can be predicted that the skin of the affected area 800 is not swollen and there is no swelling in the affected area 800, so the possibility of rheumatoid arthritis occurring is low. Regarding the color tone of the patient, for example, when the lightness and chroma (color tone) of the affected area 800 are higher than those of other surrounding areas, specifically when it is reddened, it can be predicted that inflammation has occurred in the affected area 800 and there is a high possibility that arthritis caused by rheumatoid arthritis has occurred. Therefore, in the discrimination of the presence or absence of rheumatoid arthritis by medical staff through joint visual inspection or by the server 600, it is possible to accurately detect arthritis caused by rheumatoid arthritis by combining the state (tightness) of the wrinkles and the color tone (reddening) of the affected area 800.

[0035] In addition, the server 600 may be configured to determine (analyze and process) whether rheumatoid arthritis has occurred in the affected area 800 of the patient from the 3D image data transmitted from the patient-side computing device 300 based on a machine learning model (artificial intelligence). Here, the machine learning model is, for example, a computational model that is trained to estimate the presence or absence of rheumatoid arthritis using at least one of the diagnostic information on the number of wrinkles and the color tone in the affected area 800 of the patient as learning data. The machine learning model is constructed using a machine learning algorithm such as random forest, support vector machine, or deep learning by a learning unit (not shown) and is stored, for example, in a storage unit (not shown) of the server 600.

[0036] FIG. 3 shows an example of an affected part image 800a composed of a 3D hologram displayed on the display 510 of the display device 500. FIG. 4 shows an example of the positional relationship between the affected part image 800a composed of a 3D hologram displayed on the display 510 of the display device 500 and the medical staff 900.

[0037] As shown in FIG. 3, on the display 510, an affected part image 800a composed of a 3D hologram image of the hand of a patient in a remote location is displayed superimposed on the real scenery where the medical staff 900 is located. The hand 910 of the medical staff 900 is recognized by a camera (not shown) provided in the display device 500, and when the hand 910 of the medical staff 900 performs a specific operation on the affected part image 800a composed of a 3D hologram image, the affected part image 800a can return a reaction corresponding to the operation.

[0038] For example, as shown in FIG. 3, when an operation is performed by the hand 910 of the medical staff 900 to rotate the affected part image 800a in the arrow directions D1 and D2, the display device 500 rotates the affected part image 800a from the position indicated by the solid line to the position indicated by the dashed line and displays it. Further, although not shown, when an operation is performed by the hand 910 of the medical staff 900 to pinch and move the affected part image 800a outward, for example, the affected part image 800a is enlarged and displayed. On the other hand, when an operation is performed by the hand 910 of the medical staff 900 to pinch and move the affected part image 800a inward, for example, the affected part image 800a is reduced and displayed. Icons for rotation, enlargement, and reduction may be displayed on the display 510, and functions such as rotation, enlargement, and reduction may be realized by operating a predetermined icon with the hand 910 of the medical staff 900. Also, as shown in FIG. 4, when the medical staff 900 wears the display device 500 and moves the affected part image 800a from the position P1 to the position P2 or the position P3, different sides of the affected part image 800a can be visually recognized.

[0039] Furthermore, as shown in the parentheses in FIG. 4, when a plurality of medical staff 900, 901, 902 perform examinations, by having the plurality of medical staff 900, 901, 902,... wear the display devices 500, 501, 502,... respectively, the affected part image 800a can be displayed on each of the displays 510, 511, 512,... In this case, when one medical staff 900 performs an operation on the affected part image 800a, the operation may be reflected on the affected part images 800a displayed on the displays 511, 512,... of the other medical staff 901, 902,... Such a function enables diagnosis by a plurality of specialists at a plurality of locations for the affected part 800 of a single patient. Alternatively, the operation performed by one medical staff 900 on the affected part image 800a may be reflected only on the affected part image 800a displayed on the display 510 of the medical staff 900, and the affected part images 801a, 802a,... operated to be displayed at the angles and sizes that the other medical staff 901, 902,... want to observe may be displayed on the displays 511, 512,... Such a function enables a more comprehensive evaluation and diagnosis of the affected part 800.

[0040] [Operation example of the telemedicine system 100] FIG. 5 is a flowchart showing the operation at the time of diagnosing rheumatoid arthritis in the telemedicine system 100 according to the present embodiment. FIG. 6 is a diagram showing the affected part image 800a and the rheumatoid arthritis analysis information 520 displayed on the display 510 of the display device 500 according to the present embodiment.

[0041] As shown in FIG. 5, in step S100, the server 600 receives 3D image data (three-dimensional information) transmitted from the patient-side arithmetic device 300. The 3D image data includes, for example, an affected part image 800a of the patient's hand.

[0042] In step S110, the information processing unit 610 of the server 600 counts the number of wrinkles in a predetermined part (area) of the patient's hand, which is the affected part image 800a, based on the 3D image data. The information processing unit 610 identifies, for example, each of the first joint, the second joint, the third joint (base of the finger), and the wrist joint (wrist) in the affected part image 800a, and counts the number of wrinkles in each identified joint. The count value is stored in a storage unit (not shown) of the server 600.

[0043] In step S120, the information processing unit 610 of the server 600 determines whether the count value of the wrinkles in each joint of the affected part image 800a is less than or equal to a preset threshold value. The threshold value may be set, for example, by counting the number of wrinkles in the joints of a plurality of patients who actually have rheumatoid arthritis and based on the results of the count values. If there is a location in the joint of the affected part image 800a where the count value of the wrinkles is less than or equal to the preset threshold value, the information processing unit 610 of the server 600 identifies the joint and proceeds to step S130.

[0044] In step S130, the information processing unit 610 of the server 600 determines whether the identified joint in the affected part image 800a is reddened. For example, using the lightness, which is one of the color tones, it is determined based on whether the numerical value of the lightness of the identified joint in the affected part image 800a is less than or equal to a preset numerical value of the lightness. If the information processing unit 610 of the server 600 determines that the identified joint in the affected part image 800a is reddened, it proceeds to step S140.

[0045] In step S140, if the count value of the wrinkles in the identified joint in the affected part image 800a is less than or equal to the preset threshold value and is reddened, the information processing unit 610 of the server 600 determines that inflammation has occurred and there is a high possibility of rheumatoid arthritis. The information processing unit 610 of the server 600 transmits the analysis information 520 based on the determination result to the medical staff side computing device 400 via the network 700. The medical staff side computing device 400 transmits the analysis information 520 received from the medical staff side computing device 400 to the display device 500.

[0046] In step S150, the display device 500 superimposes and displays the analysis information 520 indicating a high possibility that the patient received from the medical staff side computing device 400 has arthritis due to rheumatoid arthritis on the affected part image 800a which is a 3D hologram image. Specifically, as shown in FIG. 6, the display device 500 changes the color of the highly likely rheumatoid arthritis part 810a to highlight it so as to superimpose on the affected part image 800a which is a 3D hologram image on the display 510, and also displays the highly likely rheumatoid arthritis part 810a surrounded by a substantially circular frame 520a. In addition, the display device 500 may display character information 520b such as "arthritis in the second joint of the middle finger" on a part of the display 510. Further, the highly likely rheumatoid arthritis part 810a may be displayed blinking, or may be indicated by an arrow or the like.

[0047] On the other hand, when the count value of the wrinkles of the hand joint which is the affected part image 800a exceeds a preset threshold value (S120) and the hand joint which is the affected part image 800a is not reddened (S130), the processing unit of the server 600 proceeds to step S160 and determines that the possibility of rheumatoid arthritis is low. The processing unit of the server 600 transmits the analysis information 520 based on the determination result to the medical staff side computing device 400 via the network 700. The medical staff side computing device 400 transmits the analysis information 520 received from the medical staff side computing device 400 to the display device 500.

[0048] In step S170, the display device 500 displays on the display 510 that the possibility that the patient undergoing medical treatment has rheumatoid arthritis is low or that the patient does not have rheumatoid arthritis based on the analysis information 520 received from the medical staff side computing device 400. Specifically, as the analysis information 520, the display device 500 may display characters such as "low possibility or no rheumatoid arthritis" on a part of the display 510.

[0049] In FIG. 5, an example was described in which both the wrinkles and color tone of the joint in the affected area were used as indicators for diagnosing rheumatoid arthritis, but the present invention is not limited thereto. For example, it may be possible to determine whether or not a patient has rheumatoid arthritis using either the wrinkles or the color tone of the patient's joints. Further, in FIG. 5, the procedure for counting the wrinkles of the joint and the procedure for confirming the redness of the joint may be in the reverse order.

[0050] As described above, according to the present embodiment, since the three measuring devices 200, 210, and 220 having the depth sensors 202, 212, and 222 are used to measure the affected area of the patient, a detailed three-dimensional image including the wrinkles and color tone of the affected area 800 of the patient can be obtained. Thereby, based on the diagnostic information of at least one of the wrinkles and color tone of the affected area 800 of the patient in the server 600, it is possible to determine whether or not the affected area 800 of the patient has rheumatoid arthritis, so that it is possible to evaluate and diagnose with higher accuracy and accuracy whether or not the affected area 800 of the patient has rheumatoid arthritis.

[0051] Further, according to the present embodiment, since the affected area image 800a composed of the 3D hologram image of the affected area 800 of the patient located remotely is displayed on the display 510 of the display device 500, an accurate diagnosis can be made based on the wrinkles and color tone of the affected area 800 of the patient. Further, since the determination result as to whether or not the affected area 800 of the patient analyzed and processed on the server 600 side has rheumatoid arthritis is displayed on the display 510 of the display device 500, the medical staff 900 can use it as auxiliary diagnostic information when diagnosing the affected area 800 of the patient.

[0052] Further, according to the present embodiment, since the distance between each of the measuring devices 200, 210, and 220 attached to the support base 250 and the imaging position O is made substantially equal, a 3D hologram image of the patient's hand can be formed by overlaying each affected area image 800a of the patient's hand measured by the measuring devices 200, 210, and 220.

[0053] By using the telemedicine system 100 of the present invention, patients in remote areas are freed from the burden of long-distance travel for receiving diagnoses from specialists. In addition, since patients can receive high-quality examinations and diagnoses from specialists in remote areas at clinics and hospitals in their place of residence where it is easy to visit, they can receive changes in their medical conditions and physical function evaluations continuously and no less than in face-to-face medical consultations. Therefore, the telemedicine system 100 of the present invention can contribute to the improvement of patients' QOL and the elimination of medical disparities.

[0054] As described above, the preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings, but the technical scope of the present disclosure is not limited to such examples. For example, in this embodiment, the case of mainly diagnosing rheumatoid arthritis of the finger, which is the affected part 800 of the patient, has been described, but it is not limited thereto. For example, the present invention can also be applied to the base of the toe, ankle, knee, hip joint, elbow, shoulder, etc.

[0055] Also, in the above-described embodiment, it is determined whether or not it is rheumatoid arthritis using a three-dimensional image of the patient's affected part in the server 600, but it is not limited thereto. For example, it may be determined whether or not it is rheumatoid arthritis using a three-dimensional image of the patient's affected part in the information processing unit 320 of the patient-side computing device 300 or the information processing unit 420 of the medical staff-side computing device 400. In this case, the analysis information 520 is transmitted to the display device 500, and the analysis information 520 is displayed on the display 510 of the display device 500 as shown in FIG. 6.

[0056] As another embodiment of the present invention, at least one image data selected from the group consisting of magnetic resonance imaging (MRI) data, tomography data, ultrasonic data, X-ray data, photographic data of the appearance of the affected part, and pathological annotation data is uploaded to the server 600 in advance, and a mode of superimposing and displaying or partially synthesizing the image data with a 3D hologram image of the patient's affected part is also considered. According to this embodiment, it is possible to more accurately evaluate and diagnose whether or not the patient's affected part is rheumatoid arthritis.

Explanation of Reference Numerals

[0057] 100 Telemedicine system 200, 210, 220 Measuring device 202, 212, 222 Depth sensor 300 Patient-side computing device 310 Input unit 320 Information processing unit 330 Transmission unit 400 Healthcare provider-side computing device 410 Reception unit 420 Information processing unit 430 Output unit 500 Display device 600 Server 700 Network (telecommunication line) 800 Affected part 800a Image of affected part 900 Healthcare provider 910 Hand O Imaging position

Claims

1. A telemedicine system for a medical practitioner to diagnose a disease based on an affected part image of a patient located remotely, comprising: at least three or more measuring devices; an input unit for three-dimensional information of the affected part image based on the measurement results obtained by the measuring devices; an information processing unit for generating 3D image data based on the three-dimensional information input from the input unit, and a transmission unit for transmitting the 3D image data to the medical practitioner via a telecommunication line, a patient-side computing device; a receiving unit for receiving the 3D image data transmitted from the patient-side computing device via the telecommunication line, and an output unit for outputting the 3D image data received by the receiving unit, a medical practitioner-side computing device; a display device for displaying the 3D image data output from the output unit; a processing device for analyzing and processing the 3D image data by software or artificial intelligence; wherein the affected part of the patient is a joint part from the patient's wrist to the fingertips; the 3D image data displayed on the display device is based on mixed reality technology that is displayed superimposed on the real scenery, and is a 3D hologram that can be rotated in any angle or direction and enlarged or reduced by the operation of the medical practitioner; the processing device discriminates whether it is rheumatoid arthritis based on the count value of wrinkles and the color tone state in the affected part included in the 3D image data; A telemedicine system for rheumatoid arthritis, characterized in that.

2. The measuring device includes a depth sensor for measuring the distance between the measuring device and the affected part of the patient. The telemedicine system for rheumatoid arthritis according to claim 1, characterized in that.

3. Each of at least the three measuring devices is attached to a support table arranged so as to surround the imaging position for imaging the affected part of the patient; each distance between at least the three measuring devices and the imaging position is substantially the same. The telemedicine system for rheumatoid arthritis according to claim 1 or claim 2, characterized in that.

4. The display device superimposes and displays analysis information based on the discrimination result of the processing device on the 3D image data. The telemedicine system for rheumatoid arthritis according to any one of claims 1 to 3, characterized in that.

5. The display device is a device corresponding to stereoscopic vision, and is a 3D display, a 3D projector or a head-mounted display. The rheumatoid arthritis telemedicine system according to any one of claims 1 to 4, characterized in that...

Images