Telemedicine providing system, server, and program

The telemedicine system enhances remote medical services by using virtual reality to create a synchronized avatar environment, providing a more lifelike sense of presence and improving the effectiveness of virtual consultations.

JP2025077565APending Publication Date: 2025-05-19DOKKYO MEDICAL UNIVERSITY
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023189846
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-11-07
Publication Date
2025-05-19

AI Technical Summary

Technical Problem

Existing telemedicine technologies do not provide a lifelike sense of presence for remote medical services, limiting the effectiveness of virtual consultations.

Method used

A telemedicine system that uses a virtual reality space to synchronize avatars of patients and medical staff, allowing for real-time interaction and medical services with a more face-to-face-like sense of presence.

Benefits of technology

Enables remote medical services such as examinations and rehabilitation guidance with a higher sense of presence compared to conventional video phone consultations, improving the effectiveness and engagement of virtual medical interactions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025077565000001_ABST
    Figure 2025077565000001_ABST
Patent Text Reader

Abstract

To carry out a telemedicine service with realism closer to face-to-face medical treatment than before.SOLUTION: A telemedicine providing system comprises: a server that provides a virtual reality space; a first sensor unit that detects information on the movement of a patient; and a first VR device that is used by a medical worker and has a display unit displaying the virtual reality space. The server displays, in the virtual reality space, an avatar synchronized with the movement information detected by the first sensor unit.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a telemedicine providing system, a server, and a program.

Background Art

[0002] In recent years, technologies such as VR (Virtual Reality) have been applied to the medical field. For example, in Patent Document 1, an apparatus for displaying and recording a patient's medical information to a user using a three-dimensional (3D) avatar has been proposed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Against the backdrop of the development of VR technology and the like, it has become possible to have a lifelike communication with others who are located remotely. However, the above-described conventional technology records a patient's medical information in a form associated with the patient's avatar, and does not provide medical services to the patient remotely.

[0005] The present invention provides a technology for providing remote medical services with a more face-to-face-like sense of presence than before.

Means for Solving the Problems

[0006] According to one aspect of the present invention, a telemedicine providing system, a server that provides a virtual reality space, a first sensor unit that detects operation information of a patient, a first device used by a medical worker and having a display unit that displays the virtual reality space, comprising The server displays an avatar synchronized with the operation information detected by the first sensor unit on the virtual reality space. Remote medical service system is provided.

Advantages of the Invention

[0007] According to the present invention, remote medical services can be provided with a more face-to-face-like sense of presence than in the past.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Modes for Carrying Out the Invention

[0009] <Remote medical service system> FIG. 1 is a configuration diagram showing a telemedicine providing system SY (hereinafter, system SY) according to an embodiment. The system SY is a system for medical staff to provide medical services remotely to patients. In the system SY, by using a virtual reality space in which an avatar synchronized with the patient's movements is projected, medical services can be provided with a sense of presence close to that during in-person consultations despite the remote nature. The medical staff includes, for example, doctors, nurses, physical therapists, etc. The medical services provided include, for example, examinations, rehabilitation guidance, and other medical and nursing practices. With the system SY, patients can receive medical services from medical staff in medical facilities such as hospitals while staying at home or in nursing facilities.

[0010] The system SY includes a server 1, a subsystem SS2 on the medical staff side, and a subsystem SS3 on the patient side. The subsystem SS2 includes an information processing device 20, and the subsystem SS3 includes an information processing device 30. The server 1, the information processing device 20, and the information processing device 30 can communicate with each other via a network NT. The configuration of the network NT can be designed as appropriate. For example, the server 1 and the information processing device 20 may be able to communicate via a LAN within a medical facility, and the server 1 and the information processing device 30 may be able to communicate via the Internet. Also, for example, the server 1, the information processing device 20, and the information processing device 30 may be able to communicate via the Internet. In FIG. 1, one subsystem SS2 on the medical staff side and two subsystems SS3 on the patient side are shown, but the number of each can be set as appropriate. For example, when a doctor conducts an examination, one subsystem SS2 and one subsystem SS3 may be included in the system SY. Also, when a physical therapist conducts rehabilitation guidance, one subsystem SS2 and a plurality of subsystems SS3 may be included in the system SY. Also, a plurality of subsystems SS2 on the medical staff side may be included in the system SY.

[0011] <Server 1> Server 1 provides a virtual reality space SP for telemedicine. Although details will be described later, Server 1 displays an avatar synchronized with the patient's movements on the virtual reality space SP based on the movement information of the patient detected by the sensor unit 31. Also, Server 1 displays an avatar synchronized with the movements of the medical staff on the virtual reality space SP based on the movement information of the medical staff detected by the sensor unit 21.

[0012] Server 1 has a communication unit 11, a storage unit 12, and a control unit 13, and these components are electrically connected inside Server 1 via a communication bus (not shown). Server 1 may be constituted by a single information processing device or may be constituted by a plurality of information processing devices capable of communicating with each other.

[0013] The communication unit 11 executes communication with other devices. As the communication method, known ones can be appropriately used. Server 1 communicates various information with the information processing device 20 and the information processing device 30 via the network NT by the communication unit 11.

[0014] The storage unit 12 stores various information. This can be implemented, for example, as a storage device such as a solid state drive (SSD) that stores various programs related to Server 1 executed by the control unit 13, or as a memory such as a random access memory (RAM) that stores temporarily necessary information (arguments, arrays, etc.) related to the calculation of the program. Also, combinations of these may be used. Further, the storage unit 12 stores various information necessary for providing the telemedicine service. For example, the storage unit 12 stores display information for displaying the virtual reality space SP on each user terminal.

[0015] The control unit 13 performs processing and control of the overall operation related to the server 1. The control unit 13 is, for example, a Central Processing Unit (CPU). The control unit 13 realizes various functions related to the server 1 by reading a predetermined program stored in the storage unit 12. That is, the information processing by the software stored in the storage unit 12 is specifically realized by the control unit 13 which is an example of hardware, and can be executed as each functional unit included in the control unit 13. Note that the control unit 13 is not limited to being single, and may be implemented to have a plurality of control units 13 for each function, or a combination thereof may also be possible.

[0016] <Subsystem SS2 on the side of medical staff> The subsystem SS2 is composed of devices used on the side of medical staff who provide remote medical services. The subsystem SS2 includes an information processing device 20, a sensor unit 21, and a VR device 22. In the present embodiment, the information processing device 20, the sensor unit 21, and the VR device 22 can communicate with each other via a wireless LAN or the like. That is, the information processing device 20 relays the exchange of various information between the server 1, the sensor unit 21, and the VR device 22. Note that a configuration in which the sensor unit 21 and the VR device 22 communicate with the server 1 via the network NT without the information processing device 20 being provided is also adoptable. Also, a mode in which the sensor unit 21 is not provided is also adoptable.

[0017] (Information processing device 20) The information processing device 20 has a communication unit 201, a storage unit 202, and a control unit 203, and these components are electrically connected to each other inside the information processing device 20 via a communication bus (not shown). The information processing device 20 may be a PC, a tablet terminal, or the like.

[0018] The communication unit 201 executes communication with other devices. As the communication method, known ones can be appropriately used. The information processing device 20 communicates various information with the server 1 and the information processing device 30 via the network NT by the communication unit 201. Also, the information processing device 20 communicates various information with the sensor unit 21 and the VR device 22 by the communication unit 201.

[0019] The storage unit 202 stores various information. This can be implemented as a storage device such as a solid state drive that stores various programs and the like related to the information processing device 20 executed by the control unit 203, or as a memory such as a random access memory that stores temporarily necessary information (arguments, arrays, etc.) related to the operation of the program. Also, a combination of these may be used.

[0020] The control unit 203 performs processing and control of the overall operation related to the information processing device 20. The control unit 203 is, for example, a central processing unit. The control unit 203 realizes various functions related to the information processing device 20 by reading a predetermined program stored in the storage unit 202. That is, the information processing by software stored in the storage unit 202 is specifically realized by the control unit 203 which is an example of hardware, and can be executed as each functional unit included in the control unit 203. Note that the control unit 203 is not limited to being single, and may be implemented to have a plurality of control units 203 for each function. Also, a combination of them may be used.

[0021] (Sensor unit 21) The sensor unit 21 detects the operation information of medical staff. The sensor unit 21 detects, as the operation information, the skeletal information of medical staff, information regarding expressions, information regarding gazes, etc. The sensor unit 21 may include a motion sensor that detects skeletal information. Further, the skeletal information may include information such as the limbs, the trunk, and the fingers. Also, for example, the sensor unit 21 may include a camera and a recognition unit that analyzes the captured image of the camera to recognize expressions and gazes. In one embodiment, the sensor unit 21 may be a full-body motion capture of the limbs, trunk, fingers, expressions, and other body parts. Note that the detection of expressions and gazes may be performed by the VR device 22. That is, at least a part of the sensor unit 21 may be provided integrally with the VR device 22. Regarding the acquisition of operation information, known techniques such as optical motion capture or inertial sensor-based motion capture can be appropriately used. Examples include KinMAS of j-mex Inc., VIVE Tracker of HTC Corporation, OptiTrack (registered trademark) of Accuity Co., Ltd., etc.

[0022] (VR device 22) FIG. 2(a) is a configuration diagram showing the VR device 22. The VR device 22 is used by medical staff. As the VR device 22, known ones can be appropriately used. For example, a head-mounted display and a VR controller can be used. Examples include META QUEST (registered trademark) 2, META QUEST (registered trademark) 3, Oculus Rift (registered trademark), and HTC VIVE series, etc.

[0023] The VR device 22 includes a display unit 221 that displays the virtual reality space SP described later. The VR device 22 also includes a communication unit 222 that communicates with other devices to acquire information for displaying the virtual reality space SP, and a control unit 223 that controls the display by the display unit 221 based on the information acquired by the communication unit 222.

[0024] The display unit 221 displays the virtual reality space SP. The display unit 221 may be, for example, a liquid crystal display, an organic EL display, or the like. Alternatively, the display unit 221 may be a system that directly irradiates an image onto the retina.

[0025] The communication unit 222 acquires information for the display unit 221 to display the virtual reality space SP from the information processing device 20. The control unit 223 is, for example, a central processing unit, and performs processing and control of the overall operation related to the VR device 22. In the case of an embodiment where the information processing device 20 is omitted, in the sequence diagrams of FIGS. 4 and 5 described later, the control unit 223 of the VR device 22 may undertake the processing of the information processing device 20.

[0026] Further, the VR device 22 may include a microphone 224 and a speaker 225, thereby enabling voice communication with the patient. Further, the VR device 22 may also include an operation unit 226 such as the aforementioned VR controller. The operation unit 226 accepts various operations by medical staff. In one embodiment, the medical staff may operate the operation unit 226 to share music and videos with others on the virtual reality space SP. For example, in rehabilitation guidance, it is conceivable to perform predetermined rehabilitation movements in accordance with music and videos. Further, the VR device 22 may be able to acquire information about the position information and orientation (viewpoint) within the virtual reality space SP of the VR device 22 by means of an inertial sensor or the like.

[0027] <Subsystem SS3> Subsystem SS3 is composed of devices used on the patient side to enjoy remote medical services. Subsystem SS3 includes an information processing device 30, a sensor unit 31, a VR device 32, and an inspection device 33. In this embodiment, the information processing device 30, the sensor unit 31, the VR device 32, and the inspection device 33 can communicate with each other via a wireless LAN or the like. That is, the information processing device 30 relays the exchange of various information between the server 1 and the sensor unit 31, the VR device 32, and the inspection device 33. Note that a configuration in which the sensor unit 31, the VR device 32, and the inspection device 33 communicate with the server 1 via the network NT without the information processing device 30 being provided is also adoptable. Also, a mode in which the VR device 32 and the inspection device 33 are not provided is also adoptable.

[0028] (Information processing device 30) The information processing device 30 has a communication unit 301, a storage unit 302, and a control unit 303, and these components are electrically connected via a communication bus (not shown) inside the information processing device 30. The information processing device 30 may be a PC, a tablet terminal, or the like.

[0029] The communication unit 301 executes communication with other devices. As the communication method, known ones can be appropriately used. The information processing device 30 communicates various information with the server 1 and the information processing device 30 via the network NT by the communication unit 301. Also, the information processing device 30 communicates various information with the sensor unit 31, the VR device 32, and the inspection device 33 by the communication unit 301.

[0030] The storage unit 302 stores various information. This can be implemented, for example, as a storage device such as a solid state drive that stores various programs related to the information processing device 30 executed by the control unit 303, or as a memory such as a random access memory that stores temporarily necessary information (arguments, arrays, etc.) related to the calculation of the program. Also, a combination of these may be used.

[0031] The control unit 303 performs processing and control of the overall operation related to the information processing apparatus 30. The control unit 303 is, for example, a central processing unit. By reading a predetermined program stored in the storage unit 302, the control unit 303 realizes various functions related to the information processing apparatus 30. That is, the information processing by software stored in the storage unit 302 is specifically realized by the control unit 303, which is an example of hardware, and can be executed as each functional unit included in the control unit 303. Note that the control unit 303 is not limited to being single, and may be implemented to have a plurality of control units 303 for each function. Or a combination thereof may also be possible.

[0032] (Sensor unit 31) The sensor unit 31 detects the motion information of the patient. As the motion information, the sensor unit 31 detects the skeletal information of the patient, information related to the expression, information related to the line of sight, etc. The sensor unit 31 may include a motion sensor that detects skeletal information. Further, the skeletal information may include information on the limbs, torso, fingers, etc. Also, for example, the sensor unit 31 may include a camera and a recognition unit that analyzes the captured image of the camera to recognize the expression and the line of sight. In one embodiment, the sensor unit 31 may be a full-body motion capture of the limbs, torso, fingers, expression, and other body parts. By detecting more information, medical staff can more appropriately grasp the state of the patient located remotely. Note that the detection of the expression and the line of sight may be performed by the VR device 32. That is, at least a part of the sensor unit 31 may be provided integrally with the VR device 32. In addition, regarding the acquisition of the motion information, known techniques can be appropriately used. For example, the VIVE Tracker of HTC Corporation, OptiTrack (registered trademark) of AQUITY Co., Ltd., etc. can be mentioned. Also, the sensor unit 31 can detect the position of the patient avatar 52 on the virtual reality space SP.

[0033] (VR device 32) Figure 2(b) is a configuration diagram representing the VR device 32. The VR device 32 is used by medical personnel. As the VR device 32, known ones can be appropriately used. For example, a head-mounted display and a VR controller can be used. For example, Oculus Rift (registered trademark), HTC VIVE series, etc. can be mentioned.

[0034] The VR device 32 includes a display unit 321 that displays the virtual reality space SP described later. The VR device 32 also includes a communication unit 322 that communicates with other devices to acquire information for displaying the virtual reality space SP, and a control unit 323 that controls the display by the display unit 321 based on the information acquired by the communication unit 322.

[0035] The display unit 321 displays the virtual reality space SP. The display unit 321 may be, for example, a liquid crystal display, an organic EL display, etc. Alternatively, the display unit 321 may be a method of directly irradiating an image on the retina.

[0036] The communication unit 322 acquires information for the display unit 321 to display the virtual reality space SP from the information processing device 30. The control unit 323 is, for example, a central processing unit, and performs processing and control of the overall operation related to the VR device 32.

[0037] Further, the VR device 32 may include a microphone 324 and a speaker 325, whereby communication with medical personnel by voice can be performed. The operation unit 326 receives various operations of the patient. Also, the VR device 32 may be able to acquire information about the position information and orientation (viewpoint) within the virtual reality space SP of the VR device 22 by means of an inertial sensor or the like.

[0038] (Inspection device 33) The inspection device 33 is a device for inspecting the patient's condition. The inspection results of the inspection device 33 are sent to the server 1 via the information processing device 30 as inspection information. The server 1 displays the inspection information acquired from the inspection device 33 in the virtual reality space SP. For example, the inspection device 33 can acquire electrocardiogram, electroencephalogram, electromyogram, auscultation sound data, etc. Further, the inspection device 33 can acquire so-called vital data such as pulse, respiration, body temperature, blood pressure, etc.

[0039] <Virtual reality space> Figure 3 is a diagram showing the virtual reality space SP. In the virtual reality space SP, a medical staff avatar 51 synchronized with the operation of the medical staff and a patient avatar 52 synchronized with the operation of the patient are displayed. The medical staff can immerse themselves in the virtual reality space SP where the patient avatar 52 is located using the VR device 22, and while observing the movements and expressions of the patient from a 360-degree perspective, perform diagnosis and other necessary instructions and support for the patient located in a remote location. As a result, for example, compared with online diagnosis using a conventional video phone, the medical staff can provide medical services such as diagnosis with a more face-to-face-like sense of presence.

[0040] On the other hand, the patient can immerse themselves in the virtual reality space SP where the medical staff avatar 51 is located using the VR device 32 and receive medical services while observing the movements of the medical staff avatar 51 from a 360-degree perspective. As a result, for example, compared with online diagnosis using a conventional video phone, the patient can receive medical services such as diagnosis with a more face-to-face-like sense of presence. For example, in rehabilitation guidance, etc., the demonstration movements of the medical staff can be seen with a more face-to-face-like sense of presence.

[0041] Further, the inspection information 53 acquired from the inspection device 33 is displayed in the virtual reality space SP. Therefore, the medical staff can perform medical services such as diagnosis while simultaneously confirming the movements of the patient and the inspection information 53 by the inspection device 33. Note that the display mode of the inspection information 53 can be changed as appropriate. For example, it may be displayed at a position closer to the patient avatar 52, or it may be displayed superimposed on the patient avatar 52.

[0042] Also, a plurality of patient avatars 52 may be displayed in the virtual reality space SP together with one or more medical staff avatars 51. The plurality of patient avatars 52 may be able to recognize each other's actions or may be able to communicate by voice communication. For example, in rehabilitation guidance or the like, from the perspective of the group psychology of patients, it is considered that when patients recognize others, the motivation of the patients can be improved and the fun in implementation can be generated. Also, from the perspective of medical staff, medical services can be provided to a plurality of patients in various locations at once, so that services can be provided efficiently.

[0043] <Processing Example> FIG. 4 is a sequence diagram showing a processing example of the system SY. In the present embodiment, by periodically repeating the processing shown in FIG. 4, the actions of medical staff and patients can be reflected in real time as avatars on the virtual reality space SP.

[0044] In S201, the information processing device 20 acquires the action information of the medical staff from the sensor unit 21. In S301, the information processing device 30 acquires the action information of the patient from the sensor unit 31 and acquires the examination information from the examination device 33.

[0045] In S202, the information processing device 20 transmits the action information acquired in S201 to the server 1. In S302, the information processing device 30 transmits the action information and the examination information acquired in S301 to the server 1. In S102, the server 1 receives various information transmitted from the information processing device 20 and the information processing device 30 (receiving means).

[0046] In S103, the server 1 generates display information for displaying the virtual reality space SP based on the various information acquired in S102. The server 1 functions to synchronize the actions of medical staff and patients as avatars based on the action information received from each of the information processing devices 20 and 30. Also, the server 1 causes the examination results of the examination device 33 to be displayed on the virtual reality space SP based on the examination information acquired from the examination device 33.

[0047] In S104, the server 1 transmits the display information generated in S103 to the information processing device 20 and the information processing device 30 (output means). In S204, the information processing device 20 receives the display information from the server 1. In S304, the information processing device 30 receives the display information from the server 1.

[0048] In S205, the information processing device 20 transmits the display information received in S204 to the VR device 22. The VR device 22 displays a display image based on the received display information on the display unit 221. Specifically, the control unit 223 of the VR device 22 generates an image from the perspective of a medical staff based on the display information acquired from the server 1 via the information processing device 20, and causes it to be displayed on the display unit 221.

[0049] In S305, the information processing device 30 transmits the display information received in S304 to the VR device 32. The VR device 32 displays a display image based on the received display information on the display unit 321. Specifically, the control unit 323 of the VR device 32 generates an image from the perspective of a patient based on the display information acquired from the server 1 via the information processing device 30, and causes it to be displayed on the display unit 321.

[0050] As described above, according to the present embodiment, a medical staff can perform a diagnosis while observing a patient avatar 52 synchronized with the motion information of the patient detected by the sensor unit 31. Thereby, for example, compared with an online diagnosis using a conventional videophone, etc., a medical staff can observe the state of a patient with a more face-to-face sense of presence, so that medical services such as diagnosis can be performed more effectively.

[0051] Also, in one embodiment, a patient can view a medical staff avatar 51 synchronized with the motion information of the medical staff detected by the sensor unit 21. Thereby, in medical services such as rehabilitation guidance, etc., the intention of a medical staff can be conveyed to a patient more appropriately.

[0052] Also, in one embodiment, a plurality of patient avatars 52 may be displayed in the virtual reality space SP. Thereby, for example, in rehabilitation guidance or the like, from the perspective of group psychology of patients, by recognizing others, it is possible to improve the motivation of patients and create a fun atmosphere during implementation.

[0053] <Modification Example> The present invention has been described based on the embodiments. However, the present invention is not limited to the above embodiments, and modifications may be made without departing from the spirit of the present invention. Also, the techniques described in the embodiments may be appropriately combined, or the techniques described in the above embodiments may be combined with known appropriate techniques. Examples are shown below.

[0054] The server 1 may be able to provide the VR device 22 with display information about past virtual reality spaces SP. For example, the server 1 stores the display information generated in S103 of FIG. 4 in the storage unit 12. And after the medical service using the virtual reality space SP is completed, it may be possible for medical staff to use the VR device 22 to view images of past virtual reality spaces SP.

[0055] FIG. 5 is a sequence diagram showing a processing example of the system SY, and is a sequence diagram when medical staff views an image of a past virtual reality space SP using the VR device 22.

[0056] In S211, the information processing device 20 transmits a display request for a past virtual reality space SP to the server 1. The medical staff may directly operate the information processing device 20 to transmit the display request, or may send an instruction from the VR device 22 to the information processing device 20, and the information processing device 20 that has received the instruction transmits the display request. In S111, the server 1 receives the display request.

[0057] In S112, the server 1 transmits a data list of the virtual reality space SP that can be provided to the information processing device 20. In S212, the information processing device 20 receives the data list. Here, FIG. 6 is a diagram showing a display example of the received data list of the virtual reality space SP. This data list can be displayed on a display unit such as a display included in or connected to the information processing device 20. The display unit connected to the information processing device 20 may be the display unit 221 of the VR device 22.

[0058] In S213, the information processing device 20 transmits the selection result of the past data to be displayed to the server 1. For example, a medical staff member selects the past data to be displayed from the data list by an operation unit or the like that can operate the information processing device 20. The information processing device 20 that has received the selection transmits the selection result to the server 1. In S113, the server 1 receives the selection result.

[0059] In S114, the server 1 transmits the display information of the target. In S214, the information processing device 20 receives the display information. In S215, the information processing device 20 transmits the received display information to the VR device 22.

[0060] The control unit 223 of the VR device 22 that has received the display information generates an image from the perspective of the medical staff member based on the display information and displays it on the display unit 221. For example, operations such as play, pause, fast forward, and rewind may be executable by the operation unit 226.

[0061] Also, during the provision of telemedicine services to a certain patient, it may be configured to be able to view the images of the patient during the previous provision of telemedicine services. Thereby, the comparison between the current situation and the past can be carried out more effectively.

[0062] As another modification example, the server 1 may acquire the medical records of a patient and display the acquired medical records in the virtual reality space SP. FIG. 7 is a diagram showing an example of the display of medical records. The medical record 60 may be displayed, for example, at a position close to the patient avatar 52 or the examination information 53 in the virtual reality space SP. The medical record 60 may include, for example, identification information such as the patient's name and ID, basic information, medical examination history, and the like. For example, when a medical staff member selects the basic information button 61 by the operation unit 226, the basic information of the patient may be displayed. The basic information may include gender, date of birth, past medical history, presence or absence of allergies, medication history, and various other information. Also, for example, when a medical staff member selects any one of the medical examination history lists 62 by the operation unit 226, the details of the selected medical examination history may be displayed. Note that the information shown here is illustrative, and the display content can be changed as appropriate.

[0063] Also, the server 1 acquires the information to be displayed as medical records from other devices or the like via the network NT. The other device may be, for example, a server in which a database for managing patient information in a medical facility is stored. The other device provides the necessary information to the server 1 from the information stored in the database based on a request from the server 1. By configuring in this way, medical staff can efficiently grasp the information necessary for providing telemedicine services within the virtual reality space SP, so that the provision of telemedicine services is made more efficient.

Explanation of Reference Numerals

[0064] SP Virtual reality space, SY System, 1 Server, 22 VR device, 31 Sensor unit

Claims

1. A remote medical care delivery system, comprising: A server that provides a virtual reality space; A first sensor unit that detects motion information of a patient; a first VR device used by a medical professional and having a display unit that displays the virtual reality space; Equipped with the server displays an avatar in the virtual reality space synchronized with the motion information detected by the first sensor unit. Remote medical delivery system.

2. The remote medical care delivery system according to claim 1 , The sensor unit is a motion capture unit that detects bone structure, facial expression, and gaze as the motion information. Remote medical delivery system.

3. The remote medical care delivery system according to claim 1 , Further comprising an examination device for examining the condition of the patient; The server displays the inspection information acquired from the inspection device in the virtual reality space. Remote medical delivery system.

4. The remote medical care delivery system according to claim 1 , a second sensor unit for detecting motion information of a medical worker; a second VR device used by the patient and having a display unit that displays the virtual reality space; the server displays an avatar in the virtual reality space synchronized with the motion information detected by the second sensor unit. Remote medical delivery system.

5. The remote medical care delivery system according to claim 1 , A plurality of the first sensor units are provided, the server displays, in the virtual reality space, avatars of a plurality of patients each synchronized with the motion information detected by the plurality of first sensor units. Remote medical delivery system.

6. The remote medical care delivery system according to claim 1 , the server includes a storage unit configured to store display information for displaying the virtual reality space on the first VR device; The server is capable of providing the display information about the past virtual reality space stored in the storage unit to the first VR device. Remote medical delivery system.

7. The remote medical care delivery system according to claim 1 , the server includes an acquisition unit for acquiring medical records of the patient; The server displays the medical records in the virtual reality space. Remote medical delivery system.

8. A server for providing a remote medical system, a receiving unit that receives motion information detected by a first sensor unit that detects motion information of a patient; an output unit that outputs display information for a first VR device having a display unit that displays the virtual reality space, for displaying the virtual reality space; Equipped with the first VR device is used by a medical professional; the display information includes information for displaying an avatar in the virtual reality space synchronized with the motion information received from the first sensor unit; server.

9. Computer, a receiving means for receiving motion information detected by a first sensor unit that detects motion information of a patient; an output means for outputting display information for displaying the virtual reality space by a first VR device having a display unit for displaying the virtual reality space; and The virtual reality space is used in a remote medical care delivery system, the first VR device is used by a medical professional; the display information includes information for displaying an avatar in the virtual reality space synchronized with the motion information received from the first sensor unit; program.

Citation Information

Patent Citations

  • Medical record system using patient avatars

    JP2019514105A