Epidural anesthesia support system, epidural anesthesia training method, and display device control method

Abstract

To provide an epidural anesthesia support system that improves blind epidural anesthesia to improve the safety and speediness of the epidural anesthesia.SOLUTION: An epidural anesthesia support system is used to support epidural anesthesia, and has a goggle-type display unit comprising: a transmission display part which is installed in the front direction of the eyes of a user; and an output processing part which outputs a first aerial image showing at least a part of the backbone to the transmission display part so that the first aerial image is displayed at a corresponding position of a human body model or the patient back part when the user views the human body model or patient back part through the transmission display part.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The embodiments disclosed herein relate to an epidural anesthesia assistance system, an epidural anesthesia training method, and a method for controlling a display device. [Background technology]

[0002] Epidural anesthesia is used in conjunction with general anesthesia during surgery of the chest, abdomen, pelvis, and lower extremities. The analgesic effect of epidural anesthesia is superior to that of paravertebral nerve blocks, and recent studies have shown that epidural anesthesia during surgery can reduce postoperative cognitive dysfunction and postoperative stress responses.

[0003] On the other hand, epidural anesthesia is a highly challenging procedure. Clinicians administering epidural anesthesia must feel the tip of the epidural needle with their fingers and "walk" their fingertips to determine the location of the epidural. In this way, clinicians perform the "walking" technique blindly. Therefore, when administering epidural anesthesia, clinicians need not only anatomical knowledge but also experience and intuition.

[0004] The incidence of difficult or impossible epidural catheter insertion during epidural anesthesia is approximately 7% and is as high as approximately 26% among anesthesiology trainees. Difficulty in inserting an epidural catheter can cause pain to the patient over time, and multiple epidural punctures can cause local pain to the patient. Furthermore, if the patient cannot remain still during the puncture, the risk of nerve damage due to the epidural puncture increases, and the epidural puncture procedure may have to be interrupted.

[0005] For this reason, methods for performing safe and accurate epidural anesthesia have been sought for many years. For example, Patent Document 1 and Non-Patent Document 1 describe an epidural puncture simulator for learning epidural puncture techniques. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Laid-Open No. 2002-132138 [Non-patent literature]

[0007] [Non-Patent Document 1] "Lumbar and epidural puncture simulator Lumbar-kun IIA", [online], March 18, 2022, Kyoto Scientific Co., Ltd., [Retrieved September 1, 2022], Internet <URL:https: / / www.kyotokagaku.com / jp / products_data / m43b_02 / ?utm_source=YT&utm_medium=L&utm_campaign=TR> Summary of the Invention [Problem to be solved by the invention]

[0008] However, the human body model (epidural puncture simulator) described in Patent Document 1 and Non-Patent Document 1 merely provides a method for learning how to perform blind epidural puncture. As such, the conventional human body model does not improve blind epidural puncture, nor does it further improve the safety and speed of epidural puncture.

[0009] The epidural anesthesia support system, epidural anesthesia training method, and display device control method disclosed in this specification make it possible to improve blind epidural puncture and increase the safety and speed of epidural puncture. [Means for solving the problem]

[0010] The disclosed epidural anesthesia support system is an epidural anesthesia support system for supporting epidural anesthesia, and includes a goggle-type display device that includes a human body model that imitates at least a part of a human body that is the subject of epidural anesthesia training, a transparent display unit installed in front of the user's eyes, and an output processing unit that outputs a first aerial image to the transparent display unit so that when the user looks at the human body model through the transparent display unit, a first aerial image showing at least a part of the spine is displayed at the corresponding position on the human body model.

[0011] Furthermore, in the disclosed epidural anesthesia support system, it is preferable that the human body model has a spine model that mimics at least a part of the spine, and the output processing unit outputs a first aerial image based on three-dimensional object data generated from a CT image of the spine model acquired by a CT device.

[0012] Furthermore, in the disclosed epidural anesthesia support system, it is preferable that the output processing unit outputs the second aerial image to the transparent display unit so that, when a user views the human body model through the transparent display unit, the second aerial image indicating at least one of the skin puncture point of the epidural needle used in epidural anesthesia, the puncture angle of the epidural needle, and the epidural space puncture point of the epidural needle is displayed at the corresponding position on the human body model.

[0013] Furthermore, in the disclosed epidural anesthesia support system, it is preferable that the human body model has a spine model that mimics at least a part of the spine, the output processing unit outputs a first aerial image and a second aerial image based on three-dimensional object data generated from a CT image of the spine model into which the epidural needle has been inserted, obtained by a CT device, and the epidural needle is inserted into the spine model so as to satisfy medically appropriate skin puncture point, puncture angle, and epidural space puncture point.

[0014] The disclosed epidural anesthesia support system is an epidural anesthesia support system for supporting epidural anesthesia, and includes a goggle-type display device that includes a transparent display unit installed in front of the user's eyes, and an output processing unit that outputs an aerial image to the transparent display unit so that when the user looks at the human body through the transparent display unit, an aerial image showing at least a part of the human body's spine is displayed at a corresponding position on the human body.

[0015] In addition, in the disclosed epidural anesthesia support system, it is preferable that the goggle-type display device allows the user wearing it to imagine an aerial image, and after imagining the aerial image, the user removes the goggle-type display device and performs epidural anesthesia as usual.

[0016] The disclosed epidural anesthesia training method is an epidural anesthesia training method for training epidural anesthesia using the disclosed epidural anesthesia support system, and includes a step of displaying a first aerial image on the goggle-type display device to allow a user wearing the goggle-type display device to insert an epidural needle used for epidural anesthesia into a human body model.

[0017] The disclosed epidural anesthesia training method is an epidural anesthesia training method for training epidural anesthesia using the disclosed epidural anesthesia support system, and includes the steps of: displaying a first aerial image on a goggle-type display device to allow a user wearing the goggle-type display device to insert an epidural needle into a spinal model attached to a human body model; acquiring a CT image of the spinal model into which the epidural needle has been inserted by the user; and displaying the skin puncture point, puncture angle, and epidural space puncture point of the epidural needle in the spinal model into which the epidural needle has been inserted by the user.

[0018] Furthermore, it is preferable that the disclosed epidural anesthesia training method further includes a step in which the user puts on a goggle-type display device, visualizes a first aerial image, and then removes the goggle-type display device and inserts an epidural needle into the human body model.

[0019] The disclosed control method is a control method for a display device having an image acquisition unit, a memory unit, and a transparent display unit, in which the display device stores first three-dimensional object data representing at least a portion of the shape of the surface of a specific human body and second three-dimensional object data representing at least a portion of the spine of the specific human body in the memory unit, and displays an aerial image representing at least a portion of the spine of the specific human body based on the second three-dimensional object data on the transparent display unit based on an image of the specific human body acquired by the image acquisition unit and the first three-dimensional object data. [Effects of the Invention]

[0020] The disclosed epidural anesthesia support system, epidural anesthesia training method, and display device control method make it possible to improve blind epidural puncture and increase the safety and speed of epidural puncture. [Brief explanation of the drawings]

[0021] [Figure 1] 1 is a schematic diagram for explaining an example of an overview of an epidural anesthesia support system. FIG. [Figure 2] FIG. 1 is a diagram illustrating an example of a schematic configuration of a human body model. [Figure 3] FIG. 10 is a schematic diagram showing an example of a method for generating a lumbar spine model inserted with an epidural needle. [Figure 4] FIG. 1A is a perspective view showing an example of the appearance of a wearable device, and FIG. 1B is a diagram showing an example of a schematic configuration of the wearable device. [Figure 5] FIG. 1A is a schematic diagram showing an example of a three-dimensional object, and FIG. 1B is a diagram showing an example of an aerial image displayed on a wearable device. [Figure 6] FIG. 10 is a schematic diagram for explaining the result image of epidural needle puncture training. [Figure 7] FIG. 10 is a diagram showing an example of an operation flow of an epidural anesthesia training method. DETAILED DESCRIPTION OF THE INVENTION

[0022] Various embodiments of the present invention will be described below with reference to the drawings. However, it should be noted that the technical scope of the present invention is not limited to these embodiments, but extends to the inventions set forth in the claims and their equivalents.

[0023] (Outline of Epidural Anesthesia Support System 1) 1 is a schematic diagram illustrating an example of an overview of an epidural anesthesia support system 1. The epidural anesthesia support system 1 includes a human body model 2 and a wearable device 3. The human body model 2 has a main body section 21 that imitates a human body and a skin section 22 that imitates at least a portion of the skin on the back of the human body. The main body section 21 has a housing section 23 that houses a spine model 24 that imitates at least a portion of the spine.

[0024] The wearable device 3 is a goggle-type display device that can be worn on the head of a user (such as a doctor or a medical intern). A transparent display unit is installed in the wearable device 3 so as to be positioned directly in front of the eyes of the user wearing the device. The wearable device 3 has an MR (Mixed Reality) function that displays various aerial images on the transparent display unit.

[0025] As shown in FIG. 1(b), the wearable device 3 displays an aerial image A1 of the spine model 24 at a position corresponding to the human body model 2 when a user wearing the wearable device 3 views the human body model 2 through the translucent display unit. For example, the wearable device 3 stores three-dimensional object data of a three-dimensional object D1 indicating the surface shape of the human body model 2 and three-dimensional object data of a three-dimensional object D2 indicating the surface shape of the spine model 24. The wearable device 3 also stores the relative positional relationship between the three-dimensional object D1 and the three-dimensional object D2. The wearable device 3 reads the three-dimensional object data of the three-dimensional object D1 and recognizes the shape of the human body model 2 using a known MR function to identify the real-space position of the human body model 2. The wearable device 3 displays the aerial image A1 on the translucent display unit based on the real-space position of the human body model 2, the relative positional relationship between the three-dimensional object D1 and the three-dimensional object D2, and the three-dimensional object data of the three-dimensional object D2. For example, the aerial image A1 is a hologram (stereoscopic video) corresponding to a three-dimensional object D2, and is an example of a first aerial image.

[0026] When the spine model 24 is an imitation of the lumbar vertebrae, the wearable device 3 displays an aerial image A1 representing the lumbar vertebrae at the position of the spine model 24 housed within the human body model 2 when a user wearing the wearable device 3 views the human body model 2 through the translucent display unit. This allows the user wearing the wearable device 3 to view the aerial image A1 displayed at the position corresponding to the spine model 24 housed within the human body model 2 through the translucent display unit.

[0027] Note that the aerial image A1 is not limited to being displayed based on the three-dimensional object data of the three-dimensional object D2 indicating the surface shape of the spine model 24. For example, the aerial image A1 may be displayed based on three-dimensional object data indicating the surface shape of at least a part of the spine that is generated by a trainer operating an information processing device (such as a personal computer (PC)) that can execute an application program for generating three-dimensional object data. The trainer is a person who provides training in epidural puncture to trainees, such as medical interns.

[0028] As described above with reference to Figure 1, the epidural anesthesia support system 1 includes a wearable device 3 that displays an aerial image A1 showing at least a portion of a spine in a position corresponding to at least a portion of the spine of a human body model 2. In this way, the epidural anesthesia support system 1 makes it possible to visualize the area to be targeted for epidural puncture, improving blind epidural puncture and making it safer and faster to perform epidural puncture.

[0029] The above description of Fig. 1 is merely provided to deepen understanding of the present invention. The present invention is specifically embodied in the following embodiments, and may be embodied in various modifications without substantially departing from the principles of the present invention. All such modifications are included within the scope of the present invention and the disclosure of this specification.

[0030] (Human Body Model 2) 2 is a diagram showing an example of a schematic configuration of the human body model 2. The human body model 2 has a spine model 24, a skin part 22, a cord part 25, and the like.

[0031] The main body 21 shown in Fig. 2 has a waist portion that imitates the waist of a human body. The main body 21 is not limited to a waist portion, and may further have a back portion that imitates the back of a human body and / or a buttocks that imitate the buttocks of a human body. Furthermore, the main body 21 may have only one of the back portion and the buttocks. Furthermore, the main body 21 may include models that imitate other parts of a human body (for example, a neck that imitates a neck, upper arms that imitate upper arms, and / or thighs that imitate thighs, etc.).

[0032] The skin part 22 is made of a soft synthetic resin that imitates the skin and subcutaneous tissue, and is configured so that the softness and feel when palpated by a user are similar to that of human skin. The storage part 23 is a recessed groove provided on the back surface of the human body model 2, and stores the spine model 24.

[0033] The spine model 24 is a model that simulates at least the spinous processes and the epidural space. The spine model 24 shown in FIG. 2(b) is a model that simulates the lumbar vertebrae of the spine. The spine model 24 is not limited to a model that simulates the lumbar vertebrae, but may be a model that simulates the cervical vertebrae, thoracic vertebrae, or sacral vertebrae. The spine model 24 may also be a model that simulates two or more of the cervical vertebrae, thoracic vertebrae, lumbar vertebrae, and sacral vertebrae.

[0034] The spine model 24 is housed in the housing 23 (FIG. 2(b)) and covered by the skin part 22 (FIG. 2(a)) so as not to be visible to the user. A user who is not wearing the wearable device 3 cannot see the spine model 24, and therefore blindly trains in the epidural puncture procedure using the human body model 2. In this way, the human body model 2 is a model that imitates at least a part of a human body that is the subject of epidural anesthesia training, and the spine model 24 is housed in the human body model 2 and is a model that imitates at least a part of a spine that is the subject of epidural puncture in epidural anesthesia. Details of the spine model 24 will be described later.

[0035] The code portion 25 is, for example, a QR code (registered trademark), and is associated with the three-dimensional object data of the three-dimensional object D1 and the three-dimensional object D2. Other barcode information such as an AR marker may be used as the code portion 25. How to use the code portion 25 will be described later.

[0036] As a component of the human body model 2 other than the cord unit 25, for example, a known epidural puncture simulator ("Lumbar Epidural Puncture Simulator Lumbar-kun IIA," March 18, 2022, Kyoto Scientific Co., Ltd., [searched September 1, 2022], Internet <URL:https: / / www.kyotokagaku.com / jp / products_data / m43b_02 / ?utm_source=YT&utm_medium=L&utm_campaign=TR> ) may also be used.

[0037] (Spine model 24 inserted with epidural needle N) FIG. 3 is a schematic diagram showing an example of a method for generating a spine model 24 inserted with an epidural needle N. The spine model 24 inserted with an epidural needle N is used to create three-dimensional object data. The epidural needle N inserted into the spine model 24 corresponds to three-dimensional object data for displaying an aerial image A2 showing at least one of the skin puncture point of the epidural needle N, the puncture angle of the epidural needle N, and the epidural space puncture point of the epidural needle N. The spine model 24 inserted with the epidural needle N is created by a trainer. The aerial image A2 is an example of a second aerial image.

[0038] As shown in FIG. 3(a), the spine model 24 has a spinous process portion 241, a transparent portion 242, and an epidural space portion 243. The spinous process portion 241 is modeled after a spinous process and is made of synthetic resin with the same hardness as a spinous process. The transparent portion 242 is made of transparent silicone or the like that is configured to generate a resistance similar to that of an interspinous ligament when the epidural needle N is inserted, allowing the inserted epidural needle N to be visually confirmed. Note that when the epidural needle N is inserted into the transparent portion 242, the puncture position of the epidural needle N on the upper surface of the transparent portion 242 is sometimes referred to as the skin puncture point. The epidural space portion 243 is a hollow tubular body that constitutes the epidural space. In the example shown in Figure 3, the upper side of the epidural space portion 243 resembles the ligamentum flavum, and the point at which the epidural needle N inserted into the transparent portion 242 reaches the upper side of the epidural space portion 243 is the epidural space puncture point.

[0039] Next, as shown in Figure 3(b), the trainee inserts the epidural needle N into the spine model 24. The epidural needle N is inserted into the spine model 24 so as to satisfy medically appropriate skin puncture points, puncture angles, and epidural space puncture points. The puncture angle is, for example, the angle θ between a line passing through the skin puncture point and the epidural space puncture point and an axis passing through the upward direction in Figure 3(b).

[0040] Next, as shown in Figure 3(c), the trainer cuts the epidural needle N extending from the upper side of the epidural space portion 243, thereby completing the spine model 24 inserted with the epidural needle N. Note that the spine model 24 inserted with the epidural needle N may be the one in the state in which the epidural needle N is inserted before cutting (Figure 3(b)).

[0041] (3D object data) An example of a method for creating three-dimensional object data will be described below. The trainee places the spinal model 24, into which the epidural needle N has been inserted, in the human body model 2, and acquires a CT image of the human body model 2 using a CT (Computed Tomography) device (not shown).

[0042] Next, the trainee uses an information processing device (not shown) such as a PC capable of executing a three-dimensional object data generation application program to generate three-dimensional object data of three-dimensional object D1 and three-dimensional object D2 from the CT image of the human body model 2. A known application program ("Unity Pro" (registered trademark)) may be used as the three-dimensional object data generation application program.

[0043] For example, for each CT image of the human body model 2, the information processing device identifies pixel P1 corresponding to the surfaces of the main body 21 and the skin 22, pixel P2 corresponding to the surfaces of the spinous process 241 and / or the epidural space 243 of the spine model 24, and pixel P3 corresponding to the surface of the epidural needle N. Next, the information processing device generates three-dimensional object data by a known conversion process using the identified pixels P1 to P3 in all of the CT images. The three-dimensional object data of the three-dimensional object D1 is generated based on pixel P1, and the three-dimensional object data of the three-dimensional object D2 is generated based on pixel P2. Furthermore, the three-dimensional object data of the three-dimensional object D3 indicating the shape of the surface of the epidural needle N is generated based on pixel P3.

[0044] The three-dimensional object D3 is not limited to one that represents the shape of the surface of the epidural needle N itself. For example, the three-dimensional object D3 may be a spherical object corresponding to the skin puncture point of the epidural needle N, or a spherical object that represents the epidural space puncture point of the epidural needle N. Furthermore, the line segment object corresponding to the epidural needle N may be designed as an arrow. In this case, the direction of the arrow indicates the puncture direction. The three-dimensional object D3 may include multiple of each of the objects exemplified above.

[0045] (Wearable device 3) FIG. 4(a) is a perspective view showing an example of a wearable device 3, and FIG. 4(b) is a diagram showing an example of a schematic configuration of the wearable device 3. The wearable device 3 is a goggle-type display device that can be worn on the head of a user, and has an MR (Mixed Reality) function that displays various aerial images on a half mirror unit 36 ​​installed in the front direction (x direction) of the eyes of the user wearing the device. To realize such a function, the wearable device 3 includes a communication I / F 31, a memory unit 32, a sensor acquisition unit 33, a video output unit 34, a processing unit 35, a half mirror unit 36, an environmental sensor 37, a depth sensor 38, etc. Examples of the wearable device 3 include a well-known MR HMD (Head Mounted Display) (for example, "Microsoft HoloLens 2," [searched September 1, 2022], available on the Internet).<URL:https: / / www.microsoft.com / ja-jp / hololens / > ) may also be used.

[0046] The communication I / F 31 includes a communication interface circuit that performs wireless communication with an access point of a wireless LAN (Local Area Network) (not shown) based on the wireless communication method of the Institute of Electrical and Electronics Engineers, Inc. (IEEE) 802.11 standard. The communication I / F 31 receives three-dimensional object data transmitted by wireless communication from an information processing device. The communication I / F 31 may also establish a wireless signal line with a base station (not shown) using a Long Term Evolution (LTE) method, a fifth-generation (5G) mobile communication system, or the like via a channel assigned by the base station, and perform communication with the base station. The communication I / F 31 may also have an interface circuit for performing short-range wireless communication using a communication method such as Bluetooth (registered trademark), and may receive radio waves from the information processing device. The communication I / F 31 may also include a communication interface circuit for a wired LAN. This allows the wearable device 3 to acquire three-dimensional object data (three-dimensional object data of three-dimensional object D1, three-dimensional object data of three-dimensional object D2, and three-dimensional object data of three-dimensional object D3) from the information processing device via the communication I / F 31.

[0047] The storage unit 32 is a semiconductor memory device such as a read-only memory (ROM) or a random-access memory (RAM). The storage unit 32 stores an operating system program, driver programs, application programs, data, and the like used for processing in the processing unit 35. The driver programs stored in the storage unit 32 include a communication device driver program that controls the communication I / F 31, an output device driver program that controls the video output unit 34, an environment sensor device driver program that controls the environment sensor 37, and a depth sensor device driver program that controls the depth sensor 38. The application programs stored in the storage unit 32 are various control programs for causing the processing unit 35 to realize the MR function. Furthermore, the storage unit 32 stores three-dimensional object data (three-dimensional object data of three-dimensional object D1, three-dimensional object data of three-dimensional object D2, and three-dimensional object data of three-dimensional object D3) acquired from the information processing device.

[0048] The sensor acquisition unit 33 has a function of acquiring various sensor data from the environmental sensor 37 and the depth sensor 38 and passing it to the processing unit 35. The video output unit 34 has a function of projecting a hollow image onto the half mirror unit 36 ​​using a holographic optical element based on display data for displaying the hollow image.

[0049] The processing unit 35 is a processing device that loads the operating system program, driver program, and application program stored in the storage unit 32 into memory and executes instructions included in the loaded programs. The processing unit 35 is, for example, an electronic circuit such as a central processing unit (CPU), a micro processing unit (MPU), or a digital signal processor (DSP), or a combination of various electronic circuits. Although the processing unit 35 is illustrated as a single component in FIG. 4(b), the processing unit 35 may be a collection of multiple physically separate processors.

[0050] The processing unit 35 executes various commands included in the control program to function as a recognition unit 351 and an output processing unit 352. The functions of the recognition unit 351 and the output processing unit 352 will be described later.

[0051] The half mirror unit 36 ​​is an example of a transmissive display unit that is placed in front of the user's eyes when the wearable device 3 is worn by the user. The half mirror unit 36 ​​displays the hollow image projected from the video output unit 34. This allows the user to view the displayed hollow image superimposed on the real world in the user's line of sight.

[0052] The environmental sensor 37 includes an optical lens and an image sensor. The optical lens focuses a light beam from the subject on the imaging surface of the image sensor. The image sensor is a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS), and outputs an image of the subject focused on the imaging surface. The environmental sensor 37 creates still image data in a predetermined file format from the image generated by the image sensor and outputs the data as environmental sensor data. When outputting the environmental sensor image data, the environmental sensor 37 may associate the image data with the time of acquisition. The environmental sensor 37 also passes the environmental sensor data to the processing unit 35 at predetermined intervals (e.g., every second).

[0053] The depth sensor 38 is, for example, a pair of infrared sensors. The depth sensor 38 outputs an infrared image, measures distances corresponding to multiple points on the surface of an object from the output infrared image using a known active stereo method, and outputs depth data (distance data) corresponding to each of the multiple points. The depth sensor 38 passes the depth data to the processing unit 35 every predetermined time (for example, every second).

[0054] An example of the functions of the recognition unit 351 and the output processing unit 352 will be described below.

[0055] Each time the recognition unit 351 receives environmental sensor data from the environmental sensor 37 and depth data from the depth sensor 38, it estimates its own position and generates 3D mesh data of the surfaces of surrounding objects using the well-known SLAM (Simultaneous Localization And Mapping) technique.

[0056] Furthermore, the recognition unit 351 determines whether or not the code portion 25 is included in the image displayed by the environmental sensor data from the environmental sensor 37. If the recognition unit 351 determines that the code portion 25 is included in the image, it acquires three-dimensional object data corresponding to the code portion 25 and passes the data to the output processing unit 352. Furthermore, the recognition unit 351 calculates the orientation (e.g., a three-dimensional unit vector) and distance of the code portion 25 relative to the wearable device 3 based on the size and shape of the code portion 25 in the image. Note that a known calculation method (e.g., JP 2016-57758 A) may be used as the process of calculating the orientation and distance of the target object based on the size and shape of a reference display object such as the code portion 25.

[0057] The output processing unit 352 calculates three-dimensional objects D1, D2, and D3, which are three-dimensional objects D1 based on the three-dimensional object data acquired from the recognition unit 351, by rotating and resizing the three-dimensional objects D1, D2, and D3 based on the orientation and distance of the code portion 25 acquired from the recognition unit 351. Fig. 5(a) is a schematic diagram showing examples of the three-dimensional objects D1, D2, and D3. Note that Fig. 5(a) includes the code portion 25 for the sake of explanation, but the acquired three-dimensional object data does not necessarily include object data corresponding to the code portion 25.

[0058] The output processing unit 352 intermittently aligns the 3D mesh data of the surface of the object corresponding to the human body model 2 output from the recognition unit 351 with the identified 3D object D1, and passes display data (projection data) of the aerial image A1 corresponding to the 3D object D2 and the aerial image A2 corresponding to the 3D object D3 to the video output unit 34.

[0059] The user can view the real world ahead while viewing the aerial images A1 and A2 based on the display data (projection data) created in this manner on the half mirror unit 36. Fig. 5(b) is a diagram showing an example of the aerial images A1 and A2 displayed on the half mirror unit 36. Thereafter, the aerial images A1 and A2 are displayed moving and / or rotating in accordance with the result of alignment between the identified three-dimensional object D1 and the three-dimensional mesh data of the surface of the object corresponding to the human body model 2, which is intermittently performed by the recognition unit 351.

[0060] While wearing the wearable device 3 displaying the aerial images A1 and A2, the user trains to insert the epidural needle N into the human body model 2. After the training is completed, the trainer removes the punctured spine model 24 from the human body model 2 after the user has inserted the epidural needle N, and acquires a CT image using a CT device. Then, using an information processing device, the trainer generates and displays a result image of the puncture training that includes both an image R1 of the epidural needle N that satisfies the medically appropriate skin puncture point, puncture angle, and epidural space puncture point, and an image R2 of the epidural needle N inserted by the user.

[0061] FIG. 6 is a diagram illustrating the result of training for puncturing the epidural needle N. FIG. 6(a) is a diagram showing the top surface of the spine model 24, and the position indicating the skin puncture point is displayed. In FIG. 6(a), the position of the "x" indicates the position of the skin puncture point in image R1, and the position of the "o" indicates the position of the skin puncture point in image R2. FIG. 6(b) is a diagram seen from the side of the spine model 24, and the puncture angle is displayed. In FIG. 6(b), an image R1 of the epidural needle N and an image R2 of the epidural needle N are displayed. FIG. 6(c) is a diagram showing the top surface of the epidural space portion 243, and the position indicating the epidural space puncture point is displayed. In FIG. 6(c), the position of the "x" indicates the position of the epidural space puncture point in image R1, and the position of the "o" indicates the position of the epidural space puncture point in image R2. In this way, it is possible to present to the user an image R1 of the epidural needle N that meets the medically appropriate skin puncture point, puncture angle, and epidural space puncture point, in contrast to an image R2 of the epidural needle N that has been punctured by the user.

[0062] FIG. 7 is a diagram showing an example of an operation flow of the epidural anesthesia training method.

[0063] First, when the user looks at the human body model 2 through the half mirror unit 36 ​​after putting on the wearable device 3, the aerial image A1 and / or the aerial image A2 is displayed on the half mirror unit 36 ​​(step S101).

[0064] Next, the user performs a first training session of inserting the epidural needle N into the human body model 2 while wearing the wearable device 3 displaying the aerial image A1 and the aerial image A2 (step S102). During the first training session, the user visualizes the aerial image A1 and / or the aerial image A2 displayed by the wearable device 3.

[0065] Next, after the user has inserted the epidural needle N for the first time, the trainee removes the inserted spine model 24 from the human body model 2 and obtains a CT image using the CT device (step S103).

[0066] Next, the user performs a second training session of inserting the epidural needle N into the human body model 2 without wearing the wearable device 3 (step S104).

[0067] Next, after the user has inserted the epidural needle N for the second time, the trainee removes the inserted spine model 24 from the human body model 2 and obtains a CT image using the CT device (step S105).

[0068] Then, the trainer uses an information processing device to generate and display an image of the results of the puncture training, which includes both an image R1 of the epidural needle N that satisfies the medically appropriate skin puncture point, puncture angle, and epidural space puncture point, and an image R2 of the epidural needle N that has been punctured by the user (step S105), and the epidural anesthesia training method is completed.

[0069] As described above in detail, the epidural anesthesia support system 1 of this embodiment includes a wearable device 3 that displays an aerial image A1 representing the spine at a position corresponding to the spine of the human body model 2. In this way, the epidural anesthesia support system 1 makes it possible to visualize the area to be targeted for epidural puncture, improving blind epidural puncture and making it safer and faster to perform epidural puncture.

[0070] (Variation 1) It should be noted that the present invention is not limited to this embodiment. For example, the epidural anesthesia support system 1 does not necessarily include the human body model 2. In this case, the wearable device 3 projects the aerial image A1 onto the half mirror unit 36, instead of the human body model 2, so that the aerial image A1 showing at least a part of the spine of a human body such as a patient is displayed at a position corresponding to at least a part of the spine of the human body.

[0071] For example, the trainer acquires a CT image of the human body (patient) using a CT device (not shown). Next, the trainer uses an information processing device (not shown), such as a PC, capable of executing a three-dimensional object data generation application program, to generate, from the CT image of the human body, three-dimensional object data of a three-dimensional object D1 representing at least a portion of the shape of the surface of the human body (e.g., the torso (back, waist, and buttocks)) and three-dimensional object data of a three-dimensional object D2 representing the shape of at least a portion of the spine of the human body. In this case, the trainer manually generates three-dimensional object data of a three-dimensional object D3. The storage unit 32 stores the three-dimensional object data of the three-dimensional object D1, the three-dimensional object data of the three-dimensional object D2, and the three-dimensional object data of the three-dimensional object D3 acquired from the information processing device.

[0072] The storage unit 32 stores the shape of the three-dimensional object D1 and the code portion 25 displayed on a sheet member placed on the back of the human body in association with each other. In a case where a sheet member on which the code portion 25 is displayed is not provided on the human body, the storage unit 32 stores the shape of the three-dimensional object D1 and the position of at least some characteristic parts of the vertebrae of the human body in association with each other. The three-dimensional object data of the three-dimensional object D1 is an example of first three-dimensional object data, and the three-dimensional object data of the three-dimensional object D2 is an example of second three-dimensional object data. In addition, the at least some characteristic parts of the vertebrae of the human body associated with the shape of the three-dimensional object D1 are, for example, the seventh cervical vertebra (vertebral prominence) and the anterior superior iliac spine.

[0073] When the sheet member on which the code portion 25 is displayed is placed on the human body, the recognition unit 351 calculates the orientation (e.g., a three-dimensional unit vector) and distance of the code portion 25 relative to the wearable device 3 using a known calculation method, based on the size and shape of the code portion 25 in the image shown by the environmental sensor data from the environmental sensor 37. Then, the output processing unit 352 calculates three-dimensional objects D1, D2, and D3, which are three-dimensional objects D1 based on the three-dimensional object data acquired from the recognition unit 351, and which have been rotated and resized based on the orientation and distance of the code portion 25 acquired from the recognition unit 351.

[0074] When a sheet member bearing the code section 25 is not placed on the human body, the recognition unit 351 recognizes the position of at least some characteristic parts of the vertebrae of the human body and identifies the human body based on the relative positions of the characteristic parts and the shape of the surface of the torso of the human body. For example, the recognition unit 351 determines whether at least some characteristic parts of the vertebrae of the human body are included in an image displayed by environmental sensor data from the environmental sensor 37. The environmental sensor 37 is an example of an image acquisition unit. If the recognition unit 351 determines that at least some characteristic parts of the vertebrae of the human body are included in the image, it acquires a three-dimensional object D1 associated with the positions of the characteristic parts and passes it to the output processing unit 352. Furthermore, based on the positions of at least some characteristic parts of the vertebrae in the image, the recognition unit 351 calculates the orientation (e.g., a three-dimensional unit vector) and distance of the characteristic parts relative to the wearable device 3 using a known calculation method. The output processing unit 352 calculates three-dimensional object D1, three-dimensional object D2, and three-dimensional object D3, which are three-dimensional object D1 based on the three-dimensional object data acquired from the recognition unit 351, by rotating and changing the size based on the orientation and distance of the characteristic points acquired from the recognition unit 351.

[0075] Thereafter, the output processing unit 352 intermittently aligns the 3D mesh data of the surface of the object corresponding to the human body model 2 output from the recognition unit 351 with the 3D object D1, while passing display data (projection data) of the aerial image A1 corresponding to the 3D object D2 and / or the aerial image A2 corresponding to the 3D object D3 to the video output unit 34. In this way, the epidural anesthesia support system 1 and the wearable device 3 can superimpose the aerial image A1 and / or the aerial image A2 corresponding to the vertebrae of the human body onto the human body, thereby encouraging the user to understand the shape of the vertebrae of the human body and enabling the user to visualize the aerial image A1 and / or the aerial image A2 displayed by the wearable device 3. After imaging the aerial image A1 and / or the aerial image A2, the user can remove the wearable device 3 and perform epidural anesthesia as usual.

[0076] Furthermore, in Modification 1, when the human body (patient) performs an action that deforms the surface of the lumbar region (such as "twisting the waist" or "bending the waist"), the three-dimensional object D2 of the corresponding spine may be deformed in accordance with the change in the surface of the lumbar region of the human body. For example, multiple points of the three-dimensional object D2 may be associated with the positions of the three-dimensional object D1 closest to each point, and the output processing unit 352 may deform the three-dimensional object D1 in synchronization with the deformation of the lumbar region of the human body, and move the multiple corresponding points of the three-dimensional object D2 to follow the deformation of the three-dimensional object D1, thereby deforming the aerial image A1 corresponding to the spine.

[0077] (Variation 2) In step S104 of the epidural anesthesia training method shown in Figure 7, the user may perform a second training session to insert the epidural needle N into the human body model 2 while wearing the wearable device 3 displaying the aerial images A1 and A2. [Explanation of symbols]

[0078] 1. Epidural anesthesia support system 2 Human body model 21 Main body 22 Skin area 23 Storage unit 24 spine models 241 spinous process 242 Transparent part 243 Epidural space 25 Code section 3. Wearable devices 31 Communication I / F 32 Storage section 33 Sensor acquisition unit 34 Video output section 35 Processing section 351 Recognition part 352 Output Processing Unit 36 Half mirror part 37 Environmental Sensors 38 Depth Sensor N epidural needle

Claims

1. 1. An epidural anesthesia support system for supporting epidural anesthesia, comprising: a human body model that imitates at least a part of a human body that is a training target for epidural anesthesia; a transmissive display unit disposed in front of the user's eyes; an output processing unit that outputs a first aerial image to the transparent display unit so that, when the user views the human body model through the transparent display unit, a first aerial image showing at least a part of a spine is displayed at a corresponding position on the human body model, and that outputs a second aerial image to the transparent display unit so that a second aerial image showing at least one of a skin puncture point of an epidural needle used for epidural anesthesia, a puncture angle of the epidural needle, and an epidural space puncture point of the epidural needle is displayed at a corresponding position on the human body model; and and the human body model includes a spine model that imitates at least a part of the spine, the output processing unit outputs the first aerial image and the second aerial image based on three-dimensional object data generated from a CT image of the spine model inserted with the epidural needle, the CT image being acquired by a CT device; The epidural needle is inserted into the spinal model so as to satisfy medically appropriate skin puncture points, puncture angles, and epidural space puncture points. An epidural anesthesia support system characterized by:

2. 2. An epidural anesthesia training method for training epidural anesthesia using the epidural anesthesia assistance system according to claim 1, comprising: displaying the first aerial image on the goggle-type display device to allow the user wearing the goggle-type display device to insert the epidural needle used for epidural anesthesia into the human body model; Epidural anesthesia training method including:

3. the user wearing the goggle-type display device to visualize the first aerial image, then removing the goggle-type display device, and inserting the epidural needle into the human body model; 3. The epidural anesthesia training method of claim 2, further comprising:

4. 2. An epidural anesthesia training method for training epidural anesthesia using the epidural anesthesia assistance system according to claim 1, comprising: displaying the first aerial image on the goggle-type display device to allow the user wearing the goggle-type display device to insert the epidural needle into the spinal model attached to the human body model; acquiring the CT image of the spinal model into which the epidural needle has been inserted by the user; displaying the skin puncture point, the puncture angle, and the epidural space puncture point of the epidural needle in the spinal model where the epidural needle has been inserted by the user; Epidural anesthesia training method including:

5. the user wearing the goggle-type display device to visualize the first aerial image, then removing the goggle-type display device, and inserting the epidural needle into the human body model; 5. The epidural anesthesia training method of claim 4, further comprising:

Images