Mixed reality system, associated medical training garment and associated medical training kit
Patent Information
- Application Number
- PCT/EP2026/055097
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-02-26
- Filing Date
- 2026-02-25
- Publication Date
- 2026-09-03
Smart Images

Figure EP2026055097_03092026_PF_FP_ABST
Abstract
Description
[0001] DESCRIPTION
[0002] TITLE: MIXED REALITY SYSTEM, MEDICAL TRAINING WEAR AND ASSOCIATED MEDICAL TRAINING KIT
[0003] FIELD OF INVENTION
[0004] The invention relates to the technical field of mixed reality systems, medical training clothing and associated medical training kits.
[0005] TECHNOLOGICAL BACKGROUND OF THE INVENTION
[0006] Medical simulation is a teaching method used to train current and future healthcare professionals in their respective fields. Medical simulation is playing an increasingly important role in medical training and can achieve varying levels of realism depending on the technological sophistication of the training equipment used. High-fidelity simulation is the most realistic level of simulation. It typically uses high-fidelity mannequins packed with electronics, which are highly effective but also expensive, complex to operate, and require significant additional infrastructure. This limits access to high-fidelity training to a few highly specialized centers in each country, while a large number of people who would be eligible each year cannot access these specialized centers.
[0007] In the absence of readily available immersive training materials, instructors often use low-fidelity mannequins for their training sessions because these are simpler to use and cheaper. However, they unfortunately do not allow for full learner immersion during simulation-based training.
[0008] The general problem addressed by the invention is to increase the effectiveness of medical training, using a solution that is both relatively simple and reasonably priced.
[0009] The solution proposed by the invention will easily enhance the immersive power of low-fidelity mannequins, making healthcare professional training accessible both practically and financially. This solution is based on a connected textile envelope equipped with pressure and position sensors which, once placed on a training mannequin or a human, bridges the gap between the physical world and virtual reality using realistic and immersive feedback, which can include haptic feedback. Thus, the learner can perform training procedures on a real physical mannequin while being fully immersed in a realistic visual and auditory virtual environment facing a patient, even though this training would otherwise be unsuitable or irrelevant.
[0010] The invention relates to the general field of medical training and the simulation of a medical situation. This type of medical training can be carried out on a mannequin or on a human being using certain accessories that allow an action to be exerted on this mannequin or human being, and the effect of this action to be analyzed and visualized, either in real time for immediate correction or in delayed time for more in-depth analysis.
[0011] Two preferred medical training applications are, on the one hand, cardiac massage, performed on a mannequin, and on the other hand, stopping a hemorrhage, on the arm, on the leg or on the abdomen, either of a mannequin, or of a human being, playing the role of the accident victim to whom a user, a learner in a training situation, for example medical personnel or personnel in medical studies, will have to provide emergency care.
[0012] The mixed reality system combining:
[0013] on the one hand, a real or partially real device at the level of the action performed by the user, for example, pressures exerted during the simulation of cardiac massage or the cessation of external bleeding,
[0014] and on the other hand, a partially virtual device in terms of rendering the effect of the user's action, for example, the movements of the mannequin's rib cage, or the flow rate of blood at the (fictitious) wound of the mannequin or human being,
[0015] This allows for more effective medical training because it is more realistic and immersive. According to prior art, for example described in US patent 10854098, a mixed reality system is known in which a mannequin incorporating pressure sensors is coupled with an augmented reality headset connected to a camera. The augmented reality headset synthesizes, on the one hand, the real images from the camera, including the mannequin and its environment, and on the other hand, additional information from the mannequin's pressure sensors, which includes the actions of the mixed reality system user. This information is superimposed on the real camera images to display an augmented reality image that corresponds to a real scene image (mannequin with its environment) incorporating additional virtual information representative of the mixed reality system user's actions.A double disadvantage of this earlier art, resulting in the dispersion of the user's attention in the augmented reality system, which is then no longer focused on the medical training gestures to be performed (with the hands) and controlled (with the eyes), lies:.
[0016] Firstly, there is the difficulty in combining, in a truly well-synchronized and integrated way, the real images with the additional virtual images, when the scene has to be rendered in 3D or in real time, a difficulty even greater when the scene has to be rendered in 3D and in real time,
[0017] to create high-quality augmented reality images, allowing the user's attention to remain focused on the medical training they are performing, instead of being diverted by the additional work of interpreting a low-quality augmented reality image.
[0018] and then, the difficulty in rendering it in a truly realistic and truly immersive way, at the same time:
[0019] o On the one hand, the image displayed by the augmented reality headset, in particular the display of the mannequin and its environment,
[0020] and, on the other hand, the gestures performed by the user of the augmented reality system, in particular the pressure exerted by the user on the mannequin's pressure sensors,
[0021] leading to further difficulties in displaying an augmented reality image of sufficient quality, moreover at the cost of using an expensive and sophisticated mannequin with pressure sensors directly integrated into or on the mannequin, especially when the scene has to be rendered in 3D or in real time, and even more so when the scene has to be rendered in 3D and in real time, hindering or preventing the mixed reality system user's attention from remaining focused on the medical training they are performing, by diverting it with the additional work of interpreting an augmented reality image of insufficient quality.
[0022]
[0023] OF THE INVENTION
[0024] The aim of the present invention is to provide a mixed reality system that at least partially overcomes the aforementioned drawbacks.
[0025] The solution proposed by the invention lies mainly in the combination of: on the one hand, the use of a virtual reality headset displaying a completely virtual image (therefore not combining a real camera image and augmented reality) which includes both the part of the mannequin or human being concerned by the medical training, the action or the effect of the action performed by the user of the mixed reality system integrating the virtual reality headset (and not augmented reality), as well as the environment of the mannequin or human being, this image then being homogeneous and of good quality, even when the image is displayed in 3D and / or in real time, the homogeneous nature of the image contributing significantly to improving the immersive nature of the display,
[0026] and on the other hand, a garment that integrates pressure sensors, thus allowing the use of either a simple mannequin, or even a passive and inert mannequin, or a human being, without sacrificing either the immersive and realistic nature of the display produced by the virtual reality headset, or the quality of the virtual image displayed by this virtual reality headset, even when the image is displayed in 3D and in real time, in particular because the display in pure virtual reality (as opposed to augmented reality) is more tolerant of the relative positioning of the garment in relation to the mannequin or the human being wearing this garment than would be an augmented reality display, in particular because of the necessary recalibration between real image (mannequin or human being and its environment) and virtual image (effect of the user's action, such as the evolution of a hemorrhage).
[0027] The images are preferably 3D (in 3 dimensions). The 3D images are generated and displayed, in particular by the virtual reality headset, in three dimensions and in stereoscopy, this stereoscopy being obtained by displaying a different image for each eye, the image of the left eye then being seen from a slightly different angle from the image of the right eye, so as to offer the wearer of the virtual reality headset this stereoscopic vision (as in reality), in order to allow them a better perception of relief and distances within the scene represented by the two images displayed (that of the right eye and that of the left eye).
[0028] The images are preferably real-time images.
[0029] The sensors are preferentially located inside the garment, between two layers of fabric.
[0030] To this end, the present invention proposes a mixed reality system, comprising a medical training garment and a virtual reality headset, and combining:
[0031] on the one hand, medical training garments for use on mannequins or humans, including a pressure detection zone incorporating one or more pressure sensors, such that:
[0032] ■ when a part of a mannequin or a human being is clothed in said garment,
[0033] ■ when a pressure force is exerted on a support area on said garment, in said pressure detection area of said garment, ■ one or more pressure signals, representative of on the one hand the position of said support area and on the other hand the intensity of said pressure force exerted on said support area, is or are generated by one or more of said pressure sensors, as well as the possible evolution over time of said pressure signal(s), with on the other hand, the virtual reality headset displaying images:
[0034] o which are visible to the helmet wearer
[0035] o which are representative:
[0036] ■ of the said position of the said support zone, and of its possible evolution over time,
[0037] ■ of the said intensity of the said pressure force exerted on the said support area, and of its possible evolution over time, o which represent the action and / or the effect of the action corresponding to the said pressure force exerted on the said support area, as well as the possible evolution over time of the said action and / or the said effect of the action, in the form of a virtual figurative representation simultaneously including at least:
[0038] ■ a figurative and virtual representation of a victim corresponding to the mannequin or human part wearing the medical training garment,
[0039] ■ a figurative and virtual representation of said action and / or said effect of the action on the part of the mannequin or human being wearing the medical training garment,
[0040] ■ a figurative and virtual representation of a victim's environment corresponding to the part of a mannequin or human being wearing medical training clothing,
[0041] o and which are derived from the pressure signal(s) generated by the pressure sensor(s), as well as from the possible evolution over time of the pressure signal(s). According to preferred embodiments, the invention comprises one or more of the following features which can be used separately or in partial combination with each other or in total combination with each other, with one or the other of the aforementioned objects of the invention.
[0042] Preferably:
[0043] The mixed reality system also includes a processing unit that transforms said pressure signal(s) generated by the pressure sensor(s) into images displayed by the processing unit on an interface of the processing unit, and / or the virtual reality headset transforms said pressure signal(s) generated by the pressure sensor(s) into said images displayed by the virtual reality headset.
[0044] Thus, in the chain of transmission and / or transformation from the signals generated by the pressure sensors of the garment to the images displayed by the virtual reality headset, part of the work is done by a processing unit and part of the work is done by the virtual reality headset.
[0045] Preferably:
[0046] The mixed reality system also includes a processing unit that transforms the pressure signal(s) generated by the pressure sensor(s) into images displayed by the processing unit on an interface of the processing unit; the virtual reality headset displays the images received from the processing unit.
[0047] Thus, in the transmission and / or transformation chain from the signals generated by the garment pressure sensors to the images displayed by the virtual reality headset, the bulk of the work is done by the processing unit.
[0048] The processing unit becomes more complex, while the virtual reality headset becomes simpler.
[0049] Preferably:
[0050] the images transformed by said processing unit:
[0051] o are visible via a human-machine interface of the processing unit, preferably on a screen of the processing unit,
[0052] o are modifiable, and / or movable and / or reorientable, via the processing unit interface, preferably via a keyboard and / or mouse and / or joystick of the processing unit,
[0053] o are representative of: ■ the said position of the said support zone, and of its possible evolution over time,
[0054] ■ of the said intensity of the said pressure force exerted on the said support area, and of its possible evolution over time, o represent, in figurative form, the action and / or the effect of the action corresponding to the said pressure force exerted on the said support area, as well as the possible evolution over time of the said action and / or the said effect of the action,
[0055] and are derived from the pressure signal(s) generated by the pressure sensor(s), as well as from the possible evolution over time of the pressure signal(s).
[0056] Thus, independently of the images displayed by the virtual reality headset, visible to the wearer of the virtual reality headset, the processing unit also displays images on its human-machine interface, most often on its screen, these images being identical, similar or different from those displayed by the virtual reality headset, these images being able to be modified, both the position and the orientation of the part shown or enlarged in the scene represented.
[0057] Thus the user of the processing unit, who will be different from the wearer of the virtual reality headset, who will be for example a teacher, can show identical, similar and different images, with the position and / or orientation of the part shown and / or enlarged in the scene represented, so as to explain or correct, for example for spectators different from the wearer of the virtual reality headset, the action performed by the wearer of the virtual reality headset.
[0058] Preferably:
[0059] The virtual reality headset also includes a system for detecting the position and / or orientation of the headset, attached to said headset, so that one or more complementary signals, representative of the frequency of said pressure force exerted on said support area and / or possibly also of the intensity of said pressure force exerted on said support area:
[0060] o are generated by the virtual reality headset, from the evolution over time of the position of said position sensor which is representative of the movements of said headset over time, as well as the possible evolution over time of said or said complementary signals, o and are combined with said or said pressure signals from the pressure sensor(s) to obtain said images displayed by the virtual reality headset and / or to obtain said additional images displayed by the human machine interface of the processing unit.
[0061] Thus, the virtual reality headset's detection system can be used to correct, modify and / or enrich the pressure signals generated by the garment's pressure sensors, in order to obtain an even more relevant rendering during a real-time display of the virtual reality headset, in particular by mitigating the effect of the delay of the pressure signals generated by the garment's pressure sensors which are a little slower than the signals generated by the virtual reality headset's detection system.
[0062] Preferably:
[0063] The said detection system, attached to the said helmet, comprises several elements integrated into the said helmet, which are:
[0064] one or more tracking cameras,
[0065] and / or a gyroscope,
[0066] and / or an accelerometer.
[0067] Thus, the virtual reality headset's detection system can be used to correct, modify and / or enrich the pressure signals generated by the garment's pressure sensors, in order to obtain an even richer rendering during a real-time display of the virtual reality headset, in particular by enriching the content of the pressure signals generated by the garment's pressure sensors with the content of the signals generated by the virtual reality headset's detection system.
[0068] Preferably:
[0069] The medical training garment is a vest,
[0070] The images displayed on the helmet in figurative form represent the compression and release movements of the victim's rib cage corresponding to a mannequin or a human being wearing said training garment.
[0071] Thus, the mixed reality system can lead to medical training simulating cardiac massage that is effective, realistic and immersive.
[0072] Preferably:
[0073] The images displayed on the helmet in figurative form also represent the hand movements of the human wearing the helmet, depicting them in contact with the rib cage of a mannequin or a human wearing said training garment and at the level of the support area, as soon as the effective intensity of compression becomes non-zero.
[0074] Thus, thanks to this indirect detection, the rendering of the display in the images, by the virtual reality headset, of the hands of the wearer of the reality headset is more accurate and more realistic, even though the direct detection of the movement of these hands of the wearer is relatively difficult and can present risks of inaccuracy.
[0075] Preferably:
[0076] The medical training garment is a sleeve,
[0077] The images displayed on the helmet in figurative form represent the evolution over time of the bleeding rate of a wound on the arm or leg of a mannequin or a human being wearing said training garment.
[0078] Thus, the mixed reality system can lead to medical training simulating an external bleeding arrest that is effective, realistic and immersive.
[0079] Preferably:
[0080] The medical training suit and virtual reality headset are connected to the processing unit via wireless communication, preferably via Bluetooth or Wi-Fi. This makes the mixed reality system simpler and more flexible to use.
[0081] Preferably:
[0082] The virtual reality headset emits virtual sounds:
[0083] o which are audible to the wearer of the helmet,
[0084] o which are representative:
[0085] ■ of the said position of the said support zone, and of its possible evolution over time,
[0086] ■ of the said intensity of the said pressure force exerted on the said support area, and of its possible evolution over time, o which represent the action and / or the effect of the action corresponding to the said pressure force exerted on the said support area, as well as the possible evolution over time of the said action and / or the said effect of the action,
[0087] o and which are derived from the pressure signal(s) generated by the pressure sensor(s), as well as from the possible evolution over time of the pressure signal(s).
[0088] Thus, the mixed reality system is even more realistic and immersive for the headset wearer, without adding any significant complexity to the overall system.
[0089] Preferably:
[0090] the virtual figurative representation of the victim is the representation of a human being even when it is part of a mannequin that is wearing medical training clothing, and / or the virtual figurative representation of the victim's environment is a different environment from the real environment of the mannequin or the human being wearing medical training clothing.
[0091] Thus, the mixed reality system is even more realistic and immersive for the headset wearer, and this without adding significant complexity to the whole system, here thanks to the virtual representation of the victim, which could not be done without adding complexity if the victim or mannequin were represented in augmented reality.
[0092] Ideally, the garment should also include:
[0093] in at least one portion of the garment, a stacking in thickness of several successive layers:
[0094] o a first inner layer of fabric,
[0095] o a second layer forming one or more first electrodes,
[0096] o a third layer made of piezoresistive material,
[0097] o a fourth layer forming one or more second electrodes, o a fifth outer layer of fabric,
[0098] so that:
[0099] o when part of a mannequin or human being is covered with said garment, o when an electric current flows through the second layer,
[0100] o when an electric current flows through the fourth layer,
[0101] o a pressure force exerted at a support zone on the fifth layer in said portion, modifies the value of the electrical resistance, in the thickness of the third layer in said portion, at a compressed zone on the third layer corresponding to said support zone on the fifth layer,
[0102] ■ the change in the value of this electrical resistance at the level of said compressed zone on the third layer being representative of the value of said pressure force exerted at the level of said support zone on the fifth layer,
[0103] ■ the position of said compressed zone on the third layer being representative of the position of said support zone on the fifth layer.
[0104] In order to carry out this medical training with a particularly good compromise between on the one hand the overall effectiveness of the mixed reality system and on the other hand significant simplicity and reduced cost, the mixed reality system preferentially uses a medical training garment which is on the one hand particularly effective in the detection of Faction carried out by the user of the mixed reality system and on the other hand which is simple and low cost, as well as easily usable with a mannequin which is itself simple and low cost, for example a passive and / or inert mannequin, or even an old and damaged mannequin but still usable, or even on a human being not equipped with too much additional equipment.
[0105] Such a medical training garment will achieve a good compromise between robustness, accuracy in detecting pressures exerted on the garment, and ease of installation on a mannequin or on a human being.
[0106] Moreover, such a garment will still be thin enough to enhance the immersive aspect, by not interposing too much thickness between the hands of the mixed reality system user on the one hand and the mannequin or human being playing the role of the victim on the other, while remaining robust and maintaining a high sensitivity of pressure detection during the life of the garment, despite the frequent and powerful movements to which it will be subjected by the mixed reality system user mimicking for example emergency first aid gestures such as cardiac massage or stopping external bleeding at the level of a (fictitious) wound.
[0107] In a design, the second layer is the electrode layer that is excited (the electrical energy source sends the current into this second electrode layer) while the fourth layer is the electrode layer that is read (the electrical signals, current and voltage coming out of this fourth electrode layer are read).
[0108] In another alternative embodiment to the previous one, the fourth layer is the electrode layer that is excited (the electrical energy source sends the current into this fourth electrode layer) while the second layer is the electrode layer that is read (the electrical signals, current and voltage coming out of this second electrode layer are read).
[0109] The solutions described in the prior art involve a device composed of multiple printed force sensors of the FSR type. While simple to use, these sensors are not very precise and are relatively complex to integrate within a textile envelope. Increasing the number of these sensors within a textile layer to improve measurement accuracy and resolution resulted in significant bulk due to the volume of connectors and cables used.
[0110] The solution proposed by embodiments of the invention differs from the prior art in that the pressure sensor is directly integrated and composed of the connected fabric itself. This allows for a modular surface area, both in terms of device size and the desired measurement resolution. The matrix, in both the longitudinal and transverse directions, enables more precise mapping and also serves as a position sensor.
[0111] Thanks to its thinness and flexibility, the active material can be adapted to vests and sleeves, enabling effective detection of position, pressure, and even compression. The three layers, whose stacking forms a matrix of pressure sensors, react to deformations and stresses, allowing for precise measurement of changes in force and positioning.
[0112] The combination of the X and Y grids with the piezoresistive textile allows for sensitive and precise detection of position and pressure. Furthermore, it is possible to vary the grid and add lines to increase the accuracy of point detection.
[0113] The flexibility of the materials allows them to be integrated into various garments and accessories, ensuring both functionality and comfort for the user. The three separate layers allow for easy replacement in case of maintenance.
[0114] The three layers are designed to form a flexible and thin assembly, making it imperceptible to the naked eye and intangible, while allowing it to adapt to any surface. The goal of this research is to create a system that is easily reproducible in series, low-cost, and offers high performance.
[0115] Preferably, within the garment:
[0116] The second layer, forming one or more first electrodes, comprises: o parallel conductive bands along a first direction,
[0117] ■ distributed over the surface of the second layer,
[0118] ■ separated from each other by non-conductive bands,
[0119] and / or the fourth layer, forming one or more second electrodes, comprises: o parallel conductive bands along a second direction orthogonal to the first direction,
[0120] ■ distributed over the surface of the fourth layer,
[0121] ■ separated from each other by non-conductive bands,
[0122] and preferably:
[0123] the conductive strips of the second layer and / or the conductive strips of the fourth layer each have a width greater than 2mm, or between 2mm and 10mm, or between 3mm and 7mm, or between 4mm and 6mm,
[0124] and preferably:
[0125] the non-conductive bands of the second layer and / or the non-conductive bands of the fourth layer each have a width between 5mm and 50mm, or a width between 10mm and 40mm, or a width between 20mm and 30mm.
[0126] Thus, this structure of three very thin and well separated layers allows both precise and reliable detection with an overall thickness of the stack of these detection layers which remains relatively low, while offering high robustness for the conductive strips which may be subjected to powerful and brutal movements during certain medical training, such as cardiac massage or stopping bleeding.
[0127] However, any degradation, such as tearing or breaking, of a conductive strip would reduce the accuracy of detecting the position of the support area as well as the intensity of the pressure exerted at the level of this support area, while a degradation of a non-conductive strip would be significantly less problematic.
[0128] To ensure particularly high robustness of the conductive bands, their width is significantly increased, which then allows them to retain a fairly limited thickness which avoids excessive reliefs which would otherwise risk disturbing the realistic and immersive nature of the action exerted by the user on the garment, or even disturbing his action and gestures and movements.
[0129] The thickness of the conductive strips can preferably be less than 1mm, or even less than 500µm, but advantageously remains greater than 100µm, or even greater than 200µm.
[0130] Therefore, preferably, the spacing range of the conductive strips is optimized so that these conductive strips are:
[0131] sufficiently close together so that the density of pressure sensors provides good detection accuracy,
[0132] sufficiently far apart to avoid the risk of short circuits or other malfunctions, particularly during relative movement of different parts of the garment subjected to intense user activity. Preferably:
[0133] the parallel conducting strips along a first direction and the parallel conducting strips along a second direction orthogonal to the first direction, forming a matrix of rows and columns,
[0134] A power supply feeds this matrix via a scan that: o either feeds the columns one after the other,
[0135] ■ The electrical signals from all lines are then read for each powered column to determine the values of the matrix pressure sensors, or the lines are powered one after the other.
[0136] ■ the electrical signals from all columns are then read for each row powered to determine the values of the matrix pressure sensors.
[0137] Thus, detecting the pressure exerted on the garment's pressure sensors is relatively simple and particularly effective, even with the use of a garment of relatively low total thickness.
[0138] Preferably:
[0139] either the second layer, forming one or more first electrodes, is a woven layer, weaving together conductive and non-conductive strips, and / or the fourth layer, forming one or more second electrodes, is a woven layer, weaving together conductive and non-conductive strips,
[0140] either the second layer, forming one or more first electrodes, is a knitted matrix with an "interlock" pattern corresponding to a knitting structure using two sets of needles working in opposition, one set of needles for the conductive strips and the other needle for the non-conductive strips, and / or the fourth layer, forming one or more second electrodes, is a knitted matrix with an "interlock" pattern corresponding to a knitting structure using two sets of needles working in opposition, one set of needles for the conductive strips and the other needle for the non-conductive strips,
[0141] either the second layer forming one or more first electrodes, is a non-conductive textile layer on which the conductive strips are embroidered, and / or the fourth layer forming one or more second electrodes, is a non-conductive textile layer on which the conductive strips are embroidered.
[0142] Thus, the compromise between high robustness and low thickness is further improved for weaving, compared to other embodiments (described below) such as knitting or embroidery.
[0143] Preferably:
[0144] the conductive strips of the second layer and / or fourth layer comprise conductive steel wires, preferably silver-plated steel, the non-conductive strips of the second layer and / or fourth layer comprise non-conductive treated copper wires, preferably enameled copper.
[0145] Thus, the compromise between volume, weight, and conductivity is improved.
[0146] Preferably: the third layer of piezoresistive material is a woven piezoresistive layer, preferably made from carbon-loaded textiles.
[0147] o the third piezo-resistive woven layer preferably having:
[0148] ■ and / or a thickness greater than 50µm, or between 50 and 500µm, or between 50 and 300µm, or between 100 and 200µm,
[0149] ■ and / or a density between 10 and 100g / m³ 2 or between 20 and 80g / m² 2 or between 30 and 50g / m 2 .
[0150] Thus, the sensitivity to pressure detection, by variation of resistance as a function of the force exerted, is precise, while maintaining a third layer of relatively thin thickness.
[0151] Thus, advantageously, the sensitivity range is particularly well suited to applications envisaged in medical training, such as cardiac massage or stopping a hemorrhage.
[0152] Thus, advantageously, the compromise between robustness and detection accuracy on the one hand and cost, simplicity and reduced volume on the other is further improved.
[0153] In one example of an embodiment, the third piezo-resistive woven layer can advantageously exhibit a surface resistance between 0.1 and 2 megaohms.
[0154] Preferably:
[0155] The second layer, the third layer, and the fourth layer are joined together by several ultrasonic welding points, made at the level of the non-conductive bands of the second and fourth layers, between the conductive bands of the second and fourth layers, within the thickness of the layers.
[0156] preferably evenly distributed over the surface of the layers,
[0157] and / or preferably with between 30 and 200 weld points.
[0158] Thus, the overall strength of the layer stack is improved, by a simple and effective technique, without degrading the weight or volume of the overall layer stack.
[0159] Preferably, the medical training method with the mixed reality system according to the invention simulates a first aid operation while controlling this first aid operation, preferably while controlling this first aid operation in real time, comprising the following steps:
[0160] a step of dressing a mannequin or a human being in the medical training garment, a step of performing one or more compressions on the medical training garment dressing the mannequin or human being,
[0161] a step involving the retrieval, via wireless communication with the processing unit, of signals from the garment's pressure sensor(s),
[0162] a first transformation step, by the processing unit, of the signal(s) from the pressure sensor(s) into the images displayed by the processing unit on the interface of the processing unit,
[0163] a display step, on the processing unit interface, of said images, a transmission step, from the processing unit to the virtual reality headset, via wireless communication, of said pressure signal(s),
[0164] a second transformation stage, by the virtual reality headset, of said pressure signal(s) into said images subsequently displayed by the virtual reality headset,
[0165] a step involving the display of said images by the virtual reality headset,
[0166] the virtual reality headset being worn by the person performing said compression(s).
[0167] Thus, the medical training provided is simple and effective, meaning easy to perform while also being realistic and immersive.
[0168] Other features and advantages of the invention will become apparent from the following description of a preferred embodiment of the invention, given by way of example and with reference to the accompanying drawings.
[0169] BRIEF DESCRIPTION OF THE DRAWINGS
[0170] [Fig. 1] Figure 1 schematically represents an example of stacking several successive layers of a medical training garment according to an embodiment of the invention.
[0171] [Fig. 2] Figure 2 schematically represents an example of a second layer forming one or more first electrodes in a stack in thickness of several successive layers of a medical training garment according to an embodiment of the invention.
[0172] [Fig. 3] Figure 3 schematically represents an example of a third layer of piezo-resistive material in a stack-up of several successive layers of a medical training garment according to an embodiment of the invention.
[0173] [Fig. 4] Figure 4 schematically represents an example of a fourth layer forming one or more second electrodes in a stack in thickness of several successive layers of a medical training garment according to an embodiment of the invention.
[0174] [Fig. 5] Figure 5 schematically represents an example of a pressure sensor matrix resulting from the stacking in thickness of several successive layers of a medical sleeve-type training garment according to an embodiment of the invention.
[0175] [Fig. 6] Figure 6 schematically represents an example of a pressure sensor matrix resulting from the stacking in thickness of several successive layers of a medical training garment of the vest type according to an embodiment of the invention.
[0176] [Fig. 7] Figure 7 schematically represents an example of a pressure sensor matrix resulting from the stacking in thickness of several successive layers of a medical training garment with its connections to the first wireless communication module of the garment which is connected to the garment, according to an embodiment of the invention.
[0177] [Fig. 8] Figure 8 schematically represents an example of a pressure sensor matrix resulting from the stacking in thickness of several successive layers of a medical training garment with its connections to the first wireless communication module of the garment which is connected to the garment, according to an embodiment of the invention.
[0178] [Fig. 9] Figure 9 schematically represents an example of a medical sleeve-type training garment according to an embodiment of the invention.
[0179] [Fig. 10] Figure 10 schematically represents an example of a vest-type medical training garment according to an embodiment of the invention.
[0180] [Fig. 11] Figure 11 schematically represents an example of a medical training kit integrating a medical training garment, a virtual reality headset and a processing unit, according to an embodiment of the invention.
[0181] [Fig. 12] Figure 12 schematically represents an example of an image displayed on a screen of the processing unit of a medical training kit according to an embodiment of the invention.
[0182] [Fig. 13] Figure 13 schematically represents an example of an image displayed on a screen of the virtual reality headset of a medical training kit according to an embodiment of the invention.
[0183] [Fig. 14] Figure 14 schematically represents an example of a pressure sensor matrix resulting from the stacking in thickness of several successive layers of a medical training garment during an excitation phase according to an embodiment of the invention.
[0184] [Fig. 15] Figure 15 schematically represents an example of an image displayed on a screen of the virtual reality headset of a medical training kit, including both a figurative and virtual representation of a victim corresponding to the part of the mannequin or human being wearing the medical training garment, a figurative and virtual representation of said action and / or said effect of F action on the part of the mannequin or human being wearing the medical training garment, and a figurative and virtual representation of an environment of a victim corresponding to the part of the mannequin or human being wearing the medical training garment, during a cardiac massage phase, according to an embodiment of the invention.
[0185] [Fig. 16] Figure 16 schematically represents an example of an image displayed on a screen of the virtual reality headset of a medical training kit, including both a figurative and virtual representation of a victim corresponding to the part of the mannequin or human being wearing the medical training garment, a figurative and virtual representation of said action and / or said effect of F action on the part of the mannequin or human being wearing the medical training garment, and a figurative and virtual representation of an environment of a victim corresponding to the part of the mannequin or human being wearing the medical training garment, during another phase of cardiac massage, according to an embodiment of the invention.
[0186] [Fig. 17] Figure 17 schematically represents an example of an image displayed on a screen of the virtual reality headset of a medical training kit according to an embodiment of the invention.
[0187] [Fig. 18] Figure 18 schematically represents an example of an image displayed on a screen of the virtual reality headset of a medical training kit, including both a figurative and virtual representation of a victim corresponding to the part of the mannequin or human being wearing the medical training garment, and a figurative and virtual representation of an environment of a victim corresponding to the part of the mannequin or human being wearing the medical training garment, before the intervention of the rescuer, therefore without figurative and virtual representation of said action and / or said effect of Faction on the part of the mannequin or human being wearing the medical training garment, according to an embodiment of the invention.
[0188] [Fig. 19] Figure 19 schematically represents an example of an image displayed on a screen of the virtual reality headset of a medical training kit, including both a figurative and virtual representation of a victim corresponding to the part of the mannequin or human being wearing the medical training garment, and a figurative and virtual representation of an environment of a victim corresponding to the part of the mannequin or human being wearing the medical training garment, before the intervention of the rescuer, therefore without figurative and virtual representation of said action and / or said effect of action on the part of the mannequin or human being wearing the medical training garment, according to an embodiment of the invention.
[0189] DETAILED DESCRIPTION OF THE IMPLEMENTATION METHODS
[0190] THE INVENTION
[0191] Figure 1 schematically represents an example of stacking several successive layers of a medical training garment according to an embodiment of the invention.
[0192] The stack comprises the superposition of a top layer 1 (which will act as either the second layer of first electrodes or the fourth layer of second electrodes), an intermediate layer 3, and a bottom layer 2 (which will act as either the fourth layer of second electrodes or the second layer of first electrodes). The stack superimposes the different layers 1, 3, and 2 along a vertical Z direction.
[0193] The upper layer 1 is a conductive matrix grid comprising 10 parallel conductive bands extending along a longitudinal direction X, these 10 parallel conductive bands being separated from each other by 11 parallel non-conductive bands also extending along the longitudinal direction X.
[0194] The lower layer 2 is a conductive matrix grid which comprises parallel conductive bands 20 extending along a transverse direction Y, these parallel conductive bands 20 being separated from each other by parallel non-conductive bands 21 also extending along the transverse direction Y.
[0195] The intermediate layer 3 is a piezoresistive layer, more precisely a textile layer made of piezoresistive material. The intermediate layer 3 is sandwiched between the upper conductive layer 1 and the lower conductive layer 2.
[0196] To design this connected textile envelope, three textile layers, 1, 2, and 3, were superimposed to create two matrix grids, 1 and 2, separated by a piezoresistive textile 3 placed in the center. This assembly is called the X, Y, Z matrix, since it provides spatialized information along the three axes.
[0197] It is this superposition of the three textile layers that will form the pressure sensor matrix.
[0198] Figure 2 schematically illustrates an example of a second layer forming one or more first electrodes in a stack of several successive layers of a medical training garment according to an embodiment of the invention. The vertical direction Z is perpendicular to the plane of Figure 2.
[0199] The upper layer 1 is a conductive matrix grid comprising parallel conductive bands 10 extending along a longitudinal direction X, these parallel conductive bands 10 being separated from each other by parallel non-conductive bands 11 also extending along the longitudinal direction X. The upper layer 1 is a textile layer.
[0200] The conductive bands 10 are narrower, and preferably significantly narrower, by at least a factor of 2, or even by at least a factor of 3 or 4, but less than a factor of 10, than the non-conductive bands 11. The width of the conductive bands 10 extends along the transverse direction Y perpendicular to the longitudinal direction X.
[0201] This first matrix grid of the upper textile layer 1 consists of vertical bands 10 which incorporate conductive threads to make the area active on the X axis.
[0202] This upper textile layer 1 is formed by a fabric with vertical conductive strips 10, which are strips of conductive yarns aligned vertically. These strips serve as electrodes for the resistive grid.
[0203] Figure 3 schematically represents an example of a third layer of piezoresistive material in a stacked, multi-layered medical training garment according to an embodiment of the invention. The vertical direction Z is perpendicular to the plane of Figure 3.
[0204] The intermediate layer 3 is a piezo-resistive layer, more precisely a textile layer made of piezo-resistive material, for example piezo-resistive textile material.
[0205] The intermediate layer 3 is either continuous or in sufficiently dense bidirectional mesh so that a path of piezoresistive material can connect any conductive band 10 of the upper layer 1 to a conductive band 20 of the lower layer 2, so that an electric current can pass from this conductive band 10 to this conductive band 20 via this path of piezoresistive material.
[0206] This piezo-resistive textile layer 3 is positioned between textile layers 1 and 2. The resistive properties of the piezo-resistive material allow for three-dimensional measurement and therefore for measuring the pressure exerted on this material.
[0207] The piezoresistive material is placed between the two conductive fabrics of the upper layer 1 and the lower layer 2, respectively, so that its resistance changes according to the pressure applied to it, particularly by the hands of the trainee, i.e., the first responder in medical training. When pressure is applied, the resistance between the conductive strips increases, allowing both the force and the position of the applied pressure to be detected.
[0208] The piezoresistive material is a carbon-loaded piezoresistive textile that is very thin and adds almost no extra thickness, thus enhancing the immersive feel of the medical training garment incorporating it. It is also easy to clean. Varying the carbon content allows for a pressure detection range within an overall interval of 0.1 to 20 N / cm². 2 , or even up to 50N / cm 2 or up to 100 / cm 2 , and possibly even up to 150N / cm 2 The assembly is woven. The thickness is between 100µm and 200µm, equivalent to, for example, I35pm. The external dimensions can be chosen to be around 200mm x 200mm. The density is around 30g / m³. 2 and 50g / m 2 , worth for example 40g / m 2 .
[0209] A possible, but less preferred, alternative to piezoresistive textiles would be the use of an intermediate layer of antistatic silicone, also carbon-loaded. However, this comes in the form of a hard, thick plate, which could compromise the immersive experience of medical training for the medical training garment incorporating it.
[0210] A second possible, but less preferable, alternative to piezoresistive textiles would be the use of an intermediate layer of antistatic foam, for example, polyethylene, also carbon-loaded. However, this layer is thick (otherwise too fragile), which could compromise the immersive aspect of medical training for the medical training garment incorporating it, especially since this foam possesses a certain "shape memory" property that is often useful but detrimental in this case (because the layer must return to its original shape each time it is released, for example, during CPR).
[0211] Figure 4 schematically illustrates an example of a fourth layer forming one or more second electrodes in a stacked, multi-layered medical training garment according to an embodiment of the invention. The vertical direction Z is perpendicular to the plane of Figure 4.
[0212] The lower layer 2 is a conductive matrix grid comprising parallel conductive bands 20 extending along a transverse direction Y, these parallel conductive bands 20 being separated from each other by parallel non-conductive bands 21 also extending along the transverse direction Y. The lower layer 2 is a textile layer.
[0213] The conductive bands 20 are narrower, and preferably significantly narrower, by at least a factor of 2, or even by at least a factor of 3 or 4, but less than a factor of 10, than the non-conductive bands 21. The width of the conductive bands 20 extends along the longitudinal direction X perpendicular to the transverse direction Y.
[0214] This second matrix grid of the lower textile layer 2 consists of 20 horizontal bands incorporating conductive threads to make the area active on the Y axis.
[0215] This lower textile layer 2 is formed by a fabric with horizontal conductive bands 20 which are horizontally aligned conductive yarns, perpendicular to the vertical bands 10 of the upper textile layer 1, thus forming a cross grid with these vertical bands 10.
[0216] To produce the conductive strips 10 and 20, respectively on the upper textile layer 1 and the lower textile layer 2, two main textile techniques can be used: embroidery and knitting. The invention favors knitting. In a preferred embodiment, the technique used is interlock knitting. The interlock pattern is a knitting structure that uses two sets of needles working in opposition. This type of knitting is double-sided and does not curl at the edges, which is advantageous for maintaining the stability of the matrix, which will be subjected to high pressure during medical training simulations. The interlock pattern is also denser and more elastic than single jersey, offering better resilience and support.
[0217] In one example of implementation, the knitted matrix is then composed on the one hand of a non-conductive treated copper wire and on the other hand of a conductive steel wire.
[0218] In other embodiments, the woven matrices can be supplied in different format configurations (width and spacing of the conductive bands 10 and 20) and material (silver or tin) of the conductive bands 10 and 20:
[0219] First example: the conductive strips 10 are made of tin, are 5 mm wide, and are separated from each other by non-conductive strips 10 mm wide. Second example: the conductive strips are made of silver, are 5 mm wide, and are separated from each other by non-conductive strips 10 mm wide. Third example: the conductive strips are made of silver, are 5 mm wide, and are separated from each other by non-conductive strips 25 mm wide. Fourth example: the conductive strips are made of silver, are 2.5 mm wide, and are separated from each other by non-conductive strips 27.5 mm wide. Fifth example: the conductive strips are made of silver, are 3 mm wide, and are separated from each other by non-conductive strips 7 mm wide. Sixth example: the conductive strips are made of silver, are 2 mm wide, and are separated from each other by non-conductive strips of 3 mm wide.Figure 5 schematically represents an example of a pressure sensor matrix resulting from the stacking in thickness of several successive layers of a medical sleeve-type training garment according to an embodiment of the invention.
[0220] Figure 5 shows a top view of the stack of layers. In Figure 5, the conductive strips 10 of the upper layer 1 form with the conductive strips 20 of the lower layer 2 a grid of vertical and horizontal lines whose intersections represent the pressure sensors 31.
[0221] At part of the crossings between non-conductive bands 11 of the upper layer 1 and non-conductive bands 21 of the lower layer 2, for example at half of these crossings, more precisely one crossing out of two in the longitudinal direction X as well as in the transverse direction Y, weld points 30 are respectively arranged which attach together the three layers that are the upper layer 1, the intermediate layer 3 and the lower layer 2. The weld points 30 are advantageously made by ultrasonic welding.
[0222] All conductive strips, whether conductive strips 10 or conductive strips 20, have the same width dl, advantageously between 3 and 10 mm, for example 5 mm. All non-conductive strips, whether non-conductive strips 11 or non-conductive strips 21, have the same width d2, advantageously between 8 and 20 mm, for example 10 mm.
[0223] The total width L of the pressure sensor array 31, in the transverse direction Y, is advantageously between 8 and 20 cm, and is for example 12 cm. The total height H of the pressure sensor array 31, in the longitudinal direction X, is advantageously between 15 cm and 30 cm, and is approximately 20 cm, for example 19.5 cm.
[0224] The pressure sensors 31, which act as both position and force sensors, function by detecting variations in resistance between the vertical conductive strips 10 and horizontal strips 20. The intersection of the rows and columns creates pressure-sensitive points, allowing pressure to be located on a surface, thus forming the pressure sensors 31 at the intersections between the rows and columns. The central layer 3 acts as a variable resistor that affects the electrical signal, providing information on the force exerted at each point of contact, i.e., at the intersections between rows and columns, i.e., at the pressure sensors 31.
[0225] The creation of resistive matrices using strips of conductive wire, combined with a piezoresistive material, enables the fabrication of an efficient position and force sensor. Flexibility in the number of strips and optimization of the materials used allow the sensor's performance to be tailored to the specific application requirements. The number and thickness of the strips can be varied according to the desired results and use cases.
[0226] To choose the detection resolution, the position and size of each resistance formed at each band intersection depends on the area of the intersection and the distance between the conductive bands 10 or 20; the higher the number of 10 or 20 bands and the smaller their width, the greater the resolution of the overall matrix formed by these 10 and 20 bands will be.
[0227] The position is detected by measuring the variations in resistance at each intersection, thus triangulating the exact location of the force applied to the grid. The more bands there are (10 or 20), the more accurately the position is detected.
[0228] The measurement of force is linked to the change in resistance due to the deformation of the piezoresistive material under applied pressure, thus allowing the applied force to be quantified. This change in resistance is directly related to the value of the pressure exerted, enabling a precise measurement of the force and therefore the applied pressure.
[0229] Figure 6 schematically represents an example of a pressure sensor matrix resulting from the stacking in thickness of several successive layers of a medical training garment of the vest type according to an embodiment of the invention.
[0230] Figure 6 shows a top view of the stack of layers. In Figure 6, the conductive strips 10 of the upper layer 1 form with the conductive strips 20 of the lower layer 2 a grid of vertical and horizontal lines whose intersections represent the pressure sensors 31.
[0231] At part of the crossings between non-conductive bands 11 of the upper layer 1 and non-conductive bands 21 of the lower layer 2, for example at half of these crossings, more precisely one crossing out of two in the longitudinal direction X as well as in the transverse direction Y, weld points 30 are respectively arranged which attach together the three layers which are the upper layer 1, the intermediate layer 3 and the lower layer 2.
[0232] All the conductive strips, whether conductive strips 10 or conductive strips 20, have the same width dl, advantageously between 3 and 10 mm, for example 5 mm. All the non-conductive strips, whether non-conductive strips 11 or non-conductive strips 21, have the same width d2, advantageously between 8 and 20 mm, for example 10 mm. Another embodiment with non-conductive strips 21 of the same width d2, advantageously between 20 and 30 mm, for example 25 mm, gives almost equally good results, but with a simpler and less expensive structure, which therefore makes it more advantageous overall. The total width L of the pressure sensor array 31, in the transverse direction Y, is advantageously between 20 and 30 cm, and is approximately 25 cm, for example 25.5 cm.The total height H of the pressure sensor matrix 31, in the longitudinal direction X, is advantageously between 20cm and 30cm, and is about 25cm, for example 25.5cm.
[0233] Figure 7 schematically represents an example of a pressure sensor matrix resulting from the stacking in thickness of several successive layers of a medical training garment with its connections to the first wireless communication module of the garment which is connected to the garment, according to an embodiment of the invention.
[0234] On the side view, the three thin layers are clearly shown superimposed on each other, with the intermediate layer 3 sandwiched between the upper layer 1 and the lower layer 2. The first inner layer of fabric (not shown here) would, for example, be to the left of the lower layer 2, while the fifth outer layer of fabric (not shown here) would be to the right of the upper layer 1.
[0235] The front view again shows the stacking of the upper layer 1, intermediate layer 3 and lower layer 2.
[0236] On the upper layer 1, the conductive strips 10 form the first column-type electrodes. Wired electrical connections 12 respectively link the different conductive strips 10 to a first connector 13. This first connector 13 is connected by wire to the first communication module 4 of the medical training garment.
[0237] On the lower layer 2, the conductive strips 20 form the first line or row type electrodes. Wired electrical connections 22 respectively link the different conductive strips 20 to a second connector 23. This second connector 23 is connected by wire to the first communication module 4 of the medical training garment.
[0238] At the intersections between the columns and the rows are located the pressure sensors 31 forming the pressure sensor matrix 31.
[0239] Snap fasteners 32, located at the edge of the upper layer 1 and lower layer 2, will allow the entire stack to be fixed on the one hand to the first inner layer of fabric and on the other hand to the fifth outer layer of fabric, neither of which are shown here.
[0240] Figure 8 schematically represents an example of a pressure sensor array resulting from the stacking of several successive layers of a medical training garment, with its connections to the garment's first wireless communication module, which is connected to the garment, according to an embodiment of the invention. Figure 8 is a real sample demonstrating the stacking schematically represented in Figure 7. It shows the conductive strips 10, separated by the non-conductive strips 11, connected to the wire connections 12, crossing the conductive strips 20, separated by the non-conductive strips 21, connected to the wire connections 22. The solder points 30 connect the upper layer 1 and the lower layer 2.
[0241] Figure 9 schematically represents an example of a medical sleeve-type training garment according to one embodiment of the invention.
[0242] The medical training garment 5 is a cylindrical sleeve 510 with two openings 512 and 513 at the bases of the cylindrical shape 510. The cylindrical shape 510 is obtained by rolling a flexible sheet 510 into a cylinder, the cylinder being closed with fasteners 511. The flexible sheet 510, which rolls into a cylinder, comprises, on a portion of its surface, the successive stacking of the first inner layer of fabric, the lower layer 2, the intermediate layer 3, the upper layer 1, and the fifth outer layer of fabric, which remains the only visible layer once the cylindrical shape 510 is formed. The sleeve 51 is wrapped around the arm or leg of a mannequin or a human being playing the role of the victim for medical training.
[0243] Figure 10 schematically represents an example of a medical training garment of the vest type according to an embodiment of the invention.
[0244] The medical training garment 5 is a vest 52 to be worn on a mannequin or a human being playing the role of the victim for medical training. The victim, mannequin or human, has a head, a torso, and two arms. This vest 52 includes a top opening 522 for the head, a bottom opening 524 for the torso, and two openings 523 for the arms. The vest 52 closes at the shoulder straps with fasteners 521. The front part of the vest 52 is a chest plate 520. The chest plate 520 comprises, over part of its surface, the successive stacking of the first inner layer of fabric, the lower layer 2, the middle layer 3, the upper layer 1, and the fifth outer layer of fabric, which remains the only visible layer of the chest plate 520.
[0245] Figure 11 schematically represents an example of a medical training kit integrating a medical training garment, a virtual reality headset and a processing unit, according to one embodiment of the invention.
[0246] The medical training kit includes a couple of parts together:
[0247] a medical training garment 5 for use on a mannequin or human being, comprising a pressure detection zone integrating one or more pressure sensors 31 capable of generating one or more pressure signals representative of a negative pressure force exerted on a support area on the garment, in said pressure detection zone of the garment,
[0248] one or two virtual reality headsets 8, displaying images visible to the headset wearer, on their respective screens 80, usually a pair of screens with one screen per eye, one screen for the left eye and one screen for the right eye, the two screens displaying images angularly offset so as to reconstruct for the headset wearer a stereoscopic vision, as for example in classical real vision, and representative of the action and / or the effect of the action corresponding to said pressure force exerted on said support area,
[0249] representing the action and / or the effect of the action corresponding to said pressure force exerted on said support area, as well as the possible evolution over time of said action and / or said effect of the action, in the form of a virtual figurative representation simultaneously including at least:
[0250] ■ a figurative and virtual representation of a victim corresponding to the mannequin or human part wearing the medical training garment,
[0251] ■ a figurative and virtual representation of said action and / or said effect of the action on the part of the mannequin or human being wearing the medical training garment,
[0252] ■ a figurative and virtual representation of a victim's environment corresponding to the part of a mannequin or human being wearing medical training clothing,
[0253] a processing unit 7, transforming the signal(s) from the pressure sensor(s) into images displayed by the processing unit on an interface 71 of the processing unit 7 which are representative of said pressure signal(s) generated by the pressure sensor(s) 31, and comprising:
[0254] o a portable computer terminal 70 transforming the pressure signal(s) from the pressure sensor(s) into said images displayed by the processing unit 7 on an interface 71 of the processing unit, for example the screen 71 of the terminal 70, and possibly also on another remote interface 72 of the processing unit 7,
[0255] o using a first software program from the control panel 74, allowing the scenario in which the headset wearer 8 will evolve to be determined and launched using the processing unit 7, o and using a second software program 73 from the spectator view application, allowing the view displayed to spectators to be modulated and displayed on the remote interface 72, for example a screen,
[0256] a first wireless communication module 4, for example of the Bluetooth type, of the garment 5 which is connected or connectable to the garment 5,
[0257] a second wireless communication module 6, advantageously different from that of the first communication module 4, for example of the WIFI type, of the headset 8 which is connected or connectable to the headset 8 which is managed by a client-server type virtual reality application,
[0258] a third wireless communication module 75 of the processing unit 7 which is connected or connectable to the processing unit 7, and configured to communicate wirelessly, advantageously by two different types of wireless communication:
[0259] o on the one hand, for example via Bluetooth, with the first wireless communication module 4 of the garment 5, so as to be able to retrieve the pressure signal(s) from the pressure sensor(s),
[0260] o and on the other hand, for example via WIFI, with the second wireless communication module 6 of the headset 8, so as to be able to transmit to it said pressure signal(s) from the pressure sensor(s) or said images displayed or displayable by the processing unit 7 on the interfaces 71 and 72 of the processing unit 7,
[0261] and possibly also with other trackers 9 positioned on the mannequin or on the human playing the role of the victim, such as wrist trackers 90 or torso trackers.
[0262] A virtual figurative representation, or a figurative and virtual representation, is a representation that is both:
[0263] figurative, in the form of drawings or photos, like a real view, and not a set of information only in the form of text, numerical values, etc...
[0264] and virtual, that is to say recreated by software, and not filmed by camera.
[0265] Wireless communication can be achieved via WIFI (registered trademark), which is a standardized communication protocol, and / or via Bluetooth (registered trademark), which is another standardized communication protocol.
[0266] The data perceived by the smart textile envelope of the medical garment 5 is read and then transmitted to the laptop 70 of the processing unit 7 via a wireless communication module 4 comprising a microcontroller-based transmitter box. This data transmission can preferably be via standard Bluetooth, Bluetooth Low Energy, or Wi-Fi.
[0267] Even though the processing unit 7 can manage the existence of several learners, and therefore several headsets 8 each running their own virtual reality application, preferably this processing unit 7 manages only a single learner and a single virtual reality headset 8 associated with him.
[0268] The server application of the processing unit 7, running on the supervisory PC 70, is intended to centralize most of the data to be synchronized with the virtual reality headset 8 and with the control panel 74 of the processing unit 7, as well as to retrieve and pre-process the data from the pressure sensors implemented in the medical training garment 5.
[0269] This server application is also responsible for generating the images that will be displayed to the audience in the training room via a monitor or projector connected to this supervisory PC. These images provide the audience, and the instructor, with a view, which the instructor can modify, of the ongoing medical training scenario. This display can be described as a spectator view.
[0270] The control panel application 74 is a second application running on the supervisory PC 70. It provides the trainer with a supervisory interface 71 which allows him, in particular, to configure and then launch the simulation scenario to which he wishes to expose the learner.
[0271] This 71 monitoring interface may include:
[0272] an interface for selecting the scenario to launch and its options, such as:
[0273] either perform cardiac massage,
[0274] either compression to stop bleeding,
[0275] and an interface for selecting the location where the scenario to be launched will take place, such as:
[0276] in the street,
[0277] o in a subway station,
[0278] in the middle of the forest,
[0279] o in the mountains, etc...
[0280] Once the simulation has started, interface 71 allows the learner to interact with it, primarily to trigger reactions from the virtual characters they are speaking to or wish to interact with (obtaining objects, calling for help, etc.), and also to receive feedback on the simulation's progress. A simulation summary screen provides an overview of the scenario's advancement and the outcome of each step. For example, the sequence of steps to be taken when treating a hemorrhage might include the following: triggering the incident, securing the scene, applying pressure, lowering the victim to the ground, securing the victim, placing a blanket over the victim, performing compression (for example, on the victim's arm), calling for help, and so on.
[0281] Indicators (average frequency and average depth of chest compressions observed during the last 5 seconds) of the quality of the intervention (characteristics of commonly performed compressions) allow the learner to have feedback on the quality of the intervention over time, as well as indicators of the current quality of chest compressions (average frequency and depth, real-time graph of the last compressions performed), or, depending on the scenario chosen, indicators of the current quality of compressions performed on or near a bleeding wound, including, for example, the intensity in each of the three zones (at the wound, upstream, downstream), with color varying according to whether or not the threshold for reducing and then stopping the bleeding has been reached.
[0282] An application is embedded and run in each virtual reality headset, primarily to generate the images to be displayed specifically in that headset (corresponding to the learner's view), images which take into account the current state of the simulation and the learner's position in the real room where the simulation takes place (position of their head and hands for example).
[0283] Each virtual reality application on each headset is also responsible for transmitting to the server information that only it can evaluate and / or detect, such as the position and / or orientation of the reference point corresponding to the learner's head (for example, at the back of their head just above their neck), and the position of their hands (and fingers). Finally, the virtual reality application on one of the headsets is also responsible for evaluating and transmitting the position and orientation of the position trackers, which are used to locate certain characteristic points on the body representing the victim in the current scenario (a human being or a mannequin playing the role of the victim, depending on the scenario).
[0284] All the applications described above communicate data with each other via the local network. Access to this local network is usually provided by a Wi-Fi router (which does not require internet access) to which the PC 70 of the processing unit 7 and the virtual reality headset 8 connect via Wi-Fi. Figure 12 schematically represents an example of an image displayed on a screen of the processing unit of a medical training kit according to an embodiment of the invention.
[0285] Image 81, visible to viewers, is displayed, for example on interface 72 of the preceding figure, representing the action and / or the effect of the action corresponding to said pressure force exerted on said support area, as well as the possible evolution over time of said action and / or said effect of the action, in the form of a virtual figurative representation, that is to say here a fully figurative and also fully virtual image, simultaneously including at least:
[0286] a figurative and virtual representation 82 of a victim corresponding to the part of a mannequin or human being wearing medical training clothing, o here, the victim lying on the ground on a subway platform,
[0287] a figurative and virtual representation 84 of said action and / or said effect of the action on the part of the mannequin or human being wearing the medical training garment,
[0288] o here the up and down movement of the hand, placed on the victim's torso, also causing the up and down movement of the victim's rib cage, during this simulation of cardiac massage, a figurative and virtual representation 85 of a victim's environment corresponding to the part of a mannequin or human being wearing medical training clothing,
[0289] here the walls, platform and track and automatic gate of the metro station, as well as the seats and even other metro users like the standing lady, and possibly a figurative and virtual representation 83 of the helmet wearer who is the first aider, that is to say the learner providing (in a simulated way) emergency care to the victim corresponding to the part of mannequin or human being wearing the medical training garment,
[0290] Here is the rescuer crouching next to the victim, whose head and hands can be seen performing cardiac massage on the victim.
[0291] Figure 13 schematically represents an example of an image displayed on a screen of the virtual reality headset of a medical training kit according to an embodiment of the invention.
[0292] Image 181, visible only to the helmet wearer, who is the first aider practicing cardiac massage on a supine victim, is displayed on the two screens 80 of the helmet 8 in the preceding figure, corresponding respectively to the vision observed by the first aider's right and left eyes, representing the action and / or the effect of the action corresponding to said pressure force exerted on said support area, as well as the possible evolution over time of said action and / or said effect of the action, in the form of a virtual figurative representation, that is to say here a fully figurative and also fully virtual image, simultaneously including at least:
[0293] a figurative and virtual representation 182 of a victim corresponding to the part of a mannequin or human being wearing medical training clothing,
[0294] Here, the victim is lying on the ground on a subway platform.
[0295] a figurative and virtual representation 184 of said action and / or said effect of the action on the part of the mannequin or human being wearing the medical training garment,
[0296] Here are the two hands that will be placed on the victim's chest before the cardiac massage is performed.
[0297] a figurative and virtual representation 185 of a victim's environment corresponding to the part of a mannequin or human being wearing medical training clothing,
[0298] Here is the platform and the track of the metro station.
[0299] but of course without representation of the head of the helmet wearer who is the rescuer. Figure 14 schematically represents an example of a pressure sensor matrix resulting from the stacking in thickness of several successive layers of a medical training garment during an excitation phase according to an embodiment of the invention.
[0300] The conductive bands 10, parallel to each other, cross the conductive bands 20, parallel to each other and orthogonal to the conductive bands 10, their intersections forming the pressure sensors 31.
[0301] Each pressure sensor 31 is individualized on the one hand by its abscissa i corresponding to the column i of the conductive strip 10 which excites it by sending it an electrical current at the input, and on the other hand by its ordinate j corresponding to the row j of the conductive strip 20 whose electrical output current will be read, this electrical current having been modified by the compression undergone by this pressure sensor 31. The reading and transmission of the data generated by the pressure sensors 31 is a task which is carried out by the code embedded in the transmitter box of the first wireless communication module 4 (see figure 11).
[0302] The conductive strips 10 of one of the two matrix layers are electrically excited one after the other by the microcontroller in the transmitter housing of the first wireless communication module 4. Thus, at any given time, at most only one of these strips 10 is excited. We refer to such an excited strip 10 here as a “column”.
[0303] As soon as a column is energized, the microcontroller will successively read the voltages observed on each conductive band 20 of the other matrix layer. Here, we call a conductive band 20 of this matrix layer, which is the subject of the voltage readings, a “line”.
[0304] Thus, when a compression is carried out at the intersection of an excited column i and a row j, the voltage read for this row is strictly positive, and its value is higher the more the compression carried out at the level of the pressure sensor 31 corresponding to the intersection (i,j) between column i and row j is significant.
[0305] Thus, by comparing the voltage read to the minimum and maximum values that this voltage can take, the voltage value is transformed into a ratio within the interval [0; 1], representative of the compression intensity observed in this pressure sensor 31 located at this point (i,j).
[0306] Once the compression intensity ratio values have been evaluated for all 31 pressure sensors in the matrix (i.e., for all intersections (i,j) of columns and rows processed by the microcontroller), these values are transmitted to the simulation server in a single message. This transmission is carried out, for example, via Bluetooth wireless communication.
[0307] It is therefore the simulation server, typically running on a dedicated 70 PC supervisory unit for the trainer, which will receive this raw data and will handle the first stage of its processing alone, which is the filtering of pressure data from the 31 pressure sensors.
[0308] A preferred embodiment for data analysis for the simulation of cardiac arrest and cardiac massage as emergency care will now be described.
[0309] In the context of simulating a cardiac arrest and cardiac massage as emergency care, the evaluation of the deformation of the virtual rib cage, advantageously corresponding to the depth of compression of this rib cage expressed in centimeters, is carried out independently by the software embedded in the virtual reality headset 8, by the PC server 70 and by the control panel 74.
[0310] The 3D model of the victim's rib cage can be gradually deformed. Its appearance can then range from an undeformed rib cage to one compressed by 7 cm. This variation in appearance is parameterized in real time by specifying a ratio with a value ranging from 0 to 1. A value of 0 corresponds to an undeformed rib cage, while a value of 1 corresponds to a rib cage compressed by 7 cm. Between these two values, the appearance is adjusted proportionally.
[0311] It is therefore the result of the evaluation of the depth of compression of the rib cage which, reduced to a ratio between 0 and 1, is then used as a parameter for the deformation of the visual of the rib cage, and thus allows the simulation to present a virtual visual consistent with the reality of the ongoing cardiac massage, which further improves its realism and immersive character.
[0312] Knowledge of this compression depth therefore contributes to monitoring this value, and thus to evaluating the quality of the massage performed, the ideal depth of compressions being equal to 5 cm, while the frequency of these compressions is ideally between 100 and 120 bpm (frequency unit).
[0313] This ability to assess massage quality allows the simulation to react in real time to any failure to meet quality standards, for example, by having a virtual character intervene to advise the learner on how to improve their massage based on the quality criterion that was not met. It also allows the instructor to be presented with a summary of the learner's performance, including the average values for these quality criteria.
[0314] The PC 70 server uses this data to generate images of the victim with the thorax more or less compressed in the spectator view shown on screen 72.
[0315] The virtual reality application does the same to generate the images to be displayed in the virtual reality headset.
[0316] Control Panel 74 uses this data to update real-time indicators of intervention quality, such as depth and rate of compressions.
[0317] Figure 15 schematically represents an example of an image displayed on a screen of the virtual reality headset of a medical training kit, including both a figurative and virtual representation of a victim corresponding to the part of the mannequin or human being wearing the medical training garment, a figurative and virtual representation of said action and / or said effect of the action on the part of the mannequin or human being wearing the medical training garment, and a figurative and virtual representation of an environment of a victim corresponding to the part of the mannequin or human being wearing the medical training garment, during a cardiac massage phase, according to an embodiment of the invention.
[0318] Image 181, visible only to the helmet wearer, who is the first aider practicing cardiac massage on a supine victim, is displayed on the two screens 80 of the helmet 8 in the preceding figure, corresponding respectively to the vision observed by the first aider's right and left eyes, representing the action and / or the effect of the action corresponding to said pressure force exerted on said support area, as well as the possible evolution over time of said action and / or said effect of the action, in the form of a virtual figurative representation, that is to say here a fully figurative and also fully virtual image, simultaneously including at least:
[0319] a figurative and virtual representation 182 of a victim corresponding to the part of a mannequin or human being wearing medical training clothing, or here, the victim lying on the ground on a subway platform, shirt open and torso bare,
[0320] a figurative and virtual representation 184 of said action and / or said effect of the action on the part of the mannequin or human being wearing the medical training garment,
[0321] o here the up and down movement of the hand, placed on the victim's torso, also causing the up and down movement of the victim's rib cage, during this simulation of cardiac massage, ■ and more specifically here the hand in the raised position, with the rib cage relaxed, representing the appearance of the victim's thorax when its deformation is considered to be zero,
[0322] a figurative and virtual representation 185 of a victim's environment corresponding to the part of a mannequin or human being wearing medical training clothing,
[0323] here the walls, platform and track of the metro station, as well as the seats and even other metro users like the feet of the standing user.
[0324] Figure 16 schematically represents an example of an image displayed on a screen of the virtual reality headset of a medical training kit, including both a figurative and virtual representation of a victim corresponding to the part of the mannequin or human being wearing the medical training garment, a figurative and virtual representation of said action and / or said effect of the action on the part of the mannequin or human being wearing the medical training garment, and a figurative and virtual representation of an environment of a victim corresponding to the part of the mannequin or human being wearing the medical training garment, during another phase of cardiac massage, according to an embodiment of the invention.
[0325] Image 181, visible only to the helmet wearer, who is the first aider practicing cardiac massage on a supine victim, is displayed on the two screens 80 of the helmet 8 in the preceding figure, corresponding respectively to the vision observed by the first aider's right and left eyes, representing the action and / or the effect of the action corresponding to said pressure force exerted on said support area, as well as the possible evolution over time of said action and / or said effect of the action, in the form of a virtual figurative representation, that is to say here a fully figurative and also fully virtual image, simultaneously including at least:
[0326] a figurative and virtual representation 182 of a victim corresponding to the part of a mannequin or human being wearing medical training clothing, or here, the victim lying on the ground on a subway platform, shirt open and torso bare,
[0327] a figurative and virtual representation 184 of said action and / or said effect of the action on the part of the mannequin or human being wearing the medical training garment,
[0328] o here the up and down movement of the hand, placed on the victim's torso, also causing the up and down movement of the victim's rib cage, during this simulation of cardiac massage, ■ and more specifically here the hand in a low position, with the rib cage compressed, representing the appearance of the victim's thorax when its deformation is considered maximal, a figurative and virtual representation 185 of a victim's environment corresponding to the part of the mannequin or human being wearing the medical training garment,
[0329] Here, the walls, platform and track of the metro station, as well as the seats and even other metro users such as the feet of the standing user. Figure 17 schematically represents an example of an image displayed on a screen of the virtual reality headset of a medical training kit according to an embodiment of the invention.
[0330] Image 181, visible only to the helmet wearer, who is the first aider practicing cardiac massage on a supine victim, is displayed on the two screens 80 of the helmet 8 in the preceding figure, corresponding respectively to the vision observed by the first aider's right and left eyes, representing the action and / or the effect of the action corresponding to said pressure force exerted on said support area, as well as the possible evolution over time of said action and / or said effect of the action, in the form of a virtual figurative representation, that is to say here a fully figurative and also fully virtual image, simultaneously including at least:
[0331] a figurative and virtual representation 182 of a victim corresponding to the part of a mannequin or human being wearing medical training clothing, or here, the victim lying on the ground on a subway platform, shirt open and torso bare,
[0332] a figurative and virtual representation 184 of said action and / or said effect of the action on the part of the mannequin or human being wearing the medical training garment,
[0333] o here the up and down movement of the hand, placed on the victim's torso, also causing the up and down movement of the victim's rib cage, during this simulation of cardiac massage, ■ and more specifically here with the intertwining of the two hands pressing on the compressed rib cage,
[0334] a figurative and virtual representation 185 of a victim's environment corresponding to the part of a mannequin or human being wearing medical training clothing,
[0335] or here simply the floor of the subway station platform.
[0336] Figure 17 shows and visualizes the positioning of the virtual hands on the surface of the virtual rib cage. This task is performed by the PC 70 server, and its result is transmitted to the control panel 74 and the virtual reality headset 8 via the wireless communication network.
[0337] The victim's condition is initially assessed independently by the software embedded in the virtual reality headset (8), the PC server (70), and the control panel (74). The simulation will take into account changes in the quality of chest compressions to adapt the victim's condition accordingly and its impact on the defibrillator's diagnosis. For this defibrillator, the heart's ability to receive an electrical shock for defibrillation depends on the quality and speed of the compressions.
[0338] An embodiment for the analysis of data for the simulation of a hemorrhage and a compression point stopping this hemorrhage as emergency care will now be described.
[0339] In the context of simulating a hemorrhage and a compression point stopping this hemorrhage as emergency care, the assessment of the state of this hemorrhage is carried out by the PC 70 server, and is then transmitted to the virtual reality headset 8 and the control panel 74 to update the simulation and their resulting displays.
[0340] The state of the hemorrhage is taken into account visually, at the level of the displayed images, in the manner represented in figures 18 and 19.
[0341] Figure 18 schematically represents an example of an image displayed on a screen of the virtual reality headset of a medical training kit, including both a figurative and virtual representation of a victim corresponding to the part of the mannequin or human being wearing the medical training garment, and a figurative and virtual representation of an environment of a victim corresponding to the part of the mannequin or human being wearing the medical training garment, before the intervention of the rescuer, therefore without figurative and virtual representation of said action and / or said effect of the action on the part of the mannequin or human being wearing the medical training garment, according to an embodiment of the invention.
[0342] Image 181, visible only to the helmet wearer, who is the first aider practicing applying pressure to stop bleeding on the arm of a kneeling victim, is displayed on the two screens 80 of the helmet 8 in the preceding figure, corresponding respectively to the vision observed by the first aider's right and left eyes, representing the action and / or the effect of the action corresponding to said pressure force exerted on said support area, as well as the possible evolution over time of said action and / or said effect of the action, in the form of a virtual figurative representation, that is to say here a fully figurative and also fully virtual image, simultaneously including at least:
[0343] a figurative and virtual representation 182 of a victim corresponding to the human being wearing medical training clothing, here, the victim is kneeling with a cut in the arm and a sharp object embedded in the arm, generating an impressive hemorrhage, with a flow of blood running onto the subway platform,
[0344] without a figurative and virtual representation 184 of said action and / or said effect of the action on the human being wearing medical training clothing, because the rescuer has not yet taken action, but is already in a situation, a figurative and virtual representation 185 of an environment of a victim corresponding to the human being wearing medical training clothing,
[0345] Here, especially the platform of the metro station, beginning to be flooded by the flow of blood that has fallen onto the ground, is a somewhat shocking but effective and immersive way of putting the rescuer in a situation and encouraging him to react very quickly while managing his own stress, by placing his hand as quickly as possible on the victim's arm in order to perform a compression, which, once in place, will stop the flow of blood currently flowing from the wound, thus showing the rescuer the effectiveness of his first aid.
[0346] Depending on the assessment of the bleeding status, the simulation will then interrupt, reduce, or fully activate the various visual effects of this bleeding. For arterial bleeding, the effects take the form of:
[0347] From a jet of blood spurting from the wound towards the front of the arm, a pool of blood is temporarily generated on the ground at the point of impact of these particles,
[0348] Moderate blood flow along the forearm, from the wound and in the direction and sense of gravity,
[0349] A moderate drip of blood, from the point on the forearm opposite the wound, towards the ground, generating a temporary pool of blood on the ground at the point of impact of these particles.
[0350] Figure 19 schematically represents an example of an image displayed on a screen of the virtual reality headset of a medical training kit, including both a figurative and virtual representation of a victim corresponding to the part of the mannequin or human being wearing the medical training garment, and a figurative and virtual representation of an environment of a victim corresponding to the part of the mannequin or human being wearing the medical training garment, before the intervention of the rescuer, therefore without figurative and virtual representation of said action and / or said effect of the action on the part of the mannequin or human being wearing the medical training garment, according to an embodiment of the invention.Image 181, visible only to the helmet wearer, who is the rescuer practicing compression to stop bleeding on the arm of a kneeling victim, is displayed on the two screens 80 of the helmet 8 in the previous figure, corresponding respectively to the vision seen by the rescuer's two right and left eyes, representing the action and / or the effect of the action corresponding to said pressure force exerted on said support area, representing the action and / or the effect of the action corresponding to said pressure force exerted on said support area, as well as the possible evolution over time of said action and / or said effect of the action, in the form of a virtual figurative representation, that is to say here of a fully figurative and also fully virtual image, simultaneously including at least:.
[0351] a figurative and virtual representation 182 of a victim corresponding to a human being wearing medical training clothing,
[0352] Here, the victim is kneeling with a cut in their arm (apparently without any object embedded in the arm), causing impressive bleeding, with a flow of blood running onto the subway platform.
[0353] without a figurative and virtual representation 184 of said action and / or said effect of the action on the human being wearing medical training clothing, because the rescuer has not yet taken action, but is already in a situation, a figurative and virtual representation 185 of an environment of a victim corresponding to the human being wearing medical training clothing,
[0354] Here, especially the platform of the metro station, beginning to be flooded by the flow of blood that has fallen onto the ground, is a somewhat shocking but effective and immersive way of putting the rescuer in a situation and encouraging him to react very quickly while managing his own stress, by placing his hand as quickly as possible on the victim's arm in order to perform a compression, which, once in place, will stop the flow of blood currently flowing from the wound, thus showing the rescuer the effectiveness of his first aid.
[0355] Depending on the assessment of the bleeding status, the simulation will then interrupt, reduce, or fully activate the various visual effects of this bleeding. For venous bleeding, the effects take the form of:
[0356] Significant blood flow along the forearm, from the wound and in the direction and sense of gravity; Significant blood drip, from the point on the forearm opposite the wound, towards the ground with the generation of a temporary pool of blood on the ground at the point of impact of these particles.
[0357] The simulation will also take into account the intensity and duration of the hemorrhage to adapt the visual symptoms of the victim's condition accordingly. For example, the skin tone will paler the greater the total amount of blood lost, in the figurative and virtual representation of the victim.
[0358] All these visual impacts are taken into account:
[0359] By the PC 70 server, when it generates a new image of the spectator view, By the virtual reality headset 8 application, when it generates a new image of the learner view.
[0360] The 74 control panel provides a real-time display of indicators of the quality of the intervention performed at any given moment. It displays the intensity of the compressions applied in each of the three main areas involved (the wound area, the area downstream from the wound, and the area upstream from the wound). This display takes the form of three progress bars ranging from zero (no compression applied in this area) to a maximum corresponding to the maximum detectable compression intensity. The color of these bars also changes according to the impact of the compression on the bleeding: red if there is no impact, orange if the bleeding is decreasing, and green if the bleeding has stopped.
[0361] An intervention summary screen, displayed on control panel 74, tracks the evolution of the bleeding status over time. Specifically, it shows the percentage of time during which the bleeding was completely stopped, the percentage of time during which the bleeding was simply reduced, and finally, the percentage of time during which the bleeding was neither stopped nor reduced.
[0362] Although the medical training garment, the mixed reality system coupling a virtual reality headset with a medical training garment, and the medical training kit were presented in connection with two main applications, cardiac massage after cardiac arrest, and stopping a hemorrhage, other medical training applications are possible, such as other types of hemorrhage, catheterization procedures, surgical procedures, damage assessment procedures, etc.
[0363] This medical training garment, this mixed reality system combining a virtual reality headset with a medical training garment, and this medical training kit, can be offered to medical training institutions, simulation centers, and hospitals. Of course, the present invention is not limited to the examples and embodiments described and illustrated, but is susceptible to numerous variations accessible to those skilled in the art.
Claims
DEMANDS 1. Mixed reality system, comprising a medical training garment (5) and a virtual reality headset (8), and coupling: on the one hand, the medical training garment (5) for use on a mannequin or human being, comprising a pressure detection zone incorporating one or more pressure sensors (31), such that: ■ when a part of a mannequin or a human being is clothed in said garment (5), ■ when a pressure force is exerted on a support area on said garment (5), in said pressure detection area of said garment (5), ■ one or more pressure signals, representative of on the one hand the position of said support zone and on the other hand the intensity of said pressure force exerted on said support zone, is or are generated by one or more of said pressure sensors (31), as well as the possible evolution over time of said pressure signal(s), with, on the other hand, the virtual reality headset (8) displaying images (181): o which are visible to the helmet wearer (8), o which are representative: ■ of the said position of the said support zone, and of its possible evolution over time, ■ of said intensity of said pressure force exerted on said support area, and of its possible evolution over time, o which represent the action and / or the effect of the action corresponding to said pressure force exerted on said support area, as well as the possible evolution over time of said action and / or said effect of the action, in the form of a virtual figurative representation (181) simultaneously including at least: ■ a figurative and virtual representation of a victim (182) corresponding to the part of the mannequin or human being wearing the medical training garment (5), ■ a figurative and virtual representation of said action and / or said effect of the action (184) on the part of the mannequin or human being wearing the medical training garment (5), ■ a figurative and virtual representation of an environment (185) of a victim corresponding to the part of a mannequin or human being wearing the medical training garment (5), o and which are derived from the said pressure signal(s) generated by the pressure sensor(s) (31), as well as from the possible evolution over time of the said pressure signal(s).
2. Mixed reality system according to claim 1, characterized in that: the mixed reality system also includes a processing unit (7) transforming said pressure signal(s) generated by the pressure sensor(s) (31) into images (81) displayed by the processing unit (7) on an interface (71, 72) of the processing unit (7), and / or the virtual reality headset (8) transforms said pressure signal(s) generated by the pressure sensor(s) (31) into said images (181) displayed by the virtual reality headset (8).
3. Mixed reality system according to claim 2, characterized in that: the mixed reality system also includes a processing unit (7) transforming said pressure signal(s) generated by the pressure sensor(s) (31) into images (81) displayed by the processing unit (7) on an interface (71, 72) of the processing unit (7), the virtual reality headset (8) displays the images (181) received from the processing unit (7).
4. Mixed reality system according to any one of claims 2 to 3, characterized in that: the images (81) transformed by said processing unit (7): are visible via a human-machine interface (71, 72) of the processing unit (7), preferably on a screen (71, 72) of the processing unit (7), are modifiable, and / or movable and / or re-orientable, via the interface (71, 72) of the processing unit (7), preferably via a keyboard and / or a mouse and / or a joystick of the processing unit (7), o are representative of: ■ the said position of the said support zone, and of its possible evolution over time, ■ of the said intensity of the said pressure force exerted on the said support zone, and of its possible evolution over time, o represent, in figurative form, the action and / or the effect of the action corresponding to the said pressure force exerted on the said support zone, as well as the possible evolution over time of the said action and / or the said effect of the action, o and are derived from said pressure signal(s) generated by the pressure sensor(s) (31), as well as from the possible evolution over time of said pressure signal(s).
5. Mixed reality system according to any one of claims 2 to 4, characterized in that: The virtual reality headset (8) also includes a system for detecting the position and / or orientation of the headset, attached to said headset (8), so that one or more complementary signals, representative of the frequency of said pressure force exerted on said support area and / or possibly also of the intensity of said pressure force exerted on said support area: o are generated by the virtual reality headset (8), from the evolution over time of the position of said position sensor which is representative of the movements of said headset (8) over time, as well as the possible evolution over time of said or said complementary signals, o and are combined with said or said pressure signals from the pressure sensor(s) (31) to obtain said images displayed by the virtual reality headset and / or to obtain said additional images (81) displayed by the human-machine interface (71, 72) of the processing unit (7).
6. Mixed reality system according to claim 5, characterized in that: said detection system attached to said helmet (8) comprises several elements integrated into said helmet which are: one or more tracking cameras, and / or a gyroscope, o and / or an accelerometer.
7. Mixed reality system according to any one of claims 1 to 6, characterized in that: The medical training garment (5) is a vest (52), The images (181) displayed on the helmet (8) in figurative form represent the compression and release movements of the victim's rib cage corresponding to a mannequin or a human being wearing said training garment (5).
8. Mixed reality system according to any one of the preceding claims, characterized in that: The images (181) displayed on the helmet (8) in figurative form also represent the movements (183) of the hands of the human being wearing the helmet (8), by representing them in contact with the rib cage of a mannequin or a human being wearing said medical training garment (5) and at the level of the support area, as soon as the effective intensity of compression becomes non-zero.
9. Mixed reality system according to any one of claims 1 to 6, characterized in that: the medical training garment (5) is a sleeve (51), The images (181) displayed on the helmet (8) in figurative form represent the evolution over time of the bleeding rate of a wound on the arm or leg of a mannequin or human being wearing said medical training garment (5).
10. Mixed reality system according to any one of the preceding claims, characterized in that: said medical training garment (5) and said virtual reality headset (8) are coupled with the processing unit (7) via wireless communication, preferably via Bluetooth or WIFI wireless communication.
11. Mixed reality system according to any one of the preceding claims, characterized in that: The virtual reality headset (8) emits virtual sounds: o which are audible to the helmet wearer (8), o which are representative of: ■ the said position of the said support zone, and of its possible evolution over time, ■ of said intensity of said pressure force exerted on said support area, and of its possible evolution over time, o which represent the action and / or the effect of the action corresponding to said pressure force exerted on said support area, as well as the possible evolution over time of said action and / or said effect of the action, o and which are derived from said pressure signal(s) generated by the pressure sensor(s) (31), as well as the possible evolution over time of said pressure signal(s).
12. Mixed reality system according to any one of the preceding claims, characterized in that: the virtual figurative representation of the victim (82, 182) is the representation of a human being even when it is part of a mannequin that is dressed in medical training clothing (5), and / or the virtual figurative representation of the environment (85, 185) of the victim is a different environment from the real environment of the mannequin or human being wearing the medical training garment (5).
13. Mixed reality system according to any one of the preceding claims, characterized in that the garment (5) comprises: in at least one portion of the garment, a stacking in thickness of several successive layers: o a first inner layer of fabric, o a second layer (1) forming one or more first electrodes (10), o a third layer (3) made of piezoresistive material, o a fourth layer (2) forming one or more second electrodes (20), o a fifth outer layer of fabric, so that: o when a part of a mannequin or a human being is clothed in said garment (5), o when an electric current flows in the second layer (1), o when an electric current flows in the fourth layer (2), o a pressure force exerted at a bearing area on the fifth layer in said portion, modifies the value of the electrical resistance, in the thickness of the third layer (3) in said portion, at a compressed area on the third layer (3) corresponding to said bearing area on the fifth layer, ■ the change in the value of this electrical resistance at the level of said compressed zone on the third layer (3) being representative of the value of said pressure force exerted at the level of said support zone on the fifth layer, ■ the position of said compressed zone on the third layer (3) being representative of the position of said support zone on the fifth layer.
14. Mixed reality system according to claim 13, characterized in that, in the garment: the second layer (1) forming one or more first electrodes (10), comprises: o parallel conducting strips (10) along a first direction (X), ■ distributed over the surface of the second layer (1), ■ separated from each other by non-conductive bands (11), and / or the fourth layer (2) forming one or more second electrodes (20), comprises: o conducting strips (20) parallel along a second direction (Y) orthogonal to the first direction (X), ■ distributed over the surface of the fourth layer (2), ■ separated from each other by non-conductive bands (21), in that, preferably: the conductive bands (10) of the second layer (1) and / or the conductive bands (20) of the fourth layer (2) each have a width (dl) greater than 2 mm, or a width between 2 mm and 10 mm, or a width (dl) between 3 mm and 7 mm, or a width (dl) between 4 mm and 6 mm, and preferably in that: The non-conductive bands (11) of the second layer (1) and / or the non-conductive bands (21) of the fourth layer (2) each have a width (d2) between 5 mm and 50 mm, or a width (d2) between 10 mm and 40 mm, or a width (d2) between 20 mm and 30 mm.
15. Mixed reality system according to claim 14, characterized in that: the conducting strips (10) parallel along a first direction (X) and the conducting strips (20) parallel along a second direction (Y) orthogonal to the first direction (X), forming a matrix of rows and columns, A power supply feeds this matrix via a scan that either: o feeds the columns one after the other, ■ The electrical signals from all lines are then read for each powered column to determine the values of the matrix pressure sensors (31), either feeds the lines one after the other, ■ the electrical signals from all columns are then read for each row supplied to determine the values of the matrix pressure sensors (31).
16. Mixed reality system according to claim in any one of claims 14 to 15, characterized in that: either the second layer (1) forming one or more first electrodes (10), is a woven layer, weaving together conductive strips (10) and non-conductive strips (11), and / or the fourth layer (2) forming one or more second electrodes (20), is a woven layer, weaving together conductive strips (20) and non-conductive strips (21), either the second layer (1) forming one or more first electrodes (10), is a knitted matrix with an "interlock" pattern corresponding to a knitting structure using two sets of needles working in opposition, one set of needles for the conductive strips (10) and the other needle for the non-conductive strips (11), and / or the fourth layer (2) forming one or more second electrodes (20), is a knitted matrix with an "interlock" pattern corresponding to a knitting structure using two sets of needles working in opposition, one set of needles for the conductive strips (20) and the other needle for the non-conductive strips (21), or the second layer (1) forming one or more first electrodes (10), is a non-conductive textile layer on which the conductive strips (10) are embroidered, and / or the fourth layer (2) forming one or more second electrodes (20),is a non-conductive textile layer on which conductive strips (20) are embroidered.
17. Mixed reality system according to claim according to any one of claims 14 to 16, characterized in that: the conductive bands (10, 20) of the second layer (1) and / or the fourth layer (2) comprise conductive steel wires, preferably silver-plated steel, the non-conductive bands (11, 21) of the second layer (1) and / or the fourth layer (2) comprise non-conductive wires of treated copper, preferably enameled copper.
18. Mixed reality system according to claim in any one of claims 13 to 17, characterized in that: the third layer (3) made of piezoresistive material is a woven piezoresistive layer, preferably based on carbon-loaded textile, o the third piezoresistive woven layer (3) preferably having: ■ and / or a thickness greater than 50µm, or between 50 and 500µm, or between 50 and 300µm, or between 100 and 200µm, ■ and / or a density between 10 and 100g / m³ 2 or between 20 and 80g / m² 2 or between 30 and 50g / m 2 .
19. Mixed reality system according to any one of claims 13 to 18, characterized in that: the second layer (1), the third layer (3), and the fourth layer (2), are assembled together by several ultrasonic welding points (30), made at the level of the non-conductive bands (11, 21) of the second (1) and fourth (2) layers, between the conductive bands (10, 20) of the second (1) and fourth (2) layers, in the thickness of the layers, preferably evenly distributed over the surface of the layers, o and / or preferably with between 30 and 200 (30) points of welding.
20. A medical training method using the mixed reality system according to any one of the preceding claims, simulating a first aid operation while controlling that first aid operation, preferably while controlling that first aid operation in real time, comprising the following steps: a step of dressing a mannequin or a human being in the medical training garment (5), a step of performing one or more compressions on the medical training garment (5) dressing the mannequin or human being, a retrieval step, via wireless communication with the processing unit (7), of the signals from the pressure sensor(s) (31) of the garment (5), a first transformation step, by the processing unit (7), of the signal(s) from the pressure sensor(s) (31) into said images (81) displayed by the processing unit (7) on the interface (71, 72) of the processing unit (7), a display step, on the interface (71, 72) of the processing unit (7), of said images (81), a transmission step, from the processing unit (7) to the virtual reality headset (8), by wireless communication, of said pressure signal(s), a second transformation step, by the virtual reality headset (8), of said pressure signal(s) into said images (181) subsequently displayed by the virtual reality headset (8), a display step, by the virtual reality headset (8), of said images (181), the virtual reality headset (8) being worn by the person performing said compression(s).