Robotic devices for minimally invasive soft tissue interventions

Abstract

The present invention relates to a robotic device (10) for performing a medical intervention on a patient (30) using a medical instrument (13), the robotic device (10) including: a robotic arm (11) having several degrees of freedom and having an end portion suitable for receiving the medical instrument; an image capture system (14) suitable for capturing positional information related to an internal structure of the patient; a storage medium (15) having a biomechanical model of the human body; processing circuitry (17) configured to identify position and orientation setpoints for the medical instrument based on the biomechanical model, based on the positional information, and based on a trajectory followed by the medical instrument (13) to perform the medical intervention; and control circuitry (16) configured to control the robotic arm (11) to position the medical instrument (13) at the position and orientation setpoints. [Selected Figure] Figure 1

Description

[Technical field]

[0001] The present invention relates to the field of medical intervention, and more particularly to robotic devices for minimally invasive medical interventions performed on deformable tissue of a patient, e.g. for performing treatment or diagnosis on deformable organs or anatomical structures. [Background technology]

[0002] Medical intervention (for diagnosis, therapy and / or surgery) by minimally invasive or percutaneous routes is becoming increasingly important in oncology, especially for the local treatment of cancer acting directly on the cells of diseased organs such as the liver, kidney, lung, pancreas, breast, prostate, etc.

[0003] Outside the field of oncology, there are many medical procedures and applications that use minimally invasive or percutaneous access routes, e.g., by needle insertion, such as biopsy (tissue collection for pathological analysis), placement of drains (absorption of bodily fluids), injection of therapeutic substances (pain treatment), etc.

[0004] In contrast to open or conventional surgery, which may require incisions spanning tens of centimeters, minimally invasive medical interventions use incisions or openings that are at most small enough to allow the insertion of an endoscope, probe, needle, or other medical instrument to reach, view, and / or treat the targeted anatomical area.

[0005] Minimally invasive medical interventions can offer many benefits, such as limited pain and scarring, reduced blood loss during surgical interventions, and shorter hospital stays, allowing medical interventions to be performed in outpatient settings, which can lead to faster recovery for patients, smaller scars, reduced risk of infection, etc.

[0006] In addition to traditional surgical excision techniques using forceps, scissors and other medical instruments, several techniques have been validated or are under evaluation for destroying tissue by minimally invasive or percutaneous routes. For example, laser surgery, cryotherapy, radiofrequency, microwave, electroporation treatment or even focused ultrasound and calitherapy may be mentioned. A common feature of many of these techniques is that a very small incision is made and one or more needles, probes or electrodes are inserted into the targeted anatomical area to deliver a precise and localized treatment (thermal, non-thermal or radiation therapy).

[0007] Medical interventions performed by minimally invasive routes mostly require the surgeon to insert a medical instrument to a certain depth inside the patient's body to reach the targeted anatomical area. These procedures are sometimes time-consuming and difficult because, unlike open surgery, the surgeon does not always have a direct view of the patient's internal structures and the organs to be treated. This makes it difficult to identify anatomical structures, place the medical instrument accurately, and avoid delicate anatomical structures (nerves, blood vessels, healthy organs, etc.).

[0008] Surgeons can use pre-operative medical images already acquired for diagnostic purposes (e.g., computed tomography (CT), magnetic resonance imaging (MRI), x-rays, etc.) to help register internal structures and plan medical interventions in advance. Pre-operative images provide a representation of internal structures valid at a point in time, which is prior to the time the medical intervention is performed, but not at the time the intervention is performed.

[0009] To accurately introduce a medical instrument to a desired location and depth within a patient's body during surgery without damaging delicate anatomical structures, the surgeon must know where the instrument is located within the patient's body. Today, several systems and methods are available for determining the location and orientation of a medical instrument during a minimally invasive intervention when direct visualization of internal structures is not available with a microscope or endoscope.

[0010] Image-guided navigation systems (i.e. computer-assisted surgery) display a virtual medical instrument on an image of the patient's body, allowing the position and orientation of the instrument to be tracked in real time. They use 3D localization techniques to register both the patient and the instrument, the most widely used being optical or electromagnetic.

[0011] An image capture system must be used before, at the start of and / or during a medical intervention to capture one or more images of the patient (by scan, MRI, X-ray, ultrasound, etc.). Before the medical intervention begins, these images are aligned with the actual position of the patient's internal structures on the operating table by various known registration methods, such as rigid or non-rigid registration of points and / or surfaces of interest or by reference to the position of the image capture system itself.

[0012] Optical navigation systems register and reference the position of or track the movement of a medical instrument by means of infrared cameras and emitters or reflectors positioned relative to known geometric characteristics of the medical instrument and the patient's body.

[0013] Electromagnetic navigation systems register the position of a medical instrument by using a low-intensity magnetic field generator placed near the patient's body, a sensor that can be built into the medical instrument, and a reference sensor placed on the patient's body. These electromagnetic navigation systems are compact and do not suffer from the problem of obstructed vision that optical navigation systems do. However, they require a specific restrictive environment coupled with the presence of a magnetic field generated by a magnetic field generator.

[0014] Although all known navigation systems can improve the accuracy of medical procedures compared to traditional manual methods by providing real-time position and orientation of medical instruments in an image, they have significant limitations for minimally invasive medical interventions on deformable tissue.

[0015] The first limitation is that the final step of introducing the medical instrument into the targeted anatomical region is performed by the surgeon's own hands, which means that the result is dependent on the surgeon's skill and does not allow for a high degree of precision.

[0016] A second limitation is that the functioning of these navigation systems presupposes that the target organ or anatomical structure has not moved or deformed between the time when the reference examination was performed and the time when the surgeon introduces the medical instrument. If the examination was performed several days before the medical intervention and if the patient assumes a different position on the operating table than he does on the examination table, the target organ or anatomical structure may have moved or deformed, resulting in significant inaccuracies between the displayed and real positions of the target organ or anatomical structure. In addition, the target organ or anatomical structure may simply be deformed by the patient's breathing, and known navigation systems are based on the control of the patient's breathing, which greatly limits the accuracy that can be achieved with these navigation systems.

[0017] There are also robotic devices to assist in medical procedures for minimally invasive surgery.

[0018] In particular, US Patent No. 8,795,188 discloses a system for medical intervention on a patient, which includes a robot, an apparatus for recording the patient's movements, and a method for automatically taking into account the patient's periodic movements, typically the thoracic movements due to breathing.

[0019] However, variations describing the use of navigation techniques or continuous laser scanners require pre-operative image capture and assume that the target organ or anatomical structure does not move or deform with respect to the patient's outer covering (skin), while variations describing the use of X-ray type images during the intervention require complex and irradiating installations of continuous image capture systems.

[0020] In addition, the aforementioned limitations in the case of medical interventions that require the insertion of a medical instrument into the patient's body can be generalized to encompass medical interventions that do not require the insertion of a medical instrument into the patient's body, for example, in the case of an instrument that provides focused ultrasound therapy, it must also be possible to control the path of ultrasound within the patient's body to a target anatomical region within the patient's body where the ultrasound must be focused. Summary of the Invention

[0021] The object of the present invention is to overcome all or some of the limitations of the prior art solutions, in particular the ones mentioned above, by providing a solution that assists the surgeon in positioning a medical instrument in relation to an organ or anatomical structure in a patient's body in order to perform a diagnosis or localized treatment, taking into account that said organ or anatomical structure may move or deform inside the patient's body.

[0022] To that end, according to a first aspect, the present invention provides a robotic device for performing a medical intervention on a patient using a medical instrument, the device comprising: a robotic arm having several degrees of freedom and having an end adapted to receive a medical instrument; an image capture system adapted to capture positional information regarding an internal structure of a patient; a storage medium having a biomechanical model of a human anatomical structure; a processing circuit configured to identify position and orientation setpoints for the medical instrument based on a biomechanical model, based on the position information, and based on a trajectory followed by the medical instrument to perform a medical intervention; and a control circuit configured to control the robotic arm to place or assist in placing the medical instrument at the position and orientation setpoints.

[0023] With this robotic arm, the accuracy and reproducibility of the positioning of the medical instrument is much higher than that of the surgeon. This increased accuracy means that the treatment selected by the surgeon can be performed in close proximity to the target organ or anatomical structure, thus improving the clinical effectiveness of the treatment. It is possible to envisage the treatment of lesions that are inoperable because they are too small or close to or in critical areas. This accuracy and reproducibility also makes it possible to reduce the risk of complications such as bleeding, pain and loss of function due to damage done to delicate anatomical structures in their path due to errors in the positioning of the medical instrument manually.

[0024] The robotic device also utilizes prior knowledge of a biomechanical model of the human body.

[0025] A "biomechanical model" of the human body is understood as a mathematical model of the various anatomical structures (muscles, tendons, bone structures, organs, vascular network, etc.) in a target anatomical region of the human body, thus of a patient, which allows the modeling of deformations of said anatomical structures and mechanical interactions between said anatomical structures. Such a biomechanical model therefore makes it possible to determine deformations and mechanical interactions (and therefore movements) induced in particular by internal anatomical structures of the patient, such as changes in the patient's envelope, changes in the position of the blood vessels of an organ, changes in the envelope of an organ, etc. Such changes may be induced, for example, by the patient's breathing (movements of organs induced by movements of the thorax and diaphragm), by changes in the patient's posture (movements of organs induced by gravity), by contact with a medical instrument (local deformations), etc. The target anatomical region corresponds, for example, to the thoracic region, and / or the abdominal region, and / or the pelvic region.

[0026] Thus, the robotic device uses the trajectory, the biomechanical model and the position information acquired during the medical intervention to determine the actual position of mobile and deformable anatomical structures inside the patient's body, regardless of the patient's position on the operating table and his / her breathing level. This feature significantly improves the performance of the medical intervention by avoiding operator errors and compensating for movements related to breathing and internal deformations of organs that are not taken into account in navigation and robotic systems known from the prior art.

[0027] For all these reasons, the robotic instrument is particularly suitable for minimally invasive medical intervention in a patient's deformable tissue.

[0028] In certain embodiments, the robotic device may additionally have one or more of the following features, either individually or in any technically feasible combination:

[0029] In certain embodiments, the biomechanical model models the anatomical structures of the human body within the thoracic region, and / or the abdominal region, and / or the pelvic region.

[0030] In certain embodiments, the image capture system is non-illuminating.

[0031] In fact, by taking into account the biomechanical model, the image capture system used during the intervention can be non-irradiating. "Non-irradiating" is understood to mean that no ionizing radiation (especially X-rays) is generated in the direction of the patient to capture images during the medical intervention. The radiation dose is therefore significantly reduced both for the patient and for the medical team in the vicinity of the image capture system. In addition, the image capture system is much cheaper and easier to handle than, for example, a CT scanner, which allows the robotic equipment to be used in small operating rooms that are not equipped with a CT scanner, making its use much less restrictive.

[0032] In certain embodiments, the image capture system comprises at least one so-called non-contact device suitable for capturing position information without contacting the patient.

[0033] In certain embodiments, the image capture system includes at least one of the following non-contact devices: stereo camera, structured light camera, time-of-flight camera, depth measuring camera, and the like.

[0034] In certain embodiments, the image capture system is adapted to provide position information corresponding to a location on an external surface of the patient's body.

[0035] In a particular embodiment, the image capture system comprises at least one so-called contact device suitable for capturing position information by contacting the patient.

[0036] In certain embodiments, the image capture system comprises at least one of the following contact devices: ultrasound probe, endoscope, etc.

[0037] In certain embodiments, the image capture system consists of one or more non-contact devices, i.e. the image capture system, or more generally the robotic device, only has one or more non-contact devices and does not include any contact devices for image capture.

[0038] In certain embodiments, the control circuitry is configured to control the robotic arm according to at least one of the following modes: automatic mode, collaborative mode, auto-tracking mode, collaborative tracking mode, etc.

[0039] In certain embodiments, the processing circuitry is configured to determine or assist in determining a trajectory of the medical instrument based on images of the patient.

[0040] In certain embodiments, the processing circuitry is configured to adjust or assist in adjusting parameters of a treatment performed during a medical intervention by simulating the effect of said parameters based on images of the patient.

[0041] In certain embodiments, the robotic instrument comprises a guide tool suitable for guiding a medical instrument that is fixed or intended to be fixed to the end of the robotic arm.

[0042] In certain embodiments, the robotic device comprises at least one man-machine interface device from the following devices: a display screen, a touch-sensitive display screen, a keyboard, 2D and / or 3D goggles, a joystick, a movement detection module, a voice-activated control module, etc.

[0043] In certain embodiments, the robotic device has at least one device for performing registration of the entry point from among the following devices: a medical instrument with a minimally invasive tip, a laser targeting module, etc.

[0044] In certain embodiments, the medical device is one of the following medical devices: a biopsy needle, a catheter, an endoscope or a treatment device using focused ultrasound, a laser treatment device, a device for cryotherapy treatment, a device for radiofrequency treatment, a device for electroporation treatment, a device for curietherapy treatment, etc.

[0045] In a particular embodiment, the robotic device comprises a mobile carriage carrying the robotic arm, said mobile carriage comprising a fixing means.

[0046] Figure presentation The invention will be better understood on reading the following description, given by way of non-limiting example, with reference to the drawings in which: [Brief description of the drawings]

[0047] [Figure 1] 1A-1D show schematic diagrams of embodiments of a robotic instrument for minimally invasive medical intervention in soft tissue. [Diagram 2] FIG. 2 shows a schematic diagram of an alternative embodiment of the robotic device of FIG. [Diagram 3]1A-1C show schematic diagrams of other embodiments of a robotic device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0048] In these figures, the same reference numbers between different drawings indicate the same or similar elements. For clarity, elements shown are not drawn to scale unless otherwise noted.

[0049] FIG. 1 illustrates diagrammatically an embodiment of a robotic device 10 for assisting a surgeon in a medical intervention, for example a minimally invasive intervention on soft tissue.

[0050] As shown in Fig. 1, the robotic device 10 comprises a robotic arm 11 with several degrees of freedom. The robotic arm 11 has an end suitable for receiving a medical instrument 13. In the example shown in Fig. 1, the medical instrument 13 is attached to the end of the robotic arm 11 by a guide tool 12 suitable for guiding said medical instrument 13. For this purpose, the robotic arm 11 has at said end a joint suitable for receiving said guide tool 12.

[0051] The robotic arm 11 preferably has at least six degrees of freedom to provide a wide range of spatial monitoring of the position and orientation of the guide tool 12 with respect to, for example, a patient 30 lying on a surgical table 20 .

[0052] The guide tool 12 is suitable for guiding the medical instrument 13, i.e. for constraining the movement of said medical instrument 13 relative to said guide tool 12. For example, the guide tool 12 is a slide suitable for guiding the medical instrument 13 in a translational movement, thereby constraining the movement of said medical instrument 13, for example during its insertion into the body of a patient 30.

[0053] The guide tool 12 is, for example, removably secured to the robotic arm 11, which is preferably adapted to receive different types of guide tools 12, for example associated with different medical instruments 13 and / or different medical procedures.

[0054] The joint of the robot arm 11 can have, for example, an error prevention mechanism to ensure the correct attachment of the guide tool 12 to the robot arm 11. In a preferred embodiment, the joint can additionally have an electronic system that automatically identifies the guide tool 12 attached by the surgeon, in order to later use in calculations the properties of the guide tool 12, such as its reference, its dimensions, its weight, its center of gravity, and any data useful for its function or its performance.

[0055] The robotic instrument 10 is preferably suitable for receiving, on a guide tool 12 carried by the robotic arm 11, any kind of medical instrument 13, in particular any kind of medical instrument used for minimally invasive interventions in soft tissue. For example, the robotic instrument 10 is preferably suitable for receiving the following surgical medical instruments: - Bio needles, - catheter, - endoscope, - therapeutic devices using focused ultrasound, - Laser treatment instruments, - equipment for cryotherapy treatment, - Radiofrequency treatment equipment; - devices for electroporation therapy, - Equipment for the treatment of curative therapy Suitable for receiving and transferring at least one of the following:

[0056] The robotic device 10 also comprises a control circuit 16 suitable for controlling the robot arm 11 to vary the position and orientation of the guide tool 12 in a reference coordinate system associated with the robotic device 10. The control circuit 16 comprises, for example, one or more processors and storage means (magnetic hard disk, electronic memory, optical disk, etc.) on which a computer program product is stored in the form of a set of program code instructions to be executed to control the robot arm 11. Alternatively or additionally, the control circuit 16 comprises one or more programmable logic circuits (FPGA, PLD, etc.), and / or one or more dedicated integrated circuits (ASIC, etc.), and / or a set of discrete electronic components, etc., suitable for controlling said robotic arm 11.

[0057] The control circuit 16, the robotic arm 11 and the guide tool 12 carried by the robotic arm 11 allow the medical instrument 13 to be positioned, orientated and guided with much greater precision than if the medical instrument 13 were directly manipulated by the surgeon.

[0058] In the example shown in Fig. 1, the robotic device 10 comprises a mobile carriage 18, for example mounted on wheels, on which the robotic arm 11 is mounted. Such an arrangement is particularly advantageous in that it is thus particularly easy to move the robotic arm 11 from one side of the operating table to the other, from one side of the operating room to the other, etc. The carriage 18 comprises fixing means (not shown in the figures) by means of which the carriage 18 can be fixed with respect to the operating table 20. The fixing means can be of any suitable kind and can in particular comprise brakes on the wheels, retractable pads or feet, a system for mechanical attachment to the operating table 20, a system for mechanical attachment to the floor, etc.

[0059] However, according to other examples, nothing excludes a direct, removably or permanent attachment of the robotic arm 11 to the operating table (in which case the operating table is an integral part of the robotic device 10). Figure 2 shows diagrammatically an alternative embodiment of the robotic device 10 in which the robotic arm 11 is removably attached to the operating table 20. In the example shown in Figure 2, the robotic arm 11 is mounted on a support 110 that forms a rigid mechanical link to a rail 21 of the operating table 20.

[0060] 1 and 2, the robotic device 10 also comprises an image capture system 14 suitable for capturing positional information regarding the internal structures of the patient 30 in a reference coordinate system related to the robotic device 10 or in a different coordinate system to said reference coordinate system, the passage matrix to which is known or identifiable in advance. In a preferred embodiment, the image capture system 14 is non-irradiating, thereby limiting the radiation dose to which the patient 30 and the medical team are exposed.

[0061] The image capture system 14 allows for the capture of positional information regarding internal structures of the patient 30. Positional information regarding internal structures of the patient 30 corresponds, for example, to the position of an outer surface of the body of the patient 30 within a reference coordinate system, the position of bone structures of the body of the patient 30 within a reference coordinate system, the position of internal organs or blood vessels of the body of the patient 30 within a reference coordinate system, etc.

[0062] In general, any type of image capture system 14 suitable for providing positional information regarding internal structures of the patient 30 can be used in the robotic device 10. For example, the image capture system 14 can comprise one or more so-called non-contact devices suitable for capturing positional information without contacting the patient 30 and / or one or more so-called contact devices suitable for capturing positional information by touching the patient 30. The image capture system of the robotic device preferably comprises only one or more non-contact devices and no contact devices.

[0063] In certain embodiments, the image capture system 14 includes the following non-contact devices: - stereoscopic camera, - Structured light camera, - Time-of-Flight camera (ToF camera), - Depth measurement cameras (e.g. RGB-D cameras), etc. The present invention has at least one of the following:

[0064] Such non-contact devices may capture position information representative of, for example, the position of an outer surface of the patient's 30 body relative to the non-contact device.

[0065] In certain embodiments, the image capture system 14 includes the following contact devices: - Ultrasonic probe (non-invasive contact capture), - Endoscope (capture by invasive contact), etc. The present invention has at least one of the following:

[0066] Such contact devices may capture position information representative of the location of organs or blood vessels within the patient's 30 body, for example.

[0067] The image capture system 14 is, for example, integrated in the robot arm 11 or attached to the end of said robot arm 11 .

[0068] In the example shown in Figures 1 and 2, the image capture system 14 is mounted on a support means separate from the robot arm 11. The support means is for example an optionally motorized articulated arm 140, which in this case forms a robot arm separate from the robot arm 11 carrying the guide tool 12 of the medical instrument 13. In the example shown in Figure 1, the articulated arm 140 is carried by the moving carriage 18, just like the robot arm 11. In the example shown in Figure 2, the articulated arm 140 carrying the image capture system 14 is carried by the moving carriage 18.

[0069] Moreover, according to other examples, it is in no way excluded that the image capture system 14 is carried by the surgeon to obtain positional information regarding the internal structures of the patient 30 .

[0070] The position and spatial orientation of the image capture system 14 is known, for example, in the reference coordinate system of the robotic device 10, from knowledge of its geometric properties if it is carried by the robotic arm 11, or through the use of a 3D localization system such as an optical, electromagnetic or other type of navigator.

[0071] As shown in Figures 1 and 2, the robotic device 10 also comprises a storage medium 15 for storing a biomechanical model of the anatomical structures of the human body. In the example shown in Figures 1 and 2, the storage medium 15 is represented separately from the control circuit 16. However, according to other embodiments, the storage medium 15 can also be one of the storage means of said control circuit 16.

[0072] It should be noted that the biomechanical model of the human body is not necessarily specific to the patient 30 under consideration, but may be a biomechanical model of a generic patient, for example of the same sex, height, build, etc. as the patient 30 on whom the medical procedure is performed. The biomechanical model preferably includes the main anatomical structures of the thoracic, abdominal and pelvic regions, such as the chest and abdominal walls, muscles, tendons, bones and joints, organs, vasculature, etc., as well as deformation models thereof and their mechanical interactions, etc. The biomechanical model preferably also takes into account the effect of gravity, which depends on the patient 30's posture.

[0073] Such biomechanical models are known in the scientific literature, see for example the following publications: -“SOFA: A Multi-Model Framework for Interactive Physical Simulation”, F. Faure et al., Soft Tissue Biomechanical Modeling for Computer Assisted Surgery-Studies in Mechanobiology, Tissue Engineering and Biomaterials, volume 11, Springer, -“A Personalized Biomechanical Model for Respiratory Motion Prediction”, B. Fuerst et al., International Conference on Medical Image Computing and Computer Assisted Intervention,2012, -“Patient-Specific Biomechanical Model as Whole-Body CT Image Registration Tool”, Mao Li et al., Medical Image Analysis, 2015, May, pages 22-34.

[0074] The biomechanical model can be created, for example, by transcription of a database of 3D medical images (CT scans, MRI scans, etc.). The geometric properties of the structures of interest can be extracted from the medical images by segmentation and reconstruction algorithms. By analysis of the image database, the average geometric properties of the components of the biomechanical model and also the main deformation parameters representative of all the medical images of the database can be calculated. The biomechanical model can be created by assigning to each of the structures mechanical properties and different boundary conditions. The biomechanical model preferably includes a modeling of the musculoskeletal system, which is composed of bones, muscles, tendons, ligaments and cartilage tissues.

[0075] 1 and 2, the robotic instrument 10 also includes a processing circuit 17 that is configured to identify position and orientation setpoints for the guide tool 12 based on a biomechanical model of the human anatomy and based on position information captured by the image capture system 14.

[0076] The processing circuitry 17 comprises, for example, one or more processors and storage means (magnetic hard disk, electronic memory, optical disk, etc.) in which a computer program product is stored in the form of a set of program code instructions that are executed to determine the position and orientation setpoints. Alternatively or additionally, the processing circuitry 17 comprises one or more programmable logic circuits (FPGA, PLD, etc.) and / or one or more specific integrated circuits (ASIC, etc.) and / or discrete electronic components suitable for determining the position and orientation setpoints, etc.

[0077] 1 and 2, the processing circuit 17 is shown as being separate from the control circuit 16. However, according to other embodiments, the processing circuit 17 can be integrated in said control circuit 16 or can also use equipment used by said control circuit 16. In addition, the storage medium 15 is shown as being separate from the processing circuit 17. However, according to other embodiments, the storage medium 15 can also be one of the storage means of said processing circuit 17.

[0078] Position and orientation setpoints for the guide tool 12 are additionally identified based on the trajectory followed by the medical instrument 13 during the medical intervention.

[0079] In the case of a medical intervention which requires the introduction of a medical tool 13 into the body of the patient 30, the trajectory corresponds to a trajectory along which the medical tool 13 must move and along which said medical tool must be guided during the medical intervention within the body of the patient 30. For example, the trajectory corresponds to the location of an entry point, for example on the external surface of an internal structure of the patient 30, from which the medical tool 13 must penetrate into the body of the patient 30, and also to the location of a target point within the body of the patient 30 in the region of a target anatomical structure where said medical tool 13 is to be reached. The entry point and the target point are for example stored within the frame of a coordinate system related to the internal structure of the patient 30.

[0080] In the case of medical interventions that do not require the introduction of a medical device 13 into the body of the patient 30, for example in the case of a focused ultrasound treatment device, the trajectory corresponds to the trajectory along which the ultrasound waves must travel within the body of the patient 30. For example, the trajectory corresponds to the location of an entry point on the outer surface of the internal structure of the patient 30 from which the ultrasound waves must penetrate into the body of the patient 30 and also to the location of a target point within the body of the patient 30 onto which the ultrasound waves must be focused. The entry points and the target points are stored, for example, in the form of a coordinate system related to the internal structure of the patient 30.

[0081] The trajectory may be pre-determined by means other than the robotic device 10, in which case it is stored, for example, in the storage medium 15 prior to the medical intervention. Alternatively or additionally, the trajectory may be determined by the robotic device 10, as described in the following description.

[0082] For example, the processing circuitry 17 includes an algorithm for adjusting the biomechanical model with position information on the internal structures of the patient 30, which information is provided by the image capture system 14. The processing circuitry 17 can thus determine the position and orientation of the patient 30 in a reference coordinate system relative to the robotic device 10. To determine the trajectory, the processing circuitry 17 can also determine the position of the entry point and the position of the end point of the trajectory in the reference coordinate system, taking into account deformations of the anatomical structures of the patient 30 (due to gravity, respiration, mechanical contact with medical instruments, etc.) with respect to the anatomical structures of the patient 30 under consideration. For example, an algorithm can propagate the movements of the surface of the skin to the internal volume to accurately calculate the positions of the anatomical structures inside the body. According to another example, the position and deformation of an organ can be determined from information on the position of the blood vessels of this organ (position information provided, for example, by an ultrasound probe). According to another example, the position and deformation of an organ can be determined from the position of the external surface of the organ (position information provided, for example, by an endoscope). The acquisition of information regarding the positions of the internal structures of the patient 30 and the calculations for adjusting the biomechanical model with said information regarding the positions of the internal structures of the patient 30 are preferably performed in real time or near real time, whereby the positions of the entry point and the target point in the reference coordinate system can be updated in real time or near real time to monitor the movements and deformations of the anatomical structures of the patient 30. This updating can also be performed while the medical device 13 is being inserted into the patient 30, whereby deformations induced by the movements of said medical device 13 are also taken into account.

[0083] After or simultaneously with determining the parameters of the trajectory (locations of the entry and destination points) in reference coordinates relative to the robotic device 10, the processing circuitry 17 determines position and orientation setpoints of the guide tool 12 to match the trajectory.

[0084] Control circuitry 16 may therefore control robotic arm 11 to place, or assist the surgeon in placing, guide tool 12 at the position and orientation setpoints identified by processing circuitry 17. In a preferred embodiment, control circuitry 16 operates in the following modes: - Automatic mode, - Collaborative mode, - Auto Tracking Mode, - Collaborative Tracking Mode The present invention is suitable for controlling the robot arm 11 according to at least one of the following:

[0085] In automatic mode, the control circuit 16 moves the robot arm 11 from its current position and orientation to a position setpoint and orientation setpoint by automatically calculating a trajectory between the current position and the position setpoint.

[0086] In the collaborative mode, the control circuitry 16 moves the robotic arm 11 in the direction of forces applied by the surgeon, which may be applied to the guide tool 12 or one of the shafts of the robotic arm 11. The forces are measured and calculated by one or more sensors (not shown) mounted on the end of the robotic arm 11 and / or on each of its shafts. Geometric constraints can be incorporated into the collaborative mode to limit the movement of the robotic arm 11, thereby facilitating the medical procedure. For example, the movement can be constrained to an area, outside an area, along an axis or curve, around a point, etc. The constraints can be defined by any kind of geometric shape and associated behavior (inclusion / exclusion). In the collaborative mode, the control circuitry 16 assists the surgeon in placing the guide tool 12 at the position and orientation setpoints.

[0087] In the tracking mode, the control circuitry 16 moves the robotic arm 11 in the direction of movement of the patient 30 to place the guide tool 12 at a position and orientation setpoint that are updated in real-time or near real-time by the processing circuitry 17. In this case, the medical instrument 13 moves within a reference coordinate system associated with the robotic device 10, but remains substantially stationary during the time it is in a coordinate system associated with the target organ.

[0088] In the collaborative tracking mode, the control circuitry 16 moves the robotic arm 11 in the direction of movement of the patient 30 with controlled positional flexibility. For example, the surgeon can apply a force to the guide tool 12, causing the position of the guide tool 12 to slightly and temporarily deviate from the position and orientation setpoints. The robotic arm 11 exerts forces that counteract those of the surgeon and attempt to return the guide tool 12 to the position and orientation setpoints when the force is no longer applied by the surgeon. The degree of flexibility can be adjusted, for example, by a stiffness parameter or a distance parameter.

[0089] FIG. 3 shows a schematic representation of a preferred embodiment in which the robotic device 10 has a man-machine interface device 19. In the example shown in FIG. 3, the man-machine interface device 19 is a display screen, preferably a touch screen. By means of the man-machine interface device 19 the surgeon can control the robotic device 10 and, where appropriate, view images related to the medical procedure to be performed. For example, the man-machine interface device 19 can be used when planning a medical procedure, for example by displaying the real-time or near real-time position of the medical device 13 with respect to the position of a target point in a reference coordinate system, to establish the trajectory of the medical device 13 or to visualize the progress of the medical device 13 inside the body of the patient 30. The man-machine interface device 19 can also be used to display images provided by the image capture system 14.

[0090] In the example shown in Fig. 3, the man-machine interface device 19 is carried by a moving carriage 18 which also carries the robot arm 11. According to other examples, it is not excluded at all that the man-machine interface device 19 is carried by another console or that it is for example removably attached to the rails of the operating table 20. Moreover, alternatively or additionally, other man-machine interface devices 19 can be envisaged. For example, the man-machine interface device 19 can include a mouse, a keyboard, a touchpad, a joystick, a non-contact movement detection module for registering the movements of the operator's hands, fingers, head or eyes, or a voice-activated control module, etc. In addition, 2D and / or 3D goggles can also replace or supplement the display screen.

[0091] To ensure safe use of the robotic device 10, the man-machine interface device 19 may also include a validation module (wired or wireless pedal, box-knob, remote control, switch on the robotic arm 11) as a safety feature for the movements of the robotic arm 11 such that the movements of the robotic arm 11 are conditional on the activation of said validation module.

[0092] In a preferred embodiment, the processing circuitry 17 is configured to determine or assist the surgeon in determining the trajectory of the medical instrument 13 based on images of the patient. The following description describes non-limiting examples of implementations of the robotic device 10 for planning a medical intervention that requires the introduction of a medical instrument into the body of a patient 30.

[0093] A medical intervention can be defined, for example, by the trajectory, the medical tool 13 used and the treatment parameters. The trajectory consists, for example, of a target point in the organ to be treated and an entry point, for example, on the skin. The medical tool 13 is defined by several characteristics, such as its length, its diameter, its 3D geometry, etc. The treatment parameters can include the settings of the ablation technique, such as the power of the delivered current, the treatment time, the diameter of the area, distance margins, etc.

[0094] The robotic device 10 can download images (CT scan, PET (Positron Emission Tomography) scan, MRI scan, X-ray, ultrasound, etc.) of the patient 30, for example from the hospital system or from an external system (cloud computing) or from an external storage medium (USB, CD, DVD, etc.), and the images can be viewed, for example in two-dimensional tomographic planes on the man-machine interface device 19, which are reconstructed in three dimensions. For example, by means of rigid and non-rigid registration algorithms, several images of the same patient 30 can be fused to provide the surgeon with all the anatomical and functional information required to plan the medical intervention. The surgeon can thus plan one or several trajectories depending on the medical intervention to be performed. For example, in the case of ablation by irreversible electroporation, the robotic device 10 can make precisely parallel trajectories in order to optimize the effect of the treatment.

[0095] The location of the trajectory target and entry points are identified, for example, manually in the image by the surgeon. The trajectory of the medical instrument 13 in the internal structure can be visualized in the image and modified to ensure that the end of the medical instrument 13 reaches the optimal target point and that the insertion of the medical instrument 13 does not damage delicate anatomical structures between the entry and target points. To facilitate the decision-making process during planning, the robotic device 10 can integrate segmentation algorithms that automatically identify the contours and volumes of specific organs, nerves, arteries, veins and vessels of interest, bones, and lesions to be treated. Alternatively, the robotic device 10 can automatically identify the target and entry points. For example, the target points are calculated by shape recognition methods based on the parameters of the treatment and the volume of the target lesion. The entry point can be calculated by methods for optimizing criteria such as the distance between the trajectory of the medical instrument 13 and the delicate anatomical structures and the position with respect to the preferred insertion area defined on the skin. Alternatively or additionally, the robotic device 10 can accumulate large amounts of planning data during its use, which can be reused, analyzed, and suggested via artificial intelligence algorithms to select optimal entry and destination points.

[0096] In a preferred embodiment, the processing circuit 17 is configured to adjust or help the surgeon adjust parameters of the treatment performed during the medical intervention by simulating the effect of said parameters based on an image of the patient. For example, from the treatment parameters, the trajectory information and the medical tool 13, the robotic device 10 can calculate the effect of the treatment on the internal structures and make it possible to visualize an accurate simulation on an image of the patient 30. For example, in case of thermal ablation, the calculation can take into account in particular the presence of adjacent blood vessels and the effect of cooling on them (heat sink effect). The surgeon can thus adjust the planning data in order to optimize the clinical result of the treatment.

[0097] In this manner, the above-described planning process can plan a wide range of medical procedures, such as laser surgery, cryotherapy, radiofrequency, microwave or electroporation ablation, curie therapy, endoscopy and any technique that requires the insertion of one or more medical instruments 13 into the body of the patient 30. The above-described planning process can also plan a wide range of medical procedures that do not require the insertion of a medical instrument 13 into the body of the patient 30, such as in the case of focused ultrasound therapy.

[0098] All data required for planning is secured by the robotic device 10 in the storage means of the processing circuit 17 or in the storage medium 15 or on an external storage medium and can be later recharged to change elements or perform treatment on the day of surgery using the robotic device 10.

[0099] An example will be described in which the robotic device 10 is used to perform a pre-planned medical procedure that requires the insertion of a medical instrument 13 into the body of a patient 30 .

[0100] To start the surgery, the robotic device 10 is brought into the operating room and placed next to the patient 30. If the robotic arm 11 is attached to a moving carriage 18, the robotic device 10 is fixed prior to the registration phase of the position of the patient 30.

[0101] Therefore, the surgeon controls the robotic device 10, for example by means of the man-machine interface device 19, and starts the registration phase of the patient 30. The registration phase of the patient 30 aims to identify the position of the patient 30 in a reference coordinate system relative to the robotic device 10, and also the positions of the entry and destination points, as well as the position and orientation set points of the guide tool 12, using the biomechanical model, the position information provided by the image capture system 14, and the planned trajectory.

[0102] Once the position of the patient 30 is known and coordinated with the pre-operative images, the surgeon begins the positioning phase, which aims to place the guide tool 12 at a position and orientation setpoint appropriate for the medical intervention to be performed.

[0103] For example, the robotic device 10 automatically positions the robotic arm 11 taking into account the dimensions of the guide tool 12, the location of the entry point, and the direction of the target point such that the guide tool is aligned on the selected trajectory and at a safe distance from the adjustable entry point. Thus, the surgeon can control the robotic arm 11, for example, in collaborative mode, to adjust the position of the guide tool 12 as close as possible to the entry point while still staying aligned with the trajectory, and then stop the movement of the robotic arm 11 and insert the medical instrument 13 through the guide tool 12.

[0104] In a preferred embodiment, the robotic device 10 includes a registration device (not shown) that allows the surgeon to precisely register an entry point on the patient's skin where an incision will be made. For example, the device for registering the entry point corresponds to a medical instrument having a minimally invasive tip that is inserted into the guide tool 12 or a laser targeting module that is integrated into the medical instrument 13 or the guide tool 12.

[0105] Once the incision has been made, the surgeon can begin the guiding phase by inserting the medical instrument 13 into the guide tool 12 until the tip of the medical instrument reaches the planned target point. The control of the insertion depth can simply be based on the length of the medical instrument 13 and / or a mechanical stop system built into the guide tool 12. Alternatively or additionally, the guide tool 12 can have a sensor to indicate the insertion depth of the medical instrument 13. The robotic device 10 can thus display the position of the medical instrument 13 in real time or near real time within the image and can provide messages to the surgeon when the target point is approached, reached or passed. In another variant, the medical instrument 13 is mechanically attached to the guide tool 12 and the robotic arm 11 automatically inserts the medical instrument 13 to the planned target point.

[0106] During insertion, the processing circuitry 17 can use a biomechanical model of the patient 30 to estimate local deformations of organs or anatomical structures through which the medical instrument 13 passes and take these deformations into account for updating the position of the target point.

[0107] Depending on the surgical requirements, during the guide phase the robotic instrument 10 is operated, for example, in a tracking mode or a collaborative tracking mode to maintain the position of the guide tool 12 relative to the target anatomy regardless of the movement of the patient 30. The robotic instrument 10 can also be operated in a collaborative mode by applying or not applying geometric constraints during the guide phase. A collaborative mode constrained on the trajectory axis is beneficial, for example, in performing a staged biopsy.

[0108] Once the medical instrument 13 reaches the target site, a planned medical intervention can be performed for diagnostic purposes or for localized treatment, such as taking tissue for a biopsy, delivering liquid nitrogen for cryotherapy, generating an electric current for radiofrequency ablation, injecting a radiation source for curettage, inserting the medical instrument into the working channel of an endoscope for direct visualization of internal body structures and endoscopic surgery.

[0109] At any time during or after the guiding phase, the surgeon can verify the correct insertion of the medical instrument 13 via the control images. Depending on the facilities available in the hospital and the operating room, the anatomical region of interest can be examined using fixed or mobile imaging devices (CT scanner, MRI scanner, radiological C-arc, ultrasound probe, etc.). In a preferred embodiment, the images are transmitted directly to the robotic device 10, whose processing circuitry 17 includes, for example, a registration algorithm for automatically fusing these intraoperative images with the preoperative images. Thus, the robotic device 10 displays planning information overlaid on the intraoperative images to assess the progress or effect of the treatment and identify corrections that must be made if necessary.

[0110] In a preferred embodiment of the invention, processing circuitry 17 may also include a segmentation algorithm to automatically identify the necrotic region, compare it to the planning region, calculate and display the resulting margin as a diameter or volume, and indicate the diameter or volume that remains to be treated. Optionally, the robotic device 10 may also provide information necessary for complementary treatment, such as the location and parameters of one or more additional ablation trajectories.

[0111] More generally, it should be noted that the embodiments and applications discussed above are described as non-limiting examples, and thus other variations are also envisaged.

[0112] In particular, the present invention is described with respect to a medical instrument 13 attached to the robotic arm 11 by a guide tool 12. However, it should be noted that the robotic device 10 can be used without the aid of a guide tool 12. For example, the use of a guide tool 12 is not required when the medical instrument 13 does not need to be introduced into the patient 30, such as in the case of external treatment with focused ultrasound. In addition, when the medical instrument 13 must be inserted into the patient 30, the use of a guide tool 12 is required if a surgeon is inserting the medical instrument 13 into the patient 30, but is not necessarily required if it is the robotic arm 11 that automatically inserts the medical instrument 13 into the patient 30.

Claims

1. A robotic device (10) for performing a medical intervention on a deformable anatomical structure placed inside a patient (30) using a medical instrument (13), comprising: a robotic arm (11) having several degrees of freedom and having an end suitable for receiving said medical instrument; an image capture system (14) adapted to capture positional information relating to an internal structure of the patient; a storage medium (15) having a biomechanical model of the anatomical structures of the human body; a processing circuit (17) configured to identify position and orientation setpoints for the medical instrument based on the biomechanical model, based on the position information regarding the internal structure of the patient, and based on a trajectory followed by the medical instrument (13) to perform the medical intervention; a control circuit (16) configured to control the robotic arm (11) to place or assist in placing the medical instrument at the position setpoint and the orientation setpoint; the image capture system (14) is non-illuminating and has only one or more non-contact devices suitable for capturing position information without contacting the patient (30), and has at least one of the following non-contact devices: a stereoscopic camera, a structured light camera, a time-of-flight camera, a depth measurement camera, and does not include any contact device for image capture; To determine the trajectory, the processing circuitry (17) determines a position of an entry point and a position of a target point of the trajectory in a reference coordinate system, taking into account deformations of the anatomical structures of the patient (30) relative to the anatomical structures of the patient (30) under consideration; The robotic device (10) captures the positional information of the patient's (30) internal structures and performs calculations to align the biomechanical model with the positional information of the patient's (30) internal structures in real time or near real time, thereby enabling the position of an entry point and the position of a target point in the reference coordinate system to be updated in real time or near real time to monitor the movement and deformation of the anatomical structures of the patient (30).

2. The robotic device (10) of claim 1, wherein the biomechanical model models the anatomical structures of the human body within a thoracic region, and / or an abdominal region, and / or a pelvic region.

3. The robotic device (10) of claim 1 or 2, wherein the image capture system (14) is adapted to provide position information corresponding to a position on an external surface of the body of the patient (30).

4. The control circuit (16) has the following modes: Auto mode, Collaborative mode, Auto-tracking mode, Collaborative tracking mode The robotic device (10) of any one of claims 1 to 3, configured to control the robotic arm according to at least one of:

5. The robotic device (10) of any one of claims 1 to 4, wherein the processing circuitry (17) is configured to determine or assist in determining the trajectory of the medical instrument based on images of the patient.

6. the processing circuitry (17) being configured to adjust or assist in adjusting parameters of a treatment performed during the medical intervention by simulating the effect of said parameters based on images of the patient, The robotic device (10) of any one of claims 1 to 5, wherein said parameters include at least setting parameters of an ablation technique.

7. The robotic device (10) of any one of claims 1 to 6, comprising a guide tool (12) suitable for guiding the medical instrument (13) fixed or intended to be fixed to the end of the robotic arm (11).

8. The following equipment: Display screens, touch-sensitive display screens, keyboards, 2D and / or 3D goggles, joysticks, movement detection modules, voice-activated control modules The robotic device (10) according to any one of claims 1 to 7, comprising at least one man-machine interface device (19) from among:

9. The following equipment: Medical instrument with minimally invasive tip, laser targeting module The robotic device (10) of any one of claims 1 to 8, comprising at least one device for performing entry point registration from among:

10. The medical device (13) is the following medical device: Biopsy needles, catheters, endoscopes, instruments for treatment using focused ultrasound, laser treatment instruments, instruments for cryotherapy treatment, instruments for radiofrequency treatment, instruments for electroporation treatment, instruments for curie therapy treatment The robotic device (10) of any one of claims 1 to 9,

11. A moving carriage (18) that carries the robot arm (11), The robotic device (10) according to any one of the preceding claims, wherein the mobile carriage comprises fixing means for fixing the mobile carriage to a surgical table.

12. 8. The robotic device (10) of claim 7, wherein the robot arm (11) exerts a force that counteracts a surgeon's force and tends to return the guide tool (12) to the position set point and the attitude set point when the force is no longer applied by the surgeon.

13. the processing circuitry (17) includes an algorithm for aligning the biomechanical model with the position information regarding the internal structure of the patient (30); the location information being provided by the image capture system (14); The robotic device (10) of any one of claims 1 to 12, wherein the processing circuitry (17) determines the position and the posture of the patient (30) within a reference coordinate system associated with the robotic device (10).

14. The robotic device (10) according to claim 13, wherein the algorithm makes it possible to propagate the movements of the surface of the skin to the internal volume in order to accurately calculate the position of the anatomical structures inside the body, and to determine the position and deformation of an organ from information on the position of the blood vessels of this organ or information on the position of the external surface of the organ.

Images