Medical system and method for determining a position of a puncture point
Patent Information
- Application Number
- EP2023710926
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-01-24
- Filing Date
- 2023-01-23
- Publication Date
- 2024-12-04
AI Technical Summary
Current medical systems for determining the position of a puncture site for accessing blood vessels are not precise enough, leading to multiple attempts and potential harm, especially in children.
A medical system comprising a device with a first illumination source, stereoscopic optical sensor, and calculation module that creates a 3D mapping of the blood vessel and puncture area, allowing for precise determination and projection of the puncture point, thereby reducing the number of failed attempts.
The system achieves a more precise calculation of the puncture point by considering the 3D mapping of both the blood vessel and puncture area, significantly reducing operator errors and maintaining sterility.
Smart Images

Figure 1.1
Abstract
Description
Medical system and method for determining a position of a puncture point Technical field
[0001] The present invention relates to a medical system and a method for determining a position of a puncture point, in particular of a puncture point belonging to a puncture zone below which is located a portion of a blood vessel, in order to facilitate access to this blood vessel by an operator. State of the art
[0002] There are several known solutions for determining the position of a puncture point, that is, a point at which an operator can insert a needle or catheter into a patient's body in order to access a patient's blood vessel.
[0003] In some known solutions, a projection of blood vessels can be made onto a patient's limb, in order to assist the operator who performs the injection. An example of such a solution is described for example in document US2004171923. However, these solutions do not allow a puncture point to be calculated and projected onto the patient's limb.
[0004] Other solutions allow calculating and projecting a puncture point on a patient's limb, as for example described in document EP1981395. These solutions are more interesting, because access to a blood vessel is easier for an operator compared to other known solutions.
[0005] However, the calculation of the puncture point is not yet sufficiently precise. Therefore, a successful puncture requires several attempts, even with the support of these known solutions. These failures have a certain impact on the patient, especially if the patient is a child.
[0006] US20120190981 describes a stand-alone device for intravenous needle insertion. This device comprises a first unit comprising sensors, such as an NIR source and an NIR camera, a second unit comprising a needle, and a robotic arm. Based on the information from the first unit, the arm is moved by actuators to insert the needle into the veins detected using the NIR camera. A perimeter can be displayed on the user's arm around the area below which the detected veins are located. This system does not require any projection of the position of the puncture point in order to show an operator this position, since it is a stand-alone device.
[0007] The document GENERATION AND EVALUATION OF HYPERSPECTRAL 3D SURFACE MODELS BASED ON A STRUCTURED LIGHT SYSTEM WITH HYPERSPECTRAL SNAPSHOT MOSAIC SENSORS, S. HEIST ET AL, Proceedings of SPIE, IEEE, US, Vol. 10667, 14.05.2018, describes a system for generating 3D hyperspectral models of surfaces, which can also find application in the medical field, for example for vein detection or 3D surface reconstruction of a hand. This system, based on hyperspectral snapshot cameras, also includes a high-speed broadband pattern projector, including several periodic sinusoidal patterns that vary, using a GOBO wheel (GOes Before Optics). This system is not concerned with calculating the position of a puncture point.
[0008] There is therefore a need for a medical system to determine a position of a puncture point free from the limitations of known systems.
[0009] There is also a need for a medical system to determine a puncture point position more accurately than known solutions. Brief summary of the invention
[0010] An object of the present invention is to provide a medical system for determining a position of a puncture point free from the limitations of known systems.
[0011] Another object of the invention is to provide a medical system for determining a position of a puncture point more precisely than known solutions.
[0012] According to the invention, these aims are achieved in particular by means of the medical system for determining a position of a puncture point according to claim 1, as well as by means of the method according to claim 20.
[0013] The medical system according to the invention makes it possible to determine a position of at least one puncture point on a puncture area below which is located a portion of a blood vessel. The medical system according to the invention therefore allows an operator to correctly introduce a needle or a catheter into a blood vessel of a patient.
[0014] In this context, the term "puncture area" means a portion of an (external) surface of a patient's skin, for example, the skin of a patient's limb. The patient may be a human being, for example, but not limited to, a child. The patient may also be an animal.
[0015] The system according to the invention comprises a device arranged to be placed at a certain distance from the puncture area. The fact that the The device is placed at a certain distance from the puncture area, and not in contact with the puncture area, allows to create a space (between the device and the puncture area) for the operator and also not to contaminate the puncture area, keeping it sterile after disinfection.
[0016] The device according to the invention comprises: - a first source of illumination, arranged to illuminate the sting area, - a stereoscopic optical sensor arranged to take initial images (of at least a portion) of the blood vessel.
[0017] Two (or more) (non-stereoscopic) cameras are a non-limiting example of a stereoscopic optical sensor according to the invention.
[0018] The system according to the invention also comprises a calculation module. In one variant, this calculation module is separate from the device and connected to the device, for example with communication means (wireless and / or with wires). In another variant, this calculation module is (at least partially) included in the device. In one variant, this calculation module is not a single block, but comprises several sub-blocks or sub-devices, connected to each other by communication means (wireless and / or with wires).
[0019] According to the invention, the calculation module is arranged to: - calculate a 3D (i.e. three-dimensional) mapping of the blood vessel, based on the first images; - calculate a 3D mapping of the sting area; - determine a 3D position of a puncture point of a needle and / or a catheter in the blood vessel, based on the 3D mapping of the blood vessel; - determine a 3D position of the puncture point, based on the 3D position of the puncture point in the blood vessel and the 3D mapping of the puncture area.
[0020] In one variant, the 3D mapping of the blood vessel, the 3D mapping of the puncture area, the 3D position of the puncture point in the blood vessel and / or the 3D position of the puncture point may be absolute or relative, to each other and / or for example to the puncture area, to a needle or to a catheter.
[0021] In one variant, the optical sensor, the computing module and the projector share the same coordinate system.
[0022] In the context of this invention, the expression "3D mapping of the stitching area" means a three-dimensional profiling of the stitching area. In other words, this 3D mapping makes it possible to know the 3D position of several points of the stitching area (or sub-areas of the stitching area), for example in the reference frame of the stereoscopic optical sensor.
[0023] In the context of this invention, the expression "3D mapping of the blood vessel" means a three-dimensional profiling of the subcutaneous blood vessel, for example a venous blood vessel. In other words, this 3D mapping makes it possible to know the 3D position of the blood vessel under the puncture area, for example in the reference frame of the stereoscopic optical sensor.
[0024] In the context of this invention, the term "puncture point" means a point of entry of a needle or catheter into a blood vessel.
[0025] According to the invention, the device comprises a projector for projecting the stitching point onto the stitching area in correspondence with the 3D position of the stitching point determined by the calculation module.
[0026] This solution has the advantage over the prior art of calculating the 3D position of the stitch more precisely than known solutions. Indeed, according to the invention, the 3D position of the stitch point The 3D position of the stitching point is calculated by also considering the 3D mapping of the stitching area. The 3D position of the stitching point thus calculated and displayed is more precise. Therefore, the number of failures of the operator using the system according to the invention is reduced compared to known solutions. In a variant, the 3D stitching position calculated by the system according to the invention is more precise by approximately 1 mm in at least one direction, compared to the same position calculated without taking into account the 3D mapping of the stitching area.
[0027] The 3D mapping of the sting area can be calculated by the calculation module based on different inputs or information.
[0028] In one variant, the device comprises a second illumination source, arranged to project a pattern onto the stitching area, and the stereoscopic optical sensor is arranged to take second images of the pattern. In this variant, the calculation module is arranged to calculate a 3D mapping of the stitching area based on these second images.
[0029] In one variant, the pattern is formed of dots and the calculation module is arranged to: - calculate the 3D position of the pattern points based on the second images, and - obtain the 3D mapping of the stitching area based on the 3D position of the pattern points.
[0030] Alternatively, the 3D position of the pattern points may be absolute or relative, for example relative to the puncture area, a needle, or a catheter.
[0031] In a variant, the points that form the pattern comprise (at least) one point (for example a central point), hereinafter called a reference point, which for example has a brightness and / or a dimension and / or a shape and / or a color different from the other points. The reference point reference could also have a specific known position in the pattern. The reference point could also be a missing point in a pattern. This allows this point to be used as a reference, in order to know which projected point corresponds to which "original" point in the pattern, that is, which point projected onto a flat surface placed at the same distance from the stitching area of the device.
[0032] Several possibilities can be envisaged for projecting a pattern onto the stitching area. In one variant, the system comprises an optical element in series with the second illumination source and which is arranged to create the pattern. This optical element can be, for example, an optical diffraction element (e.g., a dot array, a grid, etc.) or, for example, a structured light projection element.
[0033] In another variant, the system comprises several second illumination sources, each second illumination source projecting one or more points onto the stitching area, all of these points forming the pattern.
[0034] In other variants, the calculation module is arranged to calculate a 3D mapping of the stitching area based on different inputs from the second images of the pattern taken by the stereoscopic optical sensor.
[0035] For example, in another variant, the stereoscopic optical sensor is a first optical sensor, the device and / or system comprises a second optical sensor (not necessarily stereoscopic) arranged to take third images of the puncture area, and the calculation module is arranged to calculate a 3D mapping of the puncture area based on these third images.
[0036] In one variant, the second optical sensor is or comprises at least one RGB sensor, preferably two RGB sensors.
[0037] In one variant, the second optical sensor is or comprises a module of the Intel® RealSense™ Depth Module type (e.g. D401 and / or D405).
[0038] In one variant, the second optical sensor is or comprises a time-of-flight camera.
[0039] In a variant, the calculation module is arranged to calculate a 3D mapping of the puncture area based on the output of other modules or sensors that the system and / or device could include, for example a lidar, a radar, a module implementing artificial intelligence, etc. and / or any other module or sensor that can send to the calculation module the information necessary to calculate a 3D mapping of the puncture area. Non-limiting examples of this module and / or sensor include at least one of: - a photometric module, - a module arranged to determine a 3D mapping of the sting zone from a shading and / or a polarization, - a photometric stereo module, - a module arranged to determine a 3D mapping of the sting area with geometric reconstruction techniques, - a multi-view stereo module, - an active stereo module, - a module arranged to determine a 3D mapping of the sting area with structured light, - a module arranged to determine a 3D mapping of the sting area with modulated light, - a module arranged to determine a 3D mapping of the sting area with conoscopic holography, - a module arranged to determine a 3D mapping of the stitching area from shadows, contours, a texture, a model, a movement, a silhouette and / or a focus. - a module based on stereopsis, - an inverted stereoscopic and / or depth sensor, - a time-of-flight camera, - a module arranged to determine a 3D mapping of the sting zone with a lidar system, - a module arranged to determine a 3D mapping of the sting zone with a radar system, - a module arranged to determine a 3D mapping of the puncture area with a laser scanner, - a module arranged to determine a 3D mapping of the puncture area with an ultrasound system, - a module arranged to determine a 3D mapping of the sting area with a technique (for example reconstruction and mapping) based on machine learning, - a module arranged to determine a 3D mapping of the sting area with a technique based on simultaneous localization and mapping.
[0040] In this context, the expression “module implementing artificial intelligence” means a module arranged to simulate human thinking capability and / or human behavior.
[0041] In this context, the expression "module arranged to determine a 3D mapping of the puncture area with a technique based on machine learning" means a module which must be trained to learn, i.e. to progressively improve a performance on a specific task, in particular the determination of a 3D mapping of the puncture area.
[0042] In another variant, the calculation module is arranged to determine the distance between the device and the puncture area, for example on the basis of the second images, in particular on the basis of the reference point.
[0043] In one variant, the system may include alarm means, for example visual, audio and / or vibration means for signal to the operator whether or not this distance falls within a range of distances that allow the system to operate. In another variant, these alarm means include the same projector, which in this case is arranged to project onto the puncture area also information to signal to the operator whether or not this distance falls within the range of distances that allow the system to operate. The use of the projector as an alarm means allows the operator to receive information, while maintaining his attention on the puncture area.
[0044] In one variant, the calculation module is arranged to determine in real time a 3D position of a needle and / or a catheter on the basis of the first images. This 3D position can be absolute or relative, for example with respect to the puncture area.
[0045] In one variant, the computing module is arranged to determine in real time the orientation of a needle and / or a catheter based on the first images. This orientation may be absolute or relative, for example with respect to the puncture area.
[0046] In one variant, the calculation module is arranged to determine the position of the puncture and / or injection point also on the basis of the 3D position and / or orientation of the needle and / or catheter.
[0047] In one variant, the calculation module is arranged to determine and / or modify in real time the position of the puncture point so that the puncture point and the puncture point belong to a straight line corresponding to the main direction of the needle or catheter.
[0048] Alternatively, if the main direction of the needle or catheter changes (e.g. following a movement made by the operator), the calculation module redetermines the 3D position of the puncture point so that the puncture point and the puncture point belong to a straight line corresponding to the new main direction of the needle or catheter. In this case, the projector reprojects onto the area to stitch a new stitch point corresponding to the new position determined by the calculation module.
[0049] Once the needle or catheter enters the patient's skin, it is preferable that the direction of the needle or catheter is not changed by the operator. Alarms can be used to signal the operator to maintain this direction.
[0050] In one variant, the calculation module is arranged to determine the angle between the needle or catheter and the puncture area and check whether this angle falls within a determined range. In one variant, the alarm means are arranged to signal to the operator whether this angle falls within this range or not and, if necessary, to give instructions to the user on changing this angle, so that it may fall within the desired range.
[0051] In the variant that uses the second images of the pattern to calculate the 3D mapping of the puncture area, the stereoscopic optical sensor is arranged to alternately take a (first) image to determine the 3D mapping of the blood vessel and / or the needle and / or the catheter, and a (second) image to obtain the 3D mapping of the puncture area.
[0052] In one embodiment, the alarm means are arranged to confirm to the operator the entry of the needle and / or catheter into the blood vessel. In one embodiment, the alarm means are arranged to warn the operator if he is in the process of damaging the blood vessel, for example by crossing it from one side to the other.
[0053] In one embodiment, the computing module is arranged to differentiate the shadow of the needle and / or catheter on the puncture area from a blood vessel. In one embodiment, the computing module is arranged to differentiate hairs and / or tattoos and / or other visual artifacts on the puncture area from a blood vessel.
[0054] In a variant, when the needle and / or catheter touches the patient's skin, the calculation module is arranged to stop calculating the 3D mapping of the puncture area. Indeed, this 3D mapping is modified by the contact of the needle and / or catheter with the puncture area.
[0055] In a variant, the calculation module is arranged to follow the path of the needle and / or catheter in the patient's body until it enters the blood vessel on the basis of the first images, the alarm means being arranged to indicate to the operator when he must stop and / or warn him in advance if necessary.
[0056] In one variant, the first illumination source and / or the second illumination source is / are arranged to emit a spectrum in the NIR and / or IR band, possibly to emit several different wavelengths in the NIR and / or IR band. The combination of different wavelengths makes it possible to increase the quality of detection of blood vessels. In one variant, the first illumination source is arranged to emit the following two wavelengths: 850 nm and 940 nm.
[0057] In one variant, the first illumination source and / or the second illumination source is / are arranged to emit a spectrum in the visible or UV band, possibly to emit several different wavelengths in the visible and / or UV band, in order to allow the computing module to improve the 3D mapping of the blood vessel and / or to filter visual artifacts such as hairs, pimples or tattoos.
[0058] In one variant, the computing module is arranged to combine (first) images of different wavelengths to increase the quality of blood vessel detection and / or its 3D mapping.
[0059] In a variant, the calculation module is arranged to (re)determine the 3D position of the puncture point also on the basis of the 3D mapping of the puncture area. This can be useful when the position of the puncture point determined on the basis of a (first) position of the puncture point is not optimal, for example because it corresponds to a scar, a wound, a pimple, etc. In this case, the 3D position of the puncture point can be redetermined by the calculation module by also considering the 3D mapping of the puncture area.
[0060] In one variant, the needle and / or catheter comprises means enabling the computing module to track its movement outside and / or inside the puncture area, for example a light source arranged to illuminate its tip.
[0061] In a variant, the projector for projecting the puncture point onto the puncture area or a second projector of the device are arranged to project onto the puncture area or onto another area of the patient an image or video in order to distract the patient during the puncture.
[0062] The present invention also relates to a method for determining a position of a puncture point on a puncture area below which there is a blood vessel, comprising the steps of - place a device at a certain distance from the sting area, - illuminate the puncture area with a first illumination source from the device, - take the first images of the blood vessel with a stereoscopic optical sensor of the device, - calculate with a calculation module connected to the device and / or included in the device a 3D mapping of the blood vessel on the basis of the first images, - calculate with the calculation module a 3D mapping of the sting zone - determine with the calculation module the 3D position of a puncture point of a needle and / or catheter into the blood vessel, - determine with the calculation module a 3D position of the puncture point, based on the 3D position of the puncture point in the blood vessel and the 3D mapping of the puncture area, - project with a projector of the device onto the puncture area the puncture point in correspondence with its 3D position determined by the calculation module.
[0063] In one variant, the method comprises the steps of: - project a pattern onto the puncture area with a second illumination source of the device, - take second images of the pattern with the device's stereoscopic optical sensor, - calculate with the calculation module a 3D mapping of the puncture area based on the second images.
[0064] In another variant, the method comprises the steps of: - take third images of the sting area with a second optical sensor of the device, - calculate with the calculation module a 3D mapping of the sting zone based on the third images. Brief description of the figures
[0065] Examples of implementation of the invention are indicated in the description illustrated by the appended figures in which: Figure 1 illustrates a sectional view of an embodiment of the medical system according to one embodiment of the invention. Figure 2 illustrates a top view of one embodiment of the pattern projected onto a planar surface by the second illumination source of the medical system in one embodiment according to the invention. Figure 3 illustrates a top view of the embodiment of a portion of the pattern of Figure 2, as projected onto a puncture area by the second illumination source of the medical system in an embodiment according to the invention. Figure 4 schematically illustrates a cross-sectional view of a puncture area with a syringe. Example(s) of embodiment of the invention
[0066] Figure 1 illustrates a cross-sectional view of an embodiment of the medical system 100 according to one embodiment of the invention.
[0067] The medical system 100 makes it possible to determine a position of (at least) one puncture point P on a puncture area 40, below which is located a portion of a blood vessel 60, visible for example in FIG. 4. The medical system 100 according to the invention can calculate the position of several (optimal) puncture points P on a puncture area 40, the operator being able to choose one of them. The dimensions and proportions of the elements illustrated in FIGS. 1 and 4 do not necessarily correspond to the actual ones.
[0068] In this context, the term "puncture area" means a portion of an (external) surface of a patient's skin, for example the skin of a patient's limb, for example his arm. The dimensions of this "puncture area" are included, for example and without limitation, in the range 1 cm 2 at 100 cm 2 .
[0069] As can be seen in Figure 1, this puncture area 40 is not necessarily flat or planar. Indeed, it generally has (at least) a curvature. In known solutions, the fact that the puncture area is not necessarily flat or planar is not considered, which explains the lack of precision of the position of the calculated puncture point. Once the 3D position of the puncture point has been determined, the invention also takes into consideration the 3D mapping of the puncture area for calculating the 3D position of the puncture point, which is therefore more precise compared to known solutions.
[0070] As visible in Figure 1, the system 100 according to the invention comprises a device 10 arranged to be placed at a certain distance d from the pricking area 40. In a variant, this distance d is in the range 20 mm to 200 mm. For example and in a non-limiting manner, the device 10 comprises an arm allowing it to be positioned at the distance d from the pricking area 40. The fact that the device 10 is placed at a certain distance d from the pricking area 40, and not in contact (at least partially) with the pricking area 40, makes it possible to create a space for the operator between the device 10 and the pricking area 40, and also to not contaminate the pricking area 40, keeping it sterile after disinfection.
[0071] As seen in Figure 1, the device 10 comprises (at least) a first illumination source 1, arranged to illuminate the puncture area. In one variant, the first illumination source 1 is arranged to emit a spectrum in the NIR (Near Infra-Red) and / or IR (Infra-Red) band, possibly to emit several different wavelengths in the NIR and / or IR band. In one variant, the first illumination source 1 is arranged to emit the following two wavelengths: 850 nm and 940 nm. The combination of these two wavelengths makes it possible to increase the quality of detection of the blood vessels. In another variant, other wavelengths, in the visible and / or in the UV (UltraViolet), will be used to eliminate certain artifacts, such as hairs or tattoos (not shown) on the puncture area 40, and / or enrich / improve the blood vessel signal and the quality / accuracy of its 3D mapping. In a variant (non-limiting), the first illumination source 1 is a laser.
[0072] In the variant of Figure 1, the device 10 comprises (at least) a second illumination source 2, arranged to project a pattern 50 (visible for example in Figure 3) onto the stitching area 40. In one (non-limiting) variant, the second illumination source 2 is also a laser. In one variant, the second illumination source 2 is arranged to emit a spectrum in a band invisible to the human eye, for example in the NIR and / or IR band.
[0073] In the variant of Figure 1, the device 10 comprises a stereoscopic optical sensor 3 arranged to take first images (of at least a portion) of the blood vessel and to take second images (of at least a portion) of the pattern. The two (non-stereoscopic) cameras of Figure 1 are a non-limiting example of a stereoscopic optical sensor 3 according to the invention.
[0074] The system 100 according to the invention also comprises a calculation module 20, 20'. In one variant, this calculation module 20 is separate from the device 10 and connected to the device, for example with communication means (wireless and / or with wires). In another variant, this calculation module 20' is (at least partially) included in the device 10. In one variant, this calculation module 20, 20' is not a single block, but comprises several sub-blocks or sub-devices, connected to each other by communication means (wireless and / or with wires).
[0075] In one variant, the optical sensor 3, the computing module 20, 20' and the projector 4 share the same coordinate system.
[0076] In the variant of Figure 1, the calculation module 20, 20' is arranged to: - calculate a 3D mapping of the blood vessel, based on the first images, - calculate a 3D mapping of the sting zone 40, based on the second images, - determine the 3D position of the optimal puncture point P' of the needle and / or catheter in the blood vessel, - determine a 3D position of the puncture point P, based on the 3D position of the puncture point P' of the needle and / or catheter in the blood vessel and the 3D mapping of the puncture area, - project with a projector of the device onto the stitching area the stitching point P in correspondence with its previously determined 3D position.
[0077] According to the invention, the 3D mapping of the stitching area can be calculated by the calculation module 20, 20' on the basis of other inputs or information, different from the second images of the pattern.
[0078] In one variant, the device comprises a second illumination source, arranged to project a pattern onto the stitching area, and the stereoscopic optical sensor is arranged to take second images of the pattern. In this variant, the calculation module is arranged to calculate a 3D mapping of the stitching area based on these second images.
[0079] In other variants, the calculation module 20, 20' is arranged to calculate a 3D mapping of the stitching area 40 on the basis of different inputs from the second images of the pattern taken by the stereoscopic optical sensor 3.
[0080] For example, in another variant, the stereoscopic optical sensor 3 is a first optical sensor, the device 10 and / or the system 100 comprises a second optical sensor (not shown) arranged to take third images of the stitching area 40. In this variant, the calculation module 20, 20' is arranged to calculate a 3D mapping of the stitching area 40 on the basis of these third images.
[0081] In one variant, the second optical sensor is or comprises at least one RGB sensor, preferably two RGB sensors.
[0082] In one variant, the second optical sensor is or comprises a module of the Intel® RealSense™ Depth Module type (e.g. D401 and / or D405).
[0083] In one variant, the second optical sensor is or comprises a time-of-flight camera.
[0084] In a variant, the calculation module 20, 20' is arranged to calculate a 3D mapping of the puncture zone 40 on the basis of the output of other modules or sensors that the system 100 and / or the device 10 could comprise, for example a lidar, a radar, a module implementing artificial intelligence, etc. and / or any other module or sensor that can send to the calculation module 20, 20' the information necessary to calculate a 3D mapping of the puncture zone 40. In a variant, the calculation module 20, 20' is also arranged to: - supervise the path of the needle and / or catheter until the tip of the needle reaches the puncture point P' in the blood vessel, and / or - prevent and / or confirm with alarm means the entry of the needle and / or catheter into the blood vessel
[0085] The mapping of the 3D stitching zone makes it possible to know the 3D position of several points of the stitching zone 40 or of sub-zones of the stitching zone 40, for example in the reference frame of the stereoscopic optical sensor 3. In a variant, these points are those which form the pattern.
[0086] In a variant, obtaining the 3D mapping of the stitching surface also makes it possible to know at least one curvature of the stitching zone 40.
[0087] According to the invention, the device comprises a projector 4, for example a pico-projector, for projecting onto the stitching zone 40 the stitching point P in correspondence with its 3D position determined by the calculation module.
[0088] According to the invention, the 3D position of the stitching point P is calculated by also considering the 3D mapping of the stitching zone 40. The 3D position of the stitching point P thus calculated is more precise than the known solutions.
[0089] Figure 2 illustrates a top view of an embodiment of the pattern 50' as projected onto a flat or plane surface by the second illumination source 2 of the medical system 100 in a variant of the invention. Although in the example of Figure 2 the pattern 50' is in the form of a matrix or array of points 500', 510', this pattern 50' is not limiting.
[0090] In the variant of Figure 2, the pattern 50' is formed by several points, of which (at least) one point (for example a central point), hereinafter called reference point 500', has a brightness and / or a dimension and / or a shape and / or a color different from the other points 510'. The reference point 500' could also have a specific known position in the pattern 50', or be a missing point.
[0091] Figure 3 illustrates a top view of the embodiment of a portion of the pattern 50 of Figure 2, as projected onto a puncture area 40 by the second illumination source 2 of the medical system 100 in a variant of the invention. In the case where the puncture area 40 is not a planar or flat surface, the pattern 50 of Figure 3 is distorted relative to that 50' of Figure 2. Some points have a dimension, position and / or brightness different from those of Figure 2. The reference point 500 makes it possible to know which projected point 510 of Figure 3 corresponds to which “original” point 510' of Figure 2.
[0092] In a variant, the calculation module 20, 20' is arranged to analyze the image of FIG. 3, and thus calculate the 3D position of the points 500, 510 of the pattern 50. It is therefore possible to obtain in this case the 3D mapping of the stitching zone on the basis of the 3D position of the points 500, 510 of the pattern 50.
[0093] In a variant, the 3D mapping is obtained by the 3D position of the points 500, 510 of the pattern 50, as well as by an interpolation between these points 500, 510, which makes it possible to have a complete estimation of the 3D profiling of the stitching zone 40, which is precise for the needs of the system 100 according to the invention.
[0094] Several possibilities can be envisaged for projecting a pattern 50 onto the stitching area 40. In one variant, the system 100 comprises an optical element (not shown) in series with the second illumination source 2 and which is arranged to create the pattern 50. This optical element can be, for example, an optical diffraction element (for example, a dot array, a grid, etc.) or, for example, a structured light projection element.
[0095] In another variant, the system 100 comprises several second illumination sources 2, each second illumination source 2 projecting one or more points onto the stitching zone 40, all of these points forming the pattern 50.
[0096] In another variant, the calculation module 20, 20' is arranged to determine the distance d between the device 10 and the puncture zone 40, for example on the basis of the second images, for example on the basis of the reference point 500. In this case, the system 100 may comprise alarm means, for example visual, audio and / or vibration means to signal to the operator whether or not this distance d belongs to a range of distances allowing the system 100 to operate.
[0097] In another variant, these alarm means comprise the same projector 4, which in this case is arranged to project onto the sting area 40 also visual information to signal to the operator whether this distance d belongs or not to the range of distances allowing the system 100 to operate. The use of the projector 4 as an alarm means allows the operator to receive information, while maintaining his attention on the sting area 40.
[0098] In a variant, the calculation module 20, 20' is arranged to determine in real time the 3D position and / or an orientation of a needle 30 and / or a catheter on the basis of the first images. This 3D position and / or this orientation can be absolute or relative, for example with respect to the puncture zone 40.
[0099] In a variant, the calculation module 20, 20' is arranged to determine the position of the puncture point P and / or the puncture point P' also on the basis of the 3D position and / or the orientation of the needle 30 and / or the catheter.
[0100] In one variant, the alarm means are arranged to project onto the puncture zone 40 also information to signal to the operator whether the orientation of the needle 30 and / or the catheter must be modified or not before pricking the patient. In one variant, these alarm means are arranged to project onto the puncture zone 40 any information relevant to the proper conduct of the operations, for example the puncture direction (and not just the puncture point), the depth of the puncture point P', etc.
[0101] In a variant, the calculation module is arranged to determine and / or modify in real time the position of the puncture point P, so that the puncture point P and the puncture point P' belong to a straight line corresponding to the main direction X of the needle or catheter, as for example visible in figure 4.
[0102] In a variant, if the main direction X of the needle or catheter 30 changes (for example following a movement made by the operator), the calculation module 20, 20' redetermines the 3D position of the puncture point P so that the puncture point P and the puncture point P' belong to a straight line corresponding to the new main direction of the needle or catheter 30. In this case, the projector 4 reprojects onto the puncture zone 40 a new puncture point corresponding to the new position determined by the calculation module 20, 20'.
[0103] Once the needle or catheter 30 enters under the patient's skin, it is preferable that the direction of the needle or catheter is not changed by the operator. Alarm means may be used as appropriate to signal the operator to maintain this direction.
[0104] In a variant, the calculation module 20, 20' is arranged to determine the angle a (visible in FIG. 4) between the needle or the catheter and the puncture zone 40, or its tangent Y (for example in correspondence with the puncture point P) if the puncture zone 40 has a curvature.
[0105] In this variant, the calculation module 20, 20' is arranged to check whether this angle a belongs to a determined range, for example to the range 20°-40°. In a variant, the alarm means are arranged to signal to the operator whether this angle "belongs or not to this range and, if necessary, give instructions to the user (for example via the alarm means) on the change of this angle a, so that it can belong to the desired range.
[0106] In a variant, the stereoscopic optical sensor 3 is arranged to alternately take a (first) image to determine the 3D mapping of the blood vessel and / or the needle 30 and / or the catheter and a (second) image to obtain the 3D mapping of the puncture area. In this way, the system 100 according to the invention uses a single stereoscopic optical sensor 3, with two very different illumination sources 1, 2.
[0107] In one variant, the alarm means are arranged to warn and / or confirm to the operator the entry of the needle 30 and / or the catheter into the blood vessel.
[0108] In one variant, the calculation module is arranged to differentiate the shadow of the needle 30 and / or the catheter on the puncture area 40, from a blood vessel.
[0109] In a variant, when the needle 30 and / or the catheter touches the puncture zone 40, the calculation module 20, 20' is arranged to stop calculating the 3D mapping of the puncture zone 40. Indeed, this 3D mapping of the puncture zone is modified by the contact of the needle 30 and / or the catheter with the puncture zone 40.
[0110] In a variant, the calculation module 20, 20' is arranged to follow the path of the needle 30 and / or the catheter in the patient's body until it enters the blood vessel on the basis of the first images, the alarm means being arranged to indicate to the operator when he must stop and / or warn him in advance if necessary.
[0111] In one variant, the calculation module determines the optimal puncture point P' in the blood vessel by means of algorithms implementing the recommendations and / or experience of professionals (such as nurses, doctors, etc.).
[0112] In one variant, the calculation module includes a machine learning module, allowing it, for example, to continually improve the optimality of the choice of the puncture point P' in the 3D mapping of the blood vessel.
[0113] In a variant, the needle and / or the catheter 30 comprises means allowing the calculation module 20, 20' to follow its movement outside and / or inside the puncture zone 40, for example a light source arranged to illuminate its tip.
[0114] In a variant, the projector 4 for projecting the puncture point P onto the puncture area 40 or a second projector (not shown) of the device are arranged to project an image or video onto the puncture area or onto another area of the patient in order to distract the patient during the puncture. Reference numbers used in the figures 1 First source of illumination 2 Second source of illumination 3 Stereoscopic optical sensor 4 Projector 10 Device 20, 20' Calculation module 30 Needle 40 Sting area 50, 50' Pattern 60 Blood vessel 100 System 500, 500' Pattern reference point 510, 510' Pattern Points Distance P Stitch point P' Puncture point X Main direction of the needle Y Direction of the tangent to the sting zone in correspondence of P a Angle
Claims
27 Demands 1. Medical system (100) for determining the position of a puncture point (P) on a puncture site (40) below which lies a blood vessel (60), said system (100) comprising: - a device (10) arranged to be placed at a certain distance (d) from the sting zone (40), said device (10) comprising: - a first source of illumination (1), arranged to illuminate the sting area (40), - a stereoscopic optical sensor (3) arranged to take initial images of said blood vessel (60), - a calculation module (20, 20') arranged for: - calculate a 3D mapping of said blood vessel (60) based on said first images, - calculate a 3D mapping of the sting zone (40), - determine the 3D position of a puncture point (P') of a needle or catheter in the blood vessel (60), - determine the 3D position of the puncture point (P), based on the 3D position of the puncture point (P') and the 3D mapping of the puncture area, the device (10) comprising a projector (4) to project said puncture point (P) onto the puncture area (40) in correspondence with the position determined by the calculation module (20, 20').
2. System according to claim 1, the device (10) comprising: - a second illumination source (2), arranged to project a pattern (50) onto said sting area (40), the stereoscopic optical sensor (3) being arranged to take second images of the pattern, the computing module (20, 20') being arranged to calculate a 3D mapping of the sting area (40) on the basis of said second images.
3. System according to claim 2, wherein the pattern (50) is formed of points (500, 510) and the calculation module (20, 20') is arranged to: - calculate the 3D position of points (500, 510) of pattern (50) based on the second images, and - obtain the 3D mapping of the stitching area (40) based on the 3D position of the points (500, 510) of the pattern (50).
4. System according to claim 3, wherein the points which form the pattern (50) include a reference point (500), for example a point which has a brightness and / or size and / or shape and / or color different from the other points (510).
5. System according to any one of claims 2 to 4, comprising an optical element in series with the second illumination source (2) and arranged to create said pattern (50), and / or wherein the system (100) comprises several second illumination sources (2), each second illumination source (2) projecting a point onto the prick area (40), the set of these points forming the pattern (50).
6. System according to any one of claims 1 to 5, the stereoscopic optical sensor (3) being a first optical sensor, the device and / or the system comprising a second optical sensor arranged to take third images of the pitting zone (40), the computing module (20, 20') being arranged to calculate a 3D mapping of the pitting zone (40) on the basis of said third images.
7. System according to any one of claims 1 to 6, said calculation module (20, 20') being arranged to determine the distance (d) between the device and the sting zone (40), the system (100) comprising alarm means to signal to the operator whether this distance (d) belongs or not to a range of distances enabling the system (100) to function, these alarm means comprising for example said projector (4).
8. System according to any one of claims 1 to 7, said computing module (20, 20') being arranged to determine in real time a 3D position of a needle (30) and / or a catheter on the basis of said first images.
9. System according to any one of claims 1 to 8, said calculation module (20, 20') being arranged to determine in real time an orientation of a needle (30) and / or a catheter on the basis of said first images.
10. System according to any one of claims 8 or 9, said calculation module (20, 20') being arranged to determine the position of the puncture point (P) also on the basis of the 3D position and / or the orientation of the needle (30) and / or the catheter.
11. System according to any one of claims 2 to 10, wherein the stereoscopic optical sensor (3) is arranged to take alternately a first image to determine the 3D mapping of the blood vessel (60) and / or the needle (30) and / or the catheter and a second image to obtain the 3D mapping of the puncture area (40).
12. System according to any one of claims 7 to 11, the alarm means are arranged to warn and / or confirm to the operator the entry of the needle (30) and / or catheter into the blood vessel (60).
13. System according to any one of claims 1 to 12, said calculation module being arranged to differentiate the shadow of the needle and / or catheter on the puncture area from a blood vessel (60).
14. System according to any one of claims 1 to 13, said computing module is arranged to follow the path of the needle and / or catheter in the patient's body until entry into the blood vessel (60) on the basis of the first images, the alarm means being arranged to indicate to the operator when to stop and / or warn him upstream.
15. System according to any one of claims 1 to 14, the first illumination source (1) and / or the second illumination source (2) being arranged to emit a spectrum in the NIR and / or IR band, optionally to emit several different wavelengths in the NIR and / or IR band, for example to emit wavelengths of 850 nm and 940 nm.
16. System according to any one of claims 1 to 15, the first illumination source (1) and / or the second illumination source (2) being arranged to emit a spectrum in the visible or UV band, optionally to emit several different wavelengths in the visible and / or UV band, in order to enable the computing module to improve the 3D mapping of the blood vessel (60) and / or to filter out visual artifacts such as hairs, pimples or tattoos.
17. System according to any one of claims 1 to 16, the calculation module (20, 20') being arranged to determine and / or modify in real time the position of the puncture point (P) so that the puncture point (P) and the puncture point (P') belong to a straight line corresponding to the principal direction (X) of the needle or catheter (30).
18. System according to any one of claims 1 to 17, the calculation module (20, 20') being arranged to determine the angle (a) between the needle or catheter (30) and the puncture area (40) and to check whether this angle (a) belongs to a determined range.
19. System according to any one of claims 1 to 19, the projector (4) or a second projector of the device (10) is / are arranged to project onto the injection area (40) or onto another area of the patient an image or a video in order to distract him / her during the injection.
20. A method for determining the position of a puncture point (P) on a puncture zone (40) below which lies a blood vessel (60), comprising the steps of 31 - place a device (10) at a certain distance (d) from the sting area (40), - illuminate the sting area (10) with a first light source (1) of the device (10), - to take, with a stereoscopic optical sensor (3) of the device (10), the first images of said blood vessel (60), - to calculate, using a calculation module (20, 20') connected to the device (10) and / or included in the device (10), a 3D mapping of said blood vessel (60) based on said first images, - calculate using the calculation module (20, 20') a 3D mapping of the sting zone (40), - determine with the calculation module (20, 20') the 3D position of a puncture point (P') of a needle and / or catheter in the blood vessel (60), - calculate using the calculation module (20, 20') a 3D position of the puncture point (P), based on the 3D position of the puncture point (P') and the 3D mapping of the puncture zone (40), - project with a projector (4) of the device (10) onto the stinging area (40) said stinging point (P) corresponding to its 3D position determined by the calculation module (20, 20').
