Assisted anatomical localisation device and method

Abstract

The invention relates to an anatomical localisation device (2) and method. The method comprises: obtaining an image (IM1) of a patient (UR2); detecting at least two first anatomical points (PT1) associated with the skull of the patient; determining a first value (V1) representative of a reference distance (D1) separating the two first anatomical points; detecting two second anatomical points (PT2) associated with the shoulders of the patient; locating a midsternal line equidistant from the second anatomical points (PT2), wherein the midsternal line intersects, at a point of intersection, a segment defined by the second anatomical points (PT2); and determining co-ordinates (C1) of at least one target anatomical point (PT3) by calculating second distances (D2x, D2y) from the at least one target anatomical point to the point of intersection, wherein the second distances are determined on the basis of the first value (V1).

Description

[0001] DESCRIPTION

[0002] Title: Device and method for assisted anatomical localization

[0003] Domain

[0004] The invention relates to the field of anatomical point localization and more particularly to methods and devices enabling assisted localization of anatomical points of a subject, for purposes such as auscultation or applications in the field of medicine, telemedicine or well-being.

[0005] Previous technique

[0006] Traditionally, auscultation requires a thorough knowledge of human physiology to correctly identify the areas to be examined. Such examinations require specific technical skills, generally reserved for physicians.

[0007] Current solutions do allow for the localization of auscultation points on the human body, but only approximately, with the quality of results varying depending on the subjects examined and the conditions of use. Practitioners are not always able to precisely identify the position of auscultation points, which can compromise the accuracy and reliability of the auscultation.

[0008] Some current systems, particularly digital stethoscopes, offer the ability to capture bodily sounds but often lack precision, especially in non-clinical settings, such as noisy intervention environments that are not conducive to listening and concentration. Using this type of equipment presents a particular challenge for non-specialized users who are generally not qualified to locate the anatomical area(s) to be auscultated.

[0009] One of the main problems with current solutions is the need for specialized training to perform a proper auscultation, which limits the use of these devices by non-specialized emergency responders. Without adequate training, it is difficult for these responders to accurately locate the auscultation points, which can lead to examination or diagnostic errors, or to ineffective listening to bodily sounds.

[0010] Furthermore, obtaining an accurate diagnosis in less-than-ideal or noisy conditions is difficult without appropriate equipment. Conventional devices are not always designed to operate effectively in noisy environments, which can further complicate the task for practitioners and emergency responders.

[0011] Furthermore, current solutions generally lack ergonomics, making them impractical to use, especially in emergency situations or noisy environments.

[0012] The lack of adequate technological support to guide auscultation in patients, particularly in emergency settings, is therefore a major obstacle to patient care. In these situations, healthcare professionals often have to perform rapid and accurate examinations without the ideal conditions of a clinical setting. The inability to quickly and accurately locate auscultation sites can have detrimental consequences, potentially leading to inaccurate observations and therefore incorrect diagnoses or medical findings, which can be harmful to the patient being examined, for example, if they require medical attention. These difficulties can, in particular, lead to a decline in the quality of care provided to the patient in question.

[0013] In short, current techniques do not meet the needs of healthcare and wellness professionals, and more generally, of any practitioner tasked with examining or interacting with specific anatomical points on a human or animal body. These techniques suffer particularly from shortcomings in terms of precision, reliability, and ease of use, especially in emergency situations where speed and accuracy are crucial and / or when practitioners are not specialists in this type of procedure.

[0014] Description of the invention

[0015] One of the objects of the present invention is to solve at least one of the problems or deficiencies of the technological background described above.

[0016] Another object of the present invention is to enable precise, reliable and rapid localization of anatomical points of a subject, for example of an individual or an animal.

[0017] Another object of the present invention is to assist, or guide, in an efficient and ergonomic manner a practitioner in the localization of anatomical points of a subject.

[0018] To this end, a first aspect of the present invention relates to a method, also called an assisted anatomical localization method, implemented by a processing device, said method comprising: a) obtaining an image of a subject; b) detecting, in said image, at least two first anatomical points associated with the skull of the subject; c) determining a first representative value of a reference distance separating said at least two first anatomical points; d) detecting, in said image, two second anatomical points associated with the shoulders of the subject; e) locating a sternal midline equidistant from the second anatomical points, the sternal midline intersecting at a point of intersection a segment defined by the second anatomical points;and f) determination of coordinates of at least one target anatomical point by calculating second distances of said at least one target anatomical point with respect to the point of intersection, at least one of the second distances being determined from the first value.;

[0019] The method according to the invention may include other features which may be taken separately or in combination, in particular among the following embodiments which are presented by way of illustration only and may be combined or associated unless otherwise stipulated.

[0020] According to a particular embodiment, obtaining the image a) comprises at least one of the following:

[0021] - image acquisition using a camera embedded in the processing device;

[0022] - receiving the image from a remote server; and

[0023] - Extracting the image from a memory embedded in the processing device.

[0024] According to a particular embodiment, the first anatomical points detected in b) include at least one of the following:

[0025] - anatomical points associated with the subject's eyes, visible in the image; and

[0026] - anatomical points associated with the subject's ears visible in the image.

[0027] According to a particular embodiment, the process comprises:

[0028] - searching for candidate anatomical points in the image; and

[0029] - selection, from among the candidate anatomical points detected in the image, of the first anatomical points used in c).

[0030] According to a particular embodiment, during determination c), the first value is defined as a function of a number of pixels, in the image obtained in a), separating said at least two first anatomical points.

[0031] According to a particular embodiment, during detection d), the second anatomical points are associated with the subject's shoulder points. According to a particular embodiment, the sternal midline forms a perpendicular bisector of the segment defined by the second anatomical points.

[0032] According to a particular embodiment, during determination f), one of the second distances is determined by applying a proportionality coefficient to the first value.

[0033] According to a particular embodiment, determination f) comprises:

[0034] - determination of a second distance D2x along a first axis of an anatomical reference frame associated with the subject visible in the image such that D2x = Kx; and

[0035] - determination of a second distance D2y along a second axis of the anatomical reference frame such that D2y = Ky ■ VI, where Kx is a constant and Ky is said proportionality coefficient.

[0036] According to a particular embodiment, the process comprises:

[0037] - display of an image, called the second image, according to an image reference frame, said second image being determined from the image (IM 1) obtained in a); in which determination f) comprises:

[0038] - determination of initial coordinates (X1, Y1) of said at least one target anatomical point in the anatomical reference frame, said initial coordinates (X1, Y1) being defined as a function of the pair (D2x, D2y); and

[0039] - conversion of the first coordinates (X1, Y1), as second coordinates (X2, Y2), in the image reference frame (RF2) associated with said second image.

[0040] According to a particular embodiment, determination f) comprises:

[0041] - conversion of the second coordinates (X2, Y2) as third coordinates (X3, Y3) in the display reference associated with a graphical representation of said image.

[0042] According to a particular embodiment, the method comprises: e) providing instructions to guide a user to said at least one target anatomical point.

[0043] According to a particular embodiment, the instruction provided in e) includes at least one of the following:

[0044] - a visual instruction;

[0045] - an audible instruction; and

[0046] - a vibration control.

[0047] According to a particular embodiment, the supply (e) comprises:

[0048] - display of the image and at least one visual indicator, superimposed on the displayed image, said at least one visual indicator being representative of a target position associated with said at least one target anatomical point.

[0049] According to a particular embodiment, the first value represents a number of pixels separating said at least two first anatomical points, in which the supply e) comprises:

[0050] - estimation of a dimension ratio between the number of pixels defined by the first value and a reference value; and

[0051] - adaptation of at least one dimension of the visual indicator according to said dimension ratio.

[0052] In one particular embodiment, the different stages of the process according to the first aspect are determined by computer program instructions.

[0053] Accordingly, the invention according to a second aspect relates to a computer program on an information medium (or recording medium), this program being capable of being implemented in a device, called a processing device, or more generally in a computer, this program comprising instructions adapted to the implementation of the steps of a process according to the first aspect of the invention.

[0054] This program can use any programming language, and be in the form of source code, object code, or code somewhere between source code and object code, such as in a partially compiled form, or in any other desirable form.

[0055] The invention according to a third aspect relates to an information medium (or recording medium) readable by a computer, and comprising instructions for a computer program according to the second aspect of the invention.

[0056] The information medium can be any entity or device capable of storing the program. For example, the medium may include a storage means, such as rewritable non-volatile memory or ROM, for example a CD-ROM or a microelectronic circuit ROM, or a magnetic recording means, for example a hard disk drive.

[0057] On the other hand, the information medium can be a transmissible medium such as an electrical or optical signal, which can be transmitted via an electrical or optical cable, by radio, or by other means. The program according to the invention can, in particular, be uploaded to a network such as the Internet.

[0058] Alternatively, the information carrier may be an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the process in question. A fourth aspect of the invention relates to a device, also called a processing device or localization device, configured to implement the process of the first aspect of the invention. In particular, the fourth aspect of the invention relates to a processing device comprising:

[0059] - a data acquisition module configured to obtain an image of a subject;

[0060] - a first detection module configured to detect, in said image, at least two initial anatomical points associated with the subject's skull;

[0061] - a first determination module configured to determine a first representative value of a reference distance (D1) separating said at least two first anatomical points;

[0062] - a second detection module configured to detect, in said image, two second anatomical points associated with the subject's shoulders;

[0063] - a localization module configured to locate a sternal midline equidistant from the second anatomical points, the sternal midline intersecting at a point of intersection a segment defined by the second anatomical points; and

[0064] - a second determination module configured to determine coordinates of at least one target anatomical point by calculating second distances of said at least one target anatomical point with respect to the point of intersection, the second distances being determined from the first value.

[0065] Note that the various embodiments mentioned above (as well as those described below) in relation to the process according to the first aspect of the invention and the associated advantages apply in a similar way to the device according to the fourth aspect of the invention.

[0066] For each step of the process according to the first aspect, the device according to the fourth aspect may include a corresponding module configured to carry out said step.

[0067] According to one embodiment, the invention is implemented using software and / or hardware components. In this context, the term "module" in this document may refer to a software component, a hardware component, or a set of hardware and software components.

[0068] A software component corresponds to one or more computer programs, one or more subroutines of a program, or more generally to any element of a program or software capable of implementing a function or set of functions, as described below for the module in question. Such a software component can be executed by a data processor of a physical entity (terminal, server, etc.) and is capable of accessing the hardware resources of that physical entity (memory, storage media, communication buses, input / output cards, user interfaces, etc.).

[0069] Similarly, a hardware component corresponds to any element of a hardware assembly capable of implementing a function or set of functions, as described below for the module in question. This could be a programmable hardware component or one with an integrated processor for software execution, for example, an integrated circuit, a smart card, a memory card, an electronic board for running firmware, etc.

[0070] Brief description of the drawings

[0071] Other features and advantages of the present invention will become apparent from the description of the specific and non-limiting embodiments of the present invention below, with reference to the attached Figures 1 to 5, in which:

[0072] [Fig. 1] Figure 1 schematically represents a processing device and more generally a localization system, according to at least one particular embodiment of the invention;

[0073] [Fig. 2] Figure 2 schematically represents the processing device of Figure 1 according to at least one particular embodiment of the invention;

[0074] [Fig. 3] Figure 3 schematically represents, in the form of a diagram, the steps of an assisted anatomical localization process according to particular embodiments of the invention;

[0075] [Fig. 4] Figure 4 schematically represents the implementation of steps of the assisted anatomical localization process of Figure 3, according to at least one particular embodiment of the invention;

[0076] [Fig. 5] Figure 5 schematically represents the implementation of steps of the assisted anatomical localization process of Figure 3, according to at least one particular embodiment of the invention;

[0077] [Fig. 6] Figure 6 schematically represents the implementation of steps in the assisted anatomical localization process of Figure 3, according to at least one particular embodiment of the invention; and

[0078] [Fig. 7] Figure 7 schematically represents the implementation of steps in the assisted anatomical localization process of Figure 3, according to at least one particular embodiment of the invention.

[0079] Examples of implementations of the invention will now be described in what follows with joint reference to Figures 1-8. Unless otherwise indicated, common or similar elements in several figures bear the same reference symbols and have identical or similar characteristics, so that these common elements are generally not described again for the sake of simplicity.

[0080] The terms "first(s)", "second(s)", etc.) are used in this document by arbitrary convention to allow identification and distinction of different elements (such as operations, threshold values, etc.) implemented in the embodiments described below.

[0081] In the following description, the terms "superior / inferior", "right / left", "top / bottom", "front / back" and generally terms designating a spatial reference, concern the position in which the elements appear on the attached figures in accordance with their context of use.

[0082] The present invention is based on processing an image of a subject to detect at least one target anatomical point from reference elements of the human body used for said detection. This processing specifically involves detecting at least two first anatomical points associated with the subject's skull (or head) and at least two second anatomical points associated with the subject's shoulders. From physiological data deduced from these first and second anatomical points, the coordinates of at least one target anatomical point to be identified in or on the subject's body can be determined accurately, reliably, and rapidly.

[0083] The invention, according to its various embodiments, thus implements a method of assisted anatomical localization, said method comprising: a) obtaining an image of a subject; b) detecting, in said image, at least two first anatomical points associated with the skull of the subject; c) determining a first representative value of a reference distance (D1) separating said at least two first anatomical points; d) detecting, in said image, two second anatomical points associated with the shoulders of the subject; e) locating a sternal midline equidistant from the second anatomical points, the sternal midline intersecting at a point of intersection a segment defined by the second anatomical points;and f) determination of coordinates of at least one target anatomical point by calculating second distances of said at least one target anatomical point with respect to the point of intersection, the second distances being determined from the first value.;

[0084] The process can be implemented by a device, hereafter referred to as a processing device (or localization device), this device comprising means for implementing the steps of the process of the invention.

[0085] Other aspects and advantages of the present invention will become apparent from the embodiments described below with reference to the drawings mentioned above.

[0086] This document describes examples of implementing the invention in the context of locating anatomical points on an individual, i.e., applied to a human body (this individual may be living or dead). Alternatively, the invention can be applied similarly to an animal, in particular a vertebrate animal (for example, a mammal).

[0087] In this document, an anatomical point refers to a specific and well-defined location on the human (or possibly animal) body, identifiable by physical or physiological landmarks. These points can be used as references for various medical or wellness procedures, including auscultation, observations, examinations, manipulations, treatments, diagnoses, and various interventions (surgical or otherwise). They can serve as guides for healthcare or wellness professionals to locate underlying structures, such as organs, bones, and blood vessels, thus enabling targeted and effective assessment and intervention. Precise location of anatomical points ensures appropriate medical examinations and treatments, particularly in contexts where speed and accuracy are crucial.

[0088] Unless otherwise indicated, elements common or similar to several figures bear the same reference signs and have identical or similar characteristics, so that these common elements are generally not described again for the sake of simplicity.

[0089] Figure 1 schematically represents a processing device (also called a device) 2 intended for use by a practitioner (or user) UR1 to implement an assisted localization procedure (also called an anatomical localization procedure or localization procedure) in order to locate at least one target anatomical point PT3 of a subject, namely an individual UR2 in this example. For example, this individual UR2 could be a person requiring first aid, for instance in an emergency situation, although other contexts of use are possible. The subject UR2 undergoing assisted anatomical localization can be in any position, for example, a supine position (prone, supine, or otherwise).

[0090] To implement the assisted anatomical localization process, also referred to hereafter as the localization process, the processing device 2 includes in the example considered a processor 4, a user interface 6 and a non-volatile memory 8.

[0091] As illustrated in Figure 1, device 2 is configured to obtain an image IM1 from an image acquisition device 10. It is assumed hereafter that this image acquisition device 10 is (or includes) a camera, although any other suitable device for capturing images or videos could be used. Device 2 and camera 10 together form a system, also called a localization system, denoted SY1.

[0092] The camera 10 can be part of the device 2 or be external to it. For the sake of example, we will assume that the processing device 2 is a terminal, for example a mobile terminal such as a smartphone, tablet or other, comprising a camera 10 capable of acquiring one or more images IM1 of a subject UR2, for example in the form of at least one image, a sequence of images or video.

[0093] Device 2, shown in Figure 1, is only one example of an embodiment; other implementations are possible within the scope of the invention. Those skilled in the art will understand, in particular, that certain elements of Device 2 are described here only to facilitate understanding of the invention, as these elements are not essential for implementing the invention.

[0094] Memory 8 may include one or more memories, in particular rewritable non-volatile memory and / or read-only memory (ROM). Memory 8 may also optionally include volatile memory (RAM). This memory 8 constitutes a recording medium (or information storage medium) according to a particular embodiment, readable by device 2, and on which a computer program PG1 according to a particular embodiment is stored. This computer program PG1 contains instructions for executing the steps of an assisted anatomical localization process according to a particular embodiment. The steps of this process are shown, in a particular embodiment of the invention, in Figure 3 described below.

[0095] The processor 4 is configured to execute the instructions of the computer program PG1 in order to perform steps of the assisted anatomical localization process. For this purpose, the processor 4 may include integrated memory, an input / output interface, and various circuits known to those skilled in the art. In particular, the processor 4 may use the memory 8 to perform the various operations and functions necessary for the operation of the device 2, including executing the computer program PG1 during the implementation of the anatomical localization process of the invention. At least a portion of the memory 8 may be part of the processor 4.

[0096] Memory 8 is capable of storing various data useful for implementing the localization method of the invention, in particular: an image IM1 in the form of image data, anatomical point data defining first and second anatomical points PT1 and PT2 respectively, a value V1 representing a reference distance D1, and coordinates denoted C1, O2, and O3 of at least one target anatomical point PT3 located by the localization method. The nature of this data and how it is used will become clearer in the description of the following embodiments with reference to the figures.

[0097] The user interface 6 may include any appropriate means by which the UR1 practitioner can interact with their device 2.

[0098] According to one example, the output interface of user interface 6 may include means of delivery suitable for transmitting (or presenting) information to the practitioner UR1, in particular at least one instruction CM1 to guide the practitioner and help them locate at least one target anatomical point PT3.

[0099] The user interface 6 may further include an input interface enabling the practitioner UR1 to provide user instructions to the device 2, in particular to control the execution of the localization process according to the computer program PG1.

[0100] As illustrated in Figure 1 by a specific example, device 2 is capable of triggering the display, by a display device 14 (for example, a screen), of an image IM2 of all or part of the subject UR2, this image IM2 being obtained (or derived) by processing from the image IM1 acquired by the image acquisition device 10. It is assumed hereafter that the display device 14 is included in the user interface 6, although other examples where the display device 14 is external to device 2 are possible. It should be noted that embodiments in which no image IM2 is displayed are also possible.

[0101] The image IM2 thus displayed may be identical or different from the image IM1 captured by the camera 10, as the case may be. The displayed image IM2 may, for example, be a version of the acquired image IM1 but in a different format or resolution than that of the acquired image IM1. An image conversion may, for example, be performed by the device 2 if the format of the obtained image IM1 does not correspond to the format of the image IM2 that one wishes to display on the screen 14, as described below in specific examples.As shown in Figure 2 according to a particular embodiment, the processor 2 controlled by the computer program PG1 here implements a number of modules, namely: an acquisition module MD2, a first detection module MD4, a first determination module MD6, a second detection module MD8, a localization module MD10, a second determination module MD12, and possibly also a supply module (or guidance module) MD14.

[0102] More specifically, the MD2 acquisition module is configured to obtain an IM1 image of a UR2 subject (or person).

[0103] The first MD4 detection module is configured to detect, in the IM1 image, at least two first anatomical points PT1 associated with the skull of subject UR2.

[0104] The first MD6 determination module is configured to determine a first value V1 representative of a reference distance D1 separating said at least two first anatomical points PT 1.

[0105] The second MD8 detection module is configured to detect, in the IM1 image, two (or at least two) second anatomical points PT2 associated with the subject's shoulders.

[0106] The MD10 localization module is configured to locate a sternal midline L1 equidistant from the second anatomical points PT2, this sternal midline L1 intersecting at an intersection point noted PN1 a segment SG1 defined by the second anatomical points PT2.

[0107] The second determination module MD12 is configured to determine coordinates C1 of at least one anatomical target point PT3 by calculating second distances D2x and D2y of said at least one anatomical target point PT3 with respect to the intersection point PN1, these second distances D2x and D2y being determined from the first value V1 determined by the first determination module MD6.

[0108] If appropriate, the MD14 delivery module is configured to provide (or generate, or render) a CM1 instruction to guide a user, namely the UR1 practitioner in this example, to said at least one anatomical target point PT3.

[0109] In one particular embodiment, the modules M2 to MD14 are controlled or implemented by the processor 4 by executing the computer program PG1, the latter being able to take the form of a software application or any other suitable form.

[0110] The configuration and operation of the MD2-MD14 modules of Device 2 will be shown in more detail in the embodiment examples described below with reference to the figures. It should be noted that the MD2-MD14 modules as shown in Figure 2 represent only one non-limiting example of an implementation of the invention. Generally, for each step of the assisted anatomical localization process of the invention, Device 2 may include a corresponding module configured to perform said step.

[0111] As illustrated in Figures 3 to 7 according to specific embodiments, the steps of the assisted anatomical localization process of the invention implemented by the processing device 2, and more generally by the SY2 system, as previously described with reference to Figures 1-2, are now described. To this end, the device 2 executes the instructions of the computer program PG1 to implement the steps S2-S14 of the anatomical localization process.

[0112] In what follows, we assume that a practitioner UR1, for example, an emergency responder (a firefighter, paramedic, or other), uses device 2, in this case a smartphone or tablet, to locate at least one target anatomical point PT3 of an individual UR2 requiring examination, for example, for first aid purposes. To do this, the practitioner UR1 positions device 2 and activates camera 10 to acquire an image IM1 of all or part of the subject UR1. For the sake of example, we assume that camera 10 is integrated into device 2.

[0113] Thus, during an acquisition step S2 (Figures 3-4), the device 2 obtains the image(s) IM1 acquired by the camera 10. This image IM1 is stored, as image data, in the memory 8 for further processing (Figure 1). A plurality of IM1 images can therefore be obtained during this step S2, for example in the form of a sequence of images or a video, these IM1 images then being processed in a manner analogous to that described below for the IM1 image under consideration.

[0114] Note that the IM1 image can be obtained (S2, figure 3) in various ways by device 2, for example by receiving the IM1 image from an entity external to device 2 such as a remote server (not shown), or by extracting (or reading) the IM1 image from an embedded memory (for example memory 8) in the processing device 2.

[0115] As shown in Figure 4, device 2 can cause the display device 14 to show an image IM2 derived from the acquired image IM1. Image IM2 may be identical to or different from image IM1, particularly in terms of resolution and / or format. For example, it is assumed that image IM2 is obtained by processing image IM1, this processing including, for instance, coordinate and / or resolution conversions from image IM1 to image IM2, as described in more detail later in specific examples. The acquired image IM1 and the displayed image IM2 include all or part of the body of the individual UR2 undergoing assisted anatomical localization. In particular, it is assumed here that images IM1 and IM2 include all or part of the skull 20 (or head) and shoulders 26 of subject UR2 (Figure 4).

[0116] During a detection step S4, device 2 detects, in (or from) image IM1, at least two first anatomical points PT1 associated with the skull 20 of subject UR2. These anatomical points PT1 are preferably chosen so as to vary minimally according to the morphology of the individuals. For example, we will subsequently consider that device 2 detects (S4) two first anatomical points PT1 associated with the eyes 22 of the subject visible in image IM1. It should be noted, however, that it is possible to use other anatomical points as first anatomical points PT1, either alternatively or cumulatively to the two aforementioned anatomical points of the eyes 22.

[0117] According to one example, the first PT1 anatomical points detected in S4 include at least one of the following:

[0118] - anatomical points associated with the eyes 22 of subject UR2 visible in (or contained within) image IM1; and

[0119] - anatomical points associated with the ears 24 of subject UR2 visible in (or contained in) image IM1.

[0120] The use of the eyes (22) and / or ears (24) as the first anatomical points (PT1) is advantageous because these anatomical parts are arranged at a distance that varies proportionally with the human skeletal structure. This distance is relatively independent of the subject's morphology (UR2). In particular, it has been observed that there is generally little adipose tissue in these regions of the human body, so the detection of these points is not disrupted by such tissue, allowing for accurate and reliable detection.

[0121] As shown in Figure 5, the first anatomical points PT1 detected in S4 correspond, for example, to the two outer extremities of the eyes 22 of individual UR2. Using the outer extremities of the eyes advantageously ensures precise and reliable detection of the first anatomical points PT1 regardless of the eyelid condition, including when the eyes 24 are partially or fully closed, thus optimizing detection under all circumstances. Furthermore, such detection is possible regardless of the morphology of the eyes 22, including for almond-shaped or non-slanted eyes. Similarly, the base of the ears 24 can be used as the first anatomical points PT1, as these anatomical parts are generally devoid of fat and therefore allow for reliable and precise detection.

[0122] S4 detection can be performed using a pre-trained artificial intelligence (AI) model (or algorithm) to recognize the desired anatomical points based on a training dataset. This AI model can be part of the PG1 computer program.

[0123] Note that the presence or absence of eyes 22 in the IM1 image obtained in S2 depends in particular on the position of subject UR2 relative to camera 10. In a specific example, during the detection step S4, device 2 (for example, its artificial intelligence algorithm) searches for candidate anatomical points in the IM1 image and selects, from among the candidate anatomical points detected in the IM1 image, the first anatomical points PT1 to be used in the subsequent steps of the process. This search can be performed by analyzing the image using the aforementioned AI algorithm.

[0124] In a specific example, candidate anatomical points can be searched for according to a priority order in the acquired IM1 image. In one embodiment, the device searches for the eyes 22 of subject UR2 and, if detected, selects as the first anatomical points PT1 the anatomical points associated with the two eyes 22 thus detected. If, however, the eyes 22 cannot be detected (for example, because subject UR2 is lying prone), the device searches for the ears 24 of subject UR2 and uses as the first anatomical points PT1 the anatomical points associated with the two ears 24 thus detected. This ensures good accuracy and reliability of detection regardless of the position or morphology of subject UR2.According to one embodiment, device 2 only searches for eyes 22 if it has not previously managed to detect both eyes 22 of subject UR1, which ensures good detection quality while minimizing the resources required in terms of capacity and processing time.

[0125] For the sake of simplicity in the description of the invention, it is hereafter assumed that only one IM1 image is obtained during this step S2, although it is possible to obtain a plurality of IM1 images, for example in the form of a sequence of images or a video, these IM1 images then being processed in a manner similar to that described below for the IM1 image under consideration.

[0126] During a determination step S6 (Figures 3 and 5), the device 2 determines a first value V1 representing a reference distance D1 separating the first two anatomical points PT1 associated in this example with the eyes 22 of subject UR2. This first value V1 is defined, for example, as a function of the number of pixels in the image IM1 obtained in S2 separating the first two anatomical points PT1. By counting the number of pixels between the two anatomical points PT1, one can, in particular, evaluate the size of the skeletal structure of subject UR2 as visualized by the camera 10. As indicated below, the distance D1 between the eyes 22 (for example, between the outer extremities of the eyes in this example) can advantageously serve as a reliable reference for determining target anatomical points in the human body.

[0127] During a detection step S8 (Figures 3 and 6), device 2 detects, in image IM1, two (or at least two) second anatomical points PT2 associated with the shoulders 26 of subject UR2. To do this, device 2 can, for example, use the aforementioned AI model to search for characteristics (shapes, dimensions, etc.) specific to shoulders in the human body.

[0128] In one particular example, the second anatomical points PT2 detected at S8 are associated with the subject's shoulder points, although other parts of the shoulders can be used as a reference. Generally, the device can be configured to detect, as second anatomical points, bony and / or muscular features of the shoulders, such as the upper bony points of the shoulders 26 and / or external muscular points of the shoulders 26.

[0129] During a localization step S10 (figures 3 and 6), device 2 locates (or identifies) a sternal midline L1 equidistant from the two second anatomical points PT2, the sternal midline L1 intersecting (or cutting) at an intersection point PN1 a segment SG1 defined by the second anatomical points PT2 associated respectively with the two shoulders 26. In other words, the segment SG1 terminates at its extremities by the two anatomical points PT2.

[0130] As illustrated in Figure 6, this sternal midline L1 forms the perpendicular bisector of the segment SG1 defined by the second anatomical points PT2. This line L1 is parallel here to the Y axis of the anatomical reference frame RF1 associated with the subject's body UR2, while the segment SG1 extends in a direction parallel to the X axis of said anatomical reference frame RF1.

[0131] It has been observed that, despite the variability in people's morphologies, the sternal midline L1 generally agrees with the position of the spine of the subject UR2.

[0132] During this localization step S10, device 2 can, in particular, determine and store the coordinates of the intersection point PN1, for example, in an anatomical reference frame RF1 associated with the body of subject UR2. During a determination step S12 (Figures 3 and 6), device 2 determines the coordinates, denoted C1, of at least one anatomical target point PT3 of subject UR2. For the sake of simplicity, it is hereafter considered that only one anatomical target point PT3 is determined during the process, although it is possible to determine and use a plurality of such anatomical target points in a manner analogous to that described in this disclosure for the anatomical target point PT3 under consideration.The anatomical target point PT3 thus identified may correspond to various anatomical points of the human body as the case may be, for example an anatomical point associated with a lung or the heart of the subject UR2, as described later in particular examples.

[0133] In this example, we consider that the coordinates C1 of the target anatomical point PT3 are defined according to the anatomical reference frame RF1 associated with the subject UR2 as positioned in the image IM1. These coordinates C1 can therefore be expressed as a pair of positions (X1, Y2) along the X axis (abscissa) and Y axis (ordinate) of the anatomical reference frame RF1, respectively.

[0134] The determination S12 of the coordinates C1 can be done by calculating second distances, denoted D2x and D2y (figure 6), from the target anatomical point PT3 with respect to the point of intersection PN1 along the X and Y axes of the anatomical reference frame RF1, respectively. These second distances Dx and Dy (or at least one of them) can be determined from the first value V1, which serves as the reference value.

[0135] In particular, one of these second distances, namely D2y in the following examples, is determined by applying a proportionality coefficient Ky to the first value V1. The other of these distances, namely D2x in this example, can be determined from, or be equal to, a constant (or predetermined value) denoted Kx.

[0136] More precisely, in the example considered, the distance D2x is determined at S12 such that D2x = Kx, where Kx is a constant (or predetermined value). The distance D2y is further determined (S12) based on the value V1 previously determined at S6, that is, in this example, based on the value V1 representing the distance between the first two anatomical points PT1 associated with the eyes 22 of subject UR2. A proportionality coefficient Ky is applied to this constant Ky to deduce the distance D2y. The intersection point PN1 thus serves as the reference position for determining the position of the target anatomical point PT3 along the Y-axis of the anatomical coordinate system RF1. To do this, device 2 can use as a reference the coordinates, in the anatomical coordinate system RF1, of the intersection point PN1 located at S10.The coordinates C1 of the target anatomical point PT3 can then be defined (S12) by the pair (X1, Y1) which is a function of the distances D2x and D2y respectively. In a particular example, the coordinates C1 (X1, Y1) are such that X1 = D2x and Y1 = D2y.

[0137] Note that the constant Kx and the proportionality coefficient Ky, associated respectively with the X and Y directions of the anatomical reference RF1, can be adapted by a person skilled in the art as appropriate, depending in particular on the type of target anatomical point PT3 sought.

[0138] In a specific example, during determination S12, device 2 performs the following determinations:

[0139] - determination of the second distance D2x along the first X axis of the anatomical reference frame RF1 associated with the subject UR2 visible in (or contained within) the image IM1 such that D2x = Kx; and

[0140] - determination of the second distance D2y along the second axis Y of the anatomical reference frame RF1 such that D2y = Ky ■ VI, where Kx is a constant (or a positive value) and Ky is a proportionality coefficient.

[0141] As mentioned above, D2x here is equal to the constant (or predetermined value, or coefficient) Kx, the first value V1 not being used in this example to determine the abscissa coordinates (along X) of the target anatomical point PT3. Indeed, since the reference position is the intersection point PN1 itself deduced from the distance between the two second anatomical points PT2 (at the level of the shoulders), it has been observed that it is not necessary to take into account the first value V1 to accurately determine the distance D2x along the abscissas in the subject's anatomical frame RF1.On the other hand, the first value V1 is taken into account for the calculation of the position of the target anatomical point PT3 along the Y ordinates (distance D2y) because the reference distance D1 provides information on the subject's skeletal growth factor UR2 and therefore constitutes a reliable value for determining the position of the target anatomical point PT3 along the Y axis of the ordinates.

[0142] As illustrated as an example in Figure 6, to detect the pulmonary focus of subject UR2 as the target anatomical point PT3, we can fix the values ​​of the constant Kx and the proportionality coefficient Ky so that Kx is equal to (or approximately equal to) 0.7 and Ky is equal to (or approximately equal to) 0.1. Thus, D2x = 0.7 and D2y = 0.1 * V1.

[0143] According to another example, it is possible to detect the mitral focus of subject UR2 as the target anatomical point PT3. In this case, the values ​​of the constant Kx and the proportionality coefficient Ky can be fixed such that Kx is equal to (or approximately equal to) 0.9 and Ky is equal to (or approximately equal to) 2.8. Thus, D2x = 0.9 and D2y = 2.8 * V1. However, the above values ​​of the constant Kx and the proportionality coefficient Ky are provided for illustrative purposes only. The values ​​of Kx and Ky can be adapted depending on the AI ​​model, and more broadly the operating system, used for the detection of the anatomical points PT1 and PT2.

[0144] According to a particular example, the coefficient Ky is different from 0 (Ky 0), for example to allow the localization of any anatomical target point PT3 other than on the ordinate position corresponding to the spine of the subject UR2.

[0145] According to a particular example, the value of the coefficient Ky is adapted by the person skilled in the art, and may for example be different from 1 (Ky 1).

[0146] Once the C1 coordinates of the target anatomical point(s) PT3 have been determined, these coordinates can be used by device 2 in various ways depending on the use case. In particular, device 2 can inform the practitioner UR1 of the position of the target anatomical point(s) PT3, although other uses of the result obtained in S12 are possible.

[0147] In a specific example, device 2 triggers the display, by display device 14 (for example, a screen), of an image IM2 (called the second image) of all or part of the subject UR2. This second image IM2 is obtained from the image IM1 obtained in S2. This display can be performed as soon as the image IM1 is obtained in S2, preferably in parallel with the execution of steps S4-S12, so that the practitioner can have visual feedback of the subject UR2 during the procedure. This display can, for example, be performed in real time, notably to help the practitioner UR1 to correctly position the camera 10 with respect to the subject UR2.

[0148] As already mentioned, the second image IM2 thus displayed may be identical or different from the initial image IM1 captured by the camera 10, as the case may be. The displayed image IM2 may, for example, be a version of the acquired image IM1 with a different format or resolution. An image conversion may, for example, be performed by device 2 if the format of the obtained image IM1 does not correspond to the format of the image IM2 that one wishes to display on the screen 14, as described below.

[0149] In a specific example, during the determination step S12, device 2 determines the first coordinates C1(X1, Y1) of the target anatomical point PT3 in the anatomical frame RF1. These first coordinates C1(X1, Y1) are defined as a function of the pair (D2x, D2y). These first coordinates C1(X1, Y1) are then converted into second coordinates C2(X2, Y2) in an image frame RF2 associated with the second displayed image IM2 (Figure 7). Such a coordinate conversion may be necessary to account for the fact that the anatomical frame RF1, in which the C1 coordinates of the target anatomical point PT1 were initially determined, differs from the image frame RF2, i.e., the frame in which the IM2 image is displayed by the display device 14.This change in reference frame results in particular from the fact that the displayed image IM2 may have a different size (in terms of pixels) and / or resolution than the captured image IM1. For example, images IM1 and IM2 may have different DPI (dots per inch) values, corresponding to different levels of image quality.

[0150] As illustrated in Figure 7, the subject's body UR2, and therefore its reference frame RF1, can be misaligned and / or offset relative to the RF2 reference frame of the IM2 image as displayed on the screen. This conversion can, for example, take into account an angular offset 0° (Figure 7) between the RF1 and RF2 reference frames. The coordinate conversion can therefore include a rotation of the coordinates (X1, Y1) by angle 0° to determine the location of the target anatomical point PT3 in the displayed IM2 image. This angle 0° is, for example, defined by the shoulder segment SG1 relative to the X-axis of the RF2 image reference frame.

[0151] Thanks to this coordinate conversion, the target anatomical point PT3 can advantageously be displayed accurately on (or in association with) the IM2 image, regardless of the position of the subject's body UR2 relative to the camera 10, and therefore regardless of the position or orientation of the subject UR2 relative to the contours of the IM2 image.

[0152] In a specific example, during the S12 determination (Figure 3), device 2 performs a second coordinate conversion: it converts the second coordinates C2 defined by the pair (X2, Y2) into third coordinates C3 defined by the pair (X3, Y3), still within the RF2 display reference frame associated with the displayed IM2 image. Such a conversion can be useful if the resolution of the IM1 image initially obtained in S2 differs from the resolution of the IM2 image displayed on the screen. This conversion from C2 to C3 allows the position of the target anatomical point PT3 to be expressed in the RF2 image reference frame, taking into account the difference in resolution, along the X and Y axes, between the RF1 and RF2 reference frames. For example, the image acquired in S2 may have a given resolution (e.g., 640 x 480 pixels) that is lower than the resolution of the displayed IM2 image (e.g., 1920 x 1080 pixels).During this conversion, device 2 calculates ratios between the resolutions of images IM1 and IM2 along the X and Y directions, respectively. These ratios are then used to convert the C2 coordinates into C3 coordinates. This conversion, linked to the change in image resolution, prevents any positioning errors of the target anatomical point PT3, and potentially of the visual indicator, as explained below. In a specific example (Figures 1-6), during a delivery step S14 following steps S2-S12, device 2 provides (or renders) a CM1 instruction to guide the user UR2 to the target anatomical point PT3. This CM1 instruction is determined based on the C1 coordinates of the target anatomical point PT3. This CM1 instruction can take various forms and be presented in different ways, depending on the situation.

[0153] According to a particular example, the IN1 instruction provided in S14 includes at least one of the following: a visual instruction; an audible instruction; and a vibration instruction.

[0154] In a specific example, device 2 displays image IM2 (derived from image IM1 as previously mentioned) along with at least one visual indicator IN1 associated with the target anatomical point PT3. This visual indicator IN1 can, in particular, be displayed superimposed on the displayed image IM2, depending on the augmented reality display mode. The visual indicator IN1 then represents a target position associated with the target anatomical point PT3.

[0155] The IN1 visual indicator can take any form, for example that of a target or any other graphic object indicating the target anatomical point PT3 or a target position associated with this target anatomical point PT3 (for example a target position coinciding with, or close to, the anatomical point PT2 where the practitioner must perform an auscultation).

[0156] In a specific example, following steps S2-S12 (Figure 3), device 2 sends a machine instruction (or command) CM2, which is a function of the coordinates of the target anatomical point PT3. This CM2 instruction is used to control or operate a system (not shown), such as a massage system, a medical treatment system (injection system, medical booth, wellness equipment, non-invasive or non-remotely controlled treatment system, etc.), and other examples are possible. In response to this machine instruction CM2, the system can then automatically perform a given operation, for example, by physically interacting with the subject UR2, such as performing mechanical cardiac massage, an injection, or any other action, depending on the located target anatomical point(s) PT3.

[0157] As previously mentioned, the first value V1 determined in S6 (Figure 3) can represent the number of pixels separating the first two anatomical points PT1. In a specific example, during the supply step S14, device 2 estimates a dimensional ratio between the number of pixels defined by the first value V1 and a reference value. Device 2 then adjusts at least one dimension (size or other) of the visual indicator IN1 based on this estimated dimensional ratio. This reference value, which can be adjusted as needed, is the theoretical value of the reference distance D1. For example, if the reference distance D1 corresponds to the distance between the subject's eyes, this theoretical value can be set to approximately 60 mm, although other values ​​are possible depending on factors such as the eye positions used as the first anatomical points PT1.

[0158] Device 2 can thus advantageously adapt the size, and more generally the appearance, of the visual indicator IN1 displayed on the screen (for example in superposition with the displayed image IM2) according to the distance of the camera 10 to the focal plane, so that the size of the visual indicator remains adapted regardless of the position of the camera 10 with respect to the body of the subject UR2.

[0159] The present invention advantageously enables the precise, reliable, and rapid localization of anatomical points on a subject, particularly a human, or even an animal. The invention offers an ergonomic solution allowing any user, regardless of their level of training in anatomy or auscultation, to easily identify an anatomical point on the subject, even in noisy or suboptimal environments. The device of the invention significantly reduces the risk of human error, which is particularly beneficial for safe and effective medical interventions, as well as in the field of well-being.

[0160] The invention allows, in particular, for the efficient and ergonomic assistance or guidance of a practitioner in locating anatomical points on a subject, for example, for auscultation or other purposes. By providing, for example, clear visual cues and compensating for variations in the patient's position, a practitioner can quickly and accurately locate anatomical points, even in challenging environments. This can prove particularly useful in emergency situations, where conditions are not always ideal for auscultation. In this way, it is possible, for example, to perform synchronous or asynchronous auscultation, to collect the subject's vital signs, or even to aid in establishing a diagnosis.

[0161] This guidance can be advantageously achieved using an augmented reality system which automatically locates the auscultation focus(s) using a body recognition algorithm and anthropometric calculations, making the application accessible and accurate for non-specialist users.

[0162] The invention can, for example, enable a person with any level of training to effectively perform a cardiopulmonary auscultation, or any other appropriate auscultation, at one or more anatomical points on the subject's body. To this end, the invention can, in particular, provide guidance, indicating, for example, where to place an instrument, such as a medical instrument (stethoscope, etc.), on the subject's body.

[0163] The ergonomics and ease of use of the device of the invention are major advantages. By simplifying the process of locating anatomical points, it reduces the cognitive load and potential errors for practitioners. This can improve not only the efficiency of medical procedures, but also the overall quality of patient care.

[0164] The concept of the invention is based, in particular, on the counterintuitive observation that, with few exceptions, the human skeletal structure maintains certain proportions, regardless of the individual's morphology and age. For example, while the eyes remain roughly the same size throughout a person's life, their skull grows, leading to a widening of the distance between the eyes as they grow. This widening increases proportionally to the skeletal structure of the human body. Thus, using predetermined proportionality coefficients Kx and Ky and a reference distance D1, as previously described in specific examples, the position of a target anatomical point can be accurately estimated, taking into account the natural growth of an individual's skeleton with age.

[0165] A recognition algorithm can thus be implemented by the device of the invention to track and detect target anatomical points on a subject's body. An augmented reality module can also be advantageously used to overlay visual information onto an image of a subject in order, for example, to guide the placement of a stethoscope or any other instrument (for auscultation or otherwise), thereby enabling high-quality listening to cardiac and / or pulmonary sounds without prior training, particularly in physiology. The invention therefore offers a valuable tool for emergency interventions by non-specialized professionals.

[0166] As those skilled in the art will understand, all the embodiments and variations described above, some of which have been intentionally simplified for ease of explanation, are merely non-limiting examples of how this disclosure can be implemented. In particular, those skilled in the art may consider any adaptation or combination of the embodiments and variations described above to meet a specific need.

[0167] The present invention is therefore not limited to the embodiments described above but extends in particular to a localization method that would include secondary steps without departing from the scope of the present invention. The same would apply to a processing device, or more generally to a localization system, for implementing such a method.

Claims

DEMANDS 1. A method for assisted anatomical localization, implemented by a processing device (2), said method comprising: a) obtaining (S2) an image (IM1) of a subject (UR2); b) detecting (S4), in said image, at least two first anatomical points (PT1) associated with the skull of the subject; c) determining (S6) a first value (V1) representative of a reference distance (D1) separating said at least two first anatomical points; d) detecting (S8), in said image, two second anatomical points (PT2) associated with the shoulders (S26) of the subject; e) localizing (S10) a sternal midline (L1) equidistant from the second anatomical points, the sternal midline intersecting at a point of intersection (PN1) a segment (SG1) defined by the second anatomical points;and f) determination (S12) of coordinates (C1) of at least one target anatomical point (PT3) by calculating second distances (D2x, D2y) of said at least one target anatomical point with respect to the point of intersection, at least one of the second distances being determined from the first value (V1).; 2. A method according to claim 1, wherein the first anatomical points detected in b) comprise at least one of: - anatomical points associated with the eyes (22) of the subject visible in the image; and - anatomical points associated with the ears (24) of the subject visible in the image.

3. A method according to claim 1 or 2, wherein the method comprises: - search for candidate anatomical points in the image (IM1); and - selection, from among the candidate anatomical points detected in the image, of the first anatomical points (PT1) used in c).

4. A method according to any one of the preceding claims, wherein, during determination c), the first value (V1) is defined as a function of a number of pixels, in the image (IM 1 ) obtained in a), separating said at least two first anatomical points (PT1).

5. A method according to any one of the preceding claims, wherein the sternal midline (L1) forms a perpendicular bisector of the segment (SG1) defined by the second anatomical points.

6. A method according to any one of the preceding claims, wherein, during the determination f), one of the second distances (D2x, D2y) is determined by applying a proportionality coefficient (Ky) to the first value (V1).

7. A method according to claim 6, wherein determination f) comprises: - determination of a second distance D2x along a first axis of an anatomical reference frame (RF1) associated with the subject visible in the image such that D2x = Kx; and - determination of a second distance D2y along a second axis of the anatomical reference frame such that D2y = Ky ■ VI, where Kx is a constant and Ky is said proportionality coefficient.

8. A method according to any one of the preceding claims, wherein the method comprises: - display of an image (IM2), called the second image, according to an image reference frame (RF2), said second image being determined from the image (IM1) obtained in a); in which determination f) comprises: - determination of initial coordinates (X1, Y1) of said at least one target anatomical point (PT3) in the anatomical reference frame, said initial coordinates (X1, Y1) being defined as a function of the pair (D2x, D2y); and - conversion of the first coordinates (X1, Y1), as second coordinates (X2, Y2), in the image reference frame (RF2) associated with said second image.

9. A method according to claim 8, wherein determination f) comprises: - conversion of the second coordinates (X2, Y2) as third coordinates (X3, Y3) in the display reference associated with a graphical representation of said image.

10. A method according to any one of the preceding claims, wherein the method comprises: e) providing instructions to guide a user to said at least one target anatomical point.

11. A method according to claim 10, wherein the instruction provided in (e) comprises at least one of the following: - a visual instruction; - an audible instruction; and - a vibration control.

12. A method according to claim 10 or 11, wherein the supply (e) comprises: - display of the image and at least one visual indicator, superimposed on the displayed image, said at least one visual indicator being representative of a target position associated with said at least one target anatomical point.

13. A method according to claim 12, wherein the first value is representative of a number of pixels separating said at least two first anatomical points, wherein the supply (e) comprises: - estimation of a dimension ratio between the number of pixels defined by the first value and a reference value; and - adaptation of at least one dimension of the visual indicator according to said dimension ratio.

14. Computer program (PG1) comprising instructions for carrying out the steps of a process according to any one of the preceding claims when said program is executed by a computer.

15. Treatment device (2) comprising: - a (MD2) acquisition module configured to obtain an image of a subject; - a first detection module (MD4) configured to detect, in said image, at least two first anatomical points associated with the subject's skull; - a first determination module (MD6) configured to determine a first representative value of a reference distance (D1) separating said at least two first anatomical points; - a second detection module (MD8) configured to detect, in said image, two second anatomical points associated with the subject's shoulders; - a localization module (MD10) configured to locate a sternal midline equidistant from the second anatomical points, the sternal midline intersecting at a point of intersection a segment defined by the second anatomical points; and - a second determination module (MD12) configured to determine coordinates of at least one target anatomical point by calculating second distances of said at least one target anatomical point with respect to the point of intersection, the second distances being determined from the first value.

Images