Method for generating a differential marker on a representation of a portion of the human body.

Abstract

Method for generating a differential marker on a representation of a portion of the human body.Method for generating at least one differential marker of the presence of a cutaneous singularity of a human body, said method comprising: Acquisition of a first and a second set of dermoscopic images of singularities of the skin of a human body of a first individual at a first and respectively a second date; Generation of a first and a second representation of a first image of a part of the human body and of a first symbol respectively a second symbol superimposed on the first image of each representation at a position in a first reference frame of the first image, said geometry and / or said color of the second symbol being different from the geometry and / or the color of the first symbol when the second class of the dermoscopic image of the second set is different from the first class of the dermoscopic image of the first set. Figure for abstract: Fig.1.

Description

Title of the invention: Method for generating a differential marker on a representation of a portion of the human body. Field of invention

[0001] The field of the invention relates to that of computer-implemented methods for generating markers on a representation of the human body. The field of the invention relates more particularly to systems and methods for assisting a doctor such as a dermatologist in the analysis of skin singularities on the surface of the body. State of the art

[0002] Currently, dermatologists analyze skin peculiarities by examining the surface of a patient's skin with the naked eye.

[0003] Current imaging devices offer limited choices to practitioners. Most commonly, a dermatologist can access dermoscopic images with a magnification of 10x to 30x of a few lesions, taken individually using a hand-held dermatoscope such as a "gun". Alternatively, macroscopic images of a body can be accessed using whole-body imaging systems, for example a "booth", allowing for a global acquisition of the body.

[0004] These two techniques can be used in combination, but at best and at the cost of too much time, only allow a macroscopic image of the entire body to be obtained, with a few lesions in dermoscopy by manual association of dermoscopic images to an area of ​​the body.

[0005] Consequently, there is no full body imaging or skin map that allows access to dermoscopy images at any point.

[0006] Some existing systems allow for taking photos of the skin at different resolutions. These systems allow for macroscopic observation of moles, for example. However, it is important to take images at different times, ideally in dermoscopy, to monitor the evolution of a singularity over time. The doctor must therefore save the images, associate them with an area of ​​the body to be able to compare them with the correct images later and finally orient and display them in the same way to compare the images with each other during an examination.

[0007] However, to date, there is no process or system that addresses all of these issues. Summary of the invention

[0008] According to a first aspect, the invention relates to a computer-implemented method for generating at least one differential marker of the presence of a cutaneous singularity of a human body, said method comprising: • Reception on a first date of at least a first image of all or part of the human body, called first body part, of a first individual allowing the display of a dermoscopic image extracted from said first image with a dermoscopic resolution, said first image comprising a plurality of cutaneous singularities of the skin of said body, each singularity each having coordinates in a first reference frame associated with said first image and being associated with a first date and at least a first value of a first descriptor; • Reception on a second date of at least one second image of the same first part of the human body of the first individual with a substantially identical resolution, said second image comprising a plurality of cutaneous singularities of the skin of said body, each singularity each having coordinates in a first reference frame associated with said second image and being associated with a second date and at least one second value of the first descriptor; • Generation of a first representation comprising the first image and at least one first symbol associated with a first singularity located at a first position of said first image of the first reference point, said at least first symbol being superimposed on the first image at the first position, said first symbol having a first geometry and / or a first color generated as a function of at least the first value of the first descriptor considered at the first date; • Generation of a second representation in the vicinity of the first representation comprising the second image and at least one second symbol associated with the first singularity, said second symbol having a second geometry and / or a second color, said at least one second symbol being superimposed on the second image at the first position, said second geometry and / or said second color being different from the first geometry and / or the first color thus defining a differential marker, when the distance calculated between a first value of the first descriptor calculated at the first date and a second value of the first descriptor calculated at the second date is greater than a predefined threshold.

[0009] One advantage is that it provides a simple tool for comparing two skin images acquired on different dates while benefiting from tools easily accessible visualization of an area of ​​interest allowing the evaluation of the evolution of a situation.

[0010] According to one embodiment, the method comprises the generation of a graph comprising a set of nodes, said nodes corresponding to singularities, each node comprising attributes, including a position of the singularity and at least one value of a descriptor.

[0011] One advantage is that it allows the two images to be merged according to the same reference point in order to allow a similar display of the two parts of the human body at two different dates.

[0012] According to one embodiment, the two images of each representation are oriented and aligned with each other by means of a step of comparing and / or merging the two graphs and minimizing the error of the position difference of the nodes between them.

[0013] One advantage is to facilitate the reading and analysis of a singularity by offering a better visualization context favoring the detection of differences from one image to another.

[0014] According to another aspect, the invention relates to a computer-implemented method for linking two images each having a dermoscopic resolution of all or part of a human body and being received on two different dates, said method comprising: • Reception on a first date of at least a first image of all or part of the human body, called first body part, of a first individual allowing the display of a dermoscopic image extracted from said first image with a dermoscopic resolution, said first image comprising a plurality of cutaneous singularities of the skin of said body, each singularity each having coordinates in a first reference frame associated with said first image and being associated with a first date and at least a first value of a first descriptor, each singularity located in the first image defining a node of a first graph; • Reception at a second date of at least one second image of the same first part of the human body of the first individual with a substantially identical resolution, said second image comprising a plurality of cutaneous singularities of the skin of said body, each singularity each having coordinates in a first reference frame associated with said second image and being associated with a second date and at least one second value of the first descriptor, each singularity located in the second image defining a node of a second graph; • Generation of a first representation including the first image; • Calculation of a correspondence vector from the comparison of a plurality of positions of singularities and at least one value of at least one descriptor of said singularities of the first graph and of the second graph; • Generation of a second representation in the vicinity of the first representation comprising the second image, said second representation being generated so that the first and second images are oriented according to the same reference frame or are displayed according to the same dimension scale.

[0015] According to one embodiment, each singularity of the first image is associated with a plurality of descriptors comprising at least one descriptor from the following list: • A contrast value with respect to a representative value of an average color considered in the vicinity of the skin singularity; • A given class of a classifier of an output of a neural network having been trained with dermoscopic images of skin singularities; • A characterization of a geometric data of the shape. • A score corresponding to a scalar value or a numeric value obtained by implementing an algorithm processing as input an image extracted from the first image, • A score obtained by calculating different values ​​of singularity descriptors considered in the vicinity of a given singularity.

[0016] An advantage is to make it possible to identify a category or a value of a singularity making it easier to associate a type of symbol according to the category of the singularity considered.

[0017] According to one embodiment, when a class is associated with a singularity after acquired images of the skin are provided to a neural network configured to deliver a classification of said provided images, at least one class is included among the following list of classes: • a class relating to the geometry of the periphery of the singularity of a given dermoscopic photo, • a class relating to the characterization of a geometry of the periphery of the singularity of a given dermoscopic photo with respect to a plurality of characterizations of geometries of peripheries of singularities of other dermoscopic photos considered in the vicinity of the given dermoscopic photo; • a class relating to the color of a singularity; • a class relating to the asymmetry of the geometry of the periphery of the singularity of a given dermoscopic image, • a class relating to the diameter of the geometry of the periphery of the singularity of a given dermoscopic image, when said singularity has a substantially circular shape, • a class relating to the area where the singularity is present on the human body.

[0018] An advantage is to inherit the classes of a classifier of a neural network at the singularity level and therefore also a position in the first image.

[0019] According to one embodiment, an evolution criterion is calculated quantifying the evolution of a descriptor of a singularity between two images of two acquisitions carried out on two different dates.

[0020] One advantage is that it allows attention to be drawn to changes or developments in singularity over time.

[0021] According to one embodiment, an evolution criterion is calculated from a distance defined between a first value of a descriptor of a first node of a first graph acquired at a first date and a second value of a descriptor of a second node of a second graph acquired at a second date, each graph being generated from a first image, respectively from a second image, said images corresponding to a body of the same individual and the first node and the second node having the same position within the first and second images.

[0022] One advantage is that it quickly allows differential calculations between two singularities of two images taken at two different dates whose positions are known in two different frames of reference and in the frame of one and the other. Indeed, the use of graphs makes it possible to corroborate the positions of singularities very easily, in particular from position correspondences and similarities of descriptors. It is thus much simpler to make the two frames of reference of the two received images coincide in order to facilitate comparisons of descriptor values ​​of a singularity that has evolved over time.

[0023] According to one embodiment, each singularity has a calculated position in the first image or the second image which corresponds to a geometric point characteristic of a shape characteristic of the geometry of said singularity. It may be an oval, an ellipse, a circle, a rectangle or a triangle.

[0024] According to one embodiment, the color and / or geometry of a symbol is / are selected according to: • a criterion for membership of a singularity to at least one class of the classifier; • a value of a descriptor exceeding a threshold value; • the value of an evolution criterion of a descriptor of a singularity calculated between two first images acquired on two dates.

[0025] One advantage is to allow a broad configuration of representation of the different criteria for demarcating a given singularity or an evolution of a singularity over time.

[0026] According to one embodiment, the shape of the symbol is a simple geometric shape such as a circle, a triangle, a square, a rectangle or a cross or star shape.

[0027] According to one embodiment, the color of the symbol is generated according to a color gradient associated with the evolution over time of a value of a descriptor of a singularity according to a predefined scale of values.

[0028] According to one embodiment, a third symbol is generated according to a given color and / or shape(s) when a singularity is present in a first image acquired at a given position for the first time, said color or said shape of the third symbol making it possible to distinguish said symbol from another symbol to indicate the new appearance of said singularity.

[0029] An advantage is to represent the appearance of a singularity not having been identified in previous image acquisitions.

[0030] According to one embodiment, a user interaction with at least one displayed symbol makes it possible to generate a first digital instruction aimed at displaying at least one dermoscopic image in a display window, said displayed dermoscopic image corresponding to an image extracted from the first image associated with the position at which the symbol is displayed on the first image.

[0031] One advantage is to directly exploit the global image of a patient's body without having to "glue" or process images taken by another device onto a macroscopic image.

[0032] According to one embodiment, a second digital instruction generated by a user action makes it possible to display two dermoscopic images side by side extracted respectively from a first image and a second image, said two dermoscopic images making it possible to display the singularities of the same position on the body according to the same resolution and according to the same scale of dimensions.

[0033] One advantage is to benefit from the exploitation of the graphs associated with the first image and the second image. The graphs are easily manipulated and allow simple adjustments to be made between the first and second images because only the descriptors and the positions of the nodes are considered.

[0034] According to one embodiment, a second digital instruction generated by a user action makes it possible to display two dermoscopic images side by side, said two dermoscopic images making it possible to display the singularities having the same position on the body according to the same orientation.

[0035] According to one embodiment, the first image and the second image are 2D images of a part of the human body. One advantage is to represent parts of the body according to a plan view. This view allows better manipulation of the displayed image, in particular rotations and zooms.

[0036] According to one embodiment, the first image and the second image are 3D images of a part of the human body. An advantage is to better represent the body of a patient and to quickly visualize an area of ​​interest.

[0037] According to one embodiment, a digital command making it possible to move, zoom, or select an area of ​​interest of the first image of the first representation automatically causes the generation of an identical digital command on an equivalent area of ​​interest of the second image of the second representation. An advantage is to coordinate the representations of the two images during an examination of the human body represented on a computer with the taking into account of a temporal evolution criterion.

[0038] According to one embodiment, a first digital command makes it possible to orient a three-dimensional digital avatar of the human body so as to display a portion of the body selectable by a second digital command producing the display of a first image, said first image representing a plurality of singularities of the skin of said displayed portion, a set of symbols being represented with a geometry and a color dependent on at least one value of a descriptor of the singularity.

[0039] According to one embodiment, a first digital command makes it possible to orient a three-dimensional digital avatar of an individual's body so as to display a portion of the body, a third digital command making it possible to enlarge said portion of the body displayed on an area of ​​interest, said area of ​​interest displaying a plurality of markers each having a position on the surface of the human body in a reference frame associated with the digital avatar, each marker being associated with a singularity of the human body, a fifth digital command making it possible to select said marker to display a dermoscopic image extracted from the first image, said extracted image being defined around the position of the selected marker.

[0040] According to one embodiment, the dermoscopic images are acquired by an image-taking device configured to acquire a plurality of images of the skin of a human body of an individual and to assign to each image a position on a 3D model representing the body of said individual.

[0041] According to one embodiment, the 3D model representing the body of the individual corresponds to the three-dimensional representation allowing navigation on different portions of the body.

[0042] According to one embodiment, the method comprises a step of detecting a set of singularities on the surface of the body comprising the execution of a neural network processing as input images of the skin acquired by an image acquisition device and generating as output a classification of said image, each of the images being indexed according to a position on the surface of a 3D body model reconstructed from a generation of a depth map.

[0043] According to another aspect, the invention relates to a system comprising an electronic terminal comprising a display for generating the images produced by the method of the invention and a data exchange interface for receiving images acquired by an image acquisition device or another computer or another memory when said received images have been previously processed following their acquisition by an image-taking device.

[0044] Another object of the invention relates to a method for carrying out an action on an image of all or part of the human body having a dermoscopic resolution so as to visualize on the one hand images of cutaneous singularities of the skin on a dermoscopic scale and on the other hand an image of all or part of the body on a macroscopic scale.

[0045] An advantage of the invention is to generate skin maps allowing access to given areas of the skin by magnification functions up to the dermoscopic level.

[0046] One advantage is that it allows access to any image acquired and associated with a point of a representation of the body, in particular points corresponding to areas of virgin skin, or points corresponding to pigmented or non-pigmented lesions. Brief description of the figures

[0047] Other characteristics and advantages of the invention will emerge on reading the detailed description which follows, with reference to the appended figures, which illustrate: • [Fig.l]: a three-dimensional representation of a human body allowing navigation to select a portion of the body; • [Fig.2]: two representations of the same image representing the torso of a human body on two different dates, each image comprising a set of singularities of the human body and a plurality of symbols making it possible to discriminate certain singularities from other singularities; • [Fig.3]: a representation of an image of a portion of the human body allowing access to a dermoscopic photograph of a singularity; • [Fig.4]: a representation of an image of a portion of the human body allowing access to two dermoscopic photographs of a singularity obtained on two different dates. • [Fig.5]: an example of representation of a system of the invention.

[0048] The term "dermoscopic image" means an image acquired by an optical device making it possible to form an image of a portion of the skin in close-up. In the remainder of the description, a dermoscopic image corresponds in the broad sense to an image of an area of ​​the skin having a magnification of the size of the imaged area. The magnification therefore comprises an operation aimed at representing an area with a scale larger than the scale corresponding to the actual size.

[0049] The invention refers more particularly to dermoscopic images having magnifications of the order of 10x to 30x of the actual size of the area of ​​the skin considered, that is to say between ten times and thirty times the size of the actual area. According to one example, the dermoscopic image can be associated with a given resolution or greater than a given threshold.

[0050] Finally, according to another example, the dermoscopic image can refer to an image acquired by a device or instrument designed to image areas of the skin. This can be a dermatoscope which exists in different variants: • Contact or non-contact equipment; • Equipment projecting polarized or non-polarized light; • Equipment comprising optics enabling the acquisition of digital or numerical images, • Conventional equipment including, for example, a magnifying glass without acquisition.

[0051] According to another example, the method of the invention can be carried out from images acquired from certain devices going up to a magnification of 400x, or 400 times.

[0052] Any image having a dermoscopic resolution is called an image, regardless of its size, which can be zoomed or enlarged so as to display images at a dermoscopic scale, that is to say an image with a magnification between 10x or 30x of the actual size of the singularity represented on the body of an individual.

[0053] A body model faithful to an individual's body is understood to mean a body model resulting from a 3D scanning operation of an individual's body which includes images of the skin in each pixel of a three-dimensional representation. The term "body" means the entirety or almost the entirety of the body, namely that certain parts of the body may be deliberately masked without declassifying the term "body".

[0054] A skin singularity is understood to mean an area comprising a contrast with the average color of the skin in its vicinity, or a roughness of the human body located at a point on the body. Color or intensity thresholds can be defined in order to determine whether the area comprises a singularity. In other cases, a singularity can be characterized by an area comprising a color or intensity gradient. These can be in the visible light range or in other parts of the spectrum such as the UV spectrum or the infrared spectrum, i.e. multispectral / hyperspectral.

[0055] [Fig.l] illustrates a representation of an individual's body in 3D. This image may correspond to the first image IMi having a dermoscopic resolution and being able to be zoomed directly to obtain an image of a singularity SG; at the dermoscopic scale. Alternatively, this representation makes it possible, by means of a computer for example, to select an area of ​​the body such as the area Zi representing the arm of the body.

[0056] According to one example, a CR command allows a computer user to orient the 3D image of the body according to the view that he wishes to display and use. He can thus view, for example, the back or the torso of a body. For this purpose, a command makes it possible to rotate the body according to an axis of revolution here defined by the axis parallel to the axis along which the body extends according to its largest dimension. According to one example, other commands make it possible to orient the body around another axis, this may be a roll, pitch or yaw axis. According to one example, a translation may also be defined. If the 3D image is the first image received having a dermoscopic resolution, the latter may be manipulated so as to allow zooming on an image at the dermoscopic scale.

[0057] The user commands make it possible to generate digital instructions CONS2 making it possible to move, modify, zoom, orient or even coordinate the display of the two images with each other. Different digital commands CDNi for moving an area of ​​interest, CDN2 for orienting the avatar along at least one axis, CDN3 for enlarging an area of ​​interest, CDN4 for selecting a marker positioned in the first image or the second image relating to a singularity for displaying an image extracted from the first image at a dermoscopic scale can result in generating different operations on the displayed image or on the two images displayed in each representation.

[0058] The selection of a marker of interest or a symbol of the image by a user makes it possible to generate a digital instruction CON1 interpretable by a computer and making it possible to generate a window in which a dermoscopic resolution image extracted from the first image or the second image is displayed at the dermoscopic scale.

[0059] According to an exemplary embodiment, a CDN0 command makes it possible to enlarge an area displayed on the screen of the human body. Thus, once a view has been chosen, for example that of the front face of an individual Ui, it is possible to zoom in on only a part of the body, such as the torso or arm. Alternatively, it is possible to select an area of ​​the body to generate a representation in another window.

[0060] The representation may be a 2D or 3D view. According to the example of [Fig.l], it is a three-dimensional representation, but a 2D representation could alternatively be chosen. This 2D representation may concern the entire body or a part of the body. In order to obtain a 2D representation of a 3D surface, a cutout along demarcation lines makes it possible to generate a flat area of ​​a portion of the 3D surface for its representation on the screen.

[0061] The invention therefore comprises a first representation allowing navigation within the surface of the human body by operations of modification of the orientation, selection of zones or magnification, etc.

[0062] According to a first example, the representation of the human body such as that of [Fig.l], is an avatar independent of the faithful representation of the body of an individual, it is noted MODi.

[0063] According to a second example, the representation of the human body such as that of [Fig.l], is a faithful avatar of the body of an individual MOD0 which has been scanned from an image acquisition device. The avatar can be represented and oriented in a frame Ro linked to the body of the individual. When this representation is produced, it is based on the exploitation of a 3D model of a human body of which each point of the surface is indexed in a frame Ro linked to the body model. The invention is compatible with whole-body imaging devices which can produce macroscopic images of the human body from which a faithful body model can be produced.

[0064] In both cases, a plurality of dermoscopic images are recorded in a memory in order to produce a single image IMi of all or part of the human body.

[0065] The method of the invention can begin at the step of receiving the first image IMb. However, a step of detecting skin singularities on the surface of the scanned body can be carried out beforehand. This operation aims to associate with each singularity a position of a MOD0 body model. Thus, when the 3D representation directly uses the 3D model, the positions of the singularities indexed on the MOD0 body model correspond to the positions of the markers generated on the surface of the human body represented and allowing access to the dermoscopic images.

[0066] The position of the singularities can also be indexed on a 2D image in a frame noted Rb

[0067] When a 3D avatar is generated to represent a standard model of a human body, the markers generated on the surface of this representation are generated at positions corresponding to the positions indexed on the MOD0 body model which is faithful to the scan obtained from the body of an individual. A coordinate transformation matrix can be used to generate coordinates from a faithful body model to a standard body model.

[0068] According to one embodiment, descriptors are associated with each singularity.

[0069] According to one embodiment, the coordinates of the points of a faithful 3D model of a human body of an individual are transposed within a 2D representation from a standard representation of a human body from a coordinate transformation matrix.

[0070] According to one embodiment, the system of the invention comprises an actuator such as a computer mouse and a pointer or a touch control making it possible to perform operations on the avatar such as a CR rotation noted in [Fig.l].

[0071] [Fig.2] represents two representations of two images IMb IM2 of the same part of a human body of the same individual Ui acquired on two different dates. The images IMi and IM2 are preferably displayed with the same scale and in the same orientation. They correspond to two 2D representations of a portion of the body such as for example the torso of an individual.

[0072] According to one embodiment, the 2D representation of the portion of the human body is directly extracted from a faithful MOD0 body model of an individual's body resulting from a scanning operation of said individual. In the latter case, if the images are extracted from a body model that has evolved over time, for example because a long period separates the two acquisitions and the individual has followed a diet, then the two images IMi and IM / are different. In other words, the body model Mo is different or the first image is different since pixels of the skin have changed or singularities may also have changed.

[0073] However, in the remainder of the description, it is considered that the images IMi and IM2 of each representation designate equivalent parts of the human body.

[0074] Each representation of a portion of the human body comprises an image IMi and a plurality of symbols Si, S2 indicating that a plurality of singularitiesSGi associated with the plurality of symbols belongs to a class of a given classifier. For example, it may be a mole, a pimple, an angioma, a scar, etc., or a particular type of each of its elements. Typically, there may be different classes of skin lesions and different classes of scars.

[0075] The method of the invention makes it possible to recover information from an already existing classifier in order to assign the class to the singularity detected and positioned in the IMi or IM2 image. For this purpose, a neural network can be configured according to a given training in order to produce as output a classifier allowing to classify the images given as input to the network. This step as mentioned is preferably a step prior to the method of the invention.

[0076] The symbols may be geometric shapes such as circles, ovals, squares, triangles, hexagons, stars, etc.

[0077] Each symbol may also include a color, the color may also be automatically chosen to be associated with a class of a classifier. One advantage is to allow an intuitive display for a user of a representation of a portion of a human body indicating areas of interest while qualifying the area of ​​interest. The area of ​​interest in this case may refer to a singularity positioned at a position of the first image IMi and / or the second image IM2.

[0078] According to one embodiment, each singularity is represented by a marker 5 independent of the classification of the dermoscopic image associated with it.

[0079] [Fig.2] represents within each image a plurality of markers 5 and a plurality of symbols Sb Si', S2, S2' on each representation.

[0080] In the case of [Fig.2], the two representations correspond to two dates different acquisition DATEi, DATE2 of the first and second IMh IM2 images having a dermoscopic resolution of the human body. They can correspond to two visits of a patient spaced by a period of 6 months for example.

[0081] In the PRESi representation, two symbols 14 and 16 are identifiable by a triangle which can indicate that the singularities are of the same types. These symbols do not seem to have changed class in the second PRES2 representation given that their geometry and color have not changed. The color is here interpreted by the shape of the dashes forming the outline of the geometric shape.

[0082] It is noted that the four symbols 10, 12, 13 and 15 are identifiable by a circle and may indicate that the singularities are of the same types and therefore of a different type than the singularities associated with the symbols 14 and 16. Some of these symbols have changed in the second representation PRES2. Indeed, the symbol 12 has become the symbol 12' and seems to have changed color. It is recalled that the lines forming the outline of the shape here represent the color. The shape of the symbol 10 has changed geometry. It is noted that the symbols 15, 13 and 11 have neither changed geometric shapes nor changed colors.

[0083] Thus, at a glance, a doctor can, for example, draw his attention to singularities allowing for a thorough examination.

[0084] In the present case, certain singularities may have malignancy due to an evolution of the outline of the shape of the singularity or due to the fact that they have been changed classes in the classifier or vice versa.

[0085] The method of the invention allows a saving of time in the examination of a patient and a reduction of human errors for example in subjects with numerous singularities.

[0086] [Fig. 3] represents a representation PRESi of an image on which markers 5 and symbols Si, Si' are superimposed. [Fig. 3] also represents a dermoscopic image IMDi taken on a date DATE,. This dermoscopic image can be displayed in a window following an action by a user on the first image IMi of the first representation PRES]. For example, a click from a mouse pointer activates the display of a window in which a dermoscopic image IMDp is displayed. This image makes it possible to represent a singularity associated with the symbol 11 of the image IMb. The dermoscopic image IMDi displayed is for example extracted from the image IMi according to a predefined size of a predefined framing around the position of the singularity. According to one example, the framing takes into account the geometry of the contour of the singularity so as to display the entire singularity.Thus the size of the magnification of the singularity can be adapted to a defined dimension of a frame.

[0087] [Fig.4] illustrates the PRESi representation in which the image IMi is displayed following an action by an operator at the level of the symbol 12 superimposed on the image IMi. A first dermoscopic image IMDi is displayed in a first window and automatically a second dermoscopic image IMD2 extracted from a second image IM2 acquired at a date prior to DATEi, for example at DATE0 is displayed in a second window in the vicinity of the first window. The display of the second window can be automatic when the shape or the color of the symbol is associated with a change in the singularity of the same position. It can also be a new symbol associated with a singularity that has not been previously classified and newly classified in a given class of the classifier during the last acquisition, that is to say at the most recent date.

[0088] Thus, the geometric or colorimetric characteristic of a symbol associated with a dermoscopic image of a given singularity can be affected by a class attributed to said dermoscopic image, or by a change of class attributed to said dermoscopic image, or by the assignment of a first class of the classifier to said dermoscopic image or even by the result of a mathematical operation carried out on characteristics calculated from two singularities of the same position considered at two different dates.

[0089] An advantage of the invention is to produce an output of a system by means of an interface proposing to display skin maps by part or of the whole body from the macroscopic level to the dermoscopic level with a magnification ranging from x10 to x30. To switch from one view to another, a zoom function can be activated.

[0090] [Fig. 5] represents an exemplary embodiment of a system of the invention comprising a display 20 making it possible to display a first image and a second image produced by the method of the invention. The first image, like the second image, can be reconstructed from images acquired by an image acquisition device 6. In the case of [Fig. 5], it is a mobile robot arm 6 and controllable by means of a trajectory calculator. In this case, the user Ui is lying on a table 22. According to another embodiment, the acquisition device 6 can be a cabin comprising fixed or mobile optics in which an individual Ui positions himself, for example, in a standing position.

[0091] [Fig. 5] also represents another acquisition device 5 arranged in a room making it possible to image the surface of a patient's body. This device is associated with a reference point R'. This device can, for example, make it possible to image a macroscopic representation of the human body and the optical device arranged in the distal part of the robot arm is, for example, configured to image areas of the body with dermoscopic resolution.

[0092] The first image and the second image can be reconstructed by aggregating images acquired by a dermoscopic resolution image acquisition device. According to another method, a composite image is produced from the selection of the sharpest pixels of each acquired image of the human body. According to one embodiment, the images directly acquired by the image capture device can be transmitted to a local or remote computer to feed a neural network trained with images of the skin. An advantage is that it makes it possible to determine classes of the acquired images and to reassign them to singularities positioned in an image reconstructed from all of the images.

Claims

1. Claims Computer-implemented method for generating at least one differential marker (Si, S2) of the presence of a cutaneous singularity of a human body, said method comprising: • Reception on a first date (DATEi) of at least one first image (IMi) of all or part of the human body, called first part, of a first individual (Ui), said first image (IMI) being an image generated from a body model of a human body and a plurality of dermoscopic images of the skin of said human body, allowing the display of a dermoscopic image (IMDi) extracted from said first image (IMJ) with a dermoscopic resolution, said first image (IMi) comprising a plurality of cutaneous singularities (SGi) of the skin of said body, each singularity (SG;) each having coordinates in a first reference frame (Ri) associated with said first image (IMJ) and being associated with a first date (DATEi) and at least one first value (Vi) of a first descriptor (Di); • Reception on a second date (DATE2) of at least one second image (IM2) of the same first part (IMi) of the human body of the first individual (Ui) with a substantially identical resolution, said second image (IM2) being an image generated from a body model of a human body and a plurality of dermoscopic images of the skin of said human body, said second image (IM2) comprising a plurality of cutaneous singularities (SGi) of the skin of said body, each singularity (SG;) each having coordinates in a second reference frame (R2) associated with said second image (IM2) and being associated with a second date (DATE2) and at least one second value (V2) of the first descriptor (Di); • Generation of a digital avatar of a human body and orientation of said avatar by means of a graphical interface so as to display a portion of a human body; Selection of a portion of said human body by means of a graphical interface; Generating a zoom of said portion so as to extract a first image up to the dermoscopic scale of said zoomed portion; Generation of at least a first representation and a second representation of 2D images taken at different times from the first image (IMi) and respectively from the second image (IM2) corresponding to the same zoomed portion of the avatar; Generation of a first representation (PRESi) comprising the first image (IMi) and at least one first symbol (Si) associated with a first singularity (SGi) located at a first position (POSi) of said first image (IMi) of the first reference frame (Ri), said at least first symbol (Si) being superimposed on the first image (IMi) at the first position (POSi), said first symbol (Si) having a first geometry (GEOi) and / or a first color (COLi) generated as a function of at least the first value of the first descriptor (Di) considered at the first date (DATEi); Generation of a second representation (PRES2) in the vicinity of the first representation (PRESi) comprising the second image (IM2) and at least one second symbol (S2) associated with the first singularity (SGi), said second symbol (S2) having a second geometry (GEO2) and / or a second color (COL2), said at least second symbol (S2) being superimposed on the second image (IM2) at the first position (POSi), said second geometry (GEO2) and / or said second color (COL2) being different from the first geometry (GEOi) and / or the first color (COL2) thus defining a differential marker, when the distance calculated between a first value (Vj) of the first descriptor (DJ calculated on the first date (DATE i) and a second value (V2) of the first descriptor (Di) calculated on the second date (DATE2) is greater than a predefined threshold.

2. Method according to claim 1, characterized in that it comprises the generation of a graph comprising a set of nodes, said nodes corresponding to singularities, each node comprising attributes including a position of the singularity (POSi) and at least one value of a descriptor (Di) the two images (IMb IM2) of each representation (PRESi, PRES2) being oriented and aligned with each other by means of a step of comparing the two graphs and minimizing the error of the difference in position of the nodes between them.

3. Method according to claim 1, characterized in that each singularity of the first image (IMi) and / or of the second image (IM2) is associated with a plurality of descriptors (D;) comprising at least one descriptor from the following list: • A contrast value with respect to a value representative of an average color considered in the vicinity of the cutaneous singularity; • A given class of a classifier of an output of a neural network having been trained with dermoscopic images of cutaneous singularities; • A characterization of geometric data of the shape, • A score corresponding to a scalar value or a numerical value obtained by the implementation of an algorithm processing as input an image extracted from the first image or the second image, • A score obtained by a calculation of different values ​​of descriptors of singularities considered in the vicinity of a given singularity.

4. Method according to claim 3, characterized in that when a class is associated with a singularity after acquired images of the skin are provided to a neural network configured to deliver a classification of said provided images, at least one class is included among the following list of classes: • a class relating to the geometry of the periphery of the singularity of a given dermoscopic photo (IMDi, IMD2), • a class relating to the characterization of a geometry of the periphery of the singularity of a given dermoscopic photo (IMDi, IMD2) with respect to a plurality of characterizations of geometries of peripheries of singularities of other dermoscopic photos (IMDi, IMD2) considered in the vicinity of the given dermoscopic photo (IMDi, IMD2); • a class relating to the color of a singularity; • a class relating to the asymmetry of the geometry of the periphery of the singularity of a given dermoscopic image (IMDi, IMD2), • a class relating to the diameter of the geometry of the periphery of the singularity of a given dermoscopic image (IMDb IMD2), when said singularity has a substantially circular shape, • a class relating to the area on which the singularity is present on the human body.

5. Method according to any one of claims 1 to 4, characterized in that an evolution criterion is calculated quantifying the evolution of a descriptor of a singularity between two images (IMb IM2) of two acquisitions carried out on two different dates (DATEb DATE2

6. h Method according to claim 5, characterized in that an evolution criterion is calculated from a distance defined between a first value of a descriptor of a first node of a first graph acquired at a first date and a second value of a descriptor of a second node of a second graph acquired at a second date, each graph being generated from a first image, respectively from a second image, said images corresponding to a body of the same individual and the first node and the second node having the same position within the first and the second image.

7. Method according to claim 4, characterized in that the color and / or the geometry of a symbol (Si, S2) is / are selected according to: • a criterion of belonging of a singularity to at least one class of the classifier; • a value of a descriptor exceeding a threshold value; • the value of a criterion of evolution of a descriptor of a singularity calculated between two first images acquired on two dates (DATE0, DATEi).

8. Method according to claim 1, characterized in that a third symbol (S3) is generated according to a given color and / or shape(s) when a singularity (SGi) is present in a first image acquired at a given position for the first time, said color or said shape of the third symbol (S3) making it possible to distinguish said symbol from another symbol to indicate the new appearance of said singularity.

9. Method according to any one of claims 1 to 8, characterized in that a user interaction with at least one displayed symbol (Si, S2, S3) makes it possible to generate a first digital instruction (CONSi) aimed at displaying at least one dermoscopic image (IMDi) in a display window, said displayed dermoscopic image (IMDi) corresponding to an image extracted from the first image (IMi) associated with the position at which the symbol (Si, S2, S3) is displayed on the first image (IMi).

10. Method according to any one of claims 1 to 8, characterized in that a second digital instruction (CONS2) generated by a user action makes it possible to display two dermoscopic images (IMDi IMD2) side by side extracted respectively from a first image (IMi) and a second image (IM2), said two dermoscopic images (IMDiIMD2) making it possible to display the singularities of the same position on the body according to the same resolution and according to the same scale of dimensions.

11. Method according to any one of claims 1 to 8, characterized in that a first digital command (CDNi) making it possible to move, zoom, or select an area of ​​interest of the first image (IMi) of the first representation (PRESi) automatically causes the generation of an identical digital command (CDN0') on an equivalent area of ​​interest of the second image (IM 2) of the second representation (PRES2).

12. Method according to any one of claims 1 to 11, characterized in that a second digital control (CDN2) makes it possible to orient a three-dimensional digital avatar (MOD0) of the body of an individual so as to display a portion of the body, a third digital control (CDN3) making it possible to enlarge said portion of the body displayed on an area of ​​interest, said area of ​​interest displaying a plurality of markers each having a position at the surface of the human body in a reference frame (Ro) associated with the digital avatar (MOD0), each marker being associated with a singularity of the human body, a fourth digital command (CDN4) making it possible to select said marker to display a dermoscopic image extracted from the first image (IMi), said extracted image being defined around the position of the selected marker.

13. Method according to any one of claims 1 to 12, characterized in that the dermoscopic images are acquired by an image-taking device configured to acquire a plurality of images of the skin of a human body of an individual and to assign to each image a position on a 3D model (MOD0) representing the body of said individual.

14. System comprising an electronic terminal comprising a display for generating the images produced by the method of any one of claims 1 to 13 and a data exchange interface for receiving images acquired by an image acquisition device.

Images