Method for classifying objects, in particular shoes, with a view to sorting them and then recycling them

Abstract

The present invention relates to a method for classifying a product in a system (1), with a view to sorting it, the method being characterized in that it comprises the following steps being implemented by data processing means (21a) of a first server (2a) connected to the system (1): (a) obtaining at least a first image of the product and a second image potentially representing the product from a first viewpoint and a second viewpoint different from the first viewpoint, respectively, from cameras (11, 12) of the system (1); (b) detecting the product based on the result of applying a first object detection model to the first image and a second object detection model to the second image; (c) when the product is detected, obtaining a first vector describing the product and a second vector describing the product by way of a first feature extraction model and a second feature extraction model applied to the first image and the second image, respectively; (d) classifying a long vector corresponding to a concatenation of the first and second vectors describing the product, by way of a classification model.

Description

[0001] Description

[0002] Title of the invention: Method for classifying objects, in particular shoes, with a view to sorting and then recycling them.

[0003] GENERAL TECHNICAL FIELD

[0004] The present invention relates to the field of recycling. More specifically, it relates to a method for classifying objects, in particular shoes, with a view to sorting them and then possibly recycling them.

[0005] STATE OF THE ART

[0006] Recycling products requires knowing their composition and assembly, in order to be able to send them to the correct processing line.

[0007] Techniques are known for classifying objects moving on a conveyor belt, in particular using neural networks, see patent US10824936.

[0008] While such techniques work very well for classifying waste (for example, to distinguish between paper, plastic or aluminum), it is much more difficult for products such as shoes, for which there are a very large number of models and sometimes almost identical models but with completely different compositions.

[0009] It has therefore been proposed to use RFID tags implanted in shoes as an alternative, but it is noted that:

[0010] - Often only one shoe out of two is equipped with the RFID tag, in particular to avoid interference.

[0011] - The label is sometimes destroyed if the shoe has been worn too much.

[0012] So, today there is no other choice but to use human operators, which is not acceptable. The invention improves the situation.

[0013] PRESENTATION OF THE INVENTION

[0014] The present invention therefore relates, according to a first aspect, to a method for classifying a product in a system, with a view to sorting it, the method being characterized in that it comprises the implementation by data processing means of a first server connected to said system of steps of:

[0015] (a) Obtaining at least a first image of said product and a second image potentially representing said product respectively from a first point of view and a second point of view different from the first point of view, from cameras of said system;

[0016] (b) Detecting said product based on the result of applying a first object detection model to the first image and a second object detection model to the second image;

[0017] (c) When said product is detected, obtaining a first descriptive vector of said product and a second descriptive vector of said product by means of a first feature extraction model and a second feature extraction model respectively applied to the first image and the second image;

[0018] (d) Classification of a long vector corresponding to a concatenation of the first and second descriptive vectors of said product, by means of a classification model.

[0019] According to advantageous and non-limiting characteristics:

[0020] Step (b) comprises calculating a first detection score by applying the first object detection model to the first image, and calculating a second detection score by applying the second object detection model to the second image. The product is detected in step (b) if the product of the first and second detection scores is greater than a predetermined threshold.

[0021] The first and second object detection models are object localization models, step (b) further comprising localizing said product in the first and second images, and cropping the first and second images to the localized product, step (c) being performed on the first and second cropped images.

[0022] Step (b) comprises determining a first bounding box of the product by applying the first object localization model to the first image, and determining a second bounding box of the product by applying the second object localization model to the second image, the product being detected in step (b) only if the first and / or second bounding box of the product satisfies at least one given criterion.

[0023] The first and second object localization models are convolutional neural networks, particularly of the YOLO type.

[0024] The method comprises a step (aO) of training said first and second object detection models, first and second feature extraction models, and / or classification model, on first and second reference image bases representing a plurality of instances of the product respectively according to said first and second viewpoints.

[0025] Step (aO) comprises generating reference images representing a plurality of instances of the product respectively according to said first and second viewpoints by inserting said instances of the product into empty images according to said first and second viewpoints.

[0026] The first and second feature extraction models are feature extraction blocks of convolutional neural networks, particularly of the Swin Transformer type.

[0027] The classification model is a neural network, in particular of the perceptron type. According to a second aspect, the invention relates to a method for sorting a product in a system, characterized in that it comprises the implementation of the method for classifying the product according to the first aspect, and a step (e) of sorting the product by the system according to the result of said classification.

[0028] According to a third aspect, the invention proposes a server for classifying a product in a system, with a view to sorting it, the server being characterized in that it comprises data processing means configured to:

[0029] - Obtaining at least a first image of said product and a second image potentially representing said product respectively from a first point of view and a second point of view different from the first point of view, from cameras of said system;

[0030] - Detecting said product based on the result of applying a first object detection model to the first image and a second object detection model to the second image;

[0031] - When said product is detected, obtaining a first descriptive vector of said product and a second descriptive vector of said product by means of a first feature extraction model and a second feature extraction model respectively applied to the first image and the second image;

[0032] - Classify a long vector corresponding to a concatenation of the first and second descriptive vectors of said product, using a classification model.

[0033] According to a fourth aspect, the invention relates to an assembly comprising a server according to the third aspect and the connected system.

[0034] According to a fifth and a sixth aspect, the invention relates to a computer program product comprising code instructions for executing a method according to the first aspect of classifying a product in a system, with a view to sorting it; and a storage means readable by computer equipment on which is recorded a computer program product comprising code instructions for executing a method according to the first aspect of classifying a product in a system, with a view to sorting it.

[0035] PRESENTATION OF FIGURES

[0036] Other characteristics and advantages of the present invention will appear on reading the following description of a preferred embodiment. This description will be given with reference to the appended drawings in which:

[0037] [Fig. 1] Figure 1 is a diagram of a system for implementing the method according to the invention;

[0038] [Fig. 2a] Figure 2a represents an example of an image of a product from a first point of view;

[0039] [Fig. 2b] Figure 2b represents an example of an image of a product from a second point of view;

[0040] [Fig. 3] Figure 3 is a flowchart illustrating the steps of an embodiment of the method according to the invention;

[0041] [Fig. 4] Figure 4 schematically illustrates the arrangement of the models used;

[0042] [Fig. 5] Figure 5 represents an example of a synthetic reference image.

[0043] DETAILED DESCRIPTION

[0044] Architecture The present invention relates to a method for classifying a product in a system 1 as represented in FIG. 1, in particular for implementing the sorting of said product, in particular for its recycling.

[0045] Said product can be any product whose sorting is desired, in particular an item of clothing, and in the remainder of the description a shoe will be taken, but it can be any type of product, and in particular a spare part, bulk goods, waste, etc. It is understood that the present method is capable of classifying a large number of instances (i.e. examples) of said product, presented sequentially.

[0046] In this respect, said system 1 is typically of the belt conveyor type (as seen in figure 1), that is to say that it comprises an endless conveyor belt 10, continuously moving instances of said product, but any other technique may be used (the system 1 may be roller-based, bucket-based, have arms, or even a cavity crossed by the product in free fall, etc.).

[0047] Classification means assigning each product one of a plurality of predetermined classes, for example, corresponding to a shoe model. The number of classes can be very high; in particular, there may be hundreds of shoe models. Alternatively, the class can relate to a material (or combination of materials) or directly to a possible recycling technique for the product. This method is not limited to any particular classification strategy.

[0048] Sorting means the separation of the product instances according to the classification result. As such, said system 1 preferably comprises product sorting means 13, for example switches, doors, various actuators, or even gripping arms, etc. The sorting means 13 make it possible to place together the product instances of the same class (for example all the shoes of the same model), with a view to recycling them. Note that the system 1 can even be a recycling system and comprise means for recycling the sorted products. The system 1 further comprises cameras 11, 12 for observing said product. Preferably, there is at least a first camera 11 making it possible to observe said product from a first point of view and a second camera 12 making it possible to observe said product from a second point of view different from the first point of view.The idea is to observe the product from several angles so as to increase the quality of information and facilitate its classification. It is understood that in this respect all the copies of the product in system 1 will be placed as far as possible in approximately the same orientation, for example point forward on strip 10 as in the case of figure 1, even if the method will have a certain robustness and will be capable of recognizing a shoe which would have for example been placed upside down, in particular by taking into account a number of possible points of view greater than two (we will see later an example with eight possible points of view).

[0049] For example, the first viewpoint will be from above the product, and the second viewpoint will be from one side, resulting in example images as seen in Figures 2a and 2b respectively.

[0050] Note that there can be more than two viewpoints and therefore more than two cameras 11, 12. In particular, as explained before, up to eight viewpoints could be taken into account, with in the case of a shoe:

[0051] - View from the left side;

[0052] - Left % view;

[0053] - Front view;

[0054] - Right % view;

[0055] - Right view;

[0056] - Top view;

[0057] - Oblique top view.

[0058] The present method is implemented by a first server 2a which can be part of the system 1, or remote and connected by a network 20 such as the internet network. Note that we can have the same first server 2a connected to several systems 1. Advantageously, we have a second server 2b (which is a learning device as we will see), typically remote (i.e. in the network 20), but which can be confused with the first server 2a.

[0059] Each server 2a, 2b has data processing means 21a, 21b (typically a processor) and data storage means 22a, 22b (a memory, for example a hard disk). As will be seen, the data processing means 22b of the second server 2b can store a learning database. For the sake of simplification, the learning database is called “learning base” in the remainder of this description.

[0060] Process

[0061] With reference to Figure 3, the present method is implemented by the data processing means 21 of the first server 2a, and begins with a step (a) of obtaining (from the system 1) at least a first image of said product and a second image potentially representing said product respectively according to the first point of view and the second point of view different from the first point of view, from the cameras 11, 12 of said system 1.

[0062] In other words, step (a) advantageously comprises the acquisition of the first image of the product by the first camera 11 and the second image of the product by the second camera 12, and the transmission to the server 2a of the pair of the first image and the second image. These images are called “candidate” as opposed to “reference” images which will be used for learning models.

[0063] The method then comprises a step (b) of detecting said product based on the result of applying a first object detection model to the first image and a second object detection model to the second image. By detection is meant identification of the product in said images, i.e. recognition that the images indeed represent an occurrence of the product (and not another object).

[0064] According to a first embodiment, steps (a) and (b) are repeated in a loop, in particular at a given frequency (in particular corresponding to an acquisition frequency of the cameras 11 and 12, for example every 100 ms). The idea is that the cameras 11, 12 continuously acquire pairs of images (i.e. film) and the means 21a attempt to detect the product there. The rest of the method is implemented only when the product is detected, because in fact there is no need to classify images which are known not to represent the product. This embodiment is particularly suitable for a belt conveyor on which the product instances move continuously and are therefore only at a specific moment in the right place in front of the cameras 11, 12.

[0065] According to a second embodiment, steps (a) and (b) are implemented after the product has been placed in a given position, for example a discontinuous operation with arms grabbing the product instances one by one. It is then known that the pair of images obtained in step (a) should represent the product, the objective of step (b) is to confirm this and potentially locate the product.

[0066] In all cases, the first and second object detection models may be object localization models, in particular convolutional neural networks, for example of the YOLO type (but also R-CNN, Mobilenet, etc.), trained on reference image bases representing a plurality of instances of the product respectively according to said first and second points of view (and advantageously other points of view as mentioned before, the learning will be discussed in more detail later). Those skilled in the art know numerous detection networks capable of recognizing a product, and the two models may be different or identical.

[0067] As seen in Figure 4, step (b) then advantageously further comprises the location of said product in the first and second images, and the cropping of the first and second images on the located product, the rest of the method (step (c)) being implemented on the first and second cropped images so as to “standardize” them and facilitate their classification. It is also possible to have pre-processing such as clipping, etc.

[0068] Note that said detection is in itself already a classification, because we classify what the images represent as being an occurrence of the product (i.e. a shoe) but with a lower precision than the classification expected here. For example, YOLO is capable of recognizing an object as being a shoe but not of recognizing hundreds of different models of shoes, which can be very similar. As we will see, the present method achieves this.

[0069] Note that step (b) is specific in that we have two images and therefore two detection results. Typically, step (b) includes calculating a first detection score by applying the first object detection model to the first image, and calculating a second detection score by applying the second object detection model to the second image. Each detection score is generally a value between 0 and 1 representative of the probability of detection, and we often have a detection threshold (e.g. 95%).

[0070] Thus, we can have cases in which only one of the two detection models would detect the product (the first score is above the threshold and the second score is below the threshold).

[0071] There are many different ways to do this:

[0072] - According to a first classic mode, the product is considered to be detected at the unanimous stage, i.e. if the product is detected in each image (each model returns a detection score higher than the individual threshold, for example 95%).

[0073] - According to a second mode, the product is detected in step (b) if the product of the first and second detection scores is greater than a predetermined threshold, for example 90%. This makes it possible not to rule out cases where just one model out of the two would return a score slightly lower than the individual threshold. Note that both modes can be implemented at the same time, i.e. the product is detected in step (b) in one or other of the cases (i.e. if each of the first and second detection scores is greater than an individual threshold or if the product of the first and second detection scores is greater than a common threshold).

[0074] - According to a third mode, the product is detected in step (b) if one of the first and second detection scores is greater than a low threshold (for example 92%) and the other is greater than a high threshold (for example 97%). This is an “intermediate” mode between the two previous modes in terms of severity. Note that it can also be implemented at the same time as one or other of these modes.

[0075] - According to a fourth mode, potentially in combination with one or other of the preceding modes, when the detection models are localization models, step (b) comprises the determination of a first bounding box of the product by applying the first object detection model to the first image, and the calculation of a second bounding box of the product by applying the second object detection model to the second image, and the product is detected in step (b) only if the first and / or the second bounding box satisfies at least one criterion, such as a minimum size or a sufficiently centered position, to avoid truncated detections which would penalize the rest of the classification. In other words, even if the product is perfectly detected, we wait until the bounding box is of sufficient quality before launching the rest of the method.In the preferred embodiment based on YOLO, the outputs of the two detection (localization) models are noted;.

[0076] [x11, y11, x21, y21, p1, c1] (first image)

[0077] [x12, y12, x22, y22, p2, c2] (second image)

[0078] With :

[0079] - (x1 i, y1 i) the coordinates (in terms of pixels) of the upper-left corner of the bounding box

[0080] - (x2i, y2i) the coordinates (in terms of pixels) of the lower right corner of the bounding box (we have 0 < x1 i < x2i < image width i, and 0 < y1i < y2i < image height i).

[0081] - pi the detection score.

[0082] - here the class of the detected object (potentially always 0 in our case because only one “shoe” class is expected).

[0083] In the case where one would use the third mode and the fourth mode in combination, the trigger condition for classification (i.e. implementation of the rest of the process) would be formulated as:

[0084] If (p1 > low threshold and p2 > high threshold) OR (p1 > high threshold and p2 > low threshold) AND (x1i > min position 1 and / or x2i > min position 2, for example middle of the image, or equivalent on the y1i and / or y2i).

[0085] Then, when said product is detected, the method comprises a step (c) of obtaining a first descriptive vector of said product and a second descriptive vector of said product by means of a first feature extraction model and a second feature extraction model respectively applied to the first image and the second image (if applicable cropped).

[0086] Preferably, said first and second feature extraction models are feature extraction blocks of neural networks performing vision tasks (in particular classification, localization, segmentation, etc.), in particular of the Swin Transformer type (but also VGG, YOLO, etc.)

[0087] Indeed, all these networks first have a feature extraction block, then a final encoding block performing the expected task from the extracted feature vector. For example, the encoding block of YOLO generates the vector [x1, y1, x2, y2, p, c] from the feature vector.

[0088] This feature vector, or "feature map," is a high-level representation of the input image. Note that the feature extraction block can in practice generate a feature matrix, which is then converted into a vector by arranging the lines in sequence.

[0089] We will see later how we can obtain first and second feature extraction models, but again they can be identical or different, and potentially taken directly off the shelf.

[0090] The advantage of only triggering step (c) in the event of detection is that it saves resources, because feature extraction models are much more cumbersome and time-consuming to implement if sufficient reliability is desired.

[0091] Finally, in a particularly original step (d), as seen in Figure 4, the method comprises the classification of a long vector corresponding to a concatenation of the first and second descriptive vectors of said product, by means of a classification model.

[0092] Indeed, we could directly classify each image (and somehow combine the results of both classifications), but as explained, the reliability is insufficient for fine classification, for example at the level of shoe models. By concatenating the two vectors, we combine the information from the two images in a clever way, and then we become able to achieve the sufficient level of reliability.

[0093] The classification model used can be any model capable of classifying a vector (since the feature extraction has already been carried out), in particular any forward propagation neural network, or even a simple perceptron, and not necessarily a convolutional neural network for vision.

[0094] Training

[0095] The method advantageously comprises a prior step (aO) of learning (or training) said first and second object detection models, first and second feature extraction models, and / or classification model being trained on first and second reference image bases representing a plurality of instances of the product respectively according to said first and second points of view, in particular implemented by the processing means 21 b of the second server 2 b, the model then being loaded onto the first server 2 a. It is recalled that the second server 2 b may be confused with the first server 2 a.

[0096] These reference images are associated in a set of images representing the same instance of the product according to various points of view (at least one pair according to the first and second points of view) and are already classified, that is to say that we know that they represent the product and they are associated with an expected classification result (ground truth), which is naturally the same for all the images of the same set.

[0097] Especially :

[0098] - the first and second object detection models may be pre-trained (or fully trained) on public databases. Alternatively or in addition, they are trained (this is fine-tuning if the models are already pre-trained) on the reference images representing a plurality of instances of the product respectively according to said first and second viewpoints. The first and second models may be identical and trained on all the reference images (including according to additional viewpoints - up to eight viewpoints) to improve their robustness, or trained more specifically on the reference images corresponding to the associated viewpoint (i.e. first viewpoint for the first detection model and second viewpoint for the second detection model) to improve their accuracy.

[0099] - As regards the first and second feature extraction models, it is recalled that this is typically the feature extraction block of complete models (further comprising a final encoding block). It is these more complete models that are in practice trained, and in a similar manner to the detection models: they can also be pre-trained (or fully trained) on public databases (for any task such as classification, detection, segmentation, etc.). Alternatively or in addition, they are trained (this is fine-tuning if the models are already pre-trained) on the reference images representing a plurality of instances of the product respectively according to said first and second points of view, this time specifically in the classification task.Again, the two models can be identical and trained on all reference images (including additional viewpoints - up to eight viewpoints) to improve their robustness, or trained more specifically on the reference images corresponding to the associated viewpoint (i.e., first viewpoint for the first feature extraction model and second viewpoint for the second feature extraction model) to improve their accuracy. The feature extraction models are finally recovered by removing the encoding block from the fully trained model.

[0100] - the classification model requires the reference image base: preferably we fix the weights of the feature extraction models, for each pair / set of reference images (representing the same instance of the product according to the first and second point of view - but again potentially other points of view) by constructing the corresponding long vector, and we train the classification model to predict the expected classification result for these reference images.

[0101] In a particularly preferred manner, step (a0) comprises the generation of reference images representing a plurality of instances of the product respectively according to said first and second points of view by inserting said instances of the product into empty images according to said first and second points of view, i.e. the creation of synthetic reference images.

[0102] Naturally, alternatively or additionally, we can generate “authentic” reference images by having numerous instances of the product in system 1 and using cameras 11, 12, but this takes a long time, particularly if we want a fine classification, especially at the shoe model level, because many reference images are required.

[0103] Thus, with reference to Figure 5, one can simply take a photo of the instances of the product on any background (in particular a neutral background, for example white or green) according to the various points of view (in particular the eight points of view mentioned), preferably in a standardized manner in terms of shooting conditions (lighting, etc.), which can be done simply and everywhere, without having the system.

[0104] Then, actually knowing the first and second viewpoints of system 1, we select from the images according to the eight viewpoints those which correspond to the first and second viewpoints, we cut out the product (i.e. we remove the neutral background and we extract the part of the image which represents the product), and we embed it on the empty image (see the result in the right part of figure 5). Note that the “empty image” can be a plain background, or an image from a camera 11, 12 in the absence of the product, then representing the “empty” system 1.

[0105] In any case, augmentation techniques can be used to multiply the number of synthetic and / or authentic reference images.

[0106] Server

[0107] According to a second aspect, the invention relates to the method of sorting a product in the system 1 (connected to the first server 2a).

[0108] As explained, it comprises the implementation of the method of classifying the product according to the first aspect (steps (a)-(d)), then a step (e) of sorting the product by the system 1 according to the result of said classification, in particular by using sorting means 13 of the system 1, for example switches, doors, various actuators, or even gripping arms, etc.

[0109] According to a further aspect, the invention may even relate to the method of recycling a product in the system 1, if the system 1 is suitable for it.

[0110] In this respect, the method further comprises a step (f) of recycling the sorted product, each class of product being associated with a suitable recycling technique (and therefore the sorted products can all undergo the same suitable technique together).

[0111] Server

[0112] According to a third aspect, the invention relates to the first server 2a for implementing the method according to the first aspect.

[0113] Thus, this first server 2a comprises, as explained, at least data processing means 21a and a memory 22a. It is typically a server for classifying a product in a system 1, potentially integrated into said system.

[0114] The data processing means 21a are configured to implement steps consisting of:

[0115] - Obtaining at least a first image of said product and a second image potentially representing said product respectively from a first point of view and a second point of view different from the first point of view, from cameras 11, 12 of said system 1;

[0116] - Detecting said product based on the result of applying a first object detection model to the first image and a second object detection model to the second image;

[0117] - When said product is detected, obtaining a first descriptive vector of said product and a second descriptive vector of said product by means of a first feature extraction model and a second feature extraction model respectively applied to the first image and the second image;

[0118] - Classify a long vector corresponding to a concatenation of the first and second descriptive vectors of said product, by means of a classification model

[0119] According to a fourth aspect, the invention proposes an assembly comprising said first server 2a, as well as at least one system 1 connected (via the network 20). Advantageously, said system also comprises the second server 2b, connected to the first server 2a still via the network 20.

[0120] The second server 2b comprises data processing means 21b configured to implement the training of said first and second object detection models, first and second feature extraction models, and / or classification model, on first and second reference image bases representing a plurality of instances of the product respectively according to said first and second viewpoints.

[0121] Again, system 1 and / or first server 2a and / or second server 2b may be confused.

[0122] Computer program product

[0123] According to a fifth and a sixth aspect, the invention relates to a computer program product comprising code instructions for the execution (on the data processing means 21a of the first server 2a) of a method according to the first aspect of classifying a product in a system 1, with a view to sorting it, as well as storage means readable by computer equipment (for example the data storage means 22a of the first server 2a) on which this computer program product is found.

Claims

CLAIMS 1. Method for classifying a product in a system (1), with a view to sorting it, the method being characterized in that it comprises the implementation by data processing means (21a) of a first server (2a) connected to said system (1) of steps of: (a) Obtaining at least a first image of said product and a second image potentially representing said product respectively according to a first point of view and a second point of view different from the first point of view, from cameras (11, 12) of said system (1); (b) Detecting said product based on the result of applying a first object detection model to the first image and a second object detection model to the second image; (c) When said product is detected, obtaining a first descriptive vector of said product and a second descriptive vector of said product by means of a first feature extraction model and a second feature extraction model respectively applied to the first image and the second image; (d) Classification of a long vector corresponding to a concatenation of the first and second descriptive vectors of said product, by means of a classification model.

2. The method of claim 1, wherein step (b) comprises calculating a first detection score by applying the first object detection model to the first image, and calculating a second detection score by applying the second object detection model to the second image.

3. The method of claim 2, wherein the product is detected in step (b) if the product of the first and second detection scores is greater than a predetermined threshold.

4. Method according to one of claims 1 to 3, wherein the first and second object detection models are object localization models, step (b) further comprising localizing said product in the first and second images, and cropping the first and second images onto the localized product, step (c) being implemented on the first and second cropped images.

5. Method according to one of claims 2 and 3 in combination with claim 4, wherein step (b) comprises determining a first bounding box of the product by applying the first object location model to the first image, and determining a second bounding box of the product by applying the second object location model to the second image, the product being detected in step (b) only if the first and / or second bounding box of the product satisfies at least one given criterion.

6. Method according to one of claims 4 and 5, in which the first and second object localization models are convolutional neural networks, in particular of the YOLO type.

7. Method according to one of claims 1 to 6, comprising a step (aO) of training said first and second object detection models, first and second feature extraction models, and / or classification model, on first and second reference image bases representing a plurality of instances of the product respectively according to said first and second points of view.

8. The method of claim 7, wherein step (a0) comprises generating reference images representing a plurality of instances of the product respectively according to said first and second viewpoints by inserting said instances of the product into empty images according to said first and second viewpoints.

9. Method according to one of claims 1 to 8, in which the first and second feature extraction models are feature extraction blocks of convolutional neural networks, in particular of the Swin Transformer type.

10. Method according to one of claims 1 to 9, in which the classification model is a neural network, in particular of the perceptron type.

11. Method for sorting a product in a system (1), characterized in that it comprises the implementation of the method for classifying the product according to one of claims 1 to 10, and a step (e) of sorting the product by the system (1) according to the result of said classification.

12. Server (2a) for classifying a product in a system (1), with a view to sorting it, the server (2a) being characterized in that it comprises data processing means (21a) configured to: - Obtaining at least a first image of said product and a second image potentially representing said product respectively according to a first point of view and a second point of view different from the first point of view, from cameras (11, 12) of said system (1); - Detecting said product based on the result of applying a first object detection model to the first image and a second object detection model to the second image; - When said product is detected, obtaining a first descriptive vector of said product and a second descriptive vector of said product by means of a first feature extraction model and a second feature extraction model respectively applied to the first image and the second image; - Classify a long vector corresponding to a concatenation of the first and second descriptive vectors of said product, using a classification model.

13. Assembly comprising a server (2a) according to claim 12 and the system (1) connected.

14. Computer program product comprising code instructions for executing a method according to one of claims 1 to 10 for classifying a product in a system (1), with a view to sorting it, when said program is executed on a computer.

15. Storage means readable by computer equipment on which is recorded a computer program product comprising code instructions for the execution of a method according to one of claims 1 to 10 for classifying a product in a system (1), with a view to sorting it.

Images