Robotic gripper and control method

Abstract

Multi-digital robotic gripper and control method. Robotic gripper comprising: One or more fingers, at least one actuator to act on the fingers to grip an object, the gripper comprising at least one sensor sensitive to relative movement between the object manipulated by the gripper and the gripper itself, this sensor delivering an output signal, - a control system configured to execute at least one machine learning algorithm trained to deliver, from the output signal(s) from the sensor(s), at least one slip detection score representative of the algorithm's confidence in the presence of slippage, and to transmit control data to the actuators controlling the finger(s), the control data being generated in such a way as to link the intensity of the forces applied by the finger(s) to said score. Figure for the abstract: Fig. 3

Description

Title of the invention: Robotic gripper and control method Technical field

[0001] The present invention relates to the field of robotics and in particular that of the manipulation of objects by grippers, in particular multi-digital grippers. Prior art

[0002] Robotic grippers are designed to grasp objects and move them. They are widely used on assembly lines or for handling operations. During movement, however, it is not uncommon for the object to become unbalanced and slip. Indeed, external disturbances can exceed the forces that can be transmitted by the contact points between the gripper's fingers and the object. The adhesion between the object and the fingers is then lost and the object, subjected to external forces, begins to slip. It also happens that the weight of the object is simply underestimated, the gravitational forces being greater than the forces transmitted by the gripper.

[0003] There are known methods for countering this slippage phenomenon with grippers having a clamping forceps. In particular, some methods consist of detecting and reacting to slippage by increasing the clamping force of the robotic gripper on the object. The clamping force must also be controlled to minimize the energy required and avoid any damage to the object.

[0004] In the case of a robotic gripper, due to the symmetry, the fingers exert opposing forces which cancel each other out and allow the object to be stabilized. When the gripper has fingers which are not arranged symmetrically, which is the case with an "artificial hand", the increase in gripping can induce unwanted movement of the object.

[0005] In the context of grippers comprising more than 3 fingers, it is known to seek to determine a GRASP matrix, which is a representation of the contact points between the object and the gripper, allowing the projection of the forces and torques applied in the frame of reference of the gripper towards the frame of reference of the object. From this matrix, we seek to solve an optimization problem consisting of determining the minimum forces to be applied to stop the sliding while allowing the desired movement of the object, and respecting the dynamic limits of the gripper.

[0006] Chapter 5 "Fundamentals of Grasping, Course CS 237B: Principles of Robot Autonomy 11", Stanford University, J. Bohg, M. Pavone, and D. Sadigh, teaches that optimizing forces with manipulation and friction constraints requires information about the 6-dimensional forces at each point of contact between the object and the gripper. This tends to make implementation complex and expensive.

[0007] Application EP4048480 describes a robotic arm arranged to enable the detection of a slip from a plurality of sensors intended to provide multimodal data. The use of multimodal data aims to enable a cross-referencing of data for the detection of a slip.

[0008] Application US 2020 / 019864 describes machine learning methods intended to collect information during robotic manipulations of objects so as to automate the implementation of such manipulations.

[0009] The article “A Novel Incipient Slip Degree Evaluation Method and Its Application in Adaptative Control of Grasping Force”, Ruomin Sui et al., 1545-5955, 2023 IEEE, describes a method for controlling the gripping force of an experimental robotic gripper with two parallel fingers, based on knowledge of the distribution of contact forces using optical sensors and on a calculation of the friction coefficient.

[0010] The article “Spectro-Temporal Recurrent Neural Network for Robotic Slip Detection with Piezoelectric Tactile Sensor”, Théo Ayral et al., 2023 IEEE / ASME International Conference on Advanced Intelligent Mechatronics (AIM), June 28-30, 2023, Seattle, Washington, USA, describes a method for detecting a slip using an RNN-type neural network providing a binary output: presence of a slip or absence of a slip.

[0011] The article “Detecting and Controlling Slip through Estimation and Control of the Sliding Velocity”, Marco Costanzo et al., Appl. Sci. 2023, 13, 921 describes a method for detecting slip and adapting gripping based on estimating a sliding velocity and friction state between an object and a gripper. Statement of the invention

[0012] There is a need to overcome the drawbacks of the prior art and improve the handling of an object by a robotic gripper, in particular a gripper comprising more than 2 fingers, so as to adapt the clamping as best as possible, react quickly to the occurrence of slippage, avoid damage to the object by excessive clamping while limiting energy consumption, and to improve existing clamping control methods, in particular in order to make them accessible and portable.

[0013] There remains interest in reducing the complexity of robotic grippers, particularly robotic grippers with more than 2 fingers.

[0014] The invention aims to meet all or part of these needs. Summary of the invention Gripper

[0015] The invention relates, according to a first of its aspects, to a robotic gripper comprising: - one or more fingers, - at least one actuator for acting on the finger(s) in order to grip an object, the gripper comprising at least one sensor sensitive to a relative movement between the object manipulated by the gripper and the latter, this sensor delivering an output signal, - a control system configured to execute at least one machine learning algorithm trained to deliver from the output signal(s) from the sensor(s) at least one slip detection score representative of the algorithm's confidence in the presence of slippage, and to transmit control data to the actuators controlling the finger(s), the control data being generated so as to link the intensity of the forces applied by the finger(s) to said score, in particular by increasing the gripping forces on the object all the more strongly as the slip detection score is high.

[0016] Preferably, the control system is arranged to iteratively and incrementally adjust the intensity of the forces exerted by the gripper on the object, the value of the increment being variable and a function of the value of said detection score. sliding at each iteration.

[0017] The invention makes it possible to adapt the gripping of the object by a gripper more quickly and without requiring complex information on the forces and friction. In particular, only one or more sliding detection sensors can be used, in addition to any additional sensors making it possible to know the location of the contact points and information concerning the shape or configuration of the gripper, in order to be able to locate and orient the contact points in the same frame of reference, and to determine the orientation of the normal forces. Knowledge of the intensity of the forces is not necessary. The control of the actuators can thus be carried out without calculating a coefficient of friction and / or without measuring a contact force.

[0018] The invention is applicable to gripping any type of object.

[0019] Due to the absence of the need to measure forces, the invention can allow a reduction in the complexity of the sensors, which can in particular allow the size of the gripper to be reduced. The handling of smaller objects is thus facilitated.

[0020] The invention also makes it possible to limit energy consumption by limiting the clamping forces to what is just necessary to hold the object. Indeed, when the gripper is relatively "sure" of being in the presence of slippage, the clamping forces can be increased quickly to stop the slippage. In the event of uncertainty about the detection of slippage, the gripper does not increase the clamping. or increases it slightly while waiting to see how the detection evolves. If there was no effective slip, we thus avoid increasing the clamping force for nothing, to the detriment of energy consumption. If there was an effective slip, in particular linked to the force of gravity, then this will tend to accelerate, which will lead to a reduction in the detection uncertainty, and the gripper will be able to react correctly.

[0021] The adjustment of the forces applied by the gripper, depending on the slip detection score, thus makes it possible to have a measured reaction to possible slippage and to more easily preserve the integrity of the manipulated object.

[0022] The machine learning algorithm may comprise at least one neural network, in particular of the RNN or TCN type, arranged to classify at least one input signal coming from at least one of said sensors into two classes corresponding respectively to the presence of a slip and to the absence of a slip, the network comprising a last layer with two output neurons taking normalized values, a function making these normalized values depend on the scores of each class, this normalization function preferably being a softmax function.

[0023] The neural network can receive as input data corresponding to successive measurement time windows.

[0024] The sensor(s) may comprise at least one vibration detector, in particular a piezoelectric one.

[0025] The control system can be arranged to perform a spectral analysis of the signal delivered by this or these sensors, for example by applying a fast Fourier transform, in order to generate a spectrogram, and thus know the frequency content of the signal. This spectral analysis can be done iteratively, so as to know its temporal evolution, and the neural network can be trained to classify a temporal segment of the spectrogram.

[0026] The control system may be arranged to output a set of local slip detection scores for different sensors, and generate the slip detection score from these local detection scores, in particular by taking the maximum of the local detection scores, the median of the local detection scores, the average of the local detection scores, the third quartile of the local detection scores or the mode of the local detection scores, and preferably the detection score corresponds to the maximum of the local detection scores.

[0027] At least one finger, preferably several fingers, more preferably all the fingers, comprise several phalanges, each of the fingers comprising at least one sliding-sensitive sensor, in particular a piezoelectric sensor. The gripper may comprise at least two fingers, better still at least 3 fingers, or even at least 5 fingers, each finger preferably comprising several phalanges. The gripper may also include sensors configured to detect contact points, including piezoresistive sensors.

[0028] The control system can be arranged to acquire a distribution of the contact points between the manipulated object and the fingers of the gripper and calculate ratios defining proportionality ratios to be maintained between internal clamping forces applied to the contact points, the ratios being calculated from the distribution of the contact points and the orientation of the fingers in a reference frame linked to the gripper, the internal forces being the forces applied to the contact points which balance each other.

[0029] The calculation of the intensity ratios of the forces at the different points of contact may comprise the determination of a GRASP matrix representative of the forces applied by the gripper to the object at the different points of contact, and the calculation of a basis for the kernel of the matrix, the GRASP matrix being determined by means of the location of the points of contact and the orientation of the fingers in a frame linked to the gripper. The forces applied to the object may be modified by a factor proportional to the slip detection score while respecting the intensity ratios applied to the different points of contact as determined by the GRASP matrix.

[0030] The touch sensors are preferably arranged so as to each allow detection over an extended surface. The extended surface may cover the entire finger or only the operational surface of the gripper which is intended to be in contact with the manipulated object, for the contact point sensors.

[0031] The slip detection sensors and the contact point sensors may be independent. A single slip detection sensor may be sufficient for the complete gripper.

[0032] The control system may comprise one or more processors, one or more microcontrollers, one or more personal computers, one or more automatons.

[0033] The control system may be at least partly embedded on the gripper. Method

[0034] The invention also relates, according to another of its aspects, to a method for controlling a gripper handling an object, in particular a gripper according to the invention as defined above, the gripper comprising:

[0035] - one or more fingers,

[0036] - at least one actuator for acting on the finger(s) in order to grip the object,

[0037] - at least one sensor sensitive to a relative movement between the object manipulated by the gripper and the latter, this sensor delivering an output signal,

[0038] the method comprising:

[0039] generating at least one slip detection score using at least one machine learning algorithm trained to deliver, from the at least one output signals from the sensor(s), said score, the latter being representative of the algorithm's confidence in the presence of slippage, and

[0040] the control of the actuator(s) controlling the finger(s) so as to link the intensity of the forces applied by the finger(s) to said score, in particular by increasing the gripping forces on the object all the more strongly as the slip detection score is high.

[0041] Such a method makes it possible to avoid the estimation and modeling of friction between the object and the gripper.

[0042] The intensity of the forces exerted by the gripper on the object can be adjusted iteratively and incrementally, the value of the increment being variable and a function of the value of said slip detection score at each iteration.

[0043] Such iterations make it possible in particular to minimize the forces necessary to stop the sliding, and thus avoid any damage to the object and unnecessary energy losses.

[0044] In exemplary implementations of the control method, adjusting the intensity may include comparing the slip detection score to at least one threshold value or reference scale, wherein the determination of the adjustment is made relative to this comparison. For example, when the slip detection score is less than or equal to a threshold value, no adjustment is made, and similarly when the slip detection score is greater than or equal to a threshold value, no adjustment is made.

[0045] The acquisition of at least one signal representative of a negligible relative movement is thus not systematically taken into account. This advantageously makes it possible to avoid perpetual adjustment of the forces applied by the gripper around a force which would be optimal.

[0046] The machine learning algorithm may comprise at least one neural network, in particular of the RNN or TCN type, arranged to classify at least one input signal coming from at least one of said sensors into two classes corresponding respectively to the presence of a slip and to the absence of a slip, the network comprising a last layer with two output neurons taking normalized values, a function making these normalized values depend on the scores of each class, this normalization function preferably being a softmax function.

[0047] The sensor(s) may comprise at least one vibration detector, in particular piezoelectric, and the method may comprise a spectral analysis of the signal in order to generate a spectrogram. The neural network may be trained to classify a time segment of the spectrogram.

[0048] A set of local slip detection scores may be generated for different sensors, and the slip detection score may be calculated from these local detection scores, in particular by taking the maximum of the local detection scores, the median of the local detection scores, the mean of the local detection scores, the third quartile of the local detection scores or the mode of the local detection scores, and preferably the detection score corresponds to the maximum of the local detection scores.

[0049] A decoupling of the internal forces and the manipulation forces can be achieved. The internal forces correspond to the forces applied to the contact points which balance each other. The gripping forces Fc applied by the gripper to the manipulated object can be written: Fc = Fm + Fo, where Fm corresponds to the manipulation forces and Fo to the internal forces.

[0050] Intensity ratios preferably only take into account internal forces.

[0051] An acquisition of a distribution of the contact points between the manipulated object and the fingers of the gripper can thus be carried out, and ratios defining proportionality ratios to be maintained between internal clamping forces applied to the contact points can be calculated, the ratios being calculated from the distribution of the contact points and the orientation of the fingers in a reference frame linked to the gripper, the internal forces being the forces applied to the contact points which balance each other.

[0052] The calculation of the intensity ratios of the forces at the different points of contact may include the determination of a GRASP matrix representative of the forces applied by the gripper to the object at the different points of contact, and the calculation of a basis of the kernel of the matrix, / 0= (x; I ie [1; N]) ', N being the number of points of contact between the gripper and the manipulated object, the GRASP matrix being determined by means of the location of the points of contact and the orientation of the fingers in a frame linked to the gripper. The forces applied to the object may be modified by a factor proportional to the slip detection score while respecting the intensity ratios applied to the different points of contact as determined by the GRASP matrix.

[0053] Preferably, the chosen base does not include negative values, corresponding to attractive forces, for example suction.

[0054] Heuristic methods can be implemented to select a base. Such methods make it possible to select a relevant base, in particular compatible with the physical constraints of configuration and control of the gripper.

[0055] Determining intensity ratios involves finding the coefficients x;, solving the equation:

[0056] [Math.l]

[0057] f0= (Xi I ie [1 ; N])

[0058] The clamping forces being in the core of the GRASP matrix, they do not generate any displacement of the object.

[0059] [Math.2]

[0060] The matrix G comprises at least the location of the contact points and the orientation of the base associated with the contact point, and the model used to describe the nature of the contact (number of force components, friction model). The GRASP matrix G can be determined from the location of the contact points and the orientation of the associated reference points.

[0061] The GRASP matrix takes into account the normal forces at the contact points, and possibly the tangential forces and the moments. These elements may or may not be represented, depending on the capabilities of the gripper to measure and control these forces. The measurement and control of the tangential forces and the moments are not necessary for implementing the method of the invention. In exemplary implementations, the intensity ratios only take into account the normal components of the internal forces. In particular, a GRASP matrix can be used in “frictionless” mode to determine the intensity ratios between the normal forces only, making it possible to simplify the control of the sliding. The calculation of these intensity ratios makes it possible to reduce the complexity of the sensors necessary for the operation of the robotic gripper, if necessary.

[0062] Maintaining these intensity ratios between the internal forces ensures the balance of the manipulated object. Furthermore, by decoupling the internal forces from the manipulation forces, only the question of the balance of the gripping of the manipulated object is taken into account, the manipulation being able to be carried out in parallel. This decoupling simplifies the adjustment of the forces and reduces the risk of unexpected movements occurring.

[0063] In particular, in addition to the location, information on the orientation of the normal contact forces between the object and the gripper can be associated with each point of contact, in particular by analyzing the shape and configuration of the gripper.

[0064] The orientations can be calculated from the locations of the contact points and the configuration of the gripper, in particular the relative positioning of the fingers of the gripper, the positioning of the phalanges when the fingers are formed of phalanges, the positioning of the gripper relative to the object.

[0065] The calculation of the intensity ratios to be respected between the forces can be implemented iteratively in parallel with the steps of the control method aimed at reacting to the sliding. Computer program product

[0066] The invention also relates to a computer program product, in particular recorded on a medium or in a memory, comprising code instructions which, when the program is implemented by the control system of the robotic gripper according to the invention, lead the latter to implement the control method according to the invention. Brief description of the drawings

[0067] The invention may be better understood by reading the detailed description which follows, non-limiting examples of its implementation, and by examining the attached drawing, in which:

[0068] [Fig. 1] [Fig. 1] partially and schematically illustrates an example of a robotic gripper according to the invention,

[0069] [Fig.2] [Fig.2] schematizes the determination of a point of contact between the gripper and object,

[0070] [Fig.3] [Fig.3] illustrates an example of implementation of a control method and from the calculation of intensity ratios,

[0071] [Fig.4] [Fig.4] represents the determination of the distribution of the contact points around an object held by a gripper with 3 fingers, and

[0072] [Fig.5] [Fig.5] illustrates an example of iterative adjustment of the internal forces of the gripper over time.

[0073] In the remainder of the description, elements that are identical or have similar functions bear the same reference sign. Their description is not repeated with respect to each of the figures, only the main differences between the embodiments being mentioned. Detailed description

[0074] An example of a multi-digital robotic gripper 1 is illustrated in [Fig.l]. The gripper is shown gripping an object 20, which can be any object.

[0075] The robotic gripper 1 comprises several fingers 10, for example three in number, as illustrated.

[0076] The fingers 10 may comprise phalanges 12, as illustrated.

[0077] Each finger comprises at least one touch sensor 14.

[0078] In preferred embodiments, each phalanx 12 of each finger 10 comprises at least one touch sensor 14, as shown in [Fig.2].

[0079] The gripper 1 also comprises actuators 16 arranged to actuate the fingers and allow the manipulation of the object 20.

[0080] The actuators 16 are connected to a control system 18 which controls them in function in particular of the movements that they must transmit to the object.

[0081] The control system can be implemented with any suitable calculation means, and comprises for example one or more processors which execute code instructions making it possible to process the signals from the sensors and to control the actuators, depending on the manipulations of the object to be carried out as programmed by a user, and automatically control the actuators to grip the object with sufficient force to prevent the gripped object from slipping.

[0082] The determination of the intensity ratios to be maintained between the forces can be carried out iteratively by implementing the calculation method 5 illustrated in [Fig.3].

[0083] Control of the actuators to prevent slippage can be carried out iteratively by implementing the control method 4 also illustrated in this figure.

[0084] These two processes can be executed in parallel or consecutively.

[0085] The control system 18 can in particular, from signals transmitted by the sensors 14, determine on the one hand the presence of contact points 30 between the fingers of the gripper and the object, and on the other hand generate information linked to the sliding.

[0086] As illustrated in [Fig.2], the sensors may be arranged to enable contact detection over a large area. In particular, the contact between the finger sensor and the object is not necessarily reduced to a point but may be a contact surface 32. Depending on the signals acquired by the sensor, the control system may determine a representative contact point 30 from these contact surfaces 32.

[0087] The sensor 14 may comprise a pressure sensor, and the contact point may correspond to the highest pressure point of the surface, the contact point being for example the barycenter of the contact surface 32.

[0088] The calculation method 5 comprises a step of locating contact points from signals acquired by the sensors 14 of the gripper and determining a distribution of these contact points in a global reference frame [(xi,yi,Zi), (x2,y2,z2), ..., (xn,yn,zn)]-

[0089] [Fig.4] shows schematically an object 20 and the contact points 301, 302, 303 with the fingers 101, 102, 103 of the gripper.

[0090] The control system 18 can be configured so as to allow the detection of the distribution of the contact points 301, 302, 303 around the object 20, in a global reference frame (X,Y,Z).

[0091] The distribution in the global reference frame (X,Y,Z) of a contact point 30 can be determined from a local position of the contact point relative to the sensor 14 and the configuration of the robotic gripper.

[0092] The intensity ratios to be maintained between the forces applied to the different points contact points allowing the object 20 to be held can be calculated from the distribution of the contact points in the global frame, for example by determining a base / 0 of the kernel, Ker(G), of a matrix G constructed from the distribution of the contact points.

[0093] Preferably, only the internal forces are considered, in other words the matrix G is constructed by assuming a decoupling of the internal forces and the manipulation forces constituting the forces applied by the gripper to the manipulated object.

[0094] In the example of [Fig.4], it can be estimated that the contact points 301, 302, 303 are distributed around the object 20, at the same height. In a global reference frame, it can be defined that the contact point 301 is at an angle 03Oi = 0; the contact point 302 is at an angle 03o2 = -5ir / 6 and the contact point 303 is at an angle 03O3 = 5ir / 6.

[0095] Assuming decoupling of internal forces and manipulation forces and that the friction forces of the internal forces are zero, the matrix G of the example in [Fig.4] can have the following form:

[0096] [Math.2] sinO - sinO 0 ' - cosO - cosf) -1 G = 0 0 0 0 0 0 0 0 0 . 0 0 0 .

[0097] With 0 = 03O3 = -03O2 = 5ir / 6

[0098] A basis of the kernel of G can be:

[0099] [Math.3] ' 0.577 ' 0.577 . 1 .

[0100] The intensity ratios to be maintained between the forces applied to the different contact points therefore correspond here to [0.577; 0.577, 1]. In other words, for an increase in the internal force applied to the contact point 301 of a, the increase in the internal force applied to the contact points 302 and 303 will be 0.577*a.

[0101] Obviously, this example is presented for illustrative purposes and is not limiting. In particular, the frictional forces (tangential) are, if necessary, taken into consideration in the construction of the matrix G, in particular when the gripper allows them to be controlled.

[0102] These ratios can be determined by the control system 18 and condition the commands transmitted to the actuators 16, with regard to maintaining the object by the gripper, that is to say without considering the forces applied to move the object in space.

[0103] The control system 18 is arranged so as to allow the implementation of an iterative control method 4 comprising at each iteration a step of generating a slip detection score between the manipulated object and the gripper, and a step of adjusting the forces applied by the gripper to the object so as to stop any slipping, the adjustment comprising an increase in the force applied to the object that is all the greater the greater the slip detection score.

[0104] For example, the sensors 14 comprise vibration sensors, in particular piezoelectric sensors, which react to the vibrations induced by sliding. The vibration sensor may be that described in the article “Spectro-Temporal Recurrent Neural Network for Robotic Slip Detection with Piezoelectric Tactile Sensor”, Ayral et al., 2023 IEEE / ASME International Conference on Advanced Intelligent Mechatronics (AIM), June 28-30, 2023. Seattle, Washington, USA, in chapter II page 574, this article being incorporated herein by reference.

[0105] A fast Fourier transform (FFT) 40 can be applied to the signals from the sensors 14 so as to generate a spectrogram making it possible to concentrate the rest of the processing on certain frequencies representative of the slip and eliminate the noise linked to the actuators, as described in the article “Spectro-Temporal Recurrent Neural Network for Robotic Slip Detection with Piezoelectric Tactile Sensor”.

[0106] The power spectral density (PSD) can thus be calculated on the signals delivered by the piezoelectric detectors after subtraction of the average over time windows of sampled values, to provide successive spectrograms serving as input data to a previously trained machine learning algorithm 42 can be implemented to determine the slip detection score.

[0107] The machine learning algorithm may comprise at least one neural network, in particular a recurrent neural network (RNN).

[0108] The machine learning algorithm may correspond to that described in the article "Spectro-Temporal Recurrent Neural Network for Robotic Slip Detection with Piezoelectric Tactile Sensor", Ayral et al., 2023 IEEE / ASME International Conference on Advanced Intelligent Mechatronics (AIM), June 28-30, 2023. Seattle, Washington, USA, modified by the addition of a final normalized neural layer with a softmax function providing two normalized scores as output, one of which a is a normalized and bounded value between 0 and 1 corresponding to the confidence level on the presence of slippage, the highest value 1 corresponding to a higher confidence on the presence of an effective slippage than the value 0.

[0109] The neural network may have the architecture described in point IV) chapter B 1) page 575 of the article “Spectro-Temporal Recurrent Neural Network for Robotic Slip Detection with Piezoelectric Tactile Sensor” above and include a stack of 4 GRU units as described in the publication K. Cho, B van Merrienboer, D Bahdanau, and Y Bengio, “On the properties of neural machine translation: Encoder-decoder approaches” 2014 https: / / arxiv.org / abs.1409.1259. The network described in the article “Spectro-Temporal Recurrent Neural Network for Robotic Slip Detection with Piezoelectric Tactile Sensor” produces a 32-channel representation of each time step (“sequence-to-sequence”), and the outputs are classified independently by a fully connected linear classification layer.

[0110] The training may have been performed for each slip-sensitive sensor as described in 2) of the same chapter, by simultaneously training the classification layer and the RNN end-to-end, with training data that can be generated automatically as described in the article in chapter III.

[0111] It is thus possible to determine in parallel using several instances of the machine learning algorithm local slip detection scores (ai, a2, ..., an ) for each of the gripper's slip sensors, and the maximum value of the local scores can be taken as the slip detection score a. In particular, for each slip sensor, an instance of the algorithm is implemented.

[0112] Alternatively, a single instance of the machine learning algorithm may take as input a concatenation of the sensor signals so as to determine as output an overall value a.

[0113] A comparator 44 can compare at each iteration the slip detection score a with a threshold value beyond which the score a is taken into account as representative of the presence of slippage of the object relative to the gripper.

[0114] Preferably, the adjustment takes into account the distribution of the contact points around the object, by applying the method of calculating the intensity ratios described above.

[0115] A force increase factor or increment may be determined at each iteration from the score a, while maintaining the force intensity ratios to be exerted by the gripper on the object at the various contact points. The adjustment may thus include an increase in the forces applied by the gripper to the object proportional to a

[0116] Alternatively, the increase can be determined by comparing the score a with threshold values. For example, if a is less than a threshold value Vo, then no adjustment is made, if a is in the interval ]V0; VJ then the adjustment is an increase of [3i* / 0; ..if a is in the interval ]Vm4; 1] then the adjustment is an increase of [3m* / 0>with [3i, constants.

[0117] In a particular embodiment, when the score a is greater than a threshold value, the adjustment consists of an increase in the internal forces by a predetermined value. The forces at the different contact points are increased by this predetermined value modulated by the intensity ratios of the forces to be maintained between the different contact points.

[0118] [Fig.5] represents an example of curves showing the evolution of the normal forces applied by a gripper to an object over time. These curves are compared to the weight of the object Wo and to the friction forces CLim between the object and the gripper allowing the gripper to grip said object.

[0119] We can identify 3 beginnings of sliding of the object at 2s, 4s and 6s.

[0120] The CLim curve corresponds to the friction force.

[0121] In the example of [Fig.5], several iterations of the slip control method are implemented, the iteration value being variable XI, X2, X3, X4, and depending on the score a, in order to stop the detected slip.

[0122] Thus, in the example of [Fig.5], the adjustment is progressive and depends on the score a estimated at each iteration.

[0123] The curve Fn corresponds to the sum of the intensities of the normal forces applied to the different points of contact between the object and the gripper.

[0124] The invention is not limited to the examples described.

[0125] Non-piezoelectric sensors may be used as slip-sensitive sensors, and non-piezoresistive sensors may be used to provide information on the location of the contact points; for example, vision sensors may be used to provide information on the contact points.

[0126] The sensors can thus be chosen from any type of capacitive sensors and / or optical touch sensors such as GelSight® or FingerVision®.

[0127] Since the method according to the invention does not require knowledge of the forces at the contact points, it is possible to use any type of sensor making it possible to obtain signals from which a movement can be detected and allowing the location of contact points.

[0128] The sensors may form a matrix of unit sensors.

[0129] The determination of the intensity ratios can take into account, in addition to the normal forces, the friction forces. However, it is preferred not to take them into account. Taking friction forces into account improves accuracy, but complicates the calculation steps and the control of the forces, constrained by the capacities of the gripper.

[0130] The control system may operate asynchronously at each point of contact.

[0131] A TCN type neural network can be used in the machine learning algorithm.

Claims

Claims

1. A robotic gripper comprising: - One or more fingers (10), - at least one actuator (16) for acting on the finger(s) (10) in order to grip an object (20), the gripper comprising at least one sensor (14) sensitive to a relative movement between the object manipulated by the gripper and the latter, this sensor delivering an output signal, - a control system (18) configured to execute at least one machine learning algorithm trained to deliver from the output signal(s) coming from the sensor(s) (14) at least one slip detection score (a) representative of the algorithm's confidence in the presence of slippage, and to transmit control data to the actuators (16) controlling the finger(s), the control data being generated so as to link the intensity of the forces applied by the finger(s) to said score,in particular by increasing the gripping forces on the object all the more strongly as the slip detection score is high.,

2. Robotic gripper according to the preceding claim, the control system (18) being arranged to iteratively and incrementally adjust the intensity of the forces exerted by the gripper on the object, the value of the increment being variable and a function of the value of said slip detection score at each iteration.

3. Gripper according to one of the preceding claims, the machine learning algorithm comprising at least one neural network, in particular of the RNN type, arranged to classify at least one input signal coming from at least one of said sensors into two classes corresponding respectively to the presence of a slip and to the absence of a slip, the network comprising a last layer with two output neurons taking normalized values and a function making these normalized values depend on the scores of each class, this normalization function preferably being a softmax function.

4. Gripper according to the preceding claim, the sensor(s) comprising at least one vibration detector, in particular piezoelectric, the control system (18) being arranged to carry out a spectral analysis of the signal in order to generate a spectrogram, and the neural network being trained to classify a time segment of the spectrogram.

5. A gripper according to any preceding claim, the control system being arranged to deliver a set of local slip detection scores (ab a2, ..., an ) for different sensors, and generate the slip detection score from these local detection scores, in particular by taking the maximum of the local detection scores, the median of the local detection scores, the mean of the local detection scores, the third quartile of the local detection scores or the mode of the local detection scores, and preferably the detection score corresponds to the maximum of the local detection scores.

6. Method according to one of the preceding claims, in which at least one finger, preferably several fingers, more preferably all the fingers, comprise several phalanges, each of the fingers comprising at least one sensitive sliding sensor, in particular a piezoelectric sensor.

7. Robotic gripper according to one of the preceding claims, comprising sensors configured to detect the contact points, in particular piezoresistive sensors.

8. Gripper according to any one of the preceding claims, the control of the actuators being carried out without calculating a coefficient of friction and / or without measuring a contact force.

9. Gripper according to any one of the preceding claims comprising at least two fingers (10), better still at least 3 fingers, or even at least 5 fingers, each finger preferably comprising several phalanges, each finger preferably comprising at least one sliding-sensitive sensor.

10. Gripper according to the preceding claim, the control system being arranged to acquire a distribution of the contact points between the manipulated object and the fingers of the gripper and to calculate ratios defining intensity ratios to be maintained between internal clamping forces applied to the contact points, the ratios being calculated from the distribution of the contact points and the orientation fingers in a frame linked to the gripper, the internal forces being the forces applied to the points of contact which balance each other.

11. Gripper according to the preceding claim, in which the calculation of the intensity ratios of the forces at the different points of contact comprises the determination of a GRASP matrix representative of the forces applied by the gripper to the object at the different points of contact, and the calculation of a basis of the kernel of the matrix, the GRASP matrix being determined by means of the location of the points of contact and the orientation of the fingers in a reference frame linked to the gripper.

12. Gripper according to claim 11, the forces applied to the object being modified by a factor proportional to the slip detection score while respecting the intensity ratios applied to the different contact points as determined by the GRASP matrix.

13. A method for controlling a gripper handling an object (20), in particular a gripper as defined in any one of the preceding claims, the gripper comprising: - one or more fingers, - at least one actuator (16) for acting on the finger(s) (10) in order to grip the object (20), - at least one sensor (14) sensitive to a relative movement between the object handled by the gripper and the latter, this sensor delivering an output signal, the method comprising: generating at least one slip detection score using at least one machine learning algorithm trained to deliver, from the output signal(s) from the sensor(s) (14), said score (a), the latter being representative of the algorithm's confidence in the presence of slippage, and controlling the actuator(s) (16) controlling the finger(s) so as to link the intensity of the forces applied by the finger(s) to said score (a), the latter being representative of the algorithm's confidence in the presence of slippage, and controlling the actuator(s) (16) controlling the finger(s) so as to link the intensity of the forces applied by the finger(s) to said score (a). score,in particular by increasing the gripping forces on the object all the more strongly as the slip detection score is high.,

14. Method according to the preceding claim, in which the intensity of the forces exerted by the gripper on the object is adjusted iteratively and incrementally, the value of the increment being variable and a function of the value of said slip detection score at each iteration.

15. Method according to one of claims 13 and 14, the machine learning algorithm comprising at least one neural network, in particular of the RNN type, arranged to classify at least one input signal coming from at least one of said sensors into two classes corresponding respectively to the presence of a slip and to the absence of a slip, the network comprising a last layer with two output neurons taking normalized values and a function making these normalized values depend on the scores of each class, this normalization function preferably being a softmax function.

16. Method according to claim 15, the sensor(s) comprising at least one vibration detector, in particular piezoelectric, the method comprising a spectral analysis of the signal in order to know the frequency content of the signal and its temporal evolution, and the neural network being trained to classify a temporal segment of the signal.

17. A method according to any one of claims 13 to 16, wherein a set of local slip detection scores (ab a2, ..., an ) is generated for different sensors, and the slip detection score is calculated from these local detection scores, in particular by taking the maximum of the local detection scores, the median of the local detection scores, the mean of the local detection scores, the third quartile of the local detection scores or the mode of the local detection scores, and preferably the detection score corresponds to the maximum of the local detection scores.

18. Method according to any one of claims 13 to 17 in which an acquisition of a distribution of the contact points between the manipulated object and the fingers of the gripper is carried out, and ratios defining intensity ratios to be maintained between internal clamping forces applied to the contact points are calculated, the ratios being calculated from the distribution of the contact points and the orientation of the fingers in a reference frame linked to the gripper, the internal forces being the forces applied to the contact points which balance each other.

19. Method according to the preceding claim, in which the calculation of the intensity ratios of the forces at the different points of contact comprises the determination of a GRASP matrix representative of the forces applied by the gripper to the object at the different points of contact, and the calculation of a basis of the kernel of the matrix, the GRASP matrix being determined by means of the location of the points of contact and the orientation of the fingers in a reference frame linked to the gripper.

20. Method according to claim 19, the forces applied to the object being modified by a factor proportional to the slip detection score while respecting the intensity ratios applied to the different contact points as determined by the GRASP matrix.

21. A computer program comprising code instructions which, when the program is executed on one or more processors of a system for controlling a robotic gripper according to any one of claims 1 to 12, cause the latter to implement the control method according to any one of claims 13 to 20.