Method for predicting the value of a target quantity exhibiting a geographical dependence for a candidate object.

Abstract

The present invention relates to a method for predicting the value of a target quantity exhibiting a geographical dependence for a candidate object defined by a first vector of structural characteristics of said object and a second vector of geographical characteristics of said object, the method being characterized in that it comprises the implementation by data processing means (11) of a first server (1), of Selection steps, in a database of reference objects each also defined by a first vector of structural characteristics and a second vector of geographical characteristics, and associated with a known value of said quantity, of at least one set of comparable reference objects to said candidate object, by application of at least one information retrieval model trained on said database of reference objects;Estimation of the value of said target quantity for said candidate object as a function of the known values ​​of said quantity for comparable reference objects selected from said candidate object, by application of a prediction neural network comprising at least one attention block. [Fig. 1];

Description

Title of the invention: Method for predicting the value of a target quantity exhibiting a geographical dependence for a candidate object.

[0001] GENERAL TECHNICAL FIELD

[0002] The present invention relates to the field of spatial analysis and geographic regression. More specifically, it concerns a method for predicting the value of a target quantity exhibiting a geographic dependence for a candidate object defined by two vectors of structural and geographic characteristics respectively.

[0003] STATE OF THE ART

[0004] A large number of physical or economic phenomena exhibit a geographical dependence, i.e. are not entirely defined by intrinsic parameters, but also by a spatial parameter.

[0005] The same property, for example, would be assigned a different value depending on its location. Similarly, the same industrial site will have different environmental impacts depending on its geographical position. To give a final example, meteorological phenomena depend not only on atmospheric physical conditions, but also on the location where they occur.

[0006] Predicting a quantity exhibiting such geographical dependence proves to be very complex, even with a large training base.

[0007] We know of "geographical regression" mechanisms adapted to the field of spatial analysis and taking into account geographical dependence, whereas in classical regression it is presupposed that the phenomenon is stationary in the space studied.

[0008] The integration of the geographical concept often involves using a spatial interpolation mechanism. This consists of combining known neighboring values ​​to form a local estimate. However, the method for selecting these neighbors, often based on the k-nearest neighbors (k-NN) model, can be simplistic. Moreover, combining the selected values ​​remains a challenge at high dimensions, requiring consideration of numerous structural and geographical factors. Thus, these methods have several areas for improvement.

[0009] More recently, it has been proposed to use deep learning models, and in particular neural networks coupled with attention mechanisms.

[0010] The document Viana, D., Barbosa, L.: Attention-based spatial interpolation for house price prediction proposes, for example, a hybrid mechanism called ASI (Attention- Spatial Interpolation (SIP) is used to estimate the value of a property. Nearest neighbors are weighted based on their similarity in attributes (the "Euclidean" attention block) and their geographical proximity (the "geo-attention" block). A neural network is then applied to the outputs of the attention blocks to create an embedding representation of the property, which can then be used to predict its value.

[0011] This solution is particularly efficient but proves to be very computationally intensive, with the ASI requiring nearly 20,000 parameters. Beyond the simple question of the necessary resources and computation time, such a model is too complex for its decisions to be explainable and therefore to inspire confidence.

[0012] The present invention improves the situation. PRESENTATION OF THE INVENTION

[0013] The present invention relates, in a first aspect, to a method for predicting the value of a target quantity exhibiting a geographical dependence for a candidate object defined by a first vector of structural characteristics of said object and a second vector of geographical characteristics of said object, the method being characterized in that it comprises the implementation, by data processing means of a first server, of steps of a. Selection, in a database of reference objects stored on data storage means accessible by said first server, each reference object also being defined by a first vector of structural characteristics of said reference object and a second vector of geographical characteristics of said reference object, and associated with a known value of said magnitude, of at least one set of reference objects comparable to said candidate object, by application to the first vector and / or the second vector of said candidate object of at least one information retrieval model trained on said database of reference objects; b. Estimation of the value of said target quantity for said candidate object as a function of the known values ​​of said quantity for the reference objects comparable to said candidate object selected, by application of a prediction neural network comprising at least one attention block, step (b) comprising at least one step (b2) of obtaining a weight of each comparable reference object according to a proximity of the first vector of the comparable reference object with the first vector of the candidate object and / or a proximity of the second vector of the comparable reference object with the second vector of the candidate object, by application of said attention block.

[0014] According to advantageous and non-limiting features:

[0015] Said prediction neural network further includes at least one encoding block upstream of the attention block, step (b) including a prior step (bl) of obtaining a representation of each candidate object or comparable reference object, by applying said encoding block to the first and / or second vector(s) of the candidate object and comparable reference objects, said attention block being applied in step (b) to said representations of the candidate object and comparable reference objects.

[0016] Said encoding block comprises at least one bi-encoder, in particular a multilayer perceptron, the step (bl) comprising, for each comparable reference object, obtaining a representation of said comparable object, by applying said encoding block to both the first and / or second vector(s) of the candidate object, and to the first and / or second vector(s) of said comparable reference object.

[0017] The attention block implements a similarity calculation, step (b2) comprising, for each comparable reference object, obtaining the weight of said comparable reference object, by calculating the similarity between the representation of said comparable reference object and the representation of the candidate object.

[0018] Preferably, said similarity calculation is a dot product, i.e. the attention block implements a dot product calculation, step (b2) comprising, for each comparable reference object, obtaining the weight of said comparable reference object, by the dot product of the representation of said comparable reference object and the representation of the candidate object.

[0019] Said prediction neural network comprises a single encoding block and a single attention block, the encoding block being applied to both the first and second vectors of the candidate object and comparable reference objects.

[0020] Step (a) includes the selection:

[0021] - of a first set of reference objects comparable to said candidate object in in terms of structural characteristics, by applying at least to the first vector of said candidate object a first information retrieval model trained on said database; and

[0022] - of a second set of reference objects comparable to said candidate object in terms of geographical characteristics, by applying at least to the second vector of said candidate object a second information retrieval model trained on said database.

[0023] The information retrieval block(s) and the prediction neural network form a RetrievaLEnhanced Machine Learning, REML type set.

[0024] The said structural characteristics of the object are not geographical.

[0025] Said attention block includes a first ancillary block, step (b2) comprising the adjustment, for each comparable reference object, of the weight of said comparable reference object by application of said first ancillary block.

[0026] Said predictive neural network further includes a second auxiliary block, step (b2) comprising, for each comparable reference object, the adjustment of the known value of the target quantity for said comparable reference object by application of said second auxiliary block.

[0027] The prediction neural network includes an aggregation layer at the output of the attention block, the method comprising a step (b3) of calculating a weighted sum of the known values ​​of the target quantity for each comparable reference object, by said weights of each comparable reference object, said raw aggregation value, by application of said aggregation layer; the value of said target quantity for said candidate object being estimated either directly as said raw aggregation value, or as a function of said raw aggregation value.

[0028] Said prediction neural network further includes at least one decoding block downstream of the attention block, step (b) including a step (b4) of adjusting said raw aggregation value by applying said decoding block to a so-called global representation of the candidate object.

[0029] Said decoding block includes a multilayer perceptron and a security mechanism using a bounded function, typically hyperbolic tangent, step (b4) including the calculation of an adjustment factor to be applied to the raw aggregation value.

[0030] The method includes a step (aO) of training, by means of data processing of a second server, the information retrieval model and said prediction neural network, from said database of reference objects.

[0031] According to a second aspect, the invention relates to a first server for predicting the value of a target quantity exhibiting a geographical dependence for a candidate object defined by a first vector of structural characteristics of said object and a second vector of geographical characteristics of said object, characterized in that it comprises data processing means configured to: • Select, from a database of reference objects stored on data storage means accessible by said first server (1), each reference object also being defined by a first vector of structural characteristics of said reference object and a second vector of geographical characteristics of said reference object, and associated with a known value of said quantity, at least one set of reference objects comparable to said candidate object, by application to the first vector and / or the second vector of said candidate object of at least one information retrieval model trained on said database of reference objects; • Estimate the value of said target quantity for said candidate object as a function of the known values ​​of said quantity for the reference objects comparable to said candidate object selected, by application of a prediction neural network comprising at least one attention block, including obtaining a weight of each comparable reference object according to a proximity of the first vector of the comparable reference object with the first vector of the candidate object and / or a proximity of the second vector of the comparable reference object with the second vector of the candidate object.

[0032] According to a third and a fourth aspect, the invention relates to a computer program product comprising code instructions for the execution of a process according to the first aspect of predicting the value of a target quantity exhibiting a geographical dependence for a candidate object defined by a first vector of structural characteristics of said object and a second vector of geographical characteristics of said object; and a computer-readable storage means on which is stored a computer program product comprising code instructions for the execution of a process according to the first aspect of predicting the value of a target quantity exhibiting a geographical dependence for a candidate object defined by a first vector of structural characteristics of said object and a second vector of geographical characteristics of said object. PRESENTATION OF THE FIGURES

[0033] Other features and advantages of the present invention will become apparent from the description of a preferred embodiment which follows. This description will be given with reference to the accompanying drawings in which:

[0034] [Fig.1] [Fig.1] is a diagram of a system for implementing the process according to the invention;

[0035] [Fig.2] [Fig.2] is a flowchart illustrating the steps of an embodiment of the process according to the invention;

[0036] [Fig. 3] [Fig. 3] illustrates a predictive artificial neural network structure used in a preferred embodiment of the method according to the invention. DETAILED DESCRIPTION

[0037] Architecture

[0038] The present invention relates in a first aspect to a method for predicting the value of a target quantity exhibiting a geographical dependence for a candidate object, with reference to [Fig.1].

[0039] It is assumed that a database of reference objects is stored on data storage means 12 accessible by a first server 1, forming a training set. Note that the means 12 may in practice be those of the first server 1 (which is the execution server of the process as will be seen) as represented by [Fig. 1] (for example, a memory such as a hard drive) or may be distinct / remote from the first server 1 and only connected to it, for example via a communication network 20 such as the internet.

[0040] It is understood that the candidate object and the reference objects are of the same type, the difference being that the reference objects are each associated with a known, for example measured, value of the target quantity, called the "expected value," whereas this value is generally unknown and therefore to be predicted for the candidate object. It is nevertheless possible, of course, to treat a reference object as a candidate object, i.e., to act as if the value of the target quantity for that object were unknown, for example during the learning phase which will be described later.

[0041] Note that the objects and said target quantity may be of any nature of interest (the objects are described in detail later), as long as said target quantity has a geographical dependence, i.e. its value has a spatial correlation.

[0042] In this respect, each object (candidate or reference) is defined by a first vector of structural characteristics of said object, of dimension dh and a second vector of geographical characteristics of said object, of dimension d2.

[0043] By structural characteristics of said object, we mean intrinsic characteristics, structural being understood in the primary sense of the term (and not as "relating to a physical structure" of the object), and designates intrinsic characteristics. To rephrase, the structural characteristics of the object are non-geographic attributes, as opposed to the geographic characteristics of the second vector. Whatever the object, said geographic characteristics of the second vector are advantageously coordinates (latitude, longitude), but they could alternatively be, for example, an address, or the distances to predefined points of interest (POIs).

[0044] For example, the object could be a property, and the quantity could target its price, CO2 emissions, energy consumption, etc. The structural characteristics of the first vector would then be its surface area, number of floors, construction materials, etc. Any useful characteristics could be chosen.

[0045] Note that there may also be, for the reference objects, a third vector of relative characteristics of said object, of dimension d3, relative being understood with respect to to the candidate object. For example, the distance between the candidate object and the reference object could be a relative characteristic. In contrast, all the characteristics of the first and second vectors are absolute characteristics. Naturally, the third vectors depend on the candidate object and cannot, of course, be stored in the database; the relative characteristics that compose them are, for example, calculated on the fly (based on the first and second vectors of the two objects). Naturally, there is no third vector of relative characteristics for the candidate object (that wouldn't make sense).

[0046] As shown in [Fig. 1], in addition to the first server 1, a client terminal 10, such as a workstation or smartphone, is advantageously used. This terminal provides an interface through which the user can interact, and an optional second training server 2 is also used. It is understood that the first server 1 is connected to the client terminal 10 and to the optional second server 2, for example, via a network 20, such as the internet.

[0047] The first / second servers 1, 2 comprise data processing means 11, 21 such as a processor of any kind, and data storage means 12, 22 i.e. a memory.

[0048] Note that the second server 2 may, where appropriate, be confused with the client terminal 10 and / or with the first server 1.

[0049] Process

[0050] With reference to [Fig.2], the present method is implemented by the data processing means 11 of the first server, and advantageously begins by obtaining said first and second vectors of the candidate object from the client terminal 10, for example by direct input on an interface of the terminal 10.

[0051] The process then includes a step (a) of selecting, from the database of reference objects, at least one set of reference objects comparable to the candidate object. As will be seen, "comparable" means close in terms of structural characteristics (i.e., "similar") and / or geographical characteristics (i.e., "neighboring"). In the following description, we will refer to comparable objects to designate more precisely objects comparable to the candidate object.

[0052] This selection was in itself already known, and traditionally implemented by a basic algorithm (typically on the basis of a predetermined metric such as Euclidean distance for proximity in terms of structural features or Haversine distance for geographical features and / or predetermined features), with a predefined number of comparable objects, for example 60 in the document Viana, D., Barbosa, L.: Attention-based spatial interpolation for house price prediction mentioned above.

[0053] Indeed, this high number is necessary for the good performance of the algorithm, but also the main cause of its cumbersome nature in addition to the high number of parameters for the prediction model.

[0054] The present invention advantageously solves the problem by providing for said selection by applying to the first vector and / or the second vector of said candidate object at least one information retrieval model trained on said database. In practice, the training of said retrieval model is an intelligent indexing of said database.

[0055] By information retrieval model, we mean a model adapted to the task of extracting relevant data from a database, known as "information retrieval". The information retrieval model takes as input the first vector and / or second vector of said candidate object and identifies comparable, i.e., similar, reference objects on the basis of these vectors, and in particular returns the first vectors and / or second vectors of these comparable reference objects.

[0056] An information retrieval model can be seen as a "search engine" returning relevant objects for a candidate object. It is the development of new models of this type that allows for the refinement of an approach that has hitherto been more naive in the literature.

[0057] The use of these models within a Retrieval Enhanced Machine Learning (REML) structure allows in particular the development of new selection techniques such as vector search.

[0058] These structures are described in the document Retrieval-Enhanced Machine Learning, Hamed Zamani, Fernando Diaz, Mostafa Dehghani, Donald Metzler, Michael Bendersky.

[0059] While the primary objective of information retrieval models is efficiency in massive databases, here they are used for their relevance and the quality of their selection. In practice, the model can be trained to return a few well-chosen objects, advantageously fewer than ten (this number can vary depending on the candidate object). It is observed that the selection thus performed yields more relevant references than more naive approaches.

[0060] Preferably, we use a pair of information retrieval models (denoted first information retrieval model and / or second information retrieval model). However, the structure also works with only one of them.

[0061] Step (a) then includes the selection:

[0062] - of a first set of reference objects comparable to said candidate object in in terms of structural characteristics, by application at least to the first vector said candidate object of the first information retrieval model trained on said database (more precisely on the first vectors of the reference objects); and / or

[0063] - of a second set of reference objects comparable to said candidate object in in terms of geographical characteristics, by applying at least to the second vector of said candidate object an information retrieval model trained on said database (more precisely on the second vectors of the reference objects).

[0064] To rephrase, the first information retrieval model can select comparable objects on the basis of their structural characteristics alone, while the second can select comparable objects on the basis of their geographical characteristics alone.

[0065] Alternatively, and preferably, the first information retrieval model selects comparable objects using both structural and geographical characteristics, while the second always selects comparable objects solely on the basis of their geographical characteristics.

[0066] It could very well be possible to have only one single information retrieval model selecting comparable objects either on the basis of their structural characteristics alone or their geographical characteristics alone, or both on the basis of their structural and geographical characteristics, or even a hybrid scheme with on one side an information retrieval model (in particular the first) and a traditional algorithm (for example to select geographical neighbors).

[0067] It is even possible to have more than two information retrieval models, for example by searching for comparable objects on the basis of only certain structural characteristics (i.e. by cutting the first vector), or simply with the same characteristics, but a different encoding.

[0068] The embodiment with at least two information retrieval models is particularly preferred because it allows for leveraging both types of proximity and achieving the best results. Known algorithms, notably the Attention-based spatial interpolation (ASI) mechanism, select only geographical neighbors and therefore ignore structurally similar but geographically more distant objects. Other methods allow for this, but impose a manually chosen metric, which is difficult to adapt to a new dataset and is not optimal.

[0069] If several sets of comparable objects have been selected, these sets are pooled in the rest of the procedure, either directly or at the end of step (b2), see below.

[0070] Next, the method includes a step (b) of estimating the value of said target quantity for said candidate object as a function of the known values ​​of said quantity for the selected comparable reference objects (one or more sets), by application of a prediction neural network (the prediction model, also called the "downstream" model) comprising at least one attention block, which can be implemented in any known way, although preferred embodiments, particularly suited to REML models, will be seen later.

[0071] The attention mechanism is a popular technique used in deep learning models for many tasks such as object detection in images, large language models, and recommendation engines. The underlying idea is to help the predictive model focus its attention on the most useful comparable objects when generating its output.

[0072] Step (b) includes at least one step (b2) of obtaining a weight of each comparable reference object according to a proximity of the first vector of the comparable reference object with the first vector of the candidate object and / or a proximity of the second vector of the comparable reference object with the second vector of the candidate object, by application of said attention block.

[0073] Said weight constitutes an attention score, i.e. a scalar, representing a level of proximity of the comparable object with the candidate object, so that the set of weights of the comparable objects forms an attention vector (of size equal to the number of comparables selected).

[0074] According to a first embodiment, said attention block can be applied directly to the first and / or second vector(s) of the candidate object and comparable reference objects. One can even, similarly to the ASI mechanism, have two attention blocks: one applied to the first vectors (allowing a first weight to be assigned to each comparable reference object based on the proximity of the first vector of the comparable reference object to the first vector of the candidate object) and the other applied to the second vectors (allowing a second weight to be assigned to each comparable reference object based on the proximity of the second vector of the comparable reference object to the second vector of the candidate object), i.e., two attention vectors are obtained, each with a size equal to that of each group of reference objects. Again, as with information retrieval models, even more could be used.

[0075] According to a second, preferred embodiment, said predictive neural network further comprises at least one encoding block (or encoder block) upstream of the attention block, that is to say, a block for generating a "representation" of data The input, called "embedding," is typically in the form of a vector or a matrix feature map. Such encoding blocks are well-known and facilitate the attention stage and ultimately the prediction. The encoding block can be pre-trained (and possibly fine-tuned afterward) or trained from scratch.

[0076] Then, step (b) includes a preliminary step (bl) of obtaining a representation of each candidate object or comparable reference object, by applying said encoding block to the first and / or second vector(s) of the candidate object and comparable reference objects.

[0077] Said attention block is then applied in step (b) to said representations of the candidate object and comparable reference objects.

[0078] Like attention blocks, there can be several and / or as many as attention blocks, but anything is possible:

[0079] - 1 encoding block (applied to the first and second vectors) and 1 attention block as in the example of [Fig.3];

[0080] - 2 encoding blocks (applied respectively to the first and second vectors) and 2 attention blocks;

[0081] - 2 encoding blocks and 1 attention block applied to a concatenation of representations obtained by the two blocks for a comparable object

[0082] - etc.

[0083] In a particularly preferred manner, said encoding block comprises at least one bi-encoder, in particular a multilayer perceptron (MLP), advantageously implementing an activation function of type SELU (Scaled Exponential Linear Unit).

[0084] A dual encoder is known to increase robustness. It applies to vectors from the candidate object and comparable reference objects in the same way, so that they are represented homogeneously.

[0085] In other words, step (bl) includes, for each comparable reference object, obtaining a representation of said comparable object, by applying said encoding block to both the first and / or second vector(s) of the candidate object, and to the first and / or second vector(s) of said comparable reference object.

[0086] For example, in the case of a single encoding block, noting F; the absolute features (i.e. first and / or second vector) of the i-th comparable object, Fc those of the candidate object, and Z; and Zc the corresponding representations, we have Z; = BiEncoder(F; ) and Zc = BiEncoder(Fc).

[0087] With regard to the attention block, it advantageously implements a scalar product calculation, in particular on vector representations.

[0088] Then, step (bl) preferentially includes, for each comparable reference object, obtaining the weight of said comparable reference object by the scalar product of the representation of said comparable reference object and the representation of the candidate object.

[0089] Mathematically, we have aa; = Z;.ZC, with a; the weight of the i-th comparable object.

[0090] In a conventional way, the weights can be normalized for example by using a softmax function (so that their sum is equal to 1), and undergo other treatments which will be described later.

[0091] It will be understood that in all cases (with or without encoding block) each attention block is applied directly or indirectly to the first and / or second vector(s) of the candidate object and comparable reference objects.

[0092] According to a preferred variant, each attention block can be extended to include features that are not usable as such in the initial encoding, i.e., relative features (of the third vector). Indeed, an absolute vector representation of each object is required for the attention block, and any relative feature cannot participate in it. However, these features are important; for example, the distance between a candidate object and a reference object.

[0093] We can therefore use a first ancillary block called gate (from the English "gate") to adjust the attention a posteriori by using this time all the available characteristics, i.e. including those of the third vector.

[0094] This additional block allows the adjustment of the raw attention weights by a multiplicative factor obtained for example via an MLP using, for each comparable reference object, the concatenation of all the characteristics, absolute and relative, of the vectors of the candidate object (first and second vector - there are no relative characteristics for the candidate object), of the vectors of the comparable reference object (first, second and third vector) as well as the known value of the target magnitude of the latter.

[0095] This yields a modified attention weight a'i = ai * annex(Fc ® E ® R; ® Vi) with R; the relative features of the i-th comparable object and v; the known value of the target quantity. If gates are used, it is therefore this weight a'; that will be normalized by applying a softmax function rather than a;.

[0096] A second auxiliary block, comparable to the first auxiliary block (door), or similar to the decoder block to be described later, may be used alternatively or in addition. Step (b2) may further include In parallel, an adjustment of the known values ​​of the target quantity for the reference objects with respect to the candidate object is performed. The idea is to obtain modified known values ​​for the subsequent steps in the process, similar to attention weights, by applying the aforementioned second annex block to the known values ​​of the reference objects. Preferably, this second annex block can also take the form of a Modular Programming Language (MPL) that again uses, for each comparable reference object, the concatenation of all the absolute and relative characteristics of the vectors of the candidate object, the vectors of the comparable reference object, and the known value of the latter's target quantity. This yields a modified known value v*; = v; *annex2(Fc ® F; ® R; ® v;).

[0097] In step (b), a crude estimate of said target quantity is given as a function of the weights of said comparable reference objects, the first and / or second vectors of the comparable reference objects, and the known values ​​of the quantity for these comparable reference objects. Preferably, using the calculated weights (where applicable modified and / or normalized – the notation a will be retained for convenience), a weighted sum (called aggregation – by a dedicated aggregation layer at the output of the attention block) of the known values ​​of the target quantity (also where applicable modified – the notation v will also be retained for convenience) is performed in step (b3) for each comparable reference object vc = S aj.Vj. This value vc, called the crude aggregation value, already represents a valid estimate of the target quantity.In other words, according to a first embodiment, we stop at the end of step (b3), and said raw aggregation value is returned as the estimate of the value of said target quantity for said candidate object.

[0098] Advantageously, a decoding block can be used to refine this raw value by taking advantage of an overall representation also calculated on the basis of attention weights, said decoding block being at the output of the aggregation layer and the attention block.

[0099] Step (b) then includes a step (b4) of adjusting said raw value of said target quantity by applying said decoding block to the so-called global representation of the candidate object constructed as a function of the weights of said comparable reference objects (the attention vector) and the first and / or second vectors of the comparable reference objects (or directly from their representations).

[0100] This global representation includes both the characteristics specific to the candidate object, the weighted sum of the characteristics of each reference object, and optionally the raw aggregation i.e. vc described previously. The resulting vector is therefore of size 2di + 2d2 (+ 2d3) and optionally 2di + 2d2 (+ 2d3) + 1.

[0101] If we have several attention blocks, we can obtain a global representation per attention block and concatenate them. For example, in the embodiment with two attention blocks respectively dedicated to the first vector and the second vector, we obtain a first global representation of the candidate target object (of size nj constructed as a function of the first attention vector and the first vectors of the comparable reference objects), and a second global representation of the candidate object (of size n2) constructed as a function of the second attention vector and the second vectors of the comparable reference objects.

[0102] The decoder typically consists of a novel Multilayer Perceptron type neural network, preferably using a SELU type activation function.

[0103] This decoder allows the raw aggregation value vc to be refined to adjust it in light of the differences between candidate objects and reference objects. It allows obtaining a so-called refined value denoted vc*.

[0104] Preferably, this refinement is performed by applying a multiplicative factor denoted adjc. The decoder predicts the value of this factor through the successive application of the evoked perceptron and a bounded function such as the hyperbolic tangent. This latter function allows the adjustment factor to be contained between fixed bounds [-1, 1], i.e., an increase or decrease of 100% in the value. It therefore acts as a safety mechanism against extreme values ​​that this factor could take.

[0105] For example, we denote the global representation F'C=S a; (Fc ® F; ® R;® vO and adjc =Tanh(Decoder(F'c)). Thus, vc*= vc.adjc. Alternatively, we can choose another global representation such as F'c= S a; (F; ® R;® vO ® Fc, the person skilled in the art will not be limited to a particular expression.

[0106] The user receives in return, typically on terminal 10, the predicted value of the target quantity, i.e. the raw aggregation value vc or the refined value vc* if there has been implementation of step (b4).

[0107] Tests show that the performance (median absolute balanced relative error (MdABRE) between 6 and 10% depending on the datasets) of an ASI with 20,000 parameters is achieved with a predictive neural network of fewer than 800 parameters, i.e., 25 times fewer. It is noted that even better performance could therefore be achieved by increasing the number of parameters, while remaining well below the number of parameters of the ASI.

[0108] By comparison, traditional methods such as regression, kNN or XGBoost can reach 25% of MdABRE.

[0109] Learning

[0110] The method advantageously includes a training step (aO), i.e., learning the parameters of the information retrieval model(s) and the prediction neural network. As explained, the encoding block can be pre-trained, so that it may be a matter of training only the attention block and the decoding block; the encoding block can then be fine-tuned, but preferably all three blocks are trained completely.

[0111] This learning is implemented by the data processing means 21 of the possible second server 2, in a supervised manner, i.e. from the reference objects for which a known value of the target quantity is available, used as ground truth.

[0112] The information retrieval model and the prediction neural network can be trained separately (for example, using the weights obtained from the attention block as an evaluation metric for the retrieval model), but preferably they are trained together (i.e. with a single cost function), possibly varying the learning parameters alternately over time.

[0113] More precisely, for a plurality of reference objects, mirror steps of steps (a) and (b) are implemented. Advantageously, this involves selecting at least one set of reference objects comparable to a candidate object by applying the information retrieval model to the first and / or second vector of said candidate object; estimating the value of said target quantity for this candidate object using the prediction neural network; and adapting the parameters of the information retrieval model and / or the prediction neural network (or at least the blocks that one seeks to train) according to the known value of the associated quantity in the database (feedback loop with respect to the estimated value). In other words, the aim is to minimize the distance between the predicted value and the known value as the expected value for a reference object.Naturally, if adjustments are used (auxiliary block(s) and / or decoder block), the aim is to minimize the distance between the adjusted values.

[0114] The network is considered correctly trained when it is able to predict the known value with a sufficiently small margin of error.

[0115] Server

[0116] According to a second aspect, the invention relates to the first server 1 for implementing the method according to the first aspect.

[0117] Thus, this first server 1 comprises, as explained, at least data processing means 11 and at least access to a memory 12 (storing a database of reference objects in which each reference object is also defined by a first vector of structural characteristics of said reference object). and a second vector of geographical characteristics of said reference object, and associated with a known value of said quantity). This is typically a server for predicting values ​​of the target quantity.

[0118] The data processing means 11 are configured to implement steps consisting of: • Select, in the reference object database, at least one set of reference objects comparable to said candidate object, by applying to the first vector and / or the second vector of said candidate object at least one information retrieval model trained on said reference object database; • Estimate the value of said target quantity for said candidate object as a function of the known values ​​of said quantity for the reference objects comparable to said candidate object selected, by application of a prediction neural network comprising at least one attention block, including obtaining a weight of each comparable reference object according to a proximity of the first vector of the comparable reference object with the first vector of the candidate object and / or a proximity of the second vector of the comparable reference object with the second vector of the candidate object.

[0119] According to a third aspect, the invention proposes a system comprising said first server 1, as well as the second server 2 and / or a client terminal 10 connected (via the network 20).

[0120] The second server 2 includes data processing means 21 configured to implement the learning of the information retrieval model and / or the prediction network.

[0121] Computer program product

[0122] According to a sixth and a seventh aspect, the invention relates to a computer program product comprising code instructions for the execution (on the data processing means 11 of the first server 1) of a method according to the first aspect of predicting the value of a target quantity exhibiting a geographical dependence for a candidate object defined by a first vector of structural characteristics of said object and a second vector of geographical characteristics of said object; as well as computer-readable storage means (for example the data storage means 12 of the first server 1) on which this computer program product is located.

Claims

1.

2. Demands A method for predicting the value of a target quantity exhibiting a geographical dependence for a candidate object defined by a first vector of structural characteristics of said object and a second vector of geographical characteristics of said object, the method being characterized in that it comprises the implementation, by data processing means (11), of a first server (1), of steps of a. Selection, in a database of reference objects stored on data storage means (12) accessible by said first server (1), each reference object also being defined by a first vector of structural characteristics of said reference object and a second vector of geographical characteristics of said reference object, and associated with a known value of said magnitude, of at least one set of reference objects comparable to said candidate object, by application to the first vector and / or the second vector of said candidate object of at least one information retrieval model trained on said database of reference objects; b. Estimation of the value of said target quantity for said candidate object as a function of the known values ​​of said quantity for the reference objects comparable to said candidate object selected, by application of a prediction neural network comprising at least one attention block, step (b) comprising at least one step (b2) of obtaining a weight of each comparable reference object according to a proximity of the first vector of the comparable reference object with the first vector of the candidate object and / or a proximity of the second vector of the comparable reference object with the second vector of the candidate object, by application of said attention block. A method according to claim 1, wherein said predictive neural network further comprises at least one encoding block upstream of the attention block, step (b) comprising a preliminary step (bl) of obtaining a representation of each candidate object or comparable reference object, by applying said encoding block to first and / or second vector(s) of the candidate object and comparable reference objects, said attention block being applied in step (b) to said representations of the candidate object and comparable reference objects.

3. A method according to claim 2, wherein said encoding block comprises at least one bi-encoder, in particular a multilayer perceptron, step (bl) comprising, for each comparable reference object, obtaining a representation of said comparable object, by applying said encoding block to both the first and / or second vector(s) of the candidate object, and to the first and / or second vector(s) of said comparable reference object.

4. A method according to any one of claims 2 and 3, wherein the attention block implements a dot product calculation, step (b2) comprising, for each comparable reference object, obtaining the weight of said comparable reference object, by the dot product of the representation of said comparable reference object and the representation of the candidate object.

5. A method according to any one of claims 2 to 4, wherein said prediction neural network comprises a single encoding block and a single attention block, the encoding block being applied to both the first and second vectors of the candidate object and comparable reference objects.

6. A method according to any one of claims 1 to 5, wherein step (a) comprises the selection of: - a first set of reference objects comparable to said candidate object in terms of structural characteristics, by applying at least to the first vector of said candidate object a first information retrieval model trained on said database; and - a second set of reference objects comparable to said candidate object in terms of geographical characteristics, by applying at least to the second vector of said candidate object a second information retrieval model trained on said database.

7. A method according to any one of claims 1 to 6, wherein the information retrieval block(s) and the prediction neural network form a Retrieval-Enhanced Machine Learning (REML) type set.

8. A method according to any one of claims 1 to 7, wherein said structural characteristics of the object are not geographical.

9. A method according to claim 1 to 8, wherein said attention block comprises a first auxiliary block, step (b2) comprising adjusting, for each comparable reference object, the weight of said comparable reference object by application of said first auxiliary block.

10. A method according to any one of claims 1 to 9, wherein said predictive neural network further comprises a second auxiliary block, step (b2) comprising, for each comparable reference object, the adjustment of the known value of the target quantity for said comparable reference object by application of said second auxiliary block.

11. A method according to any one of claims 1 to 10, wherein the prediction neural network includes an aggregation layer at the output of the attention block, the method comprising a step (b3) of computing a weighted sum of the known values ​​of the target quantity for each comparable reference object, by said weights of each comparable reference object, said raw aggregation value, by application of said aggregation layer; the value of said target quantity for said candidate object being estimated either directly as said raw aggregation value, or as a function of said raw aggregation value.

12. A method according to claim 11, wherein said prediction neural network further comprises at least one decoding block downstream of the attention block, step (b) comprising a step (b4) of adjusting said raw aggregation value by applying said decoding block to a so-called global representation of the candidate object.

13. A method according to any one of claims 11 and 12, wherein said decoding block comprises a multilayer perceptron and a security mechanism using a bounded function, typically hyperbolic tangent, step (b4) comprising the calculation of an adjustment factor to be applied to the raw aggregation value.

14. A method according to any one of claims 1 to 13, comprising a step (aO) of training, by data processing means (21) of a second server (2), the information retrieval model

15.

16. and said predictive neural network, from said reference object database. First server (1) for predicting the value of a target quantity exhibiting a geographical dependence for a candidate object defined by a first vector of structural characteristics of said object and a second vector of geographical characteristics of said object, characterized in that it comprises data processing means (11) configured to: • Select, from a database of reference objects stored on data storage means (12) accessible by said first server (1), each reference object also being defined by a first vector of structural characteristics of said reference object and a second vector of geographical characteristics of said reference object, and associated with a known value of said quantity, at least one set of reference objects comparable to said candidate object, by applying to the first vector and / or the second vector of said candidate object at least one information retrieval model trained on said database of reference objects; • Estimate the value of said target quantity for said candidate object as a function of the known values ​​of said quantity for the reference objects comparable to said candidate object selected, by application of a prediction neural network comprising at least one attention block, including obtaining a weight of each comparable reference object according to a proximity of the first vector of the comparable reference object with the first vector of the candidate object and / or a proximity of the second vector of the comparable reference object with the second vector of the candidate object. Product computer program comprising code instructions for executing a method according to any one of claims 1 to 14 of predicting the value of a target quantity exhibiting a geographical dependence for a candidate object defined by a first vector of structural characteristics of said object and a second vector of geographical characteristics of said object, when said program is executed on a computer.

17. Computer-readable storage means on which is recorded a computer program product comprising code instructions for the execution of a method according to any one of claims 1 to 14 of predicting the value of a target quantity exhibiting a geographical dependence for a candidate object defined by a first vector of structural features of said object and a second vector of geographical features of said object.