SYSTEM FOR RECORDING A PATH TRAIL TAKED BY A DEVICE ON A WRITING SURFACE, AND CORRESPONDING METHOD AND INFORMATION RECORDING MEDIUM

DE602020042565T2Active Publication Date: 2024-12-04ADVANCED MAGNETIC INTERACTION (AMI) +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
DE602020042565
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-10-04
Filing Date
2020-09-30
Publication Date
2024-12-04
Estimated Expiration
2040-09-30

AI Technical Summary

Technical Problem

Existing systems for recording the trace of a utensil on a writing surface face challenges in accurately detecting the tip contact while minimizing parasitic contacts, such as those from the user's fingers or palm, and struggle with high electrical consumption and latency in pixel reading due to the need for complex electronics and connections.

Method used

A system combining a magnetic object attached to the utensil with a locating device to determine the tip's position and orientation, and a tactile matrix sensor to detect contact and pressure, allowing for precise tracking of the utensil's trace with reduced electrical consumption and latency by selectively activating only necessary pixels.

Benefits of technology

Enables accurate and efficient recording of the utensil's trace with high resolution, reduced latency, and lower power consumption, allowing for the use of a wide range of commercial utensils without the need for multiple magnets or complex electronics.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The field of the invention is that of recording a mark made on a writing surface by the tip of a tool handled by a user. The mark corresponds to all the successive positions of the tip when it is in contact with the writing surface. PREVIOUS STATE OF THE ART

[0002] Electronic systems for recording the trace of the tip of a utensil on a writing surface, for example the tip of a stylus, a pencil or other, make it possible in particular to digitize the drawing or writing made by a user manipulating the utensil.

[0003] In general, it is important to be able to accurately detect the contact of the utensil tip on the writing surface while eliminating or limiting the impact on detection of extraneous contacts such as the user's finger or palm. In this regard, document EP2811383A1 describes an example of a system for recording the imprint of a utensil on a writing surface using an array of magnetometers that track the position of at least one magnet attached to the utensil. Such a system makes it possible to disregard extraneous contacts.

[0004] To detect the contact and pressure exerted by the tip on the writing surface, this trace-recording system uses a first magnet attached to the tip, which is retractable from the tool's body, and a second magnet attached to the body. The system determines the position and / or orientation of the two magnets, deduces their relative spacing, and then detects the contact of the tip on the writing surface when this spacing falls below a predefined threshold. However, this requires a specific tool with at least two magnets that are mechanically linked together. Therefore, not just any tool can be used.

[0005] Document WO2013 / 057412 describes another example of a system for detecting the trace of a utensil, in this case using a tactile matrix sensor, for example, of the capacitive or resistive type. This tactile matrix sensor comprises a matrix of distinct pixels formed by the intersection of conductive lines arranged in rows and columns on either side of a film. Contact of the utensil tip is detected by measuring the intensity of the electrical signals emitted by the pixels.

[0006] However, such a system has a resolution associated with measuring the position of the stylus contact that depends, in particular, on the dimensions and spacing of the pixels. Furthermore, such a system exhibits a certain latency due to the time required to read the pixels from the matrix. In this document, to reduce this latency while optimizing power consumption, it is proposed to perform a global measurement of the columns and to perform a sequential measurement of the rows only when a contact is detected on at least one of the activated columns. This implies having suitable electronics enabling such control of pixel activation. Therefore, there remains a need to limit power consumption while reducing the latency associated with pixel reading, without increasing the complexity of the electronics and the necessary connections.

[0007] Furthermore, document FR2988872A1 describes a display screen comprising a device for locating a moving magnetic object by means of a network of magnetometers. DESCRIPTION OF THE INVENTION

[0008] The invention aims to remedy, at least in part, the drawbacks of the prior art. To this end, the object of the invention is a system for recording a mark made on a writing surface as defined in claim 1.

[0009] Some preferred but non-limiting aspects of this system for recording the trace of a utensil are defined in claims 2 to 9.

[0010] The invention also relates to a method, as defined in claim 10, for recording a trace of the tip of a utensil on a writing surface using the system according to any one of claims 1-9.

[0011] The invention also relates to an information recording medium, as defined in claim 11, comprising instructions for the execution of a trace recording method according to claim 10, when these instructions are executed by a computing unit. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Other aspects, objectives, advantages, and features of the invention will become clearer upon reading the following detailed description of preferred embodiments thereof, given by way of example, and made with reference to the accompanying drawings in which: there figure 1 is a schematic and partial cross-sectional view of a system for recording the mark made by the tip of a utensil on the writing surface according to one embodiment; the figure 2 is a schematic and partial exploded view of the trace recording system illustrated on the fig.1 ; there figure 3is a flowchart illustrating the steps of a process for recording the mark made by the tip of a utensil on a writing surface, according to a particular embodiment; the Figures 4A and 4B are schematic and partial views, in perspective, of a trace recording system according to one embodiment, for two different measurement instants. DETAILED DESCRIPTION OF SPECIFIC METHODS OF IMPLEMENTATION

[0013] In the figures and throughout the description, the same reference numerals represent identical or similar elements. Furthermore, the various elements are not drawn to scale to ensure clarity. Moreover, the different embodiments and variants are not mutually exclusive and may be combined. Unless otherwise stated, the terms "approximately," "around," and "in the order of" mean within 10%, and preferably within 5%. Furthermore, the terms "between ... and ..." and equivalents mean inclusive of the bounds, unless otherwise specified.

[0014] The invention relates to a system and method for recording the mark made by the tip of a tool on a writing surface. The marking system generally comprises: a utensil equipped with a magnetic object; a localization device, adapted to determine the position P a of the magnetic object, and possibly its orientation, and to determine an estimated reference position Č p|c on the writing surface; and a tactile matrix sensor, adapted to detect the contact of the tip on the writing surface, and advantageously to measure the force of the contact.

[0015] The tracing system may also include a graphical interface to display the trace thus recorded. It can be used in the digitization of a drawing or handwriting, or even in controlling the graphical interface (e.g., selecting and moving a digital object displayed by the graphical interface, etc.). Tracing the mark made by the tip of the tool refers to determining and recording the successive positions of the tip of the tool when it is in contact with the writing surface. The tracing system can thus detect the initial moment of the tip's first contact with the writing surface, defining the beginning of the mark, as well as the final moment corresponding to the loss of contact, defining the end of the mark.

[0016] A tool is an object designed to be manipulated by a user, for example, by hand. It has a rigid structure (body) made of a preferably non-magnetic material, such as plastic, which has a point designed to come into contact with the writing surface of the tracing system. It can be a pencil in the broadest sense, that is, a pen, stylus, marker, brush, or any other writing or drawing instrument. The point is an end of the tool and can be pointed or rounded, rigid or flexible.

[0017] The tactile matrix sensor is called 'tactile' because it is designed to detect the contact of the utensil tip with the writing surface. Furthermore, it is called 'matrix' because it comprises a matrix of distinct pixels formed by conductive tracks arranged in rows and columns. Each pixel is designed to provide an electrical response signal representative of the possible contact of the utensil tip with the writing surface. The tactile matrix sensor can be capacitive or resistive, for example, piezoresistive. More broadly, the tactile matrix sensor has a parameter that varies locally depending on the contact of the tip with the writing surface, and possibly the pressure applied. This parameter can be capacitance, electrical resistance, voltage, etc.

[0018] THE Figures 1 And 2These are schematic and partial views, respectively in cross-section and exploded view, of a system 1 for recording the trace of a tool 3 according to an embodiment. In this example, the tool 3 is a stylus whose tip 4 is intended to come into contact with the writing surface 2. Furthermore, the tactile matrix sensor 20 is a resistive pressure matrix sensor, which is then adapted, in addition to detecting the contact of the tip 4 on the writing surface 2, to measure the contact force (also called pressure force).

[0019] The writing surface 2 can be the surface of a protective layer of the touch matrix sensor 20 described in detail later. It can also be the surface of an element attached and placed on a support surface of the touch matrix sensor 20, this element being adapted to transmit the pressure force exerted by the tip 4 of the stylus 3 to the touch matrix sensor 20. Such an element can be, for example, one or more sheets of paper.

[0020] We define here and for the rest of the description a direct three-dimensional orthogonal frame OXYZ, where the X and Y axes form a plane parallel to the writing surface 2, and where the Z axis is oriented towards the utensil 3. In this example, the origin O is located at the edge of a Zs tracking zone of the magnetic object 6, but it can be located elsewhere in the Zs tracking zone, for example at the edge of the writing surface 2.

[0021] The tool 3 is equipped with a magnetic object 6, here a permanent magnet, fixed without any degrees of freedom to the rigid structure 5 of the stylus 3. The magnetic object 6 comprises a material exhibiting magnetization, for example remanent magnetization, for which a magnetic moment m is defined. It can be a cylindrical permanent magnet, for example a ring magnet, as illustrated in document WO2014 / 053526, or even an electromagnet. It can also be a transponder adapted to re-emit a magnetic field emitted by an array of magnetic generators. However, in this example, the magnetic object 6 is a permanent magnet. In this example, the magnetic object 6 is distinct from the tip 4 and is separated from it by a non-zero distance L. Alternatively, it can be considered indistinguishable from the tip 4.

[0022] The magnetic material is preferably ferrimagnetic or ferromagnetic. It exhibits a non-zero spontaneous magnetic moment even in the absence of an external magnetic field. It may exhibit a coercive magnetic field greater than 100 Am⁻¹ or 500 Am⁻¹, and the magnitude of the magnetic moment is preferably greater than 0.01 Am² or even 0.1 Am², for example, approximately 0.2 Am². The magnetic object 6 is considered to be approximated by a magnetic dipole, but other models may be used. The magnetic axis of the magnetic object 6 is defined as the axis collinear with the magnetic moment m of the magnetic object 6. Preferably, the magnetic axis is directed towards the tip of the utensil.

[0023] As illustrated by the fig.1The magnet 6 can be positioned at a non-zero distance L from the tip 4 of the stylus 3. This distance L is known and does not vary over time. It is defined in a numerical model representing the tool 3 used, this model being stored in a memory 13 of the localization device 10. Therefore, knowing the position and orientation of the magnet 6 in the OXYZ coordinate system allows us to deduce the position Pp of the tip 4 of the stylus 3. In the case where the magnet 6 and the tip 4 coincide, it is not necessary to determine the orientation of the magnetic moment m of the magnet 6.

[0024] The stylus 3 is intended to be manipulated by the user within a tracking zone Zs. Initially, the stylus 3 is not in contact with the writing surface 2 and is at a distance d, a non-zero value that varies over time. The user then moves the stylus 3 so that the tip 4 makes contact with the writing surface 2. The distance d is then zero, and the tactile matrix sensor 20 detects the contact and, advantageously, the pressure force exerted by the tip 4. The user then moves the tip 4 of the stylus 3 along the writing surface 2. The successive positions of the tip 4 in contact with the writing surface 2 form the trace determined by the trace-recording system 1.

[0025] The trace-recording system 1 also includes a localization device 10, adapted to determine a state vector Xa representing the position of the magnet 6 in the OXYZ coordinate system, and possibly its orientation, and then to determine at least one estimated reference position Čp|c on the writing surface 2. Thus, the localization device 10 determines, at different successive measurement times, an estimated reference position Čp|c on the writing surface 2, before or during contact with it. This estimated reference position Čp|c is preferably a projection along the Z-axis of the position Pp of the tip 4 onto the XY plane of the writing surface 2. It is said to be estimated insofar as it is determined by the localization device 10 and not by the tactile matrix sensor 20.

[0026] Locating magnet 6 means determining its position within the tracking zone Zs as a state vector Xa and, if applicable, its orientation. The position Pa of magnet 6 corresponds here to the coordinates of its geometric center, that is, the unweighted centroid of all points of magnet 6. Furthermore, the magnetic moment m of magnet 6 is a vector whose components are (mx, my, mz) in the real OXYZ coordinate system. Its magnitude, also called intensity or amplitude, is denoted ∥m∥ or m.

[0027] Magnet 6 is intended to operate within the Zs tracking zone. This is a space in which the signal-to-noise ratio (SNR) (for Signal to Noise Ratio(in English) of at least one of the magnetometers of the locating device 10 is greater than or equal to a predefined threshold value. For example, the tracking zone Zs can be a space in which the signal, i.e., the magnitude or at least a component of the magnetic field generated by the magnet 6 and measured by the corresponding magnetometer, is greater than or equal to, for example, 20 times the noise. The noise associated with each magnetometer can be approximately 0.2 µT. In this case, the tracking zone Zs corresponds to a region of space in which the magnetic field generated by the magnet 6 and measured by at least one of the magnetometers M i is greater than or equal to approximately 6 µT, which corresponds to a maximum distance d max of approximately 20 cm along the direction axis passing through the magnetometer M i in question.More simply, the tracking zone Zs can be defined as a space in which each point is at a distance less than or equal to a maximum distance d max along the direction axis passing through the nearest magnetometer M i, this being for example equal to 20cm, or even 10cm, or even 5cm.

[0028] The localization device 10 is capable of measuring the ambient magnetic field, one of whose contributions is the magnetic field generated by the magnet 6, at different measurement times, during a tracking time T, in the OXYZ frame, and then estimating the position of the magnet 6, and possibly its orientation, on the basis of the measurements of the magnetometers M i.

[0029] To achieve this, it comprises an array of magnetometers Mi fixed here without any degrees of freedom to a rear face of the tactile matrix sensor 20. The number of magnetometers Mi can be, for example, greater than or equal to 2, preferably greater than or equal to 16, for example approximately 25, particularly when dealing with triaxial magnetometers. The array of magnetometers Mi, however, has at least three measuring axes that are spaced apart and not parallel to each other. The magnetometers Mi can be aligned in rows and columns, or can be positioned relative to each other in a substantially random manner. The positions of the magnetometers Mi are known. For example, they can be between 1 cm and 10 cm, for example 5 cm.

[0030] Each magnetometer Mi has at least one measurement axis, for example, three axes, denoted xi, yi, zi. Each magnetometer therefore measures the amplitude and direction of the ambient magnetic field Bi, a contribution of which is generated by the magnet 6. More precisely, each magnetometer Mi measures the magnitude of the orthogonal projection of the ambient magnetic field Bi along the magnetometer's axes xi, yi, zi. A calibration parameter for the magnetometers Mi can be the noise associated with the magnetometers, here on the order of 0.2 µT. By ambient magnetic field B, we mean the magnetic field undisturbed by any magnetic element, formed in particular by a terrestrial contribution Bterr of the order of 50µT, to which is added the magnetic field Ba generated by the magnet 6. Other magnetic contributions may be added, such as a contribution associated with sensor noise and a contribution related to a shift error ( offset,(in English), which are neglected here.

[0031] The localization device 10 further includes a processing unit 11 capable of determining, from the measurements of the magnetometers Mi, the position of the magnet 6 in the OXYZ coordinate system and optionally its orientation, the position and, where applicable, the orientation defining a state vector Xa. In addition, the processing unit 11 is capable of determining the position Pp of the tip 4 of the stylus 3 in the OXYZ coordinate system. The processing unit 11 is also adapted to determine an estimated reference position Čp|c on the writing surface 2, and is connected to the processing unit 24 of the tactile matrix sensor 20 to transmit this estimated position Čp|c to it. The processing unit 11 contains the coordinates of the writing surface 2 in the OXYZ coordinate system. Thus, knowing the position of the tip P p and the coordinates of the writing surface 2 in the OXYZ frame, it is able to determine the estimated reference position Č p|c on the writing surface 2.

[0032] To this end, each magnetometer Mi is electrically connected to the processing unit 11 via an information transmission bus (not shown). The processing unit 11 includes a programmable processor 12 capable of executing instructions stored on a data storage medium. It also includes a memory 13 containing the instructions necessary for localizing the magnet 6, as well as the digital model of the instrument 3 used, enabling the position Pp of the stylus tip 4 in the OXYZ coordinate system to be provided from the state vector Xa. The memory 13 is also adapted to store the information calculated at each measurement instant.

[0033] The computing unit 11 implements a mathematical model associating the position of the magnet 6 in the OXYZ frame, as well as, in this example, the orientation and magnitude of its magnetic moment m, with the measurements of the magnetometers Mi. This mathematical model is constructed from the equations of electromagnetism, in particular magnetostatics, and is parameterized notably by the positions and orientations of the magnetometers in the OXYZ frame. Here, this model is nonlinear. The computing unit 11 implements an algorithm to estimate its solution, such as, for example, Bayesian filtering (e.g., an extended Kalman filter) or optimization, or any other algorithm of the same type.

[0034] Preferably, to approximate magnet 6 as a magnetic dipole, the distance between magnet 6 and each magnetometer Mi is greater than 2, or even 3 times, the largest dimension of magnet 6. This dimension can be less than 20 cm, or even less than 10 cm, or even 5 cm. Magnet 6 can be modeled by a dipole model, among others, depending in particular on the distance between magnet 6 and each magnetometer Mi of the network.

[0035] The trace-recording system 1 includes a touch matrix sensor 20, here a pressure matrix sensor. It is adapted to detect the contact of the tip 4 of the stylus 3 on the writing surface 2 by measuring the intensity of the pressure force exerted on this writing surface 2.

[0036] The matrix pressure sensor comprises a pressure matrix, formed of a plurality of pixels Px i sensitive to the pressure exerted on its surface. The pressure matrix is, in this example, of the resistive type. Such a sensor is also called a resistive force sensor ( Force-Sensing Resistor, in English).

[0037] It consists of a film 23 made of a piezoresistive material, that is, a material whose local electrical resistance varies according to the applied mechanical stress, for example, a conductive polymer. The sensitive material of the film can be continuous in the XY plane or can be pixelated. Conductive tracks 21, 22 are formed in rows on one face of the film 23 and in columns on the opposite face. The pixels Px i are formed by the intersection, in top view, between the rows and columns of the conductive tracks 21, 22. The pixels Px i can be adjacent to each other or even spaced apart (as illustrated in the fig.2 ).

[0038] The pressure matrix sensor 20 has a number N of pixels Pxi, for example, approximately 2500. The conductive tracks 21, 22 can be a few millimeters wide, for example, 2.5 mm, so that a pixel here has an area of ​​2.5 × 2.5 mm2. The pixels Pxi are distinct and are spaced in the XY plane, for example, approximately 1 mm apart. The diameter of the tip 4 of the stylus 3 in contact with the writing surface 2 can be on the order of a millimeter, for example, between approximately 1 mm and 3 mm.

[0039] The pressure matrix sensor 20 comprises a processing unit 24, including a microcontroller 25 that controls and reads the individual pixels of the pressure matrix, and a calculation unit 26 adapted to detect contact of the stylus tip 4 and determine the intensity of the pressure force exerted, based on the electrical response signals emitted by the pixels. The microcontroller 25 is thus adapted to transmit an electrical control signal to each pixel and to receive an electrical response signal, which represents a possible contact of the stylus tip 4 on the writing surface 2, and, in this case, the intensity of the pressure force exerted by the stylus 3. The processing unit 24 contains the coordinates of the N pixels Px i in the OXYZ coordinate system.Thus, knowing the estimated reference position Č p|c on the writing surface 2 and the coordinates of the N pixels Px i in the OXYZ frame, it is able to determine a set S px of M pixels, with M less than N, which surround at least partially the estimated reference position Č p|c. M is preferably greater than or equal to 2.

[0040] The processing unit 26, based on the received electrical response signals, detects whether or not there is contact between the point 4 and the writing surface 2. For this, the electrical signal emitted by each pixel has an intensity which, when it is greater than a predetermined threshold, corresponds to the contact of the point 4 on the writing surface 2. The intensity of the pressure force exerted by the point 4 is dependent on the intensity of the electrical signals emitted by one or more pixels.

[0041] The processing unit 24 then records the successive estimated reference positions Č p|c (tn ) on the writing surface 2, determined by the localization device 10, when contact has been detected, which thus form or contribute to forming the trace of the utensil 3 on the writing surface 2. The intensity of the pressure force exerted provides an additional characteristic of the trace of the utensil 3, and can be used to vary, for example, the width of the trace of the utensil 3. The processing unit 24 can be connected to a graphical interface 7, to display, for example, the trace recorded by the system.

[0042] The processing unit 24 may thus include a microcontroller 25 for controlling the power supply to the pixels, associated with analog-to-digital converters (ADCs), and its calculation unit 26 includes at least one processor and at least one memory containing the instructions necessary for implementing the contact detection of the tip 4 and the measurement of the pressure force, and for storing the information calculated at each measurement instant, and here, the converters. Of course, the processor and memory of the calculation unit 26 may or may not be shared with those of the microcontroller 25.

[0043] According to the invention, the processing unit 24 of the touch matrix sensor 20 is connected to the calculation unit 11 of the localization device 10, and receives from the latter the successive estimated reference positions Č p|c (tn ) on the writing surface 2, whether or not there is contact of the tip 4 on the writing surface 2.

[0044] Preferably, it receives this data only when the position P p,z of the tip 4 along the Z axis is less than or equal to a predetermined threshold value P p,z,th . When this is not the case, the tactile matrix sensor 20 can be inactive, i.e. not electrically powered totally or partially, so as to limit the electrical consumption of the trace recording system 1.

[0045] When the position Pp,z is less than or equal to the threshold value Pp,z,th, the processing unit 24 is activated (powered on), receives the value of the estimated reference position Čp|c on the writing surface 2, and determines a set Spx of M pixels, with M less than N, which at least partially surround the estimated reference position Čp|c. As an example, the total number N of pixels may be approximately 2500, and the number M of pixels in said set Spx may be approximately 25, for example, a 5×5 pixel square.

[0046] The processing unit 24 then measures only the pixels of the specified set S pixels, and not all the pixels in the matrix. The electrical control signals are therefore transmitted only to the M pixels, while the other pixels remain unpowered. Subsequently, the electrical response signals are received by the processing unit 24. Thus, the pixel command / read latency is significantly reduced, since only 25 pixels are read at each measurement instant, rather than 2500 pixels. Consequently, power consumption is also greatly reduced.

[0047] The processing unit 24 is adapted to determine the trace made by the stylus 3 from successive estimated reference positions Č p|c on the writing surface 2, and in this case from the value of the applied pressure force, and then to control the graphical interface 7 to display the determined trace. As detailed later, the trace can be formed by the set of successive estimated positions Č p|c, but it can also take into account the successive contact positions Č p|c determined by the tactile matrix sensor 20. The accuracy of the contact measurement can then be improved.

[0048] Thus, the trace-recording system 1, due to the combination of the magnetic object 6 localization device 10 and the tactile matrix sensor 20, offers several advantages. It allows the use of a wide variety of commercially available utensils, provided they allow the magnetic object 6, such as a magnet, to be attached. The utensil 3 may even be equipped with only a single magnet 6 to be located. Therefore, it is not necessary for it to have multiple magnets, although it is possible to incorporate several magnets attached to the utensil. This avoids the need for a dedicated and complex utensil 3, as described in document EP2811383. Furthermore, it is not necessary to integrate a pressure sensor into the utensil.

[0049] Furthermore, the contact of the tip 4 is precisely detected by the tactile matrix sensor 20, and the position of the tip 4 on the writing surface 2 is determined with high resolution by the localization device 10. The position of the tip 4 is thus not affected by the potentially low resolution of conventional tactile matrix sensors, which depends on the dimensions and arrangement of the conductive tracks 21, 22. In addition, the determination of the estimated reference position Č p|c on the writing surface 2 is not disturbed by any unwanted contacts, such as the contact of the user's finger or palm on the writing surface 2.

[0050] Furthermore, the track-recording system 1 exhibits a particularly low latency related to the command / reading of the pixel matrix, since only the selected M pixels of the set S px are activated by the microcontroller 25, and not the N pixels of the matrix. The command / reading frequency can therefore be particularly high. Consequently, the power consumption of the track-recording system 1 is reduced. In addition, it is advantageous for the tactile matrix sensor 20 to remain at least partially inactive during the tracking of the magnetic object 6 by the localization device 10, particularly when the position P p,z of the tip 4 along the Z-axis is greater than the threshold value P p,z,th.

[0051] Furthermore, it is possible to use a tactile matrix sensor 20 with a simple and conventional microcontroller 25 and electrical connections. This avoids the need for a microcontroller 25 and specific connections related to the requirement to activate rows and / or columns either individually and sequentially or collectively, as described in document WO2013 / 057412.

[0052] There figure 3 is a flowchart illustrating a method for recording the trace of utensil 3 according to one embodiment. In this example, the trace recording system 1 is identical to that described with reference to the Fig. 1 And 2 It commands the graphical interface 7 to display the trace thus recorded.

[0053] In a first step 11, a digital model of the stylus 3 is recorded in the memory 13 of the calculation unit 11 of the localization device 10. As mentioned previously, this digital model makes it possible to deduce the position P p of the tip 4 in the OXYZ frame from the state vector X a of the magnet 6. This step 11 may also include a phase of recording the coordinates in the OXYZ frame of the writing surface 2, as well as a phase of recording the coordinates in the OXYZ frame of the N pixels Px i of the touch matrix sensor 20.

[0054] In step 21, the user manipulates the stylus 3 in the Zs tracking zone, that is, they modify its position and possibly its orientation in the OXYZ coordinate system. Initially, the tip 4 of the stylus 3 is not in contact with the writing surface 2 and has a position Pp,z along the Z-axis greater than the threshold value Pp,z,th. Next, the tip 4 has a position Pp,z less than or equal to the threshold value Pp,z,th but is still not in contact with the writing surface 2. Finally, in the third step, it comes into contact with the writing surface 2, and the position of the tip 4 on the writing surface 2 is recorded, forming the trace that is recorded and displayed.

[0055] Steps 22 to 33 are performed iteratively at a measurement instant tn, with time discretized at a determined sampling frequency, for example 140Hz. Each iteration of rank n is associated with a measurement instant tn, also called the current instant.

[0056] During step 22, the magnetometers measure the ambient magnetic field at the current time, and in particular the contribution of the ambient magnetic field generated by the magnet 6 attached to the stylus 3.

[0057] In step 23, the computing unit 11 receives measurements of the ambient magnetic field, deduces the contribution of the magnetic field generated by magnet 6, and determines the state vector Xa(tn) associated with magnet 6 at the current time tn in the OXYZ frame. The state vector Xa(tn) includes the position of magnet 6 in the OXYZ frame and, in this example, its orientation. This estimation of the state vector can be performed using a Bayesian-type position and orientation estimation algorithm for magnet 6, such as an extended Kalman filter, or using an optimization method (gradient descent, etc.), or any other similar algorithm. An example of estimating a state vector associated with a magnet 6 is described in application WO2018 / 219891.

[0058] In a step 24, the calculation unit 11 determines the position P p (tn ) of the tip 4 of the stylus 3, from the state vector X a (tn ) and the digital model of the stylus 3. The position P p (tn ) of the tip 4 has the component P p,z (tn ) along the Z axis and the component P p,xy (tn ) in the XY plane parallel to the writing surface 2. In the case where the magnetic object 6 is coincident with the tip 4, the position P p (tn ) of the tip 4 is identical to the position P a (tn ).

[0059] In step 25, the calculation unit 11 determines the estimated reference position Č p|c (tn ) on the writing surface 2, from the state vector X a (tn ) and the coordinates of the writing surface 2 in the OXYZ frame. This estimated reference position Č p|c can be equal to the projection along the Z axis of the position P p,xy (tn ) of the tip 4 in the XY plane, in which case there is equality between Č p|c (tn ) and P p,xy (tn ).

[0060] In step 26, the position value Pp,z(tn) of the tip 4 along the Z-axis is compared to the predefined threshold value Pp,z,th. When the position Pp,z(tn) is greater than the threshold value Pp,z,th, the locating device 10 continues to measure the magnetic field (step 22 and subsequent steps). The tactile matrix sensor 20 advantageously remains deactivated, i.e., it is not electrically powered, in order to limit the power consumption of the trace recording system 1. If the locating device 10 is directly connected to the graphical interface 7, the tip 4 can be represented and displayed on the graphical interface 7, without a trace being displayed. When the position Pp,z(tn) is less than or equal to the threshold value Pp,z,th, the process continues with step 27.

[0061] In step 27, the touch matrix sensor 20 is activated (if present), and the value of the estimated reference position Č p|c (tn ) on the writing surface 2 is transmitted to the processing unit 24 of the touch matrix sensor 20. This unit then determines a set S px (tn ) of pixels from the pressure matrix that at least partially surround the estimated reference position Č p|c (tn ). To do this, the coordinates of each pixel Px i in the OXYZ coordinate system are stored in the memory of the processing unit 24. The processing unit 24 determines a pixel selection area Z px (tn ) centered on the estimated reference position Č p|c (tn ) and having a predefined contour, for example, a circle, oval, square, rectangle, etc. As such, the Figures 4A and 4BThey illustrate the trace recording system 1 at two distinct measurement times, and show the area Zpx(tn) centered on the estimated reference position Čp|c(tn). In this example, the set Spx(tn) contains the pixels whose surface is at least partially located within this pixel selection area Zpx(tn). This set Spx(tn) is redefined at each measurement time tn.

[0062] Furthermore, the touch matrix sensor 20 may have been initialized by measuring the "background noise" associated with the pixel matrix in the absence of any contact (stylus tip, finger, palm, etc.) on the writing surface 2. This initial measurement is then systematically subtracted from the measurements of the electrical response signals of the pixels of the set S px (tn), thus making it possible to eliminate any potential temporal drifts and / or shift errors ( offset, in English).

[0063] In step 28, the microcontroller 25 of the processing unit 24 activates only the M pixels of the set S px (tn ), and leaves the other unselected pixels inactive (i.e., not electrically powered). It therefore transmits an electrical control signal to the pixels of the set S px (tn ) and receives their electrical response signals.

[0064] In step 29, the processing unit 24 determines the value of a parameter κ(tn) representing the contact of the tip 4 on the writing surface 2. This parameter can be the intensity of the electrical response signal of at least one of the pixels in the set S px (tn), or even the average intensity, weighted or unweighted, of the electrical response signals of the pixels in the set S px (tn). It can be the electrical resistance of at least one of the pixels in the set S px (tn), or any other equivalent parameter.

[0065] In step 30, the processing unit 24 compares the value of the parameter κ(tn) to a predefined threshold value κth and detects contact of the tip 4 on the writing surface 2 as effective when the value of the parameter κ(tn) is greater than or equal to the threshold value κth. The threshold value κth filters out fluctuations due to measurement noise. When this is not the case, the trace recording process continues with the measurement of the magnetic field (step 22 and subsequent steps), and when contact is detected, the process continues with step 31.

[0066] During a step 31, insofar as the contact of the tip 4 on the writing surface 2 is detected by the touch matrix sensor 20, the processing unit 24 records the estimated reference position Č p|c (tn ) provided by the localization device 10. The successive estimated reference positions Č p|c (tn ) recorded by the processing unit 24 form or participate in forming the record of the trace made by the stylus 3.

[0067] Alternatively, the position of the tip 4 in contact with the writing surface 2, as recorded by the processing unit 24, can depend both on the estimated reference position Č p|c (tn ) provided by the localization device 10, and on a position Č p|c (tn ) provided by the touch matrix sensor 20. Thus, the position Č p|c (tn ) can correspond to the position of the centroid (weighted center of gravity) of the pressure forces exerted by the tip 4 on the writing surface 2, and measured by the pixels of the set S px (tn ). The position of the tip 4 recorded by the processing unit 24 can be the average, weighted or unweighted, of the positions Č p|c (tn ) and C p|c (tn ).

[0068] In step 32, when the touch matrix sensor 20 is adapted to measure pressure force, i.e., when it includes a pressure matrix, the processing unit 24 measures the pressure force applied by the tip 4 to the writing surface 2. As is known, the pressure force is determined from the intensity of the electrical response signals emitted by the pixels of the set S px (tn). The pressure force, at the current time tn, allows, for example, a characteristic of the trace to be modified, such as the width of the line displayed on the graphical interface 7.

[0069] In a step 33, the processing unit 24 constructs the trace from the successive positions of the tip 4 recorded, and here taking into account the pressure force applied by the tip 4 on the writing surface 2. It then commands the display of the trace thus recorded on the graphical interface 7.

[0070] Steps 22 to 33 are repeated at the defined sampling frequency, which may or may not be constant over time, and which may notably depend on the speed of movement of the magnet 6 or the tip 4, calculated by the localization device 10 from the state vector Xa(tn). In particular, the sampling frequency associated with the localization of the magnet 6 (e.g., 140 Hz) may be the same as or different from the command / read frequency of the pixels of the set Spx(tn).

[0071] THE Figures 4A and 4B are perspective views of the utensil 3 manipulated by a user above the writing surface 2 of the touch matrix sensor 20, for two different instants.

[0072] In both examples, the tip 4 has a position Pp,z(tn) along the Z-axis lower than the threshold value Pp,z,th, so the tactile matrix sensor 20 is activated and the estimated reference position Čp|c(tn) on the writing surface 2 is transmitted to it. It then determines a circular selection area Zpx(tn) centered on the value Čp|c(tn).

[0073] In the example of the fig.4AThe stylus 3 is positioned at the edge of the writing surface 2. The selection area Zpx(tn) then extends both inside and outside the writing surface 2. One pixel is entirely located within the selection area Zpx(tn) and is surrounded by 5 adjacent pixels that are partially located within the selection area Zpx(tn). Thus, the set Spx(tn) comprises the 6 pixels that are at least partially located within the selection area Zpx(tn). The selected pixels therefore at least partially surround the estimated reference position Čp|c(tn) on the writing surface 2.

[0074] In the example of the fig.4BThe stylus 3 is positioned at the center of the writing surface 2. The selection area Zpx(tn) then extends entirely within the writing surface 2. In this example, a single pixel lies entirely within the selection area Zpx(tn) and is surrounded by 8 adjacent pixels that are partially within the selection area. Thus, the set Spx comprises the 9 pixels that are at least partially within the selection area Zpx(tn). The selected pixels therefore at least partially surround the estimated reference position Čp|c on the writing surface 2.

[0075] Of course, the selection zone Zpx(tn) can have other shapes. For example, it can be elongated, with its major axis oriented along the direction of movement of the tip 4, which is determined by the localization device 10 from the state vector Xa(tn). The dimension of the major axis can also depend on the speed of movement of the tip or the magnet, this speed being determined by the calculation unit 11 from the state vector Xa estimated for several measurement times, and being transmitted to the processing unit 24. Furthermore, the shape and / or size of the selection zone Zpx(tn) can depend on the type of tool 3 used, and possibly on the characteristics of the tip 4.

[0076] Specific embodiments have just been described. Different variations and modifications will be apparent to those skilled in the art.

[0077] Thus, the trace recording system 1 can include several utensils 3, each equipped with at least one magnetic object 6, intended to come into contact with the same writing surface 2. The localization device 10 can thus determine a state vector for each of the magnetic objects 6, and the tactile matrix sensor 20 can determine the contact of the tip 4 of each of the utensils 3.

Claims

1. A system (1) for recording a trace performed on a writing surface (2), including: ∘ a utensil (3), intended to be handled by a user, provided with a magnetic object (6), and including a tip (4) intended to come into contact with the writing surface (2) to form the trace to be recorded; ∘ a localisation device (10), including: • a network of magnetometers (Mi), which are secured to the writing surface (2), and adapted to measure a magnetic field emitted by the magnetic object (6) at different successive measurement times tn, • an electronic calculation unit (11), adapted to determine a state vector Xa representative of at least one position of the magnetic object (6) from the measured magnetic field, and to determine an estimated reference position Čp|c on the writing surface (2) from the state vector Xa, ∘ characterised in that it includes a touch matrix sensor (20) including: • a matrix of N distinct pixels (Pxi), which are secured to the writing surface (2), and each adapted to provide an electrical response signal representative of a contact of the tip (4) on the writing surface (2); • an electronic processing unit (24), connected to the electronic calculation unit (11), and adapted to determine a set Spx of M pixels, with M less than N, at least partly surrounding said estimated reference position Čp|c, to transmit an electrical control signal to the M pixels of said set Spx and receive their electrical response signals; and to detect the contact of the tip (4) on the writing surface (2) from the electrical response signals from said set Spx of M pixels, and when the contact is detected, to save successive positions of the tip (4) to form the trace record depending on at least the successive estimated reference positions Čp|c.

2. The system (1) according to claim 1, wherein the localisation device (10) is adapted to determine a position Pp,z of the tip (4) along an axis orthogonal to the writing surface (2) from the state vector Xa, to compare the determined position Pp,z with a predefined threshold value Pp,z,th, and to transmit the estimated reference position Ĉp|c to the touch matrix sensor (20) when the position Pp,z is less than or equal to the predefined threshold value Pp,z,th.

3. The system (1) according to claim 1 or 2, wherein the localisation device (10) is adapted to determine the position Pp,z of the tip (4) along the axis orthogonal to the writing surface (2) from the state vector Xa, to compare the determined position Pp,z with a predefined threshold value Pp,z,th and to activate the touch matrix sensor (20) when the position Pp,z is less than or equal to the predefined threshold value Pp,z,th, the touch matrix sensor (20) remaining not electrically powered otherwise.

4. The system (1) according to any one of claims 1 to 3, wherein the estimated reference position Ĉp|c is determined by projection along the axis orthogonal to the writing surface (2) of the position Pp,xy of the tip (4) in a plane parallel to the writing surface (2).

5. The system (1) according to any one of claims 1 to 4, wherein the localisation device (10) is adapted to calculate a displacement speed of the magnetic object (6) from the state vector Xa determined for several measurement times, to transmit the displacement speed to the processing unit (24), the latter being adapted to define the set Spx of M pixels with an elongated contour along a major axis, the major axis being parallel to the axis of the displacement speed.

6. The system (1) according to claim 5, wherein the major axis has a length which depends on the norm of the displacement speed.

7. The system (1) according to any one of claims 1 to 6, wherein the touch matrix sensor (20) is a pressure matrix sensor adapted to determine a pressure force exerted by the tip (4) on the writing surface (2).

8. The system (1) according to claim 7, wherein the touch matrix sensor (20) is adapted to determine a position Cp|c, of the point of contact of the tip (4) on the writing surface (2), the position of the tip (4) save to form the trace is a function of the estimated reference position Čp|c and of the position Cp|c, of the point of contact of the tip (4).

9. The system (1) according to any one of claims 1 to 8, wherein the state vector Xa is determined by a Bayesian estimation algorithm or by an optimisation method.

10. A method for recording a trace of the tip (4) of a utensil (3) on a writing surface (2) by means of the system according to any one of the preceding claims, including the following steps: ∘ handling the utensil (3) by a user, said utensil first not being in contact with the writing surface (2) then, coming into contact with the writing surface (2); ∘ measuring, by the network of magnetometers (Mi), the magnetic field emitted by the magnetic object (6) at different successive measurement times tn; ∘ determining, by the electronic calculation unit (11), the state vector Xa(tn) of the magnetic object (6), from the measurements of the measured magnetic field; ∘ determining, by the electronic calculation unit (11), the estimated reference position Ĉp|c(tn) on the writing surface (2), from the determined state vector Xa(tn); ∘ characterised in that it further includes the following steps: ∘ determining, by the electronic processing unit (24), the set Spx(tn) of M pixels (Pxi) at least partly surrounding the estimated reference position Čp|c(tn); ∘ transmitting, by the electronic processing unit (24), the electrical control signal to the pixels of the set Spx(tn), and receiving the electrical response signals; ∘ detecting, by the electronic processing unit (24), the contact of the tip (4) on the writing surface (2), from the electrical response signals from said set Spx of the M pixels, and when the contact is detected, recording the successive positions of the tip (4) to form the trace record depending on at least the successive estimated reference positions Čp|c(tn).

11. An information recording medium, including instructions for executing a method for recording a trace according to claim 10, when these instructions are executed by a calculation unit.