Method and system for measuring point of impact for the onset and development of a musical gesture

Abstract

The present invention relates to a method for measuring at least one point of impact between at least one member and a playing zone for the onset and development of a musical gesture (1). For this purpose, computing means receive a first datum representative of a contact between said member and said playing zone from a first sensor associated with said playing zone, receive a second datum representative of the impact dynamics between said member and said playing zone from a second sensor associated with said playing zone, and determine a fourth datum representative of the dynamics of said musical gesture (1) from said first datum and said second datum.

Description

[0001] Title: Method and system for measuring the point of impact for the activation and development of a musical gesture

[0002] Technical field

[0003] The present invention relates to the field of electronic musical instruments.

[0004] The present invention relates more particularly to a method for measuring a point of impact associated with a musical gesture making it possible to better characterize and differentiate the interactions with the electronic musical instrument.

[0005] For the purposes of the present invention, musical gesture is understood here, and throughout the description which follows, to mean any interaction with the electronic musical instrument which can create or impact a sound generated by the musical instrument. The nature of the musical gesture thus varies according to the desired characteristics of the electronic musical instrument, and corresponds for example to a set of gestures associated with a standard musical instrument, which is reproduced by the electronic musical instrument.

[0006] The present invention will thus find numerous advantageous applications in the emulation of a wide variety of acoustic instruments, or even in the creation of sounds specific to electronic musical instruments.

[0007] State of the art

[0008] The Applicant develops, produces and markets electronic musical instruments.

[0009] For the triggering of musical notes and the variations in expression of the musician, the Applicant has already developed a specific process for measuring these musical gestures for wind instruments. This process allows the musician to nuance his playing very precisely on an electronic instrument as he could do on an acoustic instrument.

[0010] Document WO 2016 / 193601 Al is thus known. The Applicant has also developed a sound engine which can respond to varied and nuanced gestures for its electronic wind instrument.

[0011] With the intention of bringing the possibilities of this sound engine to a wider audience, not limited to wind instruments alone, it was necessary to imagine a similar technical solution for other ranges of instruments.

[0012] We can thus describe two large families of instruments, to which specific instrumental gestures are associated:

[0013] - percussion instruments, for which the usual methods use impact and deformation sensors, allowing the measurement of an impact point and the impact dynamics;

[0014] - keyboard instruments, for which the usual methods are based on a measurement of the dynamics of triggering gestures, based on the crossing of thresholds.

[0015] Many technical solutions offer electronic percussion instruments using force sensors, for example piezoelectric sensors or resistive force sensors (also called FSR sensors, from the English "Force-sensing resistor"), for a game most often using sticks to trigger sounds. Striking a finger or a stick on the electronic percussion instrument activates the force sensor and triggers the generation of an associated sound.

[0016] Other solutions, associated with finger drumming practices, are based on a grid of sensors that can trigger different sounds. Depending on the position of the strike, different force sensors are activated, and the sound is modulated.

[0017] The Applicant submits, however, that these solutions do not allow electronic instruments to obtain as many nuances as acoustic, percussion or keyboard instruments. In particular, sound modulation using a grid of force sensors has limited precision and requires a multiplication of sensors, resulting in a complex instrument generating irregular sounds.

[0018] Summary of the invention

[0019] The present invention aims to improve the current situation described above. The present invention aims more particularly to remedy the above limitations by proposing an original technical solution which makes it possible to measure the entire musical gesture triggered directly with the fingers in the same way as on an instrument, (dynamics of note triggering, continuous variation according to different parameters during the development of the note and release of the note, position of the point of impact which can have an influence on the sound rendering) by possibly integrating additional possibilities.

[0020] To this end, the subject of the present invention relates in a first aspect to a method for measuring at least one point of impact between at least one organ and a playing zone for the triggering and development of a musical gesture, the method being implemented by at least one processor, the method comprising the following steps:

[0021] - reception of a first data representative of a contact between the organ and the playing area from a first sensor associated with the playing area;

[0022] - receiving a second piece of data representative of an impact dynamic between the organ and the playing area from a second sensor associated with the playing area; and

[0023] - determination of a fourth data item representative of a dynamic of the musical gesture from the first data item and the second data item.

[0024] It is understood here that the organ corresponds for example to one or more fingers of a user interacting with the playing area, to a hand of such a user, to a stick or to any other tool used to interact with an electronic musical instrument. It is further understood that the playing area corresponds to a surface or a space associated with the electronic musical instrument or more generally to any area in which the user performs the musical gesture. The playing area corresponds for example to a portion of a physical device grouping the first sensor and the second sensor, for example a flat surface associated with this physical device.

[0025] The first data item thus comprises information on the way in which the organ is brought into contact with the playing area, for example one or more positions associated with different fingers, one or more trajectories or movements, i.e. a set of positions of the organ when it moves along the playing area, or a contact surface between the organ and the playing area. The first data item also comprises, for example, derivatives of the position or the contact surface between the organ and the playing area. The reception of the first data item therefore corresponds to a capture of the position and continuous gestures of the organ on the playing area, between the impact of the organ with the playing area and the release, i.e. over the entire interval during which the organ is in contact with the playing area.

[0026] The first sensor comprises, for example, a capacitive touchpad. Those skilled in the art understand that a capacitive touchpad makes it possible to very precisely determine the position of a finger and its path on a surface but remains very limited in terms of measuring impact dynamics. A capacitive touchpad also makes it possible to introduce variations depending on the point(s) of impact between the organ and the playing area.

[0027] On the other hand, the reception of the second data corresponds to a capture of gestures triggering the musical gesture. The second data provides, for example, firstly, threshold crossing information, like the methods associated with keyboard instruments of the prior art, and secondly, information relating to the dynamics of the musical gesture, which vary depending on whether the gesture corresponds to a strike, a roll, a rub, or whether it is performed with the pad of a finger, a nail or a stick.

[0028] The second sensor comprises, for example, one or more piezoelectric sensors. A person skilled in the art understands that piezoelectric sensors, commonly used for electronic percussion instruments, make it possible to accurately measure the dynamics of the impact of a strike on a surface, i.e., in this case, the impact between the organ and the playing area. In other words, the piezoelectric sensors measure a mechanical stress or deformation resulting from the impact. On the contrary, such sensors are not suitable for determining the positions associated with the impacts. The second sensor thus makes it possible to recover the dynamics of percussive playing.

[0029] Alternatively, the second sensor comprises at least one accelerometer. Such an accelerometer may be an alternative to piezoelectric sensors, and may be integrated into a complete inertial unit more suitable for instruments that may be in motion.

[0030] Thus, the principle of the present invention consists of merging the data from the first and second sensors, each of which has drawbacks with respect to the desired objective, to extract the most relevant information and combine it in such a way as to obtain a fourth piece of data representative of the entire dynamics of the musical gesture. This combination makes it possible in particular to dissociate and characterize the different parts of the musical gesture:

[0031] - triggering, that is to say the moment and the way in which one begins to trigger a sound, generally the contact between the organ and the playing area;

[0032] - maintenance, i.e. maintaining contact with the playing area to control variations in sound; and

[0033] - the release, that is to say the separation between the organ and the playing area, corresponding to the stopping of the sustained part of the sound.

[0034] The Applicant therefore submits that combining the strengths of each sensor by merging the data, i.e. by giving weight to each sensor on the dimension where it is most precise and most interesting in terms of the possibility of nuanced control of the generated sound in a controlled manner, makes it possible to obtain a more powerful and more precise result than what the individual sensors would allow.

[0035] It is further understood that it is possible to obtain additional information from the first sensor and the second sensor, respectively supplementing the second data and the first data, with less weight. Interferometry techniques make it possible, for example, to obtain an approximate estimate of the position of the organ from the second sensor, in particular from piezoelectric type sensors. According to another example, the variation of the contact surface, obtained from the first data, makes it possible to anticipate the release gestures, that is to say the reduction or stopping of the forces applied to the playing area. In other words, the sensors can provide estimation and / or substitution information on certain aspects of the other sensors to make the method more robust.This design also allows for more economical implementation variants by reducing the requirements for a given sensor, with other sensors being able to supplement the information if necessary.

[0036] Thanks to the present invention, musical gestures are measured and transcribed with a fidelity that is much higher than previous techniques, allowing in a second step a more faithful and more nuanced restitution of the sound. This measurement thus makes it possible to obtain electronic musical instruments whose quality is closer to acoustic instruments, opening the way to greater variations in sound and timbre in their triggering and maintenance. In an advantageous embodiment of the invention, the determination comprises the following phases:

[0037] - obtaining representative information on surface and contact variation from the first data;

[0038] - obtaining representative dynamic measurement information from the second data; and

[0039] - determination of information representative of the triggering of the musical gesture from the information representative of surface and variation of contact and the information representative of dynamic measurement, the fourth data comprising the information representative of the triggering of the musical gesture.

[0040] In other words, the fourth data item includes information specifically associated with the trigger, i.e. a specific part of the musical gesture. The sound and / or timbre at the beginning of a note is thus obtained by combining all the information allowing the characterization of the dynamics of the impact, from both the first data item and the second data item. The information representative of the triggering of the musical gesture corresponds, for example, to one or more signals for controlling the dynamics of the sound and / or the timbre associated with the musical gesture.

[0041] In an additional embodiment, the determination comprises the following steps:

[0042] - obtaining information representative of the position of a contact point from the first data;

[0043] - obtaining information representative of maintenance and / or friction dynamics on the playing area from the second data; and

[0044] - determination of information representative of variations in sound and / or timbre of the musical gesture and information representative of maintenance of the musical gesture from information representative of position of the point of contact and of the dynamics of maintenance and / or friction on the playing area, the fourth data item comprising information representative of variations in sound and / or timbre and maintenance of the musical gesture.

[0045] Thus, the information representative of the position of the contact point and the information representative of the dynamics of maintenance and / or friction make it possible to determine on the one hand the sound and / or the timbre associated with the musical gesture, which is for example used for all the parts of the musical gesture, and on the other hand information associated specifically with the maintenance part of the musical gesture. This design thus makes it possible to precisely determine the evolution of the sound when the organ maintains its contact with the playing area.

[0046] For example, a determination of the sound associated with the triggering is provided by combining the preceding embodiments, the choice of sound and / or timbre being obtained via the position and dynamics of maintenance and / or friction, and the control of the dynamics associated with the sound and / or timbre being obtained via the surface and variation of contact and the measurement of dynamics.

[0047] In a particular embodiment, the first data comprises:

[0048] - information representing the coordinates of the organ on a reference point associated with the playing area; and / or

[0049] - information representative of a contact surface between the organ and the playing area; and / or

[0050] - information representing a distance between several organs; and / or

[0051] - information representative of the speed of variations in the playing area; and / or

[0052] - information representing the acceleration of variations in the playing area; and / or

[0053] - information representing the orientation of the organ in relation to the playing area.

[0054] It is understood here that the information included in the first data can vary depending on the first sensor and the processing carried out. Obviously, the information representing the distance between several organs is only used if several organs interact with the playing area, for example several fingers interacting with a virtual keyboard.

[0055] It is also understood that the notion of first data representative of a contact between the organ and the playing area is taken here in a broad sense, being able to correspond to one or more points of contact according to a given surface, as well as to an evolution of the contact over time via the evolution of the contact surface and the possible displacement(s) of the organ along the playing area, according to a series of positions, or a combination of one or more speeds / accelerations (also variable) and orientations.

[0056] The first data item may thus comprise one or more items of information representing coordinates, i.e. position, of the organ on the playing area, of the contact surface between the organ and the playing area, as well as their respective derivatives, in particular speed or acceleration. It is further understood that the speeds of variation on the playing area correspond to the speeds associated with the different possible movements of the fingers on the surface. The information representing the speed of variation on the playing area and the information representing the orientation of the organ relative to the playing area are for example grouped together in a vector representing the movement of the organ on the playing area.

[0057] Thus, the information representing the contact surface between the organ and the playing area corresponds, for example, to a crushing surface of a finger, which makes it possible to partially simulate the pressure exerted and, for example, to supplement the force information from the second data item. The first data item includes, for example, speed and / or acceleration information supplementing the position information, for example corresponding to a change in positions, or even a speed of distance or approach between several organs.

[0058] It is further understood that, when the organ corresponds to a hand or several fingers of the user, some of the information may be linked together, the overall movement of the hand being able to impact the movement of separate fingers. On the contrary, when the organ corresponds to several hands, many characteristics, in particular orientation and speed of the organs, may be completely independent.

[0059] In a specific embodiment, the second data comprises:

[0060] - information representative of an amplitude of an envelope of a signal from the second sensor; and / or

[0061] - information representative of a spectral content of the signal from the second sensor; and / or

[0062] - information representative of interferometry between a plurality of second sensors.

[0063] It is understood here that the concepts of signal envelope and signal spectral content are associated with a dynamic analysis of the information from the second sensor. Such information is for example determined during the execution of the method from raw data from the second sensor. This information makes it possible in particular to obtain a measurement of dynamics and / or maintenance dynamics and / or friction on the playing area.

[0064] The person skilled in the art further understands that the information representative of dynamic measurement stated above can be obtained, or derives directly, from the information representative of amplitude of the envelope of the signal. Similarly, the information representative of maintenance and / or friction dynamic measurement on the playing area can be obtained, or derives directly, from the information representative of spectral content of the signal.

[0065] It is also understood, as stated above, that when using several second sensors, for example several piezoelectric sensors, interferometry makes it possible to obtain a position estimate associated with the measured forces. This position estimate can be used to supplement the first data, or to distinguish several forces measured by the second sensors and associate them with given positions or zones, which can be specified for example via the first data.

[0066] In an additional embodiment, the method further comprises receiving a third piece of data representative of a gesture of approaching and / or moving away from the organ with respect to the playing area from a third sensor, the fourth piece of data being further determined from the third piece of data.

[0067] It is understood here that the third data item includes information on the speed or orientation of the organ, before or after impact. The fourth data item is thus modified so as to introduce, on the one hand, variations depending on the speeds and direction of approach, and on the other hand to increase the spectacular dimension of the musical gesture, in particular with respect to the movement away from the organ. This design thus makes it possible, on the one hand, to better transcribe and anticipate musical gestures depending on the approach, and on the other hand to add additional unique variations depending on the distance. Of course, it is also possible to consider only the approach or the distance, depending on the intention of the person skilled in the art.

[0068] The third sensor comprises, for example, an electric field sensor, also called an “E-field” sensor. A person skilled in the art understands that an electric field sensor is capable of measuring the position of the organ, in particular a hand, above a surface, in particular the playing area, to anticipate the approach before and after the impact. Since such a sensor is not more precise on the position of the impact itself or on the distinction between several fingers, this measurement remains approximate and must be supplemented, in particular via the information from the first sensor and the second sensor. According to another example, the third sensor comprises an optical sensor and / or a radio sensor, allowing an alternative measurement of the approach and distance movements.As stated above with respect to the first sensor and the second sensor, it is possible to use information from one of the sensors to estimate or substitute certain aspects of one of the other sensors.

[0069] Thus, the integration of the third sensor makes it possible to characterize and dissociate additional parts of the musical gesture:

[0070] - the approach, that is to say the period before the trigger, which does not normally produce a sound in itself but can modify the trigger; and

[0071] - the distance, that is to say the period after the release, which can introduce variations in the progressive disappearance of the sound.

[0072] Of course, although variations in the creation and disappearance of sound result mainly from the triggering, sustaining and releasing parts of the musical gesture, also characterizing the approach and / or the distance allows for additional possibilities of variation to be preserved, for example in order to increase or exaggerate the gesture from the parameters of speed and direction of approach and distance.

[0073] Preferably, the determination further comprises obtaining information representative of the speed of approach of the organ with respect to the playing zone from the third data, the information representative of triggering of the musical gesture being further determined as a function of the information representative of the speed of approach.

[0074] In other words, the way in which the fourth data item is determined as a function of the third data item comprises a modification of the triggering of the musical gesture according to the speed of approach to the playing area, that is to say of the contact surface with the organ. This speed of approach is for example determined in advance and recorded in a memory during the execution of the method according to the invention, so as to predetermine the dynamics of the sound before the reception of more precise information from the first and second sensors.

[0075] In yet another embodiment, the determination further comprises obtaining information representative of the orientation of an approach gesture from the third data item, the information representative of variations in sound and / or timbre and maintenance of the musical gesture being further determined as a function of the information representative of the orientation of the approach gesture. In other words, the manner in which the fourth data item is determined as a function of the third data item comprises a modification of the sound (or timbre) and / or maintenance associated with the musical gesture, depending on the angle of approach of the organ.

[0076] It is understood here, with respect to the preceding embodiments, that the determination of the fourth data item involves one or more mergers of the first, second and third data items, so as to extract the relevant information therefrom and to complete or specify information from a sensor via the other sensors.

[0077] In an additional embodiment, the determination further comprises a determination of information representative of an additional effect of an extinction of the musical gesture from the third data.

[0078] It is understood here that the extinction of the musical gesture is associated with the part of distancing of the musical gesture as described above, the release resulting in a progressive extinction of the sound, which is in this embodiment modulated according to the third data.

[0079] In yet another embodiment, the third data item comprises:

[0080] - information representative of an orientation of the organ; and / or

[0081] - information representing a speed between the organ and the playing area; and / or

[0082] - information representing a distance between the organ and the playing area.

[0083] It is understood here, as previously, that the information included in the third data item may vary depending on the third sensor and the processing carried out during the execution of the method. Similarly, the information representing the orientation or distance of the organ may vary depending on whether the organ designates a finger, several fingers, a hand, or another specific object, and the speed of approach or distance between the organ and the playing area is for example derived from the evolution of the distance between the organ and the playing area.

[0084] In one embodiment, the method further comprises rendering at least one sound of an instrument from the fourth data.

[0085] It is understood here that the fourth data item is intended to characterize the sound and / or timbre of an instrument during playing, in the most precise and nuanced manner possible. The method may therefore include a reproduction of the characterized sound, for example via a sound device such as a speaker, loudspeaker or other. The reproduction of the sound is for example also determined according to a type of selected electronic musical instrument, in particular a type of emulated acoustic instrument. Such a method is thus applicable for example to different percussion or keyboard instruments, the characteristics of the method and / or of the reproduced sound being adapted so as to match the sound or the playing area to a given instrument.

[0086] In another embodiment, the method further comprises transmitting the fourth data to a remote device.

[0087] It is understood here that the method is designed to generate a recordable electronic signal, without necessarily resulting in a sound reproduction itself. The fourth data corresponds to a description of control parameters of a sound to be produced, based on the characteristics of the musical gesture. It is therefore possible in this embodiment to transmit the fourth data to a remote device, for example a device dedicated to the reproduction of sound and distinct from the means implementing the method according to the invention. For example, provision is made for transmission of the fourth data to a sound device as described above, or to a remote device comprising a sound device.

[0088] The transmission of the fourth data is for example carried out according to a specific communication protocol, for example a MIDI communication protocol (from the English "Musical Instrument Digital Interface"). Such a communication protocol allows in particular communication between a controller serving as a physical interface, comprising for example the playing area and the sensors, and a sound synthesis or processing device.

[0089] In yet another embodiment, the method further comprises determining a fifth data item representative of an emulation of a behavior of an instrument from the fourth data item.

[0090] It is understood here that the fifth data item makes it possible to characterize in as much detail as possible the behavior of a given instrument as a function of the musical gesture, that is to say to adapt the information of the fourth data item to the instrument. The fifth data item is then, for example, transmitted to a remote device or used for the reproduction of a sound from the instrument like the embodiments described above. The fifth data item is, for example, determined specifically for a predetermined instrument, or as a function of information representative of a type of selected electronic musical instrument. Such an embodiment is in particular suitable for communication with a remote device only allowing direct reproduction of the sound, without being capable of processing the fourth data item itself.

[0091] According to a second aspect, the present invention relates to a computer program comprising instructions for implementing the method according to the first aspect of the present invention, in particular when these instructions are executed by a processor.

[0092] According to a third aspect, the present invention relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the method according to the first aspect of the invention.

[0093] On the one hand, the recording medium can be any entity or device capable of storing the program. For example, the medium may include a storage medium, such as a ROM memory, a CD-ROM or a microelectronic circuit type ROM memory, or a magnetic recording medium or a hard disk.

[0094] Furthermore, this recording medium may also be a transmissible medium such as an electrical or optical signal, such a signal being able to be conveyed via an electrical or optical cable, by conventional or hertzian radio or by self-directed laser beam or by other means. The computer program according to the present invention may in particular be downloaded from a network such as the Internet.

[0095] Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to perform or to be used in performing the method in question.

[0096] According to a fourth aspect, the present invention relates to a system for measuring at least one point of impact between at least one organ and a playing area for the triggering and development of a musical gesture.

[0097] Advantageously, the system includes:

[0098] - a support having a surface defining the playing area;

[0099] - a first sensor and a second sensor associated with the play area;

[0100] - a beacon unit configured to receive a first data item representative of a contact between the organ and the playing area from the first sensor and to receive a second data item representative of an impact dynamic between the organ and the playing area from said second sensor; and

[0101] - a unit for processing the first data and the second data configured to determine a fourth data representative of a dynamic of the musical gesture.

[0102] Preferably, the system comprises computer means configured to implement the steps of the method according to the first aspect of the invention. The system thus comprises, for example, a third sensor associated with the playing area, the beacon unit being configured to receive a third piece of data representative of a gesture of approach and / or distance of the organ with respect to the playing area from the first sensor, and the processing unit being configured to also process the third piece of data and to determine the fourth piece of data furthermore as a function of the third piece of data. The system also comprises, for example, means for reproducing a sound of an instrument from the fourth piece of data, for example computer means configured to convert a signal comprising the fourth piece of data into a sound signal.

[0103] The person skilled in the art understands that the beacon unit, the processing unit and the computing means, individually or in combination, can be integrated in a single integrated circuit, in several integrated circuits and / or in discrete components, be produced in the form of electronic circuits or software (or computer) modules or even a combination of electronic circuits and software modules.

[0104] The person skilled in the art also understands that the support, the first sensor, the second sensor and optionally the third sensor are for example grouped in the same physical device integrating or in communication with the electronic circuit(s) above, the physical device forming an electronic musical instrument. According to another design, the support is configured to be fixed on another element, for example a drum set or any flat surface, so as to form the electronic musical instrument.

[0105] Thus, through the various functional and structural technical characteristics above, the Applicant proposes a method and a system for measuring at least one point of impact between at least one organ and a playing area for the activation and development of a musical gesture, allowing a much more precise measurement of the movements than the systems known from the state of the art and based solely on force sensors and measurements of activation dynamics, and thus resulting in a more varied and precise modulation of the sounds that can be produced with electronic musical instruments.

[0106] Brief description of the figures

[0107] Other characteristics and advantages of the present invention will emerge from the description of the particular and non-limiting exemplary embodiments of the present invention below, with reference to the appended figures 1 to 8 and in which:

[0108] [Fig- 1]

[0109] Figure 1 schematically illustrates a chronology of the different parts of a musical gesture performed by hand, in relation to percussion, keyboard playing or even bow playing;

[0110] [Fig- 2]

[0111] Figure 2 illustrates a front view of a support of a system for measuring at least one point of impact between an organ and a playing area for the activation and development of the musical gesture of Figure 1, according to a first exemplary embodiment;

[0112] [Fig- 3]

[0113] Figure 3 illustrates a side view of the support of Figure 2;

[0114] [Fig. 4]

[0115] Figure 4 illustrates a front view of a support of a system for measuring at least one point of impact between an organ and a playing area for the activation and development of the musical gesture of Figure 1, according to a second exemplary embodiment;

[0116] [Fig. 5]

[0117] Figure 5 illustrates a side view of the support of Figure 4;

[0118] [Fig. 6] Figure 6 illustrates a flowchart of the different steps of a method for measuring at least one point of impact between an organ and a playing area for the triggering and development of the musical gesture of Figure 1, according to a first variant embodiment;

[0119] [Fig. 7]

[0120] Figure 7 illustrates a flowchart of the different steps of a method for measuring at least one point of impact between an organ and a playing area for the triggering and development of the musical gesture of Figure 1, according to a second variant embodiment; and

[0121] [Fig. 8]

[0122] Figure 8 schematically illustrates a device configured to measure at least one point of impact between an organ and a playing area for the triggering and development of the musical gesture of Figure 1, according to a particular and non-limiting exemplary embodiment of the present invention.

[0123] Detailed description

[0124] A method and a system for measuring at least one point of impact between at least one organ and a playing area for the triggering and development of a musical gesture will now be described in what follows with joint reference to figures 1 to 8. The same elements are identified with the same reference signs throughout the description which follows.

[0125] As indicated in the preamble to the description, current solutions for measuring musical gestures for percussion or keyboard instruments are limited on the one hand to the use of one or more impact sensors, and on the other hand to a measurement of threshold crossing.

[0126] One of the objectives of the present invention is to provide a more precise and nuanced measurement of musical gestures, adapted to the wide variety of gestures that can be performed with an instrument. This is made possible in the example described below, which considers a musical gesture performed in such a way as to reproduce the sound of a percussion instrument, a keyboard instrument or even a bowed instrument.

[0127] It will be understood here that this example is not limiting and that the method and the system according to the invention can be adapted to the reproduction of sounds associated with a wide range of instruments.

[0128] According to the example of figure 1, a musical gesture 1 can be broken down into several parts, as illustrated in a first chronology 11 illustrating an organ, here a finger, coming into contact with a surface forming a playing zone of the musical gesture 1:

[0129] - approach 111 corresponds to the period before contact between the organ and the playing area;

[0130] - trigger 112 corresponds to the instant at which the organ comes into contact with the playing zone, potentially forming an impact of a certain force;

[0131] - maintenance 113 corresponds to the period during which the organ remains in contact with the playing area, and for example performs different movements along the playing area, in a continuous gesture;

[0132] - release 114 corresponds to the end of maintenance 113, that is to say the moment when the organ breaks contact with the playing zone; and

[0133] - distance 115 corresponds to the period after contact between the organ and the playing area.

[0134] Of course, the organ can correspond to a variety of elements that can be used to interact with the playing area, for example one or more fingers, a hand, a stick or any other suitable tool.

[0135] The movement between the organ and the playing area can be likened to a musical gesture of a percussion instrument, according to the second chronology 12 illustrating the sound of the percussion instrument and the third chronology 13 illustrating the movement of an organ, here a stick, with respect to the playing area, here a skin, of the percussion instrument:

[0136] - during approach 131, the stick approaches the percussion instrument, no sound is yet produced until the stick comes into contact with the skin;

[0137] - the contact between the stick and the percussion instrument generates a note or a sustained sound 121, which is for example modulated by the movement of the stick along the skin, from a first position 132 corresponding for example to the triggering, to a second position 133 corresponding for example to the release; - after the release, that is to say during the distance 134, the percussion instrument generates a progressive disappearance of the sound 122, corresponding for example to the free vibrations of the skin after impact.

[0138] Such behavior can also be adapted to the behavior of a keyboard according to the fourth timeline 14, or of a bow according to the fifth timeline 15, and for which only a sustained sound 141, 151 is generated, the sustained sound corresponding respectively to a note associated with a pressed key of the keyboard and to the friction of the bow on a string. The progressive disappearance of the sound after release is considered non-existent or negligible in these situations.

[0139] It therefore appears, for all of these instruments and in particular for percussion instruments, that the monitoring of the musical gesture 1 is more nuanced than the simple triggering of a note during contact between the organ and the playing area. In particular, the transcription of the sustain part 131 into a sustained sound 121, 141, 151 must take into account the different movements that can be carried out during this sustain part 131.

[0140] In order to propose a solution to this problem, a method is provided for measuring at least one point of impact between at least one organ and a playing zone for the triggering and development of the musical gesture 1, for example method 3 of figures 6 and 7. Method 3 is for example implemented via a dedicated system comprising computer means configured for the implementation of method 3.

[0141] As illustrated in Figure 8, such computing means are for example advantageously grouped in an electronic device 4, for example a computer (hereinafter referred to as “computer”). The computer 4 is for example configured to transmit and receive data within a communication network. The elements of the computer 4, individually or in combination, can be integrated in a single integrated circuit, in several integrated circuits, and / or in discrete components. The computer 4 can be produced in the form of electronic circuits and software modules.

[0142] The computer 4 comprises one (or more) processor(s) configured to execute instructions for carrying out the steps of the method and / or for executing the instructions of the software(s) embedded in the computer 4. The processor may include integrated memory, an input / output interface, and various circuits known to those skilled in the art. The computer 4 further comprises at least one memory 40 corresponding for example to a volatile and / or non-volatile memory and / or comprises a memory storage device which may comprise volatile and / or non-volatile memory, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic or optical disk.

[0143] The computer code of the embedded software(s) comprising the instructions to be loaded and executed by the processor is for example stored in the memory 40 of the computer 4.

[0144] According to an alternative embodiment, the computer 4 is configured to implement a method for measuring at least one point of impact between at least one organ and a playing area forming part of a broader method. The method according to the invention is, for example, part of a method for reproducing at least one sound of an instrument, in which the quantities determined during the method according to the invention, in particular the fourth data item described below, are used as input data for reproducing the sound of an instrument. Such a method is, for example, specifically dedicated to reproducing the sound of a given instrument, for example a percussion instrument or a keyboard instrument, or for reproducing the sound of a plurality of instruments, the fourth data item being, for example, combined with information representative of the selection of an instrument from among the plurality of instruments.

[0145] As illustrated in Figures 2 to 5, the system also comprises, in combination with the computer means, physical means associated with the musical gesture 1 and defining in particular the playing area. The system thus comprises a support 2 having a surface defining the playing area. Such a support 2 comprises for example a frame 21, delimiting an internal zone forming the playing area, and a substrate 22, assembled with the frame 21 and forming a solid base on which the organ can strike. The combination of the frame 21 and the substrate 22 thus defines the playing area as the portion of the substrate 22 delimited by the frame 21.

[0146] It is understood here that the notion of support 2 must be taken in the broad sense, as a tangible physical element capable of forming the playing area on which to strike, and that it is for example possible to design a support 2 in a flexible material, for example reproducing a skin of a percussion instrument so as to be able to replace or cover such an instrument, or even in a more rigid material, for example whose behavior remains substantially similar to that of a stretched skin. The support 2 can thus correspond, depending on the applications, to a more or less stretched percussion skin or to a deformable textile. In a first step 31 of the measurement method, the computer 4 receives a first data item representative of a contact between the organ and the playing area. In other words, the first data item makes it possible to determine the position of the organ with respect to the playing area during the musical gesture 1, from the triggering 112 to the release 114.The contact between the organ and the playing area corresponds for example to a simple position, to several different positions associated with several organs (for example several fingers), to a trajectory associated with a continuous movement of the organ, in particular during the maintenance part 113 of the musical gesture, or even to one or more contact surfaces between the organ and the playing area.

[0147] The first data thus includes for example:

[0148] - information representing the coordinates of the organ on a reference point associated with the playing area; and / or

[0149] - information representative of a contact surface between the organ and the playing area; and / or

[0150] - information representing a distance between several organs, which includes, for example, a speed of separation or rapprochement between several organs; and / or

[0151] - information representative of the speed of variations in the playing area; and / or

[0152] - information representing the acceleration of variations in said playing area; and / or

[0153] - information representing the orientation of the organ in relation to the playing area.

[0154] The first data is advantageously received from a first sensor 231 associated with the playing area. As illustrated in Figures 2 and 4, for example, a plurality of first position sensors 231 are provided forming a grid or a checkerboard crisscrossing the playing area, the first sensors 231 being arranged on the substrate 22 according to the example of Figures 3 and 5. Preferably, the first sensors 231 are grouped in a capacitive touchpad, that is to say a specific sensor allowing precise position tracking inside the playing area, in particular the tracking of one or more fingers.

[0155] According to the example of Figure 8, the first data is received by a beacon unit 42 of the computer 4, for example a beacon unit 42 in communication with the first sensor 231. The computer 4 is for example in wired or wireless communication with the first sensor 231. According to another particular example, the support 2 directly comprises the computer 4. In a second step 32, the computer 4 also receives a second data item representative of an impact dynamic between the member and the playing area. In other words, the second data item makes it possible to characterize the strike against the playing area during the triggering 112, as well as the forces applied during the maintenance 113.The second data allows for example the capture of trigger gestures, providing not only a threshold but also gesture dynamics, making it possible to distinguish tapped gestures, rolling gestures, rubbed gestures, or even to distinguish the organ used, for example an impact made with the pulp of the finger or with a nail.

[0156] The second data is advantageously received from a second sensor 232 also associated with the playing area, like the first sensor 231. According to a first example illustrated in Figures 2 and 3, a single second sensor 232 is provided, making it possible to measure only the information relating to the impact dynamics. According to a second example illustrated in Figures 4 and 5, a plurality of second sensors 232 are provided, arranged at different points in the playing area. Each sensor of the plurality of second sensors 232 measures, for example, substantially different information, making it possible to increase the precision of the measurement of the impact dynamics, to measure several distinct impacts or to associate a position estimate with the impact dynamics.

[0157] Like the first data, the second data is advantageously received by the computer 4 via the beacon unit 42. According to a variant, the computer 4 comprises a plurality of distinct beacon units 42, in respective communication with the first sensor 231 and the second sensor 232.

[0158] The second data thus includes for example:

[0159] - information representative of an amplitude of an envelope of a signal from the second sensor 232; and / or

[0160] - information representative of a spectral content of the signal from the second sensor 232; and / or

[0161] - information representative of interferometry between a plurality of second sensors 232, making it possible to approximately locate the organ or to associate the other information with a location.

[0162] The second sensor 232 comprises, for example, one or more piezoelectric sensors, which are known to measure the dynamics of the impact very faithfully, and thus make it possible to obtain all of the information listed above. According to a variant, the second sensor 232 comprises, in addition to or in replacement of the piezoelectric sensors, one or more accelerometers, for example grouped within an inertial unit. Obviously, the exact information received during the second step 32 depends on the number, position and nature of the second sensors 232.

[0163] In a third optional step 33, the computer 4, for example the beacon unit 42, receives a third piece of data representative of an approach and / or distance gesture of the organ with respect to the playing area. In other words, the third piece of data corresponds to data making it possible to characterize the approach part 111 and / or the distance part 115 of the musical gesture 1. The third piece of data therefore makes it possible to obtain information without there being any contact between the organ and the playing area.

[0164] The third data includes for example:

[0165] - information representing an orientation of the organ, that is to say of a finger, of several fingers, or even of the hand; and / or

[0166] - information representative of a speed between the organ and the playing zone, for example an approach speed in the approach part 111 and a distance speed in the distance part 115, or even information representative of more complex movements; and / or

[0167] - information representing a distance between the organ and the playing area.

[0168] The third data item thus makes it possible, for example, to anticipate the triggering 112 by obtaining additional information on the way in which the organ approaches the playing area, for example a speed making it possible to predict an impact force or an orientation making it possible to predict a position during the impact. The third data item can therefore be used to supplement or anticipate the information from the first sensor 231 and / or the second sensor 232. Optionally, the third data item can be used for the generation of additional sounds or effects before or after contact between the organ and the playing area, so as to add additional variations or nuances when playing with an electronic musical instrument. The third data item can, for example, be processed to modify the gradual disappearance of the sound 122.

[0169] The third data is advantageously received from a third sensor 233. The third sensor 233 comprises for example an electric field sensor, making it possible to measure in particular the position of a hand above a surface, and therefore by extension the position of the organ above the playing area. According to a variant, the third sensor 233 comprises an optical sensor and / or a radio sensor, or any other sensor making it possible to obtain information on the organ without requiring direct contact. The sensor is for example selected according to the type of organ considered, for example adapted in the context of using a stick or another tool.

[0170] According to the example of figures 2 to 5, the third sensor 233 is integrated into the support 2 and arranged between the frame 21 and the substrate 22, on the periphery of the playing area. It is understood here that the third sensor 233 does not need to be placed directly at the level of the playing area, but simply arranged in such a way as to make it possible to determine the distance between the member and the playing area. This arrangement thus makes it possible to limit the constraints on the dimensions of the playing area, by associating the third sensor 233 with its periphery.

[0171] In a fourth operation, the computer 4 then determines a fourth data item representative of a dynamic of the musical gesture 1. The fourth data item is determined by a processing unit 41 integrated into the computer 4, the processing unit 41 corresponding for example to an integrated processor. The fourth data item is advantageously determined from the first data item and the second data item, and optionally from the third data item, when this third data item is received.

[0172] The determination of the fourth data item therefore comprises a combination of information from different sensors, making it possible to take advantage of the specificities of each sensor and to obtain a greater quantity of data than those used by the solutions of the prior art. This design also allows for a less complex and more precise implementation than a multiplication of piezoelectric sensors. The different parts of the musical gesture 1 can thus be correctly characterized, in particular the triggering 112, the maintenance 113 and the release 114. The use of the third data item also makes it possible to characterize in more detail the approach 111 and the distance 115. Thus, the fourth data item is determined in a more precise and nuanced manner.

[0173] According to the example of Figure 7, the fourth step 34 is divided into a plurality of sub-steps 341, 342, 343, 344, 345, 346, 347 corresponding to a plurality of separate processing operations allowing the fourth data item to be obtained, for example several pieces of information included in the fourth data item. Thus, in this example, a first sub-step 341 is provided comprising obtaining information representative of the position of a contact point from the first data item and information representative of maintenance and / or friction dynamics on the playing area from the second data item. The information is then processed, for example via a first data fusion transform.Following this first sub-step 341, the processing unit 41 performs a first determination 344 of information representative of variations in sound and / or timbre of the musical gesture 1 and a second determination 345 of information representative of maintenance of the musical gesture 1. This first sub-step 341 therefore makes it possible to characterize on the one hand the type of sound associated with the musical gesture 1 via the first determination 344, on the other hand the maintenance part 113 of the musical gesture 1 via the second determination 345.

[0174] When the calculator 4 also receives the third data item, the processing unit 41 also performs a second sub-step 342 of obtaining information representative of the orientation of the approach gesture, the first determination 344 and the second determination 345 being further performed from the orientation of the approach gesture. It is understood here that this second sub-step 342 makes it possible to specify additional information on the musical gesture 1, in particular the angle at which the playing area is struck, as well as to anticipate the strike itself.

[0175] In this same example, a third sub-step 343 is provided comprising obtaining information representative of surface area and contact variation from the first data item and information representative of dynamic measurement from the second data item. The information is for example processed via a second data fusion transform, and the processing unit 41 performs a third determination 346 of information representative of triggering of the musical gesture 1. The third sub-step 343 and the third determination 346 thus make it possible to characterize the triggering part 112 of the musical gesture 1.

[0176] Optionally, the third sub-step 343 also comprises obtaining information representative of the speed of approach of the organ with respect to the playing zone from the third data, the second data fusion transform and the third determination also processing this information. The speed of approach of the organ thus makes it possible to anticipate the force of the impact between the organ and the playing zone. Still according to FIG. 7, the third step 33 can also be followed by a fourth determination 347 of information representative of an additional effect of extinction of the musical gesture 1, that is to say an additional effect associated with the distancing part 115 and / or the progressive disappearance of the sound 122.

[0177] Thus, it will be understood that the present invention provides a method for measuring at least one point of impact between at least one organ and a playing area for the triggering and development of a musical gesture, which makes it possible to provide additional precision and nuance in the measurement, so as to transcribe all the subtleties during the game. Such a method is for example implemented by a dedicated system associating a plurality of sensors with a playing area, for example a system associated with an electronic musical instrument. Such a method can also be integrated into a broader method for reproducing the sound of a given musical instrument.

[0178] It should be noted that this detailed description relates to a particular embodiment of the present invention, but that in no case does this description have any limiting character with respect to the subject of the invention; on the contrary, its objective is to remove any possible imprecision or misinterpretation of the claims which follow.

[0179] It should also be noted that the reference signs placed in parentheses in the following claims are in no way limiting; these signs have the sole purpose of improving the intelligibility and understanding of the following claims as well as the scope of the protection sought.

Claims

Claims 1. Method for measuring at least one point of impact between at least one organ and a playing area for the triggering and development of a musical gesture (1), said method being implemented by at least one processor, said method comprising the following steps: - reception (31) of a first data item representative of at least one position of a contact between said member and said playing area from a first sensor (231) associated with said playing area; - reception (32) of a second data item representative of an impact dynamic between said member and said playing area from a second sensor (232) associated with said playing area; and - determination (34) of a fourth data item representative of a dynamic of said musical gesture (1) from said first data item and said second data item.

2. The method of claim 1, wherein said determining (34) comprises the following steps: - obtaining information representative of surface area and contact variation from said first data; - obtaining information representative of dynamic measurement from said second data; and - determination (346) of information representative of triggering of said musical gesture (1) from said information representative of surface and variation of contact and said information representative of dynamic measurement, said fourth data item comprising said information representative of triggering of said musical gesture (1).

3. Method according to claim 1 or 2, wherein said determination (34) comprises the following phases: - obtaining information representative of the position of a contact point from said first data; - obtaining information representative of maintenance and / or friction dynamics on said playing area from said second data; and - determination (344, 345) of information representative of variations in sound and / or timbre of said musical gesture (1) and of information representative of maintenance of said musical gesture (1) from said information representative of position of said point of contact and of said dynamics of maintenance and / or friction on said playing zone, said fourth data comprising said information representative of variations in sound and / or timbre and maintenance of said musical gesture (1).

4. Method according to one of claims 1 to 3, in which said first data comprises: - information representing the coordinates of said organ on a reference point associated with said playing area; and / or - information representative of a contact surface between said organ and said playing area; and / or - information representing a distance between several organs; and / or - information representative of the speed of variations in said playing area and / or - information representing the acceleration of variations in said playing area; and / or - information representing the orientation of said organ in relation to said playing area.

5. Method according to one of claims 1 to 4, in which said second data item comprises: - information representative of an amplitude of an envelope of a signal of said second sensor (232); and / or - information representative of a spectral content of said signal of said second sensor (232); and / or - information representative of interferometry between a plurality of second sensors (232).

6. Method according to one of claims 1 to 5, which further comprises a reception (33) of a third data item representative of a gesture of approaching and / or moving away from said organ with respect to said playing zone from a third sensor (233), said fourth data item being further determined from said third data item.

7. Method according to claim 6 in combination at least with claim 2, in which said determination (34) further comprises obtaining information representative of the speed of approach of said organ with respect to said playing zone from said third data, said information representative of triggering of said musical gesture (1) being further determined as a function of said information representative of approach speed.

8. Method according to claim 6 or 7 in combination at least with claim 3, in which said determination (34) further comprises obtaining information representative of the orientation of an approach gesture from said third data, said information representative of variations in sound and / or timbre and maintenance of said gesture musical (1) being further determined as a function of said information representing the orientation of said approach gesture.

9. Method according to one of claims 6 to 8, in which said determination (34) further comprises a determination (347) of information representative of an additional effect of an extinction of said musical gesture (1) from said third data.

10. Method according to one of claims 6 to 9, in which said third data item comprises: - information representative of an orientation of said body; and / or - information representative of a speed between said organ and said playing zone; and / or - information representing a distance between said organ and said playing area.

11. Method according to one of claims 1 to 10, which further comprises a restitution of at least one sound of an instrument from said fourth data.

12. Computer program product comprising instructions for implementing the method according to any one of the preceding claims, when these instructions are executed by a processor.

13. Computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the method according to any one of claims 1 to 11.

14. System for measuring at least one point of impact between at least one organ and a playing area for the triggering and development of a musical gesture, said system comprising: - a support (2) having a surface defining said playing area; - a first sensor (231) and a second sensor (232) associated with said play area; - a beacon unit (42) configured to receive a first data item representative of at least one position of said member on said playing area from said first sensor (231) and to receive a second data item representative of an impact dynamic between said member and said playing area from said second sensor (232); and - a processing unit (41) of said first data and said second data configured to determine a fourth data representative of a dynamic of said musical gesture.

15. Measuring system according to claim 14 comprising computer means configured for the implementation of any one of claims 2 to 11.

Images