Method and system for measuring the point of impact for initiating and developing a musical gesture

Abstract

The present invention relates to a method for measuring at least one point of impact between at least one organ and a playing area for the initiation and development of a musical gesture (1). To this end, computer means receive a first data point representing contact between said organ and said playing area from a first sensor associated with said playing area, receive a second data point representing the impact dynamics between said organ and said playing area from a second sensor associated with said playing area, and determine a fourth data point representing the dynamics of said musical gesture (1) from said first and second data points. Figure 1

Description

Title of the invention: Method and system for measuring the point of impact for initiating and developing a musical gesture technical field

[0001] The present invention relates to the field of electronic musical instruments.

[0002] The present invention relates more particularly to a method of measuring an impact point associated with a musical gesture, allowing for better characterization and differentiation of interactions with the electronic musical instrument.

[0003] For the purposes of this invention, the term "musical gesture" herein and throughout the following description means any interaction with the electronic musical instrument that can create or affect a sound generated by the instrument. The nature of the musical gesture thus varies according to the desired characteristics of the electronic musical instrument, and corresponds, for example, to a set of gestures associated with a standard musical instrument, which is reproduced by the electronic instrument.

[0004] The present invention will thus find many advantageous applications in the emulation of a wide variety of acoustic instruments, or even in the creation of sounds specific to electronic musical instruments. State of the art

[0005] The Applicant develops, produces and markets electronic musical instruments.

[0006] For the triggering of musical notes and the variations in the musician's expression, the Applicant has already developed a specific method for measuring these musical gestures for wind instruments. This method allows the musician to nuance their playing very precisely on an electronic instrument, just as they could on an acoustic instrument.

[0007] Document WO 2016 / 193601 AL is thus known

[0008] The Applicant has also developed a sound engine that allows for responding to varied and nuanced gestures for its electronic wind instrument.

[0009] Intending to make the possibilities of this sound engine available to a wider public not limited to wind instruments alone, it was necessary to devise a similar technical solution for other ranges of instruments.

[0010] We can thus describe two main families of instruments, to which specific instrumental gestures are associated: - percussion instruments, for which the usual methods use impact and deformation sensors, allowing the measurement of an impact point and the impact dynamics; - keyboard instruments, for which the usual processes rely on a measurement of the dynamics of triggering gestures, based on crossing thresholds.

[0011] Numerous technical solutions offer electronic percussion instruments that use force sensors, for example piezoelectric sensors or resistive force sensors (also called FSR sensors, from the English "Force-sensing resistor"), for playing that most often uses drumsticks to trigger sounds. Striking the electronic percussion instrument with a finger or a drumstick activates the force sensor and triggers the generation of an associated sound.

[0012] Other solutions, associated with "finger drumming" practices, are based on a grid of sensors that trigger different sounds. Depending on the position of the strike, different force sensors are activated, and the sound is modulated.

[0013] The Applicant submits, however, that these solutions do not allow electronic instruments to achieve as many nuances as acoustic, percussion, or keyboard instruments. In particular, sound modulation using a grid of force sensors has limited precision and requires a multiplication of sensors, resulting in a complex instrument that generates irregular sounds. Summary of the invention

[0014] The present invention aims to improve the current situation described above.

[0015] The present invention is more particularly aimed at overcoming the above limitations by proposing an original technical solution that allows the entire musical gesture triggered directly with the fingers to be measured in the same way as on an instrument, (dynamics of note engagement, continuous variation according to different parameters during the development of the note and release of the note, position of the point of impact which can have an influence on the sound rendering) possibly integrating additional possibilities.

[0016] To this end, the object of the present invention relates in a first aspect to a method of measuring at least one point of impact between at least one organ and a playing area for the triggering and development of a musical gesture, the method being implemented by at least one processor, the method comprising the following steps: - receiving a first data representative of a contact between the organ and the playing area from a first sensor associated with the playing area; - reception of a second data point representing the impact dynamics between the organ and the playing area from a second sensor associated with the playing area; and - determination of a fourth piece of data representing a dynamic of the musical gesture from the first and second pieces of data.

[0017] It is understood here that the organ corresponds, for example, to one or more fingers of a user interacting with the playing area, to a hand of such a user, to a drumstick, or to any other tool used to interact with an electronic musical instrument. It is further understood that the playing area corresponds to a surface or space associated with the electronic musical instrument or, more generally, to any area in which the user performs the musical gesture. The playing area corresponds, for example, to a portion of a physical device comprising the first sensor and the second sensor, for example, a flat surface associated with this physical device.

[0018] The first piece of data thus includes information on how the organ is brought into contact with the playing area, for example, one or more positions associated with different fingers, one or more trajectories or movements, that is, a set of positions of the organ as it moves along the playing area, or even a contact surface between the organ and the playing area. The first piece of data also includes, for example, derivatives of the position or the contact surface between the organ and the playing area. The reception of the first piece of data therefore corresponds to a capture of the position and continuous movements of the organ on the playing area, between the impact of the organ with the playing area and its release, that is, over the entire interval during which the organ is in contact with the playing area.

[0019] The first sensor includes, for example, a capacitive touchpad. Those skilled in the art understand that a capacitive touchpad makes it possible to determine very precisely the position of a finger and its path on a surface, but remains very limited in terms of measuring impact dynamics. A capacitive touchpad also makes it possible to introduce variations depending on the point(s) of impact between the organ and the playing area.

[0020] On the other hand, the reception of the second piece of data corresponds to the capture of gestures triggering the musical gesture. The second piece of data provides, for example, firstly, information on crossing a threshold, similar to the processes associated with keyboard instruments of the prior art, and secondly, information relating to the dynamics of the musical gesture, which varies depending on whether the gesture corresponds to a strike, a roll, a rub, or whether it is performed with the pad of a finger, a nail, or a stick.

[0021] The second sensor comprises, for example, one or more piezoelectric sensors. Those skilled in the art understand that piezoelectric sensors, commonly used for electronic percussion instruments, make it possible to accurately measure the dynamics of the impact of a strike on a surface, that is to say, in this case, the impact between the instrument and the playing area. In other words, piezoelectric sensors measure a mechanical stress or deformation resulting of the impact. On the contrary, such sensors are not suitable for determining the positions associated with impacts. The second sensor thus makes it possible to recover the dynamics of percussive play.

[0022] Alternatively, the second sensor includes at least one accelerometer. Such an accelerometer can be an alternative to piezoelectric sensors and can be integrated into a complete inertial measurement unit more suitable for instruments that may be in motion.

[0023] Thus, the principle of the present invention consists of merging the data from the first and second sensors, each of which has drawbacks with regard to the objective sought, in order to extract the most relevant information and combine it in such a way as to obtain a fourth piece of data representative of the whole dynamic of the musical gesture.

[0024] This combination makes it possible in particular to separate and characterize the different parts of the musical gesture: - the triggering, that is to say the moment and the way in which a sound begins to be triggered, generally the contact between the organ and the playing area; - maintenance, that is, maintaining contact with the playing area to control variations in sound; and - the release, that is to say the separation between the organ and the playing area, corresponding to the stopping of the sustained part of the sound.

[0025] The Applicant therefore submits that combining the strengths of each sensor by merging the data, i.e. by giving weight to each sensor on the dimension where it is most precise and most interesting in terms of the possibility of nuancedly controlling the generated sound, makes it possible to obtain a more powerful and more precise result than the individual sensors would allow.

[0026] It is further understood that it is possible to obtain additional information from the first and second sensors, supplementing the second and first data points respectively, with less weight. Interferometric techniques, for example, allow for an approximate estimation of the organ's position from the second sensor, particularly piezoelectric sensors. As another example, the variation in the contact area, obtained from the first data point, makes it possible to anticipate release movements, i.e., the reduction or cessation of forces applied to the playing area. In other words, the sensors can provide estimation and / or substitution information on certain aspects of the other sensors to make the process more robust. This design also allows for alternative embodiments. more economical by reducing the requirements on a given sensor, with other sensors able to supplement the information if necessary.

[0027] Thanks to the present invention, musical gestures are measured and transcribed with a fidelity far superior to previous techniques, subsequently allowing for a more faithful and nuanced reproduction of the sound. This measurement thus makes it possible to obtain electronic musical instruments whose quality is closer to that of acoustic instruments, opening the way to greater variations in sound and timbre in their activation and sustain.

[0028] In an advantageous embodiment of the invention, the determination comprises the following phases: - obtaining representative information on surface area and contact variation from the first data point; - obtaining representative information on dynamic measurements from the second data point; and - determination of representative information for triggering the musical gesture from representative information of surface and contact variation and representative information of dynamic measurement, the fourth data including representative information for triggering the musical gesture.

[0029] In other words, the fourth piece of data comprises information specifically associated with the triggering, that is, a precise part of the musical gesture. The sound and / or timbre at the beginning of a note is thus obtained by combining all the information that characterizes the dynamics of the impact, derived from both the first and second pieces of data. The information representing the triggering of the musical gesture corresponds, for example, to one or more signals controlling the dynamics of the sound and / or timbre associated with the musical gesture.

[0030] In an additional embodiment, the determination comprises the following phases: - obtaining representative position information from a point of contact based on the first piece of data; - obtaining information representative of a maintenance and / or friction dynamic on the playing area from the second data point; and - determination of information representative of variations in sound and / or timbre of the musical gesture and of information representative of maintenance of the musical gesture from information representative of position of the point of contact and of the dynamics of maintenance and / or friction on the playing area, the fourth data including information representative of variations in sound and / or timbre and maintenance of the musical gesture.

[0031] Thus, information representing the position of the contact point and information representing the dynamics of maintenance and / or friction make it possible to determine, on the one hand, the sound and / or timbre associated with the musical gesture, which is used, for example, for all parts of the musical gesture, and on the other hand, information specifically associated with the maintenance part of the musical gesture. This design thus makes it possible to precisely determine the evolution of the sound when the organ maintains its contact with the playing area.

[0032] For example, the sound associated with triggering is determined by combining the previous embodiments, the choice of sound and / or timbre being obtained via the position and dynamics of maintenance and / or friction, and the control of the dynamics associated with the sound and / or timbre being obtained via the surface and variation of contact and the measurement of dynamics.

[0033] In a particular embodiment, the first data comprises: - information representing the coordinates of the organ on a reference frame associated with the playing area; and / or - information representing a contact surface between the organ and the playing area; and / or - information representing a distance between several organs; and / or - information representing the speed of variations on the playing area; and / or - information representing the acceleration of variations on the playing area; and / or - information representing the orientation of the organ relative to the playing area.

[0034] It is understood here that the information contained in the first data point can vary depending on the first sensor and the processing performed. Obviously, the information representing the distance between several organs is only used if several organs interact with the playing area, for example, several fingers interacting with a virtual keyboard.

[0035] It is also understood that the notion of first data representing a contact between the organ and the playing area is taken here in a broad sense, which may correspond to one or more points of contact according to a given surface, as well as to an evolution of the contact over time via the evolution of the contact surface and the possible displacement(s) of the organ along the playing area, according to a series of positions, or a combination of one or more speeds / accelerations (also variable) and orientations.

[0036] The first data can thus include one or more pieces of information representing coordinates, i.e. position, of the organ on the playing area, of contact surface between the organ and the playing area, as well as their respective derivatives, in particular velocity or acceleration.

[0037] It is further understood that the speeds of variation on the playing area correspond to the speeds associated with the different possible movements of the fingers on the surface. The information representing the speed of variation on the playing area and the information representing the orientation of the organ relative to the playing area are, for example, combined in a vector representing the movement of the organ on the playing area.

[0038] Thus, the information representing the contact surface between the component and the playing area corresponds, for example, to a finger crushing surface, which makes it possible to partially simulate the pressure exerted and, for example, to supplement the force information from the second data point. The first data point includes, for example, velocity and / or acceleration information supplementing the position information, for example, corresponding to a change in positions, or even a speed of movement away from or towards each other between several components.

[0039] It is further understood that, when the organ corresponds to a hand or several fingers of the user, some of the information may be linked, as the overall movement of the hand may affect the movement of individual fingers. Conversely, when the organ corresponds to several hands, many characteristics, particularly the orientation and speed of the organs, may be completely independent.

[0040] In a specific embodiment, the second data comprises: - information representing an amplitude of an envelope of a signal from the second sensor; and / or - information representative of the spectral content of the signal from the second sensor; and / or - representative interferometry information between a plurality of second sensors.

[0041] It is understood here that the concepts of signal envelope and signal spectral content are associated with a dynamic analysis of the information from the second sensor. Such information is, for example, determined during the execution of the process from raw data from the second sensor. This information makes it possible, in particular, to obtain a measurement of dynamics and / or maintenance dynamics and / or friction on the playing area.

[0042] A person skilled in the art further understands that the representative dynamic measurement information stated above can be obtained, or is directly derived, from the representative amplitude information of the signal envelope. Similarly, the representative measurement information of maintenance and / or friction dynamics on the playing area can be obtained, or is directly derived, from the representative spectral content information of the signal.

[0043] It is also understood, as stated above, that when using several secondary sensors, for example several piezoelectric sensors, interferometry makes it possible to obtain a position estimate associated with the measured forces. This position estimate can be used to supplement the first data point, or to distinguish several forces measured by the secondary sensors and associate them with given positions or areas, which can, for example, be specified using the first data point.

[0044] In an additional embodiment, the method further includes receiving a third data point representing an approach and / or retreat gesture of the organ with respect to the playing area from a third sensor, the fourth data point being further determined from the third data point.

[0045] It is understood here that the third piece of data includes information on the speed or orientation of the instrument, before or after impact. The fourth piece of data is thus modified to introduce, on the one hand, variations according to the speed and direction of approach, and on the other hand, to increase the spectacular dimension of the musical gesture, particularly with regard to the instrument's movement away from the target. This design thus makes it possible, on the one hand, to better transcribe and anticipate musical gestures according to the approach, and on the other hand, to add unique additional variations depending on the distance. Of course, it is also possible to consider only the approach or the distance, according to the intention of a person skilled in the art.

[0046] The third sensor includes, for example, an electric field sensor, also called an "E-field" sensor. Those skilled in the art understand that an electric field sensor is capable of measuring the position of an organ, particularly a hand, above a surface, notably the playing area, to anticipate the approach before and after impact. Since such a sensor is no more precise regarding the position of the impact itself or the distinction between multiple fingers, this measurement remains approximate and must be supplemented, particularly with information from the first and second sensors. In another example, the third sensor includes an optical sensor and / or a radio sensor, allowing for an alternative measurement of approach and retreat movements.As stated above with regard to the first and second sensors, it is possible to use information from one of the sensors to estimate or substitute certain aspects of one of the other sensors.

[0047] Thus, the integration of the third sensor makes it possible to characterize and separate additional parts of the musical gesture: - the approach, that is, the period before the triggering, which does not normally produce sound in itself but can modify the triggering; and - the distance, that is to say the period after the release, which can introduce variations in the progressive disappearance of the sound.

[0048] Of course, although the variations in the creation and disappearance of the sound result mainly from the triggering, sustaining and releasing parts of the musical gesture, also characterizing the approach and / or the retreat allows for additional possibilities of variation, for example in order to increase or exaggerate the gesture from the parameters of speed and direction of approach and retreat.

[0049] Preferably, the determination further includes obtaining information representative of the speed of approach of the organ with respect to the playing area from the third data point, the information representative of triggering the musical gesture being further determined as a function of the information representative of the speed of approach.

[0050] In other words, the way in which the fourth piece of data is determined based on the third piece of data involves modifying the triggering of the musical gesture according to the approach speed of the playing area, i.e., the contact surface with the organ. This approach speed is, for example, determined in advance and stored in memory during the execution of the method according to the invention, so as to predetermine the dynamics of the sound before receiving more precise information from the first and second sensors.

[0051] In yet another embodiment, the determination further includes obtaining representative information on the orientation of an approach gesture from the third data point, the representative information on variations in sound and / or timbre and maintenance of the musical gesture being further determined as a function of the representative information on the orientation of the approach gesture.

[0052] In other words, the way in which the fourth data is determined as a function of the third data includes a modification of the sound (or timbre) and / or maintenance associated with the musical gesture, depending on the angle of approach to the organ.

[0053] It is understood here, with regard to the previous embodiments, that the determination of the fourth data involves one or more fusions of the first, second and third data, so as to extract the relevant information and to complete or specify information from a sensor via the other sensors.

[0054] In a further embodiment, the determination further includes a determination of information representative of an additional effect of an extinction of the musical gesture from the third data point.

[0055] It is understood here that the extinction of the musical gesture is associated with the part of distancing the musical gesture as described above, the resulting release in a gradual extinction of the sound, which in this embodiment is modulated according to the third piece of data.

[0056] In yet another embodiment, the third data comprises: - information representing an orientation of the organ; and / or - information representing a speed between the organ and the playing area; and / or - information representing a distance between the organ and the playing area.

[0057] It is understood here, as before, that the information contained in the third data point can vary depending on the third sensor and the processing carried out during the execution of the method. Similarly, the information representing the orientation or distance of the organ can vary depending on whether the organ designates a finger, several fingers, a hand, or another specific object, and the speed of approach or departure between the organ and the playing area is, for example, derived from the evolution of the distance between the organ and the playing area.

[0058] In one embodiment, the method further comprises a reproduction of at least one sound of an instrument from the fourth input.

[0059] It is understood here that the fourth element aims to characterize the sound and / or timbre of an instrument during playing, as precisely and subtly as possible. The process may therefore include a reproduction of the characterized sound, for example via a sound device such as a speaker, loudspeaker, or other device. The sound reproduction is also determined, for example, according to a selected type of electronic musical instrument, in particular a type of emulated acoustic instrument. Such a process can be applied, for example, to various percussion or keyboard instruments, the characteristics of the process and / or the reproduced sound being adapted to match the sound or the playing area to a given instrument.

[0060] In another embodiment, the method further comprises a transmission of the fourth data to a remote device.

[0061] It is understood here that the method is designed to generate a recordable electronic signal, without necessarily resulting in a sound reproduction itself. The fourth piece of data corresponds to a description of control parameters for a sound to be produced, based on the characteristics of the musical gesture. It is therefore possible in this embodiment to transmit the fourth piece of data to a remote device, for example, a device dedicated to sound reproduction and separate from the means implementing the method according to the invention. For example, the fourth piece of data can be transmitted to a sound device as described above, or to a remote device comprising a sound device.

[0062] The transmission of the fourth piece of data is, for example, carried out according to a specific communication protocol, for example a MIDI communication protocol (of (English "Musical Instrument Digital Interface"). Such a communication protocol allows, in particular, communication between a controller serving as a physical interface, including for example the playing area and sensors, and a sound synthesis or processing device.

[0063] In yet another embodiment, the method further comprises determining a fifth data point representing an emulation of the behavior of an instrument from the fourth data point.

[0064] It is understood here that the fifth piece of data allows the behavior of a given instrument to be characterized in as much detail as possible according to the musical gesture, that is to say, the information of the fourth piece of data to be adapted to the instrument. The fifth piece of data is then, for example, transmitted to a remote device or used for the reproduction of a sound from the instrument, as in the embodiments described above. The fifth piece of data is, for example, determined specifically for a predetermined instrument, or based on information representative of a selected type of electronic musical instrument. Such an embodiment is particularly suitable for communication with a remote device that only allows direct sound reproduction, without being able to process the fourth piece of data itself.

[0065] According to a second aspect, the present invention relates to a computer program comprising instructions for implementing the method according to the first aspect of the present invention, particularly when these instructions are executed by a processor.

[0066] According to a third aspect, the present invention relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the process according to the first aspect of the invention.

[0067] On the one hand, the recording medium can be any entity or device capable of storing the program. For example, the medium can include a storage means, such as a ROM, a CD-ROM or a microelectronic circuit-type ROM, or a magnetic recording means or a hard disk drive.

[0068] On the other hand, this recording medium can also be a transmissible medium such as an electrical or optical signal, such a signal being able to be transmitted via an electrical or optical cable, by conventional or radio frequency, by self-directing laser beam, or by other means. The computer program according to the present invention can, in particular, be downloaded from an Internet-type network.

[0069] Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to execute or to be used in the execution of the process in question.

[0070] According to a fourth aspect, the present invention relates to a system for measuring at least one point of impact between at least one organ and a playing area for the engagement and development of a musical gesture.

[0071] Advantageously, the system comprises: - a support presenting a surface defining the playing area; - a first sensor and a second sensor associated with the playing area; - a beacon unit configured to receive initial data representing contact between the organ and the playing area from the first sensor, and to receive second data representing impact dynamics between the organ and the playing area from said second sensor; and - a processing unit for the first and second data configured to determine a fourth data point representative of a dynamic of the musical gesture.

[0072] Preferably, the system comprises computer means configured for implementing the steps of the process according to the first aspect of the invention. The system thus comprises, for example, a third sensor associated with the playing area, the beacon unit being configured to receive a third piece of data representing an approach and / or retreat gesture of the organ relative to the playing area from the first sensor, and the processing unit being configured to also process the third piece of data and to further determine the fourth piece of data based on the third piece of data. The system also comprises, for example, means for reproducing the sound of an instrument from the fourth piece of data, for example, computer means configured to convert a signal including the fourth piece of data into a sound signal.

[0073] A person skilled in the art understands that the beacon unit, the processing unit and the computing means, individually or in combination, can be integrated into a single integrated circuit, into several integrated circuits and / or into discrete components, be implemented in the form of electronic circuits or software (or computer) modules or a combination of electronic circuits and software modules.

[0074] A person skilled in the art also understands that the support, the first sensor, the second sensor, and optionally the third sensor are, for example, grouped together in a single physical device integrating or communicating with the aforementioned electronic circuit(s), the physical device forming an electronic musical instrument. According to yet another design, the support is configured to fix to another element, for example a drum tom or any flat surface, so as to form the electronic musical instrument.

[0075] Thus, by the various functional and structural technical characteristics above, the Applicant proposes a method and a system for measuring at least one point of impact between at least one organ and a playing area for the engagement and development of a musical gesture, allowing a much more precise measurement of movements than the known prior art systems based solely on force sensors and engagement dynamics measurements, and thus resulting in a more varied and precise modulation of the sounds that can be produced with electronic musical instruments. Brief description of the figures

[0076] Other features and advantages of the present invention will become apparent from the description of the particular and non-limiting embodiments of the present invention below, with reference to the attached Figures 1 to 8, in which:

[0077] [Fig.1]

[0078] Fig. 1 schematically illustrates a chronology of the different parts of a musical gesture performed by hand, in relation to a percussion instrument, a keyboard instrument or a bowed instrument;

[0079] [Fig.2]

[0080] Fig. 2 illustrates a front view of a support for a measuring system of at least one point of impact between an organ and a playing area for the engagement and development of the musical gesture of Fig. 1, according to a first example of embodiment;

[0081] [Fig.3]

[0082] Fig. 3 illustrates a profile view of the support of Fig. 2;

[0083] [Fig.4]

[0084] Fig. 4 illustrates a front view of a support for a measuring system of at least one point of impact between an organ and a playing area for the engagement and development of the musical gesture of Fig. 1, according to a second embodiment;

[0085] [Fig.5]

[0086] Fig. 5 illustrates a profile view of the support of Fig. 4;

[0087] [Fig.6]

[0088] Fig. 6 illustrates a flowchart of the different stages of a process for measuring at least one point of impact between an organ and a playing area for the triggering and development of the musical gesture of Fig. 1, according to a first variant of embodiment;

[0089] [Fig.7]

[0090] Figure 7 illustrates a flowchart of the different stages of a method for measuring at least one point of impact between a component and a playing area for the activation and development of the musical gesture of Figure 1, according to a second embodiment; and

[0091] [Fig.8]

[0092] Fig. 8 schematically illustrates a device configured to measure at least one point of impact between an organ and a playing area for the engagement and development of the musical gesture of Fig. 1, according to a particular and non-limiting embodiment of the present invention. Detailed description

[0093] A method and a system for measuring at least one point of impact between at least one organ and a playing area for the triggering and development of a musical gesture will now be described in what follows with joint reference to Figures 1 to 8. The same elements are identified with the same reference signs throughout the description that follows.

[0094] As indicated in the preamble to the description, current solutions for measuring musical gestures for percussion or keyboard instruments are limited on the one hand to the use of one or more impact sensors, and on the other hand to a measurement of crossing thresholds.

[0095] One of the objectives of the present invention is to offer a more precise and nuanced measurement of musical gestures, adapted to the wide variety of gestures that can be performed with an instrument.

[0096] This is made possible in the example described below, which considers a musical gesture made in such a way as to reproduce the sound of a percussion instrument, a keyboard instrument or even a bowed instrument.

[0097] It will be understood here that this example is not limiting and that the method and system according to the invention can be adapted to the reproduction of sounds associated with a wide range of instruments.

[0098] According to the example in [Fig.1], a musical gesture 1 can be broken down into several parts, as illustrated in a first chronology 11 illustrating an organ, here a finger, coming into contact with a surface forming a playing area of ​​the musical gesture 1: - the approach 111 corresponds to the period before the contact between the organ and the playing area; - the trigger 112 corresponds to the moment when the organ comes into contact with the playing area, potentially forming an impact of a certain force; - maintenance 113 corresponds to the period during which the organ remains in contact with the playing area, and performs, for example, different movements along the playing area, in a continuous gesture; - the release 114 corresponds to the end of the maintenance 113, that is to say the moment when the organ breaks contact with the playing area; and - the distance 115 corresponds to the period after contact between the organ and the playing area.

[0099] Obviously, the organ can correspond to a variety of elements that can be used to interact with the playing area, for example one or more fingers, a hand, a wand or any other suitable tool.

[0100] The movement between the organ and the playing area can be likened to a musical gesture of a percussion instrument, according to the second chronology 12 illustrating the sound of the percussion instrument and the third chronology 13 illustrating the movement of an organ, here a stick, vis-à-vis the playing area, here a skin, of the percussion instrument: - during approach 131, the stick approaches the percussion instrument, no sound is produced until the stick comes into contact with the skin; - the contact between the stick and the percussion instrument generates a note or sustained sound 121, which is for example modulated by the movement of the stick along the skin, from a first position 132 corresponding for example to the triggering, to a second position 133 corresponding for example to the release; - after the release, that is to say during the distancing 134, the percussion instrument generates a progressive disappearance of the sound 122, corresponding for example to the free vibrations of the skin after impact.

[0101] Such behavior can also be adapted to the behavior of a keyboard according to the fourth chronology 14, or of a bow according to the fifth chronology 15, for which only a sustained sound 141, 151 is generated, the sustained sound corresponding respectively to a note associated with a pressed key of the keyboard and to the friction of the bow on a string. The gradual disappearance of the sound after release is considered non-existent or negligible in these situations.

[0102] It therefore appears, for all these instruments and in particular for percussion instruments, that the tracking of the musical gesture 1 is more nuanced than the simple triggering of a note upon contact between the organ and the playing area. In particular, the transcription of the sustained part 131 into a sustained sound 121, 141, 151 must take into account the different movements that can be performed during this sustained part 131.

[0103] In order to propose a solution to this problem, a method for measuring at least one point of impact between at least one component and a playing area is provided for the initiation and development of the musical gesture 1, for example, process 3 of Figures 6 and 7. Process 3 is, for example, implemented via a dedicated system comprising computer means configured for the implementation of process 3.

[0104] As illustrated in [Fig. 8], such computer means are advantageously grouped, for example, in an electronic device 4, for example, a computer (hereinafter referred to as the "computer"). The computer 4 is, for example, configured to transmit and receive data within a communication network. The elements of the computer 4, individually or in combination, can be integrated into a single integrated circuit, into several integrated circuits, and / or into discrete components. The computer 4 can be implemented in the form of electronic circuits and software modules.

[0105] The computer 4 comprises one (or more) processor(s) configured to execute instructions for carrying out the steps of the process and / or for executing instructions from the software embedded in the computer 4. The processor may include integrated memory, an input / output interface, and various circuits known to those skilled in the art. The computer 4 further comprises at least one memory 40, corresponding, for example, to volatile and / or non-volatile memory, and / or includes a memory storage device that may include volatile and / or non-volatile memory, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic disk, or optical disk.

[0106] The computer code of the embedded software(s) including the instructions to be loaded and executed by the processor is for example stored on the memory 40 of the computer 4.

[0107] According to one embodiment, the calculator 4 is configured to implement a method for measuring at least one point of impact between at least one component and a playing area, as part of a larger method. The method according to the invention is, for example, part of a method for reproducing at least one sound from an instrument, in which the quantities determined during the method according to the invention, in particular the fourth piece of data described below, are used as input data for reproducing the sound of an instrument. Such a method is, for example, specifically dedicated to reproducing the sound of a given instrument, for example a percussion instrument or a keyboard instrument, or even to reproducing the sound of a plurality of instruments, the fourth piece of data being, for example, combined with information representing the selection of an instrument from among the plurality of instruments.

[0108] As illustrated in Figures 2 to 5, the system also includes, in combination with computer means, physical means associated with the musical gesture 1 and defining in particular the playing area. The system thus includes a A support 2 has a surface defining the playing area. Such a support 2 comprises, for example, a frame 21, delimiting an internal area forming the playing area, and a substrate 22, assembled with the frame 21 and forming a solid base against which the organ can strike. The combination of the frame 21 and the substrate 22 thus defines the playing area as the portion of the substrate 22 delimited by the frame 21.

[0109] It is understood here that the concept of support 2 should be taken in a broad sense, as a tangible physical element capable of forming the playing area on which to strike, and that it is possible, for example, to design a support 2 in a flexible material, for example reproducing the head of a percussion instrument so as to be able to replace or cover such an instrument, or in a more rigid material, for example whose behavior remains substantially similar to that of a stretched head. The support 2 can thus correspond, depending on the application, to a more or less stretched percussion head or to a deformable textile.

[0110] In a first step 31 of the measurement process, the computer 4 receives a first data point representing a contact between the organ and the playing area. In other words, the first data point makes it possible to determine the position of the organ relative to the playing area during the musical gesture 1, from the triggering 112 until the release 114. The contact between the organ and the playing area corresponds, for example, to a simple position, to several different positions associated with several organs (for example, several fingers), to a trajectory associated with a continuous movement of the organ, in particular during the maintenance part 113 of the musical gesture, or to one or more contact surfaces between the organ and the playing area.

[0111] The first piece of data thus includes, for example: - information representing the coordinates of the organ on a reference point associated with the playing area; and / or - information representing a contact surface between the organ and the playing area; and / or - information representing a distance between several organs, which includes, for example, the speed at which several organs move apart or come together; and / or - information representing the rate of change in the playing area; and / or - information representing the acceleration of change in said playing area; and / or - representative information on the orientation of the organ relative to the playing area.

[0112] The first piece of data is advantageously received from a first sensor 231 associated with the playing area. As illustrated in Figures 2 and 4, for example, a plurality of first position sensors 231 are provided, forming a grid or checkerboard pattern covering the playing area, the first sensors 231 being arranged on the substrate 22 according to the example of figures 3 and 5. Preferably, the first sensors 231 are grouped in a capacitive touchpad, that is to say a specific sensor allowing precise position tracking within the game area, in particular the tracking of one or more finger(s).

[0113] According to the example in [Fig.8], the first data is received by a beacon unit 42 from the computer 4, for example a beacon unit 42 in communication with the first sensor 231. The computer 4 is, for example, in wired or wireless communication with the first sensor 231. According to yet another particular example, the support 2 directly includes the computer 4.

[0114] In a second step 32, the calculator 4 also receives a second data point representing the impact dynamics between the organ and the playing area. In other words, the second data point makes it possible to characterize the impact against the playing area during the triggering action 112, as well as the forces applied during the maintenance action 113. The second data point allows, for example, the capture of triggering gestures, providing not only a threshold but also a gesture dynamic, making it possible to distinguish between tapping gestures, rolling gestures, rubbing gestures, or even to distinguish the organ used, for example, an impact made with the fingertip or with a nail.

[0115] The second data point is advantageously received from a second sensor 232 also associated with the playing area, like the first sensor 231. According to a first example illustrated in Figures 2 and 3, a single second sensor 232 is used, allowing only the measurement of information relating to impact dynamics. According to a second example illustrated in Figures 4 and 5, a plurality of second sensors 232 are provided, positioned at different points in the playing area. Each sensor in the plurality of second sensors 232 measures, for example, substantially different information, making it possible to increase the accuracy of the impact dynamics measurement, to measure several distinct impacts, or to associate a position estimate with the impact dynamics.

[0116] Like the first data, the second data is advantageously received by the computer 4 via the beacon unit 42. According to one variant, the computer 4 comprises a plurality of separate beacon units 42, in respective communication with the first sensor 231 and the second sensor 232.

[0117] The second piece of data thus includes, for example: - information representative of the amplitude of an envelope of a signal from the second sensor 232; and / or - information representative of a spectral content of the signal from the second sensor 232; and / or - representative information from interferometry between a plurality of second sensors 232, allowing to locate the organ approximately or to associate other information with a location.

[0118] The second sensor 232 comprises, for example, one or more piezoelectric sensors, which are known to measure the impact dynamics very accurately, and thus make it possible to obtain all the information listed above. According to one embodiment, the second sensor 232 comprises, in addition to or instead of the piezoelectric sensors, one or more accelerometers, for example grouped within an inertial measurement unit. Obviously, the exact information received during the second step 32 depends on the number, position, and nature of the second sensors 232.

[0119] In an optional third step 33, the computer 4, for example the beacon unit 42, receives a third piece of data representing an approach and / or retreat gesture of the organ with respect to the playing area. In other words, the third piece of data corresponds to a data enabling the characterization of the approach part 111 and / or the retreat part 115 of the musical gesture 1. The third piece of data thus makes it possible to obtain information without there being any contact between the organ and the playing area.

[0120] The third piece of data includes, for example: - information representative of the orientation of the organ, that is to say of a finger, several fingers, or even the hand; and / or - information representing a speed between the organ and the playing area, for example an approach speed in the approach area 111 and a retreat speed in the retreat area 115, or information representing more complex movements; and / or - information representing a distance between the organ and the playing area.

[0121] The third data point thus allows, for example, the triggering of 112 to be anticipated by obtaining additional information on how the organ approaches the playing area, for example, a speed to predict the impact force or an orientation to predict the position at the time of impact. The third data point can therefore be used to supplement or anticipate the information from the first sensor 231 and / or the second sensor 232. Optionally, the third data point can be used to generate additional sounds or effects before or after contact between the organ and the playing area, so as to add further variations or nuances when playing an electronic musical instrument. The third data point can, for example, be processed to modify the gradual fading of the sound 122.

[0122] The third data point is advantageously received from a third sensor 233. The third sensor 233 comprises, for example, an electric field sensor, allowing, in particular, the measurement of the position of a hand above a surface, and therefore, by extension, the position of the organ above the playing area. In one variant, the third sensor 233 comprises an optical sensor and / or a radio sensor, or any other sensor that provides information about the organ without requiring direct contact. The sensor is selected, for example, according to the type of organ being considered, for instance, one adapted for use with a stick or other tool.

[0123] As illustrated in Figures 2 to 5, the third sensor 233 is integrated into the support 2 and positioned between the frame 21 and the substrate 22, around the perimeter of the playing area. It is understood here that the third sensor 233 does not need to be placed directly at the playing area, but simply positioned to allow the distance between the organ and the playing area to be determined. This arrangement thus limits the constraints on the dimensions of the playing area by associating the third sensor 233 with its periphery.

[0124] In a fourth operation, the computer 4 then determines a fourth piece of data representing a dynamic of the musical gesture 1. The fourth piece of data is determined by a processing unit 41 integrated into the computer 4, the processing unit 41 corresponding, for example, to an integrated processor. The fourth piece of data is advantageously determined from the first and second pieces of data, and optionally from the third piece of data, when this third piece of data is received.

[0125] The determination of the fourth data point therefore involves a combination of information from different sensors, making it possible to take advantage of the specific characteristics of each sensor and to obtain a greater quantity of data than that used by prior art solutions. This design also allows for a less complex and more precise implementation than a multiplication of piezoelectric sensors. The different parts of the musical gesture 1 can thus be correctly characterized, in particular the triggering 112, the sustaining 113, and the releasing 114. The use of the third data point also makes it possible to characterize the approach 111 and the retreat 115 in greater detail. Thus, the fourth data point is determined more precisely and with greater nuance.

[0126] According to the example in [Fig.7], the fourth step 34 is divided into a plurality of substeps 341, 342, 343, 344, 345, 346, 347 corresponding to a plurality of separate processing operations enabling the obtaining of the fourth data, for example of several pieces of information included in the fourth data.

[0127] Thus, in this example, a first sub-step 341 is provided, comprising obtaining representative information on the position of a contact point from the first data point and representative information on an interview dynamic. and / or friction on the playing area based on the second data point. The information is then processed, for example via a first data fusion transform. Following this first substep 341, the processing unit 41 performs a first determination 344 of information representative of variations in sound and / or timbre of the musical gesture 1 and a second determination 345 of information representative of the maintenance of the musical gesture 1. This first substep 341 thus makes it possible to characterize, on the one hand, the type of sound associated with the musical gesture 1 via the first determination 344, and on the other hand, the maintenance part 113 of the musical gesture 1 via the second determination 345.

[0128] When the computer 4 also receives the third data point, the processing unit 41 also performs a second substep 342 of obtaining representative information on the orientation of the approach gesture, the first determination 344 and the second determination 345 being further performed based on the orientation of the approach gesture. It is understood here that this second substep 342 makes it possible to specify additional information on the musical gesture 1, in particular the angle at which the playing area is struck, as well as to anticipate the strike itself.

[0129] In this same example, a third substep 343 is provided, comprising obtaining information representative of the surface area and contact variation from the first data point and information representative of the dynamic range measurement from the second data point. The information is, for example, processed via a second data fusion transform, and the processing unit 41 performs a third determination 346 of information representative of the triggering of the musical gesture 1. The third substep 343 and the third determination 346 thus make it possible to characterize the triggering part 112 of the musical gesture 1.

[0130] Optionally, the third substep 343 also includes obtaining representative information on the approach speed of the component relative to the playing area from the third data point, the second data fusion transform, and the third determination, which also processes this information. The approach speed of the component thus makes it possible to anticipate the force of the impact between the component and the playing area.

[0131] According to [Fig.7], the third step 33 can also be followed by a fourth determination 347 of information representative of an additional effect of extinction of the musical gesture 1, that is to say an additional effect associated with the part of distancing 115 and / or the progressive disappearance of the sound 122.

[0132] Thus, it will be understood that the present invention provides a method for measuring at least one point of impact between at least one organ and a playing area for the initiation and development of a musical gesture, which makes it possible to bring additional precision and nuance to the measurement, so as to transcribe capturing all the subtleties of the game. Such a process is implemented, for example, by a dedicated system that combines multiple sensors with a playing area, such as a system associated with an electronic musical instrument. This process can also be integrated into a broader sound reproduction process for a given musical instrument.

[0133] It should be noted that this detailed description relates to a particular embodiment of the present invention, but in no way does this description limit the scope of the invention; on the contrary, its purpose is to remove any possible inaccuracy or misinterpretation of the following claims.

[0134] It should also be noted that the reference signs in parentheses in the following claims are in no way intended to be limiting; these signs are solely intended to improve the intelligibility and understanding of the following claims and the scope of the protection sought.

Claims

Demands

1. Method for measuring at least one point of impact between at least one organ and a playing area for the initiation and development of a musical gesture (1), said method being implemented by at least one processor, said method comprising the following steps: - receiving (31) a first data representative of at least one position of a contact between said organ and said playing area from a first sensor (231) associated with said playing area; - receiving (32) a second data representative of an impact dynamic between said organ and said playing area from a second sensor (232) associated with said playing area;and - determination (34) of a fourth data representative of a dynamic of said musical gesture (1) from said first data and said second data, in which said determination (34) comprises the following phases: - obtaining information representative of the position of a point of contact from said first data; - obtaining information representative of a dynamic of maintenance and / or friction on said playing area from said second data;and - determination (344, 345) of information representative of variations in sound and / or timbre of said musical gesture (1) and of information representative of maintenance of said musical gesture (1) from said information representative of position of said point of contact and of said dynamics of maintenance and / or friction on said playing area, said fourth data comprising said information representative of variations in sound and / or timbre and maintenance of said musical gesture (1).;

2. A method according to claim 1, wherein said determination (34) comprises the following steps: - obtaining representative surface and contact variation information from said first data; - obtaining representative dynamic measurement information from said second data; and - determining (346) representative triggering information from said musical gesture (1) from said information representative of surface and contact variation and of said information representative of dynamic measurement, said fourth data including said information representative of triggering said musical gesture (1).

3. A method according to any one of claims 1 to 2, wherein said first data comprises: - information representing the coordinates of said organ on a reference frame associated with said playing area; and / or - information representing a contact surface between said organ and said playing area; and / or - information representing a distance between several organs; and / or - information representing the rate of change on said playing area and / or - information representing the acceleration of change on said playing area; and / or - information representing the orientation of said organ with respect to said playing area.

4. A method according to any one of claims 1 to 3, wherein said second data comprises: - information representing an amplitude of an envelope of a signal of said second sensor (232); and / or - information representing a spectral content of said signal of said second sensor (232); and / or - information representing interferometry between a plurality of second sensors (232).

5. A method according to any one of claims 1 to 4, further comprising receiving (33) a third data item representing an approach and / or retreat gesture of said organ with respect to said playing area from a third sensor (233), said fourth data item being further determined from said third data item.

6. A method according to claim 5 in combination at least with claim 2, wherein said determination (34) further comprises obtaining information representative of the approach speed of said organ with respect to said playing area from said third data, said information representative of the triggering of said musical gesture (1) being further determined as a function of said information representative of approach speed.

7. A method according to claim 5 or 6, wherein said determination (34) further comprises obtaining representative information of the orientation of an approach gesture from said third data, said representative information of variations in sound and / or timbre and maintenance of said musical gesture (1) being further determined as a function of said representative information of the orientation of said approach gesture.

8. A method according to any one of claims 5 to 7, wherein said determination (34) further comprises a determination (347) of information representative of an additional effect of an extinction of said musical gesture (1) from said third data.

9. A method according to any one of claims 5 to 8, wherein said third data comprises: - information representing an orientation of said organ; and / or - information representing a speed between said organ and said playing area; and / or - information representing a distance between said organ and said playing area.

10. A method according to any one of claims 1 to 9, further comprising a reproduction of at least one sound of an instrument from said fourth data point.

11. Product computer program comprising instructions for carrying out the method according to any one of the preceding claims, when these instructions are executed by a processor.

12. Computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the process according to any one of claims 1 to 10.

13. A system for measuring at least one point of impact between at least one organ and a playing area for the initiation and development of a musical gesture, said system comprising: - a support (2) having a surface defining said playing area; - a first sensor (231) and a second sensor (232) associated with said playing area; - a beacon unit (42) configured to receive a first data point representing at least one position of said organ on said playing area from said first sensor (231) and to receive a second data point representing an impact dynamic between said organ and said playing area from said second sensor (232); and - a processing unit (41) for said first data and said second data point configured to determine a fourth data point representing a dynamic of said musical gesture, said processing unit (41) being configured to: - obtain information representing the position of a contact point from said first data point; - obtain information representing a maintenance and / or friction dynamic on said playing area from said second data point;and - determine information representative of variations in sound and / or timbre of said musical gesture (1) and information representative of maintenance of said musical gesture (1) from said information representative of position of said point of contact and of said dynamics of maintenance and / or friction on said playing area, said fourth data including said information representative of variations in sound and / or timbre and maintenance of said musical gesture (1).;

14. Measurement system according to claim 13 comprising computer means configured for the implementation of any one of claims 2 to 10.

Images