System for remotely testing a musical instrument
Patent Information
- Authority / Receiving Office
- EP · EP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-07-25
- Publication Date
- 2026-03-18
AI Technical Summary
The need to physically visit a store to test musical instruments, especially during store closures or the COVID-19 pandemic, limits the ability to make informed purchases.
A system comprising a control server, processing devices, and MIDI interfaces enables remote interaction with musical instruments through a control server system, allowing users to connect to a selected instrument via a processing device, control it remotely, and receive audio signals, mimicking a real testing experience.
Enables users to test musical instruments virtually, expanding customer reach and increasing interest in products without geographical restrictions, while ensuring energy efficiency and security through server load distribution.
Smart Images

Figure IMGF0001 
Figure IMGF0002 
Figure IMGF0003
Abstract
Description
Scope of the invention
[0001] The present invention relates to the technical field of sound reproducing and processing apparatuses.
[0002] In particular, the invention relates to an innovative system which makes it possible to remotely interact with an apparatus equipped with MIDI interface in order to test the features thereof, for example, a musical instrument in general.Brief outline of the prior art
[0003] Online stores of musical apparatuses are currently available but it is known that the purchase of an electronic musical instrument implies the need to go to the store in order to test the instrument.
[0004] In fact, a person who purchases an instrument wants to hear the sound and analyze the functions available on the instrument, such as tones, timbre variations, effects, etc. in order to make at least an initial selection if not the final choice.
[0005] At present, this is not possible but by physically going to the place and, of course, this represents a certain technical inconvenience.
[0006] In addition, if the store is closed, one has to wait for the opening time to see and test the instrument.
[0007] Moreover, people have been experiencing the impact of the Covid-19 pandemic and for this reason retail sales were brought to a standstill, obviously making it harder to test the musical instrument on site.
[0008] The patent publications US2002 / 0085546 and US2016 / 0379514 are further known.Summary of the invention
[0009] Therefore, there is a need for a technical solution that can overcome the limitations related to the need to physically go to the store or in the music "store" in general.
[0010] Specifically, there is a need for a solution that makes it possible to test a musical instrument without physically going to the store but, rather, remotely.
[0011] These and other aims are achieved with the present method for remotely testing a musical apparatus, for example a musical instrument, according to claim 1.
[0012] This method comprises the following steps: Arranging a control server system (100, 110, 310); Arranging one or more processing devices (210, 220, 230), each one associated with a user; The control server system being able to communicate with one or more musical apparatuses (T1, T2, Tn); Said control server system being programmed to connect a processing device (210, 220, 230) to one or more of said musical apparatuses; The method comprising sending, from a processing device associated with the user, a request for communication with a selected musical apparatus, the control server system connecting the requesting processing device to the selected musical apparatus in such a way that said musical apparatus is controllable remotely by the user through said processing device wherein the processing device is equipped with a display screen, on which a graphic interface is displayed through which the musical apparatus is controllable remotely by playing it and receiving the sound emitted by the musical apparatus.
[0013] According to the proposed solution, now it is possible to enable prospective customers to visit the store virtually through an experience very similar to the real one.
[0014] The store can be chosen in an area not geographically restricted and at the same time the stores can increase their customer base and increase interest in their products.
[0015] Thanks to the indicated method, the user can connect to the control server system which actually creates a connection to the selected instrument that can be located in any store.
[0016] Thanks to a suitable programming software, the described system generates a video interface on the user processing device in such a way that the instrument can be controlled remotely for example by means of the user's own processing device keyboard.
[0017] The described architecture, for example through a suitable MIDI interface, allows an exchange of control signals and audio signals between a selected specific musical apparatus and the processing device to which it is connected, thereby allowing users to remotely play and thus test the apparatus.
[0018] In this manner, it is possible to actually test an instrument remotely, therefore without the need to be physically on site.
[0019] The object of the present invention is also an assembly as defined by independent claim 7.
[0020] Further advantages can be inferred from the dependent claims.Brief description of the drawings
[0021] Further features and advantages of the present system according to the invention will become apparent from the following description of embodiments thereof, only by way of example but not limited thereto, with reference to the attached drawings, wherein: Figures 1A, 1B 1C, 1D, 1E and 1F describe the structure and the communication flows of the service; Specifically, figure 1A describes the overall architecture, figure 1B describes the structure related to the single store provided with local server, musical instrument (T1..Tn) with MIDI interface 115, figure 1C is a flow chart of the functioning phases, figure 1D shows a screenshot which is displayed on the screen of the user who is connected to the store in order to test the instrument (in this example a keyboard), figure 1E is a further overall scheme whereas figure 1F shows a detail of the main communication flows; Figure 2 describes in detail the "hw" (Hardware) and "sw" (Software) equipment of a store registered with the service. Description of some preferred embodiments
[0022] Therefore, according to the invention, a possible embodiment of the system in accordance with the invention consists of a software architecture composed by an electronic platform which also allows, in addition to the exchange of conventional information describing the instrument features among the prospective customers and to a series of retailers registered with the service, the exchange of audio signals and control signals for the MIDI interfaces of the instruments.
[0023] This is possible through an architecture which comprises a control server system (100, 110, 310) producing an audio and / or video communication between a user (for example, generally through a PC or personal computer) and a musical instrument which can be controlled remotely by said user.
[0024] More specifically, said architecture, which can be identified by the acronym ReSYP (Remote Synth Player), comprises four components characterizing the purposes thereof, i.e.: Customer, Store, Central server and Support Server System.
[0025] The set of server apparatuses, suitably programmed and equipped with their own processors, which together manage the functionality of the set, constitutes the so-called control server system which comprises the central server (100) and the support server system (110, 310; 120, 320; 130, 330).
[0026] The support server system is preferably, in turn, formed by a local server communicating and cooperating with a further server called Repeater Server.
[0027] In the present description the local server is also defined as "Dashboard Server" and the central server can also be defined as "Master Server" (see for example in this respect figure 1E).
[0028] Preferably, the central server and the Repeater server reside in a "Cloud" system.
[0029] The "Cloud" system is well-known and for this reason it is not detailed further herein.
[0030] According to the scheme in figure 1A, a central server 100 (or Master Server) is depicted which acts as an intermediary between a receiving location, in the form of a store, and a "client" side, i.e. the person that wishes to access the service.
[0031] Therefore, the figure shows a central server 100 which communicates, on one side, with the support server system, each one associated with a predetermined music store and on the other side with the client side.
[0032] Therefore, the music store is equipped with a support server system made up of a local server (110, 120, 130) (or dashboard server) which communicates with a Repeater Server (310, 320, 330) and, as a whole, they form the support server system (110, 310) of the corresponding store.
[0033] On the opposite side, there are the "client" processors, i.e. the processing device (210, 220, 230) of the user which establishes a connection to the server system through them, and from the server to the specific store.
[0034] The number of local server systems and Client-side processing devices can obviously be any number and therefore figure 1A is not limiting.
[0035] In this way, in essence, a "purchaser" user can safely remotely connect to a specific store or business through the central server and manage a test on a musical instrument.
[0036] As shown in figure 1B, each local server (110, 120, 130), is communicating with a MIDI interface 115 which manages the audio data of one or more musical instruments.
[0037] Basically, the store is provided with a local server 110 connected to a MIDI interface 115.
[0038] More specifically, figure 1B describes the local server 110 which, through a MIDI interface 115 (for example an audio MIDI interface) manages the communication with one or more musical instruments (in the example of figure 1B keyboards T1...Tn).
[0039] As shown in figure 1B, a switch 116 may be provided that can be controlled remotely through said local server 110, as also indicated by the arrow in figure 1B (as indicated in figure 1B with at number 116). In this way, the local server can enable or disable, depending on the needs, the power supply to the musical instruments, thereby activating them only when required and therefore providing a remarkable energy saving.
[0040] Therefore, figure 1B shows the example of a store (indicated as STORE 1), being it understood that any number of stores and instruments per store can be managed and / or provided for with the same architecture described herein.
[0041] As explained below, when the local server 110 receives a request from a user for testing a specific instrument, it turns "ON" the power of the selected instrument, which through the MIDI interface communicates with the local server, and through the latter the user can remotely control and thus test the specific instrument.
[0042] Basically, therefore, the music store that the user wants to reach via the Internet comprises a local server and at least one MIDI interface that allows the flow of information between the local server and the musical instrument.
[0043] In this way, the user, as shown in the operating flow chart shown in figure 1C, selects a store and, through the repeater server thereof, accesses the local server to be able to select an instrument.
[0044] Advantageously, as shown in figure 1E, the store comprises, as mentioned, a Repeater Server communicating and cooperating with the local server.
[0045] The flow chart shows in fact the main steps, i.e.: 1) Starting the software application by the customer (client application) through their processing device, for example PC, tablet, mobile device and the like.
[0046] The software that manages the described method can obviously be in the form of an App for mobile devices as well as software installed or able to be installed on any PC, server system, etc. and in any case suitable to run on a normal computer device.
[0047] 2) This is followed by a connection to the central server that manages the operations;
[0048] The Master Server or central server (which preferably resides on cloud) is always listening to any requests for connection from the Clients. When the user runs the Client application, this one establishes a first connection to the Master Server 100 in order to obtain the list of stores. 3) Thanks to this connection, a list of stores registered with the service is displayed on the device through which the user is connected (for example a PC, a mobile device of any type such as a mobile telephone); 4) Once the list has been received, the user can select a store and start the connection to it; 5) This operation results first of all in the disconnection from the Master Server to then establish a connection to the local server of the store through the support server (as already mentioned, indicated below and in the drawings as Repeater Server); therefore, the client application can be connected either to the Master Server or to a Store Server through the repeater server. 6) Once the user is connected to the local server of the store, a list of instruments that can be remotely tested is displayed on the user's device, such as the PC, and the user can select the one they would like to test; 7) The selection of the instrument involves sending an order to the local server of the store which sets up a transfer of information, through the MIDI interface, between the instrument and the user. 8) The user's PC will display an image representing the selected type of instrument (such as synthesizer, Piano Digital Work Station, etc. as outlined in figure 1D), corresponding to the instrument and its functions, that they will be able to control. 9) Therefore, the user can test the instrument by playing it, for example by using the keyboard of their own PC and receiving the audio packages related to the sound generated by the instrument.
[0049] A special software is therefore provided which creates a graphical interface on the user's screen that simulates the instrument, for example a keyboard, in such a way that through the keys of their PC the user can control the instrument from their own workstation, playing it and activating its functions.
[0050] Therefore, a connection is established between the PC, or more generally the user's connecting device, and the musical instrument to be tested such that the latter can be controlled by said PC or connecting device in general.
[0051] Figure 1D shows a possible example of a screen displayed to the user in case they want to test for example a keyboard.
[0052] Therefore, the figure shows the function keys of the instrument keyboard that can be virtually activated through the PC keyboard and, in this manner, the user can actually play some music with the instrument.
[0053] Obviously, the system described does not allow the user to experience the feeling of the real key (for example its weight) but still allows the user to play the instrument live to verify sounds and personal impression.
[0054] Figure 1D shows further functions associated with the selected musical instrument, for example volume, battery, accompaniments that can be freely selected and tested.
[0055] Therefore, by describing the invention structure in greater detail, the overall architecture of the system is shown in figure 1E wherein it is evident that the repeater server of each store manages the communication between the PC on the "client" side and on the "store" side: the user who is thus connected to the dashboard server (local server of the store) can select and test an instrument through the local server.
[0056] Finally, still through the Repeater Server, the local server of the store communicates with the main server which has granted the service to it.
[0057] Thus, ultimately, according to the present architecture, the principal master server 100 establishes a connection to the client processing device in order to provide it with the electronic list of the available stores and other pertaining information.
[0058] Therefore, the client user can select a store from the list and request the connection to the store.
[0059] At this point, the client disconnects from the master server to establish the communication between the client side and the store through the repeater server and the local server.
[0060] The use of a repeater server and a local server is preferred for the following reasons, although a single server, such as the local one, could be used.
[0061] Specifically, the combined use of these two servers makes it possible to improve: 1) speed and simplicity of connection that the parties (store and client) must have. Everything is related to the problem of private and public IP addresses. Considering the worst-case scenario, a retailer accessing the Internet through a private IP address is not directly reachable by a client accessing the Internet with their own smartphone (another private IP address but it could also be public). In this case, in order to be directly reachable, the retailer will be compelled to ask their own provider for a public address.
[0062] Inserting a repeater (for forwarding information) between the store server and client ultimately resolves this issue because the repeater resides in the Internet, and it is equipped with public IP address and is then reachable by any device with a private IP address.
[0063] A store server could be readily connected to the Internet through a smartphone (private IP) which serves as a router (all the functioning tests for client and store have only been carried out through smartphones), or through a router provided with a conventional SIM. Ultimately, no modification of the router settings, no request for public IP address to one's own provider and immediacy of use of the service.
[0064] 2) The master server can as well act as a repeater, but in many occasions it would fall into an excessive workload and obviously a possible server failure (i.e. failure of the entire service) is to be avoided.
[0065] For this reason, the choice to distribute loads through repeaters is a non- essential but preferred solution. If a repeater gets blocked, then a single store is blocked, whereas all the other stores keep on working.
[0066] 3) In cases involving illicit behaviors (for example illegal distribution of the program) by the retailer, it is possible to disable the repeater in order to interrupt the service.
[0067] More specifically, the whole architecture comprises: A sw (Software) application installed on the customer's device; A hardware equipment available for each store providing a software installed on the PC of the store (dashboard server); Some network resources, among which a main master server and other network applications dedicated to the stores (Repeater Server); A Customer's software application according to the invention comprises for example the following functions: Enables the customer to access a database of the Master server and to see on screen the information related to all stores registered with the service. Makes it possible to obtain from each store an identification code which allows the connection to the MIDI interface of the instruments for the data exchange.
[0068] A SERVER-STORE equipment according to the invention is for example the one described in figure 2 and it is composed of: A PC-Server (2.1) equipped with double network interface card (one for a traditional router for accessing the Internet and one for a switch to be connected to one or more remote Ethernet multi-socket switches) and a port for the connection to the multi-channel audio MIDI interface.
[0069] A remote multi-socket switch (2.2) through which the musical instruments included in the service are powered. The power supply of each instrument can be automatically interrupted after completing the test with a time delay that can be set, in order to avoid sudden switching on and switching off and thereby reducing wear of instruments and energy consumption.
[0070] A multi-channel audio MIDI interface (2.3) to which the musical instruments inserted in the service to be played remotely are connected.
[0071] Some dedicated connectors according to requirements, switch and router.
[0072] The software for the service management is installed on the PC Server (2.1) by the store, this software can be characterized by one or more of the following functions: "Dashboard setting" function, which manages the acquisition of audio data from each instrument connected to the Audio / MIDI interface and the sending in the form of data packages to the Clients. "Uploading and creation of the instrument list" function, for creating the list of instruments and the association with each instrument of one's own audio channel and MIDI channel. Function for the publication of the list on the network platform. Function for access managing and monitoring, for displaying and processing access data statistics of each instrument (frequency, records, timing) for example as indicators of customer satisfaction. Function for modifying the instrument list after its publication, in order to take an instrument out of service and delete it from the list and replace it.
[0073] The network applications according to the invention are composed of, for example, an application dedicated to each store registered with the service, called "repeater" and a network server (Master Server) on which the program for managing the whole service resides and which makes information concerning all the stores accessible to the client users.
[0074] A repeater application is designed to forward any data traffic between the STORE SERVER and the Client, and send / receive data from and to the MASTER SERVER in order to manage the service. It can be installed in a V.P.S. (Virtual Private Server) provided by a provider with a public IP address and it allows several Customers to remotely access the store server at the same time without using other services dedicated to manage this communication.
[0075] Therefore, the repeater acts as a link between the Store Server and Client PC, thereby enabling providers of the Internet service to overcome obstacles due to the redirection of local IPs, N.A.T. (network address translate).
[0076] The MASTER SERVER communicates with a database in which all main information concerning all stores that have subscribed the agreement is registered.
[0077] When the store starts the service, the master server uploads into memory a list with the main information concerning each store: Name, logo, website, contact information of the store and opening hours of the store and the online service. IP address (in this case, the IP address of the Repeater). A status to indicate whether it is online or offline (a timed process, it scans all stores to update the availability status). The list of available instruments, together with the pictures, links to the webpage of the instrument in its store, and the MIDI mapping of each instrument.
[0078] The list of stores will then be sent to the clients at the time of their connection to the service.
[0079] Figure 1F shows the sequence of already described actions and communication flows between customer, Master server, support server (Repeater) and Store Server for a service functioning according to the invention.
[0080] Specifically, figure 1F represents the communications in the main steps of the service, i.e. the steps provided for the activation and the use of the service by the store, and the ones for the use of the service and the use of the instrument by the Customer. The steps described here are to be understood as exemplifying and non-limiting, in fact for example all the possible intermediate options enabled by the software, the options for managing multiple access, the modifying and monitoring functions, etc. as mentioned elsewhere, are not described.
[0081] In addition to the above, the software installed on the Customer device according to the invention (and shown as mentioned at point 1 in figure 1E) provides a further function which enables more Clients to remotely access the server at the same time even when the Clients that are connected to the store use the same router.
[0082] This is in practice achieved with an application modelled on the Repeater, replicated within the software installed on each Customer's device, making the Clients themselves (in this case the first that connects to the service) the active reference nodes of the communication with the store server and communication sorting points.
[0083] In detail, this further function of a system according to the invention works as follows: When a computer (computer 1) asks for a connection to the store server (i.e. to the repeater of the store on cloud), it also sends, through the application used for the connection, a request for verifying whether other computers are already connected to that store, if no confirmation is given, after a preset time, it is recognized as first customer (Active Client) and the communication is established without problems.
[0084] At the moment when a second computer asks for access to the store (computer 2), the active Client responds by notifying its presence. Then in this case the computer 2 can access as a PASSIVE CLIENT and the connection between the store and computer 2 will occur through the computer 1, in such a way that the store Repeater of that store can continue communicating only through the IP address already associated with computer 1. The maximum number of passive Clients can be set and limited in order not to increase the burden on the resources.
[0085] On the contrary, when each Customer is connected to a separate router, each Customer's computer accesses the store Repeater as an Active Client.
[0086] Preferably, in all the described configurations, the musical apparatus, preferably the electronic musical instrument, integrates the MIDI interface in itself.
Claims
1. A method for remotely testing musical apparatus, the method comprising the following steps: - Arranging a control server system (100, 110, 310); - Arranging one or more processing devices (210, 220, 230), each one associated with a user; - The control server system being able to communicate with one or more musical apparatuses (T1, T2, Tn); - Said control server system being programmed to connect a processing device (210, 220, 230) to one or more of said musical apparatuses; - The method comprising sending, from a processing device associated with the user, a request for communication with a selected musical apparatus, the control server system connecting the requesting processing device to the selected musical apparatus in such a way that said musical apparatus is controllable remotely by the user through said processing device; - wherein the processing device is equipped with a display screen, on which a graphic interface is displayed through which the musical apparatus is controllable remotely by playing it and receiving the sound emitted by the musical apparatus.
2. The method according to claim 1, wherein the arrangement of said control server system comprises arranging a central server system (100) and arranging one or more support server systems (110, 310; 120, 320; 130, 330), each one associated with a store having one or more of said musical apparatuses (T1, T2, Tn) and with said musical apparatuses being connected to the corresponding support server system; - Said central server system (100) being programmed to connect a processing device (210, 220, 230) to a support server system (110, 310; 120, 320; 130, 330); - The method comprising sending, from said processing device associated with the user to said central server system, a request for communication with a store, the central server system connecting the support server system associated with the selected store with the requesting processing device in such a way as to allow, between said processing device associated with the user and said support server system, an exchange of control signals and / or audio signals and with the said support server system connected with a specific musical apparatus after said selection done by the user of a specific musical apparatus belonging to said store.
3. The method according to claim 1 or 2, wherein the processing device is a PC.
4. The method according to one or more of the previous claims, wherein the arrangement of the support server system comprises arranging the local server associated with the store which is connected to an additional specific repeater server, the repeater server receiving the request for connection from the central server, which disconnects from the processing device requesting the connection in such a way that the repeater server establishes communication between the local server and the processing device.
5. The method according to one or more of the previous claims, wherein the local server connects to a MIDI interface for allowing the exchange of audio and / or video information between a musical apparatus and a processing device.
6. The method, according to one or more of the previous claims, wherein the musical apparatus is a musical instrument.
7. An assembly for remotely testing musical apparatus, the assembly comprising: - A control server system (100, 110, 310); - One or more processing devices (210, 220, 230) each one associated with a user; - The control server system being configured to communicate with one or more musical apparatuses (T1, T2, Tn) and with one or more of said processing devices; - Said control server system being programmed to connect a processing device (210, 220, 230) to one or more of said musical apparatuses after receiving a request for connection to one of said apparatuses sent from a processing device in such a way that, following said request, the control server system establishes a connection between the requesting processing device and a selected musical apparatus, in such a way that said musical apparatus is controllable remotely by the user through said processing device; - The assembly further generating a graphic interface through which said musical apparatus is controllable remotely, playing the musical apparatus in order to test the sound thereof and receiving the sound emitted by said musical apparatus.
8. The assembly according to claim 7, wherein said control server system comprises a central server system (100) and one or more support server systems (110, 310; 120, 320; 130, 330) each one associated with a store having one or more of said musical apparatuses (T1, T2, Tn) and with said musical apparatuses connected to the respective support server system.
9. The assembly according to claim 7 or 8, wherein said central server system (100) is programmed to connect a processing device (210, 220, 230) to a support server system (110, 310; 120, 320; 130, 330) in such a way that, after said input, the central server system connects the support server system associated with the selected store to the requesting processing device in such a way as to allow an exchange of control signals and / or audio signals between said processing device associated with the user and said support server system and with the support server system connected to a specific musical apparatus following said selection input from the user of a specific musical apparatus related to said store.
10. The assembly according to one or more of the previous claims from 7 to 9, wherein said support server system comprises a local server associated with the store connected to another specific repeater server in such a way that the repeater server receives a request for connection from the central server which disconnects from the processing device requesting the connection in such a way that the repeater server establishes a communication between the local server and the processing device.
11. The assembly according to one or more of the previous claims from 7 to 10, wherein a MIDI interface is provided for allowing the exchange of control signals and audio signals between the processing device and a specific musical apparatus.
12. The assembly according to one or more of the previous claims from 7 to 11, wherein the musical apparatus is a musical instrument.
Citation Information
Patent Citations
Real time communications of musical tone information
US20020085546A1
Musical-performance-information transmission method and musical-performance-information transmission system
US20160379514A1