A system for remotely testing musical instruments
A system for remote testing of musical instruments using a control server and MIDI interfaces addresses the inconvenience of physical visits, allowing virtual testing and expanding customer reach.
Patent Information
- Application Number
- JP2023574606
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-07-29
- Filing Date
- 2022-07-25
- Publication Date
- 2025-08-13
- Estimated Expiration
- 2042-07-25
AI Technical Summary
The need to physically visit a store to test musical instruments for sound and features is inconvenient, especially during closures or pandemics, limiting customer experience and retail sales.
A system allowing remote testing of musical instruments through a control server system, processing devices, and MIDI interfaces, enabling users to connect and control instruments via a graphical interface on their devices.
Enables virtual testing of instruments from anywhere, expanding store customer base and increasing product interest, while saving energy and avoiding physical presence.
Smart Images

Figure 0007723120000001 
Figure 0007723120000002 
Figure 0007723120000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to the technical field of sound reproduction and processing devices.
[0002] In particular, the present invention relates to an innovative system that allows remote interaction with devices equipped with a MIDI interface in order to test features of the device, for example musical instruments in general. [Background technology]
[0003] Although online stores for musical equipment are now available, purchasing an electronic musical instrument is known to necessitate a visit to the store to test the equipment.
[0004] In reality, people buying equipment will want to hear the sound and analyze the features available in the equipment, such as tonal variations, timbral changes, effects, etc., in order to at least make an initial choice, if not a final one.
[0005] Currently, this is not possible, but would be possible by physically being present at the location, which of course presents certain technical inconveniences.
[0006] Additionally, if the store is closed, you must wait until opening time to view and test the equipment.
[0007] Additionally, people are experiencing the effects of the COVID-19 pandemic, and for this reason retail sales have stopped and, obviously, it has become more difficult to test instruments in the field.
[0008] Patent publications US 2002 / 0085546 and US 2016 / 0379514 are further known. [Prior art documents] [Patent documents]
[0009] [Patent Document 1] US Patent Application Publication No. 2002 / 0085546 [Patent Document 2] US Patent Application Publication No. 2016 / 0379514 Summary of the Invention [Problem to be solved by the invention]
[0010] Therefore, there is a need for a technological solution that can overcome the limitations typically associated with the need to physically visit a store or "music shop."
[0011] Specifically, there is a need for a solution that allows instruments to be tested remotely, rather than physically visiting a store. [Means for solving the problem]
[0012] These and other objects are achieved by the inventive method for remotely testing musical devices, e.g. musical instruments, as set forth in claim 1.
[0013] The method comprises the following steps: - arranging a control server system (100, 110, 310); - arranging one or more processing devices (210, 220, 230), each one associated with a user; The control server system is capable of communicating with one or more music devices (T1, T2, Tn), the control server system is programmed to connect a processing device (210, 220, 230) to one or more of the music devices; The method includes transmitting a request for communication with a selected music device from a processing device associated with a user, wherein a control server system connects the requesting processing device to the selected music device, thereby enabling the music device to be remotely controllable by the user via the processing device.
[0014] According to the proposed solution, it is now possible for potential customers to virtually visit a store through an experience that is highly similar to the real thing.
[0015] Stores can choose from a wide range of geographically unrestricted areas, and stores can expand their customer base and increase interest in their products.
[0016] The method shown allows a user to connect to a control server system that actually effects the connection to selected equipment that may be located in any store.
[0017] With appropriate programming software, the described system can generate a video interface with a user processing device, allowing the user to control the equipment remotely, for example, using their own processing device keyboard.
[0018] The described architecture allows for the exchange of control and / or audio signals between a selected specific musical device and the processing device to which it is connected, for example via an appropriate MIDI interface, thereby allowing a user to play and therefore test the device remotely.
[0019] Thus, the result is the ability to actually test equipment remotely without the need to be physically present at the location.
[0020] The subject of the invention is also an assembly for remotely testing a musical device, preferably a musical instrument, comprising: a control server system (100, 110, 310); one or more processing devices (210, 220, 230), each one associated with a user; the control server system is capable of communicating with one or more music devices (T1, T2, Tn) and one or more of the processing devices; the control server system is programmed to connect the processing device (210, 220, 230) to one or more of the music devices after receiving a connection input to one of the music devices sent from a processing device, whereby, after the input, the control server system connects the requesting processing device to the selected music device; The assembly further generates a graphic interface on a display screen equipped with a processing device that requests connection to the music device, and by means of the graphic interface the music device can be remotely controlled, for example to play the music device to test its sound.
[0021] Further advantages can be inferred from the dependent claims.
[0022] Further features and advantages of the inventive system according to the invention will become apparent from the following description of embodiments of the invention, which are to be considered by way of example only and are not limiting, with reference to the accompanying drawings, in which: [Brief explanation of the drawings]
[0023] [Figure 1A] Explain the structure and communication flow of the service. [Figure 1B] Explain the structure and communication flow of the service. [Figure 1C] Explain the structure and communication flow of the service. [Figure 1D] Explain the structure and communication flow of the service. [Figure 1E] Explain the structure and communication flow of the service. [Figure 1F]The structure and communication flow of the service are described - in particular, Figure 1A describes the overall architecture, Figure 1B describes the structure associated with a single store provided with a local server, musical instruments (T1..Tn) with a MIDI interface 115, Figure 1C is a flowchart of the functional phases, Figure 1D shows screenshots that are displayed on the screen of a user connected to the store to test an instrument (in this example, a keyboard), Figure 1E is a further overall scheme, while Figure 1F shows details of the main communication flow. [Figure 2] It details the "hw" (hardware) and "sw" (software) devices of the store registered with the service. DETAILED DESCRIPTION OF THE INVENTION
[0024] Thus, according to the present invention, a possible embodiment of the system according to the present invention consists of a software architecture configured by an electronic platform, which also allows the exchange of audio and / or control signals for the MIDI interface of the equipment, in addition to the traditional information describing the equipment characteristics between potential customers and a set of retailers registered with the service.
[0025] This is made possible by an architecture that includes a control server system (100, 110, 310) that generates audio and / or video communication between a user (e.g., typically via a PC or personal computer) and an instrument that can be remotely controlled by the user.
[0026] More specifically, the architecture, which can be identified by the acronym ReSYP (Remote Synth Player), comprises four components that characterize its purpose: the customer, the store, the central server, and the support server system.
[0027] The set of server devices is suitably programmed and equipped with its own processor which jointly manages the functionality of the set, and the set of server devices constitutes a so-called control server system, comprising a central server (100) and supporting server systems (110, 310; 120, 320; 130, 330).
[0028] Preferably, the support server system is further formed by a local server communicating and cooperating with further servers, called repeater servers.
[0029] In the present description, the local server may also be defined as a "dashboard server," and the central server may also be defined as a "master server" (see, for example, FIG. 1E in this regard).
[0030] Preferably, the central server and the repeater servers reside in a "cloud" system.
[0031] Cloud "systems" are well known and for this reason will not be detailed further herein.
[0032] According to the scheme of FIG. 1A, a central server 100 (or master server) is shown that acts as an intermediary between a receiving location in the form of a store and the "client" side, ie those who wish to access the service.
[0033] Thus, in the figure, a central server 100 is shown, which communicates on the one hand with the support server systems, each one associated with a given music store, and on the other hand with the client side.
[0034] Thus, a music store is equipped with a support server system consisting of local servers (110, 120, 130) (or dashboard servers) communicating with repeater servers (310, 320, 330), which together form the support server system (110, 310) of the corresponding store.
[0035] On the other side are the "client" processors, i.e., the user's processing devices (210, 220, 230), which establish connections to the system via the server and from the server to their own stores.
[0036] The number of local server systems and client-side processing devices can obviously be any number, and thus FIG. 1A is not limiting.
[0037] In this way, essentially, a "buying" user can securely connect remotely via a central server to a particular store or merchant to manage the testing of the instrument.
[0038] As shown in FIG. 1B, each of the local servers (110, 120, 130) communicates with a MIDI interface 115 that manages audio data for one or more musical instruments.
[0039] Essentially, the store is provided with a local server 110 connected to a MIDI interface 115 .
[0040] More specifically, FIG. 1B illustrates a local server 110 that manages communication with one or more musical instruments (such as the example keyboards T1...Tn in FIG. 1B) via a MIDI interface 115 (e.g., an audio MIDI interface).
[0041] As shown in Figure 1B, a switch 116 may be provided that can be remotely controlled via the local server 110, also indicated by an arrow in Figure 1B (in Figure 1B, designated by the number 116). In this way, the local server can enable or disable power to the instrument as needed, thereby activating the instrument only when needed, thus resulting in significant energy savings.
[0042] Thus, while FIG. 1B illustrates an example of a store (designated as Store 1), it is understood that any number of stores and devices per store can be managed by and / or provided with the same architecture described herein.
[0043] As explained below, when the local server 110 receives a request from a user to test a particular instrument, the selected instrument is powered "on," through which the MIDI interface communicates with the local server, and through which the user can remotely control and thus test the particular instrument.
[0044] So basically, a music store that users wish to contact via the Internet is equipped with a local server and at least one MIDI interface that allows the flow of information between the local server and the musical instruments.
[0045] In this way, as shown in the operational flowchart in FIG. 1C, the user can select a store, access the local server via the repeater server, and select a device.
[0046] Advantageously, as shown in FIG. 1E, the store comprises a repeater server that communicates and cooperates with the local server as mentioned.
[0047] The flow chart actually shows the main steps:
[0048] 1) A customer (client application) starts a software application on its processing device, e.g., PC, tablet, mobile device, etc.
[0049] The software managing the described method may obviously be in the form of an app for a mobile device, and may also be software that is installed or can be installed on any PC, server system, etc., and in any case is suitable for running on a standard computing device.
[0050] 2) This is then connected to a central server that manages the operation.
[0051] A master server or central server (preferably residing in the cloud) always receives requests for any connection from clients. When a user launches a client application, this one establishes a first connection to the master server 100 to get a list of stores.
[0052] 3) With this connection, the list of stores registered with the service is displayed on the device to which the user is connected (for example, any type of mobile device, such as a PC, a mobile phone, etc.).
[0053] 4) Once the list is received, the user can select a store and initiate a connection to it.
[0054] 5) This action first results in a disconnection from the master server, and then establishes a connection to the store's local server via a support server (as already mentioned, shown below and in the drawings as a repeater server). Thus, a client application can connect to either the master server or the store server via the repeater server.
[0055] 6) Once the user is connected to the store's local server, a list of devices that can be remotely tested is displayed on the user's device, such as a PC, and the user can select the ones they want to test.
[0056] 7) Device selection involves sending a command to the store's local server via a MIDI interface to set up the transmission of information between the device and the user.
[0057] 8) The user's PC displays an image representing the selected instrument type (synthesizer, piano digital workstation, etc., as outlined in Figure 1D), which corresponds to the instrument and its functions that the user can control.
[0058] 9) Thus, a user can test the instrument by playing it, for example by using the keyboard of the user's own PC to receive an audio package associated with the sounds produced by the instrument.
[0059] Therefore, special software is provided that produces a graphical interface on the user's screen that simulates the device, for example a keyboard, with keys on the PC that allow the user to control the device from their own workstation, play the device and activate its functions.
[0060] Thus, a connection is established between a PC, or more generally a user's connected device, and the instrument to be tested, so that the instrument can generally be controlled by said PC or connected device.
[0061] FIG. 1D shows an example of a possible screen displayed to a user if the user wishes to test, for example, the keyboard.
[0062] Thus, the figure shows function keys of the device's keyboard that can be virtually activated by the PC keyboard, thus allowing the user to actually play some songs using the device.
[0063] Obviously, the described system does not allow the user to experience the feeling of a real key (e.g., its weight), but it still allows the user to play the instrument live to verify the sound and personal impression.
[0064] FIG. 1D further shows the features associated with the selected instrument, such as volume, percussion, and accompaniment, which can be freely selected and tested.
[0065] Therefore, by describing the structure of the present invention in more detail, the overall architecture of the system is shown in Figure 1E, and it is clear that the repeater server in each store manages the communication between the "client" PC and the "store" PC. As a result, users connected to the dashboard server (the store's local server) can select and test devices via the local server.
[0066] Finally, still via the repeater server, the store's local server communicates with the main server that is authorized to serve it.
[0067] As a result, ultimately, in accordance with the architecture of the present invention, the central master server 100 establishes a connection to the client processing device in order to provide the client processing device with an electronic list of available stores and other related information.
[0068] Thus, a client user can select a store from the list and request a connection to the store.
[0069] At this point, the client connection is disconnected from the master server and communication is established between the client and the store via the repeater server and the local server.
[0070] A single server, such as a local server, may be used, although the use of a repeater server and a local server is preferred for the reasons described below.
[0071] Specifically, using these two servers in combination will enable improvements to:
[0072] 1) The speed and simplicity of connection required by the parties involved (store and client). Everything is related to the issue of private and public IP addresses. Considering the worst case scenario, a retailer who accesses the Internet through a private IP address cannot be directly contacted by a client who accesses the Internet through their own smartphone (which has a different private IP address, but which may also be public). In this case, to be directly contactable, the retailer is forced to ask its own provider for a public address.
[0073] Adding a repeater between the store server and the client (to forward information) finally solves this problem, as the repeater resides on the Internet and has a public IP address, which can then be contacted by any device using a private IP address.
[0074] The store server can be easily connected to the Internet via a smartphone (private IP) acting as a router (all functional tests for clients and stores are performed solely by the smartphone) or via a conventional SIM-provided router. Finally, no modifications to the router configuration are required, no request for a public IP address from the provider for the router itself, and the service is immediately available.
[0075] 2) The master server can also act as a repeater, but on many occasions it will be under excessive workload, avoiding obviously possible server failure (i.e., total service failure).
[0076] For this reason, the option to distribute the load via repeaters is not required, but is the preferred solution: if a repeater is blocked, a single store is blocked while all of the other stores continue to operate.
[0077] 3) It will be possible to disable repeaters in order to suspend service in cases involving fraudulent behavior by retailers (e.g. illegal distribution of programs).
[0078] More specifically, the overall architecture is:
[0079] SW (software) applications installed on the customer's device,
[0080] The hardware equipment available to each store that provides the software installed on the store's (dashboard server) PC,
[0081] It includes a main master server and some network resources that are dedicated to store other network applications (repeat servers).
[0082] A customer software application according to the present invention may include, for example, the following functions:
[0083] -Allows the customer to access the master server database and view on screen information related to all stores registered with the service.
[0084] - making it possible to obtain from each store an identification code that allows connection to the MIDI interface of the device for data exchange;
[0085] A server store device according to the present invention is, for example, that illustrated in FIG. 2, and the server store device comprises:
[0086] A PC server (2.1) equipped with double network interface cards (one a conventional router for accessing the Internet, the other a switch connected to one or more remote Ethernet multi-socket switches) and a port for connecting to a multi-channel audio-MIDI interface.
[0087] A remote multi-socket switch (2.2) for powering the instruments included in the service. The power supply to each instrument can be automatically cut off after completion of a test with a configurable time delay, in order to reduce wear and energy consumption on the equipment by avoiding sudden switching on and off.
[0088] A multi-channel audio-MIDI interface (2.3) that connects instruments added to a service to be played remotely.
[0089] Several specialized connectors, switches and routers according to your requirements.
[0090] The software for managing the services is installed by the store on a PC server (2.1), and this software can be characterized by one or more of the following functions:
[0091] -"Dashboard Settings" function that manages the acquisition of audio data from each device connected to the audio / MIDI interface and the transmission of the data package to the client.
[0092] - "Upload and create device list" feature to create a list of devices and their association with their own audio and MIDI channels.
[0093] -Functionality for publishing listings on network platforms.
[0094] - Functionality for managing and monitoring access, for example to display and process access data statistics (frequency, records, timing) for each device as an indicator of customer satisfaction.
[0095] - Ability to modify the equipment list after it has been published in order to remove equipment from service, remove equipment from the list, and replace equipment.
[0096] A network application according to the present invention consists of, for example, an application dedicated to each store registered in the service called a "repeater," and a network server (master server) on which a program for managing all services resides and on which client users can access information about all stores.
[0097] The repeater application is designed to forward any data traffic between the store server and the clients, sending / receiving data to / from the master server to manage the service. The application can be installed on a VPS (Virtual Private Server) with a public IP address provided by the provider, allowing several customers to remotely access the store server at the same time without using other services dedicated to managing this communication.
[0098] Thus, the repeater acts as a link between the store server and the client PC, thereby allowing Internet service providers to overcome obstacles due to local IP, NAT (Network Address Translation) redirection.
[0099] The Master Server communicates with a database that contains all the key information about all stores that have approved subscriptions.
[0100] When a store starts service, the Master Server uploads to memory a list containing key information about each store:
[0101] -Store name, logo, website, contact information, store opening hours and online services.
[0102] -IP address (in this case, the IP address of the repeater).
[0103] - Status showing if online or offline (time process that scans all stores and updates availability status).
[0104] - A list of available devices, along with pictures, links to the device's webpage in the store, and the MIDI mapping for each device.
[0105] The list of stores is then sent to the client at the time of its connection to the service.
[0106] FIG. 1F illustrates the sequence of actions already described and the communication flow between the customer, master server, support server (repeater), and store server for service functions in accordance with the present invention.
[0107] Specifically, Figure 1F illustrates the communication in the main steps of the service: the steps provided for activation and use of the service by the store, and the steps for use of the service and device by the customer. The steps described here should be understood as exemplary and non-limiting. Indeed, for example, as noted elsewhere, not all possible intermediate options enabled by the software, options for managing multiple accesses, modifying and monitoring functions, etc., are described.
[0108] In addition to the above, the software installed on the customer device according to the present invention (shown as referred to in point 1 of FIG. 1E) provides further functionality, which allows more clients to remotely access the server at the same time, even when the clients connected to the store use the same router.
[0109] This is actually achieved with an application modeled as a repeater replicated within the software installed on each of the customer's devices, making the client itself (in this case the first client to connect to the service) the active reference node for communication with the store server and communication sorting point.
[0110] In detail, this further function of the system according to the invention works as follows.
[0111] - When a computer (Computer 1) requests a connection to the store server (i.e., a connection to the store's repeater on the cloud), it also sends a request via the application used for the connection to verify whether another computer is already connected to the store. If no confirmation is given, after a preset time, it is recognized as the first customer (active client) and communication is established without any problems.
[0112] When a second computer (Computer 2) seeks access to the store, the active client responds by announcing its presence. Computer 2 can then access the store as a passive client, and the connection between the store and Computer 2 occurs via Computer 1, allowing the store's store repeater to continue communication only via the IP address already associated with Computer 1, and setting a maximum number of passive clients to limit resource strain.
[0113] Instead, when each customer is connected to a separate router, each customer's computer accesses the store repeater as an active client.
[0114] Preferably, in all of the described configurations, the musical device, preferably an electronic musical instrument, integrates a MIDI interface itself.
Claims
1. 1. A method for remotely testing a musical device, said method comprising the steps of: Arranging a control server system (100, 110, 310); arranging one or more processing devices (210, 220, 230), each one associated with a user; the control server system is capable of communicating with one or more music devices (T1, T2, Tn); the control server system is programmed to connect a processing device (210, 220, 230) to one or more of the music devices; The method includes transmitting a request from a processing device associated with the user to communicate with a selected music device, wherein the control server system connects the requesting processing device to the selected music device such that the music device is remotely controllable by the user via the processing device; The control server system arrangement includes arranging a central server system (100) and one or more support server systems (110, 310; 120, 320; 130, 330), each one associated with a store having one or more of the music devices (T1, T2, Tn) and the music devices connected to the corresponding support server system; The central server system (100) is programmed to connect processing devices (210, 220, 230) to support server systems (110, 310; 120, 320; 130, 330); The method includes sending a request to communicate with a store from a processing device associated with the user to the central server system, the central server system connecting the support server system associated with the selected store with the requesting processing device, and enabling, after the selection by the user of a specific musical device belonging to the store, the exchange of control and / or audio signals between the processing device associated with the user and the selected specific musical device by the support server system connected to the specific musical device. method.
2. 2. The method of claim 1, wherein the processing device is a PC and is equipped with a display screen, on which a graphical interface is displayed, by means of which the musical device can be remotely controlled by playing the musical device and receiving sounds emitted by the musical device.
3. 3. The method of claim 1 or 2, wherein the support server system architecture includes a configuration of local servers associated with the store connected to an additional, specific repeater server, the repeater server receiving a request for connection from a central server, the central server disconnecting from the processing device requesting the connection, thereby allowing the repeater server to establish communication between the local server and the processing device.
4. 4. The method of claim 3, wherein the local server is connected to a MIDI interface for enabling the exchange of audio and / or video information between a music device and a processing device.
5. 1. An assembly for remotely testing a musical device, comprising: A control server system (100, 110, 310); one or more processing devices (210, 220, 230), each one associated with a user; a control server system capable of communicating with one or more music devices (T1, T2, Tn) and one or more of said processing devices; the control server system is programmed to connect a processing device (210, 220, 230) to one or more of the music devices after receiving a connection input to one of the devices sent from a processing device, whereby, following a request input, the control server system connects the requesting processing device to a selected music device; the assembly further generates a graphic interface by which the musical device can be remotely controlled to play the musical device to test the sound of the musical device; the control server system comprises a central server system (100) and one or more support server systems (110, 310; 120, 320; 130, 330), each one of the support server systems (110, 310; 120, 320; 130, 330) being associated with a store having one or more of the music devices (T1, T2, Tn) and with the music devices connected to the respective support server system; the central server system (100) is programmed to connect processing devices (210, 220, 230) to support server systems (110, 310; 120, 320; 130, 330), whereby, after said input, the central server system connects the support server system associated with the selected store to the requesting processing device, and, following a selection from the user of a specific musical device associated with the store, enables the exchange of control and / or audio signals between the processing device associated with the user and the selected musical device by the support server system connected to the specific musical device; assembly.
6. 6. The assembly of claim 5, wherein the support server system comprises a local server associated with the store connected to another specific repeater server, whereby the repeater server receives a request for a connection from the central server and the central server disconnects from the processing device requesting the connection, thereby causing the repeater server to establish communication between the local server and the processing device.
7. 7. An assembly according to claim 5 or 6, wherein a MIDI interface is provided to enable the exchange of the control and / or audio signals between the processing device and a specific musical device.
Citation Information
Patent Citations
System for distributing automatic piano playing data
JP2003131670A
Program for assisting in performing musical instrument in virtual space, computer-implemented method for assisting in selecting musical instrument, and information processor
JP2019101050A
Real time communications of musical tone information
US20020085546A1
Musical-performance-information transmission method and musical-performance-information transmission system
US20160379514A1
Performance sound generation method, performance sound generation device, and program
WO2024252919A1