Program and signal output device

Abstract

A signal output device according to one aspect comprises an information acquisition unit, a signal processing unit, and a signal output unit. The information acquisition unit has a configuration for acquiring identification information relating to sound processing from a medium recording the identification information. The signal processing unit performs, on a sound signal, signal processing based on the identification information. The signal output unit outputs the sound signal on which the signal processing has been performed.

Description

[Technical Field]

[0001] The present disclosure relates to a technique for outputting an audio signal. [Background technology]

[0002] An effector adds sound effects by performing signal processing on sound signals. Conventionally, signal processing has been realized by hardware such as electric circuits, but it can also be realized by software (for example, see Patent Document 1). Effectors realized by hardware have operating devices provided corresponding to multiple parameters used for predetermined types of sound effects. These operating devices allow the setting values of the parameters to be changed.

[0003] On the other hand, software-based effectors are implemented as a single function in, for example, a mobile device, tablet device, or personal computer. Therefore, by modifying the software or adding plug-ins, it is possible to support a wide variety of sound effects. Such effectors display a setting screen on a display and can accept various setting changes via an operating device, allowing for the control of many parameters and the addition of a wide variety of sound effects without the need for multiple operating devices. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Special Publication No. 2020-508495 Summary of the Invention [Problem to be solved by the invention]

[0005] Software effectors allow for a wide range of settings, which can require complex operations, and effectors implemented on mobile devices require the use of small touch panels, which can make them difficult to use.

[0006] One of the objects of the present disclosure is to improve the operability for setting parameters in a device that performs signal processing such as sound effects. [Means for solving the problem]

[0007] According to one embodiment, a program is provided for causing a computer to acquire identification information related to sound processing from a medium on which the identification information is recorded via an information acquisition unit, perform signal processing on a sound signal based on the identification information, and output the sound signal after the signal processing.

[0008] The information acquisition unit may include an imaging unit that generates an image of a predetermined imaging range, and acquiring the identification information may include extracting the identification information corresponding to the medium from the image generated by the imaging unit.

[0009] The method may further include displaying an identification image based on the identification information on a display unit.

[0010] The method may further include acquiring a sound signal from an external device. The performing of the signal processing may include performing the signal processing on the sound signal acquired from the external device.

[0011] The identification information may include information for specifying a type of parameter used in the signal processing. The signal processing based on the identification information may include processing using a parameter specified by the identification information.

[0012] The method may further include measuring a change in the position of the medium, and changing the setting values of the parameters used in the signal processing in response to the change in the position of the medium.

[0013] The method may further include measuring a change in orientation of the medium, and changing the setting values of the parameters used in the signal processing in response to the change in orientation of the medium.

[0014] The method may further include measuring a user's operation state with respect to the medium, and changing the setting values of the parameters used in the signal processing in accordance with the operation state.

[0015] The method may further include recording the parameter settings used in the signal processing on the medium.

[0016] The signal processing may include processing based on the setting values of the parameters read from the medium.

[0017] The method may further include acquiring a sound signal from a signal generating unit that generates a sound signal based on a sound generation instruction signal. The sound signal acquired from the signal generating unit may be subjected to the signal processing.

[0018] When first identification information is acquired from a first medium and second identification information is acquired from a second medium, the signal processing includes processing based on the first identification information, the second identification information, and the positional relationship between the first medium and the second medium.

[0019] When first identification information is acquired from a first medium, second identification information is acquired from a second medium, and related information associating the first medium with the second medium is acquired, the signal processing may include processing based on the first identification information, the second identification information, and the related information.

[0020] The signal processing may include processing according to a usage history relating to the identification information.

[0021] The information acquisition unit may include an imaging unit that generates an image of a predetermined imaging range. The identification information may include information for specifying a type of parameter used in the signal processing. The signal processing based on the identification information may include processing using a parameter specified by the identification information. The method may further include displaying an identification image corresponding to the medium on a display unit based on the identification information, extracting a predetermined pointing object from the image generated by the imaging unit and displaying an indication image on the display unit, and changing setting values of the parameters used in the signal processing based on a positional relationship between the identification image and the indication image.

[0022] According to one embodiment, there is provided a signal processing device including an information acquisition unit, a signal processing unit, and a signal output unit. The information acquisition unit is configured to acquire identification information related to sound processing from a medium on which the identification information is recorded. The signal processing unit performs signal processing on a sound signal based on the identification information. The signal output unit outputs the sound signal after signal processing.

[0023] The signal output unit may include a sound emitting unit that amplifies the sound signal output from the signal output unit and converts it into air vibrations.

[0024] The audio signal processing device may further include a signal acquisition unit for acquiring an audio signal from an external device, the signal processing unit performing signal processing on the audio signal acquired by the signal acquisition unit based on the identification information.

[0025] The sound generating device may further include a signal generating section that generates a sound signal based on a sound generation instruction signal, and the signal processing section may perform the signal processing on the sound signal generated by the signal generating section.

[0026] The information acquisition unit may include an imaging unit that generates an image within a predetermined imaging range. The identification information may include information for identifying a type of parameter used in the signal processing. The signal processing based on the identification information may include processing using a parameter identified by the identification information. The signal output device may include: a screen generation unit that displays an identification image corresponding to the medium on a display unit based on the identification information, extracts a predetermined pointing object from the image generated by the imaging unit, and displays an instruction image on the display unit; and a parameter setting unit that changes setting values of the parameters used in the signal processing based on a positional relationship between the identification image and the instruction image. [Effects of the Invention]

[0027] According to the present disclosure, it is possible to improve the operability for setting parameters in a device that performs signal processing such as sound effects. [Brief explanation of the drawings]

[0028] [Figure 1] FIG. 2 is a diagram for explaining a method of using the signal output device in the first embodiment. [Figure 2] FIG. 2 is a diagram for explaining the hardware configuration of the signal output device according to the first embodiment. [Figure 3] FIG. 3 is a diagram for explaining a setting table in the first embodiment. [Figure 4] FIG. 2 is a diagram illustrating the functional configuration of a signal output device according to the first embodiment. [Figure 5] FIG. 2 is a diagram for explaining the relationship between a setting screen and an effector card in the first embodiment. [Figure 6] FIG. 2 is a diagram for explaining the relationship between a setting screen and an effector card in the first embodiment. [Figure 7] FIG. 2 is a diagram for explaining the relationship between a setting screen and an effector card in the first embodiment. [Figure 8] FIG. 2 is a diagram for explaining a signal processing method in the first embodiment. [Figure 9] FIG. 4 is a diagram for explaining a setting update process in the first embodiment. [Figure 10] FIG. 4 is a diagram for explaining the detailed setting process in the first embodiment. [Figure 11] FIG. 10 is a diagram for explaining the relationship between a setting screen and an effector card in the second embodiment. [Figure 12] FIG. 11 is a diagram for explaining the relationship between a setting screen and an effector card in the third embodiment. [Figure 13] FIG. 13 is a diagram for explaining the relationship between a setting screen and an effector card in the fourth embodiment. [Figure 14] FIG. 10 is a diagram illustrating the functional configuration of a signal output device according to a fifth embodiment. [Figure 15] FIG. 20 is a diagram illustrating a setting change screen in the sixth embodiment. [Figure 16] FIG. 13 is a diagram for explaining a method of using a signal output device in the seventh embodiment. [Figure 17] FIG. 13 is a diagram illustrating the functional configuration of a signal output device according to an eighth embodiment. [Figure 18] FIG. 13 is a diagram for explaining a method of using a signal output device in the ninth embodiment. [Figure 19] FIG. 13 is a diagram illustrating the functional configuration of a signal output device according to a ninth embodiment. [Figure 20] FIG. 23 is a diagram for explaining a method of using a signal output device in a tenth embodiment. [Figure 21] FIG. 23 is a diagram for explaining a time management table in the tenth embodiment. [Figure 22] FIG. 23 is a diagram for explaining a time management method in the tenth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0029] An embodiment of the present disclosure will be described in detail below with reference to the drawings. The embodiments described below are merely examples, and the present disclosure should not be construed as being limited to these embodiments. In the drawings referred to in the following embodiments, identical parts or parts having similar functions are designated by the same or similar symbols (symbols consisting of a number followed by A, B, etc.), and repeated explanations may be omitted. For clarity of explanation, the drawings may be described schematically, with some components omitted from the drawings.

[0030] First Embodiment [overview] FIG. 1 is a diagram illustrating a method of using a signal output device in a first embodiment. In this example, the signal output device 1 is a smartphone. The signal output device 1 may be a tablet computer, a laptop computer, or a desktop computer. The signal output device 1 includes a display unit 15 for displaying an image in a display area DA, an imaging unit 19 for capturing an image of a predetermined imaging range, an interface 21 for connecting to an external device, and the like (see FIG. 2).

[0031] As shown in FIG. 1, the signal output device 1 is held by a holder 50. In this example, an optical unit 59 for expanding the imaging range of the imaging unit 19 is attached to the signal output device 1. The imaging range PA shown in FIG. 1 indicates the imaging range expanded by the optical unit 59. A musical instrument 70 such as an electric guitar and a speaker device 80 are connected to the interface 21 via a connector CN. The musical instrument 70 has a function of outputting a sound signal when played by a user. The musical instrument 70 may be a device that outputs a sound signal, such as a microphone. The speaker device 80 is a sound emitting device that converts a supplied sound signal into air vibrations and outputs the sound into space.

[0032] When a user plays the musical instrument 70, a sound signal output from the musical instrument 70 is output from the speaker device 80 via the signal output device 1. At this time, the signal output device 1 performs signal processing on the sound signal so as to process the sound in accordance with cards (three effector cards CR1, CR2, and CR3 in the example of FIG. 1), which are an example of media placed in the imaging range PA. In this example, the sound processing corresponds to adding a sound effect. In this example, each card includes a picture that resembles an effector and is made of paper. The cards may also be made of plastic, metal, wood, or the like.

[0033] The signal output device 1 determines sound effects from the pictures included on the effector cards CR1, CR2, and CR3, and displays images corresponding to these in the display area DA. The screen displayed in the display area DA in this manner is sometimes called a setting screen. The user can instruct the signal output device 1 to change the sound effect settings by moving the effector cards CR1, CR2, and CR3 or by manipulating them (such as by moving a finger near the card). At this time, the content of the setting screen is changed according to the sound effect settings. The configuration and operation of the signal output device 1 will be described in detail below.

[0034] [Configuration of signal output device] 2 is a diagram illustrating the hardware configuration of the signal output device according to the first embodiment. The signal output device 1 includes a control unit 11, a storage unit 13, a display unit 15, an operation unit 17, an imaging unit 19, an interface 21, and a communication unit 23. The signal output device 1 may also include other components such as a microphone, a speaker, a position detection sensor, an acceleration sensor, etc.

[0035] The control unit 11 includes a processor such as a CPU or DSP, RAM, and ROM. The control unit 11 performs processing according to instructions written in a program stored in the storage unit 13 by executing the program using the CPU. This program includes a program 131 for realizing a signal processing function, which will be described later. The signal processing function is a function for executing a signal processing method. The signals output from each element of the signal output device 1 are used by various functions realized in the signal output device 1.

[0036] The storage unit 13 includes a storage device such as a nonvolatile memory. The storage unit 13 stores a program 131 and a setting table 133. The program 131 may be executable by a computer, and may be provided to the signal output device 1 in a state where it is stored in a computer-readable recording medium such as a magnetic recording medium, an optical recording medium, a magneto-optical recording medium, or a semiconductor memory. In this case, the signal output device 1 may be provided with a device for reading the recording medium. The program 131 may be provided to the signal output device 1 by being downloaded via the communication unit 23. The setting table 133 may be loaded into the storage unit 13 when the program 131 is executed. The storage unit 13 is also an example of a recording medium.

[0037] The display unit 15 includes a display device such as a liquid crystal display. The display unit 15 displays various screens in the display area DA under the control of the control unit 11. The screens displayed include the setting screen described above.

[0038] In this example, the operation unit 17 includes an operation device such as a touch sensor arranged on the surface of the display area DA. The operation unit 17 accepts a user's operation and outputs a signal corresponding to the operation to the control unit 11. The operation unit 17 and the display unit 15 are combined to form a touch panel. By touching the operation unit 17 with a stylus pen or the user's finger, etc., commands or information corresponding to the user's operation are input to the signal output device 1. The operation unit 17 may also include an operation device such as a switch arranged on the housing of the signal output device 1.

[0039] The imaging unit 19 includes an imaging device such as an image sensor. The imaging unit 19 captures an image of the imaging range PA under the control of the control unit 11, and generates data showing an image corresponding to that range. The image may be a still image or a moving image.

[0040] The interface 21 includes a terminal for connecting an external device to the signal output device 1. The external device includes, for example, a musical instrument 70 such as the electric guitar described above, and a speaker device 80. In this example, the signal output device 1 transmits sound signals to the external device and receives sound signals from the external device via the interface 21. The interface 21 may also include a terminal for transmitting and receiving MIDI data. A connector CN may be used between the interface 21 and the external device to enable communication using various signals by making the connector compatible with various types of terminals.

[0041] The communication unit 23 includes a communication module for communicating various data with other devices connected via a network under the control of the control unit 11. The communication unit 23 may include a communication module for performing infrared communication, short-range wireless communication, etc. This completes the description of the hardware configuration of the signal output device 1.

[0042] 3 is a diagram illustrating the setting table in the first embodiment. The setting table 133 defines the correspondence between identification information, effects, and parameters. The identification information is information related to sound processing included in the card shown in FIG. 1, and in this example corresponds to feature information (Ia, Ib, Ic, ...) that can be extracted from the picture drawn on the effector card as described below.

[0043] The effect indicates the type of sound effect (Ea, Eb, Ec, ...). Examples of the type of sound effect include reverb, chorus, and distortion. The parameter indicates the type of parameter used in the sound effect, the setting value of which can be changed. According to the setting table 133, for the effect corresponding to Ea, the setting values of three types of parameters, Pa1, Pa2, and Pa3, can be changed. If the type of sound effect is chorus, examples of the type of parameter are output level (LEVEL), speed (SPEED), and depth (DEPTH). In this way, it can be said that the identification information includes information that specifies the type of sound effect and the type of parameter.

[0044] In this example, any type of sound effect includes at least a parameter corresponding to the output level, which may be simply referred to as the level in the following description.

[0045] [Configuration of signal processing function] Next, the signal processing function realized by the control unit 11 executing the program 131 will be described.

[0046] 4 is a diagram illustrating the functional configuration of the signal output device in the first embodiment. The signal processing function 100 includes an information extraction unit 101, a signal acquisition unit 103, a signal output unit 105, a parameter setting unit 111, a signal processing unit 113, and a screen generation unit 121. The configuration that realizes the signal processing function 100 is not limited to being realized by executing a program, and at least a part of the configuration may be realized by hardware.

[0047] The information extraction unit 101 extracts feature information corresponding to the identification information defined in the setting table 133 from the information acquired by the information acquisition unit 190. In this example, the information acquisition unit 190 includes the imaging unit 19. Therefore, the information acquired by the information acquisition unit 190 corresponds to an image acquired corresponding to the imaging range PA (hereinafter, sometimes referred to as an acquired image). It can also be said that the information acquisition unit 190 has a configuration (here, the imaging unit 19) for acquiring the identification information from an effector card on which the identification information is recorded. The information extraction unit 101 analyzes the acquired image, and if it is able to extract predetermined feature information from the acquired image, it also identifies the position in the imaging range PA from which the feature information was extracted (hereinafter, sometimes referred to as an extraction position).

[0048] The characteristic information is information for identifying the effector card, and specifically, information indicating the characteristics of the picture included on the effector card. More specifically, the characteristic information corresponds to information such as the outline, color, and pattern of the picture. The pattern may be a two-dimensional code. The characteristic information based on color may be treated as the same even if there is a difference within a predetermined range, taking into account fading over time, or may be treated as different before and after the change due to fading. The characteristic information may be any information obtained from the effector card by imaging, and may also be the outer shape of the card.

[0049] When the information extraction unit 101 extracts multiple pieces of feature information, it identifies multiple extraction positions corresponding to each piece of feature information. For example, as shown in FIG. 1, when three effector cards CR1, CR2, and CR3 are present in the imaging range PA, three pieces of feature information are extracted. The information extraction unit 101 associates the corresponding extraction positions with the three pieces of feature information and outputs them to the parameter setting unit 111. The information extraction unit 101 further analyzes the acquired image to detect the person's fingers. The positions of the person's fingers (for example, the position of the tip of each finger) are output to the parameter setting unit 111. The finger positions detected in this way may be referred to as finger detection positions.

[0050] The signal acquisition unit 103 acquires a sound signal from the musical instrument 70 connected to the interface 21 and supplies the signal to the signal processing unit 113 .

[0051] The signal processing unit 113 performs signal processing on the sound signal supplied from the signal acquisition unit 103 to add an acoustic effect according to the parameter setting values, and supplies the signal to the signal output unit 105. The types and setting values of parameters related to the signal processing in the signal processing unit 113 are set by the parameter setting unit 111 based on the identification information.

[0052] The signal output unit 105 outputs the sound signal supplied from the signal processing unit 113 to the speaker device 80 connected to the interface 21 .

[0053] The parameter setting unit 111 sets parameters for signal processing in the signal processing unit 113 based on the feature information and extraction position provided by the information extraction unit 101. At the time of initial setting, the parameter setting unit 111 refers to the setting table 133 to identify the type of effect and the type of parameter corresponding to the feature information, and sets them in the signal processing unit 113. The value (initial value) initially set for each parameter may be specified in the setting table, may be included in the feature information, or may be determined in advance.

[0054] Thereafter, when the extraction position changes, the parameter setting unit 111 changes the setting value of each parameter in accordance with the change in extraction position. That is, the change in the position of the effector card is measured, and the setting value of the parameter is changed in accordance with the change in position.

[0055] The parameter setting unit 111 further changes the setting value of each parameter based on the relationship between the finger detection position and the extracted position provided by the information extraction unit 101. That is, the user's operation state on the effector card is measured, and the setting value of the parameter is changed according to the operation state. The parameter setting unit 111 may change the setting value of each parameter based on a user instruction input via the operation unit 17. The processing executed by the parameter setting unit 111 will be described in detail later.

[0056] In this example, the parameter setting unit 111 outputs an instruction to the screen generation unit 121 to display a setting screen (for example, FIGS. 5 to 7) in the display area DA. The setting screen includes an image corresponding to the content of the signal processing. The setting screen includes, for example, an image indicating the type of sound effect, and in this example, further includes an image indicating the setting value of at least one parameter.

[0057] The screen generation unit 121 generates a setting screen to be displayed in the display area DA based on an instruction from the parameter setting unit 111. The screen displayed in the display area DA may include screens other than the setting screen. This completes the description of the signal processing function 100.

[0058] [Example of settings screen] 5 to 7, the relationship between the setting screen displayed in the display area DA and the effector cards CR1, CR2, and CR3 in the imaging range PA, and an example of the transition of the setting screen will be described. The transition of the setting screen described here is realized by processing in the signal processing function 100.

[0059] 5 to 7 are diagrams illustrating the relationship between the setting screen and the effector cards in the first embodiment. The display area DA and the image capture area PA in FIGS. 5 to 7 correspond to the display area DA and the image capture area PA shown in FIG. 1. Effector cards CR1, CR2, and CR3 are arranged in the image capture area PA. As described above, the effector cards CR1, CR2, and CR3 each include a picture that represents a type of sound effect. For example, the effector card CR1 includes a picture that represents an effector device that adds the sound effect "COMP." "COMP" corresponds to the compressor sound effect, for example.

[0060] The setting screen displayed in the display area DA includes effector images CG1, CG2, and CG3, level meters LM1, LM2, and LM3, and a menu area MA. The effector images CG1, CG2, and CG3 are examples of identification images that identify the types of sound effects corresponding to the effector cards CR1, CR2, and CR3, respectively. In this example, the identification images are images that correspond to the pictures drawn on the effector cards and include images that resemble the effectors that add the sound effects. In the following description, the types of sound effects corresponding to the effector images CG1, CG2, and CG3 displayed in this manner may be referred to as setting effectors SE1, SE2, and SE3, respectively.

[0061] The level meters LM1, LM2, and LM3 are displayed at positions (above in this example) corresponding to the effector images CG1, CG2, and CG3, respectively. The level meters LM1, LM2, and LM3 are images corresponding to the values (hereinafter sometimes referred to as level setting values) set as the levels of the corresponding setting effectors SE1, SE2, and SE3, respectively.

[0062] The menu area MA includes operation button images for inputting various operations to the signal output device 1. In this example, a user operates the operation button images B1 and B2 to input instructions to the signal output device 1. The input instructions include, for example, an instruction to determine an initial state and an instruction to terminate signal processing. The menu area MA may also include information about each of the setting effectors SE1, SE2, and SE3. Such information may include, for example, setting values of multiple parameters used in each of the setting effectors SE1, SE2, and SE3, a description of the sound effect applied by the effector, and the like.

[0063] Before reaching the display shown in Fig. 5, the menu area MA is displayed in the display area DA, and the effector images CG1, CG2, CG3 and the level meters LM1, LM2, LM3 are not displayed. When the user places the effector cards CR1, CR2, CR3 in the imaging range PA and inputs an instruction to determine the initial state, the effector images CG1, CG2, CG3 and the level meters LM1, LM2, LM3 are displayed in the display area DA, as shown in Fig. 5. Each of the level meters LM1, LM2, LM3 includes multiple scale areas, and the number of scale areas that correspond to the level setting value illuminates. The order in which the effector images CG1, CG2, CG3 are displayed corresponds to the order in which the effector cards CR1, CR2, CR3 are arranged in the imaging range PA.

[0064] In the example shown in FIG. 5, all scale areas are off on the level meters LM1, LM2, and LM3. This state indicates that the set effectors SE1, SE2, and SE3 are off. The set effectors SE1, SE2, and SE3 are turned on and off by the user performing a predetermined first operation on the effector cards CR1, CR2, and CR3, respectively. In this example, the first operation is a single tap with a finger. For example, when the user taps the effector card CR1 once with a finger, the set effector SE1 is turned on. When the set effector SE1 is on, the number of scale areas on the level meter LM1 corresponding to the level setting value is lit. In the initial stage, the number of scale areas corresponding to the initial setting value (for example, one) is lit.

[0065] As shown in Figure 6, when effector card CR1 is moved upward from initial position P1, the level setting value of set effector SE1 increases in conjunction with the change in position. When effector card CR2 is moved upward from initial position P2, the level setting value of set effector SE2 increases in conjunction with the change in position. When set effectors SE1 and SE2 are on, the level meters LM1 and LM2 light up with the number of scale areas corresponding to their respective level setting values. In the example shown in Figure 6, effector card CR2 has moved upward a greater distance than effector card CR1, so set effector SE2 is controlled to have a larger level setting value than set effector SE1.

[0066] Here, when the set effector SE1 is turned off by tapping the effector card CR1 once, all the scale areas of the level meter LM1 go out, but the level setting value at that time is maintained. Therefore, when the set effector SE1 is turned on by tapping the effector card CR1 once thereafter, the scale areas of the level meter LM1 light up as shown in Figure 6.

[0067] Changing the setting values of parameters other than the level of the setting effectors SE1, SE2, and SE3 is achieved by the user performing a predetermined second operation on the effector cards CR1, CR2, and CR3, respectively. In this example, the second operation is a double-tap operation with a finger. As shown in FIG. 7, when the user double-taps the effector card CR1 with a finger, an enlarged effector image CG1a for changing the setting value of a parameter other than the level of the setting effector SE1, for example, the "tone" parameter, is displayed in the display area DA. At this time, the content displayed in the menu area MA may be changed to include, for example, a detailed explanation related to the setting effector SE1.

[0068] The enlarged effector image CG1a includes a knob image N1 indicating a level setting value and a knob image N2 indicating a setting value corresponding to "tone" (hereinafter, sometimes referred to as a tone setting value). The knob image N1 is displayed to indicate the current level setting value.

[0069] In an area SA of the imaging range PA that overlaps with at least a portion of the effector card CR1, the finger FG is rotated as if pinching a knob, and the movement of the finger FG is measured as the user's operation of the effector card CR1. The finger FG can also be considered an indicator for the knob included in the effector card CR. The parameter setting value is changed depending on the operation state. In this example, the tone setting value is changed depending on the amount of rotation. The area SA may be set based on the outer edge of the effector card CR1 or a picture drawn on the effector card CR1. At this time, an image resembling a finger or an image of a finger extracted from the acquired image may be displayed superimposed on the enlarged effector image CG1a at a position corresponding to the finger detection position in the display area DA as an image (instruction image) instructing the user to operate the knob.

[0070] When the tone setting value is changed, the knob image N2 rotates to indicate a position corresponding to the tone setting value. As shown in Fig. 7, when the finger FG is moved so as to rotate clockwise, the knob image N2 in the enlarged effector image CG1a rotates in conjunction with the finger FG. In Fig. 7, the finger FG is shown turning the knob on the effector card CR1, but this knob does not actually rotate because it is part of the picture drawn on the effector card CR1.

[0071] When the user taps the effector card CR1 twice with his / her finger while the enlarged effector image CG1a is displayed in the display area DA, the setting screen returns to the image shown in Fig. 6. By playing the musical instrument 70, the signal output device 1 adds sound effects according to the setting values of each parameter to the sound signal output from the musical instrument 70 and outputs the sound signal to the speaker device 80.

[0072] The order in which sound effects are applied to a sound signal is determined based on the relative positions of multiple effector cards, and is specified, for example, by the order in which the effector cards are arranged in a predetermined direction in the image capture area PA. In this example, the order in which sound effects are applied is specified starting with the setting effector corresponding to the effector card arranged on the left. Therefore, the sound effect corresponding to setting effector SE1 is applied to the sound signal, followed by the sound effect corresponding to setting effector SE2, and finally the sound effect corresponding to setting effector SE3. In the example shown in FIG. 6, since setting effector SE3 is off, the sound effect corresponding to setting effector SE3 is not actually applied to the sound signal. This concludes the description of the display example of the setting screen.

[0073] [Signal processing method] Next, a description will be given of the above-mentioned screen transition processing and the signal processing method (signal processing method) realized in the signal processing function 100. The signal processing method described here starts when the program 131 is executed.

[0074] 8 is a diagram for explaining the signal processing method in the first embodiment. First, the control unit 11 waits until an instruction to determine an initial state is input by the user (step S101; No). When the instruction to determine the initial state is input (step S101; Yes), the control unit 11 acquires identification information and an initial position from the acquired image (step S103).

[0075] Specifically, the control unit 11 analyzes the captured image obtained by the imaging unit 19 and extracts feature information defined in the setting table 133 from the captured image to obtain identification information. As described above, the feature information is included in the effector card. Therefore, by obtaining the identification information, the control unit 11 can recognize that an effector card is present in the imaging range PA. Furthermore, the control unit 11 can identify the type of sound effect corresponding to the identification information by referring to the setting table 133. Taking the situations shown in FIGS. 5 to 7 as an example, the type of sound effect corresponding to the identification information is identified as the type corresponding to the set effectors SE1, SE2, and SE3. The control unit 11 further identifies extraction positions corresponding to the feature information from the captured image and obtains each extraction position as an initial position.

[0076] Next, the control unit 11 refers to the setting table 133 and sets parameters to be used in signal processing for adding the identified sound effect to the sound signal (step S105), and starts signal processing on the input sound signal (step S111). That is, the signal output device 1 adds the sound effect to the input sound signal and outputs it until the signal processing is completed. The setting values of the parameters at this time are predetermined initial values.

[0077] The control unit 11 executes a setting update process (step S200), and when the setting update process is completed, ends the signal processing on the input sound signal (step S113), and ends the execution of the signal processing method shown in Fig. 8. Next, the setting update process (step S200) will be described.

[0078] FIG. 9 is a diagram for explaining the setting update process in the first embodiment. In parallel with the setting update process, the control unit 11 executes a process for identifying the extraction position (i.e., a process for identifying the position of the effector card) and a process for detecting the user's finger. In the setting update process, the control unit 11 waits until the extraction position is changed, a first instruction is input, a second instruction is input, or an instruction to end signal processing is input (step S201; No, step S211; No, step S221; No, step S231; No). In the following description, this state will be referred to as an instruction waiting state. The first instruction corresponds to the first operation (tapping the effector card once with a finger). The second instruction corresponds to the second operation (tapping the effector card twice with a finger). Both the first operation and the second operation are detected based on the finger detection position.

[0079] When an instruction to end signal processing is input in the instruction waiting state (step S231; Yes), the control unit 11 ends the setting update processing.

[0080] When the control unit 11 detects that the extraction position has changed during the instruction standby state based on the measurement result of the change in the position of the effector card (step S201; Yes), it changes the level setting value of the object corresponding to the extraction position in accordance with the extraction position (step S203). The object corresponding to the extraction position refers to the set effector identified from the feature information associated with the extraction position. For example, as shown in FIG. 6, when the effector card CR1 is moved upward from the initial position P1, the control unit 11 detects that the extraction position corresponding to the set effector SE1 has moved upward, and changes the level setting value in accordance with the distance from the initial position to the extraction position. At this time, the level setting value is changed in conjunction with the movement of the extraction position. Therefore, the number of illuminated scale areas on the level meter LM1 increases in accordance with the upward movement of the effector card CR1.

[0081] When the control unit 11 detects that a first instruction has been input in the instruction standby state based on the measurement result of the user's operation state (step S211; Yes), it switches the target to which the first instruction has been input between on and off (step S213). The target to which the first instruction has been input is the set effector corresponding to the effector card on which one tap (first operation) has been made. For example, if one tap has been made on the effector card CR1, the target to which the first instruction has been input corresponds to the set effector SE1.

[0082] When the control unit 11 detects, based on the measurement result of the user's operation state, that a second instruction has been input in the instruction waiting state (step S221; Yes), it executes the detailed setting process (step S300).

[0083] 10 is a diagram for explaining the detailed setting process in the first embodiment. The control unit 11 displays an enlarged effector image in the display area DA for the target to which the second instruction has been input (step S301). The target to which the second instruction has been input is the setting effector corresponding to the effector card to which two taps (second operation) have been made. For example, if two taps have been made on the effector card CR1, the target to which the first instruction has been input corresponds to the setting effector SE1. As a result, an enlarged effector image CG1a as shown in FIG. 7 is displayed in the display area DA.

[0084] The control unit 11 waits until a setting change instruction is input or an instruction to end the detailed setting is input (step S303; No, step S307; No).

[0085] When the control unit 11 detects that a setting change instruction has been input based on the measurement result of the user's operation state (step S303; Yes), it changes the value of the target parameter (step S305). The setting change instruction is input to the signal output device 1 by moving a finger as if turning a knob in a predetermined area (area SA in the example shown in FIG. 7) superimposed on the effector card to which the second instruction has been input. When the parameter value is changed, a change occurs, such as the knob of the enlarged effect image rotating in the display area DA, as exemplified in FIG. 7.

[0086] The target parameter is at least one of the parameters that can be changed in the setting effector displayed as an enlarged effect image. As for the level, the setting value can be changed by moving the effector card, so the target parameter may be a parameter other than the level.

[0087] When a setting effector for which multiple parameters can be changed is the target of the detailed setting process, the following process is exemplified. The control unit 11 may change the type of the target parameter when detecting a predetermined operation on the effector card (such as tapping with two fingers). The control unit 11 may determine the type of the target parameter based on the relationship between the position of the picture drawn on the effector card and the position when the fingers are moved. For example, when multiple knobs are drawn on the effector card, the parameter corresponding to the knob closest to the fingertip may be determined to be the target parameter.

[0088] When an instruction to end the detailed settings is input (step S307; Yes), the control unit 11 ends the detailed settings process and returns to the instruction waiting state described in Fig. 9. The instruction to end the detailed settings may be input by operating the operation button image displayed in the menu area MA, or may be input by a predetermined operation on the target effector card (for example, a double tap operation).

[0089] By using the above-described signal processing method, the operations described in FIGS. 5 to 7 can be realized. That is, the user can set the sound effect to be added to the sound signal by placing an effector card in the imaging range PA. Furthermore, the user can change the parameter values related to the sound effect by moving the effector card or operating the effector card. Therefore, the user can set the sound effect using a medium such as a card, with almost no operation on the operation unit 17 of the signal output device 1.

[0090] If the area that the user can operate, such as a touch panel provided on the signal output device 1, is small, it is difficult to operate when making various settings, and there are cases where the signal output device 1 cannot be placed close to the user while playing an instrument. Even in such cases, the signal output device 1 can substantially expand the operation range by allowing a medium such as a card to be operated, and can provide the user with an intuitively easy-to-understand parameter setting environment even while playing.

[0091] Second Embodiment In the first embodiment, an example was described in which the parameter value (level setting value in the first embodiment) was changed by moving the effector card up and down in the imaging range PA. The method of moving the effector card in the imaging range PA is not limited to up and down movement, and it may be movement in various directions such as left and right, diagonal, etc. The effector card may be moved by rotation. In other words, various movement methods are included as long as they result in a change from the initial position. In the second embodiment, an example will be described in which the parameter value is changed by movement by rotation.

[0092] FIG. 11 is a diagram for explaining the relationship between the setting screen and the effector card in the second embodiment. In the second embodiment, as shown in FIG. 11, the level setting value is changed by rotating the effector card in the image capture range PA. In this case, the information extraction unit 101 simply identifies information related to the rotation of the effector card from the acquired image. The information related to the rotation may be information indicating the orientation of the card, such as the direction of rotation and the amount of rotation. In this way, the change in the orientation of the effector card is measured, and the parameter setting value is changed according to the change in orientation.

[0093] 11, the rotation amount of the effector card CR2 from the initial position P2 is larger than the rotation amount of the effector card CR1 from the initial position P1. As a result, the level meter LM2 has a larger number of illuminated scale areas than the level meter LM1.

[0094] The first and second embodiments can also be used together. For example, as in the first embodiment, the level setting value is changed for the vertical movement of the effector card. On the other hand, for the rotational direction of the effector card, the setting value of a parameter different from the level may be changed. Similarly, the setting value of yet another parameter may be changed for the horizontal movement of the effector card.

[0095] <Third embodiment> The types of parameters related to sound effects may be added by placing or attaching a medium for adding a function to the effector card. The medium other than the effector card may be, for example, a card, a coin, a sticker, etc. The types of parameters related to sound effects may be added by using these media. In the third embodiment, a function-adding sticker attached to the effector card will be described as the medium for adding a function.

[0096] Fig. 12 is a diagram for explaining the relationship between the setting screen and effector cards in the third embodiment. Fig. 12 shows an example in which a sticker SL1 is attached to an effector card CR1 and a sticker SL2 is attached to an effector card CR2. Sticker SL1 includes a picture that resembles a knob. Sticker SL2 includes a picture that resembles a slider. Stickers SL1 and SL2 are examples of the above-mentioned function-adding stickers.

[0097] The information extraction unit 101 extracts feature information of stickers SL1 and SL2 from the acquired image and also identifies the corresponding extraction positions. This identifies the positions of stickers SL1 and SL2 in the imaging range PA. From the positional relationship between stickers SL1 and SL2 and effector cards CR1 and CR2, the parameter setting unit 111 identifies that sticker SL1 is affixed to effector card CR1 and that sticker SL2 is affixed to effector card CR2.

[0098] In this example, effector images CG1b and CG2b are displayed in the display area DA instead of the effector images CG1 and CG2 in the first embodiment. Effector image CG1b is an image to which an image corresponding to the picture of sticker SL1 (a knob in this example) is added based on the feature information of sticker SL1. Effector image CG2b is an image to which an image corresponding to the picture of sticker SL2 (a slider in this example) is added based on the feature information of sticker SL2.

[0099] For example, by attaching sticker SL1 to effector card CR1, "attack" is added to "level" and "tone" as a type of changeable parameter for the sound effect "compressor." In other words, when sticker SL1 is attached to effector card CR1 for "compressor," it adds to setting effector SE1 a function that enables the setting value of the parameter "attack" to be changed.

[0100] The types of parameters that can be changed vary depending on the type of sound effect in question. For example, when sticker SL1 is attached to effector card CR2, it adds to setting effector SE2 a function that allows the setting values of predetermined parameters related to the sound effect "reverb." When sticker SL2 is attached to effector card CR1, for example, the setting value of the parameter "ratio" for the sound effect "compressor" can be changed. The types of parameters that are added depending on the type of sticker and the type of sound effect may be specified, for example, in setting table 133.

[0101] Changing the setting value of the parameter added by the sticker may be achieved by a method similar to the detailed setting process described in the first embodiment, or by a method similar to that of the second embodiment. Furthermore, the setting value may be determined based on the orientation when the sticker is attached to the effector card. In this case, the information extraction unit 101 extracts the angle between a predetermined reference orientation of the effector card and a predetermined reference orientation of the sticker as the attachment angle and provides it to the parameter setting unit 111. The parameter setting unit 111 determines the setting value based on the attachment angle. In this case, the angle when the sticker is first detected may be set as the initial angle, and the change from the initial angle may be measured, and the setting value may be determined based on the amount of change.

[0102] The set value may be determined according to the position of the sticker on the effector card. In this case, the information extraction unit 101 extracts the position of the sticker relative to the effector card and provides it to the parameter setting unit 111. The parameter setting unit 111 determines the set value according to that position. At this time, the position when the sticker is first detected may be set as the initial position, and the change from the initial position may be measured, and the set value may be determined according to the amount of change.

[0103] Here, stickers are used as media for adding functions, but cards, coins, and other media can also be used instead. Stickers are adhesive media, while cards and coins are non-adhesive media. When adhesive media is used, it becomes easier to move the effector card while maintaining its positional relationship with the effector card. On the other hand, when non-adhesive media is used, it becomes easier to change the orientation relative to the effector card.

[0104] <Fourth embodiment> The order in which sound effects corresponding to a plurality of set effectors are applied is not limited to being determined by the order in which the effector cards are arranged in a predetermined orientation in the image capture range PA. For example, the order in which the sound effects are applied may be determined by placing the effector cards on a writable medium such as paper or a whiteboard, and by information written on the medium. In the fourth embodiment, an example will be described in which the information written on the medium includes lines.

[0105] Fig. 13 is a diagram for explaining the relationship between the setting screen and effector cards in the fourth embodiment. Fig. 13 shows an example in which effector cards CR1, CR2, and CR3 are arranged on a whiteboard WB. Information for setting the order in which sound effects are applied is drawn on the whiteboard WB with a pen or the like.

[0106] In the example shown in FIG. 13, character information D1 corresponding to an input terminal, character information D2 corresponding to an output terminal, and connection line information L1, L2, L3, and L4 are drawn on the whiteboard WB. The connection line information L1 is information that connects and associates the character information D1 with the effector card CR2. The connection line information L2 is information that connects and associates the effector card CR2 with the effector card CR1. The connection line information L3 is information that connects and associates the effector card CR1 with the effector card CR3. The connection line information L4 is information that connects and associates the effector card CR3 with the character information D2. The character information D1 and D2 may be media such as cards or stickers. The connection line information L1, L2, L3, and L4 may be media such as thread or string, and may be in any form as long as it functions as association information that associates multiple effector cards.

[0107] For example, when a specific instruction, such as an instruction to determine an initial state, is input, the information extraction unit 101 extracts information drawn on the whiteboard WB in the imaging range PA. Specifically, the information extraction unit 101 extracts character information D1, character information D2, connection line information L1, L2, L3, L4, and the positions of effector cards CR1, CR2, CR3 (respective feature information), and provides them to the parameter setting unit 111. The parameter setting unit 111 specifies the arrangement order of the effector cards on this path from D1 (input terminal) to D2 (output terminal). In the example shown in FIG. 13, the arrangement order of the effector cards on this path is specified to be CR2, CR1, CR3.

[0108] As a result, the effector images CG2, CG1, and CG3 are arranged in order from the left in the display area DA. At this time, an arrow AR indicating the order may be displayed as shown in Fig. 13. The order of the set effectors that add sound effects to the sound signal is the same as the order of the effector images: SE2, SE1, and SE3.

[0109] As shown in the first embodiment, when an effector card is moved up or down to change the level setting value, for example, when the effector card CR1 is moved, the effector card CR1 will be separated from the connection line information L2 and L3. Even in this case, the specified order will be maintained as it is until the above-mentioned specific instruction is input again.

[0110] In this way, by using related information such as connection line information, it is possible to intuitively set the order in which sound effects are applied to sound signals (the order in which the set effectors are arranged).

[0111] Fifth Embodiment The signal output device 1 is not limited to performing signal processing on a sound signal supplied from an external device. In the fifth embodiment, a signal output device 1A will be described that generates a sound signal based on a sound generation instruction from an external device, adds sound effects to the generated sound signal, and outputs the sound signal.

[0112] 14 is a diagram illustrating the functional configuration of a signal output device according to the fifth embodiment. An input device 75 is connected to the signal output device 1A via an interface 21. The input device 75 is, for example, a keyboard device having a plurality of keys, and outputs a sound generation instruction signal in response to an operation on the keys. The sound generation instruction signal is provided to the signal output device 1A via the interface 21. The input device 75 and the signal output device 1A may be integrated into one unit. This integrated configuration can also be called an electronic keyboard instrument including the input device 75 and the signal output device 1A.

[0113] The signal processing function 100A in the signal output device 1A includes a signal acquisition unit 103A and a signal generation unit 125. The sound generation instruction signal output from the input device 75 is provided to the signal generation unit 125.

[0114] The signal generation unit 125 generates a sound signal including a waveform corresponding to a preset tone color based on the sound generation instruction signal. The signal acquisition unit 103A acquires the sound signal generated by the signal generation unit 125 and supplies it to the signal processing unit 113. Similar to the signal acquisition unit 103 in the first embodiment, the signal acquisition unit 103A acquires the sound signal from the musical instrument 70 and supplies it to the signal processing unit 113.

[0115] The signal acquiring unit 103A may combine the sound signal generated by the signal generating unit 125 and the sound signal acquired from the musical instrument 70 and then supply the combined signal to the signal processing unit 113, or may select either one of the sound signals and supply it to the signal processing unit 113. Which sound signal to select may be set in advance by the user. In this case, the signal acquiring unit 103A may supply the unselected sound signal to the signal output unit 105. In this case, the signal output unit 105 combines the sound signal supplied from the signal processing unit 113 and the sound signal supplied from the signal acquiring unit 103A and outputs the combined signal to the speaker device 80.

[0116] The signal processing unit 113 imparts a sound effect to the sound signal generated by the signal generating unit 125. Therefore, it can be said that a sound source unit that generates a sound signal corresponding to a set tone is realized by the functions of both the signal generating unit 125 and the signal processing unit 113.

[0117] Sixth Embodiment In the first embodiment, the sound effect settings are changed by moving an effector card placed in the imaging range PA. Therefore, even if the effector card moves within the imaging range PA, it remains within that range. After the initial state is determined, that is, after information about the effector card is specified by the signal output device 1, the sound effect settings may be changed even if the effector card is removed from the imaging range PA.

[0118] In the sixth embodiment, even if the effector cards CR1, CR2, and CR3 are removed from the imaging range PA after the initial state in the first embodiment is determined and the setting image shown in FIG. 5 is displayed, this setting image does not change. Therefore, in the sixth embodiment, the information extraction unit 101 does not need to acquire the extraction position after the initial state is determined. On the other hand, finger position detection is performed in the same manner as in the first embodiment. When the finger detection position is in the area where the effector card was present, the control unit 11 displays a setting change screen in the display area DA for changing the parameter setting value.

[0119] Fig. 15 is a diagram for explaining a setting change screen in the sixth embodiment. In Fig. 15, areas CR1n, CR2n, and CR3n shown in the imaging range PA indicate the positions of the effector cards CR1, CR2, and CR3 when the initial state is determined. The state shown in Fig. 15 shows a state in which the effector cards CR1, CR2, and CR3 are removed after the initial state is determined, and then the user's finger FG moves to area CR1n. The user's finger FG is an example of a pointing object for inputting instructions to the signal output device 1.

[0120] When the control unit 11 detects that the finger detection position is in the area CR1n, it displays a setting change screen in the display area DA. On the setting change screen, an enlarged effector image CG1c corresponding to the effector card CR1 that was in the area CR1n is displayed. The enlarged effector image CG1c is an image similar to the enlarged effector image CG1a shown in FIG. 7. Furthermore, on the setting change screen, a finger image FS is displayed superimposed on the enlarged effector image CG1c.

[0121] The finger image FS is an image corresponding to the finger FG extracted from the acquired image and is an example of an instruction image. The position where the finger image FS is displayed is determined in relation to the area CR1n (the area where the effector card CR1 was located when the initial state was determined) in the imaging range PA. The finger image FS is superimposed on the enlarged effector image CG1c to realize so-called MR (Mixed Reality).

[0122] For example, it is assumed that the user moves his / her finger FG while looking at the display area DA, causing the finger image FS to pinch and rotate the knob image N2, as shown in Fig. 15. The control unit 11 detects that the finger image FS is pinching the knob image N2 from the positional relationship between the finger detection position and the knob image N2, and when it detects that the knob image N2 is being rotated, it rotates the knob image N2, as shown in Fig. 15. The control unit 11 changes the parameter setting value (tone setting value in this example) according to the amount of rotation of the knob image N2.

[0123] In this way, in the sixth embodiment, even after the effector card is removed, MR is realized by superimposing the enlarged effector image displayed in the display area DA on the finger image FS obtained by capturing an image of the actual finger FG. That is, the user can change the parameter setting value by operating the enlarged effector image CG1c displayed on the setting change screen with the finger FG via the finger image FS.

[0124] Seventh Embodiment In the first embodiment, the information acquisition unit 190 corresponds to the imaging unit 19, and therefore the target from which feature information is extracted by the information extraction unit 101 is an acquired image corresponding to the imaging range PA. Such a target is not limited to an acquired image. For example, if the effector card has an IC chip that stores feature information, the information extraction unit 101 may extract feature information from this IC chip. In the sixth embodiment, an example using RFID (Radio Frequency IDentification) technology will be described.

[0125] FIG. 16 is a diagram illustrating a method of using a signal output device according to the seventh embodiment. In this example, a wireless communication panel 19B is connected to a signal output device 1B. The wireless communication panel 19B corresponds to the information acquisition unit 190 described above, but in this example, it is connected to the information extraction unit 101 via an interface 21. The wireless communication panel 19B includes a plurality of detection areas SP separated into a mesh pattern. Each detection area SP is provided with a coil or the like that reads information from an IC chip using RFID technology. The wireless communication panel 19B transmits a detection signal including the read information to the signal output device 1B.

[0126] As shown in Fig. 16, the effector cards CR4, CR5, and CR6 are respectively equipped with IC chips CH4, CH5, and CH6 that are capable of communicating using RFID technology. When the effector cards CR4, CR5, and CR6 are placed on the wireless communication panel 19B, the information acquisition unit 190 (wireless communication panel 19B) receives feature information from the detection area SP that corresponds to the position where the effector card is placed (more precisely, the position of the IC chip). As a result, the wireless communication panel 19B transmits a detection signal including information indicating the position of the detection area SP and the feature information to the signal output device 1B.

[0127] In the seventh embodiment, the information extraction unit 101 extracts feature information from the detection signal transmitted from the wireless communication panel 19B, and further identifies the position from which the feature information was extracted. This allows the signal output device 1B to identify the type of sound effect corresponding to each effector card and the position of each effector card. As described above, the subject from which the information extraction unit 101 extracts feature information is not limited to the acquired image obtained by the imaging unit 19, but may also be a detection signal including information obtained by wireless communication or the like.

[0128] In the seventh embodiment, the detailed setting process may not be executed, or may be executed in the same manner as in the first embodiment, that is, by detecting the position of the finger from an image acquired from the imaging unit 19. If the wireless communication panel 19B has a configuration capable of detecting the position and movement of the finger, for example, a configuration including a proximity sensor, the position of the finger may be detected from the detection result of the sensor.

[0129] Eighth Embodiment In the eighth embodiment, a signal output device 1C that can record the changed parameter setting value on an effector card after changing the parameter setting value will be described.

[0130] 17 is a diagram illustrating the functional configuration of a signal output device in the eighth embodiment. A signal output device 1C in the eighth embodiment outputs parameter setting values to a data recording device 90 connected via an interface 21. A parameter setting unit 111C in a signal processing function 100C outputs parameter setting values for each type of sound effect (each set effector) to the data recording device 90 via the interface 21 in response to an instruction from an operation unit 17.

[0131] The data recording device 90 is a device to which a recording medium such as a memory card is connected and which records data on the connected recording medium. The data recording device 90 records, for example, parameter setting values output from the signal output device 1C on the recording medium. The parameter setting values recorded on the recording medium may be read out by another signal output device and used as parameter setting values, or may be read out by an actual effector and used as setting values.

[0132] When the configuration of the eighth embodiment is applied to the signal output device 1B of the seventh embodiment, the effector cards CR4, CR5, and CR6 may have recording media for recording parameter settings. The recording media may be included in the IC chips CH4, CH5, and CH6. The wireless communication panel 19B may include a data recording device 90. In this case, the data recording device 90 may record the parameter settings on the recording media using a coil or the like in each detection area SP. In this way, the parameter settings corresponding to the effector card can also be recorded on the recording media included in that effector card. For example, the parameter settings for the effector card CR4 are recorded on the recording media included in the effector card CR4. In this case, recording to the recording media can be achieved while the effector card CR4 is placed in the wireless communication panel 19B.

[0133] Ninth Embodiment The signal output device 1 and the speaker device 80 are not limited to devices housed in separate housings as in the first embodiment, but may be an integrated device.

[0134] Fig. 18 is a diagram illustrating the external configuration of a signal output device according to the ninth embodiment. Fig. 19 is a diagram illustrating the functional configuration of a signal output device according to the ninth embodiment. Signal output device 1D is a device that includes a sound emitting unit 85D. Sound emitting unit 85D includes an amplifier that amplifies a sound signal that has been subjected to signal processing, and a speaker unit 88D that converts the amplified sound signal into air vibrations and outputs the converted sound. Therefore, signal output device 1D can also be called an amplifier-equipped speaker device.

[0135] The signal output device 1D includes at least one of an imaging unit 19D and a wireless communication unit 29D, which constitute an information acquisition unit 190D, and in this example includes both. In this example, the imaging unit 19D has an imaging range PA in the direction in which the speaker unit 88D outputs a sound signal (toward the front of the device). The imaging range PA may be set in a direction other than the front of the device.

[0136] The wireless communication unit 29D is a device that has the function of receiving feature information from an effector card, like the wireless communication panel 19B shown in the seventh embodiment, and the function of acquiring parameter setting values from a recording medium on which the parameter setting values are recorded, as shown in the eighth embodiment. In the example shown in Figure 18, the wireless communication unit 29D includes a card installation area located on the top surface of the device, and acquires various information from an effector card CR7 placed in that area. In this example, a display unit 15D having a display area DA and an interface 21D to which a musical instrument 70 is connected are located on the top surface of the device.

[0137] The operation unit 17D is disposed on the front side or in front of the device. When the sound effect is set by acquiring feature information from an effector card via the wireless communication unit 29D, the parameter setting value may be changed based on the user's operation on the operation unit 17D.

[0138] Tenth Embodiment The signal output device 1 may be connected to an external device such as a server via a network. This allows some of the functions of the signal output device 1 to be realized in the server. That is, the functions of the signal output device 1 may be realized by cooperation between multiple devices. When applied to the eighth embodiment, data to be recorded on a recording medium may be transmitted to the server instead of the data recording device 90, and the data may be recorded on a recording medium connected to the server. In the tenth embodiment, an example of a function realized by connecting to an external device such as a server will be described.

[0139] FIG. 20 is a diagram illustrating a method of using a signal output device according to the tenth embodiment. A signal output device 1E according to the tenth embodiment communicates with a server 1000 via a network NW using a communication unit 23. The server 1000 includes a control unit 1011, a storage unit 1013, and a communication unit 1023. The control unit 1011 and the communication unit 1023 have hardware configurations corresponding to the control unit 11 and the communication unit 23 described above. The storage unit 1013 stores programs for implementing predetermined functions in the server 1000, tables for managing information such as a time management table, databases, and the like. Execution of the programs by the CPU in the control unit 1011 realizes, for example, a function for executing a time management method described below.

[0140] The signal output device 1E confirms with the server 1000 the user's authority to use the effector card, and sets a sound effect corresponding to the effector card based on the authority. In this case, the signal output device 1E requests user information such as a user ID from the user in advance, and transmits identification information (e.g., feature information) related to the effector card in association with the user ID to the server 1000. The server 1000 refers to a database to identify the authority to use the effector card for the user ID, and transmits it to the signal output device 1E. The control unit 11 of the signal output device 1E sets a sound effect based on the authority to use the effector card.

[0141] The usage rights include, for example, permission to use, prohibition of use, function restriction, function change, etc. If the usage rights of the effector card are permission to use, the signal output device 1E controls so that the user can change all of the settings of the target sound effect. If the usage rights of the effector card are prohibition of use, the signal output device 1E controls so that the target sound effect cannot be used. If the usage rights of the effector card are function restriction, the signal output device 1E controls so that the user can change some of the settings of the target sound effect. If the usage rights of the effector card are function change, the signal output device 1E controls so that the signal processing of the target sound effect changes to a setting that changes the sound quality (for example, a setting that degrades the sound quality).

[0142] This use authority may be preset for each user, or may change depending on the usage time of the effector card. For example, for a certain user, when the usage time of the sound effect related to the effector card CR1 reaches a predetermined upper limit time, the use authority may change from permitted to prohibited. In this case, the signal output device 1E transmits to the server 1000 usage information including the usage time of the set effector corresponding to the effector card (the signal processing time for adding the sound effect) in association with the identification information related to the effector card. The signal output device 1E periodically transmits the usage information to the server 1000 while the set effector is being used. The usage information may be information indicating that the set effector is being used, instead of the usage time. In this case, the usage time is calculated in the server 1000. The server 1000 registers the usage time in association with the identification information in a time management table, and further transmits the usage authority to the signal output device 1E by referring to the time management table.

[0143] FIG. 21 is a diagram illustrating a time management table in the tenth embodiment. In the example shown in FIG. 21, the time management table defines, for each user ID, the correspondence between identification information, usage time, upper limit time, and restriction details related to the effector card. For example, for user ID ID(1), characteristic information Ia, Ib, and Ic are associated as identification information. Furthermore, for this user, characteristic information "Ia" is associated with user usage time "Ut1," upper limit time "Vt1," and restriction detail "prohibited use." These values may differ depending on the user. In the example shown in FIG. 21, for user ID ID(2), the upper limit time and restriction details associated with characteristic information "Ia" are different from those associated with ID(1).

[0144] 22 is a diagram for explaining a time management method in the tenth embodiment. The time management method is started when a login process using a user ID is accepted from the signal output device 1E. The server 1000 waits until it receives usage information from the signal output device 1E (step S501; No). Upon receiving the usage information (step S501; Yes), the server 1000 registers the usage time corresponding to each identification information in the time management table for each user ID based on the usage information (step S503).

[0145] If the usage time exceeds the upper limit time (step S511; Yes), the server 1000 transmits to the signal output device 1E the changed usage authority for the effector card corresponding to the target identification information so as to comply with the restrictions specified in the time management table (step S513). After that, or if the usage time does not exceed the upper limit time (step S511; No), and before the target user ID is logged out (step S521; No), the server 1000 waits until it receives usage information from the signal output device 1E again (step S501; No). If the target user ID is logged out (step S521; Yes), the server 1000 ends the time management method.

[0146] The signal output device 1E sets the sound effects corresponding to each effector card according to the usage authorization sent from the server 1000. This type of control allows the effector card to have settings that change over time as it is used, making it possible to use a trial version of the effector card. By utilizing the usage authorization for function changes, the sound effects can be changed as the effector card is used, recreating the changes over time of an actual device. The effector card may be provided to the user as an effector card that has been in its initial state for a certain amount of time, simulating a vintage device. In this case, the elapsed time may be included in the feature information.

[0147] The authorization to use the effector card may be changed based on information other than the usage time, such as the number of times it has been used. In this way, the control unit 11 performs signal processing on the sound signal by changing the parameter settings for the sound effect in accordance with the usage history.

[0148] The characteristic information included in one effector card may not be included in other effector cards. In other words, even effector cards corresponding to the same type of sound effect may contain individual information to distinguish one effector card from another. In this way, each effector card can be distinguished from other effector cards, and usage rights can be set for each effector card regardless of the user ID.

[0149] <Modification> The present disclosure is not limited to the above-described embodiments and includes various other modifications. For example, the above-described embodiments have been described in detail to clearly explain the present disclosure, and are not necessarily limited to those including all of the described configurations. Part of the configuration of one embodiment may be replaced with the configuration of another embodiment, and the configuration of another embodiment may be added to the configuration of one embodiment. Part of the configuration of each embodiment may be added, deleted, or replaced with other configurations. Some modifications will be described below. The first embodiment will be described as an example of a modification, but the present disclosure can also be applied as an example of a modification of other embodiments.

[0150] (1) In the first embodiment, a setting screen is displayed in the display area DA, but the setting screen does not have to be displayed. An effector image or the like does not have to be displayed in the display area DA, and the display unit 15 does not have to be included in the signal output device 1. In this case, the screen generation unit 121 does not have to be included in the signal processing function 100.

[0151] (2) Although the level setting value is changed when the effector card is moved within the imaging range PA, parameters other than the level setting value may also be changed. In this case, the parameters to be changed may be predetermined for each effector card.

[0152] (3) The information acquisition unit 190 may include a reading device that reads out the characteristic information by connecting via a wire to a recording medium on which the characteristic information is recorded.

[0153] (4) The medium containing the characteristic information is not limited to a card (the effector card described above), but may be a three-dimensional structure such as a figurine, or at least a part of a musical instrument. The at least a part of a musical instrument may be, for example, an operable structure such as a knob or slider, or a part bearing a pattern such as a logo.

[0154] (5) When a user draws or scratches an effector card, this is equivalent to adding or changing the feature information contained in the effector card. In such cases, the type of sound effect or the parameter setting value may be changed based on the added feature information. [Explanation of symbols]

[0155] 1, 1A, 1B, 1C, 1D, 1E: signal output device, 11: control unit, 13: memory unit, 15, 15D: display unit, 17, 17D: operation unit, 19, 19D: imaging unit, 19B: wireless communication panel, 21, 21D: interface, 23: communication unit, 29D: wireless communication unit, 50: holder, 59: optical unit, 70: musical instrument, 75: input device, 80: speaker device, 85D: sound emission unit, 88D: speaker unit, 90: device data recording device, 100, 100A, 100C: signal processing function, 101: information extraction unit, 103, 103A: signal acquisition unit, 105: signal output unit, 111, 111C: parameter setting unit, 113: signal processing unit, 121: screen generation unit, 125: signal generation unit, 131: program, 133: setting table, 190, 190D: information acquisition unit, 1000: server, 1011: control unit, 1013: storage unit, 1023: communication unit,

Claims

1. Acquiring identification information specifying a type of sound effect from a medium on which the identification information is recorded via an information acquisition unit; performing signal processing on the sound signal to impart a sound effect specified based on the identification information; outputting the sound signal that has been subjected to the signal processing; on the computer, The signal processing changes depending on the amount of change in the position of the medium.

2. the information acquisition unit includes an imaging unit that generates an image of a predetermined imaging range, The program according to claim 1 , wherein acquiring the identification information includes extracting the identification information corresponding to the medium from an image generated by the imaging unit.

3. and further causing the computer to display an identification image based on the identification information on a display unit. The program according to claim 1 or 2.

4. further causing the computer to acquire an audio signal from an external device; The performing of the signal processing includes performing the signal processing on a sound signal acquired from the external device. The program according to any one of claims 1 to 3.

5. the identification information includes information for identifying the type of parameter used in the signal processing, the signal processing based on the identification information includes processing using parameters identified by the identification information; The program according to any one of claims 1 to 4.

6. The performing of the signal processing comprises: measuring a change in position of the medium; changing the set values of the parameters used in the signal processing in accordance with the amount of change in the position of the medium; Including, The program according to claim 5.

7. The performing of the signal processing comprises: measuring a change in orientation of the medium; changing the set values of the parameters used in the signal processing in response to a change in the orientation of the medium; Including, The program according to claim 5 or 6.

8. Acquiring identification information specifying a type of sound effect from a medium on which the identification information is recorded via an information acquisition unit; performing signal processing on the sound signal to impart a sound effect specified based on the identification information; outputting the sound signal that has been subjected to the signal processing; on the computer, The signal processing includes: Measuring a user's operation state with respect to the medium while the position is fixed; changing setting values of parameters used in the signal processing in accordance with the operating state; Including, the program.

9. and further causing the computer to record the setting values of the parameters used in the signal processing on the medium. The program according to any one of claims 5 to 8.

10. the signal processing includes processing based on the setting values of the parameters read from the medium. The program according to claim 9.

11. and further causing the computer to acquire a sound signal from a signal generating unit that generates a sound signal based on a sound generation instruction signal; The signal processing is performed on the sound signal acquired from the signal generation unit. The program according to any one of claims 1 to 10.

12. A method for obtaining first identification information and second identification information specifying a type of sound effect from a first medium on which first identification information is recorded and a second medium on which second identification information specifying a type of sound effect is recorded, respectively; performing signal processing on the sound signal to impart a sound effect specified based on the first identification information and the second identification information; on the computer, The signal processing changes in response to a change in position of the first medium or a change in position of the second medium.

13. The program described in Claim 12, wherein the signal processing includes processing based on the first identification information, the second identification information, and the positional relationship between the first medium and the second medium.

14. When related information associating the first medium with the second medium is acquired, the signal processing includes processing based on the first identification information, the second identification information, and the related information. The program according to claim 12 or 13.

15. the signal processing includes processing according to a usage history related to the identification information; The program according to any one of claims 1 to 11.

16. The signal processing includes processing according to a usage history of the first identification information and the second identification information. The program according to any one of claims 12 to 14.

17. the information acquisition unit includes an imaging unit that generates an image of a predetermined imaging range, the identification information includes information for identifying the type of parameter used in the signal processing, the signal processing includes processing using parameters identified by the identification information, displaying an identification image corresponding to the medium on a display unit based on the identification information; extracting a predetermined pointing object from the image generated by the imaging unit and displaying the pointing image on the display unit; changing the set values of the parameters used in the signal processing based on the positional relationship between the identification image and the instruction image; and further causing the computer to execute the steps of: The program according to claim 1.

18. An information acquisition unit for acquiring identification information specifying a type of sound effect from a medium on which the identification information is recorded; a signal processing unit that performs signal processing on a sound signal to impart a sound effect specified based on the identification information; a signal output unit that outputs the sound signal that has been subjected to the signal processing; Including, A signal output device in which the signal processing changes depending on the amount of change in position of the medium.

19. 19. The signal output device according to claim 18, further comprising a sound emitting section that amplifies the sound signal output from the signal output section and converts it into air vibrations.

20. a signal acquisition unit for acquiring a sound signal from an external device; the signal processing unit performs signal processing based on the identification information on the sound signal acquired by the signal acquisition unit; 20. The signal output device according to claim 18 or 19.

21. a signal generating unit that generates a sound signal based on a sound generation instruction signal; the signal processing unit performs the signal processing on the sound signal generated by the signal generation unit; 21. The signal output device according to claim 18.

22. An information acquisition unit for acquiring identification information specifying a type of sound effect from a medium on which the identification information is recorded; a signal processing unit that performs signal processing on a sound signal to impart a sound effect specified based on the identification information; a signal output unit that outputs the sound signal that has been subjected to the signal processing; Including, the information acquisition unit includes an imaging unit that generates an image of a predetermined imaging range, the identification information includes information for identifying the type of parameter used in the signal processing, the signal processing based on the identification information includes processing using parameters identified by the identification information; a screen generating unit that displays an identification image corresponding to the medium on a display unit based on the identification information, extracts a predetermined pointing object from the image generated by the imaging unit, and displays an instruction image on the display unit; a parameter setting unit that changes the set values of the parameters used in the signal processing based on the positional relationship between the identification image and the instruction image; The signal output device further includes:

Images