Sound processing device and sound processing method

Abstract

To provide a sound processing device and a sound processing method capable of realizing a natural environment sound desired by a user with a simple operation.SOLUTION: A sound processing device 1C includes: a detection part that detects an operation by a user in an operation region; and a control part that outputs first sound data to be reproduced in accordance with a first operation in the operation region. The control unit changes a reproduction position of the first sound data in accordance with an operation mode of a first operation (operation for starting reproduction of BGM) in the operation region 17 and a second operation (operation for setting a parameter value) different from the first operation. When the operation mode of the second operation satisfies a predetermined condition, the reproduction of the first sound data is started from a reproduction position corresponding to the operation mode of the second operation with respect to the current reproduction position among one or more predetermined reproduction positions of the first sound data.SELECTED DRAWING: Figure 15

Description

[Technical Field]

[0001] The present invention relates to sound processing technology. [Background technology]

[0002] Audio equipment that can reproduce the sound space of listening to music in a natural environment is known. For example, Patent Document 1 describes audio equipment that realistically reproduces the sound space of listening to music in a natural environment by applying different sound field processing to natural environmental sounds and music. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2005-250199 Summary of the Invention [Problem to be solved by the invention]

[0004] One of the objects of the present invention is to enable a user to realize a desired sound with a simple operation. [Means for solving the problem]

[0005] A sound processing device according to one embodiment of the present invention includes a detection unit that detects a user operation in an operation area, and a control unit that outputs first sound data to be played in response to a first operation in the operation area, wherein the control unit changes the playback position of the first sound data in response to an operation mode of the first operation in the operation area and a second operation different from the first operation, and when the operation mode of the second operation satisfies a predetermined condition, starts playback of the first sound data from a playback position corresponding to the operation mode of the second operation, based on the current playback position, among one or more predetermined playback positions of the first sound data.

[0006] A sound processing device according to one embodiment of the present invention includes a detection unit that detects a user operation in an operation area, and a control unit that outputs first sound data that is played in response to a first operation in the operation area, wherein the control unit initiates processing to change the output of the first sound data in response to a second operation that is different from the first operation, and the second operation is an action that is performed at two different positions in the operation area and has a corresponding relationship to each other. [Effects of the Invention]

[0007] According to the present invention, a user can achieve a desired sound with a simple operation. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram showing the appearance of a sound processing device according to an embodiment of the present invention; [Figure 2] FIG. 2 is a diagram illustrating the top surface of the sound processing device illustrated in FIG. [Figure 3] 1 is a block diagram showing a configuration of a sound processing device according to an embodiment of the present invention; [Figure 4] FIG. 2 is a block diagram showing the configuration of a control unit according to an embodiment of the present invention. [Figure 5] FIG. 2 is a block diagram showing the configuration of a determination unit according to an embodiment of the present invention. [Figure 6] FIG. 1 is a diagram showing a flow of a sound processing method according to an embodiment of the present invention. [Figure 7] 1 is a block diagram showing a configuration of a sound processing device according to an embodiment of the present invention; [Figure 8] 1 is a diagram showing the top surface of a sound processing device according to an embodiment of the present invention; [Figure 9] 1 is a block diagram showing a configuration of a sound processing device according to an embodiment of the present invention; [Figure 10] 1 is a block diagram showing a configuration of a control unit of a sound processing device according to an embodiment of the present invention. [Figure 11] FIG. 2 is a flowchart illustrating an example of a sound processing method according to the present embodiment. [Figure 12]FIG. 2 is a flowchart illustrating an example of a sound processing method according to the present embodiment. [Figure 13] FIG. 2 is a flowchart illustrating an example of a sound processing method according to the present embodiment. [Figure 14] FIG. 10 is a diagram illustrating an example of predetermined delimiter positions for multiple sections included in BGM. [Figure 15] 10A and 10B are diagrams illustrating an example of a user operation for changing the output of BGM data. [Figure 16] FIG. 10 is a diagram showing an example of parameter values ​​for changing the output of BGM data. [Figure 17] FIG. 10 is a diagram showing an example of parameter values ​​for changing the output of BGM data. [Figure 18] FIG. 2 is a flowchart illustrating an example of a sound processing method according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

[0010] [First embodiment] <Sound processing device> A sound processing device according to an embodiment of the present invention is an audio device including a speaker, and executes a built-in or installed program to perform predetermined sound processing based on a user's operation.

[0011] Fig. 1 is a diagram showing the appearance of a sound processing device according to a first embodiment. Fig. 2 is a diagram showing the top surface of the sound processing device shown in Fig. 1. As shown in Fig. 1, the sound processing device 1 includes a top surface 11, a bottom surface 13, and a side surface 15. In this embodiment, the sound processing device 1 has a cylindrical appearance, but may also have a polygonal, spherical, or ellipsoidal shape. The top surface 11 includes an operation area 17.

[0012] The operation area 17 is provided on at least a part of the upper surface 11. In this embodiment, the operation area 17 is provided in a ring shape on the upper surface 11 along the edge of the circular upper surface 11. The operation area 17 receives operations by the user.

[0013] Operation area 17 includes a plurality of operation areas. In this embodiment, as shown in FIG. 2 , operation area 17 includes first operation area 171, second operation area 172, third operation area 173, and fourth operation area 174. On top surface 11, the boundaries between first operation area 171, second operation area 172, third operation area 173, and fourth operation area 174 are not visible to the user. In this embodiment, operation area 17 is described as including four operation areas, but operation area 17 may include at least two operation areas, and the number of operation areas is not limited.

[0014] 3 is a block diagram showing the configuration of a sound processing device 1 according to this embodiment. The sound processing device 1 includes a detection unit 19, a control unit 21, a storage unit 23, a speaker 25, and an interface 27. The detection unit 19, the control unit 21, the storage unit 23, the speaker 25, and the interface 27 are connected to one another via a bus 33.

[0015] 2, the detection unit 19 is provided corresponding to the operation area 17, and detects an operation by the user in the operation area 17. The detection unit 19 is a touch sensor that detects contact of the user's fingers with the operation area 17, and is, for example, a capacitance-type touch sensor. The detection unit 19 may detect contact of the operation area 17 with not only the user's fingers but also a stylus pen. The detection unit 19 outputs a detection signal to the control unit 21 in response to the user's operation on the operation area 17.

[0016] The control unit 21 includes an arithmetic processing circuit such as a CPU, and storage devices such as a RAM and a ROM. The control unit 21 realizes various functions by executing a program 23a stored in the storage unit 23 using the CPU. The functions executed by the control unit 21 include a sound processing function.

[0017] The storage unit 23 is a storage device such as a non-volatile memory. The storage unit 23 stores a program 23a executed by the control unit 21. The storage unit 23 also stores information, including sound data 23b, necessary for the control unit 21 to execute processing. The sound data 23b is reproduced by the control unit 21. The sound data 23b may be audio data (waveform data) or sound control data such as MIDI data.

[0018] The speaker 25 outputs a sound based on the sound data output from the control unit 21 .

[0019] The interface 27 includes a USB interface such as a USB port. An operation unit 29 is connected to the interface 27. The operation unit 29 is a device for inputting user instructions and is an operation device including an operator that outputs an operation signal according to the input operation. The operation unit 29 is, for example, a USB switch or an external terminal. The external terminal includes, for example, a desktop terminal, a notebook terminal, a smartphone, a tablet terminal, etc.

[0020] The sound processing device 1 may have a communication unit (not shown). In this case, the sound processing device 1 can transmit and receive data to and from an external device such as an external server via the communication unit. Furthermore, the operation unit 29 may function as an external terminal and communicate with the sound processing device 1 via the communication unit.

[0021] The control unit 21 executes a sound processing function based on a user's operation on the operation area 17. The configuration of the control unit 21 will be described below. FIG. 4 is a block diagram showing the configuration of the control unit 21. The control unit 21 includes a determination unit 210, a sound data acquisition unit 220, and an output unit 230.

[0022] The determination unit 210 determines a user's operation in the operation area 17 based on a detection signal received from the detection unit 19. The determination unit 210 determines the user's operation position and operation type in the operation area 17. FIG. 5 is a block diagram showing the configuration of the determination unit 210. The determination unit 210 includes an operation type determination unit 211 and an operation position determination unit 213.

[0023] The operation type determination unit 211 identifies the type of user operation on the operation area 17 based on the detection signal. The operation type determination unit 211 determines at least two different types of operations. The types of operations include, for example, tapping, double tapping, tapping with two fingers, sliding, and long pressing. Each operation is associated with a different process. The user can instruct the control unit 21 to execute the process associated with the predetermined operation by performing a predetermined operation on the operation area 17. In the present embodiment, as an example, the operation type determination unit 211 determines two different operations. One operation (first operation) is an operation to instruct the start of playback of sound data, and the other operation (second operation) is an operation to instruct the end of playback of sound data. In other words, the control unit 21 switches between starting and ending playback of sound data based on the user operation. Here, "playback" means reading predetermined sound data from the storage unit 23. The operation type determination unit 211 outputs operation type information indicating the type of user operation on the operation area 17 to the sound data acquisition unit 220.

[0024] The operation position determination unit 213 determines and specifies the user's operation position in the operation area 17 based on the detection signal. Specifically, the operation position determination unit 213 determines which operation area (171 to 174) in the operation area 17 the user's operation position is in. In the operation area 17, different natural environmental sounds (ambient sounds) are associated with each operation position. The operation position determination unit 213 outputs operation position information indicating the user's operation position in the operation area 17 to the sound data acquisition unit 220.

[0025] The sound data acquisition unit 220 identifies the ambient sound desired by the user based on the operation position information acquired from the determination unit 210. Furthermore, the sound data acquisition unit 220 identifies whether the process desired by the user is to start reproducing sound data or to end reproducing sound data based on the operation type information acquired from the determination unit 210, and executes the identified process on the identified environmental sound. For example, when the operation position information indicates the first operation area 171 and the operation type information indicates the first operation, the sound data acquisition unit 220 starts reading out the first sound data corresponding to the first ambient sound associated with the first operation area 171 from the storage unit 23. That is, the sound data acquisition unit 220 starts reproducing the first sound data. The sound data acquisition unit 220 supplies the acquired first sound data to the output unit 230. Furthermore, when the operation position information indicates the first operation area 171 and the operation type information indicates the second operation, the sound data acquisition unit 220 stops reading out the first sound data.

[0026] After starting the reproduction of the first sound data corresponding to the first operation area 171, the sound data acquisition unit 220 continues the reproduction of the first sound data until operation type information instructing the end of the reproduction of the first sound data is supplied. That is, the sound data acquisition unit 220 continues reading the first sound data from the storage unit 23 until the end of the reproduction of the first sound data is instructed.

[0027] Furthermore, after starting playback of the first sound data, when operation position information and operation type information instructing the start of playback of second sound data that is different from the first sound data and corresponds to a second ambient sound are supplied to the sound data acquisition unit 220, the sound data acquisition unit 220 continues playing the first sound data from the storage unit 23 and starts playing the second sound data from the storage unit 23. In this case, the sound data storage unit 230 supplies both the first sound data and the second sound data that it reads out and acquired from the storage unit 23 to the output unit 230.

[0028] If operation type information instructing the end of playback of the first sound data is supplied while the first sound data and the second sound data are being played back, the sound data acquisition unit 220 ends playback of the first sound data. That is, the sound data acquisition unit 220 ends reading of the first sound data from the storage unit 23. After the operation type information instructing the end of playback of the first sound data is supplied, the sound data acquisition unit 220 continues playing only the second sound data.

[0029] The output unit 230 outputs the sound data supplied from the sound data acquisition unit 220 to the speaker 25. When a plurality of pieces of sound data are supplied from the sound data acquisition unit 220, the output unit 230 synthesizes the plurality of pieces of sound data and outputs the synthesized sound data to the speaker 25. The output unit 230 can also adjust the sound data based on the volume set via the operation unit 29 and output the adjusted sound data to the speaker 25.

[0030] The speaker 25 outputs a sound based on the sound data supplied from the output unit 230 .

[0031] 6 is a diagram showing the flow of the sound processing method (ambient sound output processing method) according to this embodiment, which is executed by the control unit 21. When the control unit 21 receives a detection signal from the detection unit 19 (S601; Yes), it identifies the operation position and the type of operation based on the detection signal (S602). Based on the identified operation position, the control unit 21 identifies the ambient sound desired by the user (S603). Thereafter, based on the identified type of operation, the control unit 21 determines whether or not to start playing sound data corresponding to the identified ambient sound (S604). If it is determined that playback of sound data should be started (S604; Yes), the control unit 21 starts playing the sound data corresponding to the identified ambient sound from the storage unit 23, and causes the speaker 25 to output the ambient sound based on the sound data (S605).

[0032] On the other hand, if the reproduction of the sound data is to be ended (S604; No), the reproduction of the sound data corresponding to the identified ambient sound is ended (S606), and the process returns to step 601 (S601). Also, if the control unit 21 has not received a detection signal from the detection unit 19 (S601; No), the control unit 21 repeats the process of step 601 (S601) until a detection signal is received.

[0033] In step 605 (S605), when a plurality of pieces of sound data are reproduced, the control unit 21 mixes the plurality of pieces of sound data and causes the speaker 25 to output a plurality of ambient sounds. For example, in step 605 (S605), when first sound data and second sound data are reproduced, the control unit 21 mixes the first sound data and second sound data and causes the speaker 25 to output the first ambient sound and the second ambient sound simultaneously.

[0034] Although not shown in the figure, if the detection signal received in step 601 (S601) instructs that a process that has already been started or completed be performed again, the control unit 21 may perform the instructed process again, may continue the process, or may ignore the process and repeat the process of step 601 (S601) until a new detection signal is received.

[0035] In this embodiment, by performing simple operations on the operation area 17 provided on the top surface 11 of the sound processing device 1, the user can realize the natural environmental sound they desire, and the user can experience being in the desired natural environment.

[0036] [Second embodiment] In the first embodiment, natural environmental sounds specified by a user's operation are output from the speaker 25. However, the sounds output from the speaker 25 are not limited to the natural environmental sounds associated with the operation areas of the operation area 17. The sound processing device 1 may superimpose the ambient sound specified by the user's operation on predetermined background music and output it. In other words, the user can experience listening to their favorite background music in a desired natural environment.

[0037] 7 is a block diagram showing the configuration of a sound processing device 1A according to this embodiment. The configuration of the sound processing device 1A is substantially the same as the configuration of the sound processing device 1 according to the first embodiment described with reference to FIG. 3, except that a storage unit 23A stores BGM data 23c.

[0038] In the sound processing device 1A, while background music set by the user is being played back, the user performs a first operation in the operation area 17 of the sound processing device 1A, whereby the control unit 21 starts playing back sound data corresponding to the ambient sound associated with the operation position in the operation area 17. The control unit 21 mixes the background music data and the sound data and outputs the result to the speaker 25.

[0039] In addition, when the sound processing device 1A is outputting background music and a predetermined ambient sound, if the user performs a second operation at an operation position in the operation area 17 that is associated with the predetermined ambient sound, the control unit 21 terminates the playback of the sound data corresponding to the ambient sound associated with the operation position. In this case, only background music is output from the sound processing device 1A.

[0040] The start and end of the playback of ambient sound in this embodiment are the same as in Embodiment 1. The user can specify the desired BGM via the operation unit 29, and the control unit 21 plays back the BGM data corresponding to the specified BGM.

[0041] [Third embodiment] In the sound processing device, the multiple operation areas included in the operation area 17 may partially overlap each other.

[0042] Fig. 8 is a diagram showing the top surface 11 of a sound processing device 1B according to this embodiment. The appearance and configuration of the sound processing device 1B according to this embodiment are the same as the appearance of the sound processing device 1 according to the first embodiment described with reference to Fig. 1 and the configuration of the sound processing device 1 according to the first embodiment described with reference to Figs. 3 to 5. As shown in Fig. 8, an operation area 17B provided on the top surface 11 of the sound processing device 1B includes a first operation area 171B of a predetermined range centered on a first reference point RP1, a second operation area 172B of a predetermined range centered on a second reference point RP2, a third operation area 173B of a predetermined range centered on a third reference point RP3, and a fourth operation area 174B of a predetermined range centered on a fourth reference point RP4.

[0043] In this embodiment, first operation region 171B partially overlaps with adjacent second operation region 172B and fourth operation region 174B. Similar to first operation region 171B, second operation region 172B, third operation region 173B, and fourth operation region 174B also partially overlap with adjacent operation regions.

[0044] In this embodiment, the mixing ratio of the ambient sound, i.e., the volume level, is determined based on the user's operation position in the operation area 17B. Specifically, when the user's operation position in the operation area 17B is in an area where two adjacent operation areas overlap, the sound processing device 1B mixes and outputs the two ambient sounds associated with the two operation areas. At this time, the mixing ratio of the two ambient sounds is determined according to the distance between the operation position and the reference points of the two operation areas. On the other hand, when the user's operation position in the operation area 17B is in an area where two adjacent operation areas do not overlap, the sound processing device 1B outputs only the ambient sound corresponding to the operation area corresponding to the operation position.

[0045] The output unit 230 of the sound processing device 1B determines the mixing ratio of the first sound data and the second sound data based on the first distance (for example, the distance between the user's operation position and the reference point RP1 in the first operation area 171B) and the second distance (for example, the distance between the user's operation position and the reference point RP2 in the second operation area 172B) included in the distance information. Here, the distance information is information indicating the distance between the user's operation position and each reference point in the operation area corresponding to the operation position. By changing the volume of one or more ambient sounds, the user can enjoy changing scenes in the natural environment corresponding to the ambient sounds.

[0046] [Fourth embodiment] The sound processing device can be used as a speaker device that outputs only background music. For example, the user may set the operation mode of the sound processing device via the operation unit 29. That is, the user may select whether to operate the sound processing device as a device that executes a sound processing function for outputting ambient sound as in each of the above-described embodiments, or as a speaker device that outputs only background music.

[0047] When the sound processing device is operated as a speaker device, the operation type determination unit 211 identifies the type of operation performed by the user on the operation area 17 based on the detection signal output from the detection unit 19. For example, a tap by the user on the operation area 17 may be an operation to start or pause playback of BGM data. A slide by the user on the operation area 17 may be an operation to adjust the volume level of the BGM. Alternatively, a slide operation by the user on the operation area 17 may be an operation to fast forward / rewind the BGM currently being output. A double tap by the user on the operation area 17 may be an operation to fast forward / rewind the BGM, i.e., an operation to instruct playback of BGM data different from the BGM data currently being played.

[0048] In this embodiment, a sound processing device 1C functioning as a speaker device will be described. The sound processing device 1C changes the playback position of a song being played in response to a first operation based on the current playback position of the song in response to a second operation performed by a user that is different from the first operation. In this embodiment, the user's operation mode is the operation speed.

[0049] 9 is a block diagram showing the configuration of a sound processing device 1C according to this embodiment, which is substantially the same as the sound processing device 1A according to the second embodiment described with reference to FIG.

[0050] 10 is a block diagram showing the configuration of the control unit 21C of the sound processing device 1C. The determination unit 210C determines the type of operation performed by the user in the operation area 17 on the top surface 11 of the sound processing device 1C based on the detection signal received from the detection unit 19. The determination unit 210C outputs operation type information indicating the type of operation performed by the user to the sound data acquisition unit 220 or the output unit 230.

[0051] Furthermore, if the type of user operation is fast-forward or fast-rewind, the determination unit 210C identifies the operation mode, i.e., the operation speed. Based on the identified operation speed, the determination unit 210C changes the playback position of the BGM data being played based on the current playback position of the BGM data. At this time, the determination unit 210C determines whether the operation mode satisfies a predetermined condition. If the determination result shows that the operation mode satisfies the predetermined condition, the determination unit 210C identifies a playback position corresponding to the operation mode, based on the current playback position, from one or more predetermined playback positions of the BGM being output. In this embodiment, the determination unit 210C determines whether the operation speed is equal to or greater than a predetermined speed. If the determination result shows that the operation speed is equal to or greater than the predetermined speed, the determination unit 210C identifies a playback position corresponding to the operation speed, based on the current playback position, from one or more predetermined playback positions of the BGM, and changes the playback position of the BGM to the playback position identified according to the operation speed. When the playback position is changed, the determination unit 210C outputs playback position information indicating the changed playback position to the sound data acquisition unit 220C.

[0052] The one or more predetermined playback positions of the BGM are predetermined division positions of multiple sections included in the BGM. For example, the one or more predetermined playback positions of the BGM include at least one of the following: the start position of the intro of the BGM, the division position between the intro and the A melody of the BGM, the division position between the A melody and the B melody, the division position between the B melody and the chorus, the division position between the chorus and the interlude, the division position between the interlude and the C melody, and the division position between the C melody and the outro. Each division position in the BGM is set in advance. The sound processing method executed by the control unit 21C, including the processing executed by the determination unit 210C, will be described later.

[0053] 11 to 13 are flow charts illustrating an example of processing executed by the control unit 21C for fast-forwarding or fast-rewinding the BGM. Here, as an example, it is assumed that the second operation in the operation area 17 is a slide operation by the user.

[0054] When control unit 21C receives a detection signal from detection unit 19 (S1501; Yes), it identifies the type of operation based on the detection signal (S1502). Control unit 21C determines whether the type of operation is fast-forward or fast-rewind (S1503). If the type of operation is not a slide operation, that is, if the type of operation is neither fast-forward nor fast-rewind (S1503; No), control unit 21C executes processing according to the identified type of operation (S1510), as shown in FIG. 13, and waits until it receives a new detection signal.

[0055] On the other hand, if the type of operation is a slide operation, that is, if the type of operation is fast-forward or fast-rewind (S1503; Yes), control unit 21C identifies the operation mode (S1504). In the present embodiment, in the process of S1504, control unit 21C identifies the operation speed of the slide operation as the operation mode based on the detection signal.

[0056] The operation speed can be calculated based on the operation distance and operation time of the user to the operation area 17. The operation distance is the distance between the operation start position and operation end position of the user's operation. The control unit 21C identifies the operation start position and operation end position based on the detection signal and calculates the operation distance. Furthermore, the control unit 21C identifies the operation start timing and operation end timing of the user's operation based on the detection signal and calculates the operation time. The control unit 21C can calculate and identify the operation speed by dividing the operation distance by the operation time.

[0057] Next, the control unit 21C determines whether the identified operation speed (operation mode) satisfies a predetermined condition (S1505). If the operation speed is lower than a predetermined speed (S1505; No), the control unit 21C changes the playback position of the BGM data based on the type of operation and the identified operation speed (operation mode) (S1506).

[0058] For example, in the process of S1505, if the operation speed is less than a predetermined speed (S1505; No) and the fast-forward / fast-rewind time associated with the operation speed is 10 seconds, control unit 21C shifts the playback position by 10 seconds based on the current playback position of the BGM. If the type of operation is fast-forward, control unit 21C changes the playback position by 10 seconds based on the current playback position of the BGM. On the other hand, if the type of operation is fast-rewind, control unit 21C changes the playback position by 10 seconds based on the current playback position of the BGM.

[0059] When the playback position is changed in accordance with the operation speed, the control unit 21C plays back the BGM data from the changed playback position (S1507), and continues playing the BGM data until a new detection signal is received.

[0060] On the other hand, if the operation speed is equal to or greater than a predetermined speed (S1505; Yes), the control unit 21C identifies a playback position corresponding to the operation speed (operation mode) based on the current playback position from one or more predetermined playback positions of the BGM, as shown in FIG. 12, based on the type of operation (S1508).

[0061] If the operation speed is equal to or greater than a predetermined speed, the control unit 21C calculates the absolute value of the difference between the operation speed and the predetermined speed. Based on the calculated absolute value of the difference, the control unit 21C specifies a playback position corresponding to the operation speed (operation mode) with the current playback position as the reference. The playback position is determined based on the magnitude of the absolute value of the calculated difference and multiple predetermined thresholds.

[0062] Fig. 14 is a diagram illustrating an example of predetermined division positions of multiple sections included in background music. Fig. 14 illustrates a case where the background music includes seven sections. In Fig. 14, s1 indicates the start position of the intro, s2 indicates the division position between the intro and the A melody, s3 indicates the division position between the A melody and the B melody, s4 indicates the division position between the B melody and the chorus, s5 indicates the division position between the chorus and the interlude, s6 indicates the division position between the interlude and the C melody, and s7 indicates the division position between the C melody and the outro.

[0063] If the magnitude of the absolute value of the calculated difference is equal to or smaller than a predetermined first threshold T1, the control unit 21C identifies, as the playback position, the separator position closest to the current playback position of the BGM, based on the type of operation. For example, if PP in Fig. 14 is the current playback position of the BGM and the type of operation is fast-forward, and if the magnitude of the absolute value of the calculated difference is equal to or smaller than the predetermined first threshold T1, the control unit 21C identifies, as the playback position, separator position s6 that is chronologically later than and closest to the current playback position PP, that is, the separator position between the interlude and the C melody.

[0064] If the type of operation is fast forward and the magnitude of the absolute value of the calculated difference is greater than a predetermined first threshold T1 and less than a predetermined second threshold T2 (T2>T1), the control unit 21C identifies the playback position as the division position s7, which is located chronologically later than the current playback position PP and is second closest to the current playback position PP, i.e., the division position between the C melody and the outro.

[0065] If the type of operation is fast-forward and the magnitude of the absolute value of the calculated difference is greater than a predetermined second threshold T2 and equal to or less than a predetermined third threshold T3 (T3>T2), the control unit 21C specifies the playback position as the delimiter position that is located chronologically later than the current playback position PP and is third closest to the current playback position PP. As shown in Fig. 14, if there are no delimiter positions after the delimiter position s7 that is second closest to the current playback position PP, the control unit 21C specifies the playback position as the latest delimiter position s7, based on the current playback position PP.

[0066] The above describes the case where the type of operation is fast forward, but when the type of operation is fast rewind, the playback position is determined based on the magnitude of the absolute value of the calculated difference and multiple predetermined thresholds, just like fast forward.

[0067] Returning to FIG. 12, when a playback position corresponding to the operation speed is identified from one or more predetermined playback positions of the BGM, the control unit 21C plays the BGM data from the identified playback position (S1509) and continues playing the BGM data until a new detection signal is received.

[0068] Although the above describes the case where the operation mode is the operation speed, the operation mode may also be the operation time or the operation distance. When the operation mode is the operation time or the operation distance, the control unit 21C changes the playback position of the currently output BGM according to the operation time or the operation distance, as in the case where the operation mode is the operation speed described above.

[0069] [Fifth embodiment] In this embodiment, an example of processing by the sound processing device 1C (processing S1510 in FIG. 13) will be described when the type of user operation (second operation) on the operation area 17 is not BGM fast-forward / fast-rewind (processing S1503 in FIG. 11; No). In this embodiment, the control unit 21C of the sound processing device 1C performs processing to change the output of BGM data in response to the user operation.

[0070] Changing the output of BGM data includes changing the sound quality of the BGM being output. For example, when a predetermined operation is detected, the control unit 21C may degrade the sound quality of the BGM. Degradation of sound quality can be achieved by processing the BGM data, such as lowering the bit rate, increasing the compression ratio, adding noise, or cutting a predetermined frequency band. Degradation of sound quality can also be achieved by using an effector such as a flanger or phaser to add a undulating effect to the BGM data.

[0071] 15 is a diagram illustrating an example of a user's operation for changing the output of BGM data. The user's operation for changing the output of BGM data is, for example, a so-called twist operation in which the user places one finger on each hand at two different positions TP1 and TP2 in the operation area 17 on the top surface 11 of the sound processing device 1C and slides them in the same direction at the same time. In other words, this is a user's action performed at two different positions in the operation area 17, which correspond to each other.

[0072] In this way, the sound processing device 1C can apply a predetermined effect to the BGM, such as intentionally degrading the sound quality of the BGM by changing the output of the BGM data in response to user operations. This allows the user to enjoy changes in the sound quality of the BGM. In particular, in this embodiment, when the circular upper surface 11 is circular, the user can experience listening to BGM as if operating a record player.

[0073] [Sixth embodiment] In this embodiment, another example of the processing of the sound processing device 1C (process S1510 in FIG. 13) when the type of the user's operation (second operation) on the operation area 17 is not fast-forward / fast-rewind of BGM (process S1503 in FIG. 11; No) will be described. In this embodiment, the control unit 21C of the sound processing device 1C performs processing to set the value of a parameter for changing the output of BGM data based on a predetermined user operation on the operation area while BGM is being played back.

[0074] The operation for setting the parameter value (second operation) is different from the operation for starting the playback of the background music (first operation). For example, the operation for setting the parameter value may be a long press operation at one or two positions in the operation area 17.

[0075] The magnitude of the parameter value is determined based on the amount of operation for setting the parameter value. For example, if the operation for setting the parameter value is a long press operation, the amount of operation for the long press operation may be the hold period of the long press operation in operation area 17.

[0076] In the following, as an example, a case will be described in which the operation for setting the parameter value is a long press operation, the parameter value set by the long press operation is the parameter value for setting the volume of background music, and the operation amount for determining the parameter value is the hold period of the long press operation.

[0077] Based on the detection signal, the control unit 21C identifies the position where the long press operation was performed, and thereby determines whether the user is instructing to increase or decrease the volume. For example, if the position where the long press operation was performed is a predetermined position in the operation area 17, the control unit 21C may determine that the user is instructing to increase the volume. Alternatively, if the positions where the long press operation was performed are two different positions in the operation area 17, the control unit 21C may determine that the user is instructing to decrease the volume.

[0078] Furthermore, the control unit 21C sets the value of a parameter for setting the volume based on the user's instruction indicated by the long press operation and the hold time of the long press operation. That is, if the user instructs to increase the volume, the control unit 21C changes the value of the parameter from the current value to increase the volume based on the hold time of the long press operation. On the other hand, if the user instructs to decrease the volume, the control unit 21C changes the value of the parameter from the current value to decrease the volume.

[0079] 16 and 17 are diagrams showing examples of parameter values ​​set by control unit 21 C. In Fig. 16 and Fig. 17, the vertical axis represents the parameter value for setting the volume set by control unit 21 C, and the horizontal axis represents time.

[0080] 16 shows how the value of a parameter for setting the volume increases from a relatively small value to a large value based on a long press operation by the user. In FIG. 16, "a" on the horizontal axis represents the timing at which the long press operation is detected by control unit 21C (the timing at which the long press operation by the user starts). At this time, control unit 21C sets the value of the parameter so that the value changes by a predetermined value or more from the value of the parameter before the detection of the long press operation (before timing a) during a predetermined period from timing a to timing b at which the long press operation is detected.

[0081] 16, in the period from timing a to timing b, control unit 21C increases the value of the parameter, and then decreases the value of the parameter. The absolute value of the difference between the maximum value of the parameter in the predetermined period from timing a to timing b and the value of the parameter before timing a is equal to or greater than a predetermined value. After timing b, control unit 21C gradually increases the value of the parameter, and at timing C, sets the parameter to a value based on the hold time of the user's long press operation on operation area 17.

[0082] As shown in FIG. 16, before setting the parameter value based on the hold time of the user's long press operation on the operation area 17, the parameter value is changed from the existing value by a predetermined value or more, regardless of the user's operation, during a predetermined period from timing a to timing b when the long press operation is detected, thereby notifying the user that processing based on the user's operation on the operation area 17 will be executed.

[0083] FIG. 17 shows the parameter values ​​set by control unit 21C when the existing parameter values ​​before the detection of the long press operation are at their maximum values ​​and an instruction to further increase the parameter values ​​is received from the user.

[0084] Control unit 21C sets the value of the parameter so that the parameter value changes by a predetermined value or more from the value of the parameter before timing a during a predetermined period from timing a to timing b when the long press operation is detected. As shown in FIG. 17, control unit 21C decreases the value of the parameter during the predetermined period from timing a to timing b, and then increases the value of the parameter. The absolute value of the difference between the minimum value of the parameter during the predetermined period from timing a to timing b and the value of the parameter before timing a, i.e., the maximum value of the parameter that can be set, is greater than or equal to a predetermined value. Control unit 21C gradually increases the value of the parameter after timing b, and at timing C, sets the value of the parameter to the maximum value of the parameter that can be set again.

[0085] This allows the user to have the sensation that a process based on his or her own operation has been executed, even without a visual indicator of the parameter value.

[0086] FIG. 18 is a flow diagram for explaining the details of process S1510 shown in FIG. 13 in the case where the type of operation identified in process S1502 shown in FIG. 11 is an operation for setting the value of a parameter for setting the volume of background music.

[0087] As shown in FIG. 18, if the type of operation identified in process S1502 is an operation for setting the value of a parameter for setting the volume of background music, the control unit 21C determines whether the user's instruction is to increase the value of the parameter (S2301).

[0088] If the user's instruction is to increase the value of the parameter (S2301; Yes), the control unit 21C sets the value of the parameter so that the value of the parameter increases based on the amount of user operation (here, the hold time of the long press operation) after the value of the parameter during a predetermined period from the time when the user's operation is detected (the time when the operation is started) has changed by more than a predetermined value from the existing parameter value, i.e., the parameter value before the user's operation was detected (S2302).

[0089] On the other hand, if the user's instruction is not to increase the parameter value (S2301; No), the control unit 21C sets the parameter value so that the parameter value decreases based on the amount of user operation (hold time of long press operation) after the parameter value during a predetermined period from the time when the user's operation is detected (the time when the operation is started) has changed by more than a predetermined value from the existing parameter value, i.e., the parameter value before the user's operation was detected (S2303).

[0090] The control unit 21C maintains the parameter values ​​set in step S2303 until it receives an instruction from the user to set the parameter values ​​again.

[0091] [Variations] The present disclosure is not limited to the above-described embodiment, and includes various other modifications, some of which will be described below.

[0092] (1) In the above-described embodiment, different ambient sounds (first to fourth ambient sounds) are associated with the first operation area 171, the second operation area 172, the third operation area 173, and the fourth operation area 174 in the operation area 17. Here, a plurality of pieces of sound data corresponding to the ambient sound may be associated with each operation area. For example, if the first ambient sound associated with the first operation area 171 is a bird song, the storage units 23 and 23A store a first data set including a plurality of pieces of sound data corresponding to different types of bird songs as sound data corresponding to the first ambient sound. When the user performs an operation in the first operation area 171 to instruct the start of playback of sound data, the control unit 21 selects predetermined sound data from the first data set based on a predetermined algorithm and plays the selected sound data as the first sound data.

[0093] In this case, when a predetermined time has elapsed based on a predetermined algorithm until the user performs an operation to instruct the end of playback of the sound data, the control unit 21 may select sound data from the first data set that is different from the sound data that has been played up to that point, and play it as the first sound data.

[0094] (2) When the operation area includes multiple operation areas, the sizes of the operation areas may be the same as or different from one another. Specifically, the sizes of the first operation area 171 (171B), second operation area 172 (172B), third operation area 173 (173B), and fourth operation area 174 (174B) included in operation area 17 in the above-described embodiment may be the same as or different from one another.

[0095] (3) In the first and second embodiments, when operation area 17 includes multiple operation areas, a portion of each operation area may overlap a portion of an adjacent operation area, as in operation area 17B in the third embodiment.

[0096] (4) In the above-described embodiment, in operation areas 17 and 17B, a predetermined ambient sound is associated with each operation area. However, in operation areas 17 and 17B, a predetermined ambient sound may be associated with one or more reference points. In this case, the ambient sound to be output is determined based on the distance between the user's operation position and each reference point. In other words, the area in which the ambient sound associated with each reference point is output can be said to be the operation area corresponding to the ambient sound.

[0097] (5) In the first and second embodiments described above, the first operation may be a tap and the second operation may be a slide. In the third embodiment, if the first operation is a tap, it may be difficult to distinguish between the first operation and a slide. Therefore, in the third embodiment, if the first operation is a tap, it is preferable that the second operation is an operation other than a slide.

[0098] (6) In the second embodiment, the storage unit 23A may store a plurality of BGM data. Furthermore, the user may transfer desired BGM data to the storage unit 23A of the sound processing device 1A via the operation unit 29. Such BGM data may be downloaded from an external source. The same applies to the fourth embodiment.

[0099] (7) In the fourth embodiment, it has been described that each delimiter position in the BGM is set in advance. However, the control unit 21C of the sound processing device 1C may identify multiple sections included in the BGM based on the waveform of the BGM data and set the delimiter positions of each section.

[0100] (8) In the fifth embodiment, the output of BGM data is changed in response to a user operation. In this case, the control unit 21C may execute a process different from the process in response to the user operation, such as changing the playback speed of the BGM data, before changing the output of the BGM data in response to the user operation. For example, the control unit 21C may slow down the playback speed of the BGM data before changing the output of the BGM data in response to the user operation. This makes the speed of the BGM output slower than before. By slowing down the BGM speed just before outputting the BGM data for which processing in response to the user operation has been executed, the user can be notified that the sound quality of the BGM immediately afterwards will change in response to the user operation. The user can recognize that processing in response to his or her operation has been executed.

[0101] (9) In the fifth embodiment, changing the output of BGM data is not limited to processing for degrading the sound quality of the BGM. If there are multiple effects for changing the output of BGM data, the effect to be applied to the BGM data may be selected depending on the user's operation position.

[0102] (10) In the fourth embodiment, as shown in Fig. 11, after the type of operation is identified (S1502), it is determined whether the identified type of operation is fast-forwarding or fast-rewinding of background music (S1503). However, if the instruction identified by the user's operation on the operation area 17 is only fast-forwarding or fast-rewinding of background music, the processing of S1503 is omitted in the fourth embodiment.

[0103] (11) In the fifth embodiment, if the instruction specified by the user's operation on the operation area 17 is to change the output of BGM data only, the processing from S1503 onwards in Fig. 11 is omitted in the fifth embodiment, and the process proceeds to processing for degrading sound quality from processing of S1502 in Fig. 11. Also, in the fifth embodiment, if the instruction specified by the user's operation on the operation area 17 is to change the output of BGM data only, and the processing for changing the output of BGM data is processing for degrading the sound quality of the BGM, the process of S1502 in Fig. 11 is omitted in the fifth embodiment, and the process proceeds to processing for degrading sound quality from processing of S1501 in Fig. 11.

[0104] (12) In the sixth embodiment, if the instruction specified by the user's operation on the operation area 17 is only to set a parameter value for changing the output of BGM data, the processing from S1503 onwards in Fig. 11 is omitted in the sixth embodiment, and the processing proceeds from S1502 in Fig. 11 to S2301 in Fig. 18. Furthermore, if there are multiple types of parameters for changing the output of BGM data, after the processing of S1502 in Fig. 11, a process may be executed to select the type of parameter to be set based on the type of operation specified.

[0105] (13) In the fourth embodiment, the instruction specified by the user's operation on the operation area 17 may be an instruction to skip forward / backward through the BGM, i.e., an instruction to play BGM data different from the BGM data currently being played. In this case, the control unit 21C may start playing new BGM data before ending the playback of the currently played BGM data. In other words, the new BGM may fade in over the currently output BGM. In this case, the control unit 21C may adjust a parameter for setting the volume of the BGM so as to gradually decrease the volume of the currently output BGM and, conversely, gradually increase the volume of the new BGM that fades in. In this way, the currently output BGM can be faded out and the new BGM can be faded in without the user noticing the change in BGM. Furthermore, the playback position of the fade-in BGM is not limited to the intro of the BGM.

[0106] (14) In the fourth and sixth embodiments, a slide operation is an operation for fast-forwarding / fast-rewinding the currently output background music, and a long press operation is an operation for adjusting a parameter for setting the volume of the background music. However, these operations may be reversed. Furthermore, the operations associated with these processes are not limited to slide operations and long press operations. [Explanation of symbols]

[0107] 1, 1A, 1B, 1C: sound processing device, 11: top surface, 13: bottom surface, 15: side surface, 17, 17B: operation area, 19: detection unit, 21, 21C: control unit, 23, 23A, 23C: memory unit, 23a: program, 23b: sound data, 23c: background music data, 25: speaker, 27: interface, 29: operation unit, 171, 171B: first operation area, 172, 172B: second operation area, 173, 173B: third operation area, 174, 174B: fourth operation area, 210, 210C: determination unit, 211: operation type determination unit, 213: operation position determination unit, 220: sound data acquisition unit, 230: output unit

Claims

1. a detection unit that detects an operation by a user in an operation region including the first operation region; a control unit that switches between the start and end of playback of sound data based on the operation, and outputs a sound based only on one piece of sound data from the speaker while one piece of sound data is being played, and outputs a sound that is a mixture of the plurality of pieces of sound data from the speaker while a plurality of pieces of sound data are being played; Including, When a first operation in the first operation area is detected, the control unit starts reproducing first sound data corresponding to the first operation area, and while the first sound data and second sound data different from the first sound data are being reproduced, outputs a sound obtained by mixing the first sound data and the second sound data; When a second operation different from the first operation is detected in the first operation area while the first sound data and the second sound data are being played back, the control unit terminates the playback of the first sound data and outputs sound based only on the second sound data.

2. When the first operation is detected in a second operation area in the operation area that is different from the first operation area, the second sound data is started to be reproduced by the control unit; The sound processing device according to claim 1 , wherein the control unit terminates the reproduction of the second sound data when the second operation is detected in the second operation area.

3. The sound processing device according to claim 1 , wherein the control unit outputs a sound based on the second sound data based on an operation different from the operation on the operation area.

4. a storage unit configured to store a first data set including a plurality of sound data items associated with the first operation area; The sound processing device according to claim 1 , wherein the control unit selects predetermined sound data from the first data set based on a predetermined algorithm and reproduces the selected sound data as the first sound data.

5. 5. The sound processing device according to claim 4, wherein, while the first sound data is being played back, the control unit selects different sound data from the first data set at predetermined time intervals based on the predetermined algorithm, and plays the selected sound data as the first sound data.

6. The sound processing device according to claim 1 , wherein the first operation is a tap and the second operation is a slide.

7. a detection unit that detects an operation by a user in an operation area including a first operation area and a second operation area different from the first operation area; a control unit that outputs a sound obtained by mixing, at a predetermined mixing ratio, first sound data that is reproduced in response to the operation in the first operation area and second sound data that is different from the first sound data and that is reproduced in response to the operation in the second operation area; Including, The control unit Identifying an operation position in the operation area where the operation is detected; calculating a first distance between the operation position and a first reference position in the first operation area and a second distance between the operation position and a second reference position in the second operation area; The sound processing device determines the predetermined mixing ratio of the first sound data and the second sound data based on the first distance and the second distance.

8. The sound processing device according to claim 7 , wherein the predetermined mixing ratio changes over time.

9. The sound processing device according to claim 7 , wherein the predetermined mixing ratio is determined based on a magnitude relationship between the first distance and the second distance.

10. Detecting an operation by a user in an operation region including the first operation region; outputting a sound based only on one sound data while the sound data is being reproduced, and outputting a sound that is a mixture of the sound data while the sound data is being reproduced; Including, outputting the sound includes starting reproduction of first sound data corresponding to the first operation area in response to detection of a first operation in the first operation area; outputting the mixed sound includes outputting the sound obtained by mixing the first sound data and the second sound data while the first sound data and second sound data different from the first sound data are being reproduced; while the first sound data and the second sound data are being reproduced, in response to detection of a second operation in the first operation area that is different from the first operation, the reproduction of the first sound data is terminated and a sound based only on the second sound data is output; The sound processing method further comprises:

11. detecting an operation by a user in an operation area including a first operation area and a second operation area different from the first operation area; outputting a sound obtained by mixing, at a predetermined mixing ratio, first sound data to be reproduced in response to the operation in the first operation area and second sound data different from the first sound data to be reproduced in response to the operation in the second operation area; Including, outputting the mixed sound Identifying an operation position in the operation area where the operation is detected; calculating a first distance between the operation position and a first reference position in the first operation area and a second distance between the operation position and a second reference position in the second operation area; determining the predetermined mixing ratio of the first sound data and the second sound data based on the first distance and the second distance.

12. a detection unit that detects an operation by a user in an operation area; a control unit that outputs first sound data that is reproduced in response to a first operation in the operation area; Including, The control unit changing a playback position of the first sound data in accordance with an operation mode of the first operation and a second operation different from the first operation in the operation area; When the operation mode of the second operation satisfies a predetermined condition, the sound processing device starts playback of the first sound data from a playback position corresponding to the operation mode of the second operation, based on a current playback position, among one or more predetermined playback positions of the first sound data.

13. the operation mode of the second operation is a speed of the second operation, 13. The sound processing device according to claim 12, wherein the control unit, when the speed of the second operation is equal to or greater than a predetermined speed, plays the first sound data from a playback position corresponding to the speed of the second operation, based on a current playback position, among one or more predetermined playback positions of the first sound data.

14. the operation mode of the second operation is an operation time of the second operation, 13. The sound processing device according to claim 12, wherein the control unit, if the operation time of the second operation is equal to or longer than a predetermined operation time, plays the first sound data from a playback position corresponding to the operation time of the second operation, based on a current playback position, among one or more predetermined playback positions of the first sound data.

15. the operation mode of the second operation is a distance between an operation start position and an operation end position of the second operation, 13. The sound processing device according to claim 12, wherein, if the distance is equal to or greater than a predetermined distance, the control unit plays back the first sound data from a playback position corresponding to the distance, based on a current playback position, among one or more predetermined playback positions of the first sound data.

16. 16. The sound processing device according to claim 12, wherein the one or more predetermined playback positions of the first sound data are predetermined delimiter positions of a plurality of sections included in the music corresponding to the first sound data.

17. a detection unit that detects an operation by a user in an operation area; a control unit that outputs first sound data that is reproduced in response to a first operation in the operation area; Including, the control unit starts a process for changing an output of the first sound data in response to a second operation different from the first operation; The sound processing device, wherein the second operation is an action performed at two different positions in the operation area and having a corresponding relationship with each other.

18. a detection unit that detects an operation by a user in an operation area; a control unit that outputs first sound data that is reproduced in response to a first operation in the operation area; Including, The control unit setting a value of a parameter for changing an output of the first sound data based on an operation amount of a second operation in the operation area that is different from the first operation; The sound processing device sets the value of the parameter so that, during a predetermined period after the start of the second operation, the value of the parameter changes by a predetermined value or more from the value of the parameter before the second operation is detected.

Images