Acoustic device, acoustic device control method, and program

Abstract

Provided is an acoustic device comprising: a plurality of operating elements (21A, 21B, 31) that receive a user operation and are used in performing a musical piece; a selection unit (63) that selects a plurality of parameters relating to a search for musical pieces and defines a space with a plurality of axes according to the plurality of parameters; a display unit (4) that displays information on musical pieces on the space; a setting unit (64) that sets any one of the plurality of operating elements as an operating element to be used to adjust the amount of change in the parameter in accordance with each of the plurality of axes; and a search unit (65) that executes a search for musical pieces corresponding to the plurality of parameters on the basis of the user operation performed on the plurality of operating elements set by the setting unit.

Description

Audio device, audio device control method, and program

[0001] The present invention relates to an audio device, a control method for an audio device, and a program.

[0002] The music listening environment has changed dramatically with the spread of the Internet. For example, the source of music information is shifting from traditional fixed media to communication media such as Internet radio and streaming services. In response to these changes, the number of songs available for DJs (Disc Jockeys) to choose from is also increasing. Immediacy is extremely important when DJs search for songs. In particular, they are required to quickly search for a desired song while playing a music performance. Therefore, for example, Patent Document 1 discloses a music search device that searches for songs based on related information of song data.

[0003] Patent No. 6223120

[0004] DJs typically search for music by checking and searching their own playlists, by filtering based on genres or other categories, or by directly entering text. However, these methods lack immediacy, and a more efficient search method is desired. Furthermore, searching for music that is vague or unreliable can be difficult or impossible, creating a growing need for assistance. Therefore, the present invention aims to provide an audio device, an audio device control method, and a program that enable users to quickly and easily search for more suitable music.

[0005] [1] An audio device comprising: a plurality of controls used in playing music pieces in response to user operations; a selection unit that selects a plurality of parameters related to music search and defines a space on multiple axes in accordance with the plurality of parameters; a display unit that displays music information in the space; a setting unit that sets one of the plurality of controls corresponding to each of the multiple axes as a control to be used for adjusting the amount of change of the parameter; and a search unit that executes a search for music pieces in accordance with the plurality of parameters based on user operations on the plurality of controls set by the setting unit. [2] The audio device described in [1], wherein the plurality of parameters include parameters based on at least one of supplementary information about the music pieces and music analysis results related to the music pieces. [3] The audio device described in [1] or [2], wherein the plurality of controls include at least one of a control for adjusting the playback speed of the music pieces during music performance and a control for adjusting the volume of the music pieces during music performance. [4] The audio device described in any of [1] to [3], wherein the display unit includes a first display area that displays music information in the space and a second area that displays detailed information about the music pieces present in the space. [5] A control method for an audio device that receives user operations and has multiple operators used to play music, the control method for an audio device comprising the steps of: selecting multiple parameters related to searching for music and defining a space of multiple axes in accordance with the multiple parameters; displaying information about the music in the space; setting one of the multiple operators corresponding to each of the multiple axes as an operator to be used to adjust the amount of change in the parameter; and executing a search for music in accordance with the multiple parameters based on user operations on the set multiple operators.[6] A program for causing a computer to function as an acoustic device that accepts user operations and has multiple operators used to play music, the program comprising: a selection unit that selects multiple parameters related to searching for music and defines a space of multiple axes according to the multiple parameters; a display unit that displays music information in the space; a setting unit that sets one of the multiple operators corresponding to each of the multiple axes as an operator to be used to adjust the amount of change in the parameter; and a search unit that performs a search for music according to the multiple parameters based on user operations on the multiple operators set by the setting unit.

[0006] FIG. 1 is a schematic diagram showing an audio device according to an embodiment of the present invention; FIG. 2 is a block diagram showing a schematic functional configuration of an audio device according to an embodiment of the present invention; FIG. 3 is a schematic diagram illustrating a display according to an embodiment of the present invention; FIG. 4 is another schematic diagram illustrating a display according to an embodiment of the present invention; FIG. 5 is a flowchart illustrating an example of processing according to an embodiment of the present invention.

[0007] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted.

[0008] [General Configuration of the Audio Device] As shown in FIG. 1, the audio device 1 is a DJ system that integrates two players 2A and 2B that play music, a mixer 3 that controls the players 2A and 2B, and a display unit 4.

[0009] The acoustic device 1 includes operation units 21A and 21B provided on the players 2A and 2B, respectively, and an operation unit 31 provided on the mixer 3. The operation units 21A, 21B, and the operation unit 31 include a plurality of controls used in playing music. The operation unit 21A accepts user operations for the player 2A, and the operation unit 21B accepts user operations for the player 2B. The operation unit 31 also accepts user operations for the mixer 3.

[0010] The operation unit 21A includes a jog dial 211A, a tempo slider 212A, a cue button 213A, a play / pause button 214A, and a performance pad 215A.

[0011] More specifically, the jog dial 211A is a rotary operator that is used to set the playback direction and playback speed of a song being played on the player 2A. The tempo slider 212A is used to adjust the playback speed of a song being played on the player 2A. The cue button 213A is pressed to set a specific position in the song as a cue point. The play / pause button 214A is pressed to start or stop playback of a song on the player 2A. The performance pads 215A are general-purpose operators that can be assigned various functions related to playback control.

[0012] Like operation unit 21A, operation unit 21B includes a jog dial 211B, a tempo slider 212B, a cue button 213B, a play / pause button 214B, and a performance pad 215B. For example, when a user operates operation unit 21A of player 2A, sound device 1 plays back music loaded in player 2A and applies effects to the music being played back as necessary. The same is true for player 2B.

[0013] In response to user operations, the mixer 3 switches music playback between the players 2A and 2B, adjusts the volume of each channel, and performs playback with effects applied. The operation unit 31 of the mixer 3 includes effect selection knobs 311A ​​and 311B, effect amount adjustment knobs 312A and 312B, channel faders 313A and 313B, and a crossfader 314.

[0014] More specifically, the effect selection knobs 311A ​​and 311B are used to select the effect to be applied to the music being played on the players 2A and 2B, respectively. The effect amount adjustment knobs 312A and 312B are used to adjust parameters such as the depth and magnitude of the effect to be applied to the music being played on the players 2A and 2B, respectively. The channel faders 313A and 313B are used to adjust the output volume level of the music being played on the players 2A and 2B, respectively.

[0015] The crossfader 314 is an operator for adjusting the volume balance between a first song played on the player 2A, which is the first channel, and a second song played on the player 2B, which is the second channel.

[0016] The display unit 4 includes a display 41 and a touch panel 42 that is provided to cover the display area of ​​the display. The touch panel 42 detects the position of contact by the user and outputs information such as coordinates indicating the contact position, thereby allowing the display unit 4 to also function as an operation unit.

[0017] Effects in players 2A and 2B and mixer 3 include, for example, effects that apply effects such as delay, echo, reverb, or loop to a song to reproduce effect sounds, and effects that process the original sound and reproduce it.

[0018] Fig. 2 is a block diagram showing a schematic functional configuration of the audio device 1 according to this embodiment. In addition to the above-mentioned components, the audio device 1 also includes a music data storage unit 5, a control unit 6, and an audio output unit 7, as shown in Fig. 2. The functions of the above-mentioned components are realized by a processor operating according to a program in an audio device having the hardware configuration of a computer, for example. The functions of the components will be further described below.

[0019] The music data storage unit 5 is configured to be able to store music data using a hard disk drive (HDD), flash memory, etc. The music data storage unit 5 stores music data for a plurality of songs in a predetermined format such as MP3 format.

[0020] In this embodiment, the music data stored in the music data storage unit 5 and playable on the audio device 1 includes various types of information in the form of metadata, etc., as additional information for the music data. Examples of the additional information include the song title, artist name, artwork, album name, release date, composer name, lyricist name, arranger name, key, and performance time.

[0021] The control unit 6 is implemented in the audio device 1 by, for example, a communication interface, a processor such as a CPU (Central Processing Unit), and a memory that serves as a working area, and controls the operation of the audio device 1. The control unit 6 includes a reception unit 61, a playback control unit 62, a selection unit 63, a setting unit 64, and a search unit 65, which are realized by the processor operating in accordance with a program stored in the memory or received via the communication interface.

[0022] The reception unit 61 receives user operations via the operation units 21A and 21B, the operation unit 31, and the touch panel 42. The playback control unit 62 controls at least one of the playback position, the playback speed, and the playback direction when playing back music. Based on user operations via the playback control unit 62, the operation units 21A and 21B, the operation unit 31, and the touch panel 42, playback control of the audio data of music is performed.

[0023] The selection unit 63 selects a plurality of parameters related to song search and defines a space with multiple axes in accordance with the plurality of parameters. The plurality of parameters are parameters based on at least one of the supplementary information of the song and the song analysis results related to the song, and may be selected in advance or may be selected based on a user operation or the like.

[0024] Note that the music analysis is performed, for example, on the tempo and music waveform of the music indicated by the audio data, and the music analysis results include beat position information, bar position information, development change points, genre, BPM, and melody of the music indicated by the audio data. Such music analysis is performed based on existing music analysis technology. These music analysis items are just an example, and analysis may be performed on music analysis items other than those described above. Furthermore, the music analysis items may be user-configurable.

[0025] The setting unit 64 sets operators to be used for adjusting the amount of change in the parameters, corresponding to each of the multiple axes in the space described above. The operators may be set automatically from predetermined options, or may be set based on a user operation or the like.

[0026] The search unit 65 searches for music based on the user's operation on the operator set by the setting unit 64. The function and operation of each unit of the control unit 11 will be described in detail later.

[0027] The audio device 1 may also be configured to include a communications interface, and acquire music data stored in an external storage device, a computer, or the like via the communications interface (not shown), and store the music data in the music data storage unit 5. In this case, the audio device 1 does not include the music data storage unit 5, and the external storage device functions as the music data storage unit 5. The audio output unit 7 includes an audio output terminal, such as a speaker terminal or a headphone terminal, and outputs the audio signal of the music output by the playback control unit 62 as audio information.

[0028] [Display on the audio device 1] Fig. 3 shows an example of a display screen displayed on the display unit 4. As shown in Fig. 3, the display unit 4 displays a display area A1 in which information about player 2A is displayed and a display area A2 in which information about player 2B is displayed side by side. Furthermore, the display unit 4 displays a display area A3 in which information about song search is displayed.

[0029] As shown in Figure 3, display area A3 includes display area a1, which displays a list of songs to be searched for, display area a2, which displays recommended songs, display area a3, which displays search results, and display area a4, which displays detailed information about display area a3.

[0030] A list of search targets for songs is displayed in the display area a1. Search targets include songs stored in the song data storage unit 5 of the audio device 1, songs stored in external devices connectable to the audio device 1, and songs that the audio device 1 can acquire from streaming services via the Internet. In addition to the list of search targets for songs exemplified in FIG. 3, the display area a1 may also display icons such as folders. Recommended songs are displayed in the display area a2. Targets of recommendations include popular songs, the latest songs, songs based on playback history, etc.

[0031] The search results are displayed in the display area a3. FIG. 4 is an enlarged view of the display area a3 in FIG. 3. As shown in FIG. 4, a search window P1 and a graph P2 are displayed in the display area a3. The search window P1, like various known search windows, is used to input search keywords when searching for songs by keyword. Furthermore, a search using the search window P1 may be prioritized. For example, when a search is performed using the search window P1, only songs that match the search using the search window P1 may be subject to a search using the graph P2, which will be described later.

[0032] The graph P2 includes a selection window W1 indicating an X-axis parameter, a selection window W2 indicating a Y-axis parameter, and a graph indicating a space defined by the X-axis and Y-axis. The selection windows W1 and W2 are used to select parameters related to song retrieval. In the example of FIG. 4 , parameters to be assigned to the X-axis and Y-axis, respectively, can be selected from a plurality of predetermined parameters using the selection windows W1 and W2. The parameters related to song retrieval are selected by the selection unit 63 as described above, and a space with multiple axes is defined according to the selected plurality of parameters. The parameters related to song retrieval are parameters based on at least one of additional information about songs and song analysis results related to songs.

[0033] In the example of Fig. 4, the parameter "Year" is selected for the X-axis, and the parameter "Energy" is selected for the Y-axis. For "Year," it is possible to graph it based on, for example, the "Release Date" included in the supplementary information of the music data. For "Energy," it is possible to graph it based on, for example, information such as "Genre," "BPM," and "Music Style" from the music analysis.

[0034] Furthermore, graph P2 displays information about songs searched for according to the above-mentioned parameters. In the example of Fig. 4, songs M1 to M6 are displayed. Songs M1 to M6 may be displayed using icons or may be displayed using information such as song artwork. Furthermore, the number of songs for which information is displayed on graph P2 may be set by the user.

[0035] Furthermore, for graph P2, controls used to adjust the amount of change of the corresponding parameter are set corresponding to each of the multiple axes. The controls used to adjust the amount of change of the parameter are set by the setting unit 64 as described above, and the amount of change of the parameter is adjusted based on user operation of the set controls. Here, the controls used to adjust the amount of change of the parameter are basically the same as those used when playing music, and include at least one of a control for adjusting the playback speed of the music when playing music and a control for adjusting the volume of the music. Examples of controls for adjusting the playback speed of the music when playing music include tempo sliders 212A and 212B and jog dials 211A and 211B. Examples of controls for adjusting the volume of the music include channel faders 313A and 313B and crossfader 314.

[0036] The setting unit 64 sets an operator to be used for adjusting the amount of change corresponding to each axis for each of the parameters selected by the above-described selection unit 63. The setting of the operator by the setting unit 64 may be configured to be automatically set from predetermined options, or may be configured to be set based on a user operation or the like.

[0037] For example, the X-axis may always have tempo slider 212A set as the operator used to adjust the amount of change of the parameter, and the Y-axis may always have tempo slider 212B set as the operator used to adjust the amount of change of the parameter. Also, graph P2 may have information indicating the operator that is set to be assigned to adjust the amount of change of the parameter displayed near selection window W1 showing the X-axis parameter and selection window W2 showing the Y-axis parameter.

[0038] Furthermore, operators other than the above-mentioned operators may be set as operators used to adjust the amount of change of a parameter. In this case, for parameters for which it is desirable to adjust the amount of change continuously and steplessly, it is preferable to set an operator that can be operated continuously and steplessly, and for parameters for which it is desirable to adjust the amount of change stepwise or selectively, it is preferable to set an operator that can be operated stepwise or selectively.

[0039] Display area a4 displays detailed information about the songs M1 to M6 displayed in display area a3. As shown in Fig. 4, display area a4 displays detailed information about the songs corresponding to songs M1 to M6 displayed in display area a3. As shown in Fig. 4, the detailed information may include, for example, the song title, artist name, artwork, album name, release date, composer name, lyricist name, arranger name, key, and performance time, which are included as additional information.

[0040] Note that the display contents of each display area in Figures 3 and 4 are merely examples, and the types and contents of elements included in each display area, as well as the arrangement of each element, are not limited to these examples. For example, if a three-axis space is defined by three parameters, music information may be displayed in the three-axis space as shown in Figure 5. Furthermore, the axes defining the space are not limited to straight lines and may be curved. Furthermore, graph P2 may be configured to be expandable or contractible in response to user operations.

[0041] With regard to the display described above, the search unit 65 searches for songs in accordance with the parameters selected by the selection unit 63 based on the user's operation on each operator set by the setting unit 64. The search unit 65 searches for songs for each parameter selected by the selection unit 63 in accordance with the amount of change based on the user's operation on each operator set by the setting unit 64.

[0042] The search unit 65 may, for example, extract features from multiple parameters and search for songs based on the similarity between the extracted features. When extracting text data from multiple parameters, the features may be extracted using an encoder trained by contrastive learning using a loss function based on the similarity between the extracted features. This configuration allows the relationship between parameters and song features to be learned in advance, enabling searches that better reflect the user's intent.

[0043] As explained above, the user can freely select multiple parameters related to song searches and adjust the amount of change of the parameters corresponding to each of the multiple axes in a space of multiple axes defined by the multiple parameters. For example, when the user is searching for a song that he or she has a vague or uncertain memory of, he or she can quickly and easily search for the song by selecting a parameter that will give a hint about the song, for example, a parameter that indicates the characteristics of the song, even if he or she has a vague or uncertain memory of the song.

[0044] Also, for example, when a user searches for a song that has elements that are vague or uncertain in their memory, by selecting parameters that are reliably remembered, the search can be narrowed down based on reliable information, allowing for a quick and easy search for songs.

[0045] 6 is a flowchart showing an example of processing in the embodiment. First, the control unit 6 determines whether a song search is being performed (step S101). If it is determined that a song search is being performed (YES in step S101), the control unit 6 selects parameters using the selection unit 63 (step S102). Whether a song search is being performed may be determined, for example, from the operation details performed on the operation units 21A, 21B, and 31, or may be determined based on whether a mode such as a "song search mode" is set.

[0046] In the first processing, predetermined arbitrary parameters are selected as parameters, and in the second and subsequent processing, parameters are selected based on user operations.

[0047] Next, the control unit 6 sets the operators using the setting unit 64 (step S103). As described above, the operator settings may be configured to be automatically set from predetermined options, or may be configured to be set based on a user operation, etc. The operators used to adjust the parameter change amount are basically the same as the operators used when playing a piece of music, and when it is determined in step S101 that a piece of music search is being performed, these operators function as operators used to adjust the parameter change amount, unlike when playing the actual piece of music.

[0048] The control unit 6 then executes a search for songs using the search unit 65 (step S104), and displays song information on the display unit 4 based on the search results (step S105). As described above, the search for songs is executed based on the user's operations on the controls set in step S103 for the parameters selected in step S102.

[0049] Next, the control unit 6 determines whether the parameters have been changed (step S106), and if it determines that the parameters have been changed (step S106: YES), the process returns to step S102. Here, changing the parameters means changing the parameters used for searching for songs. If it determines that the parameters have been changed (step S106: YES), the control unit 6 selects new parameters based on the parameter changes in step S102. In other words, the control unit 6 changes the parameters used for searching for songs and performs the subsequent processes.

[0050] On the other hand, if it is determined that the parameter has not been changed (step S106: NO), the control unit 6 determines whether the amount of change in the parameter has been adjusted (step S107), and if it is determined that the amount of change in the parameter has been adjusted (step S107: YES), the control unit 6 returns to step S104.

[0051] Here, adjusting the parameter change amount means adjusting the change amount based on the user's operation on the operator set in step S103. If it is determined that the parameter change amount has been adjusted (step S107: YES), the control unit 6 searches for songs again in step S104 based on the adjusted parameter change amount, and displays song information on the display unit 4 based on the search results in step S105. In other words, the control unit 6 searches for songs again and updates the display on the display unit 4.

[0052] Through this process, each time the user changes the parameters used to search for songs, the processes from step 102 onward are executed, and song search and display are repeated. Also, each time the user adjusts the amount of change in the parameters, the processes from step 104 onward are executed, and song search and display are repeated.

[0053] Effects of the Embodiment According to the configuration of the embodiment of the present invention described above, the audio device 1 receives user operations, includes operation units 21A, 21B, and 31 including multiple operators used in playing music, selects multiple parameters related to music search, defines a space with multiple axes in accordance with the multiple parameters, and displays music information in the defined space on the display unit 4. Corresponding to each of the multiple axes, one of the multiple operators is set as an operator used to adjust the amount of change in the parameter, and a music search is performed in accordance with the multiple parameters based on user operations on the set multiple operators. Therefore, even when searching for a music that is vague or uncertain, a more suitable music search can be performed quickly and easily.

[0054] In particular, with the configuration of this embodiment, the controls used in playing music, i.e., controls that the user is familiar with, can also be used to adjust the amount of parameter change, thereby improving ease of use for the user and realizing intuitive operation, and also eliminating the need for new dedicated controls.

[0055] The parameters include parameters based on at least one of the accompanying information of the song and the song analysis results, so that a user can select suitable parameters to search for songs depending on the situation, such as the purpose of the song search.

[0056] Furthermore, according to the configuration of the embodiment, the display unit 4 includes a display area a3, which is a first display area that displays information about songs in the space, and a display area a4, which is a second display area that displays detailed information about songs present in the space, as described with reference to Fig. 3. Therefore, by appropriately referring to both display areas, it is possible to efficiently search for songs.

[0057] In the above-described embodiment, a DJ system has been described as an example of an audio device that integrates two players 2A and 2B, a mixer 3, and a display unit 4. However, the present invention may also be applied to audio devices that use computers, tablet devices, and mobile phones. The present invention may also be applied to players, mixers that control players, DJ controllers without playback functions, electronic musical instruments, karaoke equipment, game machines, and the like.

[0058] Although several embodiments of the present invention have been described in detail above with reference to the accompanying drawings, the present invention is not limited to these examples. It is clear that a person skilled in the art to which the present invention pertains can conceive of various modifications and alterations within the scope of the technical idea described in the claims, and it is understood that these also naturally fall within the technical scope of the present invention.

[0059] 1...sound device, 2A, 2B...player, 3...mixer, 4...display unit, 5...music data storage unit, 6...control unit, 7...audio output unit, 21A, 21B, 31...operation unit, 41...touch panel, 61...reception unit, 62...playback control unit, 63...selection unit, 64...setting unit, 65...search unit, 211A, 211B...jog dial, 212A, 212B...tempo slider, 213A, 213B...cue button, 214A, 214B...play / pause button, 215A, 215B...performance pad, 311A, 311B...effect selection knob, 312A, 312B...effect amount adjustment knob, 313A, 313B...channel fader, 314...crossfader.

Claims

1. An audio device comprising: a plurality of operators that receive user operations and are used to play music; a selection unit that selects a plurality of parameters related to searching for music and defines a space of multiple axes according to the plurality of parameters; a display unit that displays information about the music in the space; a setting unit that sets one of the plurality of operators corresponding to each of the plurality of axes as an operator to be used to adjust the amount of change in the parameter; and a search unit that performs a search for the music according to the plurality of parameters based on the user operations on the plurality of operators set by the setting unit.

2. The audio device according to claim 1, wherein the plurality of parameters include parameters based on at least one of supplementary information of the music piece and music analysis results relating to the music piece.

3. An audio device as described in claim 1 or claim 2, wherein the plurality of operators include at least one of an operator for adjusting the playback speed of the music when the music is being played, and an operator for adjusting the volume of the music when the music is being played.

4. An acoustic device as described in any one of claims 1 to 3, wherein the display unit includes a first display area that displays information about the music in the space, and a second area that displays detailed information about the music present in the space.

5. A control method for an audio device that receives user operations and has multiple operators used to play music, comprising the steps of: selecting multiple parameters related to music search and defining a space of multiple axes in accordance with the multiple parameters; displaying information about the music in the space; setting one of the multiple operators corresponding to each of the multiple axes as an operator to be used to adjust the amount of change in the parameter; and executing a search for the music in accordance with the multiple parameters based on the user operations on the set multiple operators.

6. A program for causing a computer to function as an audio device that receives user operations and has multiple controls used to play music, comprising: a selection unit that selects multiple parameters related to searching for music and defines a space of multiple axes in accordance with the multiple parameters; a display unit that displays information about the music in the space; a setting unit that sets one of the multiple controls corresponding to each of the multiple axes as the control to be used to adjust the amount of change in the parameter; and a search unit that performs a search for the music in accordance with the multiple parameters based on the user operations on the multiple controls set by the setting unit.

Images