Operation assistance device, operation assistance method, and program

Abstract

Provided is an operation assistance device that assists execution of a function that requires at least one preparation procedure in a DJ machine, the operation assistance device comprising: an operation input acquisition unit that acquires an operation input indicating that a user executes the function in a prescribed mode; a preparation procedure execution unit that automatically executes the at least one preparation procedure when the operation input has been acquired; and a function execution unit that executes the function after the execution of the at least one preparation procedure.

Description

Operation support device, operation support method, and program

[0001] The present invention relates to an operation assistance device, an operation assistance method, and a program.

[0002] For example, as described in Patent Document 1, a technique is known in which information for practicing performance is presented in devices such as DJ players and DJ controllers operated by DJs (Disc Jockeys).

[0003] International Publication No. 2019 / 239486

[0004] The presentation of information as described in the above-mentioned Patent Document 1 is useful for mastering DJ play. However, DJ play often requires preparatory steps, such as selecting and loading songs, before the final performance, such as mix playback or scratch playback. The complexity of these preparatory steps can be an obstacle for beginners, for example, when trying to perform or practice a performance.

[0005] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide an operation assistance device, an operation assistance method, and a program that can facilitate the execution of functions that require preparation procedures in DJ equipment.

[0006] [1] An operation assistance device that assists a user in executing a function requiring at least one preparatory procedure in DJ equipment, the operation assistance device comprising: an operation input acquisition unit that acquires operation input indicating that the user wants to execute the function in a predetermined mode; a preparatory procedure execution unit that automatically executes the at least one preparatory procedure when the operation input is acquired; and a function execution unit that executes the function after the at least one preparatory procedure is executed. [2] The operation assistance device described in [1], further comprising a display control unit that displays a plurality of available functions on a screen, wherein the user selects a specific function from the plurality of functions displayed on the screen by the operation input. [3] The operation assistance device described in [2], wherein the display control unit displays the plurality of functions hierarchically on a screen, and the user selects the specific function from the plurality of functions in stages. [4] The operation assistance device described in [2] or [3], wherein the display control unit displays a description of how to operate the selected function on a screen. [5] The operation assistance device according to any one of [1] to [4], wherein the function includes a mixed playback of a first song and a second song, and the at least one preparatory step includes automatically selecting the second song that is compatible with the first song in the mixed playback and loading it onto a deck. [6] The operation assistance device according to any one of [1] to [5], wherein the function includes scratch playback, and the at least one preparatory step includes automatically selecting a song suitable for the scratch playback and loading it onto a deck. [7] The operation assistance device according to any one of [1] to [6], wherein the function includes playing using a pad, and the at least one preparatory step includes automatically assigning a sample sound source or an effect to the pad. [8] The operation assistance device according to any one of [1] to [7], wherein the function includes playing a song using an effect, and the at least one preparatory step includes switching the effect channel to a deck on which the song is loaded. [9] The operation assistance device according to any one of [1] to [8], wherein the operation input acquisition unit acquires the operation input via a GUI.

[10] The operation assistance device according to any one of [1] to [9], wherein the operation input acquisition unit acquires the operation input via voice input.

[11] An operation assistance device according to any one of [1] to

[10] , wherein the operation input acquisition unit acquires the operation input via a gesture input.

[12] An operation assistance method for assisting in the execution of a function requiring at least one preparatory procedure in DJ equipment, the operation assistance method including the steps of acquiring operation input from a user indicating that the function is to be executed in a predetermined mode, automatically executing the at least one preparatory procedure when the operation input is acquired, and executing the function after the at least one preparatory procedure is executed.

[13] A program for assisting in the execution of a function requiring at least one preparatory procedure in DJ equipment, the program causing a computer to execute the steps of acquiring operation input from a user indicating that the function is to be executed in a predetermined mode, automatically executing the at least one preparatory procedure when the operation input is acquired, and executing the function after the at least one preparatory procedure is executed.

[0007] FIG. 1 is a diagram showing the overall configuration of a system according to an embodiment of the present invention. FIG. 2 is a diagram showing the configuration of a DJ controller in the example of FIG. 1. FIG. 3 is a block diagram showing the functional configuration of an operation assistance device in the example of FIG. 1. FIG. 4 is a diagram for explaining user operations in the example of FIG. 1. FIG. 5 is a diagram showing a first example of an operation assistance function. FIG. 6 is a diagram showing a second example of an operation assistance function. FIG. 7 is a diagram showing a third example of an operation assistance function. FIG. 8 is a diagram showing a fourth example of an operation assistance function.

[0008] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted.

[0009] 1 is a diagram showing the overall configuration of a system according to an embodiment of the present invention. In a system 10 according to this embodiment, a smartphone 200, a PC (Personal Computer) 300, speakers 410 and 420, a microphone 500, and headphones 600 are connected to a DJ controller 100, which is an example of DJ equipment, either wired or wirelessly. For example, a USB (Universal Serial Bus) cable or an audio cable is used for the wired connection, and for example, Bluetooth (registered trademark) is used for the wireless connection.

[0010] The peripheral devices shown in the figure are illustrative and not limiting. For example, if a performance is not being distributed, the PC 300 may not be connected. Alternatively, regardless of whether a performance is being distributed or not, the PC 300 may be connected instead of the smartphone 200, or the smartphone 200 may be replaced by another terminal device such as a tablet. Furthermore, the microphone 500 and the headphones 600 may be integrated into a headset.

[0011] In the system 10 described above, the smartphone 200 stores, processes, and plays back audio data of music in response to user operation input acquired through the controls of the DJ controller 100 (described below). The smartphone 200 includes a display that displays information to the user. The smartphone 200 may also acquire user operation input directly through an input means such as a touch panel. The played back audio data is output, for example, from speakers 410 and 420, or distributed from the PC 300 via the Internet or the like. The microphone 500 is used for audio input during a performance, and the headphones 600 are used for monitoring.

[0012] Fig. 2 is a diagram showing the configuration of the DJ controller in the example of Fig. 1. The DJ controller 100 has, as controls, jog dials 101A and 101B, a crossfader 102, performance pads 103A and 103B, an effect adjustment knob 104, an effect activation button 105, and channel faders 106A and 106B. Using these controls, it is possible to control the playback of music and apply various effects to the audio data being played.

[0013] The DJ controller 100 described above is capable of independently playing back first audio data using the jog dial 101A, performance pads 103A, and channel fader 106A, and playing back second audio data using the jog dial 101B, performance pads 103B, and channel fader 106B. In the following description, the operation and processing system for playing back the first audio data will be referred to as deck A, and the operation and processing system for playing back the second audio data will be referred to as deck B. Meanwhile, the controls also include those that are common to deck A and deck B, such as the crossfader 102, effect adjustment knob 104, and effect start button 105.

[0014] For example, when playing back a mix of music using the DJ controller 100, the crossfader 102 is operated with music loaded onto both deck A and deck B. The crossfader 102 is an operator for controlling the balance of the playback volumes of deck A and deck B. Specifically, when the crossfader 102 is positioned at the end of the deck A side, the ratio of the playback volumes of deck A and deck B becomes A:B = 100:0, and conversely, when the crossfader 102 is positioned at the end of the deck B side, the ratio of the playback volumes of deck A and deck B becomes A:B = 0:100.

[0015] When scratching music using the DJ controller 100, the jog dials 101A and 101B and the crossfader 102 are primarily used. The jog dials 101A and 101B are controls for controlling the playback position of audio data played on Deck A and Deck B, respectively. Specifically, the user advances the playback position of the audio data by rotating the rotary controls jog dials 101A and 101B clockwise, and reverses the playback position by rotating them counterclockwise. In scratching, forward and reverse playback of the audio data is alternately performed by reversing the rotation direction of the jog dials 101A and 101B. In scratching, the crossfader 102 is used to mute the deck on which the scratch is being performed, i.e., temporarily set the playback volume to 0 to turn off the sound, repeatedly.

[0016] Note that the DJ controller 100 is configured in the same way as a normal DJ controller with respect to parts other than those controlled by the operation assistance device described below, including the jog dials 101A, 101B and the crossfader 102, and therefore a detailed description of these parts will be omitted. As controls related to the operation assistance function, the DJ controller 100 is provided with a function activation button 107 and a browse knob 108. Note that these controls do not necessarily have to be used only for the control described below, and may also have other uses.

[0017] 3 is a block diagram showing the functional configuration of the operation assistance device in the example of FIG. 1. In the system 10, the smartphone 200 also functions as the operation assistance device. In another embodiment, a PC 300 connected to the DJ controller 100 may function as the operation assistance device instead of the smartphone 200. In yet another example, DJ equipment itself, such as a mixer or an all-in-one DJ system (a digital audio player with communication and mixing functions), may function as the operation assistance device. The functions of the operation assistance device described below are realized by a processor, such as a CPU, included in these devices operating in accordance with a program stored in memory.

[0018] In the illustrated example, the smartphone 200, which is the operation assistance device, includes, as its functional components, an operation input acquisition unit 210, a preparation procedure execution unit 230, and a function execution unit 240. These functions will be described in detail below. Note that the functional components of the smartphone 200 other than those described above are the same as the functional components of a normal smartphone used in connection with DJ equipment, and therefore detailed description thereof will be omitted.

[0019] The operation input acquisition unit 210 acquires an operation input indicating that the user wants to execute a function in a predetermined mode. In the example of the system 10, the "predetermined mode" is a mode that automatically executes a preparatory procedure as described below, and this mode is activated when the user presses the function activation button 107 of the DJ controller 100. The function to be executed by the user is selected, for example, by rotating and pressing the browse knob 108, as in the example described below. An operation signal is transmitted from the DJ controller 100 to the smartphone 200 via wired or wireless communication. In this way, the operation assistance device itself does not need to have a means for receiving user operation input, and an operation signal indicating a user operation input made to another device may be transmitted to the operation assistance device. In another example, the smartphone 200 itself may receive user operation input via an input means such as a touch panel.

[0020] The display control unit 220 controls the display of the smartphone 200 to display a GUI (Graphical User Interface) for the operation input acquisition unit 210 to acquire operation input. As in the example described below, the display control unit 220 displays a plurality of available functions on the screen in the form of, for example, a list. In this case, operation input for selecting a specific function from the plurality of functions is acquired by rotating and pressing the browse knob 108 of the DJ controller 100. The display control unit 220 may display the plurality of functions hierarchically on the screen, allowing a specific function to be selected stepwise from the plurality of functions. The display control unit 220 may also display an explanation of how to operate the selected function on the screen.

[0021] It should be noted that in the embodiment of the present invention, the means for acquiring the user's operation input is not limited to a GUI, and for example, the operation input acquisition unit 210 may acquire the operation input via voice input using the microphone 500 or a microphone built into the smartphone 200, or via gesture input using a camera built into the smartphone 200. In these cases, the operation assistance device does not necessarily have to include the display control unit 220.

[0022] When the operation input acquisition unit 210 acquires the above-described operation input, the preparation procedure execution unit 230 automatically executes the preparation procedure for the selected function. The DJ controller 100 provides functions that require at least one preparation procedure, such as mix playback, scratch playback, playing using pads, and playing songs with effects, which will be described later. Such functions may, for example, change the volume, playback position, effects, etc., of the song being played. For such functions, the preparation procedure involves, for example, selecting a song or loading it onto a deck (the aforementioned Deck A or Deck B), and the function can only be executed after completing such preparation procedure. Note that the preparation procedure executed by the preparation procedure execution unit 230 is not limited to being executed within the smartphone 200; the preparation procedure execution unit 230 may execute the preparation procedure by transmitting a control signal to the DJ controller 100, etc.

[0023] The function execution unit 240 executes a function after the preparation procedure execution unit 230 executes the preparation procedure. The functions executed by the function execution unit 240 are not limited to those executed inside the smartphone 200; the function execution unit 240 may execute a function while transmitting a control signal to the DJ controller 100 or the like, or while receiving an operation signal from the DJ controller 100. Note that the DJ controller 100 may also provide a function that does not require a preparation procedure. When such a function is selected by an operation input acquired by the operation input acquisition unit 210, the function execution unit 240 executes the function without the preparation procedure execution unit 230 executing the preparation procedure. Similarly, when the function activation button 107 is not pressed on the DJ controller 100 and the mode for automatically executing the preparation procedure is not enabled, the preparation procedure execution unit 230 does not execute the preparation procedure, and instead, the function execution unit 240 executes the function after a preparation procedure, such as loading a song, is executed by the user's own operation.

[0024] FIG. 4 is a diagram illustrating user operations in the example of FIG. 1 . As shown in (a), the user presses the function activation button 107 to activate the operation assistance function. When the operation assistance function is activated, a list of multiple functions for which operation assistance is available is displayed on the display of the smartphone 200 as shown in (b). The user selects a specific function from the multiple functions by, for example, operating the browse knob 108 of the DJ controller 100. The function may be selected using a touch panel or the like of the smartphone 200. When the function is selected, a preparation procedure for the function is automatically executed, allowing the user to execute the function. At this time, an explanation of the operation method may be displayed on the display of the smartphone 200 as shown in (c).

[0025] FIG. 5 is a diagram showing a first example of an operation assistance function. In the illustrated example, as shown in (a), the user selects "I want to mix," which indicates the function of mix playback using the crossfader 102, from a list of functions. Then, as shown in (b), a list indicating the types of songs to be mixed and the atmosphere of the mix is ​​displayed on the screen. These can be considered functions that further subdivide the mix playback function. In other words, in this example, multiple functions of the DJ equipment are displayed hierarchically on the screen, and the user selects a specific function from multiple functions in stages. When the user selects the type of songs and the atmosphere of the mix, as shown in (c), songs for mix playback are automatically selected and loaded onto the deck, an explanation of the operation method is displayed on the screen, and further, a mix playback assistance function such as that described in International Publication No. WO 2022 / 230170 is activated.

[0026] In the above example, the preparation procedure for the mix playback function includes automatically selecting a second song that is compatible with a first song being played on one deck and loading it onto the other deck. For example, a song is determined to be compatible with the first song if it meets certain conditions, such as the tempo (BPM) of the selected song being the same as or close to the currently playing song, and the key of the selected song being the same as or closely related to the currently playing song. The song to be automatically loaded is selected based on the compatibility for mix playback as described above, as well as the type of song and the mix atmosphere specified in FIG. 5(b). It is also possible to select the mix playback function when no songs are being played on either deck. In this case, a first song automatically selected based on the specified type of song is loaded onto one deck and played, and a second song that is compatible with the first song is automatically selected and loaded onto the other deck.

[0027] Here, the type of music may be classified as recommended music or music tailored to the user's preferences, as in the illustrated example, or may be classified by genre, era, etc. The mix atmosphere represents, for example, the difference in musical characteristics between the music being played and the music being mixed. For example, a "classic mix" is a mix that makes the most of the compatibility of the music by gently adjusting the volume of each band or the entire music using an equalizer or channel fader, and by using effects that do not change the sound much. On the other hand, a "flashy mix" is a mix that makes a big change in sound by dynamically adjusting the volume of each band or the entire music using an equalizer or channel fader, and by using effects that change the sound dramatically.

[0028] FIG. 6 is a diagram showing a second example of an operation assistance function. In the illustrated example, as shown in (a), the user selects "Play with JOG" from the list of functions, which indicates scratch playback using the jog dials 101A and 101B. Then, as shown in (b), a song is automatically selected and loaded onto the deck, and an explanation of the operation method is displayed on the screen. In this example, the preparation procedure for the scratch playback function includes automatically selecting a song suitable for scratch playback and loading it onto the deck. Furthermore, an operation assistance function for scratch playback, such as that described in International Publication No. WO 2022 / 101979 or WO 2023 / 021602, may be activated.

[0029] For example, when a beginner tries to try or practice mix playback or scratch playback, the complicated process of selecting and loading songs before executing the function, and the difficulty of selecting the appropriate song can sometimes be obstacles to the attempt or practice. In the above example, when the user selects the mix playback or scratch playback function, the appropriate song is automatically selected and loaded, allowing the user to easily begin trying out or practicing mix playback or scratch playback. Automatically displaying instructions on how to operate the function or automatically activating an operation support function for mix playback or scratch playback also makes it easier for users to try out or practice mix playback or scratch playback.

[0030] FIG. 7 is a diagram illustrating a third example of an operation assistance function. In the illustrated example, as shown in (a), the user selects "I want to perform using PAD" from a list of functions, indicating performance using the performance pads 103A and 103B. Then, as shown in (b), a list showing the types of performance using the pads is displayed on the screen. This is a hierarchical display that further subdivides the pad performance functions. When the user selects "Perform with added sounds" as in the illustrated example, a sample sound source is automatically assigned to one of the performance pads 103A and 103B as shown in (c), and an explanation of how to operate the pads is displayed on the screen. In this example, the preparation procedure for the pad performance function includes assigning a sample sound source to the pad. On the other hand, when "Apply FX" is selected in FIG. 7(b), which activates an effect used during music playback with the pad, an effect is automatically assigned to one of the performance pads 103A and 103B, and an explanation of how to operate the pads is displayed on the screen. In this case, the preparation procedure for the pad performance function includes assigning an effect to the pad.

[0031] FIG. 8 is a diagram illustrating a fourth example of an operation assistance function. In the illustrated example, as shown in (a), the user selects "I want to play with effects" from a list of functions, which indicates playing music using effects. Then, as shown in (b), a list of effect types is displayed on the screen. This is a hierarchical display that further subdivides the function of playing music using effects. When the user selects "FX along with rhythm" as in the illustrated example, the effect channel is switched to the deck currently playing the music, as shown in (c), and an explanation of how to operate the function is displayed on the screen. In this example, the preparation procedure for playing music using effects includes switching the effect channel to the deck on which the music is loaded.

[0032] For example, when a beginner tries out or practices pad-based performance functions, the process of assigning sample sound sources and effects to each pad can be complicated, and selecting the appropriate sample sound source or effect can be challenging. When trying out or practicing effects-based music playback functions, the process of switching effect channels can be complicated or unrecognized. In the above example, the operation assistance function automatically performs these complicated or unrecognized steps, making it easy to start trying out or practicing functions. Automatically displaying instructions on the screen also makes it easy for users to try out and practice mix playback and scratch playback.

[0033] 10...System, 100...DJ controller, 101A, 101B...Jog dial, 102...Crossfader, 103A, 103B...Performance pad, 104...Effect adjustment knob, 105...Effect activation button, 106A, 106B...Channel fader, 107...Function activation button, 108...Browse knob, 200...Smartphone, 210...Operation input acquisition unit, 220...Display control unit, 230...Preparation procedure execution unit, 240...Function execution unit, 300...PC, 410, 420...Speakers, 500...Microphone, 600...Headphones.

Claims

1. An operation assistance device that assists in execution of a function that requires at least one preparation procedure in a DJ device, an operation input acquisition unit that acquires an operation input indicating that a user executes the function in a predetermined mode; a preparatory procedure execution unit that automatically executes the at least one preparatory procedure when the operation input is acquired; a function execution unit that executes the function after execution of the at least one preparatory procedure; An operation assistance device comprising:

2. a display control unit that displays a plurality of available functions on a screen; The operation assistance device according to claim 1 , wherein the user selects a specific function from the plurality of functions displayed on the screen by the operation input.

3. the display control unit displays the plurality of functions hierarchically on a screen; The operation assistance device according to claim 2 , wherein the user selects the specific function stepwise from a plurality of the functions.

4. The operation assistance device according to claim 2 , wherein the display control unit displays an explanation of how to operate the selected function on a screen.

5. the function includes a mixed playback of a first song and a second song; The operation assistance device according to claim 1 , wherein the at least one preparation procedure includes automatically selecting the second music piece that is compatible with the first music piece in the mixed playback and loading the second music piece onto a deck.

6. The function includes scratch playback, 2. The operation assistance device according to claim 1, wherein the at least one preparation procedure includes automatically selecting a piece of music suitable for the scratch playback and loading it onto a deck.

7. the function includes playing using a pad, The operation assistance device according to claim 1 , wherein the at least one preparation procedure includes automatically assigning a sample sound source or an effect to the pad.

8. The functionality includes playing music with effects, The operation assistance device according to claim 1 , wherein the at least one preparatory procedure includes switching a channel of the effect to a deck on which the music piece is loaded.

9. The operation assistance device according to claim 1 , wherein the operation input acquisition unit acquires the operation input via a GUI.

10. The operation assistance device according to claim 1 , wherein the operation input acquisition unit acquires the operation input via a voice input.

11. The operation assistance device according to claim 1 , wherein the operation input acquisition unit acquires the operation input via a gesture input.

12. 1. An operation assistance method for assisting DJ equipment in executing a function that requires at least one preparation procedure, comprising: obtaining an operation input from a user indicating that the function is to be executed in a predetermined mode; automatically executing the at least one preparatory procedure when the operational input is obtained; executing said function after execution of said at least one preparatory procedure; An operation assistance method including:

13. 1. A program for assisting in the execution of a function requiring at least one preparatory procedure in a DJ device, comprising: obtaining an operation input from a user indicating that the function is to be executed in a predetermined mode; automatically executing the at least one preparatory procedure when the operational input is obtained; executing said function after execution of said at least one preparatory procedure; A program that causes a computer to execute the following.