Information processing device and operation reproduction program

Abstract

An information processing device (3) comprises: a reproduction information acquisition unit (366) that acquires operation reproduction information in which an acoustic control operation on an acoustic control device (2) having an operator that receives the acoustic control operation is recorded; an operation reproduction unit (370) that reproduces the acoustic control operation on the basis of the operation reproduction information acquired by the reproduction information acquisition unit; and an image generation unit (371) that generates an image indicating the content of the sound control operation reproduced by the operation reproduction unit.

Description

Information processing device and operation reproduction program

[0001] The present invention relates to an information processing device and an operation reproduction program.

[0002] A music remix system has been known in the past that allows a DJ to perform DJ performances by operating a DJ play screen to remix and play multiple sound materials (see, for example, Patent Document 1). In the music remix system described in Patent Document 1, a DJ play screen operated by a user is displayed on a display unit. The DJ play screen includes a main power gear that rotates clockwise at a speed corresponding to a master tempo, two gear-shaped placeholders attached to the outer periphery of the main power gear, multiple music gears, and multiple material gears. Each of the multiple music gears is associated with a different music piece, and each of the multiple material gears is associated with a different loop material. When a music gear or material gear is placed in a placeholder, the music piece or loop material corresponding to the placed gear is played. The DJ play screen is provided with a volume slider and a tempo slider. When the volume slider is operated, the balance between the volume of the audio associated with one of the two placeholders and the volume of the audio associated with the other placeholder is adjusted. When the tempo slider is operated, the master tempo is changed, and the rotation speed of the main power gear is also changed according to the changed master tempo.

[0003] When multiple users are performing DJ sets together, the user's operations on the DJ play screen are transmitted to the application server via the network, and the application server then transmits a DJ play screen reflecting the operations to each user's terminal device. As a result, the same DJ play screen is displayed on each user's terminal device. When a user initiates playback of a new song or loop material, a content server controlled by the application server provides the corresponding audio data to each user's terminal device.

[0004] JP 2014-52469 A

[0005] In recent years, DJ equipment has become widespread, and the number of users using DJ equipment has increased. Beginners who are unfamiliar with operating DJ equipment often try to master the technique by watching videos of advanced DJs using their equipment. However, in such videos, the DJ equipment is often obscured by parts of the advanced DJ's body, making it difficult to understand how the advanced DJ is operating it. Meanwhile, when videos containing music or audio with copyright or other rights are shared, there is a risk of copyright issues arising.

[0006] An information processing device according to a first aspect of the present invention comprises a reproduction information acquisition unit that acquires operation reproduction information that records an audio control operation performed on an audio control device having an operator that accepts the audio control operation, an operation reproduction unit that reproduces the audio control operation based on the operation reproduction information acquired by the reproduction information acquisition unit, and an image generation unit that generates an image showing the content of the audio control operation reproduced by the operation reproduction unit.

[0007] An operation reproduction program according to a second aspect of the present invention is an operation reproduction program executed by at least one processor, and causes the at least one processor to execute a reproduction information acquisition step of acquiring operation reproduction information that records a sound control operation for a sound control device having an operator that accepts the sound control operation, an operation reproduction step of reproducing the sound control operation based on the acquired operation reproduction information, and an image generation step of generating an image showing the reproduced sound control operation.

[0008] 1 is a diagram illustrating a configuration of an operation reproduction system according to an embodiment. A diagram illustrating an overview of the functions of the operation reproduction system according to an embodiment. A block diagram illustrating a configuration of an information processing device according to an embodiment. A block diagram illustrating the functional configuration of a control unit according to an embodiment. A diagram illustrating part of operation log information included in operation reproduction information according to an embodiment. A diagram illustrating an example of an operation screen according to an embodiment. A diagram illustrating an example of an operation reproduction screen according to an embodiment. A diagram illustrating a discrepancy between a playback position of a song and elapsed time in operation log information according to an embodiment. A diagram illustrating a first technique according to an embodiment. A diagram illustrating the first technique according to an embodiment. A diagram illustrating a second technique according to an embodiment. A diagram illustrating the second technique according to an embodiment. A diagram illustrating an example of an editing screen according to an embodiment. A diagram illustrating an example of an operation status image according to an embodiment. A diagram illustrating a first operation status display section of an operation status image according to an embodiment. A diagram illustrating a second operation status display section of an operation status image according to an embodiment. A diagram illustrating a crossfader status display section of an operation status image according to an embodiment. A diagram illustrating an effect status display section of an operation status image according to an embodiment. A diagram illustrating an example of a mix content image according to an embodiment. A schematic diagram illustrating a configuration of an operation reproduction system according to a first application example. A diagram illustrating an example of an SNS screen according to a second application example.

[0009] An embodiment of the present invention will be described below with reference to the accompanying drawings. [Configuration of Operation Reproduction System] FIG. 1 is a diagram illustrating the configuration of an operation reproduction system 1A according to this embodiment. As shown in FIG. 1, the operation reproduction system 1A according to this embodiment includes an operation device 2, an information processing device 3 that inputs operation information corresponding to input operations on the operation device 2, and a display device 4 connected to the information processing device 3. The information processing device 3 is configured to be connectable to a network N such as the Internet and can communicate with servers SV1 and SV2 connected to the network N. The servers SV1 and SV2 are not limited to computers but also include storage that can be used as a file server. An example of the server SV2 is a server for a music distribution service. Note that, in this specification, DJ operations correspond to audio control operations and include, for example, operations to control the playback position of music, operations to modify the tone, and operations to control the volume of music. Examples of playback position control operations include scratching, variable speed playback, reverse playback, loop playback, and moving the playback position using the controls on the operation device. Examples of tone processing operations include equalizer (EQ) operations and effect (Fx) operations. Examples of music volume operations include fader operations such as channel faders and cross faders.

[0010] [Overview of Operation Reproduction System] FIG. 2 is a diagram illustrating an overview of the functions of the operation reproduction system 1A. In the operation reproduction system 1A, as shown in FIG. 2, the information processing device 3 records the details of DJ operations as operation reproduction information based on operation information and song identification information input from the operation device 2 in response to DJ operations by the user US on the operation device 2. The information processing device 3 is capable of editing the recorded operation reproduction information and uploading the operation reproduction information to the server SV1 shown in FIG. 1. The operation reproduction information includes operation log information indicating the details of DJ operations by the user US on the controls of the operation device 2 and song identification information for identifying the target song that is the target of the DJ operation. The song identified by the song identification information is the song that was the target of the operation when the operation reproduction information was recorded. Hereinafter, the song identified by the song identification information will be referred to as the target song.

[0011] The information processing device 3 can reproduce the DJ operations of the user US by acquiring pre-recorded operation reproduction information or operation reproduction information generated by another information processing device 3. Reproducing a DJ operation involves reading the operation reproduction information and executing a process similar to the process corresponding to the operation information received from the operation device 2 during the DJ operation. For example, reproducing a DJ operation involves, when a controller is operated a predetermined time after the start of recording of the operation reproduction information, executing a process corresponding to the operation of the controller after the same time has elapsed since the operation reproduction process based on the operation reproduction information was started. When reproducing a DJ operation, the information processing device 3 generates an image showing the details of the DJ operation based on the operation log information of the operation reproduction information using the second image generation unit 371 (described later) and displays the image on the display device 4. This visualizes the recorded DJ operation of the user. Furthermore, if the information processing device 3 holds a target song identified by song identification information, the information processing device 3 plays the target song according to the details of the DJ operation based on the operation log information. This reproduces the playback of the target song according to the recorded DJ operation. In this way, the operation reproduction system 1A can be said to be a DJ operation visualization system that visualizes the DJ operations of the user. Each component of the operation reproduction system 1A will be described below.

[0012] 1 and 2 is a DJ device such as a DJ controller or a DJ mixer, and is an audio control device having operators that allow DJ operations to be performed. Although detailed illustration is omitted, for example, the operation device 2 has various operators such as a jog dial, a crossfader, a channel fader, etc., as well as a rotary operator that can adjust the volume level of the high frequency band, the volume level of the mid frequency band, the volume level of the low frequency band, the volume level of the input signal, and the application rate of effects.

[0013] 1 is configured with various display panels such as liquid crystal displays. The display device 4 displays an image according to an image signal input from the information processing device 3. In this embodiment, the information processing device 3 is configured with a notebook PC (Personal Computer), and therefore the display device 4 is integrated with the information processing device 3. However, the present invention is not limited to this, and the display device 4 may be a display separate from the information processing device 3.

[0014] [Configuration of Information Processing Device] Figure 3 is a block diagram showing the configuration of the information processing device 3. The information processing device 3 is configured, for example, by a PC capable of executing music management software. The information processing device 3 executes the music management software and plays pre-stored music based on operation signals input from the operation device 2. The information processing device 3 generates and stores operation reproduction information that records the details of DJ operations performed by the user US on the operation device 2. Furthermore, the information processing device 3 reproduces the DJ operations performed by the user US based on the operation reproduction information. As shown in Figure 3, the information processing device 3 includes an input unit 31, an output unit 32, a communication unit 33, a storage unit 34, a memory 35, and a control unit 36, which are electrically connected by a bus line BL.

[0015] The input unit 31 and the output unit 32 have terminals connectable to external devices. The input unit 31 outputs signals input from external devices to the control unit 36. Examples of external devices connected to the input unit 31 include the operation device 2, a pointing device, a keyboard, and an external storage device storing music data. The external storage device is included in the storage unit of the present invention. An example of a terminal constituting the input unit 31 is a USB (Universal Serial Bus) terminal. The output unit 32 outputs information input from the control unit 36 ​​to the external device. Examples of external devices connected to the output unit 32 are the display device 4, speakers, and headphones. Examples of terminals constituting the output unit 32 are a USB terminal, a video output terminal, and an audio output terminal.

[0016] The communication unit 33 communicates with external devices such as servers SV1 and SV2 on the network N under the control of the control unit 36. For example, the communication unit 33 receives operation reproduction information from the server SV1 and outputs it to the control unit 36, and also transmits operation reproduction information generated by the control unit 36 ​​to the server SV1. The communication unit 33 can also receive music data from a server SV2 that is different from the server SV1. The information and data received by the communication unit 33 are stored in the storage unit 34 by the control unit 36. For example, music data received from the server SV2 is stored in the storage unit 34.

[0017] The storage unit 34 is configured with storage devices such as an HDD (Hard Disk Drive) and an SSD (Solid State Drive), and stores programs and data for operating the information processing device 3. For example, the storage unit 34 stores an OS (Operating System) and music management software that control the information processing device 3, as well as an operation reproduction program for executing the operation reproduction process described below. In other words, the storage unit 34 is a recording medium that stores the operation reproduction program. Furthermore, for example, the storage unit 34 can store multiple pieces of music data and operation reproduction information. The memory 35 is a work memory for the control unit 36.

[0018] [Configuration of Control Unit] Fig. 4 is a block diagram showing the functional configuration of the control unit 36. The control unit 36 ​​is configured with at least one processor such as a CPU (Central Processing Unit) and controls the operation of the information processing device 3. The control unit 36 ​​has multiple functional units that are realized when the processor executes programs stored in the storage unit 34. For example, as shown in Fig. 4, the control unit 36 ​​has an operation acquisition unit 361, a first music acquisition unit 362, a first music playback unit 363, a reproduction information generation unit 364, a first image generation unit 365, a reproduction information acquisition unit 366, an identification information acquisition unit 367, a second music acquisition unit 368, a second music playback unit 369, an operation reproduction unit 370, a second image generation unit 371, and an operation editing unit 372.

[0019] The operation acquisition unit 361 acquires an operation signal from among signals input from an external device connected to the input unit 31. For example, the operation acquisition unit 361 acquires an operation signal input from an operation device 2 connected to the information processing device 3. The first music acquisition unit 362 acquires, from the storage unit 34, music data corresponding to the music selected by the user, based on the acquired operation signal.

[0020] The first music playback unit 363 plays the music data acquired by the first music acquisition unit 362 based on the operation signal acquired by the operation acquisition unit 361. For example, when an operation signal corresponding to an operation on the jog dial of the controller device 2 is acquired, the first music playback unit 363 changes the playback speed and playback direction of the music based on the acquired operation signal. Also, for example, when an operation signal corresponding to an operation on the channel fader of the first channel on the controller device 2 is acquired, the first music playback unit 363 increases or decreases the volume level of the music being played on the first channel based on the acquired operation signal.

[0021] The reproduction information generating unit 364 generates operation reproduction information that records the content of the user's DJ operations on the operation device 2. Specifically, the reproduction information generating unit 364 generates operation reproduction information by recording the operation content corresponding to the operation signal input from the operation device 2 in chronological order from the start of recording. In other words, the reproduction information generating unit 364 generates operation reproduction information by recording the user's DJ operations on the operation device 2 in chronological order from the start of recording. The generated operation reproduction information is stored in the storage unit 34.

[0022] [Contents of Operation Reproduction Information] The operation reproduction information includes operation log information and music identification information, as shown in Fig. 2. The operation reproduction information is a file in a format that can be transmitted to the server SV1 or the like.

[0023] [Contents of Operation Log Information] FIG. 5 shows a portion of operation log information LG included in the operation reproduction information. The operation log information is information that records, for each operator, the operation details of operators operated by the user among the operators of the operation device 2, along with the elapsed time since the start of recording of the DJ operation. That is, the operation log information includes a plurality of pieces of audio control information that record each of a plurality of audio control operations. Specifically, as shown in FIG. 5, the operation log information LG is information in which records RC, each of which includes a record number RN, an elapsed time ET from the start of recording, an operator type SC indicating the operated operator, a channel number CN of the channel on which the operated operator is located, and an operator position SP indicating the position of the operator after operation, are arranged in the order of the record number RN. The operator type SC, the channel number CN, and the operator position SP correspond to operation content information.

[0024] The record number RN is, for example, an integer value. The record number RN is incremented each time an operation signal is input. A record RC including the record number RN is generated by the reproduction information generator 364, and the generated record RC is added to the operation log information LG. In other words, the record number indicates the order of the recorded operations. However, the record number is not necessary. The channel number CN of a controller shared by each channel is "0." The channel number CN of the controller for the first channel is "1," and the channel number CN of the controller for the second channel is "2." An example of a controller shared by each channel is a crossfader. The controller position SP of a controller other than the jog dial is set to an absolute value within the operable range of the controller. On the other hand, since the jog dial can be continuously rotated clockwise and counterclockwise, the absolute position of the jog dial cannot be recorded. Therefore, if the operated operator is a rotary operator that can be rotated infinitely, such as a jog dial, the operator position SP is set to a relative position based on the position before the operation.

[0025] The operation log information includes time adjustment information TA, which aligns the playback position of the song with the operation timing of the controls when reproducing the DJ operations. The time adjustment information TA is information for aligning the position on the time axis based on the elapsed time ET of the operation reproduction information with the playback position of the song. In other words, the time adjustment information TA is information that associates the elapsed time ET from the start of recording the DJ operations with the playback position of the song. Specifically, the time adjustment information TA is at least one record RC that includes a record number RN, the elapsed time ET, and the playback position PP of the target song corresponding to the elapsed time ET. The playback position PP of the target song is, for example, the playback position from the beginning of the song and is indicated by time. The time adjustment information TA is recorded every time a predetermined amount of time has elapsed since the start of recording the DJ operations, and is also recorded every time an operation that changes the playback position of the song is performed. For example, the time adjustment information TA is recorded when a jog dial that changes the playback speed and playback direction of the song is operated, and when an operation that changes the playback state of the song is performed. Examples of operations that change the playback state of a song include starting playback, stopping playback, reverse playback, and changing the tempo.

[0026] [Song Identification Information] Song identification information is information for identifying the song whose playback is controlled by the DJ operation indicated in the operation log information LG. In other words, song identification information is information that can uniquely identify the song that was being played when the DJ operation was recorded. Examples of song identification information include song metadata. Song metadata includes the song title, artist name, genre, album name, track order on the album, lyricist name, composer name, arranger name, performance time, production code, and product number. In this embodiment, song identification information is information including the song title, artist name, and album name. Additionally, song identification information may be parameter values ​​based on the analysis results of song data, or parameter values ​​calculated using a predetermined function from information such as the song title and artist name. Note that the operation replay information includes song identification information for the song used when the operation replay information was recorded. Therefore, if multiple songs were used when the operation replay information was recorded, the operation replay information includes song identification information for each target song.

[0027] 4 generates an image to be displayed on the display device 4. The first image generation unit 365 outputs the generated image to the display device 4 via the output unit 32, thereby displaying the generated image on the display device 4. For example, the first image generation unit 365 generates an image of the runtime screen G1 of the music management software shown in FIG.

[0028] FIG. 6 is a diagram showing an example of the operation screen G2. For example, the first image generation unit 365 generates an image of the operation screen G2 that is displayed when recording or reproducing DJ operations. As shown in FIG. 6 , the operation screen G2 includes a record start button G21, a record stop button G22, a reset button G23, and a play button G24. The operation screen G2 also includes display areas for the elapsed time from the start of recording, the playback time of the song, and the currently playing deck and the BPM of that deck. The record start button G21 is a button for starting recording of DJ operations. The record stop button G22 is a button for stopping recording of DJ operations. The reset button G23 is a button for erasing recorded DJ operations. In other words, the reset button G23 is a button for erasing generated operation reproduction information. The play button G24 is a button for loading recorded operation reproduction information and reproducing DJ operations based on the operation reproduction information. When the play button G24 is pressed and any operation reproduction information is selected by the user from the operation reproduction information stored in the storage unit 34, the operation reproduction process is executed.

[0029] The reproduction information acquisition unit 366, the identification information acquisition unit 367, the second music acquisition unit 368, the second music playback unit 369, the operation reproduction unit 370, and the second image generation unit 371 shown in FIG. 4 constitute an operation reproduction processing unit RP. The operation reproduction processing unit RP executes an operation reproduction process in which the control unit 36 ​​executes an operation reproduction program to reproduce DJ operations based on the operation reproduction information. The reproduction information acquisition unit 366 acquires operation reproduction information selected by the user from the operation reproduction information stored in the storage unit 34. Alternatively, the reproduction information acquisition unit 366 acquires operation reproduction information from the server SV1 via the communication unit 33. The identification information acquisition unit 367 acquires music identification information included in the operation reproduction information acquired by the reproduction information acquisition unit 366. The second music acquisition unit 368 acquires music data of a target song identified by the music identification information acquired by the identification information acquisition unit 367 from the music data stored in the storage unit 34. Note that there are cases in which music data of the target song is not stored in the storage unit 34. In such a case, the second music acquisition unit 368 may acquire music data of the target music from the server SV2, or may output a signal indicating that music data of the target music cannot be acquired to the second music playback unit 369. The music data acquired from the server SV2 by the second music acquisition unit 368 is stored in the storage unit 34. The storage of music data here includes temporary storage by the storage unit 34.

[0030] The second music playback unit 369 plays the music data acquired by the second music acquisition unit 368. At this time, the second music playback unit 369 changes the playback state of the target music in accordance with the user's DJ operation on the operation device 2 reproduced by the operation reproduction unit 370. Note that if the second music acquisition unit 368 cannot acquire the music data of the target music, the second music playback unit 369 does not play the music data.

[0031] The operation reproducing unit 370 reproduces the DJ operations based on the operation reproduction information acquired by the reproduction information acquisition unit 366. Specifically, the operation reproducing unit 370 analyzes the operation log information of the operation reproduction information, and controls the playback of the target song by the second music playback unit 369 based on the operation log information. More specifically, the operation reproducing unit 370 reproduces the DJ operations of the user on the operation device 2 at the time the operation reproduction information was recorded, based on the operation log information of the acquired operation reproduction information, and controls the playback of the target song in accordance with the reproduced DJ operations.

[0032] FIG. 7 is a diagram showing an example of the operation reproduction screen G3. The second image generation unit 371 generates an image of the operation reproduction screen G3 shown in FIG. 7. Specifically, the second image generation unit 371 generates an image of the operation reproduction screen G3 showing the DJ operations performed on the operation device 2 and the contents of the DJ operations reproduced by the operation reproduction unit 370 based on the operation reproduction information, and displays the generated image on the display device 4. In addition, the second image generation unit 371 generates an operation status image P1 and a mix content image P2, which will be described later. In other words, the second image generation unit 371 generates an image that visualizes the DJ operations reproduced by the operation reproduction unit 370.

[0033] The operation reproduction screen G3 includes a first song information display section G31, a second song information display section G32, an operation display section G33, a menu button G34, a speed adjustment button G35, a reproduction start button G36, and a reproduction position display bar G37. The first song information display section G31 and the second song information display section G32 are located at the top of the operation reproduction screen G3. The first song information display section G31 is located on the left side and displays information about the first song among the target songs. Specifically, the first song information display section G31 displays the title, playback time, remaining playback time, and BPM of the first song, as well as waveform information about the first song. The waveform information is a graph of signal strength according to the playback time of the song, with the horizontal axis representing the playback time of the song and the vertical axis representing the signal strength of the song. The second song information display section G32 is located on the right side and displays information about the second song among the target songs. The display content of the second music information display section G32 is the same as that of the first music information display section G31.

[0034] The operation display unit G33 displays a device image G331 in which the operation device 2 is viewed in plan view. Specifically, the operation display unit G33 displays a plurality of operators that the operation device 2 has at the same positions as the respective positions of the plurality of operators on the operation device 2. The second image generation unit 371 draws the content of the DJ operation on the operation device 2 reproduced by the operation reproduction unit 370 and displays it on the operation display unit G33. That is, the second image generation unit 371 visualizes the DJ operation reproduced by the operation reproduction unit 370 on the operation display unit G33.

[0035] For example, the second image generation unit 371 generates an image in which the position of a partial image indicating a control of a channel indicated by a channel number CN, among the controls indicated by the control type SC in the record RC of the operation log information LG corresponding to the elapsed time since the start of the operation reproduction process, is moved to the control position SP. In other words, the second image generation unit 371 moves the position of a partial image indicating a control corresponding to the control type SC and channel number CN, among the controls included in the device image G331, to a position corresponding to the control position SP according to the elapsed time. As a specific example, if the control indicated by the control type SC in the acquired record RC is a channel fader and the channel number CN of the record RC is "2," the second image generation unit 371 generates an operation reproduction screen G3 in which the partial image indicating the operation knob of the channel fader of the second channel is moved to a position corresponding to the control position SP of the record RC.

[0036] For example, the second image generation unit 371 generates an image showing the movement direction or rotation direction of a control for a channel indicated by a channel number CN, among the controls indicated by the control type SC in the record RC of the operation log information LG corresponding to the elapsed time since the operation reproduction process was started, using a graphic FG such as an arrow based on the control position SP. In other words, the second image generation unit 371 displays a graphic FG such as an arrow indicating the operation direction and rotation direction of the control near a control corresponding to the control type SC and deck number DN among the controls in the device image G331, based on the control position SP corresponding to the elapsed time. As a specific example, if the control indicated by the control type SC in the acquired record RC is a jog dial and the channel number CN of the record RC is "1," the second image generation unit 371 generates an operation reproduction screen G3 in which a graphic FG, an arrow indicating the operation direction of the rotary control, is arranged on a partial image indicating the jog dial for the first channel, based on the control position SP of the record RC.

[0037] For example, the second image generation unit 371 highlights or displays a graphic such as a circle on the operator of the channel indicated by the channel number CN among the operators indicated by the operator type SC in the record RC of the operation log information LG corresponding to the elapsed time since the start of the operation reproduction process. That is, the second image generation unit 371 highlights or displays a graphic such as a circle on the operator corresponding to the operator type SC and channel number CN among the operators in the device image G331 in accordance with the elapsed time, thereby distinguishing the operator from the other operators. As a specific example, if the operator indicated by the operator type SC in the acquired record RC is a first sampler pad and the channel number CN of the record RC is "2," the second image generation unit 371 generates an operation reproduction screen G3 in which a partial image indicating the first sampler pad of the second channel is highlighted, or an operation reproduction screen G3 in which a graphic FG such as a circle is superimposed on the partial image indicating the first sampler pad.

[0038] The operation display unit G33 can also display information related to the reproduced DJ operation. For example, the second image generation unit 371 displays a speech bubble SB containing information related to the DJ operation on the operation display unit G33. Examples of information related to the DJ operation include the amount of operation of the controller, the value of a parameter changed by the reproduced operation, information identifying the DJ device used when the operation reproduction information was recorded, and the settings of the DJ application when the operation reproduction information was recorded. Examples of the amount of operation of the controller include the amount of movement of the controller, a numerical value indicating the position of the controller, and the rotation angle of the controller. In the example of FIG. 7 , the speech bubble SB indicates the amount of movement of the crossfader in the direction of the arrow. If the operation of a controller that sets the value of a specific parameter is recorded in the operation log information LG, the parameter value may be the value of the parameter changed in response to the operation of the controller. For example, if the operation log information LG records a press of the loop button, the parameter value is the "number of bars of the loop" set by pressing the loop button. Displays including this information are sequentially set in the operation display section G33 by the second image generation section 371. As a result, the contents of the reproduced DJ operations and information related to the reproduced DJ operations are set in the operation display section G33, and operation reproduction screens G3 including the operation display sections G33 are sequentially displayed.

[0039] The menu button G34 is a button that displays a menu screen (not shown). The menu screen includes, for example, a selection item for selecting a device image G331 of an operation device displayed on the operation display unit G33. When reproducing another user's DJ operation based on the acquired operation reproduction information, for example, a device image G331 that resembles the model of the operation device 2 used by the user is displayed, making it easier to understand the other user's DJ operation. For this reason, the second image generation unit 371 displays the device image G331 selected by the user on the operation display unit G33 and visualizes the operations performed on the controls included in the device image G331 based on the reproduced DJ operation. This makes it easier for the user to understand the content of the DJ operation performed by the other user.

[0040] The speed adjustment button G35, reproduction start button G36, and reproduction position display bar G37 allow the content of the DJ operations displayed on the operation display unit G33 to be manipulated like a video. The speed adjustment button G35 is a button that synchronizes and increases or decreases the playback speed of the target music by the second music playback unit 369 and the reproduction speed of the DJ operations by the operation reproduction unit 370. In the example of the operation reproduction screen G3 shown in FIG. 7 , the speed adjustment button G35 includes buttons for adjusting the speed to 0.5x, 0.75x, 1x, 1.25x, and 1.5x. The operation reproduction unit 370 reproduces the DJ operations at a speed corresponding to the input button and causes the second music playback unit 369 to play the target music at the speed corresponding to the input button. When the reproduction speed of the DJ operations is increased or decreased using the speed adjustment button G35, the display update speed of the operation display unit G33 also increases or decreases in synchronization with the reproduction speed of the DJ operations. In this way, the operation reproducing unit 370 synchronizes and increases or decreases the speed at which the DJ operation is performed, which is reproduced based on the operation reproduction information, and the playback speed of the target song played by the second music playback unit 369. Note that the reproduction speed of the DJ operation and the playback speed of the target song may be configured so that the user can set them to any desired speeds.

[0041] The reproduction start button G36 is a button that starts the operation reproduction process of the DJ operation based on the operation reproduction information. When the reproduction start button G36 is pressed, the operation reproduction process starts, and the second music playback unit 369 starts playing the target music, and the operation reproduction unit 370 starts reproducing the DJ operation based on the operation reproduction information. Note that when the reproduction start button G36 is pressed again, the operation reproduction process is paused. The reproduction position display bar G37 is a bar provided with a slider G371 that indicates the current reproduction position of the DJ operation based on the operation reproduction information. The user can adjust the reproduction position by sliding the slider G371 along the reproduction position display bar G37. Based on the position of the slider G371, the operation reproduction unit 370 changes the reproduction position of the DJ operation and also changes the playback position of the target music by the second music playback unit 369. Note that the operation reproduction screen G3 may also be provided with a button that moves the reproduction position back a predetermined time from the current reproduction position and a button that moves the reproduction position forward a predetermined time from the current reproduction position.

[0042] [Adjusting the Reproduction Position Based on Time Adjustment Information] FIG. 8 is a diagram illustrating a discrepancy between the playback position of a song by the operation reproduction unit 370 and the elapsed time in the operation log information LG. Here, because the operation reproduction information and the song data are separate files, there is a possibility that the timing of the DJ operation performed during reproduction based on the elapsed time ET in the operation log information LG may differ from the playback position of the target song corresponding to the timing of the DJ operation performed during recording. For example, as shown in the upper part of FIG. 8 , when the operation log information LG is recorded, if the start time of recording the operation log information LG is time ET0, the start time of playback of the target song is time ET1, and the timing of the DJ operation is time ET2, when reproduction of the DJ operation based on the operation log information LG is started, playback of the song begins when the elapsed time from time ET0 reaches time ET1, as shown in the lower part of FIG. 8 . Then, when the elapsed time reaches time ET2, the DJ operation based on the operation log information LG is performed.

[0043] However, even if the playback position of the target song corresponding to the elapsed time when the DJ operations were recorded differs from the playback position of the target song corresponding to the elapsed time when the DJ operations were reproduced for some reason, such as a delay from the start of playback of the song from time ET1, the DJ operations based on the operation log information LG will be performed when the elapsed time reaches time ET2. In other words, even if the playback position ET3 indicated by the time adjustment information TA in the operation log information LG does not match the playback position of the target song, the DJ operations will be reproduced according to the elapsed time from time ET0. In such a case, the timing at which the DJ operations were performed on the target song will differ between when the DJ operations were recorded and when the DJ operations were reproduced. Therefore, even if the DJ operations on the target song are reproduced, the song played when the DJ operations are reproduced will be different from the song played when the DJ operations were recorded.

[0044] Furthermore, if the reproduction clock of a DJ operation based on the operation log information LG differs from the playback clock of the target song, a discrepancy occurs between the timing of a certain DJ operation based on the operation log information LG and the playback position of the target song where that DJ operation is supposed to be performed. This discrepancy accumulates as the playback of the target song progresses. Therefore, as the reproduction process of the DJ operation based on the operation log information LG progresses, the discrepancy increases, and, similar to when the playback start position of the target song is shifted, the playback of the song at the time the DJ operation was recorded cannot be faithfully reproduced. For these reasons, in order to properly reproduce the DJ operation based on the operation log information LG, it is necessary to align the position on the time axis based on the elapsed time ET of the operation log information LG with the playback position of the target song. Note that in the example shown in the lower part of Figure 8, if the DJ operation based on the operation log information LG is performed at time ET4, which is the time ET2 plus the difference between the playback position indicated by the time adjustment information TA of the operation log information LG and the playback position of the target song, the DJ operation on the target song will be performed at the appropriate timing.

[0045] In response to this, the operation reproducing unit 370 aligns, based on the time adjustment information TA included in the operation log information LG, a position on the time axis based on the elapsed time ET of the operation log information LG with the playback position of the target song being played by the second music playback unit 369. Specifically, the operation reproducing unit 370 synchronizes the elapsed time ET of the operation log information LG with the playback position of the target song being played by the second music playback unit 369 so that the playback position PP of the time adjustment information TA matches the playback position of the target song being played by the second music playback unit 369, and then reproduces the DJ operation according to the elapsed time ET and causes the second music playback unit 369 to play the target song. At this time, the operation reproducing unit 370 implements either a first method of aligning the playback position of the target song with the playback position of the time adjustment information TA, or a second method of aligning the read position of the operation log information LG including the time adjustment information TA with the playback position of the target song. That is, when the operation reproducing unit 370 reads the time adjustment information TA, if the playback position indicated by the time adjustment information TA does not match the playback position of the target song, the operation reproducing unit 370 uses either the first method or the second method to match the playback position indicated by the time adjustment information TA with the playback position of the target song. Hereinafter, the playback position indicated by the time adjustment information TA is referred to as the playback position at the time of recording, and the playback position of the target song is referred to as the current playback position.

[0046] [Contents of the Time Adjustment Process] First, when the operation reproducing unit 370 reads the time adjustment information TA at time ET3, it determines whether the playback position during recording and the current playback position match. If the playback position during recording and the current playback position match, the first and second methods for aligning the playback position during recording and the current playback position are not performed. On the other hand, if it is determined that the playback position during recording and the current playback position do not match, the operation reproducing unit 370 determines whether the current playback position is delayed relative to the playback position during recording.

[0047] [First Method for Moving the Current Playback Position] FIGS. 9 and 10 are diagrams illustrating the first method. Specifically, FIG. 9 illustrates a case where the current playback position is delayed from the playback position at the time of recording, and FIG. 10 illustrates a case where the current playback position is ahead of the playback position at the time of recording. Note that FIGS. 9 and 10 separately illustrate the range from time ET0 to time ET3, the range from time ET3 to time ET2, and the range after time ET3 in the operation log information. Also, FIGS. 9 and 10 separately illustrate the range between the playback position at the time of recording recorded at time ET1 and time ET3 in the target song, the range between the playback position at the time of recording and the timing of the first DJ operation performed after the playback position at the time of recording, and the range after the timing of the first DJ operation performed. In the first method, when the song playback position is delayed from the playback position at the time of recording, the operation reproduction unit 370 calculates the difference between the playback position at the time of recording and the current playback position, as shown in FIG. 9 , and moves the current playback position ahead by the calculated difference. In other words, the operation reproducing unit 370 omits a part of the target song from the playback position during recording by the calculated difference, thereby aligning the playback position during recording with the current playback position.

[0048] In the first technique, when the music playback position is not delayed relative to the playback position at the time of recording, i.e., when the music playback position is ahead of the playback position at the time of recording, the operation reproducing unit 370 calculates the difference between the playback position at the time of recording and the current playback position, as shown in FIG. 10 , and delays the current playback position by the calculated difference. For example, the operation reproducing unit 370 delays the current playback position. In this way, the operation reproducing unit 370 aligns the playback position at the time of recording with the current playback position. In this way, in the first technique, the operation reproducing unit 370 aligns the current playback position of the target music with the playback position at the time of recording, acquires the record RC from time ET3 onwards when the time adjustment information TA was recorded, and reproduces the DJ operation according to the elapsed time ET.

[0049] [Second Method for Moving the Reading Position of Operation Log Information] Figures 11 and 12 are diagrams illustrating the second method. More specifically, Figure 11 illustrates a case where the current playback position is delayed from the playback position during recording, and Figure 12 illustrates a case where the current playback position is ahead of the playback position during recording. Note that Figures 11 and 12 separately illustrate the range from time ET0 to time ET3, the range from time ET3 to time ET2, and the range after time ET2 in the operation log information. Furthermore, Figures 11 and 12 separately illustrate the range between the playback position during recording recorded at time ET1 and time ET3 in the target song, the range between the playback position during recording and the timing of the first DJ operation after the playback position during recording, and the range after the timing of the first DJ operation. In the second technique, when the current playback position is delayed relative to the playback position during recording, the operation reproducing unit 370 calculates the difference between the current playback position and the playback position during recording, waits for the calculated difference before reading the operation log information LG, and adjusts the read position of the operation log information LG, as shown in Fig. 11. In this way, the operation reproducing unit 370 aligns the playback position during recording with the current playback position.

[0050] In the second technique, when the music playback position is ahead of the playback position at the time of recording, the operation reproducing unit 370 calculates the difference between the playback position at the time of recording and the current playback position, as shown in FIG. 12 , and advances the read position of the operation log information LG by the calculated difference. That is, the operation reproducing unit 370 moves the read position of the operation log information LG backward from time ET2 by the calculated difference. In this way, the operation reproducing unit 370 aligns the playback position at the time of recording and the current playback position. In this way, in the second technique, the operation reproducing unit 370 aligns the read position of the operation log information LG with the current playback position, acquires the record RC after the time adjustment information TA, and reproduces the DJ operation according to the elapsed time ET.

[0051] By using the first or second method, DJ operations based on the operation log information LG are reproduced at the playback position of the target song when the DJ operations were recorded, so the DJ operations at the time the operation reproduction information was recorded can be faithfully reproduced, and song playback corresponding to the DJ operations can be realized. Note that the operation reproduction unit 370 may combine the first and second methods. For example, if the song playback position is delayed relative to the playback position at the time of recording, one of the first or second methods may be implemented, and if the song playback position is ahead of the playback position at the time of recording, the other of the first or second methods may be implemented.

[0052] [Example of Editing Screen] FIG. 13 shows an example of an editing screen G4 for editing a recorded scratch operation. The waveform shown in the upper part of FIG. 13 is a waveform representing a recorded scratch operation, and the waveform shown in the lower part of FIG. 13 is a waveform representing a scratch operation edited by the first user. In FIG. 13, a reference line SL indicates the reference position of the jog dial. The area above the reference line SL indicates the relative position to the reference position when the jog dial is rotated clockwise, and the area below the reference line SL indicates the relative position to the reference position when the jog dial is rotated counterclockwise. Vertical lines in FIG. 13 indicate beat positions. The operation editing unit 372 shown in FIG. 4 edits the operation reproduction information stored in the memory unit 34 based on an operation signal input from the input unit 31. When a user edits a recorded scratch operation, the operation editing unit 372 displays the editing screen G4 shown in FIG. 13.

[0053] For example, if a scratch operation on the jog dial of the operation device 2 is not synchronized with the beat, the waveform generated by the operation editing unit 372 based on the operation log information will have a vertical line indicating the beat position and the return position of the scratch operation not aligned, as shown in portion W11 of the waveform W1 in the upper part of FIG. 13 . In response to this, as shown in the lower part of FIG. 13 , the scratch operation can be synchronized with the beat by operating the pointer PT included in the editing screen G4 with a pointing device or the like to align the return position in portion W11 with the vertical line. The operation editing unit 372 can also add new DJ operations to the operation reproduction information stored in the storage unit 34 using another editing screen (not shown). Based on the editing content on the editing screen G4, the operation editing unit 372 updates the operation log information LG of the operation reproduction information stored in the storage unit 34.

[0054] [Operation Status Image] FIG. 14 is a diagram showing an example of an operation status image P1 that shows the details of DJ operations based on operation reproduction information for each operator on the DJ equipment. The second image generation unit 371 generates the operation status image P1, an example of which is shown in FIG. 14, as an image showing the details of DJ operations read from the operation reproduction information by the operation reproduction unit 370. The operation status image P1 is an image that shows the operation status of each operator on the DJ equipment, the contents of the target songs loaded when the DJ operations are reproduced, and the sequence of the target songs. For example, the operation status image P1 is an image that shows the operation status of each operator according to the elapsed time since the start of recording of the operation reproduction information. In other words, the operation status image P1 is one of the images that show the results of reproducing the DJ operations by the operation reproduction unit 370, and is an image that shows the operation status of each operator on the DJ equipment and the playback status of the target songs. The operation status image P1, an example of which is shown in FIG. 14, includes a first song information display area P11, a second song information display area P12, and a details display area P13.

[0055] [Configuration of First Song Information Display Unit and Second Song Information Display Unit] The first song information display unit P11 displays information about a first song being played on a first channel. Specifically, the first song information display unit P11 displays the name of the first song, the BPM of the first song, the playback position of the first song, the remaining time of the first song, the waveform of the first song, and the song structure of the first song. The second song information display unit P12 displays information about a second song being played on a second channel. Specifically, the second song information display unit P12 displays the name of the second song, the BPM of the second song, the playback position of the second song, the remaining time of the second song, the waveform of the second song, and the song structure of the second song. Note that the information about songs displayed on each song information display unit P11, P12 is not limited to the above. For example, each song information display unit P11, P12 only needs to display at least the name of the song and does not need to display at least one of the other pieces of information. Furthermore, each of the song information display sections P11 and P12 may display information about the song other than the above.

[0056] [Configuration of the Detail Display Section] The detail display section P13 displays the operation details of the controls based on the operation log information of the operation reproduction information and the playback status of music on each channel, with the elapsed time included in the operation log information of the operation reproduction information represented on the horizontal axis. The detail display section P13 is located below the first music information display section P11 and the second music information display section P12 in the operation status image P1. The detail display section P13 includes a first operation status display section P14, a second operation status display section P15, a crossfader status display section P16, and an effect status display section P17. In the detail display section P13, the first operation status display section P14, the crossfader status display section P16, the second operation status display section P15, and the effect status display section P17 are arranged in order from top to bottom, and each of the display sections P14 to P17 extends along the horizontal axis representing the elapsed time.

[0057] [Configuration of First Operation Status Display Unit] Fig. 15 is a diagram showing the first operation status display unit P14. The first operation status display unit P14 displays the playback status of the first music piece and the operation status of each operator provided for the first channel along with the elapsed time in the operation reproduction information. As shown in Figs. 14 and 15, the first operation status display unit P14 includes a time display unit TD that indicates the elapsed time included in the operation log information, as well as a first playback status display unit P14A, a first fader status display unit P14B, and a first equalizer status display unit P14C.

[0058] The first playback status display area P14A displays the playback status of the first song. As shown in FIG. 15 , the first playback status display area P14A displays the playback period of the first channel using a rectangle P141. The timing at which the song was loaded is indicated by the elapsed time corresponding to the left edge of the rectangle P141 representing the playback period. The rectangle P141 also contains characters indicating the track number of the song. The first playback status display area P14A displays the timing at which the CUE button was pressed using a downward-pointing black triangle symbol P142. The first playback status display area P14A also displays the duration for which the CUE button was pressed using a line symbol P143 connecting the two symbols P142. Pressing the CUE button during playback of a song stops playback of that song. The first playback status display area P14A displays the timing at which the START / PAUSE button was pressed using a downward-pointing white triangle symbol P144.

[0059] The first fader status display section P14B displays the operating status of the first channel fader. As shown in FIG. 15 , the first fader status display section P14B has an effective range set along the vertical direction, with the upper end of the effective range indicating the position of the first channel fader when the volume level of the first channel is maximum, and the lower end of the effective range indicating the position of the first channel fader when the volume level of the first channel is minimum. The first fader status display section P14B then displays the position of the first channel fader according to elapsed time using a line P146. In the example of FIG. 15 , during the period from 0 minutes 0 seconds to 2 minutes 40 seconds of elapsed time indicated by the horizontal axis, the first fader status display section P14B indicates that the first channel fader is positioned at the position where the volume level of the first channel is maximum. Also, in the example of Figure 15, during the period from 3 minutes 25 seconds to 6 minutes 0 seconds, the first fader status display section P14B indicates that the first channel fader is positioned at the position where the volume level of the first channel is at its minimum.

[0060] The first equalizer status display section P14C displays the operation status of the controls for adjusting the volume level of the high-frequency band, the mid-frequency band, and the low-frequency band. These controls are, for example, rotary controls such as rotary volume controls. As shown in FIG. 15 , the first equalizer status display section P14C has an effective range set along the vertical direction, with the upper end of the effective range indicating the position of the control when the volume level of the corresponding band is maximum, and the lower end of the effective range indicating the position of the control when the volume level of the corresponding band is minimum. The first equalizer status display section P14C then displays the position of each control over elapsed time using lines P147, P148, and P149. Specifically, in the first equalizer state display section P143, the position of the operator for adjusting the volume level of the high frequency band is displayed by a line P147, the position of the operator for adjusting the volume level of the mid frequency band is displayed by a line P148, and the position of the operator for adjusting the volume level of the low frequency band is displayed by a line P149. The colors of the lines P147, P148, and P149 may be different from each other, and the line types of the lines P147, P148, and P149 may be different from each other.

[0061] [Configuration of Second Operation Status Display Section] FIG. 16 is a diagram showing the second operation status display section P15. As shown in FIGS. 14 and 16, the second operation status display section P15 displays the playback status of the second music piece and the operation status of each operator provided for the second channel in chronological order from the start of reading of the operation reproduction information. Specifically, the second operation status display section P15 includes a time display section TD, as well as a second playback status display section P15A, a second fader status display section P15B, and a second equalizer status display section P15C. The second playback status display section P15A displays the playback status of the second music piece. The configuration of the second playback status display section P15A is the same as the configuration of the first playback status display section P14A. That is, as shown in FIG. 16 , the second playback status display section P15A displays the playback period of the second channel using a rectangle P151, the timing when the CUE button is pressed using a symbol P152 similar to the symbol P142, the period during which the CUE button is continuously pressed using a symbol P153 similar to the symbol P143, and the timing when the START / PAUSE button is pressed using a symbol P154 similar to the symbol P144. Note that in the second playback status display section P15A of FIG. 15 , a hollow rectangle P155 is set in the rectangle P151 indicating the playback period of the second channel. The rectangle P155 indicates the period during which the jog dial for the second channel was operated during the playback period of the second music piece. When the user clicks or taps the rectangle P155, the editing screen G4 shown in FIG. 13 may be displayed.

[0062] The second fader status display section P15B displays the operating status of the second channel fader. Similar to the first fader status display section P14B, the second fader status display section P15B displays the position of the second channel fader over time using a line P156. The second equalizer status display section P15C displays the operating status of the controls for adjusting the volume level of the high frequency band, the mid frequency band, and the low frequency band. Similar to the configuration of the first equalizer status display section P14C, the second equalizer status display section P15C displays the position of the control for adjusting the volume level of the high frequency band using a line P157, the position of the control for adjusting the volume level of the mid frequency band using a line P158, and the position of the control for adjusting the volume level of the low frequency band using a line P159.

[0063] [Configuration of the Crossfader Status Display Unit] FIG. 17 is a diagram illustrating the crossfader status display unit P16. As shown in FIG. 14 , the crossfader status display unit P16 is disposed between the first operation status display unit P14 and the second operation status display unit P15 and extends along the horizontal axis. As shown in FIGS. 14 and 17 , the crossfader status display unit P16 includes a time display unit TD and a position display unit P16A that displays the position of the crossfader. Here, the crossfader is configured to be slidable, for example, in one direction. By sliding the crossfader toward one end of the sliding range, the proportion of the first track in the volume of the currently playing music becomes greater than the proportion of the second track. When the crossfader is positioned at one end of the sliding range, the proportion of the first track becomes the largest. When the crossfader is positioned at the other end of the sliding range, the proportion of the second track in the volume of the currently playing music becomes greater than the proportion of the first track. When the crossfader is positioned at the other end of the sliding range, the proportion of the second track becomes the largest.

[0064] To display the operation status of the crossfader operated in this manner, the position display section P16A displays the position of the crossfader based on the operation log information LG using a line P161 within an effective range along the vertical direction, as shown in FIG. 17 . The position display section P16A indicates that the crossfader is being operated toward one end of the sliding range as the position moves upward relative to the crossfader status display section P16, where the first operation status display section P14 is located. The position display section P16A also indicates that the crossfader is being operated toward the other end of the sliding range as the position moves downward relative to the position display section P16A, where the second operation status display section P15 is located. In the examples of FIGS. 14 and 17 , the volume ratio between the first and second music tracks is adjusted using the first and second channel faders, so the crossfader position remains unchanged and set to the intermediate value of the effective range of the position display section P16A. In this way, by arranging the position display section P16A and displaying the position of the crossfader as described above, it becomes easier to understand whether the crossfader is being operated to the first channel or the second channel.

[0065] [Configuration of Effect Status Display Section] Fig. 18 is a diagram showing the effect status display section P17. As shown in Figs. 14 and 18, the effect status display section P17 displays the type of effect, the channel to which the effect is applied, the period during which the effect is on, and the application rate of the effect. As shown in Fig. 18, the effect status display section P17 includes a time display section DP, as well as an on status display section P17A, a rate display section P17B, a type display section P17C, and a target display section P17D.

[0066] The on-state display section P17A uses a rectangle P171 to indicate the period during which the effect is on. The percentage display section P17B displays the application percentage, generally expressed as "Dry / Wet." The percentage display section P17B displays the application percentage of the effect in the vertical effective range using a line P172. The higher the line P172 is positioned within the effective range, the greater the application percentage of the effect, and the lower the line P172 is positioned within the effective range, the smaller the application percentage of the effect.

[0067] The type display section P17C displays the type of effect. Specifically, the type display section P17C displays a name indicating the type of effect that has been set within a rectangle P173 that indicates the setting period for the effect. In the example of FIG. 18 , it is shown that "ECHO" was set during the period from 0 minutes 0 seconds to 6 minutes 20 seconds of the elapsed time indicated by the horizontal axis, and "FLANGER" was set from 6 minutes 20 seconds onwards. The target display section P17D displays the channel to which the effect is to be set. Specifically, the target display section P17D displays a name indicating the channel to which the effect is to be set within a rectangle P174 that indicates the setting period for the setting target. In the example of FIG. 18 , it is shown that the first channel was set as the setting target during the period from 0 minutes 0 seconds to 7 minutes 50 seconds of the elapsed time indicated by the horizontal axis, and the master was set as the setting target from 7 minutes 50 seconds onwards. Note that "master" indicates the master output.

[0068] By checking the operation status image P1 described above, the details of the DJ operations performed within the period recorded in the operation reproduction information can be easily understood. In addition, by checking the operation status image P1, it is possible to easily understand what songs were mixed and how they were mixed.

[0069] [Mix Content Image] FIG. 19 is a diagram showing an example of a mix content image P2 based on operation reproduction information. Specifically, FIG. 19 is an example of a mix content image P2 showing the connection between multiple target songs based on the operation log information LG. The second image generation unit 371 generates a mix content image P2, an example of which is shown in FIG. 19, as an image showing the content of DJ operations read from the operation reproduction information by the operation reproduction unit 370. Here, the operation status image P1 described above displays the operation status of each operator as well as the playback status of songs on each channel. In contrast, the mix content image P2 is an image showing the mix content of multiple songs based on the operation reproduction information. In other words, the mix content image P2 is an image showing the mix status of songs based on the DJ operation reproduction results obtained by the operation reproduction unit 370.

[0070] The mix content image P2 includes a first deck display section P2A, a second deck display section P2B, a third deck display section P2C, and a fourth deck display section P2D. In this embodiment, the music loaded onto the first and second decks is played on a first channel, and the music loaded onto the third and fourth decks is played on a second channel. Therefore, the first deck display section P2A and the second deck display section P2B display the playback status of the music played on the first channel, and the third deck display section P2C and the fourth deck display section P2D display the playback status of the music played on the second channel.

[0071] Each deck display unit P2A, P2B, P2C, and P2D displays the playback period of the song using a rectangle P21 that follows the elapsed time. When a song is being looped, each deck display unit P2A, P2B, P2C, and P2D displays a rectangle P211 indicating the loop playback period within the rectangle P21, and also displays a loop playback mark P212 within the rectangle P211. For example, in the example of Fig. 19, there is a loop playback period at the end of the song loaded on the second deck, and there is also a loop playback period at the end of the song loaded on the fourth deck, so the deck display units P2B and P2D have the rectangle P211 and the loop playback mark P212 set within the rectangle P21 that indicates the playback period of the song.

[0072] Each deck display section P2A, P2B, P2C, and P2D displays a waveform P22 of a song loaded on the corresponding deck. For example, if a DJ operation is performed to change the playback direction and playback speed of a song, the song's waveform P22 is an edited version of the song's original waveform to match the DJ operation. In other words, the waveform P22 is a waveform edited from the song's original waveform based on operation log information. Note that in each deck display section P2A, P2B, P2C, and P2D in the example of FIG. 19 , the waveform P22 is positioned above the rectangle P21. However, this is not a limitation, and the waveform P22 may be positioned below the rectangle P21 or displayed overlapping the rectangle P21. Furthermore, as long as the rectangle P211 and the loop playback mark P212 indicating the loop playback period are visibly displayed, only one of the rectangle P21 and the waveform P22 may be displayed.

[0073] Like the fader status display units P14B and P15B, each deck display unit P2A, P2B, P2C, and P2D displays the position of the channel fader for the channel associated with the deck using a line P23 in accordance with the playback period of the music. Each deck display unit P2A, P2B, P2C, and P2D has an effective range set along the vertical direction in the area above the rectangle P21 that overlaps with the waveform P22. The upper end of the effective range indicates the position of the channel fader when the volume level of the corresponding channel is maximum, and the lower end of the effective range indicates the position of the channel fader when the volume level of the corresponding channel is minimum. Based on the operation reproduction information, each deck display unit P2A, P2B, P2C, and P2D displays the position of the channel fader when the music loaded on the corresponding deck is being played using a line P23.

[0074] By checking such a mix content image P2, it is possible to easily understand how the music loaded onto each deck was mixed when the operation reproduction information was recorded.

[0075] Effects of the embodiment The operation reproduction system 1A according to the present embodiment described above has the following effects. The information processing device 3 includes a reproduction information acquisition unit 366, an operation reproduction unit 370, and a second image generation unit 371. The reproduction information acquisition unit 366 acquires operation reproduction information that records DJ operations performed on the operation device 2 having a control element that accepts DJ operations. The DJ operations correspond to sound control operations of the present invention, and the operation device 2 corresponds to the sound control device of the present invention. The operation reproduction unit 370 reproduces the DJ operations based on the operation reproduction information acquired by the reproduction information acquisition unit 366. The second image generation unit 371 generates an image showing the content of the DJ operations reproduced by the operation reproduction unit 370. The second image generation unit 371 corresponds to the image generation unit of the present invention.

[0076] With this configuration, the operation replay unit 370 replays the DJ operations performed on the controls of the operation device 2 based on the acquired operation replay information, and the second image generation unit 371 generates an image showing the details of the DJ operations. By acquiring operation replay information recording the DJ operations performed by other users, the user can view an image showing the details of the DJ operations performed by the other users, making it easier to understand the details of the DJ operations performed by the other users. This allows, for example, a beginner or other user unfamiliar with the operation device 2 to improve their proficiency by viewing the details of the DJ operations performed by an advanced user, and also makes it easier to share the details of the DJ operations. Furthermore, even when multiple users share operation replay information, the users do not share the music data of the target music performed by the DJ operations reproduced based on the operation replay information. This allows the operation replay information capable of replaying other users' DJ operations to be shared without any issues regarding copyrights or other rights related to the music.

[0077] The information processing device 3 includes a storage unit 34, an identification information acquisition unit 367, a second music acquisition unit 368, and a second music playback unit 369. The storage unit 34 stores music data. The identification information acquisition unit 367 acquires music identification information that identifies a target music piece that is the target of the DJ operation from the operation reproduction information acquired by the reproduction information acquisition unit 366. The second music acquisition unit 368 acquires music data of the target music piece from the storage unit 34 based on the music identification information. The second music acquisition unit 368 corresponds to the music acquisition unit of the present invention. The second music playback unit 369 plays the music data of the target music piece acquired by the second music acquisition unit 368. The second music playback unit 369 corresponds to the playback unit of the present invention. The operation reproduction unit 370 reproduces DJ operations for the target music piece played by the second music playback unit 369.

[0078] With this configuration, the song that is the target of the DJ operation indicated by the operation reproduction information can be identified based on the song identification information acquired from the operation reproduction information acquired by the reproduction information acquisition unit 366. Then, the operation reproduction unit 370 reproduces the DJ operations for the target song played by the second song playback unit 369, thereby reproducing the playback state of the target song at the time the operation reproduction information was recorded. Furthermore, the song data of the target song played by the second song playback unit 369 is song data stored in the storage unit 34 of the information processing device 3. Therefore, multiple users do not share the song data, and the target song can be played in accordance with the reproduced DJ operations without any problems regarding rights, such as copyright, for the song data.

[0079] In the information processing device 3, the operation reproducing unit 370 aligns the position on the time axis of the operation reproduction information with the playback position of the target song played by the second song playback unit 369. With this configuration, even if a control such as a jog dial that changes the playback speed and playback direction of the song is operated, the DJ operation based on the operation reproduction information can be reproduced for the target song at the same playback position as when the DJ operation was recorded.

[0080] In the information processing device 3, the operation reproduction information includes operation log information LG indicating the content of DJ operations. The operation log information LG includes an elapsed time ET from the start of recording of the operation log information LG and a playback position PP corresponding to the elapsed time ET of the target song identified by the song identification information. The operation reproduction unit 370 adjusts the reading position of the operation log information LG so that the playback position PP included in the operation log information LG matches the playback position of the target song played by the second song playback unit 369. With this configuration, by adjusting the reading position of the operation log information LG to match the playback position included in the operation log information LG with the playback position of the target song played by the second song playback unit 369, DJ operations can be performed based on the operation log information LG and the playback position of the target song played by the second song playback unit 369. Therefore, the playback state of the target song at the time the operation reproduction information was recorded and the DJ operations on the target song can be more faithfully reproduced.

[0081] Alternatively, in the information processing device 3, the operation reproduction information includes operation log information LG indicating the content of DJ operations. The operation log information LG includes an elapsed time ET from the start of recording of the operation log information LG and a playback position PP corresponding to the elapsed time ET of the target song identified by the song identification information. The operation reproduction unit 370 aligns the playback position of the target song played by the second song playback unit 369 to the playback position PP included in the operation log information LG. With this configuration, by shifting the playback position of the target song being played to match the playback position included in the operation log information LG, DJ operations can be performed according to the playback position of the target song played by the second song playback unit 369 based on the operation log information LG. Therefore, the playback state of the target song at the time the operation reproduction information was recorded and the DJ operations performed on the target song can be more faithfully reproduced.

[0082] In the information processing device 3, the operation reproducing unit 370 synchronizes and increases or decreases the speed at which the DJ operations reproduced based on the operation reproduction information are performed with the playback speed of the target song reproduced by the second music playback unit 369. With this configuration, by synchronizing the speed at which the DJ operations are reproduced with the playback speed of the target song being played, it is possible to perform speed adjustments such as fast-forwarding and rewinding.

[0083] In the information processing device 3, the second image generation unit 371 generates an image including the content of the DJ operation reproduced by the operation reproduction unit 370 and information related to the DJ operation. With this configuration, by checking the image generated by the second image generation unit 371, it is possible to easily understand the content of the DJ operation at the time of recording the operation reproduction information.

[0084] The information processing device 3 includes an operation editing unit 372 that edits the operation replay information in response to user input operations. This configuration allows the recorded operation replay information to be edited, so that DJ operations that were not performed properly when the operation replay information was recorded can be corrected to appropriate DJ operations. Furthermore, the operation editing unit 372 allows operations to be added to the recorded operation replay information, so that the recorded operation replay information can be rearranged to display more complex DJ operations than when it was recorded, or can be improved to display more exciting DJ operations.

[0085] In the information processing device 3, the second image generation unit 371 generates an operation state image P1 that indicates, for each operator, the operation state of the operator according to the elapsed time from the start of recording of the operation reproduction information. With this configuration, by checking the generated operation state image P1, the operation state of each operator according to the elapsed time can be easily confirmed.

[0086] In the information processing device 3, the second image generation unit 371 generates a mix content image P2 that shows the mix state of music based on the result of reproducing the DJ operations by the operation reproduction unit 370. With this configuration, by checking the generated mix content image P2, it is possible to easily check the mix content of music without listening to the music for which the DJ operations are reproduced.

[0087] The information processing device 3 includes a communication unit 33 capable of communicating with a server SV1 on the network N. The server SV1 corresponds to an external device on the network N. The reproduction information acquisition unit 366 acquires operation reproduction information from the server SV1 via the communication unit 33. With this configuration, operation reproduction information can be acquired from the server SV1 on the network N, making it possible to reproduce DJ operations based on operation reproduction information recorded by other users and understand the details of DJ operations performed by other users. This improves the convenience of the information processing device 3.

[0088] The operation reproduction program stored in the memory unit 34 is executed by a control unit 36 ​​configured with at least one processor. The operation reproduction program causes the control unit 36 ​​to execute the following operations: a reproduction information acquisition unit 366 acquires operation reproduction information recording DJ operations performed on the operation device 2 having a control that accepts DJ operations; an operation reproduction unit 370 reproduces the DJ operations based on the acquired operation reproduction information; and a second image generation unit 371 generates an image showing the reproduced DJ operations. Note that the DJ operations correspond to sound control operations, and the operation device 2 corresponds to a sound control device. The processing of the reproduction information acquisition unit 366 corresponds to a reproduction information acquisition step, the processing of the operation reproduction unit 370 corresponds to an operation reproduction step, and the processing of the second image generation unit 371 corresponds to an image generation step. By having the control unit 36 ​​execute such an operation reproduction program, the same effects as those of the information processing device 3 described above can be achieved.

[0089] [First Application Example] FIG. 20 is a schematic diagram showing the configuration of an operation reproduction system 1B according to a first application example. The above-described operation reproduction system 1A includes one operation device 2, one information processing device 3, and one display device 4. However, the operation reproduction system 1A may include multiple information processing devices 3 configured to transmit and receive operation reproduction information. For example, the operation reproduction system 1B shown in FIG. 20 includes multiple information processing devices 3. At least one of the multiple information processing devices 3 may be an information terminal such as a smartphone or tablet. Each information processing device 3 is capable of communicating with a server SV1 on a network N. Each information processing device 3 is capable of transmitting operation reproduction information to the server SV1 and receiving operation reproduction information from the server SV1. That is, each information processing device 3 is capable of downloading operation reproduction information generated by another information processing device 3 and recording DJ operations performed by another user from the server SV1.

[0090] Therefore, the reproduction information acquisition unit 366 of each information processing device 3 acquires operation reproduction information from the server SV1 via the communication unit 33, which allows the operation reproduction unit 370 to reproduce the DJ operations of other users, and the details of the DJ operations of other users can be understood by observing the operation reproduction screen G3 displayed by the second image generation unit 371 on the display device 4. Furthermore, if the information processing device 3 holds song data for a target song identified by the song identification information in the acquired operation reproduction information, or if the song data for the target song can be acquired from the server SV2, not only can the DJ operations based on the operation reproduction information be visualized, but the target song can also be played in accordance with the DJ operations.

[0091] [Second Application Example] In the operation reproduction system 1B according to the first application example described above, the reproduction of DJ operations based on operation reproduction information is performed by the information processing device 3 that executes music management software. In other words, the reproduction of DJ operations based on operation reproduction information is one of the functions of the music management software. However, the reproduction of the DJ operations may also be performed on a social platform. In other words, the operation reproduction processing unit RP described above may be provided as a social application that runs on a social networking service (SNS).

[0092] 21 is a diagram showing a screen of an information processing device 3 constituting the operation reproduction system according to the second application example, and is a diagram showing an example of an SNS screen G5 during reproduction of a DJ operation based on operation reproduction information. For example, the SNS screen G5 shown in FIG. 21 is displayed on the display device 4 when the information processing device 3, such as a smartphone, executes a social application. The SNS screen G5 includes a message area G51, an operation display area G52, and an operation area G53.

[0093] The message area G51 has a sender display section G511 that displays the sender of the message, a message display section G512 that displays the message, and a rating number display section G513 that displays the number of likes given to the message.

[0094] The operation display area G52 has a configuration similar to the operation display section G33 of the operation reproduction screen G3 shown in FIG. 7. That is, a device image G331 in which a plurality of controls are arranged is displayed in the operation display area G52. As described above, the second image generation unit 371 moves the controls included in the device image G331, displays a graphic indicating the operation direction of the controls, or displays an indication of the operated controls, based on the content of the DJ operation reproduced by the operation reproduction unit 370. Furthermore, although not shown in FIG. 21, the second image generation unit 371 displays information related to the DJ operation in the operation display area G52.

[0095] The operation area G53 has the same configuration as the speed adjustment button G35, reproduction start button G36, and reproduction position display bar G37 shown in FIG. 7 . Specifically, the operation area G53 is provided with a reproduction position display bar G531, a play button G533, a rewind button G534, and a fast-forward button G535. Like the reproduction position display bar G37, the reproduction position display bar G531 has a slider G532, and the position of the slider G532 displays the reproduction position of the DJ operation based on the operation reproduction information. The slider G532 is operated by the user, and based on the position of the slider G532, the operation reproduction unit 370 changes the reproduction position of the DJ operation and also changes the playback position of the target song by the second music playback unit 369. Note that the display content of the operation display area G52 is also changed by the second image generation unit 371 depending on the reproduction position.

[0096] The play button G533 is a button that starts the reproduction of DJ operations by the operation reproduction unit 370. Pressing the play button G533 again pauses the DJ operation reproduction process. While the rewind button G534 is pressed, the operation reproduction unit 370 reverses the reproduction direction of the DJ operations from the current reproduction position and increases the reproduction speed of the DJ operations. While the fast-forward button G535 is pressed, the operation reproduction unit 370 increases the reproduction speed of the DJ operations from the current reproduction position. As the operation reproduction unit 370 changes the reproduction direction and reproduction speed of the DJ operations, the second music reproduction unit 369 also changes the reproduction direction and reproduction speed of the target music, and the second image generation unit 371 displays an image in accordance with the reproduced DJ operations.

[0097] Note that by posting the above-mentioned operation reproduction information together with the message displayed in the message display unit G512, the sender can display the above-mentioned SNS screen G5 on the information processing device 3 used by the recipient of the message or on the information processing device 3 used by an observer such as a follower who follows the sender. At this time, if the operation reproduction information is attached to the message, the reproduction information acquisition unit 366 acquires the operation reproduction information, the identification information acquisition unit 367 acquires song identification information from the operation reproduction information, and the second song acquisition unit 368 acquires song data of the target song, and the operation display area G52 and the operation area G53 are displayed on the SNS screen G5.

[0098] Then, when the play button G533 is pressed, the second music playback unit 369 plays the target music, the operation reproduction unit 370 reproduces the DJ operations based on the operation reproduction information, and the second image generation unit 371 visualizes the DJ operations in the operation display area G52. Note that if the second music acquisition unit 368 is unable to acquire music data for the target music, the operation reproduction unit 370 reproduces the DJ operations and the second image generation unit 371 visualizes the DJ operations in the operation display area G52, but the target music is not played.

[0099] [Modifications of the Embodiments] The present invention is not limited to the above-described embodiments, and modifications and improvements within the scope of achieving the object of the present invention are included in the present invention. In the above-described embodiments, the information processing device 3 includes a reproduction information generation unit 364 that records operation reproduction information. For example, the operation reproduction system 1B according to the first application example is configured with multiple information processing devices 3, each of which has the reproduction information generation unit 364. However, this is not limiting, and the information processing device 3 does not need to include the reproduction information generation unit 364. That is, the information processing device 3 constituting the operation reproduction system 1A and at least one of the multiple information processing devices 3 constituting the operation reproduction system 1B may not include the reproduction information generation unit 364. In other words, at least one of the multiple information processing devices 3 may include an operation reproduction processing unit RP, but may not include a functional unit related to generating operation reproduction information.

[0100] In the above embodiment, the information processing device 3 includes the second music acquisition unit 368 that acquires music data of a target music piece identified by music identification information in the operation reproduction information, and the second music playback unit 369 that plays the target music piece when reproducing a DJ operation based on the operation reproduction information. However, this is not limiting, and the second music acquisition unit 368 and the second music playback unit 369 may be omitted. In this case, the operation reproduction information may not include music identification information.

[0101] In the above embodiment, the operation reproducing unit 370 aligns the position on the time axis of the operation reproducing information with the playback position of the target song played by the second music playback unit 369. Specifically, the operation reproducing unit 370 aligns the elapsed time ET included in the operation log information LG with the playback position of the target song played by the second music playback unit 369, or aligns the playback position of the target song with the playback position PP included in the operation log information LG, based on the time adjustment information TA included in the operation log information LG. The position indicated by the elapsed time ET included in the operation log information LG and the elapsed time ET corresponding to the playback position PP included in the operation log information LG correspond to the position on the time axis of the operation reproducing information. However, this is not limited to this. For example, in cases where the playback speed, playback direction, and playback tempo of the target song do not change, the operation reproducing unit 370 does not necessarily need to adjust the timing of the DJ operation based on the playback position of the target song. In this case, the time adjustment information TA may not be included in the operation reproducing information, and the playback time of the target song may be included in the operation reproducing information instead of the elapsed time ET.

[0102] In the above embodiment, the operation reproducing unit 370 synchronizes the DJ operation reproduction speed with the playback speed of the target song when the DJ operation reproduction speed is changed by the user. However, this is not limited to this, and the DJ operation reproduction speed does not have to be adjustable.

[0103] In the above embodiment, the second image generation unit 371 generates an image including the content of the DJ operation reproduced by the operation reproduction unit 370 and information related to the DJ operation. However, the image generated by the second image generation unit 371 is not limited to the above, as long as the second image generation unit 371 can generate an image including the operation content of the controls. For example, an image resembling the operation device 2 does not have to be generated.

[0104] In the above embodiment, the information processing device 3 includes the operation editing unit 372 that edits the operation reproduction information. However, this is not limiting, and the operation editing unit 372 may be omitted. Furthermore, the operation editing unit 372 may be configured not to edit operation reproduction information that records DJ operations of other users.

[0105] In the above embodiment, the information processing device 3 is configured to be able to transmit and receive operation reproducibility information to and from the server SV1 on the network N. That is, the operation reproducibility information is transmitted and received between a plurality of information processing devices 3 via the server SV1. However, the present invention is not limited to this, and the operation reproducibility information may be transmitted and received between the information processing devices 3 by other means.

[0106] In the above embodiment, the operation reproduction program for executing the operation reproduction process is stored in the storage unit 34. However, this is not limiting, and the operation reproduction program may be recorded on a computer-readable recording medium. When the information processing device reads and executes the operation reproduction program from such a recording medium, it becomes possible to achieve the same effects as the information processing device 3 described above. Examples of such recording media include a tape, a disk-type recording medium, and a semiconductor memory. Alternatively, the operation reproduction program may be provided via a network.

[0107] [Summary of the Invention] The summary of the invention is as follows: [1] An information processing device comprising: a reproduction information acquisition unit that acquires operation reproduction information that records an audio control operation performed on an audio control device having an operator that accepts the audio control operation; an operation reproduction unit that reproduces the audio control operation based on the operation reproduction information acquired by the reproduction information acquisition unit; and an image generation unit that generates an image showing the content of the audio control operation reproduced by the operation reproduction unit.

[0108] According to this configuration, the operation replay unit replays the audio control operations performed on the controls of the audio control device based on the acquired operation replay information, and the image generation unit generates an image showing the details of the audio control operations. By acquiring operation replay information recording audio control operations performed by others, users can view images showing the details of the audio control operations performed by others, making it easier to understand the details of the audio control operations performed by others. This allows, for example, a beginner user unfamiliar with operating audio control devices to improve their proficiency by viewing the details of audio control operations performed by an advanced user, and also makes it easier to disclose the details of audio control operations. Furthermore, even when multiple users share operation replay information, the multiple users do not share the music data of the songs operated by the DJ operations reproduced based on the operation replay information. This allows the sharing of operation replay information capable of replaying other users' DJ operations without causing any copyright or other rights issues related to the music.

[0109] [2] The information processing device according to [1] includes: a storage unit that stores music data; an identification information acquisition unit that acquires, from the acquired operation replay information, music identification information that identifies a target music piece that is the target of the audio control operation; a music acquisition unit that acquires music data of the target music piece from the storage unit based on the music identification information; and a playback unit that plays the music data of the target music piece acquired by the music acquisition unit, wherein the operation replay unit replays the audio control operation for the target music piece being played by the playback unit. This configuration allows the music piece that is the target of the audio control operation indicated by the operation replay information to be identified based on the music identification information acquired from the operation replay information acquired by the replay information acquisition unit. The operation replay unit then replays the audio control operation for the target music piece being played by the playback unit, thereby replaying the playback state of the target music piece at the time the operation replay information was recorded. The music data of the target music piece played by the playback unit is music data stored in the storage unit of the information processing device. Therefore, since multiple users do not share the music data, there are no problems with rights such as copyrights regarding the music data, and the target music can be played back in accordance with the reproduced DJ operations.

[0110] [3] The information processing device according to [2], wherein the operation reproducing unit aligns the time axis position of the operation reproducing information with the playback position of the target song played by the playback unit. With this configuration, even if an operator such as a jog dial that changes the playback speed and playback direction of the song is operated, the sound control operation based on the operation reproducing information can be reproduced for the target song at the same playback position as when the sound control operation was recorded.

[0111] [4] In the information processing device described in [3], the operation reproduction information includes operation log information indicating the content of the sound control operation, the operation log information including the elapsed time from the start of recording of the operation log information, and a playback position in the target song identified by the song identification information corresponding to the elapsed time, and the operation reproduction unit adjusts the reading position of the operation log information so that the playback position included in the operation log information matches the playback position of the target song played by the playback unit. With this configuration, by adjusting the reading position of the operation log information to match the playback position included in the operation log information with the playback position of the target song played by the playback unit, sound control operations can be performed according to the playback position of the target song played by the playback unit based on the operation log information. Therefore, the playback state of the target song at the time of recording the operation reproduction information and the sound control operations for the target song can be more faithfully reproduced.

[0112] [5] In the information processing device described in [3], the operation reproduction information includes operation log information indicating the content of the sound control operation, the operation log information including an elapsed time from the start of recording of the operation log information, and a playback position in the target song identified by the song identification information corresponding to the elapsed time, and the operation reproduction unit aligns the playback position of the target song played by the playback unit to the playback position included in the operation log information. With this configuration, by shifting the playback position of the target song to match the playback position included in the operation log information, sound control operations can be performed according to the playback position of the target song played by the playback unit based on the operation log information. Therefore, the playback state of the target song at the time the operation reproduction information was recorded and the sound control operations for the target song can be more faithfully reproduced.

[0113] [6] The information processing device according to any one of [2] to [5], wherein the operation reproducing unit increases or decreases the speed at which the sound control operation is performed, which is reproduced based on the operation reproducing information, in synchronization with the playback speed of the target music piece reproduced by the playback unit. With this configuration, by synchronizing the speed at which the sound control operation is performed and the playback speed of the target music piece being reproduced, it is possible to perform speed adjustments such as fast forwarding and rewinding.

[0114] [7] In the information processing device according to any one of [1] to [6], the image generation unit generates the image including the content of the sound control operation reproduced by the operation reproduction unit and information related to the sound control operation. With this configuration, by checking the image generated by the image generation unit, it is possible to easily understand the content of the sound control operation at the time of recording the operation reproduction information.

[0115] [8] The information processing device according to any one of [1] to [7], further comprising an operation editing unit that edits the operation replay information in response to an input operation. This configuration allows recorded operation replay information to be edited, so that an audio control operation that was not properly performed when the operation replay information was recorded can be corrected to an appropriate audio control operation. Furthermore, since operations can be added to the recorded operation replay information, the recorded operation replay information can be rearranged to show more complex operations than when recorded, or can be improved to create more exciting operation replay information.

[0116] [9] In the information processing device according to any one of [1] to [8], the image generation unit generates an operation state image showing, for each of the operators, the operation state of the operators according to the elapsed time from the start of recording of the operation reproduction information. With this configuration, by checking the generated operation state image, it is possible to easily check the operation state of each operator according to the elapsed time.

[0117]

[10] The information processing device according to any one of [1] to [9], wherein the image generation unit generates a mix content image showing the mix content of music based on the reproduction result of the sound control operation by the operation reproduction unit. With this configuration, by checking the generated mix content image, the mix content of music can be easily confirmed without listening to the music in which the sound control operation is reproduced.

[0118]

[11] The information processing device according to any one of [1] to

[10] , further comprising a communication unit capable of communicating with an external device on a network, wherein the reproduction information acquisition unit acquires the operation reproduction information from the external device via the communication unit. With this configuration, since the operation reproduction information can be acquired from the external device on the network, it is possible to reproduce a sound control operation based on operation reproduction information recorded by another person, and to understand the details of the sound control operation performed by the other person. Therefore, the convenience of the information processing device can be improved.

[0119]

[12] An operation replay program executed by at least one processor, the operation replay program causing the at least one processor to execute: a replay information acquisition step of acquiring operation replay information that records an audio control operation for an audio control device having an operator that accepts the audio control operation, an operation replay step of replaying the audio control operation based on the acquired operation replay information, and an image generation step of generating an image showing the replayed audio control operation. Execution of such an operation replay program by a processor can achieve the same effects as the information processing device described above.

[0120] 1A, 1B...operation reproduction system, 2...operation device, 3...information processing device, 33...communication unit, 34...memory unit, 36...control unit, 366...reproduction information acquisition unit, 367...identification information acquisition unit, 368...second music acquisition unit (music acquisition unit), 369...second music playback unit (music playback unit), 370...operation reproduction unit, 371...second image generation unit (image generation unit), 372...operation editing unit, 4...display device, P1...operation state image, P2...mix content image.

Claims

1. a reproduction information acquisition unit that acquires operation reproduction information that records an audio control operation performed on an audio control device having an operator that accepts the audio control operation; an operation reproducing unit that reproduces the sound control operation based on the operation reproduction information acquired by the reproduction information acquisition unit; an image generating unit that generates an image showing the content of the sound control operation reproduced by the operation reproducing unit.

2. 2. The information processing device according to claim 1, a storage unit for storing music data; an identification information acquisition unit that acquires, from the acquired operation reproduction information, music identification information that identifies a target music piece that is an operation target of the audio control operation; a music acquisition unit that acquires music data of the target music from the storage unit based on the music identification information; a playback unit that plays back the music data of the target music pieces acquired by the music acquisition unit, The information processing device, characterized in that the operation reproducing unit reproduces the sound control operation for the target music piece reproduced by the reproduction unit.

3. 3. The information processing device according to claim 2, The information processing device, wherein the operation reproducing unit aligns a position on a time axis of the operation reproduction information with a playback position of the target music piece played by the playback unit.

4. 4. The information processing device according to claim 3, the operation reproduction information includes operation log information indicating the content of the sound control operation, The operation log information includes: The elapsed time from the start of recording the operation log information, a playback position in the target song identified by the song identification information, the playback position corresponding to the elapsed time; An information processing device characterized in that the operation reproduction unit adjusts the reading position of the operation log information so that the playback position included in the operation log information matches the playback position of the target song played by the playback unit.

5. 4. The information processing device according to claim 3, the operation reproduction information includes operation log information indicating the content of the sound control operation, The operation log information includes: The elapsed time from the start of recording the operation log information, a playback position in the target song identified by the song identification information, the playback position corresponding to the elapsed time; The information processing device, wherein the operation reproducing unit aligns a playback position of the target song played by the playback unit with the playback position included in the operation log information.

6. 6. The information processing device according to claim 2, The information processing device is characterized in that the operation reproduction unit increases or decreases the speed at which the sound control operation is performed, which is reproduced based on the operation reproduction information, and the playback speed of the target music piece, which is played by the playback unit, in synchronization with each other.

7. 6. The information processing device according to claim 1, The information processing device, wherein the image generating unit generates the image including the content of the sound control operation reproduced by the operation reproducing unit and information related to the sound control operation.

8. 6. The information processing device according to claim 1, An information processing device comprising: an operation editing unit that edits the operation reproduction information in accordance with an input operation.

9. 6. The information processing device according to claim 1, The information processing apparatus, wherein the image generating section generates an operation state image showing, for each of the operators, an operation state of the operator according to an elapsed time from the start of recording of the operation reproduction information.

10. 6. The information processing device according to claim 1, The information processing device, wherein the image generating unit generates a mix content image showing a mix content of music based on a result of reproduction of the sound control operation by the operation reproducing unit.

11. 6. The information processing device according to claim 1, Equipped with a communication unit that can communicate with external devices on the network, The information processing apparatus, wherein the reproduction information acquisition unit acquires the operation reproduction information from the external device via the communication unit.

12. an operation reproduction program executed by at least one processor, the at least one processor; a reproduction information acquisition step of acquiring operation reproduction information that records sound control operations for a sound control device having an operator that accepts the sound control operations; an operation reproducing step of reproducing the sound control operation based on the acquired operation reproducing information; and an image generating step of generating an image showing the reproduced sound control operation.