Information processing device and operation reproduction program

Abstract

An information processing device (3) comprises: a reproduction information acquisition unit (366) that acquires operation reproduction information in which an acoustic control operation on an acoustic control device (2) having an operator that receives the acoustic control operation is recorded; an operation reproduction unit (370) that reproduces the acoustic control operation on the basis of the operation reproduction information acquired by the reproduction information acquisition unit; and an image generation unit (371) that generates an image indicating the content of the sound control operation reproduced by the operation reproduction unit.

Description

[Technical Field]

[0001] The present invention relates to an information processing device and an operation reproduction program. [Background technology]

[0002] BACKGROUND ART Conventionally, a music remix system is known that allows DJ play by operating a DJ play screen to remix and play back a plurality of sound materials (see, for example, Patent Document 1). In the music remix system described in Patent Document 1, a DJ play screen operated by a user is displayed on a display unit. The DJ play screen includes a main power gear that rotates clockwise at a speed corresponding to the master tempo, two gear-shaped placeholders attached to the outer periphery of the main power gear, multiple music gears, and multiple material gears. Each of the multiple music gears is associated with a different piece of music, and each of the multiple material gears is associated with a different piece of loop material. When a music gear or material gear is placed in a placeholder, the music or loop material corresponding to the placed gear is played. The DJ play screen has a volume slider and a tempo slider. When the volume slider is operated, the balance between the volume of the audio associated with one of the two placeholders is adjusted. When the tempo slider is operated, the master tempo is changed, and the rotation speed of the main power gear is also changed according to the changed master tempo.

[0003] When multiple users are performing DJ sets together, operations performed by the users on the DJ play screen are transmitted to the application server via the network, and the application server then transmits a DJ play screen reflecting the operations to each user's terminal device. As a result, the same DJ play screen is displayed on each user's terminal device. When a user initiates playback of a new song or loop material, a content server controlled by the application server provides the corresponding audio data to each user's terminal device. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-52469 Summary of the Invention [Problem to be solved by the invention]

[0005] In recent years, DJ equipment has become popular, and the number of users using DJ equipment has increased. Beginners who are unfamiliar with operating DJ equipment often try to master the techniques by watching videos of advanced DJs using the equipment. However, in such videos, the DJ equipment is often hidden by parts of the expert's body, making it difficult to understand how the expert is operating it. On the other hand, when videos containing music or audio whose copyrights are maintained are shared, there is a problem that copyright issues may arise. [Means for solving the problem]

[0006] An information processing device according to a first aspect of the present invention includes a reproduction information acquisition unit that acquires operation reproduction information that records an audio control operation performed on an audio control device having an operator that accepts the audio control operation, an operation reproduction unit that reproduces the audio control operation based on the operation reproduction information acquired by the reproduction information acquisition unit, and an image generation unit that generates an image showing the content of the audio control operation reproduced by the operation reproduction unit.

[0007] An operation reproduction program according to a second aspect of the present invention is an operation reproduction program executed by at least one processor, and causes the at least one processor to execute a reproduction information acquisition step of acquiring operation reproduction information that records a sound control operation for a sound control device having an operator that accepts the sound control operation, an operation reproduction step of reproducing the sound control operation based on the acquired operation reproduction information, and an image generation step of generating an image showing the reproduced sound control operation. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating a configuration of an operation reproduction system according to an embodiment. [Figure 2] 1 is a diagram illustrating an outline of functions of an operation reproduction system according to an embodiment. [Figure 3] FIG. 1 is a block diagram showing the configuration of an information processing apparatus according to an embodiment. [Figure 4] FIG. 2 is a block diagram showing the functional configuration of a control unit according to an embodiment. [Figure 5] FIG. 10 is a diagram showing a part of operation log information included in operation reproduction information according to an embodiment. [Figure 6] FIG. 10 is a diagram showing an example of an operation screen according to an embodiment. [Figure 7] FIG. 10 is a diagram showing an example of an operation reproduction screen according to an embodiment. [Figure 8] 10A and 10B are diagrams illustrating a discrepancy between a playback position of a song and an elapsed time in operation log information according to an embodiment. [Figure 9] FIG. 10 is a diagram for explaining a first technique according to an embodiment. [Figure 10] FIG. 10 is a diagram for explaining a first technique according to an embodiment. [Figure 11] FIG. 10 is a diagram for explaining a second technique according to an embodiment. [Figure 12] FIG. 10 is a diagram for explaining a second technique according to an embodiment. [Figure 13] FIG. 10 is a diagram showing an example of an editing screen according to an embodiment. [Figure 14] FIG. 10 is a diagram showing an example of an operation status image according to an embodiment. [Figure 15] FIG. 4 is a diagram showing a first operation state display section of an operation state image according to an embodiment. [Figure 16] FIG. 10 is a diagram showing a second operation state display section of an operation state image according to an embodiment. [Figure 17] FIG. 10 is a diagram showing a crossfader status display portion of an operation status image according to an embodiment. [Figure 18] 10A and 10B are diagrams showing an effect status display section of an operation status image according to an embodiment; [Figure 19] FIG. 10 is a diagram showing an example of a mix content image according to an embodiment. [Figure 20] FIG. 1 is a schematic diagram showing the configuration of an operation reproduction system according to a first application example. [Figure 21] FIG. 10 is a diagram showing an example of an SNS screen according to a second application example. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. [Configuration of operation reproduction system] FIG. 1 is a diagram illustrating the configuration of an operation reproduction system 1A according to this embodiment. As shown in FIG. 1, the operation reproduction system 1A according to this embodiment includes an operation device 2, an information processing device 3 that inputs operation information corresponding to an input operation on the operation device 2, and a display device 4 connected to the information processing device 3. The information processing device 3 is configured to be connectable to a network N such as the Internet, and is capable of communicating with servers SV1 and SV2 connected to the network N. The servers SV1 and SV2 are not limited to computers, but also include storage that can be used as a file server. Furthermore, the server SV2 can be, for example, a server for a music distribution service. In this specification, DJ operations correspond to sound control operations, and include, for example, operations to control the playback position of music, operations to process tone, and operations to control the volume of music. Operations to control the playback position include, for example, scratching, variable speed playback, reverse playback, loop playback, and moving the playback position using the controls on the operation device. Operations to process tone include, for example, equalizer (EQ) operations and effect (Fx) operations. Operations to control the volume of music include, for example, fader operations such as channel faders and crossfaders.

[0010] [Overview of the operation reproduction system] FIG. 2 is a diagram illustrating an outline of the functions of the operation reproduction system 1A. 2, in the operation reproduction system 1A, the information processing device 3 records the contents of the DJ operations as operation reproduction information based on the operation information and song identification information input from the operation device 2 in response to the DJ operations of the user US on the operation device 2. The information processing device 3 is capable of editing the recorded operation reproduction information and also capable of uploading the operation reproduction information to the server SV1 shown in FIG. The operation reproduction information includes operation log information indicating the details of the DJ operations performed by the user US on the controls of the operation device 2, and song identification information for identifying the target song that is the target of the DJ operations. The song identified by the song identification information is the song that was the target of the operation when the operation reproduction information was recorded. Hereinafter, the song identified by the song identification information will be referred to as the target song.

[0011] The information processing device 3 can reproduce the DJ operations of the user US by acquiring pre-recorded operation reproduction information or operation reproduction information generated by another information processing device 3. Reproducing the DJ operations means reading the operation reproduction information and executing a process similar to the process corresponding to the operation information received from the operation device 2 while the DJ operations are being performed. For example, reproducing the DJ operations means that, if a control is operated after a predetermined time has elapsed since the start of recording of the operation reproduction information, a process corresponding to the operation of the control is executed after the same time has elapsed since the start of the operation reproduction process based on the operation reproduction information. When reproducing the DJ operations, the information processing device 3 generates an image showing the details of the DJ operations based on the operation log information of the operation reproduction information using the second image generation unit 371 (described later) and displays the image on the display device 4. This visualizes the recorded DJ operations of the user. Furthermore, if the information processing device 3 holds a target song identified by the song identification information, the information processing device 3 plays the target song according to the details of the DJ operations based on the operation log information. This reproduces the playback of the target song according to the recorded DJ operations. In this way, the operation reproduction system 1A can be said to be a DJ operation visualization system that visualizes the DJ operations of the user. Each component of the operation reproduction system 1A will be described below.

[0012] [Configuration of operation device] 1 and 2 is a DJ device such as a DJ controller or a DJ mixer, and is an audio control device having controls that allow DJ operations to be performed. Although detailed illustration is omitted, for example, the operation device 2 has various controls such as a jog dial, a crossfader, a channel fader, etc., as well as a rotary control that can adjust the volume level of the high frequency band, the volume level of the mid frequency band, the volume level of the low frequency band, the volume level of the input signal, and the application rate of effects.

[0013] [Display device configuration] 1 is configured by various display panels such as liquid crystal displays, etc. The display device 4 displays an image according to an image signal input from the information processing device 3. In this embodiment, the information processing device 3 is configured as a notebook PC (Personal Computer), and therefore the display device 4 is integrated with the information processing device 3. However, this is not limiting, and the display device 4 may be a display separate from the information processing device 3.

[0014] [Configuration of information processing device] FIG. 3 is a block diagram showing the configuration of the information processing device 3. The information processing device 3 is configured, for example, by a PC capable of executing music management software. The information processing device 3 executes the music management software and plays pre-stored music based on operation signals input from the operation device 2. The information processing device 3 generates and stores operation reproduction information that records the details of DJ operations performed by the user US on the operation device 2. Furthermore, the information processing device 3 reproduces the DJ operations performed by the user US based on the operation reproduction information. As shown in FIG. 3, the information processing device 3 includes an input unit 31, an output unit 32, a communication unit 33, a storage unit 34, a memory 35, and a control unit 36, which are electrically connected by a bus line BL.

[0015] The input unit 31 and the output unit 32 have terminals that can be connected to external devices. The input unit 31 outputs signals input from external devices to the control unit 36. Examples of external devices connected to the input unit 31 include the operation device 2, a pointing device, a keyboard, and an external storage device that stores music data. The external storage device is included in the storage unit of the present invention. An example of a terminal that constitutes the input unit 31 is a USB (Universal Serial Bus) terminal. The output unit 32 outputs information input from the control unit 36 ​​to an external device. Examples of external devices connected to the output unit 32 include the display device 4, a speaker, and headphones. Examples of terminals constituting the output unit 32 include a USB terminal, a video output terminal, and an audio output terminal.

[0016] The communication unit 33 communicates with external devices such as servers SV1 and SV2 on the network N under the control of the control unit 36. For example, the communication unit 33 receives operation replay information from server SV1 and outputs it to the control unit 36, and also transmits operation replay information generated by the control unit 36 ​​to server SV1. The communication unit 33 can also receive music data from a server SV2 that is different from server SV1. The information and data received by the communication unit 33 are stored in the storage unit 34 by the control unit 36. For example, music data received from server SV2 is stored in the storage unit 34.

[0017] The storage unit 34 is configured with storage devices such as an HDD (Hard Disk Drive) and an SSD (Solid State Drive), and stores programs and data for operating the information processing device 3. For example, the storage unit 34 stores an OS (Operating System) and music management software that control the information processing device 3, as well as an operation reproduction program for executing the operation reproduction process described below. In other words, the storage unit 34 is a recording medium that stores the operation reproduction program. Furthermore, for example, the storage unit 34 can store a plurality of pieces of music data and operation reproduction information. The memory 35 is a work memory for the control unit 36 ​​.

[0018] [Controller configuration] FIG. 4 is a block diagram showing the functional configuration of the control unit 36. The control unit 36 ​​is configured with at least one processor such as a CPU (Central Processing Unit), and controls the operation of the information processing device 3. The control unit 36 ​​has a plurality of functional units that are realized when the processor executes a program stored in the storage unit 34. For example, as shown in FIG. 4 , the control unit 36 ​​has an operation acquisition unit 361, a first music acquisition unit 362, a first music playback unit 363, a reproduction information generation unit 364, a first image generation unit 365, a reproduction information acquisition unit 366, an identification information acquisition unit 367, a second music acquisition unit 368, a second music playback unit 369, an operation reproduction unit 370, a second image generation unit 371, and an operation editing unit 372.

[0019] The operation acquisition unit 361 acquires an operation signal from among signals input from an external device connected to the input unit 31. For example, the operation acquisition unit 361 acquires an operation signal input from the operation device 2 connected to the information processing device 3. The first music acquisition unit 362 acquires, from the storage unit 34, music data corresponding to the music selected by the user, based on the acquired operation signal.

[0020] The first music playback unit 363 plays the music data acquired by the first music acquisition unit 362 based on the operation signal acquired by the operation acquisition unit 361. For example, when an operation signal corresponding to an operation on the jog dial of the controller device 2 is acquired, the first music playback unit 363 changes the playback speed and playback direction of the music based on the acquired operation signal. Also, for example, when an operation signal corresponding to an operation on the channel fader of the first channel on the controller device 2 is acquired, the first music playback unit 363 increases or decreases the volume level of the music being played on the first channel based on the acquired operation signal.

[0021] The reproduction information generating unit 364 generates operation reproduction information that records the details of the DJ operations performed by the user on the operation device 2. Specifically, the reproduction information generating unit 364 generates operation reproduction information by recording the operation details corresponding to the operation signals input from the operation device 2 in chronological order from the start of recording. In other words, the reproduction information generating unit 364 generates operation reproduction information by recording the DJ operations performed by the user on the operation device 2 in chronological order from the start of recording. The generated operation reproduction information is stored in the storage unit 34.

[0022] [Contents of operation reproduction information] The operation reproduction information includes operation log information and music identification information, as shown in Fig. 2. The operation reproduction information is a file in a format that can be transmitted to the server SV1 or the like.

[0023] [Operation log information content] FIG. 5 is a diagram showing a part of the operation log information LG included in the operation reproduction information. The operation log information is information that records the operation details of operators operated by the user among the operators of the operation device 2 for each operator together with the elapsed time from the start of recording of the DJ operation. In other words, the operation log information includes a plurality of pieces of sound control information that record each of a plurality of sound control operations. Specifically, as shown in Fig. 5, the operation log information LG is information in which records RC, each of which includes a record number RN, an elapsed time ET from the start of recording, a control type SC indicating the control that was operated, a channel number CN of the channel on which the operated control is located, and a control position SP indicating the position of the control after it has been operated, are arranged in the order of the record number RN. The control type SC, the channel number CN, and the control position SP correspond to operation content information.

[0024] The record number RN is, for example, an integer value. The record number RN is incremented each time an operation signal is input, and a record RC including the record number RN is generated by the reproduction information generation unit 364, and the generated record RC is added to the operation log information LG. In other words, the record number indicates the order of the recorded operations. However, the record number may be omitted. The channel number CN of the operator shared by each channel is "0." The channel number CN of the operator for the first channel is "1," and the channel number CN of the operator for the second channel is "2." An example of an operator shared by each channel is a crossfader. The operator position SP of an operator other than a jog dial is set to an absolute value within the operable range of the operator. On the other hand, since a jog dial can be continuously rotated clockwise and counterclockwise, the absolute position of the jog dial cannot be recorded. Therefore, if the operated operator is a rotary operator that can be rotated infinitely, such as a jog dial, the operator position SP is set to a relative position based on the position before the operation.

[0025] The operation log information includes time adjustment information TA that aligns the playback position of the music with the operation timing of the controls when reproducing the DJ operations. The time adjustment information TA is information for aligning the position on the time axis based on the elapsed time ET of the operation reproduction information with the playback position of the music. In other words, the time adjustment information TA is information that associates the elapsed time ET from the start of recording the DJ operations with the playback position of the music. Specifically, the time adjustment information TA is at least one record RC including a record number RN, an elapsed time ET, and a playback position PP of the target song corresponding to the elapsed time ET. The playback position PP of the target song is, for example, a playback position from the beginning of the song and is indicated by time. The time adjustment information TA is recorded every time a predetermined time has elapsed since the start of recording of DJ operations, and also every time an operation to change the playback position of a song is performed. For example, the time adjustment information TA is recorded when a jog dial that changes the playback speed and playback direction of a song is operated, and also when an operation to change the playback state of a song is performed. Examples of operations that change the playback state of a song include starting playback, stopping playback, reverse playback, and changing the tempo.

[0026] [Song ID information] The song identification information is information for identifying the song whose playback is controlled by the DJ operation indicated by the operation log information LG. In other words, the song identification information is information that can uniquely identify the song that was being played when the DJ operation was recorded. An example of the song identification information is song metadata. Song metadata includes the song title, artist name, genre, album name, track order on the album, lyricist name, composer name, arranger name, performance time, production code, product number, etc. In this embodiment, the song identification information is information including the song title, artist name, and album name. In addition, the song identification information may be parameter values ​​based on the analysis results of the song data, or parameter values ​​calculated by a predetermined function from information such as the song title and artist name. The operation replay information includes song identification information for the songs used when the operation replay information was recorded. Therefore, if multiple songs were used when the operation replay information was recorded, the operation replay information includes song identification information for each of the target songs.

[0027] 4 generates an image to be displayed on the display device 4. The first image generation unit 365 outputs the generated image to the display device 4 via the output unit 32, thereby causing the generated image to be displayed on the display device 4. For example, the first image generating unit 365 generates an image of the music management software runtime screen G1 shown in FIG.

[0028] FIG. 6 is a diagram showing an example of the operation screen G2. Furthermore, for example, the first image generation unit 365 generates an image of an operation screen G2 that is displayed when recording or reproducing a DJ operation. As shown in Fig. 6, the operation screen G2 includes a record start button G21, a record stop button G22, a reset button G23, and a play button G24, and also has display areas for the elapsed time from the start of recording, the playback time of the song, and the deck currently playing and the BPM of that deck. The record start button G21 is a button that starts recording DJ operations. The recording stop button G22 is a button that stops recording of DJ operations. The reset button G23 is a button for erasing the recorded DJ operations, that is, the reset button G23 is a button for erasing the generated operation reproduction information. The play button G24 is a button that loads the recorded operation reproduction information and reproduces the DJ operation based on the operation reproduction information. When the play button G24 is pressed and any operation reproduction information is selected by the user from the operation reproduction information stored in the storage unit 34, the operation reproduction process is executed.

[0029] 4 constitute an operation reproduction processing unit RP. The operation reproduction processing unit RP performs operation reproduction processing to reproduce DJ operations based on the operation reproduction information by causing the control unit 36 ​​to execute an operation reproduction program. The reproduction information acquisition unit 366 acquires operation reproduction information selected by the user from the operation reproduction information stored in the storage unit 34. Alternatively, the reproduction information acquisition unit 366 acquires the operation reproduction information from the server SV1 via the communication unit 33. The identification information acquisition unit 367 acquires the music identification information included in the operation reproduction information acquired by the reproduction information acquisition unit 366 . The second music acquisition unit 368 acquires music data of a target song identified by the song identification information acquired by the identification information acquisition unit 367 from the music data stored in the storage unit 34. Note that there are cases where the music data of the target song is not stored in the storage unit 34. In such cases, the second music acquisition unit 368 may acquire the music data of the target song from the server SV2, or may output a signal indicating that the music data of the target song cannot be acquired to the second music playback unit 369. The music data acquired from the server SV2 by the second music acquisition unit 368 is stored in the storage unit 34. The storage of music data here includes temporary storage by the storage unit 34.

[0030] The second music playback unit 369 plays the music data acquired by the second music acquisition unit 368. At this time, the second music playback unit 369 changes the playback state of the target music in accordance with the user's DJ operation on the operation device 2 reproduced by the operation reproduction unit 370. Note that if the second music acquisition unit 368 cannot acquire the music data of the target music, the second music playback unit 369 does not play the music data.

[0031] The operation reproducing unit 370 reproduces the DJ operations based on the operation reproduction information acquired by the reproduction information acquisition unit 366. Specifically, the operation reproducing unit 370 analyzes the operation log information of the operation reproduction information, and controls the playback of the target song by the second music playback unit 369 based on the operation log information. More specifically, the operation reproducing unit 370 reproduces the DJ operations of the user on the operation device 2 at the time the operation reproduction information was recorded, based on the operation log information of the acquired operation reproduction information, and controls the playback of the target song in accordance with the reproduced DJ operations.

[0032] FIG. 7 is a diagram showing an example of the operation reproduction screen G3. The second image generation unit 371 generates an image of the operation reproduction screen G3 shown in Fig. 7. Specifically, the second image generation unit 371 generates an image of the operation reproduction screen G3 showing the DJ operations performed on the operation device 2 and reproduced by the operation reproduction unit 370 based on the operation reproduction information, and causes the generated image to be displayed on the display device 4. In addition, the second image generation unit 371 generates an operation status image P1 and a mix content image P2, which will be described later. In other words, the second image generation unit 371 generates an image that visualizes the DJ operations reproduced by the operation reproduction unit 370.

[0033] The operation reproduction screen G3 includes a first music information display section G31, a second music information display section G32, an operation display section G33, a menu button G34, a speed adjustment button G35, a reproduction start button G36, and a reproduction position display bar G37. The first music information display section G31 and the second music information display section G32 are arranged at the top of the operation reproduction screen G3. The first song information display section G31 is located on the left side and displays information about the first song among the target songs. Specifically, the first song information display section G31 displays the title, playback time, remaining playback time, and BPM of the first song, as well as waveform information about the first song. The waveform information is a graph of signal strength according to the playback time of the song, with the horizontal axis representing the playback time of the song and the vertical axis representing the signal strength of the song. The second music information display section G32 is located on the right side and displays information about the second music piece among the target music pieces. The display content of the second music information display section G32 is the same as that of the first music information display section G31.

[0034] The operation display unit G33 displays a device image G331 that is a planar view of the operation device 2. Specifically, the operation display unit G33 displays a plurality of operators that the operation device 2 has at the same positions as the respective positions of the plurality of operators on the operation device 2. The second image generation unit 371 draws the content of the DJ operation on the operation device 2 reproduced by the operation reproduction unit 370, and displays it on the operation display unit G33. That is, the second image generation unit 371 visualizes the DJ operation reproduced by the operation reproduction unit 370 on the operation display unit G33.

[0035] For example, the second image generation unit 371 generates an image in which the position of a partial image indicating a control of a channel indicated by a channel number CN, among the controls indicated by the control type SC in the record RC of the operation log information LG corresponding to the elapsed time since the start of the operation reproduction process, is moved to a control position SP. In other words, the second image generation unit 371 moves the position of a partial image indicating a control corresponding to the control type SC and channel number CN, among the controls included in the device image G331, to a position corresponding to the control position SP according to the elapsed time. As a specific example, if the operator indicated by the operator type SC of the acquired record RC is a channel fader and the channel number CN of the record RC is "2", the second image generation unit 371 generates an operation reproduction screen G3 in which a partial image showing the operation knob of the channel fader of the second channel is moved to a position corresponding to the operator position SP of the record RC.

[0036] Furthermore, for example, the second image generation unit 371 generates an image showing, by a graphic FG such as an arrow based on the operator position SP, the movement direction or rotation direction of the operator of the channel indicated by the channel number CN among the operators indicated by the operator type SC of the record RC of the operation log information LG corresponding to the elapsed time since the operation reproduction process was started. In other words, the second image generation unit 371 displays, near the operator corresponding to the operator type SC and deck number DN among the operators in the device image G331, a graphic FG such as an arrow indicating the operation direction and rotation direction of the operator, based on the operator position SP according to the elapsed time. As a specific example, if the operator indicated by the operator type SC of the acquired record RC is a jog dial and the channel number CN of the record RC is "1", the second image generation unit 371 generates an operation reproduction screen G3 based on the operator position SP of the record RC, in which a figure FG, which is an arrow indicating the operation direction of the rotary operator, is superimposed on a partial image showing the jog dial of the first channel.

[0037] Furthermore, for example, the second image generation unit 371 highlights or displays a graphic such as a circle on the operator of the channel indicated by the channel number CN among the operators indicated by the operator type SC in the record RC of the operation log information LG corresponding to the elapsed time since the operation reproduction process was started. That is, the second image generation unit 371 superimposes a graphic such as a circle on the operator corresponding to the operator type SC and channel number CN among the operators in the device image G331 in accordance with the elapsed time, thereby indicating the operator in a manner that allows it to be distinguished from other operators. As a specific example, if the operator indicated by the operator type SC of the acquired record RC is the first sampler pad and the channel number CN of the record RC is "2", the second image generation unit 371 generates an operation reproduction screen G3 in which a partial image showing the first sampler pad of the second channel is highlighted, or an operation reproduction screen G3 in which a figure FG such as a circle is superimposed on the partial image showing the first sampler pad.

[0038] The operation display unit G33 can also display information related to the reproduced DJ operation. For example, the second image generation unit 371 displays a speech bubble SB containing information related to the DJ operation on the operation display unit G33. Such information related to the DJ operation can include the amount of operation of the controls, the values ​​of parameters changed by the reproduced operation, information that can identify the DJ device used when the operation reproduction information was recorded, and the settings of the DJ application when the operation reproduction information was recorded. Examples of the operation amount of a control include the movement amount of the control, a numerical value indicating the position of the control, and the rotation angle of the control, etc. In the example of Fig. 7, the speech bubble SB indicates the movement amount of the crossfader in the direction of the arrow. If the operation log information LG records the operation of a control that sets a specific parameter value, the parameter value may be the parameter value changed in response to the operation of that control. For example, if the operation log information LG records the pressing of a loop button, the parameter value is the "number of bars in the loop" that was set by pressing the loop button. Displays including this information are sequentially set in the operation display section G33 by the second image generation section 371. As a result, the contents of the reproduced DJ operation and information related to the reproduced DJ operation are set in the operation display section G33, and operation reproduction screens G3 including the operation display section G33 are sequentially displayed.

[0039] The menu button G34 is a button for displaying a menu screen (not shown). The menu screen includes, for example, a selection item for selecting a device image G331 of an operation device displayed on the operation display unit G33. Here, when reproducing the DJ operations of another user based on the acquired operation reproduction information, for example, a device image G331 that imitates the model of the operation device 2 that the user uses is displayed, making it easier to understand the DJ operations of the other user. For this reason, the second image generation unit 371 displays the device image G331 selected by the user on the operation display unit G33, and visualizes the operations for the controls included in the device image G331 based on the reproduced DJ operations, which makes it easier for the user to understand the content of the DJ operations performed by other users.

[0040] The speed adjustment button G35, reproduction start button G36, and reproduction position display bar G37 allow the contents of the DJ operation displayed on the operation display section G33 to be operated like a moving image. The speed adjustment button G35 is a button that increases or decreases the playback speed of the target music piece by the second music piece playback unit 369 and the reproduction speed of the DJ operations by the operation reproduction unit 370 in synchronization with each other. In the example of the operation reproduction screen G3 shown in FIG. 7, the speed adjustment button G35 includes buttons for adjusting the speed to 0.5x, 0.75x, 1x, 1.25x, and 1.5x. The operation reproduction unit 370 reproduces the DJ operations at a speed corresponding to the input button and causes the second music piece playback unit 369 to play the target music piece at the speed corresponding to the input button. When the reproduction speed of the DJ operations is increased or decreased by the speed adjustment button G35, the display update speed of the operation display unit G33 is also increased or decreased in synchronization with the reproduction speed of the DJ operations. In this way, the operation reproducing unit 370 synchronizes and increases or decreases the speed at which the DJ operation is performed, which is reproduced based on the operation reproduction information, and the playback speed of the target song played by the second music playback unit 369. Note that the reproduction speed of the DJ operation and the playback speed of the target song may be configured so that the user can set any desired speed.

[0041] The reproduction start button G36 is a button that starts the operation reproduction process of the DJ operation based on the operation reproduction information. When the reproduction start button G36 is pressed, the operation reproduction process starts, and the second music playback unit 369 starts playing the target music, and the operation reproduction unit 370 starts reproducing the DJ operation based on the operation reproduction information. When the reproduction start button G36 is pressed again, the operation reproduction process is paused. The reproduction position display bar G37 is provided with a slider G371 that indicates the current reproduction position of the DJ operation based on the operation reproduction information. The user can adjust the reproduction position by sliding the slider G371 along the reproduction position display bar G37, and based on the position of the slider G371, the operation reproduction unit 370 changes the reproduction position of the DJ operation and also changes the playback position of the target music by the second music playback unit 369. The operation reproduction screen G3 may be provided with a button for moving the reproduction position back a predetermined time from the current reproduction position, or a button for moving the reproduction position forward a predetermined time from the current reproduction position.

[0042] [Adjustment of reproduction position based on time adjustment information] FIG. 8 is a diagram illustrating the discrepancy between the playback position of the music piece by the operation reproducing unit 370 and the elapsed time in the operation log information LG. Here, because the operation reproduction information and the song data are separate files, there is a possibility that the timing of the DJ operations performed during reproduction based on the elapsed time ET in the operation log information LG may differ from the playback position of the target song corresponding to the timing of the DJ operations performed during recording. For example, as shown in the upper part of Fig. 8, when the operation log information LG is recorded, if the start time of recording the operation log information LG is time ET0, the start time of playback of the target song is time ET1, and the timing of the DJ operations is time ET2, when reproduction of the DJ operations based on the operation log information LG begins, playback of the song begins when the elapsed time from time ET0 reaches time ET1, as shown in the lower part of Fig. 8. Then, when the elapsed time reaches time ET2, the DJ operations based on the operation log information LG are performed.

[0043] However, even if the playback position of the target song corresponding to the elapsed time when the DJ operation was recorded and the playback position of the target song corresponding to the elapsed time when the DJ operation is reproduced are misaligned for some reason, such as the start of playback of the song being delayed from time ET1, the DJ operation based on the operation log information LG will be performed when the elapsed time reaches time ET2. In other words, even if the playback position ET3 indicated by the time adjustment information TA in the operation log information LG does not align with the playback position of the target song, the DJ operation will be reproduced according to the time elapsed from time ET0. In such cases, the timing at which DJ operations are performed on the target song will be different when the DJ operations are recorded and when the DJ operations are reproduced, so even if the DJ operations are reproduced on the target song, the song when the DJ operations are reproduced will be different from the song when the DJ operations were recorded.

[0044] Furthermore, if the reproduction clock of a DJ operation based on the operation log information LG differs from the playback clock of the target song, a discrepancy occurs between the timing of a certain DJ operation based on the operation log information LG and the playback position of the target song where that DJ operation is supposed to be performed. This discrepancy accumulates as the target song continues to play. Therefore, as the reproduction process of the DJ operation based on the operation log information LG progresses, the discrepancy becomes larger, and just as if the playback start position of the target song was shifted, the song playback at the time the DJ operation was recorded cannot be faithfully reproduced. For these reasons, in order to properly reproduce DJ operations based on operation log information LG, it is necessary to align the position on the time axis based on the elapsed time ET of the operation log information LG with the playback position of the target song. Note that in the example at the bottom of Fig. 8, if DJ operations based on the operation log information LG are performed at time ET4, which is the time ET2 added to the difference between the playback position indicated by the time adjustment information TA of the operation log information LG and the playback position of the target song, then DJ operations on the target song will be performed at the appropriate timing.

[0045] In response to this, the operation reproduction unit 370 aligns the position on the time axis based on the elapsed time ET of the operation log information LG with the playback position of the target song being played by the second song playback unit 369, based on the time adjustment information TA included in the operation log information LG. Specifically, the operation reproduction unit 370 synchronizes the elapsed time ET in the operation log information LG with the playback position of the target song being played by the second music playback unit 369 so that the playback position PP in the time adjustment information TA matches the playback position of the target song being played by the second music playback unit 369, then reproduces the DJ operation according to the elapsed time ET and causes the second music playback unit 369 to play the target song. At this time, the operation reproducing unit 370 implements either a first method of matching the playback position of the target song to the playback position of the time adjustment information TA, or a second method of matching the read position of the operation log information LG including the time adjustment information TA to the playback position of the target song. In other words, when the operation reproducing unit 370 reads the time adjustment information TA, if the playback position indicated by the time adjustment information TA does not match the playback position of the target song, the operation reproducing unit 370 uses either the first method or the second method to match the playback position indicated by the time adjustment information TA with the playback position of the target song. Hereinafter, the playback position indicated by the time adjustment information TA is referred to as the playback position during recording, and the playback position of the target song is referred to as the current playback position.

[0046] [Time adjustment process details] First, when the operation reproducing unit 370 reads the time adjustment information TA at time ET3, it determines whether the playback position during recording and the current playback position match. If the playback position during recording and the current playback position match, the first and second methods for matching the playback position during recording and the current playback position are not performed. On the other hand, if it is determined that the playback position during recording and the current playback position do not match, the operation reproducing unit 370 determines whether the current playback position is delayed with respect to the playback position during recording.

[0047] [First method for moving the current playback position] 9 and 10 are diagrams illustrating the first technique. More specifically, FIG. 9 illustrates a case where the current playback position is delayed from the playback position during recording, and FIG. 10 illustrates a case where the current playback position is ahead of the playback position during recording. In addition, in FIGS. 9 and 10, the operation log information is shown separately for the range from time ET0 to time ET3, the range from time ET3 to time ET2, and the range after time ET3. Also, in FIGS. 9 and 10, the range between the playback position during recording recorded at time ET1 and time ET3 in the target song, the range between the playback position during recording and the timing of the first DJ operation after the playback position during recording, and the range after the timing of the first DJ operation are shown separately. In the first technique, when the music playback position lags behind the playback position during recording, the operation reproducing unit 370 calculates the difference between the playback position during recording and the current playback position, as shown in Fig. 9, and advances the current playback position by the calculated difference. In other words, the operation reproducing unit 370 omits a part of the target music from the playback position during recording by the calculated difference. In this way, the operation reproducing unit 370 aligns the playback position during recording with the current playback position.

[0048] In the first technique, when the music playback position is not delayed relative to the playback position during recording, that is, when the music playback position is ahead of the playback position during recording, the operation reproducing unit 370 calculates the difference between the playback position during recording and the current playback position, as shown in Fig. 10, and delays the current playback position by the calculated difference. For example, the operation reproducing unit 370 delays the current playback position. In this way, the operation reproducing unit 370 aligns the playback position during recording with the current playback position. In this way, in the first method, the operation reproduction unit 370 aligns the current playback position of the target song with the playback position at the time of recording, acquires the record RC from the time ET3 onwards when the time adjustment information TA was recorded, and reproduces the DJ operation according to the elapsed time ET.

[0049] [Second method for moving the reading position of operation log information] 11 and 12 are diagrams illustrating the second technique. More specifically, FIG. 11 illustrates a case where the current playback position is delayed from the playback position during recording, and FIG. 12 illustrates a case where the current playback position is ahead of the playback position during recording. Note that FIGS. 11 and 12 separately illustrate the range from time ET0 to time ET3, the range from time ET3 to time ET2, and the range after time ET2 in the operation log information. Also, FIGS. 11 and 12 separately illustrate the range between the playback position during recording recorded at time ET1 and time ET3 in the target song, the range between the playback position during recording and the timing of the first DJ operation after the playback position during recording, and the range after the timing of the first DJ operation. In the second method, when the current playback position lags behind the playback position during recording, the operation reproducing unit 370 calculates the difference between the current playback position and the playback position during recording, waits for the calculated difference before reading the operation log information LG, and adjusts the read position of the operation log information LG, as shown in Fig. 11. In this way, the operation reproducing unit 370 aligns the playback position during recording with the current playback position.

[0050] In the second method, when the music playback position is ahead of the playback position during recording, the operation reproducing unit 370 calculates the difference between the playback position during recording and the current playback position, as shown in Fig. 12, and moves the read position of the operation log information LG forward by the calculated difference. That is, the operation reproducing unit 370 moves the read position of the operation log information LG backward from time ET2 by the calculated difference. In this way, the operation reproducing unit 370 aligns the playback position during recording with the current playback position. As described above, in the second technique, the operation reproducing unit 370 aligns the read position of the operation log information LG with the current playback position, acquires the records RC after the time adjustment information TA, and reproduces the DJ operations according to the elapsed time ET.

[0051] By using the first or second method, DJ operations based on the operation log information LG are reproduced at the playback position of the target song at the time the DJ operations were recorded, so that the DJ operations at the time the operation reproduction information was recorded can be faithfully reproduced, and the song corresponding to the DJ operations can be played. The operation reproducing unit 370 may combine the first method and the second method. For example, when the music playback position is delayed relative to the playback position at the time of recording, one of the first method and the second method may be implemented, and when the music playback position is ahead of the playback position at the time of recording, the other of the first method and the second method may be implemented.

[0052] [Example of editing screen] Fig. 13 is a diagram showing an example of an editing screen G4 for editing a scratch operation of a recorded operation. The waveform shown in the upper part of Fig. 13 is a waveform showing a recorded scratch operation, and the waveform shown in the lower part of Fig. 13 is a waveform showing a scratch operation edited by a first user. In Fig. 13, a reference line SL indicates the reference position of the jog dial, and the area above the reference line SL indicates the relative position with respect to the reference position when the jog dial is rotated clockwise, and the area below the reference line SL indicates the relative position with respect to the reference position when the jog dial is rotated counterclockwise. In addition, vertical lines in Fig. 13 indicate beat positions. 4 edits the operation reproduction information stored in the storage unit 34 based on an operation signal input from the input unit 31. When the user edits a recorded scratch operation, the operation editing unit 372 displays an editing screen G4 shown in FIG.

[0053] For example, if the scratch operation on the jog dial of the operation device 2 is not synchronized with the beat, the waveform generated by the operation editing unit 372 based on the operation log information will have a waveform in which the vertical line indicating the beat position does not match the return position of the scratch operation, as shown in part W11 in the waveform W1 shown in the upper part of Figure 13. In response to this, as shown in the lower part of Figure 13, the pointer PT included in the editing screen G4 can be operated with a pointing device or the like to align the turning position in part W11 with the vertical line, thereby synchronizing the scratch operation with the beat. The operation editing unit 372 can also add new DJ operations to the operation reproduction information stored in the storage unit 34 on another editing screen (not shown). Based on the edited content on the edit screen G4, the operation editing unit 372 updates the operation log information LG of the operation reproduction information stored in the storage unit .

[0054] [Operation status image] FIG. 14 is a diagram showing an example of an operation status image P1 showing the content of DJ operations based on operation reproduction information for each operator provided on the DJ device. The second image generating unit 371 generates an operation status image P1, an example of which is shown in FIG. 14, as an image showing the content of the DJ operation read out by the operation reproducing unit 370 from the operation reproducing information. The operation status image P1 is an image that shows the operation status of each controller on the DJ equipment, the content of the target song loaded when the DJ operation is reproduced, and the connection between the target songs. For example, the operation status image P1 is an image that shows the operation status of each controller according to the elapsed time from the start of recording of the operation reproduction information. In other words, the operation status image P1 is one of the images that show the reproduction results of the DJ operation by the operation reproduction unit 370, and is an image that shows the operation status of each controller on the DJ equipment and the playback status of the target song. An operation status image P1, an example of which is shown in FIG. 14, includes a first music information display portion P11, a second music information display portion P12, and a details display portion P13.

[0055] [Configuration of the first music information display unit and the second music information display unit] The first music information display section P11 displays information about the first music piece being played on channel 1. Specifically, the first music information display section P11 displays the name of the first music piece, the BPM of the first music piece, the playback position of the first music piece, the remaining time of the first music piece, the waveform of the first music piece, the composition of the first music piece, etc. The second music information display section P12 displays information about the second music piece being played on the second channel. Specifically, the second music information display section P12 displays the name of the second music piece, the BPM of the second music piece, the playback position of the second music piece, the remaining time of the second music piece, the waveform of the second music piece, the composition of the second music piece, etc. Note that the information about songs displayed on each song information display section P11, P12 is not limited to the above. For example, each song information display section P11, P12 may display at least the name of the song, and may not display at least one of the other pieces of information. Furthermore, each song information display section P11, P12 may display information about the song other than the above.

[0056] [Detailed display section configuration] The detail display section P13 displays the operation details of the controls based on the operation log information and the playback status of music on each channel, with the elapsed time included in the operation log information of the operation reproduction information represented on the horizontal axis. The detail display section P13 is arranged below the first music information display section P11 and the second music information display section P12 in the operation status image P1. The detail display section P13 includes a first operation status display section P14, a second operation status display section P15, a crossfader status display section P16, and an effect status display section P17. In the detailed display section P13, from top to bottom, there are arranged a first operation status display section P14, a crossfader status display section P16, a second operation status display section P15, and an effect status display section P17, and each of the display sections P14 to P17 extends along the horizontal axis indicating the elapsed time.

[0057] [Configuration of the first operation status display section] FIG. 15 is a diagram showing the first operation status display section P14. The first operation status display section P14 displays the playback status of the first music piece and the operation status of each operator provided for the first channel along the elapsed time in the operation reproduction information. As shown in Figures 14 and 15, the first operation status display section P14 includes a time display section TD that shows the elapsed time included in the operation log information, as well as a first playback status display section P14A, a first fader status display section P14B, and a first equalizer status display section P14C.

[0058] The first playback status display area P14A displays the playback status of the first song. As shown in Fig. 15, the first playback status display area P14A displays the playback period of the first channel using a rectangle P141. The timing at which the song was loaded is indicated by the elapsed time corresponding to the left edge of the rectangle P141 representing the playback period. Characters indicating the track number of the song are also set in the rectangle P141. The first playback status display area P14A displays the timing at which the CUE button is pressed using a symbol P142, which is a downward-pointing black triangle. The first playback status display area P14A also displays the period during which the CUE button is continuously pressed using a symbol P143, which is a line segment connecting the two symbols P142. Note that if the CUE button is pressed while a song is being played, the playback of that song will be stopped. The first playback status display area P14A displays the timing for pressing the START / PAUSE button with a downward-facing white triangle symbol P144.

[0059] The first fader status display section P14B displays the operating status of the first channel fader. As shown in Fig. 15, the first fader status display section P14B has an effective range set along the vertical direction, with the upper end of the effective range indicating the position of the first channel fader when the volume level of the first channel is maximum, and the lower end of the effective range indicating the position of the first channel fader when the volume level of the first channel is minimum. The first fader status display section P14B then displays the position of the first channel fader according to elapsed time using a line P146. In the example of Fig. 15, when the elapsed time indicated by the horizontal axis is from 0 minutes 0 seconds to 2 minutes 40 seconds, the first fader status display section P14B displays that the first channel fader is positioned at the position where the volume level of the first channel is maximum. Also in the example of Fig. 15, when the elapsed time is from 3 minutes 25 seconds to 6 minutes 0 seconds, the first fader status display section P14B displays that the first channel fader is positioned at the position where the volume level of the first channel is minimum.

[0060] The first equalizer status display section P14C displays the operational status of the controls for adjusting the volume level of the high frequency band, the mid frequency band, and the low frequency band. These controls are, for example, rotary controls such as a rotary volume. 15, the first equalizer status display section P14C has an effective range set along the vertical direction, with the upper end of the effective range indicating the position of the control when the volume level of the corresponding band is maximum, and the lower end of the effective range indicating the position of the control when the volume level of the corresponding band is minimum. The first equalizer status display section P14C then displays the position of each control over elapsed time with lines P147, P148, and P149. Specifically, in the first equalizer state display section P143, the position of the operator that adjusts the volume level of the high frequency band is displayed by a line P147, the position of the operator that adjusts the volume level of the mid frequency band is displayed by a line P148, and the position of the operator that adjusts the volume level of the low frequency band is displayed by a line P149. The colors of the lines P147, P148, and P149 may be different from each other, and the line types of the lines P147, P148, and P149 may be different from each other.

[0061] [Configuration of the second operation status display section] FIG. 16 is a diagram showing the second operation status display section P15. 14 and 16, the second operation status display section P15 displays the playback status of the second music piece and the operation status of each operator provided for the second channel in chronological order from the start of reading of the operation reproduction information. Specifically, the second operation status display section P15 includes a time display section TD, as well as a second playback status display section P15A, a second fader status display section P15B, and a second equalizer status display section P15C. The second playback status display section P15A displays the playback status of the second music piece. The configuration of the second playback status display section P15A is the same as the configuration of the first playback status display section P14A. That is, as shown in Fig. 16, the second playback status display section P15A displays the playback period of the second channel with a rectangle P151, the timing when the CUE button was pressed with a symbol P152 similar to the symbol P142, the period during which the CUE button was continuously pressed with a symbol P153 similar to the symbol P143, and the timing when the START / PAUSE button was pressed with a symbol P154 similar to the symbol P144. In the second playback status display area P15A in Fig. 15, a white rectangle P155 is set in a rectangle P151 indicating the playback period of the second channel. The rectangle P155 indicates the period during which the jog dial for the second channel was operated during the playback period of the second music piece. When the user clicks or taps on the rectangle P155, the editing screen G4 shown in Fig. 13 may be displayed.

[0062] The second fader status display section P15B displays the operating status of the second channel fader. Similar to the first fader status display section P14B, the second fader status display section P15B displays the position of the second channel fader according to the elapsed time using a line P156. The second equalizer status display section P15C displays the operating status of the controls for adjusting the volume level of the high frequency band, the mid frequency band, and the low frequency band. The second equalizer status display section P15C is configured in the same way as the first equalizer status display section P14C, with the position of the control for adjusting the volume level of the high frequency band being displayed by a line P157, the position of the control for adjusting the volume level of the mid frequency band being displayed by a line P158, and the position of the control for adjusting the volume level of the low frequency band being displayed by a line P159.

[0063] [Configuration of the crossfader status display section] FIG. 17 is a diagram showing the crossfader state display section P16. 14, the crossfader status display section P16 is disposed between the first operation status display section P14 and the second operation status display section P15, and extends along the horizontal axis. As shown in FIGS. 14 and 17, the crossfader status display section P16 includes a time display section TD and a position display section P16A that displays the position of the crossfader. Here, the crossfader is configured to be slidable, for example, in one direction. By sliding the crossfader to one end of the sliding range, the proportion of the first song in the volume being played becomes greater than the proportion of the second song. When the crossfader is positioned at one end of the sliding range, the proportion of the first song becomes the greatest. By sliding the crossfader to the other end, the proportion of the second song in the volume being played becomes greater than the proportion of the first song. When the crossfader is positioned at the other end of the sliding range, the proportion of the second song becomes the greatest.

[0064] To display the operational status of the crossfader operated in this manner, the position display section P16A displays the position of the crossfader based on the operation log information LG using a line P161 within the effective range along the vertical direction, as shown in Fig. 17. The position display section P16A indicates that the crossfader is being operated toward one end of the sliding range as it moves upward relative to the crossfader status display section P16, where the first operation status display section P14 is located. Furthermore, the position display section P16A indicates that the crossfader is being operated toward the other end of the sliding range as it moves downward relative to the position display section P16A, where the second operation status display section P15 is located. In the examples of Figures 14 and 17, the volume ratio between the first song and the second song is adjusted using the first channel fader and the second channel fader, so the position of the crossfader remains set to the intermediate value of the effective range in the position display area P16A and does not change. In this way, by arranging the position display section P16A and displaying the position of the crossfader as described above, it becomes easier to understand whether the crossfader is being operated to the first channel or the second channel.

[0065] [Effect status display section] FIG. 18 is a diagram showing the effect status display section P17. 14 and 18, the effect status display section P17 displays the type of effect, the channel to which the effect is applied, the period during which the effect is on, and the application rate of the effect. As shown in Fig. 18, the effect status display section P17 includes a time display section DP, as well as an on status display section P17A, a rate display section P17B, a type display section P17C, and a target display section P17D.

[0066] The on-state display section P17A indicates the period during which the effect is on by a rectangle P171. The ratio display section P17B displays the application ratio, generally expressed as "Dry / Wet." The ratio display section P17B displays the effect application ratio in the effective range along the vertical direction using a line P172. As the line P172 is positioned higher in the effective range, it indicates that the effect application ratio is greater, and as the line P172 is positioned lower in the effective range, it indicates that the effect application ratio is smaller.

[0067] The type display section P17C displays the type of effect. Specifically, the type display section P17C displays the name of the type of effect that has been set within a rectangle P173 that indicates the period during which the effect has been set. In the example of Fig. 18, it is shown that "ECHO" was set for the period from 0 minutes 0 seconds to 6 minutes 20 seconds of the elapsed time indicated by the horizontal axis, and "FLANGER" was set for the period from 6 minutes 20 seconds onwards. The target display section P17D displays the channel to which the effect is to be set. Specifically, the target display section P17D displays the name of the target channel within a rectangle P174 indicating the setting period of the target. In the example of Fig. 18, the first channel was set as the target for the period from 0 minutes 0 seconds to 7 minutes 50 seconds of the elapsed time indicated by the horizontal axis, and the master was set as the target for the period from 7 minutes 50 seconds onwards. Note that "master" indicates the master output.

[0068] By checking the operation status image P1 described above, you can easily understand the details of the DJ operations performed within the period recorded in the operation reproduction information. In addition, by checking the operation status image P1, you can easily understand what songs were mixed and how they were mixed.

[0069] [Mix contents image] Fig. 19 is a diagram showing an example of a mix content image P2 based on operation reproduction information. Specifically, Fig. 19 is an example of a mix content image P2 showing connections between a plurality of target songs based on operation log information LG. The second image generating section 371 generates a mix content image P2, an example of which is shown in FIG. 19, as an image showing the content of the DJ operation read out by the operation reproducing section 370 from the operation reproducing information. Here, the above-mentioned operation status image P1 displays the operation status of each operator as well as the playback status of music on each channel. In contrast, the mix content image P2 is an image showing the mix content of multiple music pieces based on the operation reproduction information. In other words, the mix content image P2 is an image showing the mix status of music pieces based on the reproduction results of DJ operations by the operation reproduction unit 370.

[0070] The mix content image P2 includes a first deck display portion P2A, a second deck display portion P2B, a third deck display portion P2C, and a fourth deck display portion P2D. In this embodiment, music loaded onto the first and second decks is played on channel 1, and music loaded onto the third and fourth decks is played on channel 2. Therefore, the first deck display unit P2A and the second deck display unit P2B display the playback status of music played on channel 1, and the third deck display unit P2C and the fourth deck display unit P2D display the playback status of music played on channel 2.

[0071] Each deck display unit P2A, P2B, P2C, and P2D displays the playback period of the song using a rectangle P21 that follows the elapsed time. When a song is being played in a loop, each deck display unit P2A, P2B, P2C, and P2D displays a rectangle P211 indicating the loop playback period within the rectangle P21, and also displays a loop playback mark P212 within the rectangle P211. For example, in the example of Fig. 19, there is a loop playback period at the end of the song loaded on the second deck, and there is also a loop playback period at the end of the song loaded on the fourth deck, so on the deck display units P2B and P2D, the rectangle P211 and the loop playback mark P212 are set within the rectangle P21 that indicates the playback period of the song.

[0072] Each deck display unit P2A, P2B, P2C, and P2D displays a waveform P22 of the song loaded on the corresponding deck. For example, if a DJ operation is performed to change the playback direction or playback speed of the song, the song's waveform P22 is an edited version of the song's original waveform to match the DJ operation. In other words, the waveform P22 is an edited version of the song's original waveform based on the operation log information. 19, the waveform P22 is arranged above the rectangle P21. However, this is not limiting, and the waveform P22 may be arranged below the rectangle P21 or displayed overlapping the rectangle P21. Furthermore, as long as the rectangle P211 and the loop playback mark P212 indicating the loop playback period are displayed in a visible manner, only one of the rectangle P21 and the waveform P22 may be displayed.

[0073] Like the fader status display units P14B and P15B, each deck display unit P2A, P2B, P2C, and P2D displays the position of the channel fader for the channel associated with the deck using a line P23 in accordance with the playback period of the music. Each deck display unit P2A, P2B, P2C, and P2D has an effective range set along the vertical direction in the area above the rectangle P21 that overlaps with the waveform P22. The upper end of the effective range indicates the position of the channel fader when the volume level of the corresponding channel is at its maximum, and the lower end of the effective range indicates the position of the channel fader when the volume level of the corresponding channel is at its minimum. Based on the operation reproduction information, each deck display unit P2A, P2B, P2C, and P2D displays the position of the channel fader when the music loaded on the corresponding deck is being played using a line P23.

[0074] By checking such a mix content image P2, it is possible to easily understand how the music loaded onto each deck was mixed when the operation reproduction information was recorded.

[0075] [Effects of the embodiment] The operation reproduction system 1A according to the present embodiment described above has the following advantages. The information processing device 3 includes a reproduction information acquisition unit 366, an operation reproduction unit 370, and a second image generation unit 371. The reproduction information acquisition unit 366 acquires operation reproduction information that records DJ operations performed on the operation device 2 having controls that accept DJ operations. The DJ operations correspond to the sound control operations of the present invention, and the operation device 2 corresponds to the sound control device of the present invention. The operation reproducing unit 370 reproduces the DJ operation based on the operation reproduction information acquired by the reproduction information acquiring unit 366. The second image generating section 371 generates an image showing the content of the DJ operation reproduced by the operation reproducing section 370. The second image generating section 371 corresponds to the image generating section of the present invention.

[0076] With this configuration, the operation reproducing unit 370 reproduces the DJ operations performed on the controls of the operation device 2 based on the acquired operation reproduction information, and the second image generating unit 371 generates an image showing the details of the DJ operations. By acquiring operation reproduction information that records the DJ operations performed by other users, the image showing the details of the DJ operations performed by other users can be confirmed, making it easier to understand the details of the DJ operations performed by other users. Therefore, for example, a user such as a beginner who is unfamiliar with operating the operation device 2 can improve their proficiency by checking the details of the DJ operations performed by an advanced user, and it also makes it easier to make the details of the DJ operations public. Furthermore, even when multiple users share operation reproduction information, they do not share the music data of the target music that is operated by the DJ operations reproduced based on the operation reproduction information. This allows users to share operation reproduction information that can reproduce other users' DJ operations without causing any problems with copyrights or other rights related to the music.

[0077] The information processing device 3 includes a storage unit 34, an identification information acquisition unit 367, a second music acquisition unit 368, and a second music playback unit 369. The storage unit 34 stores music data. The identification information acquisition unit 367 acquires, from the operation reproduction information acquired by the reproduction information acquisition unit 366, song identification information that identifies the target song that is the operation target of the DJ operation. Based on the song identification information, the second song acquisition section 368 acquires song data of the target song from the storage section 34. The second song acquisition section 368 corresponds to the song acquisition section of the present invention. The second music playback unit 369 plays back the music data of the target music acquired by the second music acquisition unit 368. The second music playback unit 369 corresponds to the playback unit of the present invention. The operation reproducing unit 370 reproduces the DJ operation for the target music piece being played by the second music piece playing unit 369.

[0078] With this configuration, it is possible to identify the song that is the target of the DJ operation indicated by the operation replay information, based on the song identification information acquired from the operation replay information acquired by the replay information acquisition unit 366. Then, the operation replay unit 370 reproduces the DJ operation on the target song being played by the second song playback unit 369, thereby reproducing the playback state of the target song at the time the operation replay information was recorded. Furthermore, the music data of the target music played by the second music playback unit 369 is music data stored in the storage unit 34 of the information processing device 3. Therefore, the music data is not shared by multiple users, and the target music can be played in accordance with the reproduced DJ operations without any problems arising with respect to rights such as copyright for the music data.

[0079] In the information processing device 3, the operation reproducing unit 370 aligns the position on the time axis of the operation reproduction information with the playback position of the target music piece played by the second music piece playing unit 369. With this configuration, even if an operator such as a jog dial that changes the playback speed and playback direction of a song is operated, the DJ operation based on the operation reproduction information can be reproduced for the target song at the same playback position as when the DJ operation was recorded.

[0080] In the information processing device 3, the operation reproduction information includes operation log information LG that indicates the details of the DJ operations, and the operation log information LG includes an elapsed time ET from the start of recording of the operation log information LG and a playback position PP corresponding to the elapsed time ET of the target song identified by the song identification information. The operation reproduction unit 370 adjusts the reading position of the operation log information LG so that the playback position PP included in the operation log information LG matches the playback position of the target song played by the second song playback unit 369. With this configuration, by adjusting the reading position of the operation log information LG to match the playback position included in the operation log information LG with the playback position of the target song played by the second music playback unit 369, it is possible to perform DJ operations based on the operation log information LG according to the playback position of the target song played by the second music playback unit 369. Therefore, it is possible to more faithfully reproduce the playback state of the target song and the DJ operations on the target song at the time the operation reproduction information was recorded.

[0081] Alternatively, in the information processing device 3, the operation reproduction information includes operation log information LG indicating the details of the DJ operation, and the operation log information LG includes an elapsed time ET from the start of recording of the operation log information LG and a playback position PP of the target song identified by the song identification information, which corresponds to the elapsed time ET. The operation reproduction unit 370 aligns the playback position of the target song played by the second song playback unit 369 with the playback position PP included in the operation log information LG. With this configuration, by shifting the playback position of the target song being played to match the playback position included in the operation log information LG, it is possible to perform DJ operations according to the playback position of the target song being played by the second song playback unit 369 based on the operation log information LG. Therefore, it is possible to more faithfully reproduce the playback state of the target song and the DJ operations on the target song at the time the operation reproduction information was recorded.

[0082] In the information processing device 3, the operation reproducing unit 370 increases or decreases the execution speed of the DJ operation reproduced based on the operation reproduction information and the playback speed of the target music played by the second music playback unit 369 in synchronization with each other. According to this configuration, by synchronizing the speed at which the DJ operation is being reproduced with the playback speed of the target song being played, it is possible to perform speed adjustments such as fast forwarding and rewinding.

[0083] In the information processing device 3, the second image generating unit 371 generates an image including the content of the DJ operation reproduced by the operation reproducing unit 370 and information related to the DJ operation. According to this configuration, by checking the image generated by the second image generating section 371, it is possible to easily understand the content of the DJ operation when the operation reproduction information was recorded.

[0084] The information processing device 3 includes an operation editing unit 372 that edits operation reproduction information in accordance with an input operation by a user. With this configuration, the recorded operation replay information can be edited, so that DJ operations that were not performed appropriately when the operation replay information was recorded can be corrected to appropriate DJ operations. In addition, the operation editing unit 372 can add operations to the recorded operation replay information, so that the recorded operation replay information can be rearranged to show more complex DJ operations than when it was recorded, or can be improved to show more exciting DJ operations.

[0085] In the information processing device 3, the second image generating unit 371 generates an operation state image P1 that indicates, for each operator, the operation state of the operator according to the elapsed time from the start of recording of the operation reproduction information. According to this configuration, by checking the generated operation state image P1, it is possible to easily check the operation state of each operator according to the elapsed time.

[0086] In the information processing device 3, the second image generating unit 371 generates a mix content image P2 that indicates the mix state of the music based on the result of the operation reproducing unit 370 reproducing the DJ operation. With this configuration, by checking the generated mix content image P2, it is possible to easily check the mix content of the music without listening to the music in which the DJ operations are reproduced.

[0087] The information processing device 3 includes a communication unit 33 that can communicate with a server SV1 on the network N. The server SV1 corresponds to an external device on the network N. The reproduction information acquisition unit 366 acquires the operation reproduction information from the server SV1 via the communication unit 33. With this configuration, operation reproduction information can be acquired from the server SV1 on the network N, allowing DJ operations based on operation reproduction information recorded by other users to be reproduced, and the details of DJ operations performed by other users to be understood, thereby improving the convenience of the information processing device 3.

[0088] The operation replay program stored in the storage unit 34 is executed by a control unit 36 ​​configured with at least one processor. The operation replay program causes the control unit 36 ​​to execute processing by a replay information acquisition unit 366 that acquires operation replay information that records DJ operations performed on an operation device 2 having a control that accepts DJ operations, processing by an operation replay unit 370 that reproduces the DJ operations based on the acquired operation replay information, and processing by a second image generation unit that generates an image showing the reproduced DJ operations. The DJ operation corresponds to an audio control operation, and the operation device 2 corresponds to an audio control device. The processing of the reproduction information acquisition unit 366 corresponds to a reproduction information acquisition step, the processing of the operation reproduction unit 370 corresponds to an operation reproduction step, and the processing of the second image generation unit 371 corresponds to an image generation step. By having the control unit 36 ​​execute such an operation reproducing program, the same effects as those of the information processing device 3 described above can be achieved.

[0089] [First application example] FIG. 20 is a schematic diagram showing the configuration of an operation reproduction system 1B according to a first application example. The above-described operation reproducing system 1A includes one operation device 2, one information processing device 3, and one display device 4. However, the operation reproducing system 1A may include a plurality of information processing devices 3 configured to be able to transmit and receive operation reproducing information. For example, an operation reproduction system 1B shown in Fig. 20 includes a plurality of information processing devices 3. At least one of the plurality of information processing devices 3 may be an information terminal such as a smartphone or a tablet. Each information processing device 3 can communicate with a server SV1 on the network N. Each information processing device 3 can transmit operation replay information to the server SV1 and can receive operation replay information from the server SV1. In other words, each information processing device 3 can download, from the server SV1, operation replay information that has been generated by another information processing device 3 and that records DJ operations of other users.

[0090] Therefore, the reproduction information acquisition unit 366 of each information processing device 3 acquires operation reproduction information from the server SV1 via the communication unit 33, allowing the operation reproduction unit 370 to reproduce the DJ operations of other users, and by observing the operation reproduction screen G3 displayed on the display device 4 by the second image generation unit 371, the content of the DJ operations of other users can be understood. Furthermore, if the information processing device 3 holds the music data of the target song identified by the music identification information of the acquired operation reproduction information, or if the music data of the target song can be acquired from the server SV2, not only can the DJ operation based on the operation reproduction information be visualized, but the target song can also be played in accordance with the DJ operation.

[0091] [Second application example] In the operation reproduction system 1B according to the first application example described above, the reproduction of DJ operations based on operation reproduction information is performed by the information processing device 3 that executes music management software. That is, the reproduction of DJ operations based on operation reproduction information is one of the functions of the music management software. However, the reproduction of the DJ operations may also be performed on a social platform. That is, the operation reproduction processing unit RP described above may be provided as a social application that runs on a social networking service (SNS).

[0092] FIG. 21 is a diagram showing a screen of the information processing device 3 constituting the operation reproduction system according to the second application example, and is a diagram showing an example of an SNS screen G5 during reproduction of a DJ operation based on operation reproduction information. 21 is displayed on the display device 4 when an information processing device 3, such as a smartphone, executes a social application. The SNS screen G5 includes a message area G51, an operation display area G52, and an operation area G53.

[0093] The message area G51 has a sender display section G511 that displays the sender of the message, a message display section G512 that displays the message, and a rating number display section G513 that displays the number of likes given to the message.

[0094] The operation display area G52 has a configuration similar to the operation display section G33 of the operation reproduction screen G3 shown in FIG. 7. That is, a device image G331 in which a plurality of controls are arranged is displayed in the operation display area G52. As described above, the second image generation unit 371 moves the controls included in the device image G331, displays a graphic indicating the operation direction of the controls, or displays an indication of the operated controls, based on the content of the DJ operations reproduced by the operation reproduction unit 370. Furthermore, although not shown in FIG. 21, the second image generation unit 371 displays information related to the DJ operations in the operation display area G52.

[0095] The operation area G53 has the same configuration as the speed adjustment button G35, reproduction start button G36, and reproduction position display bar G37 shown in Fig. 7. Specifically, the operation area G53 is provided with a reproduction position display bar G531, a play button G533, a rewind button G534, and a fast-forward button G535. Like the reproduction position display bar G37, the reproduction position display bar G531 has a slider G532, and the position of the slider G532 displays the reproduction position of the DJ operation based on the operation reproduction information. The slider G532 is operated by the user, and based on the position of the slider G532, the operation reproduction unit 370 changes the reproduction position of the DJ operation and also changes the playback position of the target song by the second music playback unit 369. Note that the display content of the operation display area G52 is also changed by the second image generation unit 371 according to the reproduction position.

[0096] The play button G533 is a button that starts reproducing the DJ operation by the operation reproducing section 370. When the play button G533 is pressed again, the reproduction process of the DJ operation is paused. While the rewind button G534 is being pressed, the operation reproducing unit 370 reverses the reproduction direction of the DJ operation from the current reproduction position, and also increases the reproduction speed of the DJ operation. While the fast forward button G535 is pressed, the operation reproducing unit 370 increases the reproduction speed of the DJ operation from the current reproduction position. As the operation reproduction unit 370 changes the reproduction direction and reproduction speed of the DJ operation, the second music playback unit 369 also changes the playback direction and playback speed of the target music, and the second image generation unit 371 displays an image according to the reproduced DJ operation.

[0097] By posting the above-mentioned operation reproducibility information together with the message displayed in the message display section G512, the sender can display the above-mentioned SNS screen G5 on the information processing device 3 used by the recipient of the message or on the information processing device 3 used by an observer such as a follower who follows the sender. At this time, if the operation reproducibility information is attached to the message, the reproducibility information acquisition section 366 acquires the operation reproducibility information, the identification information acquisition section 367 acquires song identification information from the operation reproducibility information, and the second song acquisition section 368 acquires song data of the target song, and the operation display area G52 and the operation area G53 are displayed on the SNS screen G5.

[0098] Then, when the play button G533 is pressed, the second music playback unit 369 plays the target music, the operation replay unit 370 recreates the DJ operations based on the operation replay information, and the second image generation unit 371 visualizes the DJ operations in the operation display area G52. Note that if the second music acquisition unit 368 is unable to acquire music data for the target music, the operation replay unit 370 recreates the DJ operations and the second image generation unit 371 visualizes the DJ operations in the operation display area G52, but the target music is not played.

[0099] [Modification of the embodiment] The present invention is not limited to the above-described embodiment, and any modifications and improvements that can achieve the object of the present invention are included in the present invention. In the above embodiment, the information processing device 3 includes the reproduction information generating unit 364 that records operation reproduction information. For example, the operation reproduction system 1B according to the first application example is configured to include a plurality of information processing devices 3, and each of the plurality of information processing devices 3 includes the reproduction information generating unit 364. However, this is not limiting, and the information processing device 3 does not need to include the reproduction information generating unit 364. That is, the information processing device 3 that constitutes the operation reproduction system 1A and at least one of the plurality of information processing devices 3 that constitute the operation reproduction system 1B may not include the reproduction information generating unit 364. In other words, at least one of the plurality of information processing devices 3 only needs to include the operation reproduction processing unit RP, and may not need to include a functional unit related to generation of operation reproduction information.

[0100] In the above embodiment, the information processing device 3 includes the second music acquisition unit 368 that acquires music data of a target music piece identified by music identification information in the operation reproduction information, and the second music playback unit 369 that plays the target music piece when reproducing a DJ operation based on the operation reproduction information. However, this is not limiting, and the second music acquisition unit 368 and the second music playback unit 369 may be omitted. In this case, the operation reproduction information may not include music identification information.

[0101] In the above embodiment, the operation reproducing unit 370 aligns the position on the time axis of the operation reproduction information with the playback position of the target song played by the second music playback unit 369. Specifically, based on the time adjustment information TA included in the operation log information LG, the operation reproducing unit 370 aligns the elapsed time ET included in the operation log information LG with the playback position of the target song played by the second music playback unit 369, or aligns the playback position of the target song with the playback position PP included in the operation log information LG. Note that the position indicated by the elapsed time ET included in the operation log information LG and the elapsed time ET corresponding to the playback position PP included in the operation log information LG correspond to positions on the time axis of the operation reproduction information. However, the present invention is not limited to this, and in cases where the playback speed, playback direction, and playback tempo of the target song do not change, the operation reproducing unit 370 does not necessarily need to adjust the timing of performing the DJ operation based on the playback position of the target song. In this case, the time adjustment information TA does not need to be included in the operation reproducing information, and the playback time of the target song may be included in the operation reproducing information instead of the elapsed time ET.

[0102] In the above embodiment, the operation reproducing unit 370 synchronizes the reproduction speed of the DJ operation with the playback speed of the target song when the reproduction speed of the DJ operation is changed by the user. However, this is not limited to this, and the reproduction speed of the DJ operation does not have to be adjustable.

[0103] In the above embodiment, the second image generation unit 371 generates an image including the details of the DJ operation reproduced by the operation reproduction unit 370 and information related to the DJ operation. However, the present invention is not limited to this, and the image generated by the second image generation unit 371 is not limited to the above as long as the second image generation unit 371 can generate an image including the operation details of the controls. For example, an image resembling the operation device 2 does not have to be generated.

[0104] In the above embodiment, the information processing device 3 includes the operation editing unit 372 that edits the operation reproduction information. However, this is not limiting, and the operation editing unit 372 may be omitted. Furthermore, the operation editing unit 372 may be configured so as not to edit operation reproduction information that records DJ operations of other users.

[0105] In the above embodiment, the information processing device 3 is configured to be able to transmit and receive operation reproducibility information to and from the server SV1 on the network N. That is, the operation reproducibility information is transmitted and received between a plurality of information processing devices 3 via the server SV1. However, the present invention is not limited to this, and the operation reproducibility information may be transmitted and received between the information processing devices 3 by other means.

[0106] In the above embodiment, the operation reproduction program for executing the operation reproduction process is stored in the storage unit 34. However, this is not limiting, and the operation reproduction program may be recorded on a computer-readable recording medium. When the information processing device reads and executes the operation reproduction program from such a recording medium, it becomes possible to achieve the same effects as the information processing device 3 described above. Examples of such a recording medium include a tape, a disk-type recording medium, and a semiconductor memory. Alternatively, the operation reproduction program may be provided via a network.

[0107] [Summary of the present invention] The present invention will be summarized below. [1] A reproduction information acquisition unit that acquires operation reproduction information that records an audio control operation for an audio control device having an operator that accepts the audio control operation; an operation reproducing unit that reproduces the sound control operation based on the operation reproduction information acquired by the reproduction information acquisition unit; an image generating unit that generates an image showing the content of the sound control operation reproduced by the operation reproducing unit.

[0108] According to this configuration, the operation reproduction unit reproduces the sound control operations performed on the controls of the sound control device based on the acquired operation reproduction information, and the image generation unit generates an image showing the details of the sound control operations. By acquiring operation reproduction information that records sound control operations performed by other users, the image showing the details of the sound control operations performed by other users can be viewed, making it easier to understand the details of the sound control operations performed by other users. This allows, for example, a beginner user who is unfamiliar with operating sound control devices to improve their proficiency by viewing the details of sound control operations performed by an advanced user, and also makes it easier to make the details of sound control operations public. Furthermore, even when multiple users share operation reproduction information, they do not share the music data of the music operated by the DJ operations reproduced based on the operation reproduction information. This allows users to share operation reproduction information that can reproduce other users' DJ operations without causing any problems with copyrights or other rights related to the music.

[0109] [2] In the information processing device described in [1], a storage unit for storing music data; an identification information acquisition unit that acquires, from the acquired operation reproduction information, music identification information that identifies a target music piece that is an operation target of the audio control operation; a music acquisition unit that acquires music data of the target music from the storage unit based on the music identification information; a playback unit that plays back the music data of the target music pieces acquired by the music acquisition unit, The information processing device, characterized in that the operation reproducing unit reproduces the sound control operation for the target music piece reproduced by the reproduction unit. With this configuration, the music that is the target of the sound control operation indicated by the operation replay information can be identified based on the music identification information acquired from the operation replay information acquired by the replay information acquisition unit. Then, the operation replay unit reproduces the sound control operation for the target music played by the playback unit, thereby reproducing the playback state of the target music at the time the operation replay information was recorded. Furthermore, the music data of the target song played by the playback unit is music data stored in the storage unit of the information processing device. Therefore, since the music data is not shared by multiple users, there are no problems with rights, such as copyright, regarding the music data, and the target song can be played in accordance with the reproduced DJ operations.

[0110] [3] In the information processing device described in [2], The information processing device, wherein the operation reproducing unit aligns a time axis position of the operation reproducing information with a playback position of the target music piece played by the playback unit. With this configuration, even if an operator such as a jog dial that changes the playback speed and playback direction of a song is operated, the sound control operation based on the operation reproduction information can be reproduced for the target song at the same playback position as when the sound control operation was recorded.

[0111] [4] In the information processing device described in [3], the operation reproduction information includes operation log information indicating the content of the sound control operation, The operation log information includes: The elapsed time from the start of recording the operation log information, a playback position in the target song identified by the song identification information, the playback position corresponding to the elapsed time; An information processing device characterized in that the operation reproduction unit adjusts the reading position of the operation log information so that the playback position included in the operation log information matches the playback position of the target song played by the playback unit. With this configuration, by adjusting the reading position of the operation log information so that the playback position included in the operation log information matches the playback position of the target song being played by the playback unit, it is possible to perform sound control operations according to the playback position of the target song being played by the playback unit based on the operation log information. Therefore, it is possible to more faithfully reproduce the playback state of the target song and the sound control operations for the target song at the time the operation reproduction information was recorded.

[0112] [5] In the information processing device described in [3], the operation reproduction information includes operation log information indicating the content of the sound control operation, The operation log information includes: The elapsed time from the start of recording the operation log information, a playback position in the target song identified by the song identification information, the playback position corresponding to the elapsed time; The information processing device, wherein the operation reproducing unit aligns a playback position of the target song played by the playback unit with the playback position included in the operation log information. With this configuration, by shifting the playback position of the target song to match the playback position included in the operation log information, it is possible to perform sound control operations according to the playback position of the target song played by the playback unit based on the operation log information, thereby more faithfully reproducing the playback state of the target song and the sound control operations performed on the target song at the time the operation reproduction information was recorded.

[0113] [6] In the information processing device according to any one of [2] to [5], The information processing device is characterized in that the operation reproduction unit increases or decreases the speed at which the sound control operation is performed, which is reproduced based on the operation reproduction information, and the playback speed of the target music piece, which is played by the playback unit, in synchronization with each other. According to this configuration, by synchronizing the speed at which the reproduced sound control operation is performed with the playback speed of the target music piece being played, it is possible to perform speed adjustments such as fast forwarding and rewinding.

[0114] [7] In the information processing device according to any one of [1] to [6], The information processing device, wherein the image generating unit generates the image including the content of the sound control operation reproduced by the operation reproducing unit and information related to the sound control operation. According to this configuration, by checking the image generated by the image generating section, it is possible to easily understand the content of the sound control operation when the operation reproduction information was recorded.

[0115] [8] In the information processing device according to any one of [1] to [7], An information processing device comprising: an operation editing unit that edits the operation reproduction information in accordance with an input operation. According to this configuration, since the recorded operation replay information can be edited, sound control operations that were not performed properly when the operation replay information was recorded can be corrected to appropriate sound control operations. In addition, since operations can be added to the recorded operation replay information, the recorded operation replay information can be rearranged to show more complex operations than when it was recorded, or the recorded operation replay information can be improved to show more exciting operations.

[0116] [9] In the information processing device according to any one of [1] to [8], The information processing apparatus, wherein the image generating section generates an operation state image showing, for each of the operators, an operation state of the operator according to an elapsed time from the start of recording of the operation reproduction information. According to this configuration, by checking the generated operation state image, it is possible to easily check the operation state of each operator according to the elapsed time.

[0117]

[10] In the information processing device according to any one of [1] to [9], The information processing device, wherein the image generating unit generates a mix content image showing a mix content of music based on a result of reproduction of the sound control operation by the operation reproducing unit. With this configuration, by checking the generated mix content image, it is possible to easily check the mix content of the music without listening to the music in which the sound control operations are reproduced.

[0118]

[11] In the information processing device according to any one of [1] to

[10] , Equipped with a communication unit that can communicate with external devices on the network, The information processing apparatus, wherein the reproduction information acquisition unit acquires the operation reproduction information from the external device via the communication unit. With this configuration, operation replay information can be acquired from an external device on the network, so that sound control operations based on operation replay information recorded by others can be reproduced, and the details of sound control operations performed by others can be understood, thereby improving the convenience of the information processing device.

[0119]

[12] An operation reproduction program executed by at least one processor, the at least one processor; a reproduction information acquisition step of acquiring operation reproduction information that records sound control operations for a sound control device having an operator that accepts the sound control operations; an operation reproducing step of reproducing the sound control operation based on the acquired operation reproducing information; and an image generating step of generating an image showing the reproduced sound control operation. By having a processor execute such an operation reproducing program, it is possible to achieve the same effects as the above-mentioned information processing device. [Explanation of symbols]

[0120] 1A, 1B...operation reproduction system, 2...operation device, 3...information processing device, 33...communication unit, 34...memory unit, 36...control unit, 366...reproduction information acquisition unit, 367...identification information acquisition unit, 368...second music acquisition unit (music acquisition unit), 369...second music playback unit (music playback unit), 370...operation reproduction unit, 371...second image generation unit (image generation unit), 372...operation editing unit, 4...display device, P1...operation state image, P2...mix content image.

Claims

1. a reproduction information acquisition unit that acquires operation reproduction information that records an audio control operation performed on an audio control device having an operator that accepts the audio control operation; an operation reproducing unit that reproduces the sound control operation based on the operation reproduction information acquired by the reproduction information acquisition unit; an image generating unit that generates an image of an operation reproducing screen showing the content of the sound control operation reproduced by the operation reproducing unit, the image on the operation reproduction screen includes a device image that resembles the sound control device, The information processing device according to claim 1, wherein the image generating unit draws the content of the sound control operation reproduced by the operation reproducing unit for the operator included in the device image.

2. 2. The information processing device according to claim 1, a storage unit for storing music data; an identification information acquisition unit that acquires, from the acquired operation reproduction information, music identification information that identifies a target music piece that is an operation target of the audio control operation; a music acquisition unit that acquires music data of the target music from the storage unit based on the music identification information; a playback unit that plays back the music data of the target music pieces acquired by the music acquisition unit, The information processing device, characterized in that the operation reproducing unit reproduces the sound control operation for the target music piece reproduced by the reproduction unit.

3. 3. The information processing device according to claim 2, The information processing device, wherein the operation reproducing unit aligns a position on a time axis of the operation reproduction information with a playback position of the target music piece played by the playback unit.

4. 4. The information processing device according to claim 3, the operation reproduction information includes operation log information indicating the content of the sound control operation, The operation log information includes: The elapsed time from the start of recording the operation log information, a playback position in the target song identified by the song identification information, the playback position corresponding to the elapsed time; The information processing device is characterized in that the operation reproduction unit adjusts the reading position of the operation log information so that the playback position included in the operation log information matches the playback position of the target song played by the playback unit.

5. 4. The information processing device according to claim 3, the operation reproduction information includes operation log information indicating the content of the sound control operation, The operation log information includes: The elapsed time from the start of recording the operation log information, a playback position in the target song identified by the song identification information, the playback position corresponding to the elapsed time; The information processing device, wherein the operation reproducing unit aligns a playback position of the target song played by the playback unit with the playback position included in the operation log information.

6. In the information processing device according to claim 1, a playback unit that plays music data of a target music piece that is the target of the sound control operation, the operation reproduction information includes operation log information indicating the content of the sound control operation, the operation log information includes a playback position in the target song, The information processing device is characterized in that the operation reproduction unit adjusts the reading position of the operation log information so that the playback position included in the operation log information matches the playback position of the target song played by the playback unit.

7. 7. The information processing device according to claim 6, a storage unit for storing music data; an identification information acquisition unit that acquires song identification information that identifies the target song from the acquired operation reproduction information; a music acquisition unit that acquires music data of the target music from the storage unit based on the music identification information, the playback unit plays back the music data of the target music piece acquired by the music acquisition unit; The information processing device, characterized in that the operation reproducing unit reproduces the sound control operation for the target music piece reproduced by the reproduction unit.

8. 8. The information processing device according to claim 7, The information processing device, wherein the operation reproducing unit aligns a position on a time axis of the operation reproduction information with a playback position of the target music piece played by the playback unit.

9. 9. The information processing device according to claim 8, The operation log information includes an elapsed time from the start of recording of the operation log information, the playback position included in the operation log information is a playback position in the target song identified by the song identification information that corresponds to the elapsed time, The information processing device is characterized in that the operation reproduction unit adjusts the reading position of the operation log information so that the playback position included in the operation log information matches the playback position of the target song played by the playback unit.

10. 10. The information processing device according to claim 2, wherein: The information processing device is characterized in that the operation reproduction unit increases or decreases the speed at which the sound control operation is performed, which is reproduced based on the operation reproduction information, and the playback speed of the target music piece, which is played by the playback unit, in synchronization with each other.

11. 2. The information processing device according to claim 1, The information processing device, characterized in that the image generation unit generates an image of the operation reproduction screen including the content of the sound control operation reproduced by the operation reproduction unit and information related to the sound control operation.

12. 2. The information processing device according to claim 1, An information processing device comprising: an operation editing unit that edits the operation reproduction information in accordance with an input operation.

13. 2. The information processing device according to claim 1, The information processing apparatus, wherein the image generating section generates an operation state image showing, for each of the operators, an operation state of the operator according to an elapsed time from the start of recording of the operation reproduction information.

14. 2. The information processing device according to claim 1, The information processing device, wherein the image generating unit generates a mix content image showing a mix content of music based on a result of reproduction of the sound control operation by the operation reproducing unit.

15. 2. The information processing device according to claim 1, Equipped with a communication unit that can communicate with external devices on the network, The information processing apparatus, wherein the reproduction information acquisition unit acquires the operation reproduction information from the external device via the communication unit.

16. an operation reproduction program executed by at least one processor, the at least one processor, a reproduction information acquisition unit that acquires operation reproduction information that records an audio control operation performed on an audio control device having an operator that accepts the audio control operation; an operation reproducing unit that reproduces the sound control operation based on the acquired operation reproduction information; an image generating unit that generates an image of an operation reproduction screen including a device image that imitates the sound control device and that shows the reproduced content of the sound control operation; The operation reproducing program, wherein the image generating unit draws the content of the sound control operation reproduced by the operation reproducing unit for the operator included in the device image.

17. In the operation reproduction program according to claim 16, the at least one processor, a playback unit that plays back music data of a target music piece that is the target of the sound control operation; the operation reproduction information includes operation log information indicating the content of the sound control operation, the operation log information includes a playback position in the target song, The operation reproduction program is characterized in that the operation reproduction unit adjusts the reading position of the operation log information so that the playback position included in the operation log information matches the playback position of the target song played by the playback unit.

Images