Sound reproduction device, program, and reproduction control method

Abstract

Provided is a sound reproduction device (1) comprising: a beat position acquisition unit (132) that acquires a beat position in music data being reproduced; a display unit (110, 133) that comprises a display element, and that displays an image showing time information about the music data; an operation unit (120, 134) that receives a user operation; and a setting unit (135) that, when a first position in the image has been selected by means of the operation unit, sets, as a reproduction start position in a bar of the music data that includes the first position, a beat position corresponding to the beat position when the first position was selected.

Description

[Technical Field]

[0001] The present invention relates to an audio playback device, a program, and a playback control method. [Background technology]

[0002] When a DJ (Disc Jockey) performs a DJ performance by operating a sound reproduction device such as a DJ controller, a computer, etc., he or she performs tasks such as selecting songs, analyzing song data (detecting BPM and key, detecting and adjusting beat positions, setting cue points, etc.), and checking compatibility between multiple songs. These various tasks are performed not only using a sound reproduction device such as a DJ controller, but also using a computer, a mobile device such as a smartphone or a tablet, etc. For example, Non-Patent Document 1 discloses an application that can perform various tasks on both a computer and a mobile device. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] DJ Player Professional (iMect Ltd.) application introduction homepage (https: / / apps.apple.com / jp / app / dj-player-professional / id339810085) Summary of the Invention [Problem to be solved by the invention]

[0004] An important part of a DJ performance is setting the playback start point, also known as cueing. This requires delicate and precise operation to ensure playback starts from the right part of the song. Performing this task properly also requires knowledge of the song's structure and development.

[0005] Therefore, the present invention aims to provide an audio playback device, a program, and a playback control method that enable even users with little experience or knowledge to set the playback start position with intuitive and simple operations in an audio playback device. [Means for solving the problem]

[0006] The audio playback device of the present invention includes a beat position acquisition unit that acquires the beat position of music data being played back, a display unit that has a display element and displays an image showing time information of the music data, an operation unit that accepts user operations, and a setting unit that, when a first position on the image is selected by the operation unit, sets, as the playback start position, a beat position in the music data that corresponds to the beat position when the first position was selected within a measure that includes the first position.

[0007] A program according to the present invention is configured to cause a computer to function as the above-described sound reproducing device.

[0008] The playback control method of the present invention is a playback control method implemented by an audio playback device that includes a beat position acquisition unit that acquires the beat position of music data being played back, a display unit that has a display element and displays an image indicating time information of the music data, and an operation unit that accepts user operations, and includes a step of, when a first position on the image is selected by the operation unit, setting, as the playback start position, a beat position in the music data that corresponds to the beat position when the first position was selected within a measure that includes the first position. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a schematic functional configuration of a sound reproducing device according to an embodiment of the present invention; [Figure 2] FIG. 2 is a diagram showing an example of a display screen in the first embodiment of the present invention. [Figure 3A] FIG. 3 is a diagram illustrating setting of a playback start position in the first embodiment of the present invention. [Figure 3B]FIG. 10 is another diagram illustrating setting of a playback start position in the first embodiment of the present invention. [Figure 3C] FIG. 10 is another diagram illustrating setting of a playback start position in the first embodiment of the present invention. [Figure 4] 5 is a flowchart showing an operation when setting a playback start position in the first embodiment of the present invention. [Figure 5A] FIG. 10 is another diagram illustrating setting of a playback start position in the first embodiment of the present invention. [Figure 5B] FIG. 10 is another diagram illustrating setting of a playback start position in the first embodiment of the present invention. [Figure 5C] FIG. 10 is another diagram illustrating setting of a playback start position in the first embodiment of the present invention. [Figure 6A] FIG. 10 is another diagram illustrating setting of a playback start position in the first embodiment of the present invention. [Figure 6B] FIG. 10 is another diagram illustrating setting of a playback start position in the first embodiment of the present invention. [Figure 6C] FIG. 10 is another diagram illustrating setting of a playback start position in the first embodiment of the present invention. [Figure 7] 10 is another flowchart showing the operation when setting the playback start position in the first embodiment of the present invention. [Figure 8A] FIG. 10 is a diagram illustrating setting of a playback start position in the second embodiment of the present invention. [Figure 8B] FIG. 10 is another diagram illustrating setting of a playback start position in the second embodiment of the present invention. [Figure 8C] FIG. 10 is another diagram illustrating setting of a playback start position in the second embodiment of the present invention. [Figure 8D] FIG. 10 is another diagram illustrating setting of a playback start position in the second embodiment of the present invention. [Figure 9] 10 is a flowchart showing an operation when setting a playback start position in the second embodiment of the present invention. [Figure 10]10 is another flowchart showing the operation when setting the playback start position in the second embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted.

[0011] (First embodiment) 1 is a block diagram showing a schematic functional configuration of an audio playback device according to a first embodiment of the present invention. The audio playback device according to the first embodiment of the present invention may be an audio playback device such as a DJ controller, an audio playback device using a computer, or an audio playback device using a mobile terminal such as a smartphone or tablet. 1, sound reproduction device 100 includes display 110, touch panel 120, control unit 130, music data storage unit 140, and audio output unit 150. The functions of each of the above units are realized by a processor operating according to a program in a sound reproduction device having, for example, a computer hardware configuration. The functions of each unit will be further described below.

[0012] The display 110 is a display device that displays a screen including various types of information and controls for accepting user operations in the sound reproduction device 100. As the display 110, a display device equipped with various types of display elements, such as a liquid crystal display device or an organic EL display device, can be used. The touch panel 120 is provided on the surface of the display 110. The touch panel 120 detects the position touched by the user and outputs information such as coordinates indicating the touch position to the control unit 130. The touch panel 120 can be of various types, such as a capacitance type or a resistive type.

[0013] The control unit 130 is implemented in the sound reproduction device 100 by, for example, a communication interface, a processor such as a CPU (Central Processing Unit), and a memory that serves as a working area, and controls the operation of the sound reproduction device 100. The control unit 130 includes a reproduction unit 131, which is realized by the processor operating in accordance with a program stored in the memory or received via the communication interface, a beat position acquisition unit 132, a display control unit 133, a reception unit 134, and a setting unit 135.

[0014] The playback unit 131 acquires music data from the music data storage unit 140, which will be described later, based on user operations via the touch panel 120 and the reception unit 134. Then, the playback unit 131 plays back the acquired music data and outputs an audio signal to the audio output unit 150, which will be described later. The beat position acquisition unit 132 analyzes music data being played by the playback unit 131 and generates beat position information as music analysis information. The beat position acquisition unit 132 acquires beat position information of music data by detecting, for example, specific instrument sounds such as percussion instruments. Furthermore, the beat position acquisition unit 132 may acquire, as music analysis information, bar position information of music data and information such as development change points. Development change points can be determined, for example, based on the analysis results of the beat position information, the similarity of pronunciation patterns, and the like. Such development change points correspond to, for example, the beginnings of phrases (divisions of development) such as the intro, A melody, B melody, and chorus of a music piece, and can be referenced as the development structure of the music piece by the setting unit 135, which will be described later.

[0015] The display control unit 133 causes the display 110 to display a screen including information about the music data to be played by the sound playback device 100 and display elements (hereinafter also referred to as operators) of a GUI (Graphical User Interface) for accepting user operations related to playback settings and playback control for the music data. The accepting unit 134 accepts a user operation based on a contact position by the user detected by the touch panel 120. Then, the accepting unit 134 supplies information indicating the content of the user operation to each unit in the control unit 130.

[0016] The setting unit 135 sets a playback start position for music data being played back by the playback unit 131, based on a user operation via the touch panel 120 and the reception unit 134. The setting of the playback start position will be described in detail later.

[0017] The music data storage unit 140 is configured to be able to store music data using an HDD (Hard Disk Drive) or flash memory, etc. The music data storage unit 140 stores multiple pieces of music data in a predetermined format, such as MP3 format. In addition to audio information, the music data includes tag information such as the BPM of the music, artwork, title, artist name, album name, key, number of DJ plays, and genre. The music data stored in the music data storage unit 140 is associated with a timestamp, which is information about the playback position.

[0018] The sound reproduction device 100 may be configured to include a communication interface, and acquire music data stored in an external storage device, a computer, a server, or the like via the communication interface (not shown), and store the music data in the music data storage unit 140. In this case, the sound reproduction device 100 does not include the music data storage unit 140, and the external storage device functions as the music data storage unit 140. The audio output unit 150 includes a speaker, a headphone terminal, and the like, and outputs the audio signal of the music data reproduced by the reproduction unit 131 as audio information.

[0019] In the sound reproducing device 100 described above, a display screen that is displayed on the display 110 when the user sets a playback start position, also called cueing, will be described.

[0020] 2 is a diagram showing an example of a display screen in the first embodiment. The display control unit 133 displays a screen relating to the playback of music on the display 110, as shown in FIG.

[0021] 2, a display area 201 is provided on the upper right side of the screen of the display 110, which displays information about the music data being played back by the playback unit 131. The display area 201 displays the title of the music, the artist name, thumbnails related to the music, and the like. Below the display area 201, there is provided a display area 202 that displays waveform information of the music data being played back by the playback unit 131. The waveform information displayed in the display area 202 is an example of an image that shows time information of the entire music piece or a portion of it.

[0022] Below the display area 202, there is provided a display area 203 that displays partial waveform information of the music data being played back by the playback unit 131. The partial waveform information is an enlarged view of the waveform information of the music data within a predetermined time range that includes the current playback position. 2, bars 203A indicating development change points and phrases (divisions of development) such as the intro, verse verse, chorus, etc. of a song may be displayed superimposed on or adjacent to display area 203. In this way, by displaying on display 110 information indicating the development of a song in association with waveform information, which is an image showing the time information of the song data, it is possible to support the user in making a selection.

[0023] The user can select a position (first position) on the image that indicates the time information of the music data and set the playback start position by touching a part of the waveform information in display area 202 or 203 of the screen described in FIG. 2, i.e., by performing a so-called touch operation. When setting the playback start position, it is necessary to set an appropriate part based on the composition and development of the music. Specifically, it is preferable to set the playback start position to accurately match the beat position based on the composition and development of the music.

[0024] Therefore, in the first embodiment, when a touch operation is performed on the waveform information in the display area 202 or 203 of the screen described in Fig. 2, the setting unit 135 sets, as the playback start position, a beat position within the bar including that position (first position) that corresponds to the beat position of the music being played when the touch operation was performed. Here, the "corresponding beat position" is a position in any bar where the number of beats matches.

[0025] For example, as shown in FIG. 3A , when position P(P1) in the display area 202 is selected by the user's finger H, the setting unit 135 acquires the beat position of the music being played when the touch operation was performed from the beat position acquisition unit 132. As shown in FIG. 3B , if the beat position of the music being played when the touch operation was performed was position P(R1), that is, the third beat of the Nth measure, the setting unit 135 sets, as the playback start position, position P(S1), which is the beat position corresponding to position P(R1), which is the beat position of the music being played, in the measure including position P(P1) in the display area 202, that is, the Mth measure, as shown in FIG. 3C , rather than position P(P1) itself selected in the display area 202. Note that while the example in FIG. 3C illustrates an example in which position P(S1) set as the playback start position is later in time than position P(P1) selected by the user, the same applies in the reverse case. For example, in a measure including a position P(P1) selected by the user, if the beat position corresponding to a position P(R1), which is the beat position of the music being played, is a beat position that is temporally earlier than position P(P1), the setting unit 135 sets the beat position that is temporally earlier than position P(P1) and that corresponds to position P(R1), which is the beat position of the music being played, as the playback start position.

[0026] FIG. 4 is a flowchart showing the operation of each unit when setting the playback start position. In the example shown in FIG. 4, first, the accepting unit 134 determines whether or not a contact (touch operation) has been made with the waveform information via the touch panel 120 (step S101). When the receiving unit 134 determines that the waveform information has been touched (YES in step S101), the setting unit 135 acquires the beat position of the music being played when the touch operation was performed from the beat position acquisition unit 132 (step S102).

[0027] Then, the setting unit 135 sets, within the measure including the position where the touch operation was performed (first position), a beat position that corresponds to the beat position of the music being played when the touch operation was performed as the playback start position (step S103).

[0028] When the playback start position is set by the setting unit 135, the control unit 130 causes the playback unit 131 to perform playback from the set playback start position. That is, when a user performs cueing while monitoring via a headphone jack or the like via the audio output unit 150, the user can set the appropriate beat position as the playback start position simply by touching the approximate position in the waveform information. Furthermore, because playback by the playback unit 131 starts from the position set as the playback start position, the number of beats per bar and development of the music being played are maintained. This allows for playback that sounds natural to the user monitoring, while also preventing the problem of discomfort caused by disrupting the composition, development, and rhythm of the music.

[0029] 3 and 4, the case has been described where the beat position of the music being played when a touch operation is performed on the waveform information in display area 202 or 203 coincides with a beat division. However, if the beat position of the music being played when a touch operation is performed on the waveform information in display area 202 or 203 does not coincide with a beat division, the following measures may be taken.

[0030] The first solution is to set the playback start position regardless of the beat division. For example, as shown in FIG. 5A, when position P(P2) in the display area 202 is selected with the user's finger H, the setting unit 135 acquires the beat position of the music being played when the touch operation was performed from the beat position acquisition unit 132. As shown in FIG. 5B, a case is illustrated in which the beat position of the music being played when the touch operation was performed was position P(R2), for example, beat 3.2 of the Nth measure. Here, beat 3.2 indicates the position of "3.2" when the third beat is "3" and the fourth beat is "4" on the time axis of the music. As shown in FIG. 5C, within the measure including position P(P2) in the display area 202, i.e., measure M, the setting unit 135 sets position P(S2), which is the beat position corresponding to position P(R2), which is the beat position of the music being played, i.e., beat 3.2 of the Mth measure, as the playback start position, rather than position P(P2) itself selected in the display area 202.

[0031] By adopting such a measure, it is possible to set a playback start position that corresponds faithfully to the touch operation by the user, and also to suppress the above-mentioned problem of discomfort felt by the user during monitoring.

[0032] The second approach is to align the playback start position with a beat position corresponding to a beat division. If the beat position of the music being played when a touch operation is performed on the waveform information in display area 202 or 203 does not match the beat division, setting unit 135 waits until playback unit 131 plays the music up to the next beat division, and then sets the beat position corresponding to the next beat division as the playback start position.

[0033] 6A, when position P(P3) in display area 202 is selected by the user's finger H, setting unit 135 acquires the beat position of the music being played when the touch operation was performed from beat position acquisition unit 132. As shown in FIG. 6B, if the beat position of the music being played when the touch operation was performed was position P(R3), for example, beat 3.2 of the Nth measure, setting unit 135 waits until the beat position of the music being played reaches the division of the next beat, that is, the fourth beat of the Nth measure and becomes position P(R4). Then, as shown in FIG. 6C, within the measure including position P(P3) in display area 202, that is, measure M, the playback start position is not set to position P(P3) itself selected in display area 202, but to position P(S4), which is the beat position corresponding to position P(R4), which is the beat position of the music being played after waiting, that is, the fourth beat of the Mth measure.

[0034] FIG. 7 is another flowchart showing the operation of each unit when setting the playback start position. In the example shown in FIG. 7, first, the accepting unit 134 determines whether or not a contact (touch operation) has been made with the waveform information via the touch panel 120 (step S201). When the receiving unit 134 determines that the waveform information has been touched (YES in step S201), the setting unit 135 acquires the beat position of the music being played when the touch operation was performed from the beat position acquisition unit 132 (step S202).

[0035] Next, the setting unit 135 determines whether the acquired beat position coincides with a division of the number of beats (step S203). When the setting unit 135 determines that the acquired beat position matches the division of the number of beats (step S203 YES), the setting unit 135 sets the beat position corresponding to the beat position of the music being played when the touch operation was performed within the measure including the position where the touch operation was performed (first position) as the playback start position (step S204).

[0036] On the other hand, if the setting unit 135 determines that the acquired beat position does not match the beat division (step S203 NO), it waits by determining whether the playback position by the playback unit 131 matches the beat division (step S205), and if it determines that the playback position by the playback unit 131 matches the beat division (step S205 YES), the setting unit 135 sets the beat position corresponding to the beat position where the music being played matches the beat division as the playback start position within the measure including the position where the touch operation was performed (first position) (step S206).

[0037] By taking such measures, it is possible to set the playback start position in accordance with the beat position based on the touch operation by the user, and also to reduce the problem of discomfort felt by the user during monitoring as described above.

[0038] According to the first embodiment of the present invention as described above, the apparatus includes a beat position acquisition unit 132 that acquires the beat position of music data being played back, a display 110 and a display control unit 133 that are display units equipped with a display element and that display an image indicating time information of the music data, a touch panel 120 and a reception unit 134 that are operation units that receive user operations, and a setting unit 135 that, when a first position on the image is selected by the operation unit, sets, as the playback start position, a beat position in the music data that corresponds to the beat position at which the first position was selected within the measure that includes the first position.

[0039] Therefore, by simply selecting an approximate position on an image that shows time information for music data that allows the overall composition of the song to be grasped, such as waveform information showing the overall waveform, it is possible to set an appropriate playback start position that corresponds to the beat position. Also, because the number of beats per measure and development of the song being played are maintained before and after the user's selection operation, playback continues to sound natural to the user monitoring, and the problem of discomfort caused by a disruption in the song's composition, development, or rhythm is reduced. Therefore, even a user with little experience or knowledge of the sound reproducing device can set the reproduction start position with an intuitive and simple operation. In particular, by setting the playback start position within the measure including the first position selected by the user, it is possible to set the playback start position relatively close to the position selected by the user and in accordance with the beat position, without straying too far from the position selected by the user, thereby minimizing the user's discomfort and enabling intuitive and intuitive operation by the user.

[0040] Furthermore, according to the first embodiment of the present invention, information indicating the progression of music data is displayed on an image showing the time information of the music data, so even users with little experience or knowledge can set the playback start position according to the structure and progression of the music. Furthermore, according to the first embodiment of the present invention, user operations are accepted via the touch panel 120 provided on the surface of the display element. This allows the user to set the playback start position with an intuitive and simple operation.

[0041] In the first embodiment, an example was shown in which a beat position in a measure of music data that includes a first position selected by a user is set as the playback start position, the beat position corresponding to the beat position of the music being played when the first position was selected. However, dance music used in DJ performances is also called loop music, and many pieces of music have a characteristic of repeating development. Therefore, a position that corresponds not only to a beat position but also to a measure may be set as the playback start position.

[0042] For example, as shown in FIG. 3A , when position P (P1) in display area 202 is selected by the user's finger H, setting unit 135 acquires the beat position of the music being played when the touch operation was performed from beat position acquisition unit 132, and also acquires bar position information and information such as development change points of the music data. Then, as shown in FIG. 3B , if the beat position of the music being played when the touch operation was performed was position P (R1), that is, the third beat of the Nth measure in a certain phrase, more specifically, in a development section such as the intro, A melody, B melody, or chorus, setting unit 135 sets the phrase including position P (P1) in display area 202, more specifically, the third beat of the Nth measure in the development section such as the intro, A melody, B melody, or chorus, as the playback start position, which is the same as the music being played. In this way, the development of the music is maintained before and after the user's selection operation, allowing a more suitable playback start position to be set. In addition, whether only the beat position is matched or the bar is matched may be determined depending on the combination of the development of the music being played when the touch operation is performed and the development of the music at the position selected by the user.

[0043] Furthermore, a different playback start position may be set depending on the development of the music being played when a touch operation is performed. For example, consider a case where the music being played when a touch operation is performed is in the Xth measure of a certain phrase. If the beat position Y of the music when the touch operation is performed is in the first half of the measure, for example, between the first beat and the third beat, the setting unit 135 sets the Yth beat of the Xth measure of the music being played as the playback start position for the phrase including the position corresponding to the touch operation. On the other hand, if the beat position Y of the music when the touch operation is performed is in the second half of the measure, for example, between the third beat and the first beat of the next measure, the setting unit 135 sets the Yth beat of the X-1th measure adjacent to the Xth measure as the playback start position for the phrase including the position corresponding to the touch operation, rather than the Xth measure of the music being played. In other words, the playback start position is set to the measure immediately preceding the Xth measure. By setting the playback start position in this way, even if the user performs a rough touch operation, it is possible to reduce the sense of discomfort felt by the user and set a more suitable playback start position.

[0044] (Second embodiment) In the second embodiment, only the parts that are different from the first embodiment will be described, and the description of the parts that are the same as those in the first embodiment will be omitted. In the second embodiment, the reception unit 134 receives a so-called slide operation (swipe operation) in which a finger is slid horizontally from any position, and the display control unit 133 supports user operations by changing the display content of the display 110 according to the content of the slide operation.

[0045] In the first embodiment, an example was shown in which the playback start position was set based on a touch operation by the user, whereas in the second embodiment, candidate positions for the playback start position are changed and displayed based on a slide operation by the user. In the second embodiment, the display control unit 133 changes the positions that are candidates for the playback start position depending on the speed of the slide operation and displays them on the display 110, and the setting unit 135 sets the beat position that corresponds to the end point position of the slide operation as the playback start position.

[0046] When a slide operation is started, first, the control unit 130 causes the playback unit 131 to play from a position corresponding to the start point of the slide operation. At this time, the control unit 130 causes the playback unit 131 to play from a beat position corresponding to the beat position of the music being played when the slide operation was started. That is, in the first embodiment, the playback start position is set to a beat position within a measure including the position where the touch operation was performed that corresponds to the beat position of the music being played when the touch operation was performed. Similarly, when a slide operation is started, the control unit 130 causes the playback unit 131 to play from a beat position within a measure including the position (first position) of the start point of the slide operation that corresponds to the beat position of the music being played when the slide operation was started. In this way, when the slide operation is started, the playback unit 131 starts playing from the beat position of the music being played when the slide operation was started, so the number of beats per measure and the development of the music being played are maintained. This allows for playback that sounds natural to the user monitoring the music, and also prevents the problem of discomfort caused by a disruption in the composition, development, or rhythm of the music.

[0047] 8A, when a position P (P5) in the display area 202 is selected by the user's finger H and a sliding operation is started, and the sliding operation is performed as indicated by arrow A1 while maintaining contact with the touch panel 120, the display control unit 133 changes and displays the candidate positions for the playback start position according to the speed of the sliding operation. More specifically, the display control unit 133 increases the unit by which the candidate positions for the playback start position are changed as the speed of the sliding operation increases, and decreases the unit by which the candidate positions for the playback start position are changed as the speed of the sliding operation decreases. The candidate positions may be displayed in any manner. For example, when the candidate positions are displayed as lines, the display control unit 133 displays the candidate positions on the display 110 so that they are visible by changing the color, type, thickness, blinking type of the line, whether the line blinks, etc.

[0048] For example, the display control unit 133 divides the speed of the slide operation into four stages and changes and displays candidate positions for the playback start position as follows: (1) When the slide operation speed is the fastest As indicated by arrow A2 in FIG. 8B, the candidate position P (C5) for the playback start position is changed and displayed for each development point of the music (phrase unit). (2) When the slide operation speed is the second fastest As indicated by arrow A3 in FIG. 8C, the candidate positions for the playback start position are displayed in four-bar increments, changing sequentially from P(C6), to P(C7), to P(C8). (3) When the slide operation speed is the third fastest The candidate positions for the playback start position are changed and displayed in beat units. (4) When the slide operation speed is the slowest The candidate positions are changed and displayed according to the slide operation.

[0049] In this way, when the candidate positions for the playback start position are changed and displayed according to the speed of the slide operation, as shown in FIG. 8D, if the contact by the user's finger H ends at position P (P6) in the display area 202, that is, if the user releases the finger H from the touch panel 120, the setting unit 135 sets the beat position corresponding to the end position of the slide operation as the playback start position. Note that the above (1) to (4) are merely examples, and various units can be used depending on the development of the music. For example, in addition to the above examples, the candidate playback start positions may be changed in units of one bar, eight bars, sixteen bars, etc. Generally, music is often structured so that the development changes in units of four bars or eight bars. Therefore, the candidate playback start positions may be changed in units of multiples of four bars. Furthermore, if one development (a continuous development) is long, the candidate playback start positions may be changed in units of more bars, such as 32 bars or 64 bars.

[0050] FIG. 9 is a flowchart showing the operation of each unit when setting the playback start position. In the example shown in FIG. 9, first, the accepting unit 134 determines whether or not touching on the waveform information has started via the touch panel 120 (step S301). When the receiving unit 134 determines that contact with waveform information has started (step S301 YES), the setting unit 135 acquires the beat position of the music being played when contact with waveform information started from the beat position acquisition unit 132 (step S302), and the playback unit 131 starts playback from the beat position corresponding to the beat position of the music being played when contact with waveform information started (step S303). That is, the playback unit 131 starts playback from the beat position corresponding to the beat position of the music being played when contact with waveform information started, within the measure including the position touched by the user (first position).

[0051] Next, the accepting unit 134 determines whether or not the touch on the waveform information via the touch panel 120 has ended (step S304). When the accepting unit 134 determines that the touch on the waveform information has ended (step S304 YES), the start and end points of the touch on the waveform information are nearly the same, and it can be determined that the operation by the user is a touch operation rather than a slide operation. Therefore, the setting unit 135 sets, as the playback start position, the beat position that corresponds to the beat position of the music being played when the touch operation was performed, within the measure including the position touched by the user in step S301 (step S305).

[0052] On the other hand, if the receiving unit 134 determines that the touch on the waveform information has not ended (step S304 NO), it determines whether or not the touch position has moved (step S306). The presence of a movement of the touch position means that the user is performing a slide operation in which the user moves their finger while keeping it in contact with the touch panel 120. If the receiving unit 134 determines that the touch position has moved (step S306 YES), it detects the speed of the slide operation (step S307). Then, the display control unit 133 determines a movement unit for changing the candidate positions of the playback start position according to the speed of the slide operation (step S308), and changes the candidate positions by the determined movement unit according to the slide operation and displays them on the display 110 (step S309). Furthermore, the playback unit 131 starts playback from the candidate positions in accordance with the display of the candidate positions on the display 110 (step S310).

[0053] Next, the accepting unit 134 determines whether or not the touch on the waveform information via the touch panel 120 has ended (step S311). When the accepting unit 134 determines that the touch on the waveform information has ended (step S311 YES), it can be determined that the slide operation by the user has ended. Therefore, the setting unit 135 sets the position where the touch by the user ended in step S311, that is, the end point of the touch, as the playback start position (step S312).

[0054] As described above, when a touch operation is performed on waveform information, the control unit 130 starts playback by the playback unit 131 in step S303 with respect to the playback start position based on the position touched by the user in step S301, and sets this as the playback start position by the setting unit 135 in step S305. On the other hand, when a slide operation is performed on waveform information, the control unit 130 starts playback by the playback unit 131 in step S310 with respect to the playback start position based on the position where the user's slide operation ended in step S311, and sets this as the playback start position by the setting unit 135 in step S312.

[0055] Therefore, when performing a cueing operation while monitoring via a headphone jack or the like via the audio output unit 150, the user sets the playback start position by performing a slide operation on the waveform information. At that time, the user can control the unit of movement for changing the candidate position by controlling the speed of the slide operation. For example, when a rough selection is desired, the candidate position can be changed significantly by performing a quick slide operation, and when a detailed selection is desired, the candidate position can be changed more finely by performing a slow slide operation. Furthermore, within the measure that includes the position (first position) touched by the user, playback begins from the beat position that corresponds to the beat position of the music being played when touching the waveform information began, so the number of beats per measure and development of the music being played are maintained. This allows for playback that is natural to the user monitoring, while also preventing the problem of discomfort caused by a disruption in the composition, development, and rhythm of the music.

[0056] FIG. 10 is a flowchart showing a modification of steps S307 to S311 of the flowchart described with reference to FIG. 10, when it is determined that the contact position has moved, the accepting unit 134 detects the speed of the slide operation (step S401). Then, the display control unit 133 determines whether the speed of the slide operation is equal to or greater than a predetermined threshold Th (step S402). When it is determined that the speed of the slide operation is equal to or greater than the predetermined threshold Th (step S402 YES), the display control unit 133 changes the candidate position in beat units in accordance with the slide operation and displays it on the display 110 (step S403).

[0057] On the other hand, if it is determined that the speed of the slide operation is less than the predetermined threshold Th (step S402 NO), the display control unit 133 displays the slide operation on the display 110 in accordance with the slide operation, that is, by directly reflecting the slide operation in a change of the candidate position (step S404). Furthermore, the playback unit 131 starts playback from the candidate position in accordance with the display of the candidate position on the display 110 in step S403 or step S404 (step S405).

[0058] Then, the accepting unit 134 determines whether or not the touch on the waveform information via the touch panel 120 has ended (step S406). That is, the control unit 130 repeatedly executes the processes from step S401 to step S406 until contact with the waveform information ends.

[0059] The flowchart described in Fig. 9 shows an example in which a movement unit for changing a candidate position for the playback start position is determined according to the speed of the slide operation. Also, the flowchart described in Fig. 10 shows an example in which the speed of the slide operation is compared with a predetermined threshold Th, and different processing is executed when the speed of the slide operation is equal to or greater than the predetermined threshold Th and when the speed of the slide operation is less than the predetermined threshold Th. A configuration may be adopted in which a part or all of the processing described in FIG. 9 and a part or all of the processing described in FIG. 10 are executed in combination. For example, as described in the example of Figure 9, a configuration may be adopted in which a movement unit for changing the candidate position for the playback start position is determined depending on the speed of the slide operation, and different processing is executed when the speed of the slide operation is less than a predetermined threshold value Th. Furthermore, although the example in which the movement unit determined according to the speed of the slide operation is four levels has been shown, it may be divided into five or more levels, or into three or less levels. Furthermore, the relationship between the speed of the slide operation and the movement unit, and each threshold value, may be set by the user.

[0060] According to the second embodiment of the present invention as described above, a slide operation is accepted starting from the position of the start point of the slide operation (first position), and the display control unit 133 changes the positions that are candidates for the playback start position according to the speed of the slide operation and displays them on the display 110, and the setting unit 135 sets the beat position corresponding to the position of the end point of the slide operation as the playback start position. Therefore, by controlling the speed of the slide operation, the user can control the unit of movement for changing the candidate position, thereby improving operability in setting the playback start position. Also, because the number of beats per measure and development of the music being played are maintained before and after the user starts the slide operation, playback continues to sound natural to the user monitoring, and the problem of discomfort caused by a disruption in the composition, development, or rhythm of the music can be reduced. Therefore, even a user with little experience or knowledge of the sound reproducing device can set the reproduction start position with an intuitive and simple operation.

[0061] Furthermore, according to the second embodiment of the present invention, when the speed of the slide operation is less than a predetermined threshold, the display control unit 133 changes the positions that are candidates for the playback start position in units of beats and displays them on the display 110, and when the speed of the slide operation is equal to or greater than the predetermined threshold, the positions that are candidates for the playback start position in units different from beats and displays them on the display 110. Therefore, it is possible to change and display the positions that are candidates for the playback start position in units of movement that are suitable for the purpose of the user, depending on the speed of the slide operation.

[0062] Furthermore, according to the second embodiment of the present invention, the unit different from the beat unit is the bar unit of the music piece indicated by the music piece data, so that the positions that are candidates for the playback start position can be changed and displayed in bar units of the music piece.

[0063] Furthermore, according to the second embodiment of the present invention, when the speed of the slide operation is equal to or greater than a predetermined threshold, the display control unit 133 changes the positions that are candidates for the playback start position in beat units and displays them on the display 110, and when the speed of the slide operation is less than the predetermined threshold, the display control unit 133 changes the positions that are candidates for the playback start position in accordance with the slide operation and displays them on the display 110. Therefore, it is possible to change and display the positions that are candidates for the playback start position in suitable movement units according to the user's purpose.

[0064] Note that the user operations described in the above embodiments are merely examples and are not limited to the above embodiments. For example, instead of a slide operation, a so-called flick operation, in which a finger is slid or flicked, may be adopted. In addition, although the above embodiments have shown examples in which operations are accepted by contact with the user's fingers, the present invention can be similarly applied to other operations. For example, operations may be accepted by contact with a touch pen or stylus pen, or a pointer may be displayed on the display 110 and operations may be accepted via an operating device such as a mouse.

[0065] Furthermore, in each of the above embodiments, the cueing operation during music playback has been described as an example, but the present invention is not limited to this example. For example, the present invention can be similarly applied to video playback. In video playback, if captures and chapters are added to the target video image, the playback start position can be set in accurate association with the captures and chapters by using the divisions in the same way as the beat positions, measure positions, and phrases (divisions of development) described in the above embodiments.

[0066] Furthermore, the display screens described in the above embodiments are merely examples, and the elements, designs, layouts, etc. are not limited to the present embodiments. For example, in addition to or instead of the waveform information and partial waveform information of the entire music data, a record or a graphic resembling a record, a jog dial, etc. may be provided. Furthermore, the elements, designs, layouts, etc. of each display screen may be user-configurable.

[0067] Furthermore, in each of the above embodiments, the sound reproducing device 100 including one display 110 has been described as an example, but the present invention may also be applied to a sound reproducing device 100 including two or more display devices.

[0068] Furthermore, in the above embodiments, the sound playback device 100 has been described as being, for example, a sound playback device such as a DJ controller, a sound playback device using a computer, or a sound playback device using a mobile terminal such as a smartphone or tablet, but the sound playback device can also be applied to a player, a mixer that controls the player, a DJ system that integrates a player and a mixer, a DJ controller without a playback function, an electronic musical instrument, a karaoke machine, a game console, and even sound devices such as a DAW (Digital Audio Workstation) or DTM (Desk Top Music).

[0069] In the above embodiment, the control unit 130 of the sound reproducing device 100 performs the above-described processing by reading and executing a program from a storage unit or recording medium (not shown). However, this is not limiting, and for example, the control unit 130 may obtain and execute a program from a device on a network. Note that examples of recording media include disk-type recording media, HDDs, and semiconductor memories.

[0070] Although the preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, the present invention is not limited to these examples. It is clear that a person skilled in the art to which the present invention pertains can conceive of various modifications or alterations within the scope of the technical idea described in the claims, and it is understood that these also naturally fall within the technical scope of the present invention.

[0071] [Summary of the present invention] The present invention will be summarized below. [1] The apparatus includes a beat position acquisition unit that acquires the beat position of music data being played back, a display unit that has a display element and displays an image showing time information of the music data, an operation unit that accepts user operations, and a setting unit that, when a first position on the image is selected by the operation unit, sets, as the playback start position, a beat position in the music data that corresponds to the beat position when the first position was selected within a measure that includes the first position. [2] In the audio playback device described in [1], if the beat position when the first position is selected does not match the beat division, the setting unit waits until the music data is played back until the next beat division, and then sets the beat position corresponding to the next beat division as the playback start position. [3] In the sound reproducing device described in [1], An audio playback device characterized in that an operation unit accepts a slide operation starting from a first position, a display unit changes positions that are candidates for the playback start position depending on the speed of the slide operation and displays them on an image, and a setting unit sets a beat position that corresponds to the end position of the slide operation as the playback start position. [4] In the audio playback device described in [3], the display unit changes the candidate playback start position in beat units and displays it on the image when the speed of the slide operation is less than a predetermined threshold, and when the speed of the slide operation is equal to or greater than the predetermined threshold, changes the candidate playback start position in units other than beat units and displays it on the image. [5] The sound reproduction device according to [4], wherein the unit different from the beat unit is a bar unit of the music indicated by the music data. [6] In the audio playback device described in [3], the display unit changes candidate playback start positions in beat units and displays them on the image when the speed of the slide operation is equal to or greater than a predetermined threshold, and when the speed of the slide operation is less than the predetermined threshold, changes candidate playback start positions in accordance with the slide operation and displays them on the image. [7] The sound reproduction device according to any one of [1] to [6], wherein the display unit displays information indicating the development of the music in association with an image. [8] The sound reproducing device according to any one of [1] to [7], wherein the operation unit includes a touch panel provided on the surface of the display element. [9] A program configured to cause a computer to function as the sound reproduction device described in any one of [1] to [8].

[10] A playback control method implemented by an audio playback device having a beat position acquisition unit that acquires the beat position of music data being played back, a display unit that has a display element and displays an image showing time information of the music data, and an operation unit that accepts user operations, the playback control method including the step of, when a first position on the image is selected by the operation unit, setting, as the playback start position, a beat position in the music data that corresponds to the beat position when the first position was selected, within a measure that includes the first position. [Explanation of symbols]

[0072] 100...sound playback device, 110...display, 120...touch panel, 130...control unit, 131...playback unit, 132...beat position acquisition unit, 133...display control unit, 134...reception unit, 135...setting unit, 140...music data storage unit, 150...audio output unit.

Claims

1. a beat position acquisition unit that acquires beat positions of music data being played; a display unit including a display element for displaying an image showing time information of the music data; an operation unit that accepts user operations; a setting unit that, when a first position on the image is selected by the operation unit, sets, in the music data, a beat position in a measure including the first position, which beat position corresponds to the beat position when the first position is selected, as a playback start position; Equipped with The sound playback device is characterized in that, if the beat position when the first position is selected does not coincide with a beat division, the setting unit waits until the music data is played back until the next beat division, and then sets the beat position corresponding to the next beat division as the playback start position.

2. a beat position acquisition unit that acquires beat positions of music data being played; a display unit including a display element for displaying an image showing time information of the music data; an operation unit that accepts user operations; a setting unit that, when a first position on the image is selected by the operation unit, sets, in the music data, a beat position in a measure including the first position, which beat position corresponds to the beat position when the first position is selected, as a playback start position; Equipped with the operation unit accepts a slide operation starting from the first position; the display unit changes the candidate positions for the playback start position according to the speed of the slide operation and displays the candidate positions on the image; The sound reproducing device, wherein the setting unit sets the beat position corresponding to the end point of the slide operation as the reproduction start position.

3. 3. The sound reproducing device according to claim 2, The display unit changes the candidate positions for the playback start position in beat units and displays them on the image when the speed of the slide operation is less than a predetermined threshold, and when the speed of the slide operation is equal to or greater than the predetermined threshold, changes the candidate positions for the playback start position in units other than the beat units and displays them on the image.

4. 4. The sound reproducing device according to claim 3, The sound reproducing device according to claim 1, wherein the unit different from the beat unit is a bar unit of the music piece indicated by the music piece data.

5. 3. The sound reproducing device according to claim 2, The display unit changes the candidate positions for the playback start position in beat units and displays them on the image when the speed of the slide operation is equal to or greater than a predetermined threshold, and when the speed of the slide operation is less than the predetermined threshold, changes the candidate positions for the playback start position in accordance with the slide operation and displays them on the image.

6. 6. The sound reproducing device according to claim 1, The display unit displays information indicating the development of the music piece in association with the image.

7. 6. The sound reproducing device according to claim 1, The sound reproducing device, wherein the operation unit includes a touch panel provided on a surface of the display element.

8. A program configured to cause a computer to function as the sound reproducing device according to any one of claims 1 to 5.

9. A playback control method implemented by an audio playback device including a beat position acquisition unit that acquires beat positions of music data being played back, a display unit that includes a display element and displays an image, and an operation unit that accepts user operations, when a first position on the image showing waveform information of the music data as time information of the music data is selected by the operation unit, setting, as a playback start position, a beat position in the measure of the music data that includes the first position and that corresponds to the beat position when the first position was selected, In the step, if the beat position when the first position is selected does not coincide with a beat division, the playback control method waits until the next beat division is reached to play back the music data, and then sets the beat position corresponding to the next beat division as the playback start position.

Images