Music playback device and music playback program

The music playback device improves operability on mobile devices by switching between overall and detailed waveforms, facilitating advanced editing and seamless video shooting with edited music.

JP7711294B1Active Publication Date: 2025-07-22ALPHATHETA CORP
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2024201591
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-11-19
Publication Date
2025-07-22
Estimated Expiration
2044-11-19

AI Technical Summary

Technical Problem

The limited screen area of mobile terminals makes it difficult for users to perform various operations related to music playback and editing easily.

Method used

A music playback device that displays a waveform display screen for music playback, allowing switching between overall and detailed waveforms, and includes playback control screens, enabling advanced editing functions.

Benefits of technology

Enhances operability for music playback and editing operations even on devices with limited screen space, allowing precise control and integration of video shooting with edited music.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007711294000001_ABST
    Figure 0007711294000001_ABST
Patent Text Reader

Abstract

Even if the area of the screen is limited, various operations related to music playback and editing can be easily performed. 【Solution means】The music playback device displays, on a first screen, a waveform display screen for displaying the waveform of the music being played and a playback control screen for performing playback control of the music being played, and has a display control unit for switching the waveform of the music displayed on the waveform display screen between an overall waveform and a detailed waveform.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a music playback device and a music playback program.

Background Art

[0002] Various application softwares (hereinafter referred to as apps) that enable a mobile terminal such as a smartphone to function as a music playback device are provided. Also, assuming a scene where a dancer practices dancing, there are apps that enable not only simple music playback but also operations such as changing the tempo of the music and repeat playback.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in a mobile terminal, the screen area is limited, and an operation screen that enables various operations related to music playback and editing is not easy for a user to operate.

[0005] On one side, an object is to provide a music playback device and a music playback program that can easily perform various operations related to music playback and editing even when the screen area is limited.

[0006] A music playback device according to one aspect displays, on a first screen, a waveform display screen that displays a waveform of a music being played and a playback control screen that performs playback control of the music being played, and has a display control unit that switches the waveform of the music displayed on the waveform display screen between an overall waveform and a detailed waveform.

Effects of the Invention

[0007] According to one embodiment, even if the area of the screen is limited, various operations related to music playback and editing can be easily performed.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Mode for Carrying Out the Invention

[0009] Hereinafter, a mode for implementing a music playback device and a music playback program according to the present disclosure (hereinafter referred to as “embodiment”) will be described with reference to the accompanying drawings. Note that this embodiment merely shows one example and one aspect, and the structure, operation, function, property, characteristic, method, use, etc. according to the present disclosure are not limited by the following description.

[0010] <Embodiment 1> As described above, in the prior art, in a mobile terminal, the area of the screen is limited, and there is a problem that an operation screen that enables various operations related to music playback and editing is not easy for a user to operate.

[0011] On the other hand, in the music playback device of the present Embodiment 1, a waveform display screen that displays the waveform of the music being played and a playback control screen that performs playback control of the music being played are displayed on the operation screen, and control is performed to switch the waveform of the music displayed on the waveform display screen between an overall waveform and a detailed waveform. For example, by switching to the detailed waveform, playback control and editing for the music can be expanded and executed, so that playback control and editing can be performed at a very accurate timing. In addition, by switching to the overall waveform, not only can the overall configuration of the music be easily grasped, but also the grasping of the development points of the music can be achieved. That is, by enabling control to switch between the overall waveform and the detailed waveform, even if the area of the screen is limited as in a mobile terminal, the operability related to playback control and editing work can be improved.

[0012] Furthermore, it is common to add music to dance-related videos, and there are times when you want to freely edit the music according to the content of the video. However, conventionally, when shooting a video, the music needs to be edited with music editing software, and the video shooting needs to be separately shot using the edited music. When you want to edit the music according to the video, you need to start the music editing software again for editing, which is troublesome. In contrast, the music playback device of the first embodiment enables video shooting immediately using the edited music.

[0013] <Example of screen> An example of the screen displayed by the music playback device of the first embodiment will be described. The music playback device of the first embodiment is denoted as "music playback device 100". The music playback device 100 displays a waveform display screen of the music being played and a playback control screen for performing playback control of the music being played on the first screen, and switches the waveform of the music displayed on the waveform display screen between the overall waveform and the detailed waveform. In the first embodiment, the first screen is denoted as the "advance mode screen".

[0014] FIG. 1 is a diagram showing an example of the advance mode screen. As shown in FIG. 1, on the advance mode screen 80 displayed by the music playback device 100, a switching control 51, a menu button 52, and operation buttons 61, 62, 63, 64, 65, 66 are set. The advance mode screen 80 also includes a first setting screen 10a, a second setting screen 20a, a third setting screen 30a, a fourth setting screen 40a, and a waveform display screen 80a.

[0015] The switching control 51 has "Player" and "Edit" displayed and is selectable. When "Player" is tapped by the user, the music playback device 100 displays the advance mode screen 80. When "Edit" is selected by the user, the music playback device 100 displays a music editing screen. The music editing screen will be described later.

[0016] The menu button 52 is a button for displaying the menu screen 52a. When the menu button 52 is tapped by the user, the music playback device 100 displays the menu screen 52a. The menu screen 52a includes a write button 52-1 and a switch button 52-2. When the write button 52-1 is tapped, the music playback device 100 executes a process of converting and writing the music being edited on the music editing screen into a predetermined music file format.

[0017] The switch button 52-2 is a button for switching the current operation screen to another operation screen. For example, when the current operation screen of the music playback device 100 is the advance mode screen and the switch button 52-2 is tapped, it switches to another operation screen (for example, the basic mode screen).

[0018] Subsequently, the operation buttons 62 to 65 will be described in order. For example, the operation buttons 62 to 65 are set on the movement setting screen 60.

[0019] The operation button 61 is a button for starting the playback of the music edited on the music editing screen or stopping the music during playback. The music playback device 100 plays or stops the music in response to the tapping of the operation button 61.

[0020] The operation button 62 is a button for returning the playback position to the beginning of the music. When the operation button 62 is tapped, the music playback device 100 returns the playback position of the music to the beginning.

[0021] The operation button 63 is a button for returning the playback position of the music back by a predetermined time. When the operation button 63 is tapped, the music playback device 100 returns the playback position of the music back by a predetermined time.

[0022] The operation button 64 is a button for advancing the playback position of the music by a predetermined time. When the operation button 64 is tapped, the music playback device 100 advances the playback position of the music by a predetermined time.

[0023] The operation button 65 is a button for performing video shooting. Video shooting will be described later.

[0024] Subsequently, each screen included in the advanced mode screen 80 will be described in the order of the waveform display screen 80a, the first setting screen 10a, the second setting screen 20a, the third setting screen 30a, and the fourth setting screen 40a.

[0025] The waveform display screen 80a is a screen that displays the waveform of the music being played. The waveform of the music displayed on the waveform display screen 80a in FIG. 1 is the "overall waveform". The waveform display screen 80a includes a timeline 81 and a switching button 82. On the timeline 81, a seek bar 81a is displayed at the current playback position. The axis of the timeline 81 is the time axis, and the height of the waveform of the music shown on the timeline 81 indicates the intensity of the sound of the music. When the music playback device 100 receives a swipe on the seek bar 81a, it changes the playback position of the music according to the position of the seek bar 81a.

[0026] More specifically, the vertical axis shown on the waveform display screen 80a corresponds to the intensity of the sound with respect to the frequency, and each frequency band is in the order of Low, Mid, High. For example, the music playback device 100 analyzes the music and displays the intensity of the sound in the band "Low" in the first color (dark purple), the intensity of the sound in the band "Mid" in the second color (normal purple), and the band "High" in the third color (light purple). Thereby, it is possible to easily grasp which frequency band has more sound in each section. Also, when the intensity of the frequency becomes zero, it means that the music is interrupted once.

[0027] The switching button 82 is a button for switching the waveform of the music shown on the waveform display screen 80a from the "overall waveform" to the "detailed waveform". When the overall waveform is being displayed on the waveform display screen 80a, and the switching button 82 is tapped, the music playback device 100 switches the waveform of the music shown on the waveform display screen 80a from the "overall waveform" to the "detailed waveform".

[0028] FIG. 2 is a diagram for explaining the switching from the overall waveform to the detailed waveform. As shown in FIG. 2, when the switching button 82 on the waveform display screen 80a is tapped, the music playback device 100 displays the waveform display screen 80b. On the waveform display screen 80b, the detailed waveform of the music being played is displayed on the timeline 81. For example, the height of the waveform in the upward direction of the timeline 81 indicates the intensity of the sound in the left direction of the music. The height of the waveform in the downward direction of the timeline 81 indicates the intensity of the sound in the right direction of the music. When the music playback device 100 displays the detailed waveform, it displays the timing of the measures that are collections of beats of the music. The music playback device 100 displays the first beat with an emphasized line and the second, third, and fourth beats with unemphasized lines. Also, the first beat may be displayed in a first color, and the second, third, and fourth beats may be displayed in a second color. For example, the first color is red and the second color is purple. By displaying in this way, the beats and measures can be easily grasped.

[0029] Furthermore, when the music playback device 100 displays the detailed waveform of the music, it may display the low-band waveform, the mid-band waveform, and the high-band waveform in different colors.

[0030] When the switching button 82 on the waveform display screen 80b is tapped, the music playback device 100 switches the waveform display screen 80b to the waveform display screen 80a.

[0031] Returning to the description of FIG. 1, the first setting screen 10a will be described. The first setting screen 10a is a setting screen for changing the tempo of the music being played. For example, the tempo is indicated by a numerical value of BPM (Beats Per Minute). The first setting screen 10a includes a tempo down button 11, a tempo up button 12, and a slide bar 13.

[0032] The tempo down button 11 is a button for lowering the tempo of the music. When the music playback device 100 receives a tap on the tempo down button 11, it performs an adjustment to lower the BPM of the music by a predetermined numerical value.

[0033] The tempo up button 12 is a button for increasing the tempo of a music piece. When the music playback device 100 receives a tap on the tempo up button 12, it performs an adjustment to decrease the BPM of the music piece by a predetermined value.

[0034] The slider bar 13 is for adjusting the tempo of a music piece according to the position of the slider 13a on the slider bar 13. When the music playback device 100 receives a swipe of the slider 13a, it adjusts the BPM of the music piece according to the position of the slider 13a. For example, the music playback device 100 decreases the BPM value as the position of the slider 13a approaches the left, and increases the BPM value as it approaches the right.

[0035] Next, the second setting screen 20a will be described. The second setting screen 20a is a setting screen for setting the position to start playing a music piece. The position to start playing a music piece is referred to as the "play start point". For example, the second setting screen 20a includes markers 21, 22, 23, 24 and a trash can button 25.

[0036] FIG. 3 is a diagram for supplementary explanation of the second setting screen. The markers 21 to 24 are buttons used when setting the play start point. When the music playback device 100 receives a tap on the marker 21, it sets the "first play start point" corresponding to the marker 21 at the position of the current seek bar on the timeline 81. When the music playback device 100 receives a tap on the marker 21 with the first play start point set, it starts playing the music piece from the first play start point. In FIG. 3, the illustration of the first play start point is omitted.

[0037] When the music playback device 100 receives a tap on the marker 22, it sets the "second play start point 22a" corresponding to the marker 22 at the position of the current seek bar on the timeline 81. When the music playback device 100 receives a tap on the marker 22 with the second play start point 22a set, it starts playing the music piece from the second play start point 22a.

[0038] When the music playback device 100 receives a tap on the marker 23, it sets the "third playback start point 23a" corresponding to the marker 23 at the current position of the seek bar on the timeline 81. When the music playback device 100 receives a tap on the marker 23 with the third playback start point 23a already set, it starts playing the music from the third playback start point 23a.

[0039] When the music playback device 100 receives a tap on the marker 24, it sets the "fourth playback start point 24a" corresponding to the marker 24 at the current position of the seek bar on the timeline 81. When the music playback device 100 receives a tap on the marker 24 with the fourth playback start point 24a already set, it starts playing the music from the fourth playback start point 24a.

[0040] The trash can button 25 is used when deleting each playback start point set on the timeline 55. Here, as an example, the case where the second playback start point 22a, the third playback start point 23a, and the fourth playback start point 24a are set on the timeline 81 will be described.

[0041] When the trash can button 25 on the second setting screen 20a of the music playback device 100 is tapped, the deletion screen 20b is displayed. The deletion screen 20b includes deletion buttons 21-1, 22-1, 23-1, 24-1.

[0042] The deletion button 22-1 is displayed so that it can be tapped when the second playback start point 22a is set on the timeline 81. When the music playback device 100 receives a tap on the deletion button 22-1, it deletes the second playback start point 22a from the timeline 81.

[0043] The deletion button 23-1 is displayed so that it can be tapped when the third playback start point 23a is set on the timeline 81. When the music playback device 100 receives a tap on the deletion button 23-1, it deletes the third playback start point 23a from the timeline 81.

[0044] The deletion button 24-1 is displayed to be tappable when the fourth playback start point 24a is set on the timeline 81. When the music playback device 100 receives a tap on the deletion button 24-1, it deletes the fourth playback start point 24a from the timeline 81.

[0045] After that, the music playback device 100 returns the deletion screen 20b to the second setting screen 20a.

[0046] In the example shown in FIG. 3, the case of setting each playback start button on the timeline 81 of the waveform display screen 80a has been described. However, it is also possible to set each playback start button in the same manner on the timeline 81 of the waveform display screen 80b described in FIG. 2.

[0047] Returning to the description of FIG. 1, the third setting screen 30a will be described. The third setting screen 30a is a setting screen for setting a loop for the currently playing music. The third setting screen 30a has a start position button 31, an end position button 32, a loop button 33, and a trash can button 34.

[0048] FIG. 4 is a diagram for supplementarily explaining the third setting screen. The start position button 31 is a button for specifying the start position of loop playback. The start position of loop playback is denoted as the "loop start point". When the music playback device 100 receives a tap on the start position button 31, it sets the loop start point 31a at the position of the current seek bar on the timeline 81.

[0049] The end position button 32 is a button for specifying the end position of loop playback. The end position of loop playback is denoted as the "loop end point". When the music playback device 100 receives a tap on the end position button 32, it sets the loop end point 32a at the position of the current seek bar on the timeline 81.

[0050] The loop button 33 is a button for enabling or disabling loop playback from the loop start point to the loop end point. For example, each time the music playback device 100 receives a tap on the loop button 33, it toggles between enabled and disabled. For example, when loop playback of a music piece is enabled, the music playback device 100 highlights the section from the loop start point 31a to the loop end point 32a. On the other hand, when loop playback of the music piece is disabled, the music playback device 100 cancels the highlighting of the section from the loop start point 31a to the loop end point 32a.

[0051] For example, when the section from the loop start point 31a to the loop end point 32a is highlighted, loop playback is enabled, and in this case, the music playback device 100 loops and plays the music from the loop start point 31a to the loop end point 32a.

[0052] Returning to the description of FIG. 1, the fourth setting screen 40a will be described. The fourth setting screen 40a is a setting screen for setting the skip section of the music being played. The fourth setting screen 40a includes a skip setting button 40c. When the music playback device 100 receives a tap on the skip setting button 40c, it displays the fourth setting screen 40b shown in FIG. 5.

[0053] FIG. 5 is a diagram for supplementarily explaining the fourth setting screen. The fourth setting screen 40b includes a skip start point button 41, a skip end point button 42, a skip button 43, a skip section addition button 44, and a close button 45.

[0054] The skip start point button 41 is a button for specifying the start position of the skip. The start position of the skip is denoted as the "skip start point". When the music playback device 100 receives a tap on the skip start point button 41, it sets the skip start point 41a at the position of the current seek bar on the timeline 81.

[0055] The skip end point button 42 is a button for specifying the end position of the skip. The end position of the skip is referred to as the "skip end point". When the music playback device 100 receives a tap on the skip end point button 42, it sets a skip end point 42a at the position of the current seek bar on the timeline 81.

[0056] The skip button 43 is a button for enabling the skip. For example, when the music playback device 100 receives a tap on the skip button 43, it toggles the enable / disable of the skip from the skip start point to the skip end point. When the skip of the music is enabled on the music playback device 100, it highlights the section from the skip start point 41a to the skip end point 42a. On the other hand, when the skip of the music is disabled on the music playback device 100, it cancels the highlighting of the section from the skip start point 41a to the skip end point 42a.

[0057] For example, when the section from the skip start point 41a to the skip end point 42a is highlighted, the skip is enabled. In this case, the music playback device 100 skips the playback of the music from the skip start point 41a to the skip end point 42a.

[0058] The skip section addition button 44 is a button for adding a section to be skipped. When the music playback device 100 receives a tap on the skip section addition button 44, it additionally displays the skip start point button, the skip end point button, and the skip button. The illustration of the skip start point button, the skip end point button, and the skip button to be additionally displayed is omitted, but another skip section can be added using such skip start point button, skip end point button, and skip button.

[0059] The close button 45 is a button for closing the fourth setting screen 40b. When the music playback device 100 receives a tap on the close button 45, it displays the fourth setting screen 40a shown in FIG. 1 instead of the fourth setting screen 40b.

[0060] The above has described each screen included in the advanced mode screen 80.

[0061] <Music Editing Screen> Next, the music editing screen displayed by the music playback device 100 will be described. For example, when "Edit" is selected in the switching control 51 described in FIG. 1, the music playback device 100 displays a music editing screen as shown in FIG. 6.

[0062] FIG. 6 is a diagram showing an example of the music editing screen. As shown in FIG. 6, the music editing screen 90 has a switching control 51, a timeline 91, and operation buttons 93a, 93b, 93c, 93d, 93e. The description of the switching control 51 is the same as the above description.

[0063] The axis of the timeline 91 is the time axis, and the position of the seek bar 91a is the music playback position. Also, the position of the seek bar 91a corresponds to the music playback position 91b of the track set in the area 90a. When the music playback device 100 receives a swipe on the seek bar 91a, it adjusts the positional relationship between the playback position 91b and the music of the track according to the position of the seek bar 91a. Also, the music playback device 100 can change the relationship between the position of the music and the playback position 91b by swiping on the area 90a, and change the position of the seek bar 91a according to such a change.

[0064] The operation button 93a is a button for adding a track to the area 90a of the music editing screen 90. When the operation button 93a is tapped, the music playback device 100 displays a music selection screen (not shown) and accepts the selection of music. When the music playback device 100 accepts the selection of music, it sets the track corresponding to the selected music in the area 90a.

[0065] For example, when "Music A" is selected on the music selection screen, the music playback device 100 sets the track 92a corresponding to Music A in the area 90a. The waveform of Music A is displayed on the track 92a. Although the description is omitted in FIG. 6, when another song is selected on the music selection screen, the music playback device 100 adds the track corresponding to the other song to the area 90a.

[0066] An effect button 92a-1 is displayed on the track 92a. The effect button 92a-1 is a button for setting an effect for Music A. When the effect button 92a-1 is tapped, the music playback device 100 displays a screen for selecting an effect such as "echo" or "reverb", and sets the icon of the selected effect on the track 92a.

[0067] FIG. 7 is a diagram (1) for supplementarily explaining the music editing screen. In the example shown in FIG. 7, an icon 92a-3 of an effect (echo) is set on the track 92a. When the music playback device 100 plays Music A on the track 92a, it adds the echo effect to Music A in the time zone where the icon 92a-3 is arranged. The user can change the position and width of the icon 92a-3 by operating the icon 92a-3 such as swiping. In FIG. 7, the echo is described as an effect, but the same applies to reverb.

[0068] In FIG. 7, for the sake of convenience of explanation, the track 92a corresponding to Music A is described. However, when tracks of other songs are set in the area 90a, it is similarly possible to set effects.

[0069] Returning to the description of FIG. 6. When the music playback device 100 receives a tap on the area 92a-2 where the waveform of Music A on the track 92a is shown, it displays a music editing screen 90 as shown in FIG. 8 and accepts various edits for Music A.

[0070] FIG. 8 is a diagram (2) for supplementarily explaining the music editing screen. For example, when the music playback device 100 receives a tap on the area 92a-2, it displays the editing buttons 94a, 94b, 94c, 94d on the music editing screen 90.

[0071] The editing button 94a is a button for copying the music in the area 92a-2. When the music playback device 100 receives a tap on the editing button 94a, it copies the music in the area 92a-2.

[0072] The editing button 94b is a button for pasting the music copied by the editing button 94a. When the music playback device 100 receives a tap on the editing button 94b, it pastes the copied music at a specified position on the track.

[0073] The editing button 94c is a button for splitting the music in the area 92a-2 at a specified position. When the music playback device 100 receives a tap on the editing button 94b, it splits the music.

[0074] The editing button 94d is a button for deleting the music in the area 92a-2. When the music playback device 100 receives a tap on the editing button 94d, it deletes the music in the area 92a-2.

[0075] FIG. 9 is a diagram (3) for supplementarily explaining the music editing screen. Here, as an example, An example of the process of editing music A when the editing button 94c (split), editing button 94d (delete), editing button 94a (copy), and editing button 94b (paste) are tapped is shown.

[0076] When the music playback device 100 is in a state where music A in the area 92a-2 is selected and the editing button 94c (split) is tapped, it splits the music A in the area 92a-2 into clips C1 and C2 at the playback position 91b.

[0077] When the edit button 94d (delete) is tapped while clip C2 is selected, the music playback device 100 deletes clip C2.

[0078] When the edit button 94a (copy) is tapped while clip C1 is selected, the music playback device 100 copies clip C1.

[0079] After the music playback device 100 copies clip C1, when the edit button 94b (paste) is tapped, it pastes a clip C3 identical to clip C1 at the position specified by the user.

[0080] When the music playback device 100 receives a swipe on clips C1 and C3, it changes the positions of clips C1 and C3 according to the swipe.

[0081] In FIGS. 7 to 9, for the sake of convenience of explanation, the track 92a corresponding to music A has been described. However, when other music tracks are set in the area 90a, the same copy, paste, split, and delete editing can be performed using the edit buttons 94a to 94d.

[0082] Returning to the description of FIG. 6. The operation button 93b is a button that instructs to cancel the user operation performed immediately before on the music editing screen 90 and return to the state before the immediately previous operation. When the operation button 93b is tapped, the music playback device 100 cancels the operation performed immediately before and returns to the state before the immediately previous operation.

[0083] The operation button 93c is a button that instructs the playback and stop of the music set for the track (for example, music A, split clips). When the operation button 93c is tapped, the music playback device 100 starts the music playback, and when the operation button 93c is tapped again, it stops the music playback.

[0084] The operation button 93d is a button for instructing to redo the immediately previous operation canceled at the operation button 93b. When the operation button 93d is tapped, the music playback device 100 redoes the immediately previous operation canceled at the operation button 93b.

[0085] The operation button 93e is a button for adding a fade effect during music playback and at the end. When a fade effect is added to the music A of the track 92a, when the music playback device 100 plays the music A, it gradually increases or decreases the volume. For example, as the fade effect, fade-in and fade-out settings are possible. Fade-in is to gradually increase the volume, and fade-out is to gradually decrease the volume.

[0086] The fade effect can be used when (1) wanting to gradually increase the volume, (2) wanting to connect two pieces of music without a sense of incongruity, (3) wanting to gradually end the music, etc. For example, (1) when wanting to gradually increase the volume, set fade-in. (2) When wanting to connect two pieces of music without a sense of incongruity, set fade-out for the preceding music and fade-in for the subsequent music. (3) When wanting to gradually end the music, set fade-out.

[0087] FIG. 10 is a diagram (4) for supplementarily explaining the music editing screen. In the example shown in FIG. 10, the track 92a corresponding to the music A and the track 92a corresponding to the music B are shown. Also, the clips C4 and C5 generated by the above editing operation are set in the tracks 92a and 92.

[0088] For example, when the operation button 93e is tapped, the music playback device 100 sets fade icons at the start point and end point of the clip C4. In the example shown in FIG. 10, fade-in icons 95a are set at the start points of the clips C4 and C5. When playing the music (clip), the music playback device 100 makes an adjustment to gradually increase the volume of the music at the set position of the fade-in icon 95a.

[0089] The fade-out icon 95b is set at the end points of the clips C4 and C5. When the music playback device 100 plays a music piece (clip), it makes an adjustment to gradually reduce the volume of the music at the set position of the fade-out icon 95b.

[0090] Furthermore, the user can adjust the slopes of the fade-in icon 95a and the fade-out icon 95b by swiping. As the slopes of the fade-in icon 95a and the fade-out icon 95b become steeper, the volume change associated with the time change also becomes larger. Thereby, even without using cumbersome setting parameters or dedicated operators for performing fade-in and fade-out as in the prior art, the volume change associated with the time change can be easily adjusted. That is, since the control setting of the volume can be performed using a triangular figure, the fade-in and fade-out of music can be easily set even on a mobile device.

[0091] FIG. 11 is a diagram (5) for supplementarily explaining the music editing screen. For example, the user can also perform an editing operation of connecting different music pieces by operating the music editing screen 90. An example of the editing of connecting different music pieces will be described with reference to FIG. 11.

[0092] In the example shown in FIG. 11, it is assumed that the clip C1-1 of music piece A is set on the track 92a and the clip C2-1 of music piece B is set on the track 92a. For example, when the user swaps the position of the clip C1-1 to the left and swaps the position of the clip C2-1 to the right, the music playback device 100 adjusts the positions of the clips C1-1 and C2-1 according to the swap. At this point, when the user taps the operation button 93c, the music playback device 100 plays the clip C2-1 after playing the clip C1-1. That is, it is possible to generate a music piece by connecting the clip C1-1 of music piece A and the clip C2-1 of music piece B.

[0093] The music editing screen has been described above.

[0094] <Configuration of Music Player 100> Next, a configuration example of the music player 100 according to Embodiment 1 will be described. FIG. 12 is a functional block diagram showing the configuration of the music player according to Embodiment 1. As shown in FIG. 12, the music player 100 includes a display unit 110, an input unit 120, a communication unit 130, a camera unit 140a, an output unit 140b, a storage unit 150, and a control unit 160.

[0095] The display unit 110 displays various types of information. For example, the display unit 110 is realized by a liquid crystal display, an organic EL (Electro Luminescence) display, or the like.

[0096] The input unit 120 inputs various operations. When the music player 100 is realized by a mobile terminal, the display unit 110 and the input unit 120 are integrated to be realized as a touch panel. For example, the input unit 120 receives various inputs for various operation screens displayed on the display unit 110.

[0097] The communication unit 130 is connected to a network either wired or wirelessly, and transmits and receives information to and from other devices via the network. For example, the communication unit 130 is realized by a communication module, a NIC (Network Interface Card), or the like.

[0098] The camera unit 140a is a camera that captures images. For example, the camera unit 140a incorporates an image sensor, captures a moving image with the image sensor, and outputs the captured moving image data to the control unit 160 or the like.

[0099] The output unit 140b is a speaker or the like for playing music.

[0100] The storage unit 150 stores various types of data. For example, the storage unit 150 is implemented by a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage. For example, the storage unit 150 stores a music table 151, edited music data 152, and a music file 153.

[0101] The music table 151 is a table that stores information on a plurality of music pieces. A music piece to be played or edited is selected from the music table 151.

[0102] The edited music data 152 is data related to the music being edited on the music editing screen 90. The data related to the music being edited includes information on clips on a track, effect information, and the like.

[0103] The music file 153 is music data in a predetermined music file format. For example, when the write button 52-1 described in FIG. 1 etc. is tapped, the music playback device 100 converts the edited music data 152 into a predetermined music file format and generates the music file 153.

[0104] The control unit 160 performs overall control of the music playback device 100. For example, the control unit 160 can be implemented by a hardware processor. As shown in FIG. 12, the control unit 160 includes a display control unit 161, an editing processing unit 162, a music playback unit 163, and a video shooting unit 154.

[0105] The display control unit 161 outputs the advance mode screen 80 shown in FIG. 1 to the display unit 110 for display. In the following description, the display control unit 161 outputting various screens to the display unit 110 for display is simply referred to as "displaying". When the display control unit 161 displays the advance mode screen 80, it is assumed that the music playback unit 161 allows the user to select the music to be played from the music table 151.

[0106] The display control unit 161 analyzes the selected music piece and causes the waveform of the music piece to be displayed on the waveform display screen 80a of the advance mode screen 80. As described with reference to FIG. 2, the display control unit 161 switches and displays between the waveform display screen 80a and the waveform display screen 80b based on a tap on the switching button 82.

[0107] When the "Edit" of the switching control 51 on the advance mode screen 80 is tapped, the display control unit 161 displays the music piece editing screen 90 shown in FIG. 6.

[0108] Other explanations regarding the display control of the display control unit 161 are the same as the explanations regarding the display control of each screen described in FIGS. 1 to 11.

[0109] The editing processing unit 162 accepts various edits to the music piece using the music piece editing screen 90. For example, as described with reference to FIG. 7, the editing processing unit 162 accepts an edit to apply an effect to the music piece and edits the information of the music piece.

[0110] As described with reference to FIGS. 8 and 9, the editing processing unit 162 accepts edits related to copying, pasting, splitting, and deleting the music piece and edits the information of the music piece.

[0111] As described with reference to FIG. 10, the editing processing unit 162 accepts an edit related to fading the music piece and edits the information of the music piece.

[0112] As described with reference to FIG. 11, the editing processing unit 162 accepts an edit to join different music pieces and edits the music piece.

[0113] The editing processing unit 162 stores the information of the music piece being edited in the storage unit 150 as edited music piece data 152.

[0114] Other explanations regarding the edits accepted by the editing processing unit 162 are the same as the respective edits described in FIGS. 6 to 11.

[0115] The music playback unit 163 plays music using the output unit 140b. For example, the music playback unit 163 performs music playback control in response to taps on the operation buttons 61, 62, 63, 64, 65 of the advanced mode screen 80. Also, the music playback unit 163 plays the music being edited using the edited music data 152 in response to a tap on the operation button 93b of the music editing screen 90.

[0116] Other explanations regarding the music playback control of the music playback unit 163 are the same as the explanations regarding the playback control described in FIGS. 1 to 6.

[0117] The video shooting unit 164 controls the camera unit 14 in response to a shooting instruction and shoots a video. For example, when the operation button 65 of the advanced mode screen 80 is tapped, the video shooting unit 164 causes the display unit 110 to display a shooting screen as shown in FIG. 13.

[0118] FIG. 13 is a diagram showing an example of a shooting screen. As shown in FIG. 13, the shooting screen 300 has a video display area 301 and a shooting button 310. When the video shooting unit 164 receives a tap on the shooting button 310, it causes the music of the edited music data 152 to be output from the output unit 140b (speaker), starts shooting the video, and when it receives a tap on the shooting button 310 again, it ends the shooting of the video and stops the playback of the music. The video shooting unit 164 displays the shot video in the video display area 301.

[0119] <Flow of processing> Next, the flow of processing of the music playback device 100 according to Embodiment 1 will be described. FIG. 14 is a flowchart showing an example of the procedure of the music playback device according to Embodiment 1. As shown in FIG. 14, the display control unit 161 of the music playback device 100 displays the advanced mode screen 80 (step S101). The display control unit 161 switches and displays the overall waveform and the detailed waveform on the waveform display screen in response to a tap on the switching button 82 (step S102).

[0120] When the switching control 51 is switched to "Edit", the display control unit 161 displays the music editing screen 90 (step S103). The editing processing unit 162 of the music playback device 100 accepts the editing on the music editing screen 90 and edits the music (step S104).

[0121] When the music playback unit 163 of the music playback device 100 receives a tap on the operation button 93c, it plays the music being edited (step S105). If the editing has not been completed (step S106, No), the process proceeds to step S104. On the other hand, if the editing has been completed (step S106, Yes), the process proceeds to step S107.

[0122] When the write button 52-1 is tapped, the music playback device 100 converts the music being edited into a predetermined music file format and generates a music file 153 (step S107). When the switching control 51 is switched to "Player", the display control unit 161 displays the advance mode screen (step S108) and the process proceeds to step S102.

[0123] <Summary> As described above, the music playback device 100 of the first embodiment displays a waveform display screen that displays the waveform of the music being played and a playback control screen that performs playback control of the music being played on the advance mode screen 80, and performs control to switch the waveform of the music displayed on the waveform display screen between the overall waveform and the detailed waveform. For example, by switching to the detailed waveform as in the waveform display screen 80b, playback control and editing of the music can be expanded and executed, so that playback control and editing can be performed at a very accurate timing. Also, by switching to the overall waveform, not only can the overall configuration of the music be easily grasped, but also the development points of the music can be grasped. That is, according to the music playback device 100 of the first embodiment, by performing control to switch between the overall waveform and the detailed waveform, even if the screen area of the mobile terminal is limited, the operability regarding playback control and editing work can be improved.

[0124] In addition, when the music playback device 100 of the first embodiment receives a tap on the shooting button 310, it plays the music after editing on the music editing screen 90 and shoots a video while the music is being played. As a result, when editing the music according to the video, it is possible to eliminate the trouble of launching the music editing software again to edit the music and shooting separately using the edited music, and it is possible to shoot the video immediately using the edited music. In addition, for the fade-in and fade-out settings of the music, since a triangular figure is used and the control setting of the volume level is possible, advanced music editing can be easily performed even on a mobile terminal.

[0125] <Second Embodiment> Now, although the first embodiment of the present disclosure has been described so far, various applications are possible, and furthermore, in addition to the above-described first embodiment, it may be implemented in various different forms.

[0126] <Exertion of creative ability> The matters described in the above-described first embodiment, for example, the screen configurations of the advanced mode screen 80, the music editing screen 90, and the shooting screen 300 are merely examples and can be changed. Also, the content of the music editing on the music editing screen 90 is merely an example and can be changed. Also, the playback conditions that can be set on the basic mode screen 50 are merely examples and can be changed. Also, the flowchart described in the above-described first embodiment can have the processing order changed within a non-contradictory range.

[0127] <Application to other usage scenes> In the above-described first embodiment, an example in which the music playback device 100 is a mobile terminal such as a smartphone has been given, but the editing function, playback control function, and video shooting function of the music playback device 100 may be provided by a cloud service such as a web service.

[0128] FIG. 15 is a functional block diagram showing the configuration of the music playback device according to the second embodiment. For example, FIG. 15 shows a music playback device 400 that provides a cloud service.

[0129] The music playback device 400 may be implemented by a server device. For example, the music playback device 400 can provide an editing function, a playback control function, and a video shooting function as cloud services by executing a PaaS (Platform as a Service) type middleware or a SaaS (Software as a Service) type application.

[0130] As shown in FIG. 15, the music playback device 400 can be communicably connected to the user terminal 420 via the network NW. For example, the network NW can be any type of communication network such as the Internet or a LAN (Local Area Network), regardless of being wired or wireless.

[0131] The user terminal 420 is a terminal device used by a user who receives cloud services. The user terminal 420 may be implemented by any computer such as a smartphone, a tablet terminal, a wearable terminal, or a personal computer.

[0132] Under such an overall configuration, the music playback device 400 shown in FIG. 15 is different from the music playback device 100 shown in FIG. 12 in that various requests are received via the network NW, and the execution result of the process is output via the network NW.

[0133] For example, the music playback device 400 transmits the screen information of the operation screen including the music editing screen and the playback control screen to the user terminal 420 via the communication unit 410 to cause the user terminal 420 to display the operation screen, and receives the operation information for the operation screen from the user terminal 420 via the communication unit 410. Further, the music playback device 400 controls the camera of the user terminal 420 via the communication unit 410 to shoot a video, and receives the data of the shot video from the user terminal 420 via the communication unit 410.

[0134] The music playback device 400 provides an editing function, a playback control function, and a video shooting function to the user terminal 420. For example, the display control unit 461, the editing processing unit 462, the music playback unit 463, and the video shooting unit 464 included in the control unit 460 of the music playback device 400 have the same functions as the display control unit 161, the editing processing unit 162, the music playback unit 163, and the video shooting unit 154 included in the control unit 160 of the music playback device 100. Also, the music table 451, the edited music data 452, and the music file 453 included in the storage unit 450 of the music playback device 400 are the same as the music table 151, the edited music data 152, and the music file 153 included in the storage unit 150 of the music playback device 100.

[0135] Even in the music playback device 400 as described above, by performing control to switch between the overall waveform and the detailed waveform, it is possible to improve the operability regarding playback control and editing work even when the screen area is limited in the mobile terminal.

[0136] <Hardware> Next, a hardware configuration example of the music playback device described in the above embodiment will be described. FIG. 16 is a diagram showing a hardware configuration example. As shown in FIG. 16, the music playback device 100 includes a communication device 5a, a storage device 5b, a memory 5c, and a processor 5d. Note that each part shown in FIG. 16 may be connected to each other via a bus or the like.

[0137] The communication device 5a is a network interface card or the like. The storage device 5b is a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). For example, the storage device 5b stores a program for operating the functions shown in FIG. 12, a DB, and the like.

[0138] The processor 5d reads out a program for executing the same processing as the processing unit shown in FIG. 12 from the storage device 5b or the like and expands it in the memory 5c, thereby operating a process for executing the functions described in FIG. 12.

[0139] Such a process realizes the same functions as the processing unit of the music playback device 100. For example, the processor 5d reads out a program having the same functions as the display control unit 161, the editing processing unit 162, the music playback unit 163, and the video shooting unit 164 from the storage device 5b or the like. Then, the processor 5d executes a process of executing the same processing as the display control unit 161, the editing processing unit 162, the music playback unit 163, and the video shooting unit 164.

[0140] In this way, the music playback device 100 operates as a music playback device that executes a music playback method by reading and executing a program. Further, the music playback device 100 can also realize the same functions as the above-described embodiments by reading the program from the recording medium by the medium reading device and executing the read program. Note that the program in this other embodiment is not limited to being executed by the music playback device 100. For example, the functions of the present disclosure can be similarly applied when another computer or server executes the program, or when these cooperate to execute the program.

[0141] The above program can be distributed via a network such as the Internet. Further, the above program can be recorded on an arbitrary recording medium and executed by being read from the recording medium by a computer. For example, the recording medium can be realized by a hard disk, a flexible disk (FD), a CD-ROM, a MO (Magneto-Optical disk), a DVD (Digital Versatile Disc), or the like.

Explanation of Signs

[0142] 100 Music playback device 110 Display unit 120 Input unit 130, 410 Communication unit 140a Camera unit 140b Output unit 150 Storage unit 151, 451 Music table 152,452 Edited music data 153,453 Music file 160,460 Control unit 161,461 Display control unit 162,462 Editing processing unit 163,463 Music playback unit 164,464 Video shooting unit

Claims

1. A waveform display screen for displaying the waveform of a music piece being played, a playback control screen for performing playback control of the music piece being played, and a switching button are displayed on a first screen, When a tap operation on the switching button is received, a display control unit that executes switching between the waveform display screen on which the entire waveform of the music piece is displayed and the waveform display screen on which a detailed waveform showing the timings of a plurality of beats and bars in the music piece is displayed on the first screen, A music playback device, characterized by comprising the same.

2. The music playback device according to claim 1, wherein the playback control screen includes a movement setting screen for receiving a setting of a movement section for moving the playback position of the music piece.

3. The music playback device according to claim 1 or 2, wherein the display control unit further displays a music editing screen for receiving editing of the music piece to be played.

4. The music editing screen displays information on a plurality of music pieces. When an editing for connecting specific portions of the information on the plurality of music pieces is received, the music playback device according to claim 3 further includes an editing processing unit for editing the plurality of music pieces.

5. The music playback device according to claim 4, wherein when an editing for applying an effect to the information of the music piece is received, the editing processing unit edits the music piece.

6. The music playback device according to claim 5, wherein the editing processing unit receives an editing for applying at least one of echo and reverb as an effect to the information of the music piece.

7. The music editing screen includes a playback button. When a tap on the playback button is received before outputting the music piece edited by the editing processing unit in a music file format, the music playback device according to claim 6 further includes a music playback unit for playing the music piece edited by the editing processing unit.

8. The music playback device according to claim 7, further comprising a video shooting unit for playing the edited music piece and shooting a video while the music piece is being played.

9. A waveform display screen for displaying the waveform of a music piece being played, a playback control screen for performing playback control of the music piece being played, and a switching button are displayed on a first screen, When a tap operation on the switching button is received, execute switching between the waveform display screen on which the overall waveform of the music waveform is displayed on the first screen and the waveform display screen on which a detailed waveform displaying the timings of a plurality of beats and bars in the music is displayed. A music playback program characterized by causing a computer to execute the process.

Citation Information

Patent Citations

  • Controller and parameter control method

    JP2013008262A

  • Device and method for controlling playback of digital multimedia data as well as a corresponding computer-readable storage medium and a corresponding computer program

    US20140225845A1

  • Semiconductor device

    JP1981008843A