Information processing method, information processing device, and information processing program

Abstract

An information processing method according to the present invention is implemented by a computer and comprises: a playback bar display step for displaying a playback bar indicating a section of a song to be played back; and a playback bar change step for changing a display range of the playback bar according to an operation on the playback bar.

Description

Information Processing Method, Information Processing Apparatus, and Information Processing Program

[0001] The present invention relates to an information processing method, an information processing apparatus, and an information processing program.

[0002] Conventionally, various techniques for practicing musical instruments and singing have been known. For example, Patent Document 1 discloses a karaoke system that enables quick specification of a playback position corresponding to a section to be practiced by displaying lyrics in association with a seek bar.

[0003] Japanese Patent Application Laid-Open No. 2022-155749

[0004] However, in the above technique, lyric information separated for each phrase to be displayed in association with the seek bar must be prepared in advance in association with the music. For this reason, for example, when a user wants to practice a song stored in the user's smartphone or the like, or a song that does not include lyrics, the playback position cannot be specified using the above technique.

[0005] In view of the above circumstances, the present application provides an information processing method, an information processing apparatus, and an information processing program for easily specifying the playback positions of various songs.

[0006] An information processing method according to one aspect of the present application is an information processing method realized by a computer, including a playback bar display step of displaying a playback bar indicating the classification of a song to be played, and a playback bar change step of changing the display range of the playback bar in response to an operation on the playback bar.

[0007] FIG. showing the configuration of the information processing system 1. A flowchart showing an example of the sound source separation process of the user terminal. A diagram showing an example of the practice app screen. A diagram showing another example of the practice app screen. A flowchart showing an example of the playback position specification process of the user terminal. A diagram showing a configuration example of the terminal device. A diagram showing an example of the part reception screen C1. A flowchart showing an example of the flow of information processing executed by the terminal device. A first diagram showing other functions of the practice app screen. A second diagram showing other functions of the practice app screen. A third diagram showing other functions of the practice app screen.

[0008] The following describes in detail, with reference to the drawings, the embodiments for implementing the information processing method, information processing device, and information processing program according to the present application (hereinafter referred to as "embodiments"). Note that these embodiments do not limit the information processing method, information processing device, and information processing program according to the present application. Furthermore, the same parts are denoted by the same reference numerals in each of the following embodiments, and redundant descriptions are omitted.

[0009] [1. Embodiments] Hereinafter, embodiments of the present invention will be described with reference to the drawings. Figure 1 is a diagram showing the configuration of the information processing system 1.

[0010] Information processing system 1 includes a user terminal 10 and a server 20. The components included in information processing system 1 are connected to each other via a network 30 so that they can communicate with one another. User terminal 10 is a computer such as a smartphone, tablet, or PC (Personal Computer) used by a user. Server 20 is a computer that provides predetermined services and applications to user terminal 10.

[0011] The user terminal 10 includes a control unit 11, a storage unit 12, a communication unit 13, a display unit 14, an operation unit 15, and a sound output unit 16. The control unit 11 includes, for example, a CPU (Central Processing Unit) and performs various processes and controls according to a program. The storage unit 12 includes, for example, a storage device, ROM (Read Only Memory), RAM (Random Access Memory), etc., and stores various programs and data. The communication unit 13 includes a communication interface and communicates with other devices such as a server 20 via a network 30. The display unit 14 includes, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display, etc., and displays a screen containing various information and images. The operation unit 15 includes, for example, physical keys or a touch panel integrated with the display unit 14, etc., and is operated by the user. The sound output unit 16 includes a speaker and outputs sound.

[0012] The server 20 includes a control unit 21, a storage unit 22, and a communication unit 23. Since the components of the server 20 are the same as those of the user terminal 10, their description is omitted.

[0013] The following describes the processing of the user terminal 10. First, the sound source separation process of the user terminal 10 will be described, and then the playback position specification process of the user terminal 10 will be described. The user terminal 10 is assumed to have an application (hereinafter referred to as "practice app") pre-installed for practicing or performing (hereinafter referred to as "practice, etc.") an instrument or singing (hereinafter referred to as "instrument, etc.") along with an existing song. The practice app may be downloaded and installed to the user terminal 10 via the network 30 from, for example, a server 20 or external device that manages an app store. The control unit 11 of the user terminal 10 executes the sound source separation process and the playback position specification process according to the program contained in the practice app stored by the storage unit 12.

[0014] [1-1. Sound Source Separation Processing] Figure 2 is a flowchart showing an example of sound source separation processing on the user terminal 10. Figure 3 shows an example of the practice application screen. Figure 4 shows another example of the practice application screen.

[0015] First, the control unit 11 receives a user's operation via the operation unit 15 to select a song to be used for practicing an instrument or the like (hereinafter sometimes referred to as "practice song") (step S11). The practice song may, but is not limited to, a song that has been pre-stored (saved) in the storage unit 12. For example, the practice song may be a song stored in the server 20, and as a result of the selection in step S11, it may be downloaded from the server 20 to the user terminal 10. Alternatively, the practice song may be a song stored in the server 20 that is streamed and played on the user terminal 10.

[0016] The control unit 11 acquires information related to the user (hereinafter referred to as "related information") (step S12). The related information may be information indicating the user's attributes, for example, information indicating whether the user is a paid member or a free member, but is not limited to this. The control unit 11 may acquire the related information from the server 20, or it may acquire the related information contained in the practice application data stored in the storage unit 12.

[0017] The control unit 11 uses the song selected in step S11 as a sound source and separates it into multiple parts according to the relevant information acquired in step S12 (step S13). Any known sound source separation method may be used as the method for separating the sound source.

[0018] Step S13 will now be explained in more detail. First, the control unit 11 determines whether the related information acquired in step S12 satisfies predetermined conditions. If the related information satisfies the predetermined conditions, the control unit 11 separates the sound source into the maximum number of parts that can be separated by the practice application, as illustrated in Figure 3. In the example shown in Figure 3, the sound source is separated into seven parts from left to right: bass, drums, vocals, wind instruments, guitar, piano, and others. On the other hand, if the related information does not satisfy the predetermined conditions, the control unit 11 separates the sound source into a predetermined number of parts that is less than the maximum number that can be separated, as illustrated in Figure 4. In the example shown in Figure 4, the sound source is separated into four parts from left to right: bass, drums, vocals, and others. In the example shown in Figure 3, the wind instruments, guitar, and piano parts, which were separated, are grouped together as the "other" part.

[0019] If the related information indicates whether the user is a paid member or a free member, the predetermined condition may be, for example, "being a paid member." That is, if the related information indicates "being a paid member," the control unit 11 may separate the sound source into the maximum number of separable parts, and if the related information indicates "being a free member," it may separate the sound source into a predetermined number of parts that is less than the maximum number of separable parts. Furthermore, if the related information satisfies the predetermined condition, the control unit 11 may accept the user's operation to select the parts to be separated via the operation unit 15, and separate the sound source into an "other" part which combines the parts that were not selected, and each of the selected parts.

[0020] In step S13, the control unit 11 displays the volume adjustment faders corresponding to each separated part on the display unit 14 (step S14). In the example shown in Figures 3 and 4, each fader 142 is displayed corresponding to each icon 141 representing each part. Also, as shown by the vertical black lines in Figures 3 and 4, a level meter is placed adjacent to the right of each fader 142, and the volume level of the corresponding part is displayed.

[0021] Let's explain the process in more detail for step S14. First, the control unit 11 determines whether the number of parts separated in step S13 is the maximum number of parts for which sound source separation is possible. If the number of parts is the maximum number for which sound source separation is possible, the control unit 11 displays each fader 142 corresponding to each part on the display unit 14 with the same width, as shown in Figure 3. On the other hand, if the number of parts is not the maximum number for which sound source separation is possible, that is, if it is a predetermined number less than the maximum number, the control unit 11 displays the fader 142 corresponding to the "other" part on the display unit 14 with a width greater than the width of the faders 142 of the other parts, as shown in Figure 4. In other words, the control unit 11 increases the width of the fader 142 corresponding to the "other" part (makes it wider) by the number of parts that have been grouped together as the "other" part.

[0022] The control unit 11 receives user operations on each fader 142 displayed in step S14 via the operation unit 15 (step S15). The control unit 11 then controls the sound output unit 16 to play (output) the sound source of each part at the volume adjusted by the fader 142 operated in step S15 (step S16). By operating the fader 142 corresponding to each part, the user can lower the volume of parts other than the part they want to practice, etc., and listen to that part intensively, or conversely, lower the volume of the part they want to practice, etc., and practice, etc., in sync with the performance of the other parts.

[0023] As described above, in the sound source separation process of this embodiment, the song (sound source) is separated into multiple parts according to the relevant information. When the number of separated parts is less than the maximum number of parts from which the sound source can be separated, the width of the fader 142 of one part (the "Other" part in the example above) increases compared to the width of the faders 142 of the other parts. By checking the width of the fader 142 of the "Other" part, the user can intuitively understand that the number of parts that can be separated will increase if certain conditions are met (for example, by becoming a paid member).

[0024] The control unit 11 may also control the display unit 14 to display the icons 141 of parts grouped as "other" parts more faintly than the icons 141 of separated parts. The user can intuitively grasp the types of parts that can be separated if certain conditions are met. Furthermore, as shown in Figures 3 and 4, the control unit 11 may also display silhouettes 143 representing the performers corresponding to each part on the display unit 14, along with the icons 141 and faders 142 representing each part. The control unit 11 may also change the display mode of the silhouettes 143 according to the degree to which the faders 142 are raised or lowered, i.e., the magnitude of the volume adjusted by the faders 142. For example, the control unit 11 may control the display unit 14 to display the silhouettes 143 more darkly or larger as the faders 142 are raised. The user can intuitively grasp the volume of each part by checking the display mode of the silhouettes 143. Furthermore, if the relevant information does not meet predetermined conditions, the control unit 11 may display a message on the display unit 14 indicating that the number and types of separable parts will increase if the predetermined conditions are met.

[0025] [1-2. Playback Position Specification Process] Figure 5 is a flowchart showing an example of the playback position specification process on the user terminal 10.

[0026] First, the control unit 11 receives the user's input via the operation unit 15 to select a song to be practiced on an instrument or the like (step S21). The processing in step S21 may be the same as the processing in step S11, and the playback position specification processing shown in Figure 5 may be performed after the sound source separation processing shown in Figure 2.

[0027] The control unit 11 analyzes the song section selected in step S21 (step S22). The song section may be a division such as an intro, verse A, verse B, chorus, etc., or it may be a finer division. Any known analysis method may be used as the method for analyzing the song section.

[0028] In step S23, the control unit 11 displays the playback bar (hereinafter referred to as "section bar"), which has been divided by the sections analyzed in step S22, on the display unit 14. In the example shown in Figures 3 and 4, the section bar 144 is displayed near the center of the practice application screen. The section name corresponding to each section may also be displayed. The control unit 11 then receives the user's operation to specify the playback position 145 of the song on the section bar 144 displayed in step S23 via the operation unit 15 (step S24).

[0029] The section bar 144 is an object that can accept operations such as zooming in, zooming out, or moving the section bar 144 to change its display range, and operations such as specifying the playback position 145. For example, if the operation unit 15 is integrated with the display unit 14 to form a touch panel, the control unit 11 accepts user operations performed on the section bar 144 displayed on the touch panel. Operations performed on the section bar 144 include, for example, pinch-out operations to zoom out the display range of the section bar 144, pinch-in operations to zoom out, swipe operations to move it, and touch operations to specify the playback position 145 within the adjusted display range. Specifying the playback position 145 also includes specifying the repeat playback interval. For example, the control unit 11 accepts the operation of pressing the set A button 146 after specifying the playback position 145 on the section bar 144, thereby accepting the specified playback position 145 as point A (start point) of A-B repeat playback. The same applies to operations that specify point B (end point) using the set B button 147.

[0030] As described above, in the playback position specification process of this embodiment, the playback position 145 of the song is specified on the section bar 144, which can accept user operations to change the display range. The user can intuitively and precisely specify the playback position 145 after adjusting the display range of the section bar 144, taking into account the song sections divided on the section bar 144.

[0031] The control unit 11 may also display two bars on the display unit 14, as shown in Figures 3 and 4: a section bar 144 and a normal seek bar 148 that represents the entire song. The control unit 11 may also control the display unit 14 so that the playback position 145 specified in the section bar 144 is reflected in the normal seek bar 148. For example, the repeat playback section may be represented by making the color or width of the bar in the normal seek bar 148 different from other sections. The user can intuitively grasp the playback position 145 specified in the section bar 144 even on the normal seek bar 148.

[0032] Furthermore, as shown in Figures 3 and 4, the control unit 11 may display a break button 149 on the display unit 14 and accept user input via the operation unit 15 to press the break button 149 (enable the break). When the control unit 11 receives user input to enable the break, it may set the system to insert a break during the repeat playback of the song based on the beat of the song that has been analyzed in advance (for example, simultaneously with the analysis of the song section in step S22). The break is a silent section in which the playback of the song is stopped, inserted just before the repeat playback position returns from point B (end point) to point A (start point) of the repeat playback section. The break is set to a length that includes a predetermined number of analyzed beats (for example, a fixed number such as four, or any number corresponding to one measure). The control unit 11 may further accept user input via the operation unit 15 to set the number of beats to include in the break. Furthermore, the break may include a count sound corresponding to the beat, and the control unit 11 may output the count sound to the sound output unit 16 during the break. The break allows the user to take a breather while continuing to practice the repeat playback section, and the count sound makes it easy for the user to time when to start playing immediately after the repeat.

[0033] Furthermore, the control unit 11 may analyze the measures of the song (more specifically, the number of beats in each measure) in advance (for example, simultaneously with the analysis of the song sections in step S22), and may accept user operations to fast-forward or rewind in measure units. For example, in the examples shown in Figures 3 and 4, the rightmost "right-pointing triangle" button among the four buttons located above the setA button 146, setB button 147, and break button 149 may accept an operation to fast-forward one measure. The second "left-pointing triangle" button from the right may accept an operation to rewind one measure, and the third "left-pointing triangle" button from the right, which consists of two overlapping "left-pointing triangles," may accept an operation to rewind four measures. Note that the number of measures to fast-forward or rewind is not limited to the examples described above, and the control unit 11 may accept user operations to set the number of measures to fast-forward or rewind via the operation unit 15.

[0034] [2. Specific Examples of Embodiments] In the following, the content of information processing will be described in detail using a terminal device 100 as an example of a user terminal 10. For example, the terminal device 100 is an information processing device used by a user who accesses web content or application content displayed in a browser. For example, the terminal device 100 may be a mobile phone such as a smartphone, a desktop PC, a notebook PC, a tablet terminal, or a PDA (Personal Digital Assistant).

[0035] [2-1. Configuration of the Terminal Device] First, an example of the functional configuration of the terminal device 100 will be explained using Figure 6. Figure 6 is a diagram showing an example of the configuration of the terminal device 100. As shown in Figure 6, the terminal device 100 has a communication unit 110, a storage unit 120, an input unit 130, an output unit 140, and a control unit 150.

[0036] (Regarding the communication unit 110) The communication unit 110 is connected to the network by wire or wireless and transmits and receives information with various other devices.

[0037] (Regarding the storage unit 120) The storage unit 120 is implemented by, for example, semiconductor memory elements such as RAM and flash memory, or storage devices such as hard disks and optical discs. The storage unit 120 also includes a user information database 121 and a music database 122.

[0038] (Regarding the user information database 121) The user information database 121 stores various information about the user. For example, the user information database 121 stores at least one of the following as related information: information obtained from the user and information previously registered by the user. For example, the user information database 121 includes attribute information that indicates various attributes of the user as related information. For example, attribute information may be information that indicates the user's attributes, such as demographic attributes or psychographic attributes, or information that indicates the user's membership information. Here, membership information may include not only free members and paid members, but also information that indicates the user's rank according to the membership fee.

[0039] (About the song database 122) The song database 122 stores various information about the songs to be played (practices and other songs). For example, the song database 122 registers audio data such as MP3 (MPEG-1 Audio Layer-3), the song title, and the song thumbnail image in association with each other. The song database 122 also registers part information indicating the parts of the song. For example, the song database 122 may register song data for each part as part information. The song database 122 may also register section information related to pre-divided sections. For example, the song database 122 may register the start and end times of each section (i.e., the playback position corresponding to each section), the name of each section (for example, a sequential number from the beginning of the song), or the attributes of the sounds contained in each section as section information.

[0040] (Regarding the input unit 130) The input unit 130 accepts various operations from the user. For example, the input unit 130 accepts various operations from the user via the output unit 140 using a touch panel function. The input unit 130 also accepts various operations from buttons provided on the terminal device 100, or from a keyboard or mouse connected to the terminal device 100.

[0041] (Regarding the output unit 140) The output unit 140 outputs various types of information. Specifically, the output unit 140 is a display device for displaying various types of information. For example, the output unit 140 is a display screen for a smartphone or tablet device, etc., realized by a liquid crystal display or an organic EL display. The output unit 140 also has, for example, a speaker and outputs sound.

[0042] (Regarding the control unit 150) The control unit 150 is implemented by, for example, a CPU, MPU (Micro Processing Unit), or GPU (Graphics Processing Unit) executing various programs (an example of an information processing program) stored in a storage device (for example, the memory unit 120) inside the terminal device 100, using RAM as the working area. Alternatively, the control unit 150 may be implemented by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array).

[0043] As shown in Figure 6, the control unit 150 includes an analysis unit 151, a supply unit 152, a reception unit 153, a display unit 154, a modification unit 155, a fader display unit 156, a playback unit 157, and a volume modification unit 158, and realizes or executes the information processing functions or operations described below. Note that the internal configuration of the control unit 150 is not limited to the configuration shown in Figure 6, and other configurations are also possible as long as they perform the information processing described later. Also, the connection relationships of the various processing units in the control unit 150 are not limited to the connection relationships shown in Figure 6, and other connection relationships are also possible.

[0044] (Regarding the analysis unit 151) The analysis unit 151 has functions as a section analysis unit and as a part analysis unit. Note that the analysis unit 151 may be implemented separately as a section analysis unit and a part analysis unit.

[0045] For example, as a section analysis unit, the analysis unit 151 analyzes the sections of a piece of music. For example, when the analysis unit 151 receives a selection of a piece of music from the user via a predetermined screen, it acquires the data of the selected piece of music from the music database 122 and analyzes the sections of the piece of music. Then, the analysis unit 151 generates information on each section into which the piece of music is divided and stores the section information in the music database 122. Note that such analysis processing may be realized based on any known analysis method. For example, as sections of a piece of music, the analysis unit 151 analyzes divisions such as each measure, intro, A melody, B melody, or refrain. Note that the analysis unit 151 is not limited to the above example and may analyze finer divisions.

[0046] Also, as a part analysis unit, the analysis unit 151 analyzes the parts (parts such as instruments or vocals) included in a piece of music. For example, the analysis unit 151 analyzes the selected music data and separates it into a plurality of parts. More specifically, the analysis unit 151 separates the piece of music into a plurality of parts according to the related information of the user stored in the user information database 121. Then, the analysis unit 151 stores the information on the separated plurality of parts in the music database 122 as part information. Note that such analysis processing may be realized based on any known sound source separation method.

[0047] For example, the analysis unit 151 may perform analysis of parts according to whether the related information about the user satisfies a predetermined condition. For example, as will be clear from the description hereinafter, the terminal device 100 receives a selection of a part to be separated from the user. At this time, the terminal device 100 determines whether the user is a paid member or a free member, and if the user is a paid member, presents more parts as separable parts than when the user is a free member. For example, when the membership information indicates a paid member, the terminal device 100 presents the maximum number of separable parts (for example, bass, drums, vocals, wind instruments, guitar, and piano) to the user as separable parts. On the other hand, when the membership information indicates a free member, the terminal device 100 presents a predetermined number of parts (for example, bass, drums, and vocals), which is less than the maximum number of separable parts, to the user as separable parts. Then, the analysis unit 151 separates the sound source into the part selected by the user from the separable parts and an integrated part formed by combining one or more other parts. For example, when the user selects bass and drums, the analysis unit 151 separates the sound source into bass, drums, and an integrated part (for example, including vocals, wind instruments, guitar, piano, and other parts included in the song).

[0048] As described above, the analysis unit 151 can automatically analyze the sections of a song even for a song that is not pre-classified, such as the song data held in the terminal device 100. In addition, the analysis unit 151 can automatically analyze a predetermined number of parts even for a song for which the sound source is not prepared in advance for each part, such as the song data held in the terminal device 100.

[0049] The analysis unit 151 may designate any predetermined type of part as an integrated part, or it may designate a part based on a user's specification as an integrated part. For example, the analysis unit 151 may designate a predetermined number of parts selected by the user as individual parts, and combine the unselected parts into an integrated part. Furthermore, if the analysis unit 151 has performed an analysis of parts or sections for a song, it may register the analysis results (part information or section information) in the song database 122. The analysis unit 151 does not need to perform a re-analysis if part information and section information for the song to be played are already registered in the song database 122. Furthermore, even if the analysis results for a song are already registered in the song database 122, the analysis unit 151 may re-analyze the parts or sections in response to user input.

[0050] (Regarding the information provision unit 152) The information provision unit 152 provides various information. For example, the information provision unit 152 presents the user with a screen for selecting a song to be played and accepts the selection of a song to be played (i.e., the selection of a song to be analyzed) via the screen. Furthermore, if the user has selected a song to be played, the information provision unit 152 provides the user with a part selection screen C1, which is a screen for accepting part selection, as shown in Figure 7, and accepts the part selection from the user via the screen. Figure 7 is a diagram showing an example of the part selection screen C1. In the example in Figure 7, the information provision unit 152 provides the part selection screen C1 which includes areas RC11, RC12, RC13, RC14, and button B11.

[0051] Area RC11 is an area that displays information about the song selected by the user. For example, the providing unit 152 places and provides a thumbnail of the selected song (shaded area in Figure 7), title, artist name, etc., in area RC11. Area RC12 is an area that shows multiple parts to be separated from the practice song. In the example in Figure 7, the providing unit 152 provides area RC12 which contains information indicating drums, bass, vocals, guitar, piano, and brass (wind instruments), as well as buttons to indicate whether or not to separate each part. Here, if the user selects drums, bass, and vocals as parts to be separated, the providing unit 152 may display the drums, bass, and vocals parts brightly and the other parts darkly.

[0052] Here, the service provider 152 accepts the user's selection of parts according to their relevant information. Specifically, the service provider 152 determines whether the relevant information stored in the user information database 121 meets predetermined conditions. For example, if the user is a paid member, the service provider 152 displays all of the separable parts—drums, bass, vocals, guitar, piano, and brass—in a selectable manner. On the other hand, if the user is a free member, the service provider 152 displays only the predetermined drums, bass, and vocals in a selectable manner, and, as shown in area RC13, displays the guitar, piano, and brass in a non-selectable manner (for example, a key icon is placed on the button, making them non-selectable as separable parts). As a result of this processing, the terminal device 100 can accept the user's selection of the parts included in the song for which they wish to display individual faders. Furthermore, the terminal device 100 displays the faders of the parts included in the song that the user did not select as a unified part, allowing the user to control the volume of all parts at once.

[0053] Furthermore, the providing unit 152 displays in area RC14 that other parts (integrated parts) are provided. Here, other parts (integrated parts) are parts other than separable parts, and parts that were not selected (could not be selected) from the separable parts. The providing unit 152 also displays button B11 for separating the parts of the song and starting playback of the song. When the user selects button B11, the terminal device 100 performs part analysis and section analysis. At this time, the terminal device 100 may display a screen showing the progress of each analysis process (for example, part analysis). When each analysis process is completed, the terminal device 100 provides the practice application screen shown in Figure 3 or Figure 4.

[0054] In this way, the terminal device 100 displays a part selection screen C1 for selecting parts, so that the user can select the parts they want to separate before separating the sound source such as a practice piece.

[0055] Furthermore, the service provider 152 may provide a part selection screen C1 in which the separable parts differ depending on the type of paid member. For example, if the user is a regular paid member, the service provider 152 may display drums, bass, vocals, and guitar as selectable parts, and if the user is a premium member with a higher membership fee than a regular paid member, it may display drums, bass, vocals, guitar, piano, and brass as selectable parts.

[0056] (Regarding the reception unit 153) Returning to Figure 6, the explanation continues. The reception unit 153 receives various user operations. For example, the reception unit 153 receives the user's selection of the part to be separated via the part reception screen C1. In other words, the reception unit 153 receives the user's selection of the part whose playback volume will be individually controlled. The reception unit 153 also receives user operations on each fader 142, seek bar 148, section bar 144, set A button 146, set B button 147, and break button 149, etc., via the practice application screen shown in Figure 3 or Figure 4.

[0057] (Regarding the display unit 154) The display unit 154 has the function of a playback bar display unit that displays a section bar 144, which is a playback bar that indicates the section (division) of the song to be played, and a seek bar display unit that displays a seek bar 148 that indicates the playback position of the song, separate from the playback bar.

[0058] The display unit 154 displays a section bar 144 indicating the section analyzed by the analysis unit 151. For example, when the user selects button B11 on the part selection screen C1, the display unit 154 displays the section bar 144 on the practice application screen shown in Figure 3 or Figure 4. More specifically, the display unit 154 refers to the song database 122 and reads the section information of the song to be played. Then, according to the section information, the display unit 154 displays a section bar 144 indicating the playback position where each section of the song to be played begins (the beginning of the section), and the playback position where each section ends (the end of the section). This allows the display unit 154 to easily allow the user to specify the playback position of the song.

[0059] Here, the display unit 154 displays a section bar 144 for each divided section, with the display mode changed according to the content of the song contained in that section. For example, the display unit 154 may display a section bar 144 for each divided section, color-coded to indicate whether the range of the song contained in that section is the intro, verse A, verse B, or chorus. This allows the user to intuitively select the section they wish to play.

[0060] Furthermore, when the user selects button B11 on the part selection screen C1, the display unit 154 displays a seek bar 148 indicating the playback position of the song, separate from the section bar 144, on the practice application screen shown in Figure 3 or Figure 4. The display unit 154 also displays the section to be repeated in a different color from the other sections.

[0061] (Regarding the modification unit 155) The modification unit 155 has the function of a playback bar modification unit that changes the display range of the section bar 144 in response to operations on the section bar 144, and a seek bar modification unit that changes the display of the seek bar 148 to indicate the playback position when a playback position is specified in the section bar 144.

[0062] For example, if an operation is performed to change the display magnification of the section bar 144, the modification unit 155 will change the number of sections of the song that are displayed simultaneously without changing the display size of the section bar 144. For example, in the practice application screen shown in Figure 3 or Figure 4, if an operation is performed to enlarge the section bar 144 or each section contained within the section bar 144, such as a pinch-out operation within the range where the section bar 144 is displayed, the modification unit 155 will not change the overall size of the section bar 144, but will increase the size of each section (the vertical length of each section will not change, but the horizontal length of each section will be increased), thereby reducing the number of sections of the song that are displayed simultaneously. Furthermore, when an operation is performed to reduce the size of the section bar 144 or each section contained within it, such as a pinch-in operation within the range where the section bar 144 is displayed, the modification unit 155 does not change the overall size of the section bar 144, but reduces the size of each section (the vertical length of each section is not changed, but the horizontal length of each section is shortened), thereby increasing the number of sections of the song that can be displayed simultaneously. In this way, the modification unit 155 can change the number of sections that can be displayed simultaneously (change the size of the sections) simply by the user performing an operation to change the display magnification of the playback bar, such as a pinch-in or pinch-out operation, thus allowing the user to easily specify the desired playback position. Note that if the operation to change the display magnification of the section bar 144 is performed only slightly, the number of sections displayed on the section bar 144 may not change as a result, but if the operation to change the display magnification of the section bar 144 is performed to a certain extent, the number of sections that can be displayed simultaneously will change.

[0063] Furthermore, when an operation is performed to move the section bar 144 or each section displayed by the section bar 144, such as a slide operation within the range where the section bar 144 is displayed, the modification unit 155 moves the displayed range of each section included in the section bar 144 in accordance with the operation. For example, if the user slides the section bar 144 to the left, the modification unit 155 slides each section to the left in accordance with the slide operation to display sections with a later playback position. For example, if the user slides the section bar 144 to the right, the modification unit 155 slides each section to the right in accordance with the slide operation to display sections with an earlier playback position. In this way, the modification unit 155 allows the user to easily specify the desired playback position simply by moving the display range of the section bar 144.

[0064] Furthermore, if a playback position is specified via the seek bar 148, the modification unit 155 changes the display of the section bar 144 to indicate the specified playback position. For example, if the user specifies a playback position from the seek bar 148, the modification unit 155 moves the icon indicating the playback position on the seek bar 148 to the specified playback position, while also moving the icon indicating the playback position on the section bar 144 to the corresponding playback position. In this case, the modification unit 155 may also move each section included in the section bar 144 to the corresponding playback position. For example, the modification unit 155 may identify the section corresponding to the playback position specified on the seek bar 148 and the playback position within that section, and slide each section of the section bar 144 so that the identified playback position is displayed.

[0065] Furthermore, if a playback position is specified via the section bar 144, the modification unit 155 changes the display of the seek bar 148 to indicate the specified playback position. For example, if the user selects any of the sections displayed on the section bar 144, the modification unit 155 identifies the playback position at which that section begins and moves the playback position icon on the seek bar 148 to the identified playback position. Note that since the seek bar 148 represents the entire song, the modification unit 155 does not change the display of the seek bar 148 even if zooming operations are performed on the seek bar 148.

[0066] (Regarding the fader display unit 156) The fader display unit 156 displays a fader for controlling the playback volume of each part, for each part analyzed by the analysis unit 151. For example, the fader display unit 156 displays individual faders for controlling the playback volume of each part, and an integrated fader for controlling the playback volume of an integrated part that combines multiple parts. For example, in the practice application screen shown in Figure 3 or Figure 4, the fader display unit 156 displays each icon 141 representing each part, each fader 142 for each part, and each silhouette 143 for each part.

[0067] Here, the fader display unit 156 displays an integrated fader for controlling the playback volume of an integrated part, which is a collection of multiple parts selected according to the relevant information stored in the user information database 121 from among the parts included in the song. For example, if the relevant information stored in the user information database 121 satisfies a predetermined condition (for example, the user is a paid member), the fader display unit 156 displays individual faders for some of the multiple parts that are combined into an integrated part when the relevant information does not satisfy the predetermined condition (for example, the user is a free member).

[0068] Furthermore, the fader display unit 156 displays faders 142 with a width corresponding to the number of parts that are grouped together as an integrated part. To explain with a more specific example, the fader display unit 156 determines whether the number of parts separated from the sound source is the maximum number that can be separated. For example, if the number of parts is the maximum number that can be separated, the fader display unit 156 displays each fader 142 corresponding to each part with the same width, as shown in Figure 3. On the other hand, if the number of parts is not the maximum number that can be separated, that is, a predetermined number that is less than the maximum number, the fader display unit 156 displays the fader 142 corresponding to the integrated part with a width that is greater than the width of the faders 142 of the other parts (individual faders), as shown in Figure 4. In other words, the fader display unit 156 displays the fader 142 corresponding to the integrated part with a width that is larger by the number of parts that have been grouped together as an integrated part.

[0069] As a result of the processing described above, the terminal device 100 can allow the user to control the playback volume of multiple parts grouped together as an integrated part. Furthermore, if the user's related information indicates that they are a free member, the terminal device 100 can allow the user to control the combined playback volume of multiple parts, and if the user's related information indicates that they are a paid member, the terminal device 100 can allow the user to control the playback volume of each part individually. As a result, the terminal device 100 can guide the user to become a paid member. In addition, by checking the width of the integrated fader, the user can intuitively understand that the number of parts that can be separated will increase if conditions such as becoming a paid member are met.

[0070] Furthermore, the fader display unit 156 changes the display mode of the fader 142 in response to operations on the fader 142, and also changes the display mode of the silhouette 143, which is content corresponding to the fader 142. The silhouette 143 is content that indicates the type of sound included in the part. For example, when the user slides the guitar fader 142 down, the fader display unit 156 shrinks the display of the fader 142 downwards and increases the transparency of the silhouette 143. As a result of this processing, the terminal device 100 can intuitively show the user the degree of operation of each part's fader.

[0071] (Regarding the playback unit 157) The playback unit 157 has the function of playing a song from the specified playback position when an operation to specify the playback position of a song is performed via the section bar 144 or the seek bar 148. For example, if the user selects any of the divided sections via the section bar 144, the playback unit 157 will play the song from the beginning of the selected section. In this way, the playback unit 157 can automatically play from the beginning of the section that the user wants to play without requiring the user to specify a precise playback position. Also, if the user specifies the playback position of a song via the seek bar 148, the playback unit 157 will play the song from the specified playback position.

[0072] Furthermore, the playback unit 157 has a repeat playback function that repeats playback (repeated playback) of the selected sections of a song when an operation is performed to select one or more sections from the divided sections via the section bar 144. For example, if the user selects the set A button 146, then selects multiple consecutive sections, and then selects the set B button 147, the playback unit 157 will repeat playback of the selected multiple sections. More specifically, the playback unit 157 will repeat playback from the beginning of the first section to the end of the last section among the multiple selected sections.

[0073] The playback unit 157 may repeat playback of a specified section without using the set A button 146 and the set B button 147. For example, the playback unit 157 may repeat playback of the section that is pressed and held down from among the sections displayed on the section bar 144. The playback unit 157 may also exclude a section included in the repeat playback target (repeat playback section) from repeat playback if it is pressed and held down again. Furthermore, when the Nth section from the left (where N is any integer) of the sections displayed on the section bar 144 shown in Figure 3 or Figure 4 is selected as the section to be repeated, and then the N+2nd section from the left is selected, the playback unit 157 may include the N+1th section in between the Nth and N+2nd sections from the left as the target for repeat playback. As a result of this processing, the terminal device 100 can easily allow the user to specify the target for repeat playback.

[0074] Furthermore, when the playback unit 157 performs repeat playback, it may insert a predetermined break after playing to the end of the selected section and before playing to the beginning of the selected section. For example, if the user selects the break button 149, the playback unit 157 will play to the end of the last section to be repeated, insert a break for a predetermined time, and then play from the beginning of the first section to be repeated. Here, the playback unit 157 may change the length of the break according to the information of the song and the selected section. For example, if the song is in 4 / 4 time, the playback unit 157 may set a 4-beat break to match the tempo (speed) of the song, or it may set a break for the length of one selected section. Also, during the break, the playback unit 157 may output a sound indicating the beat at a tempo corresponding to the tempo of the song, like a metronome. Also, the playback unit 157 may output a predetermined number of beats immediately before playing from the beginning of the first selected section with a different sound from the other beats. As a result of this processing, the terminal device 100 can insert a break when repeating playback of the section selected by the user, giving the user a moment to catch their breath.

[0075] Furthermore, the playback unit 157 may prevent the user from deselecting only the sections in between when three or more sections are designated as repeat playback intervals. In other words, the playback unit 157 prevents the designation of repeat playback intervals as isolated sections. On the other hand, when three or more sections are designated as repeat playback intervals, the playback unit 157 may accept deselection requests from the leftmost and rightmost sections.

[0076] (Regarding the volume adjustment unit 158) The volume adjustment unit 158 ​​controls the output unit 140 to play the sound source of each part at a volume that has been received by the reception unit 153 and adjusted according to the fader displayed by the fader display unit 156. For example, if the user slides the guitar fader 142 down, the volume adjustment unit 158 ​​reduces the playback volume of the part corresponding to the guitar by the amount it has been slid down.

[0077] [2-2. Processing Procedure] Next, the information processing procedure performed by the terminal device 100 according to the embodiment will be explained using Figure 8. Figure 8 is a flowchart showing an example of the flow of information processing performed by the terminal device 100.

[0078] As shown in Figure 8, the terminal device 100 determines whether or not it has received a selection of a song to be played (step S101). If the terminal device 100 determines that it has not received a selection of a song to be played (step S101; No), it waits until it receives a selection of a song to be played.

[0079] Meanwhile, if the terminal device 100 determines that it has received a selection of a song to be played (step S101; Yes), it performs section and part analysis (step S102). Subsequently, the terminal device 100 provides the user with a screen to accept part selection (step S103).

[0080] Furthermore, the terminal device 100 determines whether or not it has accepted the selection of a part (step S104). If the terminal device 100 determines that it has not accepted the selection of a part (step S104; No), it waits until it accepts the selection of a part. On the other hand, if the terminal device 100 determines that it has accepted the selection of a part (step S104; Yes), it displays the silhouette 143 of each part, the fader 142 corresponding to each part, and the section bar 144 (step S105).

[0081] Next, the terminal device 100 determines whether or not it has received a playback operation or a playback stop operation via the playback button or the like shown in Figure 3 or Figure 4 (step S106). Specifically, if the terminal device 100 determines that it has not received a playback operation or a playback stop operation (step S106; No), it executes step S108. On the other hand, if the terminal device 100 determines that it has received a playback or playback stop operation (step S106; Yes), it plays or stops the song according to the operation (step S107).

[0082] Furthermore, the terminal device 100 determines whether or not it has received an operation on the section bar 144 (step S108). Specifically, if the terminal device 100 determines that it has not received an operation on the section bar 144 (step S108; No), it executes step S110. On the other hand, if the terminal device 100 determines that it has received an operation on the section bar 144 (step S108; Yes), it changes the display mode of the section bar 144 according to the operation on the section bar 144 (step S109). After step S109, the terminal device 100 executes step S106 again.

[0083] Furthermore, the terminal device 100 determines whether or not it has received an operation on the fader 142 (step S110). Specifically, if the terminal device 100 determines that it has not received an operation on the fader 142 (step S110; No), it executes step S112. On the other hand, if the terminal device 100 determines that it has received an operation on the fader 142 (step S110; Yes), it changes the volume of the corresponding part according to the operation on the fader 142 (step S111). After step S111, the terminal device 100 executes step S106 again.

[0084] Furthermore, the terminal device 100 determines whether or not it has received a request to terminate the practice application (step S112). Specifically, if the terminal device 100 determines that it has not received a request to terminate the practice application (step S112; No), it executes step S106 again. On the other hand, if the terminal device 100 determines that it has received a request to terminate the practice application (step S112; Yes), it terminates the practice application (step S113).

[0085] [2-3. Modifications] The terminal device 100 described above may be implemented in various other forms besides the embodiment described above. Therefore, other embodiments of the terminal device 100 will be described below.

[0086] [2-3-1. Practice Pieces] The practice pieces are not limited to the above embodiments, and may be songs purchased from, for example, an external server. Also, the practice pieces may be songs recorded by any person, including the user. For example, the practice pieces may be songs recorded for band practice.

[0087] [2-3-2. Seek Bar] The terminal device 100 may further include a seek bar display unit that displays a seek bar 148, and a seek bar changing unit that changes the display mode of the seek bar 148 in response to operations on the seek bar 148 or on the section bar 144. The seek bar display unit displays a seek bar 148 that indicates the playback position of the song, separately from the section bar 144. The seek bar changing unit also changes the display of the seek bar 148 to indicate the specified playback position when a playback position is specified in the section bar 144. Thus, unlike the section bar 144, the seek bar 148 may not have a changeable display range and may always show the entire song.

[0088] [2-3-3. Section Bar] The terminal device 100 may automatically set the beginning of the section containing the selected position as the playback position when the user selects an arbitrary position on the section bar 144, or it may set the selected position as the playback position. Alternatively, the terminal device 100 may add a section break at the selected position on the section bar 144, which has been automatically divided after section analysis by the analysis unit 151, when the user selects an arbitrary position. For example, the terminal device 100 may accept operations from the user to set a section break, merge sections, or separate sections.

[0089] [2-3-4. About Analysis] In addition to section analysis (musical structure analysis) and part analysis (sound source separation), the terminal device 100 (for example, the analysis unit 151) may also perform chord analysis, which analyzes the chords in each measure of the song. Furthermore, the terminal device 100 may perform section analysis, part analysis, and chord analysis in any order, or they may be performed in parallel. For example, the time required for section analysis is shorter than the time required for part analysis. Therefore, after the completion of section analysis, the terminal device 100 may display the section bar 144 containing the results of section analysis on the practice application screen and perform part analysis in the background. Also, during part analysis, if the user specifies a playback position (for example, a repeat playback section) on the section bar 144 and presses the play button, the terminal device 100 may play the original song, which has not been separated by part analysis. This allows the user to specify a playback position of the original song and start practicing even while waiting for part analysis to finish. Furthermore, during part analysis, if the user specifies a playback position (e.g., a repeat playback section) on the section bar 144 displayed after section analysis, the terminal device 100 may prioritize performing part analysis from the specified position or section. This allows the user to prioritize the separation of the sound source in the section they want to practice, enabling them to start practicing quickly. Also, for example, the time required for chord analysis is shorter than the time required for part analysis. Therefore, after the completion of chord analysis, if the user presses the play button during part analysis, the terminal device 100 may display the chords of the original song whose sound source has not been separated by part analysis.

[0090] Furthermore, the terminal device 100 may set different upper limits on the number of times (number of saved songs) the results of at least one of the section analysis, code analysis, and part analysis can be saved for paid members and free members. For example, the terminal device 100 may allow paid members to save the results of section analysis and part analysis more times (number of songs) than free members. Also, the terminal device 100 may set different units for adjusting the tempo multiplier of songs for paid members and free members. For example, if the user is a paid member, the terminal device 100 may allow the tempo when playing a song to be changed from 0.5x to 2x in 0.1x increments, while if the user is a free member, the tempo when playing a song may be changed from 0.5x to 2x in 0.5x increments.

[0091] Furthermore, the terminal device 100 may have different upper limits on the number of songs that can be analyzed per predetermined period for paid members and free members. For example, the terminal device 100 may allow unlimited section analysis and part analysis processes per month if the user is a paid member, while allowing section analysis and part analysis processes to be performed for up to 5 songs per month if the user is a free member.

[0092] [2-3-5. Other Functions] In addition to the processes described above, the terminal device 100 may implement various functions related to music playback. For example, Figure 9 is a first diagram showing other functions of the practice application screen. Figure 10 is a second diagram showing other functions of the practice application screen. Figure 11 is a third diagram showing other functions of the practice application screen. Note that in the practice application screens shown in Figures 9 to 11, displays that implement the same functions as those shown in Figure 3 or Figure 4 are denoted by the same reference numerals as in Figure 3 or Figure 4, and their explanations are omitted.

[0093] For example, as shown in Figure 9, the terminal device 100 displays a cue button 170, a first rewind button 171, a second rewind button 172, and a fast-forward button 173 alongside a play button 175 for playing a song. When the cue button 170 is selected, the terminal device 100 sets (changes) the playback position to the beginning of the song. When the first rewind button 171 is selected, the terminal device 100 sets the playback position to a predetermined number of seconds (for example, 4 seconds) earlier than the current playback position. When the second rewind button 172 is selected, the terminal device 100 sets the playback position to a predetermined number of seconds (for example, 1 second) earlier than the current playback position than the first rewind button. When the fast-forward button 173 is selected, the terminal device 100 sets the playback position to a predetermined number of seconds (for example, 1 second) later than the current playback position.

[0094] Furthermore, if the cue button 170, first rewind button 171, second rewind button 172, or fast-forward button 173 is selected while a song is playing, the terminal device 100 will continue playing the song from the new playback position. On the other hand, if the cue button 170, first rewind button 171, second rewind button 172, or fast-forward button 173 is selected while a song is not playing, the terminal device 100 will only change the playback position and will wait without playing the song until the play button 175 is selected.

[0095] Furthermore, when the first rewind button 171, the second rewind button 172, or the fast-forward button 173 is selected, the terminal device 100 may change the playback position based on the number of measures or sections rather than seconds. For example, when the first rewind button 171 is selected, the terminal device 100 may set the playback position to the beginning of the measure four measures prior to the measure containing the current playback position, or to the beginning of the section four sections prior to the section containing the current playback position.

[0096] Furthermore, the terminal device 100 displays the first folding button 180. When the first folding button 180 is selected, the terminal device 100 folds the icon containing the break button 149, etc., to the right side of the screen, as shown in Figure 10, and displays the metronome button 181, key button 182, and playback magnification button 183.

[0097] When the metronome button 181 is selected, the terminal device 100 implements the metronome function and plays a predetermined sound at regular intervals along with the playback of the song. The terminal device 100 may also display a screen for accepting metronome settings when the metronome button 181 is selected. For example, the terminal device 100 may display a screen for selecting whether or not to play a metronome sound, the timbre of the metronome sound, the timing of the beats for which the metronome sound is played, whether or not to output an intro sound (for example, a sound for 4 beats) that is output for a predetermined number of beats before the song starts playing when the play button 175 is selected, the timbre of such an intro sound, the timing of the beats for which the intro sound is played, and the volume of the metronome sound or intro sound, thereby accepting various settings related to the metronome.

[0098] Furthermore, if key button 182 is selected, terminal device 100 changes the playback key of the song. For example, if key button 182 is selected, terminal device 100 displays a screen that accepts the selection of how much to raise or lower the original song's playback key in semitone increments, with the original song's playback key set to 0, and plays the song at the selected key. Also, if playback multiplier button 183 is selected, terminal device 100 displays a screen for selecting the playback speed multiplier, and accepts the setting of the playback speed multiplier from, for example, 0.5x to 2.0x. Then, terminal device 100 plays the song at the set playback speed multiplier. In addition, terminal device 100 may also display the BPM (Beats Per Minute) when the song is played on the screen for selecting the playback speed multiplier. Furthermore, terminal device 100 may differentiate the settable multipliers depending on whether the user is a paid member or a free member. For example, if the user is a paid member, terminal device 100 may accept the setting of the playback speed multiplier in more detailed units than if the user is a free member. For example, the terminal device 100 may accept playback speed multiplier settings up to two decimal places if the user is a paid member, and up to one decimal place if the user is a free member. Furthermore, the terminal device 100 may accept playback speed multiplier settings over a wider range than when the user is a free member, provided the user is a paid member.

[0099] Furthermore, if the user selects the Chord button 160, the terminal device 100 changes the Chord button 160 to the expanded display 161, as shown in Figure 11, and displays the code score 162 and code display 163 in place of the fader 142 and silhouette 143. The terminal device 100 also places the Capo button 164 and the View button 165 on the expanded display 161.

[0100] For example, the terminal device 100 displays letters indicating chords in one or more measures, including the playback position, as a chord score 162. The terminal device 100 also provides content as a chord display 163, which shows how to play the chords in each measure on each instrument. For example, in the example shown in Figure 11, the terminal device 100 displays content showing the finger positions to press the strings when playing chord "A" on a guitar, and the finger positions to press the strings when playing chord "E" on a guitar. The chord score 162 and chord display 163 change the letters indicating chords and the content showing how to play them in accordance with the playback of the song.

[0101] Furthermore, if the Capo button 164 is selected, the terminal device 100 accepts the setting for the position where the capo is attached when playing the guitar. Based on this setting, the terminal device 100 changes the chords displayed in the chord score 162 and chord display 163. Also, if the View button 165 is selected, the terminal device 100 accepts the setting for whether to display a screen showing how to play the guitar, a screen showing how to play the keyboard, or a musical staff display as the chord display 163. If the screen showing how to play the keyboard is selected, the terminal device 100 displays a chord display 163 that shows which keys to press, instead of the chord display 163 shown in Figure 11. Also, if the display of the musical staff is selected, the terminal device 100 displays a chord display 163 that shows the chords on a musical staff, instead of the chord display 163 shown in Figure 11. The terminal device 100 may further accept settings such as the amount of beat position correction and settings for re-analyzing the song.

[0102] [2-4. Hardware Configuration] The terminal device 100 and the like according to the embodiments described above are implemented by a computer. For example, the terminal device 100 and the like are implemented by a computer having a processor, main memory, storage, communication interface, input / output interface, and media interface.

[0103] The processor includes, for example, one or more CPUs, MPUs, or GPUs. The main memory includes RAM. The storage includes, for example, flash memory or an HDD (Hard Disk Drive). The control unit 150 described above is implemented by executing an information processing program stored in the storage, using the main memory as a working area. The control unit 150 may be partially or entirely implemented by an integrated circuit such as an ASIC or FPGA. The storage unit 120 described above is implemented by storage, etc., and the communication unit 110 is implemented by a communication interface, etc.

[0104] The processor controls output devices such as displays or printers, and input devices such as keyboards or mice, for example, via input / output interfaces (I / F). The processor also acquires data from input devices and outputs data generated via the I / F to output devices. The media interface reads information processing programs stored on a storage medium. The processor loads the information processing program acquired from the storage medium via the media interface into main memory and executes the loaded program. The aforementioned storage medium is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or semiconductor memory, but is not limited to these examples.

[0105] [3. Others] Furthermore, among the processes described in the above embodiments and modifications, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by known methods. In addition, the processing procedures, specific names, various data, and information including parameters shown in the above document or drawings can be changed at will unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown.

[0106] Furthermore, the components of each illustrated device are functionally conceptual and do not necessarily need to be physically configured as shown. In other words, the specific forms of distribution and integration of each device are not limited to those shown, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads or usage conditions.

[0107] Furthermore, the embodiments and modifications described above can be combined as appropriate, provided that the processing content is not inconsistent.

[0108] Furthermore, the terms "section, module, unit" used above can be replaced with "means" or "circuit," etc. For example, a display unit can be replaced with a display means or a display circuit.

[0109] Although some embodiments of the present invention have been described in detail above with reference to the drawings, these are illustrative examples, and the present invention can be implemented in various other forms with modifications and improvements based on the knowledge of those skilled in the art, starting with the embodiments described in the disclosure section of the invention.

[0110] 1 Information Processing System 10 User Terminal 11 Control Unit 12 Storage Unit 13 Communication Unit 14 Display Unit 141 Icon 142 Fader 143 Silhouette 144 Section Bar 145 Playback Position 146 Set A Button 147 Set B Button 148 Seek Bar 149 Break Button 15 Operation Unit 16 Sound Output Unit 20 Server 21 Control Unit 22 Storage Unit 23 Communication Unit 30 Network 100 Terminal Device 110 Communication Unit 120 Storage Unit 121 User Information Database 122 Song Database 130 Input Unit 140 Output Unit 150 Control Unit 151 Analysis Unit 152 Provision Unit 153 Reception Unit 154 Display Unit 155 Change Unit 156 Fader Display Unit 157 Playback section 158 Volume adjustment section

Claims

1. A computer-based information processing method comprising: a playback bar display step of displaying a playback bar that indicates the divisions of a song to be played; and a playback bar modification step of changing the display range of the playback bar in response to an operation on the playback bar.

2. The information processing method according to claim 1, further comprising a section analysis step of analyzing sections of the song, wherein the playback bar display step displays the playback bar indicating the divisions corresponding to the sections analyzed by the section analysis step.

3. The information processing method according to claim 1 or 2, wherein, if an operation is performed to change the display magnification of the playback bar, the number of divisions of the song to be displayed simultaneously is changed without changing the display size of the playback bar.

4. The information processing method according to claim 3, wherein, in the playback bar modification step, when an operation to enlarge the playback bar is performed, the number of song divisions displayed simultaneously is reduced, and when an operation to shrink the playback bar is performed, the number of song divisions displayed simultaneously is increased.

5. The information processing method according to any one of claims 1 to 4, wherein the playback bar modification step is performed such that, if an operation is performed to move the display range of the playback bar, the display range of the playback bar is moved in accordance with said operation.

6. The information processing method according to any one of claims 1 to 5, further comprising: a seek bar display step of displaying a seek bar indicating the playback position of the song, separate from the playback bar; and a seek bar modification step of changing the display of the seek bar to indicate the playback position when a playback position is specified on the playback bar.

7. The information processing method according to any one of claims 1 to 6, further comprising: a part analysis step of analyzing the parts included in the song; and a fader display step of displaying a fader for controlling the playback volume of each part analyzed by the part analysis step.

8. The information processing method according to claim 7, wherein the fader display step displays individual faders for controlling the playback volume for each part and an integrated fader for controlling the playback volume of an integrated part that combines multiple parts.

9. The information processing method according to claim 8, wherein the fader display step displays an integrated fader that controls the playback volume of an integrated part, which is a collection of multiple parts selected from the parts included in the song according to relevant information about the user.

10. The information processing method according to claim 9, wherein the fader display step displays the individual faders for some of the parts of the plurality of parts that are combined as the integrated part when the related information does not meet the predetermined conditions, if the related information satisfies predetermined conditions.

11. The information processing method according to any one of claims 8 to 10, wherein the fader display step displays a fader with a width corresponding to the number of parts that are grouped together as the integrated part.

12. The information processing method according to any one of claims 8 to 11, wherein the fader display step displays content indicating the type of sound included in the part, and changes the display mode of the content corresponding to the fader in response to an operation on the fader.

13. The information processing method according to any one of claims 8 to 11, further comprising a receiving step of receiving a selection from a user for which the playback volume of a part to be individually controlled, wherein the fader display step displays the individual faders for individually controlling the playback volume of the part selected by the user, and the integrated fader for controlling the playback volume of the integrated part which is a collection of parts not selected by the user.

14. The information processing method according to claim 13, wherein the reception step accepts the selection of a number of parts according to the relevant information relating to the user.

15. The information processing method according to any one of claims 1 to 14, wherein the playback bar display step is to display the playback bar in a display manner that is changed according to the content of the song included in each divided section.

16. The information processing method according to any one of claims 1 to 15, further comprising a playback step of playing the song from the beginning of the section containing the specified playback position among the divided sections when an operation is performed to specify the playback position of the song via the playback bar.

17. The information processing method according to any one of claims 1 to 16, further comprising a repeat playback step of repeating playback of the selected section of the song if an operation is performed to select one or more sections from the divided sections via the playback bar.

18. The information processing method according to claim 17, wherein, when the repeat playback step is performed, a predetermined break is inserted after playback to the end point of the selected section and before playback to the start point of the selected section.

19. An information processing device having a playback bar display unit that displays a playback bar indicating the division of songs to be played, and a playback bar changing unit that changes the display range of the playback bar in response to an operation on the playback bar.

20. An information processing program for causing a computer to display a playback bar indicating the divisions of songs to be played, and a playback bar modification procedure to change the display range of the playback bar in response to an operation on the playback bar.

Images