Information processing device, information processing method, and program

Abstract

This information processing device comprises a control unit that performs control to: display related content, which is associated with music content and is composed of a plurality of pages on which characters or images are displayed; and display a page guide which shows a page being displayed within the entirety of the related content.

Description

Information processing device, information processing method, and program

[0001] The present technology relates to an information processing device, an information processing method, and a program, and to displaying content related to music content.

[0002] For example, music package media such as analog records and music CDs (Compact Discs) often include lyric sheets or lyric booklets, allowing users to enjoy listening to music while looking at lyrics and artwork such as photographs, pictures, and illustrations.

[0003] Furthermore, as disclosed in Patent Document 1 below, there is also known a music player with a lyrics display function that displays lyrics while playing music.

[0004] Japanese Patent Application Laid-Open No. 2006-259236

[0005] In recent years, in addition to purchasing their favorite songs on packaged media such as CDs, users are increasingly purchasing music content via network communications. In this case, users can easily enjoy the music itself as sound, but there are fewer opportunities for users to enjoy the lyric sheets and other accessories that are provided with music media such as CDs and analog records.

[0006] Lyric cards and lyric booklets are also a means of expression for music artists, with functions such as conveying lyrics and expressing the worldview of the song through artwork. The size, typeface, and font of the text displayed in lyrics are also part of the artist's expression. Considering this, when providing users with songs as digital content, it is desirable to be able to provide users with lyric cards and lyric booklets as works of art.

[0007] Therefore, the present disclosure proposes a technique for displaying related content associated with music content, such as a lyric sheet or lyric booklet as digital content, in a manner that is desirable for the user.

[0008] The information processing device according to the present technology includes a control unit that displays related content associated with music content and consisting of multiple pages displaying text or images, and controls the display of a page guide that indicates the currently displayed page of the entire related content. For example, when related content associated with music content is displayed on a screen as artwork including text and images on multiple pages, the page guide is performed during the display. Note that "text" refers to the portion of the page that is displayed as text, and "image" is a general term for non-text display portions such as photographs, pictures, illustrations, and animations.

[0009] 1 is an explanatory diagram of a system configuration according to an embodiment of the present technology; FIG. 1 is an explanatory diagram of a lyric booklet as related content according to an embodiment; FIG. 2 is an explanatory diagram of a lyric booklet and a lyric card as related content according to an embodiment; FIG. 3 is an explanatory diagram of an example of display of related content on a terminal device according to an embodiment; FIG. 4 is a block diagram of an information processing device according to an embodiment; FIG. 5 is a flowchart of related content creation processing according to an embodiment; FIG. 6 is an explanatory diagram of a related content creation screen according to an embodiment; FIG. 7 is an explanatory diagram of a related content creation screen according to an embodiment; FIG. 8 is an explanatory diagram of a related content creation screen according to an embodiment; FIG. 9 is an explanatory diagram of a related content creation screen according to an embodiment; 1 is an explanatory diagram of a sharing mode according to an embodiment; FIG. 2 is an explanatory diagram of a sharing mode according to an embodiment; FIG. 3 is a flowchart of a related content display process according to an embodiment; FIG. 4 is a flowchart of a display setting process according to an embodiment; FIG. 5 is a flowchart of a display update control process according to an embodiment;

[0010] Hereinafter, the embodiments will be described in the following order: <1. System configuration and display of related content> <2. Configuration of information processing device> <3. Generation and editing of related content> <4. Display of related content> <5. Summary and modifications>

[0011] In this disclosure, "music content" is a general term for music data as digital content, and may refer to music data for a single song or to music data for multiple songs collectively, such as on a music album.

[0012] "Related content" refers to digital content associated with music content, such as digital content provided in conjunction with the purchase or distribution of individual music content. In the embodiment, the related content will be described using an example of a lyric booklet or lyric card.

[0013] A lyric booklet is a booklet containing lyrics, artwork in the form of photographs or pictures, and credits for artists and producers on multiple pages. A lyric card refers to a single page, or the front and back of a single sheet of paper, on which lyrics, artwork, credits, etc. are printed, rather than on multiple pages. In the embodiments, related content refers to digitalized versions of the text and images expressed in the form of a booklet or a single sheet of paper. For the purpose of explanation, when there is no particular distinction between a lyric booklet and a lyric card, they will be collectively referred to as a "lyric booklet, etc." Such related content as a lyric booklet, etc., is provided as one or more image data. In other words, it is image data containing text or images on each page. However, text data corresponding to the displayed text of lyrics, etc., may also be included.

[0014] 1. System Configuration and Display of Related Content An example of a system configuration according to an embodiment is shown in Fig. 1. Fig. 1 shows a server device 1, a database 2, a terminal device 3, and a terminal device 4.

[0015] The server device 1 is a server that sells and distributes content via a network 6. The database 2 stores various types of content, such as music content and related content, as well as information (software programs and data) necessary for executing processing by the server device 1. The server device 1 is composed of one or more information processing devices, and performs processing such as transmitting information to a terminal device 4 and accepting information uploads from a terminal device 3.

[0016] Terminal device 3 is an information processing device used by an artist who creates music content, while terminal device 4 is an information processing device used by a general user who purchases music content, etc. Specific examples of terminal devices 3 and 4 include smartphones, PCs (personal computers), tablet devices, etc.

[0017] The terminal devices 3 and 4 are capable of communicating with the server device 1 via a network 6. The network 6 may be, for example, the Internet, a home network, a LAN (Local Area Network), a mobile communication network, or any other type of network.

[0018] In such a system, users can access the server device 1 via a predetermined application program or a web browser on their terminal device 4 to purchase music content (music albums or specific songs). Artists can also use the terminal device 3 to create and edit lyric booklets and other materials to accompany the music content. This means that artists can not only provide music data as music content, but also express artwork in lyric booklets and other materials. Lyric booklets and other materials created and edited using the terminal device 3 are uploaded to the server device 1 and registered as related content associated with the music content.

[0019] 2 and 3 show examples of related content such as a lyric booklet. Fig. 2 shows an example of a lyric booklet consisting of multiple pages. For example, a lyric booklet enclosed in a CD or the like as a music album consists of multiple pages, as shown as pages P1, P2, etc., with lyrics and artwork printed on each page. The images of each page are converted into digital content consisting of multiple pieces of image data, such as portrait-oriented image data suitable for display on a terminal device 4 such as a smartphone, and this digital content is the lyric booklet.

[0020] Each page P1, P2, etc. may include a page with lyrics for one song, a page with lyrics for multiple songs, a page with no lyrics but only artwork, or a page with track listings and credits.

[0021] Related content also comes in the form of a single lyric sheet. Fig. 3A shows image data (related content) in the form of a lyric sheet with lyrics and artwork for multiple songs printed in a vertically long area. Related content also comes in a variety of shapes, and Fig. 3B shows image data (related content) in the form of a nearly square lyric sheet with lyrics and artwork for multiple songs printed therein.

[0022] In addition, the lyrics booklet may be formed as two pages, like the front and back of a sheet of paper, in the form shown in Figures 3A and 3B, or may be formed as a lyrics booklet spanning more pages, in the form shown in Figures 3A and 3B.

[0023] The page shape of the lyric booklet, the position, style, font, and placement of the lyrics, the type of expression using artwork, photographs, illustrations, pictures, background colors, patterns, or combinations thereof, and the position and style of credits for composers, lyricists, arrangers, performers, producers, etc., can all be considered as expressions of the artist. Therefore, in this embodiment, when a user purchases music content, such as a music album, on terminal device 4, not only music is played but also the lyric booklet, etc. is displayed.

[0024] For example, Fig. 4 shows a state in which a lyrics booklet or the like is displayed on the terminal device 4 while music is being played. In the figure, various icons and guide information are also displayed as a user interface along with images of the lyrics booklet or the like. Individual functions will be described later.

[0025] In this embodiment, by displaying a lyrics booklet or the like in this way, the artist's expression through the lyrics booklet or the like that accompanies the music is delivered to the user. This allows the user to have an experience equivalent to that of looking at a paper lyrics booklet, for example, on a CD. Furthermore, by providing lyrics booklets or the like as digital content, the user can experience even more diverse ways of enjoying the content. For this reason, icons or the like are displayed as a user interface. This is to achieve good usability in terms of visual confirmation on the screen and to enable the provision of various functions that are possible with digital content.

[0026] 5 illustrates an example of the configuration of an information processing device 70 that can be used as the terminal device 4, the terminal device 3, the server device 1, or the database 2 in Fig. 1. The information processing device 70 can be configured as, for example, a dedicated workstation, a general-purpose personal computer, a mobile terminal device, or the like.

[0027] 5 executes various processes in accordance with programs stored in a nonvolatile memory unit 74, such as a read-only memory (ROM) 72 or an electrically erasable programmable read-only memory (EEP-ROM), or programs loaded from a storage unit 79 to a random access memory (RAM) 73. The RAM 73 also stores data necessary for the CPU 71 to execute various processes. The CPU 71 executes various control and calculation functions, which will be described later, using programs.

[0028] In addition, a processor other than the CPU 71 may be provided, such as a GPU (Graphics Processing Unit), a GPGPU (General-purpose computing on graphics processing units), or an AI (Artificial Intelligence) processor.

[0029] The CPU 71, ROM 72, RAM 73, and nonvolatile memory unit 74 are interconnected via a bus 83. The bus 83 is also connected to an input / output interface 75.

[0030] An input unit 76 consisting of operators and operation devices is connected to the input / output interface 75. For example, the input unit 76 may be various operators and operation devices such as a keyboard, a mouse, keys, a dial, a touch panel, a touch pad, a remote controller, etc. A user operation is detected by the input unit 76, and a signal corresponding to the input operation is interpreted by the CPU 71.

[0031] The input / output interface 75 is also connected, either integrally or separately, to a display unit 77 such as an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) panel, and an audio output unit 78 such as a speaker.

[0032] The display unit 77 performs various displays as a user interface. The display unit 77 is configured, for example, by a display device provided in the housing of the information processing device 70 or a separate display device connected to the information processing device 70. The display unit 77 displays various images on the display screen based on instructions from the CPU 71. The display unit 77 also displays various operation menus, icons, messages, etc., i.e., a GUI (Graphical User Interface), based on instructions from the CPU 71.

[0033] The input / output interface 75 may be connected to a storage unit 79 configured with an SSD (Solid State Drive) or an HDD (Hard Disk Drive), or a communication unit 80 configured with a modem, etc. The storage unit 79 can be used to store various data. A database can also be constructed in the storage unit 79. The communication unit 80 performs communication processing via the network 6.

[0034] A drive 82 is also connected to the input / output interface 75 as needed, and a removable recording medium 81 such as a flash memory, a memory card, a magnetic disk, an optical disk, or a magneto-optical disk is appropriately attached. The drive 82 allows data files such as image files and various computer programs to be read from the removable recording medium 81. The read data files are stored in the storage unit 79, and images and sounds contained in the data files are output on the display unit 77 and the audio output unit 78. In addition, the computer programs and the like read from the removable recording medium 81 are installed in the storage unit 79 as needed.

[0035] In this information processing device 70, software can be installed via network communication by the communication unit 80 or via a removable recording medium 81. Alternatively, the software may be stored in advance in the ROM 72, the storage unit 79, or the like.

[0036] Such an information processing device 70 can constitute the terminal device 4, the terminal device 3, the server device 1, or the database 2. The processing related to displaying related content in the terminal device 4, which will be described later, and the processing related to generating and editing related content in the terminal device 3 can be realized by the hardware configuration of the information processing device 70 in Fig. 5 and software installed therein.

[0037] <3. Related Content Creation and Editing> This section describes the creation and editing of related content performed by an artist using the terminal device 3. Fig. 6 shows an example of the processing performed by the terminal device 3 when creating and editing related content, and Figs. 7 to 13 show examples of display screens on the terminal device 3. Note that the term "artist" here refers to at least someone who creates a lyric booklet or the like.

[0038] When an artist generates and edits related content such as a lyric booklet, the artist simply launches an application program as an editing tool on the terminal device 3 and performs operations according to the instructions of the application program. First, the artist loads the actual music content and the lyric booklet into the editing tool.

[0039] 6 shows an example of processing by the CPU 71, which is the control unit of the information processing device 70 serving as the terminal device 3. This is an example of processing by the CPU 71 when the editing tool is activated. In step S101, the CPU 71 reads song content and a lyric booklet, etc., for the artist. For example, data of song content, a lyric booklet, etc. selected by the artist's operation is read as the processing target. The artist selects data of song content, data of a lyric booklet, etc. stored in the storage unit 79 on the editing tool and performs a read operation. If the lyric booklet, etc. is not prepared as image data, a paper lyric booklet, etc. may be scanned and read.

[0040] After reading the music content and lyrics booklet to be edited, the CPU 71 performs data analysis of the music content and lyrics booklet in step S102, and reflects the results on the editing screen in step S103.

[0041] 7 shows an example of the edit screen 20. The edit screen 20 displays the name of the currently displayed song and artist as a title 21, as well as an edit mode button 22 and a confirmation mode button 23. The edit mode button 22 is an operator for instructing the edit mode, and the confirmation mode button 23 is an operator for instructing the confirmation mode.

[0042] On the screen, three areas are provided: a designation box 25, an editing box 26, and a confirmation box 27.

[0043] 7, a text icon 30 is displayed in the specification box 25, indicating that it is a box for specifying an editing position from the lyrics side. In this case, the specification box 25 is provided with a text presentation area 31 and a corresponding text presentation area 32.

[0044] The text presentation area 31 displays text data obtained by performing voice recognition on the music content loaded by the CPU 71. The display in the text presentation area 31 can be scrolled using the scroll bar 31S. Although underlined in the lyrics text in the figure, some phrases are displayed in a different manner from the other portions to clearly indicate recommended editing. The recommended editing portions may be displayed as underlines as shown in the figure, or in a different color, font, or font size.

[0045] The corresponding text presentation area 32 displays an image of the loaded lyrics booklet or the like. However, here, the text in the image of the lyrics booklet or the like is displayed in a darker color to make it stand out. The CPU 71 determines the area where lyrics or other text is written by character recognition in the image of the lyrics booklet or the like, and displays that area in a darker color to make it stand out. On the other hand, image areas such as artwork are displayed in a lighter color to make them less noticeable. The display in the corresponding text presentation area 32 can be scrolled using the scroll bar 32S.

[0046] Furthermore, in the lyrics section of the corresponding text presentation area 32, the sections marked as recommended for editing in the text presentation area 31 are displayed in a different manner from the other sections. In the example shown in the figure, they are underlined, but a specific color may be overlaid. The corresponding text presentation area 32 displays the lyrics displayed in the lyrics booklet or the like as an image, without changing the font or size of the characters.

[0047] An image icon 35 is displayed in the edit box 26, indicating that it is a box for setting edit contents for the image portion. In this case, the edit box 26 is provided with an image presentation area 36 and an edit button area 37.

[0048] The image display area 36 displays an image of the loaded lyrics booklet or the like. However, in this case, the image portion of the lyrics booklet or the like, such as artwork, is displayed in a dark, eye-catching manner, while the text portion is displayed in a light, inconspicuous manner. The display in the image display area 36 can be scrolled using the scroll bar 36S.

[0049] Various edit buttons 38 are displayed in the edit button area 37. For example, various edit contents such as "fill background red," "fill background blue," "blinking black and white," "Japanese notation," and "change dialogue" are presented as each edit button 38 along with the part to be edited. The displayed edit buttons 38 can be scrolled using a scroll bar 37S.

[0050] The confirmation box 27 displays a song icon 34, indicating that it is an area where the editing contents can be confirmed while the song is being played. The confirmation box 27 displays a lyric booklet or the like as the editing results. The user can check the color changes made through editing and the state of the added image effects, animations, etc. as the song is being played. The progress bar 40 indicates the current position of the song being played back. The user can play and stop the song by operating the play / stop button 41. The playback position can also be changed by moving the pointer 40P of the progress bar 40 by dragging or other operations.

[0051] In this way, the editing screen 20 includes a specification box 25, an editing box 26, and a confirmation box 27. The artist uses the specification box 25 to specify the location to be edited, operates the editing box 26 to determine the edit content for that location, and can confirm the result in the confirmation box 27. The plus mark 28 is displayed to indicate that the edit in the editing box 26 will be added to the location specified in the specification box 25. The equal mark 29 indicates that the result is the content displayed in the confirmation box 27. The display mode of the plus mark 28 and equal mark 29 changes depending on the progress of the edit, thereby notifying the artist of the progress of the edit. For example, the plus mark 28 is white (light color) in FIGS. 7 and 8, but is black (dark color) in FIG. 9.

[0052] 7, the specification box 25 is used to specify an editing location within the lyrics text, and the edit box 26 is used to add an image effect, but the text and image can be swapped using the left / right conversion button 39. In other words, it is also possible to specify an arbitrary location within an image such as artwork using the specification box 25, and then use the edit box 26 to determine the editing content of the lyrics text.

[0053] The mode boundary line 24 also visually indicates whether each area is in edit mode or confirmation mode. The example in Figure 7 shows a state in which the designation box 25 and editing box 26 are positioned above the mode boundary line 24, and an artist is using the designation box 25 and editing box 26 to perform editing. In this case, the mode boundary line 24 distinguishes between the two by, for example, displaying the upper part brighter and the lower part darker, thereby indicating that the designation box 25 and editing box 26 are functioning in edit mode, and that the confirmation box 27 is functioning in confirmation mode. The position at which the mode boundary line 24 is drawn changes depending on the mode selection status, etc.

[0054] 6, the CPU 71 of the terminal device 3 performs the following process as data analysis in step S102. First, the CPU 71 performs voice recognition processing on the music content (lyrics text data generation processing) for text display in the text presentation area 31. The CPU 71 also performs processing to determine the character area and image area in the image of the loaded lyrics booklet or the like for display in the corresponding text presentation area 32 and image presentation area 36.

[0055] The CPU 71 also performs a process of setting recommended editing portions to be presented in the text presentation area 31. That is, it sets portions of music or lyric phrases for which editing such as image effects is recommended. For example, it uses AI processing based on learning effect settings for a large number of music content to find portions where flashing, animation, color changes, or other effects are effective, and sets those portions as recommended editing portions. The CPU 71 also performs a process of setting what editing content is appropriate for each recommended editing portion.

[0056] By performing these processes, it is possible to display the image of the music content and lyrics booklet, etc. that have been read in step S103, as shown in FIG.

[0057] 6, the CPU 71 monitors an operation to end editing, and also monitors various operations on the editing screen 20 in step S105. If an operation on the editing screen 20 is detected, the CPU 71 performs processing corresponding to the operation in step S106. Specifically, the CPU 71 controls updating the display state of the editing screen 20, setting edit data, playing music content, and the like in response to the operation.

[0058] The operations performed in steps S105 and S106 and the editing work for the lyrics booklet or the like realized by the corresponding processing will now be described in detail.

[0059] With the editing screen 20 displayed as shown in Fig. 7, the artist selects the part they wish to edit from the recommended editing portion (underlined portion) shown in the text presentation area 31 of the designation box 25. For example, Fig. 8 shows the state in which the artist is performing an operation to designate the phrase "I love you" in the recommended editing portion of the lyrics with the cursor CS.

[0060] When an operation to designate a recommended editing portion is detected, the CPU 71 updates the display accordingly, as shown in FIG. 9 . First, the recommended editing portion designated in the text presentation area 31 is displayed clearly in the corresponding text presentation area 32. That is, the "I love you" portion is also displayed clearly in the image of the lyric booklet, etc. For example, as shown in the figure, the selected portion is displayed in a target frame 43 in the text presentation area 31 and a target frame 44 in the corresponding text presentation area 32, and these are connected by a line 45. This allows the artist to easily confirm which portion of the image of the lyric booklet, etc., corresponds to the selected recommended editing portion. Note that the artist may also be able to designate the recommended editing portion from the corresponding text presentation area 32. In this case, the recommended editing portion designated in the corresponding text presentation area 32 is displayed clearly in the text presentation area 31, resulting in a display state as shown in FIG. 9 .

[0061] Then, edit buttons 38 corresponding to the selected recommended edit portion are displayed on the edit box 26 side. For example, of the multiple edit buttons 38, edit buttons 38 that are suitable for the selected recommended edit portion are displayed in an active state, and edit buttons 38 that are not suitable are displayed in an inactive state. This allows the artist to clearly see candidate effects (such as flashing in black and white) that are suitable for the recommended edit portion, while also clearly showing inactive effects that are not recommended for the recommended edit portion specified in the text presentation area 31, allowing the artist to consider effects to apply to the currently specified position while getting an overview of all the effects that can be applied to the entire song.

[0062] The artist selects the active edit button 38 with the cursor CS. Figure 9 shows the state in which the edit button 38 for the black and white inverted flashing for the image of the stylized "I love you" is selected. In response to this selection operation, the edit button 38 that was operated is highlighted as shown in Figure 10, and the corresponding image portion is displayed in a target frame 46, which are connected by a line 47. In other words, this indicates that the black and white inverted flashing has been set for the image portion displayed in the target frame 46.

[0063] As a result, editing becomes possible in the confirmation box 27, as shown in FIG. 11 . That is, the mode boundary line 24 is changed, and it is clearly indicated that the confirmation box 27 is functioning in edit mode. At this time, the confirmation box 27 displays an adjustment bar 42 along the progress bar 40. This adjustment bar 42 sets the period during which the image portion indicated by the target frame 46 will flash in reverse black and white during music playback. In the initial state, the section recommended by the CPU 71 is indicated by a start position 42S and an end position 42E, and the overall length of the adjustment bar 42 is indicated by a width that is slightly larger than the recommended section before and after that. In other words, the CPU 71 estimates an appropriate recommended position for the period during which the image portion indicated by the target frame 46 will flash in reverse black and white, as well as a position that allows the artist to arbitrarily adjust the position before and after that, and clearly displays these positions on the progress bar 40 and the adjustment bar 42.

[0064] When the user starts playback of a song using the play / stop button 41, the user can confirm in this confirmation box 27 that the corresponding image portion in the section indicated by the adjustment bar 42 will be flashing. The artist may also want to fine-tune the flashing display section in accordance with the progress of the song. In such cases, the artist can adjust the flashing display section by dragging the start position 42S or end position 42E or the like.

[0065] For example, as described above, the artist specifies the portion of the recommended editing section presented in the specification box 25 where he / she would like to perform some kind of editing or add some kind of effect, and determines the details of the editing or effect in the edit box 26. Furthermore, the artist can adjust the effect section within the song in the confirmation box 27 as necessary.

[0066] 12 shows the state in which the artist has operated the confirmation mode button 23 to set the entire display to confirmation mode. In this case, for example, the area below the mode boundary line 24 is displayed brightly, and the area above is displayed darkly. This indicates that the designation box 25, edit box 26, and confirmation box 27 function in confirmation mode.

[0067] When the confirmation mode is selected for the designation box 25, the parts that have been edited and set up so far are clearly indicated in the text presentation area 31 by a confirmation frame 48. While the example shown here is one in which the parts are clearly indicated by a confirmation frame 48, it is sufficient if the parts can be clearly indicated in some display format that distinguishes them from other parts. Similarly, the parts that have been edited and set up are also clearly indicated in the corresponding text presentation area 32. In the figure, these are underlined. This allows the artist to confirm the parts that have already been edited and set up.

[0068] Furthermore, detailed settings for each confirmation box 48 are displayed by selecting the confirmation box 48. For example, clicking on a confirmation box 48, which is the cursor CS, as shown in Fig. 12, displays detailed settings for that confirmation box 48, as shown in Fig. 13. First, the target box 44 corresponding to the confirmation box 48 is displayed, and by connecting it with a line 45, the target portion of the lyric booklet, etc., is clearly indicated.

[0069] In the edit box 26, the edit button 38 for the edit content set for this confirmation frame 48 is highlighted and is connected to the target frame 46 by a line 47. This clearly shows the part to be edited and the edit content, such as the image effect that has been set.

[0070] Furthermore, if the editing content displayed in this way is one for which a section is also set, such as a blinking display effect, an adjustment bar 42 is displayed in the confirmation box 27, indicating the section for which the effect is to be executed.

[0071] In this case, it would be desirable to be able to adjust the section at this point as well. Therefore, the mode boundary line 24 is changed so that the mode boundary line 24 passes through the center of the confirmation box 27, so that the confirmation box 27 is in both confirmation mode and edit mode. The user can also adjust the section to be edited by moving the start position 42S or end position 42E of the adjustment bar 42.

[0072] In steps S105 and S106 of FIG. 6, the CPU 71 of the terminal device 3 detects the operation as a user interface as described above and executes processing in response to the operation.

[0073] When the artist performs an operation to end editing, the CPU 71 proceeds from step S104 to step S107 to perform registration processing. That is, data such as the lyric booklet, including information on the edited content, is uploaded as related content to the server device 1. This enables the server device 1 to provide the user with the related content edited by the artist along with the music content.

[0074] The above example of the editing screen 20 is an example of display on a horizontally long screen of a PC or the like, but an editing screen 20 suitable for a vertically long screen of a smartphone or the like is also conceivable. In that case, too, it is sufficient to have a screen layout or the like that allows easy specification of the editing position, editing, confirmation, etc.

[0075] 4. Display of Related Contents [Display Example of Icons, etc. for User Interface] Hereinafter, a case will be described in which the user plays back music content on the terminal device 4 and also browses a lyric booklet, etc. of related content.

[0076] As shown in Fig. 4, the terminal device 4 displays images of the lyric booklet and the like, as well as icons and the like for various user interfaces. Fig. 14 shows only the icons and the like, excluding images of the lyric booklet and the like.

[0077] Icons and the like for the user interface include an album title 51, a page guide 52, a page forward icon 53, a page back icon 54, a display position guide 55, a full focus icon 56, a flip icon 57, a link icon 58, synchronization icons 59 and 61, a highlight icon 60, a track title 62 corresponding to the currently viewed page, a page number 63, sharing mode icons 64 and 65, and an audio control 66. Note that these are just examples, and it is not necessary for all of them to be displayed. Icons and the like other than these may also be displayed.

[0078] The album title 51 displays the title of the music album as the music content being played. It should be noted that the display is not limited to the album title, and the name of a single song may be displayed when playing that song, or both the album title and the title of the song being played may be displayed. Furthermore, the artist name may also be displayed. Thumbnail images of the music album or artist may also be displayed.

[0079] The page guide 52 is a display that indicates the currently displayed page within the entire lyric booklet or the like as related content. This page guide 52 indicates to the user which page is currently displayed, assuming a lyric booklet consisting of multiple pages or a lyric card consisting of two pages, one on the front and one on the back of the paper. The page guide 52 will be described in more detail later.

[0080] The page forward icon 53 is an operator for moving forward the page that the user is currently viewing, and the page back icon 54 is an operator for moving back the page that the user is currently viewing.

[0081] The display position guide 55 indicates the displayed position within one page of related content (such as a lyric booklet). For example, when the entire page is not displayed on the screen of a terminal device 4 such as a smartphone, the display position guide 55 indicates the entire page and the display range. Figure 14 shows an example in which the hatched area (area 55a) on a vertically long page is currently displayed.

[0082] The title of the song whose lyrics are currently displayed is displayed as the track title 62. Note that the song information may include not only the song title but also the lyricist, composer, arranger, etc. Note that the title of the song being played may be displayed separately.

[0083] The page number of the lyric booklet or the like being viewed is displayed as page number 63. For example, in fractional notation, the sixth page out of the total number of pages (for example, 10 pages) is displayed as "6 / 10."

[0084] The full-page focus icon 56 is an operator for focusing on full-page display, i.e., the default size that makes the pages of the lyric booklet etc. most easily viewable. The flip icon 57 is an operator for turning the lyric sheet over. The flip function allows additional hidden elements to be provided on a given page using a display method such as a pop-up. Such hidden elements are displayed by operating the flip icon 57. The link icon 58 is a link button to an external website.

[0085] Synchronization icons 59 and 61 are operators for synchronizing the playback position of a song with the currently viewed page of a lyrics booklet, etc. Synchronization icon 59 is an operator for changing the playback position of a song to match the currently viewed position of a lyrics booklet, etc., and synchronization icon 61 is an operator for changing the currently viewed position of a lyrics booklet, etc. to match the playback position of a song.

[0086] The highlight icon 60 is an operator for a highlight mode for displaying a lyric booklet, etc. The share mode icons 64 and 65 are operators for a share mode with other users or artists.

[0087] Various controls related to the playback of music content are provided as audio controls 66. For example, a play / stop button, a button for skipping forward through the playback music, a previous button, a favorite button, a progress bar, and the like are displayed.

[0088] Various functions provided to the user on the screen of such terminal device 4 will be described below.

[0089] [Content Focus Mode] The content focus mode is a mode in which the user interface is cleared and the lyrics booklet or the like is displayed in the foreground so that the user can concentrate on viewing the lyrics booklet or the like.

[0090] For example, Fig. 15A shows a display state in normal display mode. Various icons for the user interfaces described in Fig. 14 are displayed alongside an image of a lyric booklet or the like. In this case, when the user performs a predetermined operation, such as a tap operation TP, at any position on the screen (a position where no icons or the like are displayed), or when a predetermined time elapses without the user performing any operation, the CPU 71, which is the control unit of the terminal device 4, erases the icons and displays only the lyric booklet or the like (display in content concentration mode), as shown in Fig. 15B.

[0091] In this way, the user can view the lyric booklet etc. in the same state as if it were a paper version. When the user performs a predetermined operation such as a tap operation on the screen of Fig. 15B, the CPU 71 controls the display to return to the normal display mode of Fig. 15A.

[0092] [Full-screen focus] The CPU 71 of the terminal device 4 performs full-screen focus control when the user operates the full-screen focus icon 56. For example, while the display is in the state shown in Fig. 15A or 15B , the user can zoom in or out on the screen to reduce or enlarge an image of a lyric booklet or the like.

[0093] When operating the screen arbitrarily in this way, the user may lose track of the zoom level at which the page of the lyrics booklet or the like is currently being viewed. Therefore, a full-screen focus icon 56 is provided, and when the user operates it, the CPU 71 controls the page of the lyrics booklet or the like to return to a focused default size that is most easily viewable. In other words, the image size is returned to the size initially displayed on that page.

[0094] For this reason, the full focus icon 56 may be displayed at all times, but it is preferable to display it only when the screen display is no longer at the default size due to a pinch operation or the like by the user.

[0095] The full focus icon 56 is an operator that returns the image from the enlarged / reduced state to the default size as described above, but it may also be configured to simultaneously control the display position. For example, the user can move the display area by dragging or flicking on the screen, but operating the full focus icon 56 may return the current page to its initial display position. Alternatively, a separate icon may be provided for such an operation.

[0096] [Display Position Guide for Lyric Booklet, etc.] The display position guide 55 indicates the displayed position within one page of the lyrics booklet, etc.

[0097] For example, Figure 16A shows the entire page 100 of a certain page, such as a lyrics booklet. Here, a vertically long page created to fit a smartphone is assumed. The range of the thick diagonally shaded frame is the display range 101 that is actually displayed on the screen. This state is presented to the user by the display position guide 55. For the sake of explanation, this type of vertically long page shape that is suited to a smartphone will be referred to as the standard type.

[0098] Figure 16B shows a display screen of the terminal device 4 similar to that of Figure 15A, except that only the display position guide 55 is shown. In the case of Figure 16A, the entire display position guide 55 corresponds to the entire page area 100, as shown in Figure 16B, within which the current display range 101 is clearly indicated by the shaded area 55a. In practice, the area 55a may be clearly indicated by a specific color or the like.

[0099] Figure 17A shows a case where the page shape is not vertically long to suit smartphones. For example, this is the case when the entire page area 100 is close to a square. Assume that the display range 101 is in the upper left part of the page relative to the entire page area 100, as shown in the figure. In this case, the display position guide 55 is shaped to represent the entire page area 100, as shown in Figure 17B, and within that, an area 55a representing the display range 101 is clearly displayed, as shown by the hatched area.

[0100] For the sake of explanation, page shapes other than the standard type will be referred to as "custom shape types." Custom shape types are shapes that artists set when creating or editing a lyric booklet, for example.

[0101] 16B and 17B , the position of area 55a changes within display position guide 55 in response to a change in the display range caused by a scroll operation or a drag operation by the user. Also, the size of area 55a within display position guide 55 changes in response to zooming in or out caused by a pinch operation by the user.

[0102] By displaying the display position guide 55 in this way, the user can easily recognize the page shape and the current display range within a page, even when there are lyric booklets and other items with various page shapes. This is a useful guide when viewing on a screen with limited space, such as a smartphone.

[0103] The display position guide 55 may be used as an operator for moving the display range. For example, in Fig. 16B, by moving the area 55a up or down, the display range of the lyric booklet, etc. on the screen is scrolled up or down. In Fig. 17B, by moving the position of the area 55a in any direction, the display range of the lyric booklet, etc. on the screen is moved in that direction.

[0104] The display position guide 55 may be displayed at all times, or may be displayed in response to some operation. For example, if the lyric booklet or the like is a standard type as shown in FIG. 16A , the display position guide 55 is displayed in response to an up / down scrolling operation, and the area 55 a moves. The display position guide 55 is hidden when no scrolling is performed. Furthermore, if the lyric booklet or the like is an arbitrary shape type as shown in FIG. 17A , the display position guide 55 is displayed in response to a scrolling operation in all directions or a zoom-in / zoom-out operation, and the area 55 a moves or zooms in or out in response to the scrolling operation or the zoom-in / zoom-out operation. The display position guide 55 is hidden when no scrolling operation or zoom-in / zoom-out operation is performed.

[0105] The display position guide 55 is expected to occupy a relatively larger area than other icons, so by displaying it only during operation as described above, it can be prevented from interfering with the display of the lyric booklet, etc.

[0106] [Automatic Determination of Default Position in Display Position Guide] A function will be described in which the CPU 71 of the terminal device 4 automatically determines the range to be initially displayed when the page shape of a lyric booklet or the like is of an arbitrary shape. That is, the CPU 71 determines, for each page, the default position that makes it easiest to view the lyrics when the page of a lyric booklet or the like is first displayed.

[0107] For example, the CPU 71 determines how lyrics are displayed on each page of a lyrics booklet or the like, and sets the default position. If lyrics are displayed in N columns on one page, the CPU 71 determines the number of columns in the lyrics section and sets the default position based on the size that matches the width of the column closest to the top left. Figures 18A and 18B each show examples in which lyrics are displayed in multiple columns across the entire page 100. The default position 102 can be set by matching the width of the column closest to the top left.

[0108] However, lyrics are written in a variety of ways, and are not necessarily written in an orderly column. There are also cases where characters are written diagonally. In such cases, for example: - Set a screen size that can fit one block of lyrics. - If the smallest character is smaller than the specified font size when the screen size is set to fit one block of lyrics, set the screen size to match that specified font size. Then, based on the screen size set in this way, set the default position on the page.

[0109] It should be noted that the artist may be able to specify the default position at which the image is initially displayed on the page during the editing stage.

[0110] [Text Position Display] The display position guide 55 clearly indicates the position on the current page where the lyrics (text) are displayed.

[0111] Examples are shown in Figures 19A and 19B. Within the display position guide 55, a text position marker 55b is displayed as indicated by "..." in the figure. This text position marker 55b indicates the location where the text is actually written on the page. The display mode of the text position marker 55b may be any display mode as long as it allows the position of the text to be identified.

[0112] When the CPU 71 reads the lyrics booklet or the like to be displayed, it analyzes the image of each page and determines the text display position, thereby making it possible to display a text position marker 55b as shown in Figures 19A and 19B for each page to be displayed.

[0113] By displaying such a text position marker 55b within the display position guide 55, the user can easily recognize where to scroll when he or she wants to read the lyrics.

[0114] [Page Navigation of Lyric Booklet, etc.] To allow the user to easily identify the page of the lyrics booklet, etc. being displayed, a page guide 52 is displayed as shown in FIG.

[0115] An example of the page guide 52 is shown enlarged in Figure 20. In this example, the page guide 52 represents each page of a lyrics booklet or the like with circular marks 90, 91, 92, 93, and 94, and the nature of the page is indicated by the different display modes of the circles. Just one example is shown below.

[0116] First, the size of the circle indicates whether the page contains lyrics or not. For example, a small circular mark 91 indicates a page without lyrics. Large circular marks 90, 92, 93, and 94 indicate pages with lyrics.

[0117] The nature of the lyric pages is expressed as follows: Mark 90 indicates a lyric page other than the currently displayed page. Mark 92 indicates the currently displayed lyric page. Mark 93 indicates a lyric page that contains the lyrics of the song currently being played. Mark 94 indicates a lyric page that contains the lyrics of multiple songs. Note that if the lyrics currently being displayed are the lyrics of the song currently being played, it is possible to use a mark that is a combination of marks 92 and 93.

[0118] In the drawings, each mark is shown as a black circle, a white circle, a dashed circle, a ring, etc., but this is for the purpose of distinction in explanation. For example, each mark may be expressed by differences in color, brightness, shading, highlighting method, blinking / illuminating, etc.

[0119] When a user is viewing a lyric booklet while playing a song, they are not necessarily looking at only the lyrics of the song being played. The user can scroll through the page or move to another page as they wish. This can lead to the following cases:

[0120] - I want to move to the lyrics page for the song I'm playing when I'm away from that page. - I want to view a page with only artwork. - I want to know how many songs have lyrics on which page. - I want to know which page I'm currently viewing is out of the total. - I want to know what pages are before and after the page I'm currently viewing. - I want to know whether the page I want to go to is before or after the current page.

[0121] In the above case, for example, the page guide 52, which allows the user to distinguish between the pages, is a very convenient function for the user. It also serves as a guide when the user is unsure whether to operate the page forward icon 53 or the page back icon 54.

[0122] The marks 90, 91, 92, 93, and 94 may be used as controls for directly transitioning to the corresponding page. Various examples of page characteristics may also be considered. For example, text pages may be displayed regardless of whether they contain lyrics. Furthermore, a display that distinguishes between text pages, artwork pages, and pages containing both text and artists may be used. Furthermore, a display that distinguishes between lyrics pages, track listing pages, credit pages, and currently displayed pages without lyrics may be used.

[0123] The mark 92 indicating the currently displayed page may be applied regardless of whether lyrics are posted or not. Also, the mark 94 indicating the lyrics posting page that posts lyrics for multiple songs may display a number indicating the number of songs posted.

[0124] The page guide 52 may be displayed at all times, or may be displayed by some operation. For example, the display of the page guide 52 may be turned off when the page containing the lyrics of the song being played is displayed, and the page guide 52 may be displayed when the page transitions to a page other than the page containing the lyrics of the song being played.

[0125] [Navigation of the displayed page number] The page number 63 indicates the currently displayed page among all pages. However, there are cases where the page number is indicated in the lyrics booklet or the like, in which case there is less need to display the page number 63. Therefore, when the page number is not indicated on the display of the lyrics booklet or the like, the page number 63 is displayed. This allows the user to easily check the current page number.

[0126] The presence or absence of a page number in a lyrics booklet or the like can be thought of as the presence or absence of a page number within the currently displayed range. For example, even if the current page in a lyrics booklet or the like has a page number, if the page number does not appear within the currently displayed range of that page, the page number 63 is displayed. In this way, the user can always confirm which page they are currently viewing by either the page number 63 or the notation in the lyrics booklet itself.

[0127] [Synchronization Function] Users may want to see lyrics and then listen to the music with those lyrics, or they may want to see the lyrics of a song while listening to it. To address this, a synchronization function is provided, and synchronization icons 59 and 61 are displayed.

[0128] By operating the synchronization icon 59, the CPU 71 performs control to change the playback position of the music to match the currently viewed position in the lyrics booklet, etc. For example, the CPU 71 plays the music of the lyrics published on the currently displayed page.

[0129] In this case, the following control examples of the CPU 71 are possible. - If the lyrics of a song are posted on the currently displayed page, the song is played from the beginning in response to operation of the synchronization icon 59. - If the lyrics of a song are posted on the currently displayed page and part of the lyrics are displayed, the song is played from the position of the displayed lyrics in response to operation of the synchronization icon 59. - If the lyrics of a song are posted on the currently displayed page but the lyrics are not displayed, the song is played from the beginning in response to operation of the synchronization icon 59.

[0130] - If the currently displayed page contains lyrics for multiple songs, the first song in the order in which the lyrics are posted on that page will be played from the beginning in response to operation of the synchronization icon 59. - If the currently displayed page contains lyrics for multiple songs, the song whose lyrics are currently being displayed will be played from the beginning in response to operation of the synchronization icon 59. - If the currently displayed page contains lyrics for multiple songs and the lyrics of multiple songs are also displayed, select one song based on its upper position on the display or its displayed size, and the selected song will be played from the beginning of the song or the beginning of the displayed range.

[0131] When a certain portion (phrase) on the lyrics display is designated by touch operation or the like and then the synchronization icon 59 is operated, the corresponding music is played from the position of the designated phrase. A certain portion on the lyrics display may be identified by detecting the user's line of sight, and the music may be played from the position corresponding to the identified portion in response to the operation of the synchronization icon 59.

[0132] The above are examples of control, but there are various possible processing methods for controlling the playback position of a song in synchronization with the displayed lyrics. Also, the control content may vary depending on the operation mode, such as by tapping the synchronization icon 59 once to play the song in synchronization with the current position (phrase), or by long tapping (pressing and holding) to play the song from the beginning of the song corresponding to the currently displayed page.

[0133] Furthermore, playback of the music from that position may be executed by tapping the displayed lyrics portion instead of operating the synchronization icon 59. In this case, a single tap on the lyrics portion may cause the music to be played in synchronization with that position (phrase), and a long tap may cause the music to be played from the beginning.

[0134] It is preferable that the synchronization icon 59 is displayed when a page with lyrics is displayed, but not displayed on a page without lyrics, because on a page without lyrics, there are no songs to synchronize because lyrics are not displayed.

[0135] Next, in response to the operation of the other synchronization icon 61, the CPU 71 performs processing to synchronize the lyrics display with the music being played. In this case, the following control example of the CPU 71 is conceivable.

[0136] ・Display the beginning of the lyrics page for the song currently being played. ・Display the beginning of the lyrics on the lyrics page for the song currently being played. ・Display the lyrics corresponding to the phrase currently being played on the lyrics page for the song currently being played.

[0137] These controls may be switched depending on the operation mode. For example, a single tap on the synchronization icon 61 causes lyrics to be displayed in synchronization with the current playback position (phrase). A long tap on the synchronization icon 61 causes lyrics to be displayed from the beginning of the song being played.

[0138] [Turning Lyric Highlight Function On / Off] The CPU 71 switches the highlight function on / off in response to an operation on the highlight icon 60 .

[0139] The highlight function here refers to lyric text and animation. Lyric text highlighting is a function that highlights the lyric text corresponding to the playback part of a song, for example, in time with the playback of the song. Animation is, for example, a function that causes artwork to blink or move in time with a certain phrase, based on the artist's performance settings as described in Figure 10.

[0140] For example, the CPU 71 sets the highlight icon 60 as a button that toggles between the following three levels of highlight display: Display all highlights (lyric text + animation) Highlight only the lyric text Do not display highlights

[0141] In this way, the highlight display can be switched on or off according to the user's wishes. Some users may find the highlight display annoying, so this on / off function is useful. Note that the highlight mode may also include a mode in which only animation is displayed.

[0142] [Display of Music Information According to Page Format] For example, the music information display includes the track title 62. This track title 62 is displayed appropriately.

[0143] In a lyrics booklet or the like, there are pages corresponding to one song and pages corresponding to multiple songs. When a user is viewing a lyrics booklet or the like, it is desirable for the title of the song whose lyrics they are currently paying attention to to be displayed as the track title 62. Therefore, the track title 62 is displayed as follows:

[0144] When the currently displayed page contains the lyrics of one song, the CPU 71 displays the title of that song as the track title 62. When the currently displayed page contains the lyrics of multiple songs, the CPU 71 displays the title of the song that corresponds to the upper left part of the displayed range as the track title 62.

[0145] 21A and 21B show an example of a standard page format in which lyrics for multiple songs are printed on one page. A display range 101 is indicated by a dashed line within the entire page area 100. The numbers indicate track numbers.

[0146] If the display range 101 in Figure 21A is displayed at a certain point in time, the upper left portion will be the lyrics of the first song. Therefore, the title of the first song will be displayed as the track title 62. If the display range 101 is moved as shown in Figure 21B, the upper left portion will be the lyrics of the third song. Therefore, the title of the third song will be displayed as the track title 62.

[0147] 22 shows an arbitrary page format, with lyrics for nine songs printed within the entire page area 100. If the display range 101 is displayed at a certain point in time, the upper left portion will be the lyrics for the seventh song. Therefore, the title of the seventh song will be displayed as the track title 62.

[0148] By this control, the title of the song whose lyrics the user is paying attention to is displayed as the track title 62. Note that similar control can be used to display not only the song title but also song information such as the lyricist, composer, arranger, and participating musicians.

[0149] [Playback Gimmick] Prepare a playback gimmick that can deliver a digital experience to the user. For example, under certain conditions, items, content, links, etc. that are not normally displayed are displayed.

[0150] Examples of conditions are: - Playing a song n times (for example, 100 times). - Tapping a specified lyric text section or image position during a phrase in the song being played. - Tapping a specified lyric text section or image position n times. - Opening related content when it is determined that the user is in a specific location based on location information (for example, a live venue or a place associated with the content). - Being simultaneously within a specified distance range with n other users who have the same related content.

[0151] Examples of what can be done when the conditions are met include: - Displaying a limited link button. - Transitioning to limited content. - Making hidden pages in the lyric booklet, etc., viewable. - Changing the expression or wording in the lyric booklet, etc. - Granting a digital item.

[0152] By providing such playback gimmicks, it is possible to give users new experiences. For example, a user can play a favorite song multiple times, which will cause exclusive content to be displayed. Also, at a live concert venue, if there are a certain number of users who own the same song content or related content, an exclusive link button can be displayed.

[0153] Other examples of the conditions include: - It is determined that the popularity of the music content has increased (for example, the number of downloads or plays reaches a predetermined number or more), - A following user plays the music content.

[0154] If these conditions are met, a notification is made on the terminal device 4. For example, a notification of the number of downloads or a notification such as "X-san is playing **" may be made.

[0155] Furthermore, a mechanism may be provided that allows the limited content to be shared on a social networking service (SNS). For example, a share button may be displayed when certain conditions are met, and the content may be uploaded to the SNS in response to a button operation.

[0156] [Function for Sharing Playback Status, etc.] The sharing mode icons 64 and 65 allow playback status, etc. to be shared between users or between a user and an artist.

[0157] In response to the operation of the sharing mode icon 64, the CPU 71 sets the mode of the sharing function between users. Examples of the sharing function mode include a preference sharing mode, a current status sharing mode, and a comment sharing mode. For example, by operating the sharing mode icon 64, it is possible to switch between no sharing, preference sharing mode, current status sharing mode, and comment sharing mode in a toggle manner. Note that the switching between the preference sharing mode, current status sharing mode, and comment sharing mode is also indicated by changes in the sharing mode icon 64 as shown in FIGS. 23, 24, and 25.

[0158] The preference sharing mode will be described with reference to FIG. 23. When the preference sharing mode is selected, one or more other user icons 120 are displayed in a row near the sharing mode icon 64. These icons represent other users with whom preference information is shared. In the example shown in the figure, three other users are shown. For example, these include other users who are mutually followed by the user, and other users with whom sharing settings have been made.

[0159] In this preference sharing mode, other users' favorite phrases are presented in the page display of the lyrics booklet, etc. In the figure, the favorite phrases of each person represented by the other user icon 120 are presented as the favorite phrase presentation 121. For example, each user's favorite phrases are determined based on their history of playing the song multiple times, and this determination information is shared, thereby executing this display control. Alternatively, each user can set their own favorite phrases.

[0160] The current status sharing mode will be described with reference to Fig. 24. When the current status sharing mode is selected, one or more other user icons 120 are displayed. In this case, the currently active logged-in user among the other users who have been set up for sharing is the target.

[0161] In the current status sharing mode, the portion of the music content currently being listened to by other users is presented. For example, in this example, the user and two other users are listening to the same music album, with one other user listening to the music whose lyrics are displayed in FIG. 24 and the other other user listening to a different music piece. The portion being listened to by one other user is indicated by a listening phrase presentation 122 in the displayed lyrics text.

[0162] The page guide 52 also shows the part of the music album that other users are listening to by displaying the other user icon 120. In this case, the other user icon 120 is displayed on the page that contains the lyrics of the music that the user is listening to, thereby showing the part of the music album that the user is listening to.

[0163] The comment sharing mode will be described with reference to FIG. 25 . In the comment sharing mode, one or more other user icons 120 that have been set as shared are also displayed. In this comment sharing mode, comments 123 from other users are displayed. A comment target indication 124 indicates the comment target for the other user icon 120. For example, an artwork portion or a phrase in the lyrics text is displayed. The comment 123 is then displayed near the comment target together with the other user icon 120.

[0164] The above has described sharing between users using the share mode icon 64, but similar sharing between artists can also be achieved by operating the share mode icon 65. For example, by operating the share mode icon 65, it is possible to toggle between no sharing, preference sharing mode, current status sharing mode, and comment sharing mode. Note that in this case as well, the switching between preference sharing mode, current status sharing mode, and comment sharing mode is indicated by changes in the share mode icon 65 as shown in Figures 23, 24, and 25.

[0165] In the preference sharing mode, the artist's favorite parts of the song are displayed. In the current status sharing mode, the parts of the song that the artist is listening to are presented. In the comment sharing mode, comments uploaded by the artist of the song are displayed. In other words, by logging in to a viewing service such as this lyric booklet, the artist can post explanations and comments about their own songs and lyrics, present their favorite parts, and let general users know about them. In addition to the artist of the song, it is also possible to display artists that other users are following at their discretion, allowing users to see how their favorite artists are enjoying each other's songs.

[0166] [Processing Example] Up to this point, we have explained various functions for viewing a lyric booklet or the like provided by the terminal device 4, and now we will explain processing examples of the terminal device 4 that realize these functions. Below is an example of processing that the CPU 71, which is the control unit of the terminal device 4, executes through an application program or a website that provides a service.

[0167] 26 shows an example of processing related to display during playback of music content. When an operation to start playback of music content is performed, the CPU 71 proceeds from step S201 to step S202 and acquires music data and lyric data. Music data is audio data for each song in the content as a music album. Lyric data includes image data such as a lyric booklet and associated performance data.

[0168] If the user has already purchased the music data and lyric data for these musical piece contents from the server device 1 and stored them in a storage medium of the terminal device 4, the CPU 71 can read the target data from the storage medium (e.g., the storage unit 79). Alternatively, the music data and lyric data may be sequentially obtained from the server device 1 during playback.

[0169] In step S203, the CPU 71 performs display setting processing for displaying a lyrics booklet, etc., for the music content currently being played back. An example of this display setting processing is shown in FIG.

[0170] In step S221, the CPU 71 sets the page guide. The CPU 71 analyzes the images of each page of the lyrics booklet or the like acquired as lyrics data to determine the number of pages, the type of each page, etc. The type refers to whether the page contains lyrics or does not contain lyrics. That is, the CPU 71 determines these to enable the initial display of the page guide 52.

[0171] In step S222, the CPU 71 sets a default display position. As explained above in "Automatic Determination of Default Position in Display Position Guide," this is a process in which the CPU 71 automatically determines the range to be initially displayed when the page shape of a lyric booklet or the like is of an arbitrary shape. The CPU 71 analyzes the image of each page of the lyric booklet or the like acquired as lyric data, and determines for each page the default position that makes it easiest to see the lyrics when the page of the lyric booklet or the like is first displayed.

[0172] In step S223, the CPU 71 performs page notation determination and page display setting. This is preparatory processing for displaying the page number 63. The CPU 71 analyzes the image of each page of the lyrics booklet or the like acquired as lyrics data and determines whether or not a page notation is present on each page. For example, the CPU 71 checks whether or not there are numbers within a predetermined distance from the four corners of the image on the page, whether or not there are fractions such as "X / X," and whether or not the numbers correspond to the page order, and determines the page notation for each page. The CPU 71 also checks the position of the page notation on the page.

[0173] The CPU 71 then sets the page number 63 on the screen to be always displayed for pages that do not have a page designation. For pages that do have a page designation, the CPU 71 stores the page designation position and sets the page number 63 to be displayed on or off depending on the display range when the page is displayed. That is, when the page designation position is included in the display range, the display of the page number 63 is set to be off, and when the page designation position is not included in the display range, the display of the page number 63 is set to be on.

[0174] In step S224, the CPU 71 determines the text display position on each page. This is preparatory processing for displaying the text position within the display position guide 55, as shown in Figure 19. The CPU 71 analyzes the image of each page of the lyrics booklet or the like acquired as lyrics data, determines the text display area on each page, and stores the determined area.

[0175] Note that the processing of each step in the processing example of Figure 27 is based on the image analysis results of the page, and therefore the processing order may be any order. The figure is merely an example. Furthermore, the CPU 71 does not need to perform the analysis processes of steps S221, S222, S223, etc. every time playback is performed. For example, image analysis of each page of a lyric booklet or the like may be performed in advance, and the analyzed data may be stored in a database. The analyzed data may then be acquired in step S202, and the initial display settings, default display position settings, and page display settings for the page guide 52 may be performed based on the analyzed data.

[0176] After performing the above-described processing in step S203 of Fig. 26, the CPU 71 proceeds to step S204, where it controls the start of playback of the music content and the start of display of the lyrics booklet, etc. At this point, for example, as shown in Fig. 15A, icons for the user interface are displayed together with the lyrics booklet, etc. The page guide 52 and display position guide 55 are displayed according to the current lyrics booklet, etc., and the page number 63 is displayed according to the display settings.

[0177] After starting playback and display, the CPU 71 monitors the end of playback in step S205, and controls display update in step S206. During playback, the CPU 71 performs operations such as skipping songs, controlling the volume, fast-forwarding and rewinding, and updating the display of the progress bar showing the playback position in response to operations on the audio control 66, but a description of these processes related to music playback is omitted here.

[0178] An example of the display update control performed in step S206 is shown in Figures 28 and 29. Note that "c1" in Figures 28 and 29 indicates that the flowcharts in each figure are continuous. Note that Figures 28 and 29 do not show all the processes related to display update, but particularly show the processes related to the display function of the lyric booklet, etc., of this embodiment. In reality, other processes may also be performed.

[0179] In the display update control, the CPU 71 performs monitoring processes from step S231 in FIG. 28 to step S241 in FIG. 29. In step S231, the CPU 71 monitors an operation in the content concentration mode. For example, this is a tap operation by the user at any position on the screen. If this operation is detected, the CPU 71 proceeds to step S251 and changes the display setting. That is, if the normal display mode setting was used up until then, the display setting is changed to the content concentration mode. If the content concentration mode setting was used up until then, the display setting is changed to the normal display setting. Then, in step S252, the CPU 71 starts displaying according to the changed mode setting. This switches the display state as shown in FIGS. 15A and 15B.

[0180] In step S232, the CPU 71 determines whether a full-screen focus operation has been performed. This is to monitor the operation of the full-screen focus icon 56. For example, in step S232, the CPU 71 displays the full-screen focus icon 56 in response to an image of a lyric booklet or the like being enlarged or reduced by a pinch operation or the like, and monitors whether the full-screen focus icon 56 has been operated.

[0181] When it is detected that the full focus icon 56 has been operated, the CPU 71 proceeds to step S255 and changes to a full focus state. That is, the CPU 71 controls the image of the lyric booklet or the like to return to a state in which the image is focused to the default size. In addition, the CPU 71 erases the full focus icon 56 in response to the return to the default size.

[0182] In step S234, the CPU 71 monitors a screen change operation. If a screen change operation is detected, the CPU 71 proceeds from step S234 to step S261, where it controls the screen change in accordance with the operation. If necessary, the CPU 71 controls a change in the guide display in step S262.

[0183] The screen movement operation here refers to a user operation that changes the display range of the screen, including, for example, a scroll operation, a pinch operation, an operation of the page forward icon 53, an operation of the page back icon 54, a scroll operation or a drag operation when the area 55a of the display position guide 55 is used as an operator, and a page transition operation when the page guide 52 is used as an operator.

[0184] In response to these operations, the CPU 71 controls, in step S261, changing the display position on the screen within the page, zooming in / out, and transitioning to another page. In step S262, the CPU 71 also controls changes to the guide display, such as moving or zooming in / out the area 55a of the display position guide 55 in response to the change in the display position on the screen within the page, changing the display of the page guide 52 in the case of a page transition (for example, changing the position of the mark 92 indicating the currently displayed lyric page), changing the track title 62 in response to a change in the displayed portion of the lyrics, and changing the page number 63 in response to a page transition.

[0185] In step S235, the CPU 71 monitors a synchronization operation. If a synchronization operation, i.e., an operation of the synchronization icon 59 or the synchronization icon 61, is detected, the CPU 71 proceeds from step S235 to step S265 and performs synchronization processing in accordance with the operation. That is, in accordance with the operation of the synchronization icon 59, the playback position is controlled so as to synchronize the music playback position with the lyric text. Furthermore, if the synchronization icon 61 is operated, control is performed to change the display position or the displayed page so as to synchronize the lyric display with the playback position.

[0186] Furthermore, if necessary in conjunction with a change in the playback position or a change in the display position, the CPU 71 controls changes to the guide display in step S266, such as moving the area 55a of the display position guide 55 in response to a change in the display position on the screen within a page, changing the display state of the page guide 52 or the page number 63 in the case of a page transition, or changing the track title 62.

[0187] In step S236, the CPU 71 monitors the highlight setting operation using the highlight icon 60. If operation of the highlight icon 60 is detected, the CPU 71 proceeds from step S236 to step S271, and changes the highlight setting in accordance with the operation. For example, if the highlight function is currently on, it is turned off, and if it is off, it is turned on. Alternatively, if the highlight function can be switched between three modes, "display all highlights," "highlight only lyric text," and "display highlights," as described above, the highlight setting is changed in a toggle manner in accordance with operation of the highlight icon 60. Then, in step S272, the CPU 71 starts displaying in accordance with the change in the highlight setting.

[0188] In step S237 of FIG. 29, the CPU 71 monitors a change in the song being played. If a change in the song being played is detected, the CPU 71 proceeds from step S237 to step S275, where it controls a change in the display position of the lyric booklet, etc. For example, when playback of the second song in a music album ends and playback of the third song begins, the lyric booklet, etc., is transitioned to a page containing the lyrics of the third song. Alternatively, the display position within the page is moved so that the lyrics of the third song are displayed. The CPU 71 also controls a change in the guide display in step S276. For example, the CPU 71 controls the movement of the area 55a of the display position guide 55 in response to a change in the display position on the screen within the page, the change in the display state of the page guide 52 and the page number 63 when a page transition occurs, the change in the track title 62, etc.

[0189] It should be noted that such a change in the display position of the booklet or the like synchronized with the song being played may not be performed. For example, even if the song being played changes, the user may be viewing a page of a different song in the lyrics booklet. Also, even if the same song is being played and pages are being displayed, the user may not necessarily want the pages to automatically transition in sync, but may still want to be able to change pages at their own pace. For this reason, if the user wishes to provide the same usability as when turning the pages of a paper lyrics booklet or the like on a physical CD, it is advisable not to perform the processes of steps S237, S275, and S276.

[0190] In step S238, the CPU 71 monitors a designation operation for the lyrics portion. For example, this may be a tap operation on the lyrics text portion in a displayed lyrics booklet, etc. If such a designation operation for the lyrics is detected, the CPU 71 proceeds from step S238 to step S281, and controls the playback position of the music content so as to synchronize the music playback position with the lyrics text.

[0191] In step S239, the CPU 71 determines whether the conditions for the playback gimmick are satisfied. For example, the CPU 71 determines whether the conditions for the playback gimmick are satisfied by determining the user's operation, the number of plays, location information, the user's listening status, etc. If the CPU 71 detects that the conditions for the playback gimmick are satisfied, the CPU 71 proceeds from step S239 to step S285 and performs appropriate processing according to the satisfied conditions. For example, the CPU 71 controls the display of the limited link button or the hidden page described above.

[0192] In step S240, the CPU 71 monitors a sharing mode operation. If a sharing mode operation, i.e., an operation of the sharing mode icon 64 or the sharing mode icon 65, is detected, the CPU 71 proceeds from step S240 to step S291 and performs processing to change the sharing mode. For example, the CPU 71 switches between the above-mentioned no sharing, preference sharing mode, current status sharing mode, and comment sharing mode. Then, in step S292, the CPU 71 starts a display according to the sharing mode. That is, when the CPU 71 changes to no sharing, it subsequently executes a normal display without information sharing, and when the CPU 71 switches to the preference sharing mode, it subsequently executes a display such as that shown in FIG. 23. Furthermore, when the CPU 71 switches to the current status sharing mode, it subsequently executes a display such as that shown in FIG. 24, and when the CPU 71 switches to the comment sharing mode, it subsequently executes a display such as that shown in FIG. 25. In the sharing mode, the CPU 71 may monitor the user's location information, listening status, etc., and display accordingly.

[0193] In step S241, the CPU 71 makes a determination regarding page display. The CPU 71 determines whether or not it is necessary to display the page number 63, and if it determines that it is necessary, in step S295 it controls the display of the page number 63. For example, if there is no page number in a lyrics booklet or the like, or if there is a page number but the page number does not appear in the current display range, the CPU 71 displays the page number 63.

[0194] For example, the processing in Figures 28 and 29 is performed in step S206 in Figure 26. This allows the display and playback of the various functions described above. Note that the monitoring processing from step S231 to step S241 in Figures 28 and 29 may be performed in any order. Whatever the order, it is sufficient that each of these monitoring processes and corresponding processing in response to the monitoring are performed at the timing of step S206 in Figure 26.

[0195] When the end of playback is detected in step S205 of FIG. 26, the CPU 71 proceeds to step S207, where it ends the display of the lyrics booklet and the like, and ends the process.

[0196] 5. Summary and Modifications According to the above embodiment, the following effects can be obtained.

[0197] The information processing device 70 used as the terminal device 4 of the embodiment includes a control unit (CPU 71) that displays related content associated with music content, the related content being composed of multiple pages, each page containing text or images, and that controls the display of a page guide 52 that indicates the currently displayed page of the entire related content. The terminal device 4 controls the display of a lyrics booklet including the page guide 52 on the screen by, for example, executing the processes shown in Figures 26 to 29 using an installed application program. By electronically displaying the lyrics booklet (lyric card), the user can feel the artist's expression not only through the music but also through the accompanying artwork. In this case, the display of the page guide 52 described in Figures 14 and 20 allows the user to easily recognize which page of the entire lyrics booklet they are viewing when viewing the lyrics booklet, etc., on the terminal device 4.

[0198] In the embodiment, an example of a lyrics booklet corresponding to music content with lyrics has been described, but the present technology can also be applied to, for example, a booklet for an instrumental piece of music without lyrics or a music album. For example, the technology of the present disclosure can be applied when a booklet containing artwork such as photographs, illustrations, and animations is associated with a piece of music or a music album and the booklet is to be displayed.

[0199] Although the page guide 52 has been described as an example of a guide for each page of a multi-page lyrics booklet, there may be cases where a single lyric sheet containing lyrics and artwork for all songs is related to the content of a music album. In such cases, the page guide 52 may be configured to display the position of the lyrics for each song (track) on one page.

[0200] In the embodiment, an example was given in which the related content includes text that is the lyrics of the corresponding music content, and the CPU 71 controls to display the related content when the music content is played. By displaying a lyrics booklet or the like when playing music, the user can experience the same experience as when listening to a CD or record, that is, reading lyrics and enjoying artwork while listening to music, using a terminal device 4 such as a smartphone. In particular, by allowing the user to arbitrarily change the display position of the lyrics booklet or the like, or by controlling the display position according to the progress of the song, the user can experience the same enjoyment as when visually following an actual lyrics booklet while listening to music.

[0201] In this embodiment, the CPU 71 is configured to display in the page guide 52 which pages contain lyrics and which pages do not. As shown in Fig. 20, in the page guide 52, each page of the lyrics booklet is represented by, for example, a circular mark on a bar, and depending on the display mode of the circular portion (for example, the size of the circle), marks 90 (and 92, 93, 94) for pages containing lyrics and mark 91 for pages not containing lyrics are displayed. This makes it easier for the user to grasp the lyrics booklet as a whole.

[0202] In this embodiment, the CPU 71 executes a display in the page guide 52 indicating a page containing lyrics for one song and a page containing lyrics for multiple songs. In the page guide 52, the mark 90 for a lyrics page and the mark 94 for a lyrics page for multiple songs are displayed in different display modes, making it easier for the user to identify the desired page when, for example, moving to a different page. For example, when a user wants to read the lyrics for the next five songs in an album, the page guide 52 indicates the page for one song or multiple songs, making it easier to identify the page to move to. Note that the number of songs may be indicated by a number, for example. For example, the number of songs on a page may be indicated by adding a number to the mark 90 for a lyrics page, such as a circle.

[0203] In this embodiment, when playing back music content, the CPU 71 executes a display in the page guide 52 showing the currently displayed page and the page containing the lyrics of the currently played music. The user does not necessarily always look at the lyrics of the currently played music while the music is being played. Also, while looking at the lyrics of another music, the user may want to return to the lyrics page of the currently played music. Therefore, the mark 92 for the currently displayed lyrics page and the mark 93 for the lyrics page of the currently played music are displayed in a distinguishable manner. This allows the user to understand that they are looking at the lyrics of a music that is not currently being played back, and also serves as an appropriate guide for operations when the user wants to return to the lyrics page of the currently played music.

[0204] In the embodiment, the CPU 71 controls the display of a display position guide 55 that indicates the displayed position within one page of related content. For example, as described with reference to Figures 15 and 16, the display position guide 55 clearly indicates the currently displayed area within the entire page, allowing the user to view a page such as a lyric booklet while being aware of the entire page (or the entire card, in the case of a single lyric card). This also serves as a guide for scrolling and pinching, improving operability.

[0205] In the embodiment, the CPU 71 sets the initial display position based on the position of lyrics among related content. For example, in step S222 of Fig. 27, the position of lyrics in the lyrics booklet is determined and a default display position is set, and in step S204 of Fig. 26, when playback of a song begins, the lyrics booklet is started to be displayed at that default display position. This ensures that the lyrics are displayed from a position appropriate for the user when playback of the song begins. In this case, the display position is clearly indicated by the display position guide 55 as shown in Fig. 17B, allowing the user to recognize the display range in the initial display state of the lyrics booklet, etc.

[0206] In the embodiment, an example has been described in which the CPU 71 changes the display position of related content in response to changes in the music being played, and controls the display position guide 55 to indicate the display position within the page. For example, as described in steps S237, S275, and S276 of Figures 21, 22, and 29, on a page containing multiple lyrics, when the music being played changes due to, for example, moving on to the next track, the lyrics corresponding to the newly played music are displayed. This allows the lyrics booklet to be displayed in a way that is desirable for the user. Furthermore, by clearly indicating the display position in the display position guide 55, the user can be aware of the display position within the page.

[0207] In the embodiment, an example has been given in which the CPU 71 controls the display position guide 55 to indicate the lyric placement position within a page. For example, as illustrated in FIGS. 19A and 19B , the display position guide 55 displays the placement position (placement area) of lyrics within a page. This serves as a guide for scrolling when the user wants to view the lyrics of other songs within the page. In particular, lyrics booklets and lyric cards, which are a platform for artists to express themselves, do not necessarily display the lyrics of each song in an orderly manner. Lyrics may be scattered in various locations within a page in various sizes, fonts, and the like. Therefore, a guide for the placement of lyrics is extremely useful when viewing a lyrics booklet or lyric card.

[0208] In the embodiment, an example was given in which the CPU 71 controls the display of the page number 63 when there is no page notation within the display range of the related content (see steps S241 and S295 in FIG. 29). If the lyrics booklet itself has page notations, the user can see the page number on the lyrics booklet display, but if the lyrics booklet itself does not have page notations, it is difficult for the user to understand. Therefore, in addition to the page guide 52, the page number 63 is also displayed as a guide to the user. In particular, since the booklet is not actually held in the hand, displaying the current page out of all pages makes it easier for the user to get a sense of the overall volume of the lyrics booklet.

[0209] In the embodiment, an example was given in which CPU 71 controls the display of related content during playback of music content and, in response to a predetermined operation, controls the change of the playback position of the music content to a playback position corresponding to the display position of the related content. For example, as a synchronization process in response to operation of synchronization icon 59, CPU 71 controls the playback of the music content so that the song whose lyrics are currently displayed is played. This provides a convenient function when a user sees lyrics and wants to immediately listen to the song (see steps S235, S265, and S266 in FIG. 28 ). Furthermore, a tap operation on the lyrics text also provides a convenient function when a user sees lyrics and wants to immediately listen to a phrase (see steps S238 and S281 in FIG. 29 ).

[0210] In the embodiment, an example has been given in which the CPU 71, in response to a predetermined operation, controls the change of the display location of related content to a display location corresponding to the playback location of music content. For example, as a synchronization process in response to the operation of the synchronization icon 61, the CPU 71 controls the change of the lyrics display location to a location corresponding to the music currently being played. This provides a convenient function for when a user wants to immediately view the lyrics after listening to a song (see steps S235, S265, and S266 in FIG. 28).

[0211] In the embodiment, an example was given in which the CPU 71 switches between a display mode in which a portion of the related content is highlighted and a display mode in which the highlighting is not performed in response to a predetermined operation (see steps S236, S271, and S272 in FIG. 28). By highlighting corresponding lyric portions as the music is played, or by highlighting lyrics or images according to the artist's effect settings, the usefulness of a lyric booklet or lyric card as digital content can be maximized. However, by providing a mode in which such highlighting is not performed, the user can be provided with a viewing experience equivalent to that of a paper lyric booklet or the like.

[0212] In the embodiment, an example was given in which the CPU 71 switches between a display mode in which a user interface image is superimposed on a related content image and a display mode in which a user interface image is not superimposed on a related content image in response to a predetermined operation (see steps S231, S251, and S252 in FIG. 28). In the content concentration mode, various icons and guides for the user interface can be hidden as shown in FIG. 17B. This provides the user with an experience similar to that of simply viewing a lyrics booklet or the like.

[0213] Even when icons and guides are displayed in normal display mode, not content concentration mode, it is possible to minimize the interference with images of the lyric booklet, etc. by displaying each icon and guide only when necessary. Therefore, as explained with respect to display position guide 55, full-screen focus icon 56, page number 63, etc., it is preferable to display icons, guides, etc. temporarily when necessary.

[0214] In the embodiment, the CPU 71 determines whether a predetermined condition is satisfied based on a user's behavior regarding the playback of music content or the display of related content, and then performs output control according to the satisfied condition (see steps S239 and S285 in FIG. 29 ). This allows the user to enjoy the benefits of a lyric booklet or lyric card being provided as digital content. For example, the playback gimmicks described above can display images or transition pages that are not normally displayed, change the content of the lyric booklet, or display hidden pages, providing the user with an experience that is not possible with a paper lyric booklet.

[0215] In the embodiment, an example has been given in which the CPU 71 performs processing to display information about other people on the display of related content in response to a predetermined operation (see steps S240, S291, and S292 in FIG. 29). By providing a sharing mode with other users and artists and displaying information about other users and artists, a more diverse musical experience can be provided to the user.

[0216] The information of other people mentioned above refers to information about the listening positions of other people, information about the favorite positions of other people, information about comments of other people, etc. By displaying this information, it is possible to share thoughts about the song, lyrics, artwork, etc. of other users or artists. Note that although the preference sharing mode, current status sharing mode, and comment sharing mode have been mentioned as sharing modes, it is also possible for some of these modes to be executed.

[0217] The various effects of the above-described embodiment are realized by the terminal device 4 executing an application program and the CPU 71 serving as a control unit performing the processes shown in Figures 26 to 29 , but in the present technology, the server device 1 can also be assumed to be the information processing device 70 that performs the above-described control and enables a user to view a lyric booklet, etc. For example, when the server device 1 distributes music data to the terminal device 4 and plays it back, a system operation is also possible in which the CPU 71 of the server device 1 performs the processes equivalent to those shown in Figures 26 to 29 to control the display of the lyric booklet on the terminal device 4. Even in such a case, the effects of the above-described embodiment can be similarly obtained.

[0218] The program of the embodiment is a program that causes, for example, a CPU, a DSP (digital signal processor), an AI processor, or the like, or an information processing device 70 that includes these, to execute the processes shown in Figures 26 to 29 and the process shown in Figure 6. That is, the program of the embodiment is a program that causes the information processing device 70 to execute control to display related content that is associated with music content and is made up of multiple pages on which characters or images are displayed, and to display a page guide 52 that indicates the currently displayed page of the entire related content.

[0219] With such a program, the terminal device 4 or the information processing device 70 serving as the server device 1 according to the embodiment can be realized in, for example, a computer device, a mobile terminal device, or other equipment capable of executing information processing.

[0220] Such a program can be pre-recorded on a hard disk drive (HDD) as a recording medium built into a computer or other device, or on a ROM within a microcomputer having a CPU. Alternatively, the program can be temporarily or permanently stored (recorded) on a removable recording medium such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical) disc, a DVD (Digital Versatile Disc), a Blu-ray Disc (registered trademark), a magnetic disk, a semiconductor memory, or a memory card. Such removable recording media can be provided as so-called packaged software. Furthermore, such a program can be installed on a personal computer or the like from a removable recording medium, or can be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet.

[0221] Furthermore, such a program is suitable for providing a wide range of information processing devices 70 that constitute the terminal device 4 or server device 1 of the embodiment. For example, by downloading the program to a mobile terminal device such as a smartphone or tablet, a mobile phone, a personal computer, a game device, a video device, a PDA (Personal Digital Assistant), or the like, these devices can be made into information processing devices 70 that function as the terminal device 4 or server device 1 of the present disclosure.

[0222] The program of the embodiment may also be a program that causes the information processing device 70 to execute the process shown in Fig. 6. This makes it possible to realize a terminal device 3 that an artist uses to generate and edit a lyrics booklet or the like.

[0223] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.

[0224] The present technology may also be configured as follows: (1) An information processing device including a control unit that displays related content associated with musical piece content and configured with multiple pages displaying text or images, and that controls display of a page guide indicating the currently displayed page of the entire related content. (2) The information processing device described in (1) above, in which the related content includes text that is the lyrics of the corresponding musical piece content, and the control unit controls display of the related content when the musical piece content is played. (3) The information processing device described in (1) or (2) above, in which the related content includes text that is the lyrics of the corresponding musical piece content, and the control unit causes the page guide to display pages in the related content that include lyrics and pages that do not include lyrics. (4) The information processing device described in any of (1) to (3) above, in which the related content includes text that is the lyrics of the corresponding musical piece content, and the control unit causes the page guide to display pages in the related content that include lyrics for one song and pages that include lyrics for multiple songs. (5) The information processing device according to any one of (1) to (4) above, wherein the related content includes text that is the lyrics of corresponding musical piece content, and the control unit controls to display the related content when the musical piece content is played, and causes the page guide to display a page that shows the currently displayed page and a page that lists the lyrics of the musical piece being played. (6) The information processing device according to any one of (1) to (5) above, wherein the control unit controls to display a display position guide that shows the displayed position within one page of the related content. (7) The information processing device according to (6), wherein the related content includes text that is the lyrics of the corresponding musical piece content, and the control unit sets an initial display position based on the displayed position of lyrics within the related content.(8) The information processing device according to (6) or (7) above, wherein the control unit controls to display the related content when musical piece content is played, and changes the display position of the related content in accordance with changes in the played music, so that the display position guide indicates the display position within the page. (9) The information processing device according to any of (6) to (8) above, wherein the related content includes characters that are lyrics of the corresponding musical piece content, and the control unit controls to display the display position guide so that the display position guide indicates the position of the lyrics within the page. (10) The information processing device according to any of (1) to (9) above, wherein the control unit controls to display a page number when no page notation is present in the display range of the related content. (11) The information processing device according to any of (1) to (10), wherein the related content includes characters that are lyrics of the corresponding musical piece content, and the control unit controls to display the related content when musical piece content is played, and changes the playback position of the musical piece content to a playback position corresponding to the display position of the related content, in accordance with a predetermined operation. (12) The information processing device according to any of (1) to (11), wherein the related content includes text that is lyrics of corresponding musical piece content, and the control unit controls to display the related content when the musical piece content is played and controls to change a display location of the related content to a display location corresponding to a playback location of the musical piece content in response to a predetermined operation. (13) The information processing device according to any of (1) to (12), wherein the control unit performs processing to switch, in response to a predetermined operation, between a display mode in which a part of the related content is highlighted and a display mode in which the highlighting is not executed. (14) The information processing device according to any of (1) to (13), wherein the control unit performs processing to switch, in response to a predetermined operation, between a display mode in which an image for a user interface is superimposed on an image of the related content and a display mode in which an image for a user interface is not superimposed on an image of the related content.(15) The information processing device according to any one of (1) to (14) above, wherein the control unit performs output control according to the satisfied condition in response to determining whether a predetermined condition is satisfied based on a user's behavior regarding the playback of the musical piece content or the display of the related content. (16) The information processing device according to any one of (1) to (15) above, wherein the control unit performs processing to display information about other people on the display of the related content in response to a predetermined operation. (17) The information processing device according to (16) above, wherein the information about other people includes information about other people's listening locations, information about other people's favorite locations, or information about other people's comments. (18) An information processing method, wherein an information processing device controls to display related content associated with musical piece content and consisting of multiple pages displaying text or images, and to display a page guide indicating the currently displayed page of the entire related content. (19) A program causing an information processing device to execute control to display related content associated with musical piece content and consisting of multiple pages displaying text or images, and to display a page guide indicating the currently displayed page of the entire related content.

[0225] REFERENCE SIGNS LIST 1 Server device 2 Database 3, 4 Terminal device 6 Network 20 Editing screen 52 Page guide 53 Page forward icon 54 Page back icon 55 Display position guide 56 Full focus icon 57 Flip icon 58 Link icon 59, 61 Synchronization icon 60 Highlight icon 62 Track title 63 Page number 64, 65 Shared mode icon 70 Information processing device 71 CPU 90, 91, 92, 93, 94 Mark 100 Entire page 101 Display range

Claims

1. An information processing device having a control unit that controls the display of related content associated with music content and consisting of multiple pages displaying text or images, and also displays a page guide indicating the currently displayed page of the entire related content.

2. The information processing device according to claim 1, wherein the related content includes text that is lyrics of the corresponding music content, and the control unit controls to display the related content when the music content is played back.

3. The information processing device according to claim 1, wherein the related content includes text which is the lyrics of the corresponding music content, and the control unit causes the page guide to display pages in the related content which include lyrics and pages which do not include lyrics.

4. The information processing device of claim 1, wherein the related content includes text which is the lyrics of the corresponding music content, and the control unit causes the page guide to display a page containing lyrics for one music piece and a page containing lyrics for multiple music pieces in the related content.

5. The information processing device of claim 1, wherein the related content includes text which is the lyrics of the corresponding music content, and the control unit controls the display of the related content when the music content is played, and also causes the page guide to display the currently displayed page and a page containing the lyrics of the music being played.

6. The information processing device according to claim 1, wherein the control unit controls the display of a display position guide indicating the displayed position within one page of the related content.

7. The information processing device according to claim 6, wherein the related content includes text which is lyrics of the corresponding music piece content, and the control unit sets an initial display position based on a position of lyrics in the related content.

8. The information processing device according to claim 6, wherein the control unit controls the display of the related content when music content is being played, and also controls the display position of the related content to be changed in response to changes in the music being played, so that the display position guide indicates the display position within the page.

9. The information processing device according to claim 6, wherein the related content includes text which is lyrics of the corresponding music content, and the control unit controls the display position guide to indicate the position where lyrics are displayed on the page.

10. The information processing device according to claim 1, wherein the control unit performs control to cause a page number to be displayed when a page notation is not present within the display range of the related content.

11. The information processing device of claim 1, wherein the related content includes text which is the lyrics of the corresponding musical piece content, and the control unit controls to display the related content when the musical piece content is played, and controls to change the playback location of the musical piece content to a playback location corresponding to the display location of the related content in response to a specified operation.

12. The information processing device of claim 1, wherein the related content includes text which is the lyrics of the corresponding musical piece content, and the control unit controls to display the related content when the musical piece content is played, and controls to change the display location of the related content to a display location corresponding to the playback location of the musical piece content in response to a specified operation.

13. The information processing device according to claim 1, wherein the control unit performs processing for switching, in response to a predetermined operation, between a display mode in which a part of the related content is highlighted and a display mode in which the highlighted display is not executed.

14. The information processing device according to claim 1, wherein the control unit performs processing for switching, in response to a predetermined operation, between a display mode in which an image for a user interface is superimposed on an image of the related content, and a display mode in which an image for a user interface is not superimposed on an image of the related content.

15. The information processing device according to claim 1, wherein the control unit performs output control according to the satisfied condition by determining whether a predetermined condition is satisfied based on a user's action regarding the playback of the music content or the display of the related content.

16. The information processing device according to claim 1, wherein the control unit performs processing for displaying information about other people on the display of the related content in response to a predetermined operation.

17. The information processing device according to claim 16, wherein the information of other people includes information of listening locations of other people, information of favorite locations of other people, or information of comments of other people.

18. An information processing method in which an information processing device controls the display of related content associated with music content and consisting of multiple pages displaying characters or images, and also controls the display of a page guide indicating the currently displayed page of the entire related content.

19. A program that causes an information processing device to execute control to display related content associated with music content and consisting of multiple pages displaying characters or images, and to display a page guide indicating the currently displayed page of the entire related content.

Images