Information processing device, information processing method, and program

Abstract

An information processing device (1) according to the present disclosure comprises: an acquisition unit (11) which acquires a plurality of tracks; a generation unit (12) which generates a tree diagram that at least includes, as constituent elements, nodes indicating the tracks and branches indicating derivational relationship between the tracks by connecting the nodes; and a display control unit (13) which changes the display mode of the constituent elements in the tree diagram. When a node indicating a derivation source track has been selected in the tree diagram, the display control unit (13) changes, in conformity with the melody of the derivation source track, the display mode for a constituent element related to a derivation destination track that has a derivational relationship with the derivation source track, in accordance with the melody of the derivation destination track.

Description

Information processing device, information processing method, and program

[0001] The present disclosure relates to an information processing device, an information processing method, and a program.

[0002] Music production systems for layering multiple tracks to create a single piece of music are known. For example, in such music production systems, users post tracks they have created to a predetermined website via the Internet or the like. For example, when user A posts a track, other users can listen to this track. Other users may also consider creating tracks to be layered on top of user A's track. For example, user B creates and posts a track to be layered on top of user A's track. User C, who has listened to user A's track and user B's track layered together, creates and posts another track to be layered on top of the two tracks. User D then mixes these tracks to complete the song and releases the completed song.

[0003] As described above, in such a music production system, one track is used as a starting point to generate other tracks one after another. For example, the music production system generates a tree diagram in which each track is a node and the nodes are connected by branches, and displays the generated tree diagram on a browser. This allows the music production system to display multiple submitted tracks in a linked manner. In this way, users of the music production system can enjoy the process of music production by submitting tracks and viewing the progress until a song is completed.

[0004] As a related technique, Patent Document 1 discloses a digital content information sequence generation device that receives input data including multiple song information sequences or multiple song information sets and generates a song information sequence. The digital content information sequence generation device disclosed in Patent Document 1 treats each song information as a node and constructs a song information graph in which nodes corresponding to the song information are connected by edges based on the relevance between the song information.

[0005] JP 2016-110402 A

[0006] Suppose a user uses the music production system described above to create a track to be overlaid on a derivative track. For example, if three derivative tracks are derived from one derivative track, the user must consider which of the three derivative tracks to create the track to overlay. In this case, the user must play each of the three derivative tracks one by one to check the content of each track. Therefore, as the number of derivative tracks increases, the user will spend a lot of time listening to the derivative tracks. The technology disclosed in Patent Document 1 does not sufficiently consider this problem.

[0007] In view of the above-mentioned problems, the object of the present disclosure is to provide an information processing device, an information processing method, and a program that enable efficient confirmation of derived tracks in a system for producing music using tracks that are in a derivative relationship.

[0008] The information processing device according to the present disclosure comprises: an acquisition unit that acquires a plurality of tracks; a generation unit that generates a tree diagram that includes, as components, at least nodes that indicate the tracks and branches that indicate the derivation relationships of the plurality of tracks by connecting the plurality of nodes; and a display control unit that changes the display manner of the components of the tree diagram; wherein, when a node that indicates a derived track is selected in the tree diagram, the display control unit changes the display manner of the components related to a derived track that is in a derivation relationship with the derived track in accordance with the melody of the derived track, in tune with the melody of the derived track.

[0009] The information processing method according to the present disclosure includes a computer executing an acquisition step of acquiring a plurality of tracks, a generation step of generating a tree diagram including at least components including nodes representing the tracks and branches representing the derivation relationships of the plurality of tracks by connecting the plurality of nodes, and a display control step of changing the display manner of the components of the tree diagram, wherein in the display control step, when a node representing a derivation source track is selected in the tree diagram, the display manner of the components related to the derivation destination track that is in a derivation relationship with the derivation source track is changed in accordance with the melody of the derivation destination track, in tune with the melody of the derivation source track.

[0010] The program disclosed herein causes a computer to execute the following steps: an acquisition step for acquiring a plurality of tracks; a generation step for generating a tree diagram including, as components, at least nodes representing the tracks and branches representing the derivation relationships of the plurality of tracks by connecting the plurality of nodes; and a display control step for changing the display manner of the components of the tree diagram. In the display control step, when a node representing a derivation source track is selected in the tree diagram, the display manner of the components related to the derivation destination track that is in a derivation relationship with the derivation source track is changed in accordance with the melody of the derivation destination track, in accordance with the melody of the derivation destination track.

[0011] The information processing device, information processing method, and program according to the present disclosure enable efficient confirmation of derivative tracks in a system for producing music using tracks in a derivative relationship.

[0012] FIG. 1 is a diagram showing the overall configuration of a music production system according to an embodiment. FIG. 2 is a block diagram showing the functional configuration of an information processing device according to an embodiment. FIG. 3 is a block diagram showing the functional configuration of a terminal device according to an embodiment. FIG. 4 is a flowchart showing processing by an information processing device according to an embodiment to generate a tree diagram. FIG. 5 is a diagram showing an example of track data according to an embodiment. FIG. 6 is a diagram showing an example of a tree diagram according to an embodiment. FIG. 7 is a flowchart showing processing performed by an information processing device when a node is selected in a tree diagram according to an embodiment. FIG. 8 is a diagram showing an example of a change in the display mode of components of a tree diagram according to an embodiment.

[0013] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals. For clarity of explanation, duplicated explanations will be omitted as necessary.

[0014] (Configuration and Overview of Music Production System 100) A music production system 100 according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing the overall configuration of the music production system 100. The music production system 100 includes an information processing device 1 and multiple terminal devices 2. While Fig. 1 shows one information processing device 1 and three terminal devices 2, the numbers of information processing devices 1 and terminal devices 2 are not limited to those shown. In other words, the number of information processing devices 1 may be any number greater than or equal to one, and the number of terminal devices 2 may be any number greater than or equal to one.

[0015] The information processing device 1 and the multiple terminal devices 2 are connected via a network N. The network N is a wireless or wired communication line. The network N may be, for example, an internet line, a mobile phone line, a wireless LAN (Local Area Network), a wired LAN, or the like, and the type of communication is not limited.

[0016] The information processing device 1 is, for example, a personal computer (PC). The terminal device 2 is a terminal device used by a user. The terminal device 2 is, for example, a smartphone, a mobile phone, a tablet, a PC, or the like.

[0017] The music production system 100 is a system that allows users to create music by combining tracks created by the users. For example, the terminal device 2 transmits tracks created by the users to the information processing device 1 via a predetermined website that is open to users. For example, the terminal device 2 transmits the tracks to the information processing device 1 by posting the tracks on the website.

[0018] The information processing device 1 acquires tracks transmitted from multiple terminal devices 2. The information processing device 1 performs processing according to the present disclosure using the acquired tracks. For example, the information processing device 1 generates a tree diagram that visually shows the process of creating a piece of music using the acquired tracks. The information processing device 1 displays the generated tree diagram on a display unit (not shown in FIG. 1 ) of the terminal device 2. The tree diagram includes at least nodes and branches as components. Nodes represent tracks created by users. Branches represent line segments connecting nodes. As a result, branches represent derivation relationships between tracks.

[0019] In the following description, two tracks in a derivative relationship may be referred to as a derivative track and a derivative track, respectively. A derivative track is a track posted before a derivative track in a derivative relationship. Similarly, a derivative track is a track posted after a derivative track in a derivative relationship. A derivative track can also be said to be a track selected by a user who posted a derivative track as a target for overlapping tracks.

[0020] A derivation source track may have a derivation relationship with multiple derivation destination tracks. Furthermore, a derivation destination track may be derived into another track. In this case, the derivation destination track becomes a derivation source track from the perspective of the further derived track.

[0021] When a track is posted, the information processing device 1 generates a node indicating the posted track. Furthermore, when a new track is posted to be overlaid on the posted track, the information processing device 1 generates a node corresponding to the new track. The information processing device 1 connects the newly generated node to a previously generated node with a branch. This allows the tree diagram to represent a derivation relationship between the previously posted track (derivation source track) and the newly generated track (derivation destination track).

[0022] The information processing device 1 repeats the above process each time a track is posted, increasing the number of nodes and branches. When a predetermined stage is reached, the information processing device 1 completes a song using multiple tracks and releases the completed song. In this way, the tree diagram can represent the process by which a song is created by multiple users.

[0023] The information processing device 1 also changes the display mode of the components in the tree diagram. For example, suppose a user selects a node in the tree diagram that indicates a derivation source track. In this case, the information processing device 1 changes the display mode of the components related to a derivation destination track that is in a derivation relationship with the derivation source track, in accordance with the melody of the derivation destination track, in accordance with the melody of the derivation destination track. An example of a component related to a derivation destination track is a node that indicates the derivation destination track.

[0024] In the following description, a node indicating a source track may be referred to as a "source node" and a node indicating a destination track as a "destination node." The source node may not be limited to the node immediately above the destination node, but may include a node even higher than the node immediately above. Similarly, the destination node may not be limited to the node immediately below the source node, but may include a node even lower than the node immediately below.

[0025] For example, the information processing device 1 changes the size, color, position, or movement of the derivation destination node. For example, the information processing device 1 changes the size of the derivation destination node so that the node becomes larger as the volume of the derivation destination track increases, and the node becomes smaller as the volume of the derivation destination track decreases. In this way, the information processing device 1 can visually represent the melody of the derivation destination track in the tree diagram. The information processing device 1 controls the display and audio output on the terminal device 2 so as to realize the above-mentioned change in display mode while playing the derivation source track and without playing the derivation destination track.

[0026] In this way, the information processing device 1 visually displays the melody of the derivative track in synchronization with the playback of the derivative track. Even if there are multiple derivative tracks, the information processing device 1 controls the terminal device 2 so that the above-mentioned change in display mode is realized for all of the multiple derivative nodes representing the multiple derivative tracks. In this way, the user can check the contents of multiple derivative tracks without having to play each derivative track one by one. This reduces the burden on the user when selecting a derivative track. In this way, the information processing device 1 can provide a user interface that can assist the user in creating tracks.

[0027] (Configuration of information processing device 1) Next, the configuration of the information processing device 1 will be described in detail with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the information processing device 1. The information processing device 1 includes an acquisition unit 11, a generation unit 12, a display control unit 13, a playback control unit 14, a music management unit 15, a communication unit 17, and a storage unit 19.

[0028] The information processing device 1 includes a processor and a memory (not shown). A computer program implementing the processing according to this embodiment is stored in a storage unit 19 configured as a storage device. The processor can load the computer program from the storage device into the memory and execute the computer program. In this way, the processor realizes the functions of the acquisition unit 11, generation unit 12, display control unit 13, playback control unit 14, and music management unit 15. Alternatively, the acquisition unit 11, generation unit 12, display control unit 13, playback control unit 14, and music management unit 15 may each be realized by dedicated hardware.

[0029] Furthermore, some or all of the components of each device may be realized by general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and programs. Furthermore, the processor may be a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a quantum processor (quantum computer control chip), etc.

[0030] Furthermore, when some or all of the components of the information processing device 1 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or distributed. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, or the like, in a form in which each is connected via a communication network. Furthermore, the functions of the information processing device 1 may be provided in a SaaS (Software as a Service) format.

[0031] The acquisition unit 11 acquires a plurality of tracks. For example, the acquisition unit 11 acquires tracks from each of a plurality of terminal devices 2 via the network N. The acquisition unit 11 may acquire a plurality of tracks from one terminal device 2. For example, the acquisition unit 11 acquires tracks via a predetermined website.

[0032] Here, a "track" refers to audio data created by a user. A track may be an audio data track, such as data recording the tone of an instrument or data recording a human singing voice. A track may also be computer-generated audio data. For example, a track may be a MIDI (Musical Instrument Digital Interface) track containing MIDI data and MIDI sound source information, or a VOCALOID track generated using VOCALOID (registered trademark) technology. A track constitutes a part of a completed musical piece. A track may consist of one section or multiple sections. If a track consists of multiple sections, it may include sections such as an A-melody, a B-melody, and a chorus. A track may be less than the length of one section.

[0033] The acquisition unit 11 stores the acquired data including the track in the storage unit 19 as track data 191. The track data 191 may include user information and track information in addition to audio data indicating the track.

[0034] The user information is information about the user who created the track. The user information may be, for example, a username or a user nickname. The track information is information about the created track. The track information may include, for example, information about the instruments used in the performance. Without being limited to this, the track information may include various information such as the posting date and time of the track, the taste of the track, or the role of the track in the completed song. Specific examples of the track data 191 will be described later.

[0035] The generation unit 12 generates display information to be displayed on the display unit of the terminal device 2. For example, the generation unit 12 generates a tree diagram including, as components, at least nodes indicating tracks and branches indicating derivative relationships between multiple tracks by connecting multiple nodes. For example, the generation unit 12 generates a tree diagram in which multiple nodes in a derivative relationship are linked together. The generation unit 12 transmits the generated tree diagram to the terminal device 2 via the communication unit 17. Specific examples of tree diagrams will be described later.

[0036] The components of a tree diagram are not limited to nodes and branches. For example, the components may include an area related to a node or a branch. An example of an area related to a node or a branch is a peripheral area of ​​the node or branch. The peripheral area of ​​a node or a branch indicates an area within a predetermined distance from the node or branch. The predetermined distance may be expressed, for example, using the number of pixels.

[0037] The components may be characters, graphics, images, or the like related to the track indicated by the node. For example, the components may be characters or graphics indicating the username of the user who created the track or the name of the instrument used to play the track. For example, the generation unit 12 references the track data 191 to generate display information for displaying user information and track information related to each track or completed musical piece. For example, by displaying the username or instrument name near the node, a user visually viewing the tree diagram can easily grasp information related to the track or musical piece. Furthermore, by displaying icons or the like instead of characters, a user can more intuitively grasp information related to the track or musical piece.

[0038] Note that the components may include characters, graphics, images, etc. related to the derivation relationship indicated by the branch. The components may also include a background region of the tree diagram. The background region of the tree diagram may be the background region of the entire tree diagram, or may be a background region corresponding to the surrounding region of a node or branch. Without being limited to these, the components may include various regions that can be visually recognized by the user.

[0039] The generation unit 12 may generate various types of display information, not limited to the above-described display information. For example, the generation unit 12 may generate various buttons for playing or downloading tracks. The generation unit 12 transmits the generated display information to the terminal device 2.

[0040] The display control unit 13 controls the display of display information on the terminal device 2. For example, the display control unit 13 changes the display mode of the components of the tree diagram in response to a user selecting a node in the tree diagram. The display control unit 13 may also change the components in response to a user clicking a button or icon provided near the tree diagram.

[0041] For example, when a node indicating a derived track is selected in the tree diagram, the display control unit 13 changes the display mode of the components related to the derived track that is in a derivative relationship with the derived track in accordance with the melody of the derived track, in accordance with the melody of the derived track.

[0042] There are several examples of display modes for components related to a derivation destination track, as will be described later. Here, as an example, a case will be described in which the components related to the derivation destination track are derivation destination nodes, and the display mode is the size of the derivation destination node. It is also assumed here that the display mode is set so that the louder the sound of the derivation destination track, the larger the derivation destination node becomes, and the quieter the sound, the smaller the derivation destination node becomes. Furthermore, it is assumed here that the derivation source track is played back by the playback control unit 14 when a derivation source node is selected in the tree diagram. It should be noted that, as will be described later, playback of the derivation source track is not essential.

[0043] When a derivation source node is selected in the tree diagram, the display control unit 13 synchronizes the derivation source track and the derivation destination track. This allows the display control unit 13 to change the size of the derivation destination node using a time axis corresponding to the playback time of the derivation source track. While the derivation source track is being played, the display control unit 13 changes the size of the derivation destination node in accordance with the volume of the derivation destination track. In this way, the display control unit 13 can visually represent the melody of the derivation destination track to be overlaid on the derivation source track in accordance with the playback of the derivation source track.

[0044] The components related to the destination track include, for example, the destination node, the surrounding area of ​​the destination node, the branch connecting the destination track and the source track, or the surrounding area of ​​the branch, etc. Examples of the display mode of the components that the display control unit 13 changes include the following examples.

[0045] (Appearance of Component) For example, the display control unit 13 changes the appearance of the component. For example, the display control unit 13 changes the shape, size, or color of the derivation destination node. The shape of the derivation destination node may be, for example, a circle, an ellipse, a polygon, or a star. For example, the display control unit 13 changes the shape of the derivation destination node from a circle to an ellipse depending on the volume of the derivation destination track.

[0046] Furthermore, for example, the display control unit 13 changes the size of the destination node using the size of the destination node before the source node is selected as a reference value. The reference value may be set for each track, for example. The reference value may be set using a statistical value of the volume of the tracks, for example. The statistical value may be, for example, an average value, a mode value, or a median value. Alternatively, the reference value may be set uniformly for all tracks. Alternatively, the statistical value of all posted tracks may be used as the reference value, rather than for each track. Note that reference values ​​may be set similarly for other display modes (for example, color, etc.) described later.

[0047] For example, the display control unit 13 changes the size of the derivation destination node so that the louder the volume of the derivation destination track, the larger the derivation destination node becomes, and the quieter the volume, the smaller the derivation destination node becomes. Without being limited to this, the display control unit 13 may change the size of the derivation destination node to a predetermined size depending on the melody of the derivation destination track. For example, the display control unit 13 may change the size of the derivation destination node to a predetermined size when the volume of the derivation destination track becomes equal to or greater than a threshold.

[0048] The color of the derivation destination node is, for example, a color set according to the tempo of the derivation destination track. For example, the display control unit 13 changes the color of the derivation destination node so that it is red when the tempo of the derivation destination track is equal to or greater than a predetermined value, and blue when it is less than the predetermined value. In this way, the display control unit 13 displays the derivation destination node in red if the tempo of the derivation destination node is fast, and in blue if the tempo is slow.

[0049] The display control unit 13 may also change the display mode of the derivation destination node so as to highlight the derivation destination node. For example, the display control unit 13 may display the outline of the derivation destination node in a thicker color when the tempo of the derivation destination track is equal to or greater than a predetermined value, or may blink the derivation destination node when the tempo is less than the predetermined value. The display control unit 13 may change the shape, length, thickness, color, or the like of the branch connecting the derivation destination track and the derivation source track in the same manner as the derivation destination node.

[0050] (Position of Component) The display control unit 13 may change the position of a component. For example, the display control unit 13 changes the position of a derivation destination node. Accordingly, the display control unit 13 may change the position of a branch connecting the derivation destination node and the derivation source node. For example, the display control unit 13 changes the position of the derivation destination node so that the derivation destination node swings left and right on the tree diagram. For example, the display control unit 13 changes the position of the derivation destination node so that the swing width increases as the sound of the derivation destination track gets louder and decreases as the sound gets quieter. The display control unit 13 may change the position of the derivation destination node so that the position of the derivation destination node jumps up or down.

[0051] (Movement of Component) The display control unit 13 may change the movement of the component. For example, the display control unit 13 rotates the derivation destination node. For example, the faster the tempo of the derivation destination track, the faster the display control unit 13 rotates the derivation destination node, and the slower the tempo, the slower the display control unit 13 rotates the derivation destination node. The display control unit 13 may vibrate the derivation destination node.

[0052] The display control unit 13 may change the display mode of the component using one of the above-mentioned examples, or may change the display mode using multiple examples. Furthermore, the display control unit 13 may change the display mode of the component using a method other than the above-mentioned examples.

[0053] The display control unit 13 also controls various displays related to each track and song. For example, the display control unit 13 may display various buttons for playing or downloading a track near the corresponding track. When a song is completed, the display control unit 13 may also display information indicating the genre of the completed song.

[0054] The display control unit 13 may also display user information and track information near the corresponding node. This allows the user to intuitively understand information about the track's creator and instrument. The display control unit 13 may also display ratings and comments on the track near the corresponding node. The display control unit 13 may also display a gauge or icon indicating the level of rating. This allows the user to check the ratings and comments on the track, which can be used as one of the factors for making decisions about track production. The display control unit 13 may display various display information by superimposing it on the tree diagram, or may display it on a separate screen.

[0055] The playback control unit 14 plays the posted track. For example, the playback control unit 14 plays the track indicated by the node selected by the user.

[0056] For example, when a node indicating a derivative track is selected, the playback control unit 14 plays the derivative track and the derivative source track in an overlapping manner. This allows the user to listen to the melody of the derivative track and the derivative source track overlapping. When there are multiple derivative tracks, listening to the melodies of each type allows the user to use each type of melody as a basis for considering the creation of a new track.

[0057] The playback control unit 14 may overlap a track representing a selected derivation destination node with a track representing a derivation source node adjacent to the selected derivation destination node, or may further overlap a track representing a derivation source node higher than the selected derivation source node. Alternatively, the playback control unit 14 may specify the tracks to overlap in response to a user selection. Alternatively, the playback control unit 14 may play only the derivation destination track in response to a user selection.

[0058] The playback control unit 14 detects that a derivation destination node has been selected by, for example, clicking the derivation destination node on the tree diagram. Alternatively, the playback control unit 14 may detect that a derivation destination node has been selected by clicking a "play" button or the like provided near the derivation destination track.

[0059] Furthermore, when a node indicating a derivation source track is selected, the playback control unit 14 plays the derivation source track but does not play the derivation destination track. In other words, when a derivation source node is selected, the playback control unit 14 plays only the derivation source track but does not play the derivation destination track.

[0060] As described above, during playback of a derivation source track, the display control unit 13 changes the display mode of components related to the derivation destination track. For example, when the display control unit 13 changes the size of a derivation destination node, the user can visually see how the size of the derivation destination node changes in sync with the melody of the derivation source track. Because the size of the derivation destination node changes according to the melody of the derivation destination track, even if there are multiple derivation destination nodes, the user can check the contents of all the derivation destination tracks by checking the change in size of each derivation destination track. Therefore, the user does not need to play each of the multiple derivation destination nodes to check their contents.

[0061] The music management unit 15 manages music, tracks, and users. For example, the music management unit 15 manages posted tracks by associating them with the users who created them. Furthermore, when a music piece is completed, the music management unit 15 manages the tracks included in the music piece. For example, the music management unit 15 manages the above information by appropriately updating the track data 191.

[0062] The communication unit 17 communicates with the terminal device 2. The communication unit 17 may communicate with a device other than the terminal device 2. The communication unit 17 may be configured with a communication interface for performing wired or wireless communication.

[0063] The storage unit 19 is configured with a semiconductor memory or the like and stores various data and programs. At least a part of the storage unit 19 is configured with a non-volatile memory so that data is retained even when the power to the information processing device 1 is turned off. The storage unit 19 stores the track data 191 described above.

[0064] (Configuration of Terminal Device 2) Next, the configuration of the terminal device 2 will be described in detail with reference to Fig. 3. Fig. 3 is a block diagram showing the functional configuration of the terminal device 2. The terminal device 2 includes an input unit 21, a display unit 22, an audio output unit 23, a communication unit 27, and a storage unit 29.

[0065] The input unit 21 accepts user input in response to operations by the user of the terminal device 2. For example, the input unit 21 posts a track created by the user to a predetermined website via the communication unit 27. The input unit 21 also selects a component of the tree diagram displayed on the display unit 22. For example, the input unit 21 selects a source node, a destination node, or various buttons.

[0066] The input unit 21 may include, for example, a keyboard, a mouse, a trackball, or a stylus pen. The input unit 21 may also include a microphone or a camera. That is, the input unit 21 may have an audio input function or a video input function. However, the input unit 21 is not limited to these, and other input devices may also be used.

[0067] The display unit 22 displays information related to music production. The display unit 22 is, for example, a display device such as a display. The display unit 22 may be a touch panel or the like that has the functions of the input unit 21. In other words, the input unit 21 and the display unit 22 may be configured integrally. The display unit 22 displays display information generated by the information processing device 1. The display unit 22 displays, for example, a tree diagram. The tree diagram includes components whose display form changes.

[0068] The audio output unit 23 outputs information related to music production by audio. The audio output unit 23 is, for example, a speaker. When a derivation source node is selected in the tree diagram, the audio output unit 23 outputs the derivation source track by audio. When a derivation destination node is selected in the tree diagram, the audio output unit 23 outputs the derivation destination track and the derivation source track by overlapping them.

[0069] The communication unit 27 communicates with the information processing device 1. The communication unit 27 receives display information transmitted from the information processing device 1. The communication unit 27 may communicate with devices other than the information processing device 1. The communication unit 27 may be configured with a communication interface for performing wired or wireless communication.

[0070] The storage unit 29 is configured with a semiconductor memory or the like and stores various data and programs. At least a portion of the storage unit 29 is configured with a non-volatile memory so that data is retained even when the terminal device 2 is turned off. The storage unit 29 may store produced tracks. The storage unit 29 may also store downloaded music.

[0071] The above describes the components of the music production system 100 according to this embodiment. The above-described components of the music production system 100 are merely examples and may be modified as appropriate. For example, the above description describes an example in which the information processing device 1 generates display information and transmits the generated display information to the terminal device 2, which then displays the display information. However, the present invention is not limited to this.

[0072] For example, the music production system 100 may perform the processing according to this embodiment via a web application. In this case, the information processing device 1 implements the web application that executes the processing according to this embodiment. Furthermore, the terminal device 2 stores (installs) in the storage unit 29 a web browser for displaying pages of a predetermined website. The terminal device 2 executes part of the processing according to this embodiment via the web browser displayed on the display unit 22. For example, the terminal device 2 executes part of the processing of the generation unit 12, display control unit 13, and playback control unit 14 described above via the web browser. For example, the terminal device 2 displays a tree diagram and plays music on the web browser using a web application stored in the storage unit 19 of the information processing device 1.

[0073] (Processing of information processing device 1) Next, the processing of the information processing device 1 will be described with reference to Fig. 4 to Fig. 8. Fig. 4 to Fig. 6 are diagrams explaining the processing by which the information processing device 1 generates a tree diagram. Fig. 7 and Fig. 8 are diagrams explaining the processing performed by the information processing device 1 when a node is selected in the generated tree diagram.

[0074] The process up to the generation of a tree diagram by the information processing device 1 will be described with reference to Fig. 4. Fig. 4 is a flowchart showing the process of generating a tree diagram by the information processing device 1. Here, an example will be described in which users A to G who use the music production system 100 post tracks that they have created to a predetermined website.

[0075] First, user A posts a guitar track TR1 to a website using terminal device 2. Track TR1 is audio data of a track created by user A. Acquisition unit 11 acquires track TR1 transmitted from terminal device 2 (S11). Furthermore, acquisition unit 11 associates acquired track TR1 with track information of track TR1 and stores it as track data 191 in storage unit 19 (S12).

[0076] 5 is a diagram showing an example of track data 191. Other tracks that will be added later are also shown here. As shown in the diagram, the track data 191 includes a node number, a track number, a user name, an instrument name, and audio data. The user name is an example of the user information described above. The instrument name is also an example of the track information described above.

[0077] The node number is a number for identifying a node. When a track is added, the node number may be automatically assigned to the node that indicates the track. The track number is a number for identifying a track. When a track is added, the track number may be automatically assigned to the track.

[0078] The user name is information indicating the name of the user. The user name may be an account name or nickname used by the user. The user name may also be an automatically assigned identification number, etc. The instrument name is information indicating the name of the instrument used in the performance. The instrument name may be registered by the user via the terminal device 2, for example, or may be determined by the information processing device 1 based on the melody of the track. The audio data is data indicating the content of the track. The audio data may be data recording the tone of an instrument, or data recording a person's singing voice, etc.

[0079] These are merely examples, and the track data 191 may not include some of this information. The track data 191 may also include other information. For example, the track data 191 may include the posting date and time of the track.

[0080] Returning to FIG. 4, the generation unit 12 generates a tree diagram T1 (S13). Here, only track TR1 of user A has been posted. Therefore, the generation unit 12 generates the tree diagram T1 whose only component is node N1 indicating track TR1. The generation unit 12 may generate the tree diagram T1 after two or more tracks have been posted. The display control unit 13 displays the tree diagram T1 on the website (S14). As a result, the display unit 22 of the user's terminal device 2 displays the tree diagram T1.

[0081] FIG. 6 is a diagram showing an example of a tree diagram T1. Here, nodes indicating other tracks to be added later are also shown. As shown in the diagram, node N1 is displayed at the start of music production. Here, for example, assume that node N1 is selected by a user by clicking, etc. In response to the selection of node N1, the playback control unit 14 plays track TR1. This allows users other than user A, who posted track TR1, to listen to track TR1. Users can also create tracks to be overlaid on track TR1.

[0082] Returning to Fig. 4, the generation unit 12 determines whether or not a new post has been made (S15). If it is determined that a new post has not been made (NO in S15), the generation unit 12 waits until a new post is made. If it is determined that a new post has been made (YES in S15), the information processing device 1 returns to step S11 and repeats the subsequent processes.

[0083] For example, in the example shown in Figures 5 and 6, if user B posts a piano track TR2 in response to track TR1 posted by user A, the acquisition unit 11 acquires track TR2 (S11 described above). The acquisition unit 11 associates the acquired track TR2 with the track information of track TR2 and stores the associated track in track data 191 (S12 described above). The generation unit 12 generates a tree diagram T1 (S13 described above). Specifically, the generation unit 12 adds node N2 to tree diagram T1. The generation unit 12 also adds a branch connecting node N1 and node N2. As a result, the generation unit 12 updates tree diagram T1. The display control unit 13 displays the updated tree diagram T1 on the website (S14 described above).

[0084] Similarly, user C posts a drum track TR3 in response to user A's track TR1. The generation unit 12 adds a node N3 indicating track TR3. The generation unit 12 also adds a branch connecting nodes N1 and N3. The display control unit 13 displays the updated tree diagram T1.

[0085] Furthermore, in response to user C's track TR3, user D posts bass track TR4, user E posts saxophone track TR5, and user F posts piano track TR6. The generation unit 12 adds nodes N4, N5, and N6 representing tracks TR4, TR5, and TR6, respectively. The generation unit 12 also adds branches connecting nodes N4, N5, and N6 to node N3. The display control unit 13 displays the updated tree diagram T1.

[0086] Furthermore, user G posts a piano track TR7 in response to track TR4 posted by user D. The generation unit 12 adds a node N7 indicating track TR7. The generation unit 12 also adds a branch connecting nodes N4 and N7. The display control unit 13 displays the updated tree diagram T1.

[0087] 4 in response to the posting of a track, the information processing device 1 updates the tree diagram T1. This increases the number of nodes and branches on the tree diagram T1. The generation unit 12 generates the tree diagram T1 so that tracks in a derivative relationship are linked together, allowing the user to easily check the progress of music production by visually checking the display unit 22.

[0088] In the examples shown in FIGS. 5 and 6 , assume that when user G posts track TR7, the song composed of overlapping tracks TR1, TR3, TR4, and TR7, which represent nodes N1, N3, N4, and N7, respectively, reaches a predetermined level. In this case, the song management unit 15 releases the song composed of overlapping tracks TR1, TR3, TR4, and TR7 as a completed song. The predetermined level can be defined as a level sufficient for a song composed of overlapping multiple tracks to be released as a completed song. In FIG. 6 , the family M indicated by the dashed line indicates the family of the completed song. The generation unit 12 may generate display information indicating family M, as shown by the dashed line in FIG. 6 . For example, the generation unit 12 may generate display information for changing the background color around nodes belonging to family M.

[0089] The music management unit 15 may use a predetermined condition to determine whether a music piece has reached a predetermined level. The predetermined condition may be, for example, that the number of types of instruments has reached a predetermined number, that vocals have been posted, or that a user has performed a mixing operation. The music management unit 15 may determine that a music piece has reached a predetermined level by receiving input from a user performing a mixing operation.

[0090] When a completed song is released in the song management unit 15, the display control unit 13 may display a “download” button for downloading the completed song on the display unit 22. This allows the user to save the completed song on the terminal device 2.

[0091] 7 is a flowchart showing the processing performed by the information processing device 1 when a node is selected in the tree diagram T1. The display control unit 13 determines whether any node is selected in the tree diagram T1 (S21). If no node is selected (NO in S21), the display control unit 13 waits until any node is selected. If any node is selected (YES in S21), the display control unit 13 determines whether the selected node is a derivation source node (S22).

[0092] If the selected node is a derivation source node (YES in S22), the display control unit 13 changes the display mode of the components related to the derivation destination track in the tree diagram T1 (S23). Furthermore, the playback control unit 14 plays only the derivation source track (S24). At this time, the playback control unit 14 does not play the derivation destination track. Steps S23 and S24 may be performed in parallel.

[0093] Fig. 8 shows an example of changes in the display mode of the components of tree diagram T1. Tree diagram T1 shown in Fig. 8 is similar to tree diagram T1 shown in Fig. 6, but for the sake of explanation, node N7 is not shown. Node N3 also has a mark P attached to it to play track TR3 indicated by node N3.

[0094] Assume that node N3 is selected by the user of terminal device 2. The playback control unit 14 plays track TR3 indicated by node N3, causing the audio output unit 23 of terminal device 2 to output track TR3 as audio.

[0095] Node N3 is connected to nodes N4, N5, and N6 via branches. That is, track TR3 is in a derivative relationship with tracks TR4, TR5, and TR6. While track TR3 is being played back by the playback control unit 14, the display control unit 13 changes the display modes of nodes N4, N5, and N6 representing tracks TR4, TR5, and TR6, respectively. The display control unit 13 may also change the display modes of components associated with nodes N4, N5, and N6, respectively.

[0096] For example, the display control unit 13 changes the size of the derivation destination node according to the melody of the derivation destination track. In the example of FIG. 8, the display control unit 13 changes the size of node N4 according to the volume of track TR4. In the same figure, node N4 when node N3 is not selected is shown by a solid line, and node N4 when node N3 is selected is shown by a dashed line. The display control unit 13 changes the size of node N4 so that the louder the volume of track TR4, the larger node N4 becomes, and the quieter the volume, the smaller node N4 becomes. This allows the user to understand the change in volume of track TR4 in accordance with the melody of track TR3 without playing track TR4.

[0097] Furthermore, for example, the display control unit 13 may change the length of the branch connecting the derivative track and the derivative source track depending on the melody of the derivative track. In the example of FIG. 8 , the display control unit 13 changes the length of the branch B1 connecting node N3 and node N5 depending on the pitch of track TR5. The display control unit 13 also changes the position of node N5 by changing the length of branch B1. In the figure, node N5 when node N3 is not selected is shown by a solid line, and node N5 when node N3 is selected is shown by a dashed line. The display control unit 13 changes the length of branch B1 so that the higher the pitch of track TR5, the longer branch B1 becomes, and the lower the pitch, the shorter branch B1 becomes. This allows the user to understand the changes in pitch of track TR5 in sync with the melody of track TR3 without playing track TR5.

[0098] Furthermore, for example, the display control unit 13 may change the color of the derivation destination node according to the melody of the derivation destination track. In the example of FIG. 8 , the display control unit 13 changes the color of node N6 according to the tempo of track TR6. If the tempo of track TR6 is equal to or greater than a predetermined value, the display control unit 13 changes the color of node N6 to red. If the tempo of track TR6 is less than the predetermined value, the display control unit 13 changes the color of node N6 to blue. This allows the user to understand the changes in tempo of track TR6 in sync with the melody of track TR3 without playing track TR6. Note that the colors are not limited to red and blue, and the display control unit 13 may use other colors. The display control unit 13 may change the shade of the color according to the tempo.

[0099] While track TR3 is being played, the display control unit 13 changes the display modes of nodes N4, N5, and N6. At this time, the playback control unit 14 does not play tracks TR4, TR5, and TR6. Therefore, the user can visually confirm the melodies of tracks TR4, TR5, and TR6 while listening to track TR3, without playing any of these three tracks.

[0100] The display control unit 13 may change the display mode of all of the nodes N4, N5, and N6, or may detect the node hovered over with the mouse and change the display mode of only the detected node. In this case, the playback control unit 14 may play the track indicated by the node hovered over with the mouse over track TR3.

[0101] Furthermore, the playback control unit 14 may play track TR1 indicating node N1, which is higher than node N3, while playing track TR3. Furthermore, the playback control unit 14 may stop the playback of track TR3 in response to, for example, clicking on node N3 while playing track TR3. In this case, the display control unit 13 stops the changes in the display modes of nodes N4, N5, N6, and branch B1.

[0102] Here, the display control unit 13 changes the display modes of nodes N4, N5, N6, and branch B1 in accordance with the playback of track TR3, but this is not limited to this. The display control unit 13 may perform similar processing even when track TR3 is not being played. For example, the display control unit 13 displays a seek bar for playing tracks or music pieces near the tree diagram T1. The seek bar indicates the playback position of the track or music piece. The seek bar has, for example, a slider indicating the playback position. The slider is configured to correspond to the time axis of track TR3. By operating the slider, the user can visually confirm the changes in the melodies of tracks TR4, TR5, and TR6 in accordance with the time axis of track TR3.

[0103] Returning to FIG. 7 . If the selected node is not a derivation source node, i.e., if it is a derivation destination node (NO in S22), the playback control unit 14 plays the derivation destination track and the derivation source track in an overlapping manner (S25). For example, suppose the user selects node N4 after checking the change in the display mode shown in FIG. 8. In this case, the playback control unit 14 plays tracks TR4 and TR3 in an overlapping manner. In addition to tracks TR4 and TR3, the playback control unit 14 may also play track TR1, which is the derivation source of track TR3, in an overlapping manner.

[0104] In addition to the above-described processes, the display control unit 13 and the playback control unit 14 may perform processes according to a user's selection. Alternatively, if a process to be preferentially performed is set in advance, the display control unit 13 and the playback control unit 14 may perform processes according to the setting.

[0105] Although an example in which users A to G each post one track has been shown here, this is not limiting. Users A to G may post multiple tracks. Therefore, the tree diagram T1 may include nodes corresponding to the multiple tracks posted by user A, for example.

[0106] Although an example in which three tracks TR4, TR5, and TR6 are derived from track TR3 has been shown here, this is not limiting. Any number of destination tracks can be derived from one source track. Furthermore, one destination track may be derived from multiple source tracks. In this case, by overlapping multiple source tracks, the multiple source tracks can be treated as a single source track.

[0107] A derivative track may also be a combination of multiple tracks. In this case, by overlapping multiple derivative tracks, the multiple derivative tracks can be treated as a single derivative track. In this case, the display control unit 13 changes the display mode of the components related to each of the multiple derivative tracks according to the melody of each derivative track.

[0108] As described above, in the music production system 100 according to this embodiment, the acquisition unit 11 in the information processing device 1 acquires tracks from multiple terminal devices 2. The generation unit 12 generates a tree diagram including, as components, at least nodes representing tracks and branches representing derivative relationships between multiple tracks by connecting the multiple nodes. The display control unit 13 changes the display manner of the components in the tree diagram. For example, when a derivation source node is selected in the tree diagram, the display control unit 13 changes the display manner of the components related to the derivative destination track in accordance with the melody of the derivation destination track, in sync with the melody of the derivation source track.

[0109] This allows the terminal device 2 to play the derivative track while displaying a tree diagram in which the display mode of the derivative tracks changes. This allows the user to simultaneously and visually confirm the melodies of multiple derivative tracks in sync with the melody of the derivative track, even when there are multiple derivative tracks. Therefore, even when there are a large number of derivative tracks, the user can efficiently check the derivative tracks without having to play each one individually, making it easy to get a feel for each track. This allows the user to quickly find the music they are looking for.

[0110] Each functional component of the information processing device 1 and the terminal device 2 described above may be realized by hardware (e.g., a hardwired electronic circuit, etc.) that realizes each functional component, or may be realized by a combination of hardware and software (e.g., a combination of an electronic circuit and a program that controls it, etc.). For example, any process in the present disclosure may be realized by having a CPU execute a computer program.

[0111] The program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on various types of non-transitory computer-readable medium or tangible storage medium. By way of example and not limitation, non-transitory computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may also be transmitted on various types of transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

[0112] The present disclosure is not limited to the above-described embodiments, and can be modified as appropriate within the scope of the present disclosure.

[0113] This application claims priority based on Japanese Patent Application No. 2023-139567, filed on August 30, 2023, the disclosure of which is incorporated herein in its entirety.

[0114] The present disclosure can be used in music production systems and the like.

[0115] REFERENCE SIGNS LIST 1 Information processing device 2 Terminal device 11 Acquisition unit 12 Generation unit 13 Display control unit 14 Playback control unit 15 Music management unit 17 Communication unit 19 Storage unit 21 Input unit 22 Display unit 23 Audio output unit 27 Communication unit 29 Storage unit 100 Music production system 191 Track data A to G User B1 Branch M System N Network N1 to N7 Node T1 Tree diagram TR1 to TR7 Track

Claims

1. An information processing device comprising: an acquisition unit that acquires a plurality of tracks; a generation unit that generates a tree diagram including at least components, which include nodes indicating the tracks and branches indicating the derivation relationships of the plurality of tracks by connecting the plurality of nodes; and a display control unit that changes the display manner of the components of the tree diagram, wherein when a node indicating a source track is selected in the tree diagram, the display control unit changes the display manner of the components related to a destination track in a derivation relationship with the source track in accordance with the melody of the destination track, in tune with the melody of the source track.

2. The information processing device according to claim 1, further comprising a playback control unit that plays the track, wherein when a node indicating the derived track is selected, the playback control unit plays the derived track and does not play the derived track.

3. The information processing device according to claim 2, wherein said playback control section plays back said derivative track and said derivative source track in an overlapping manner when a node indicating said derivative destination track is selected.

4. An information processing device as described in claim 1 or 2, wherein when a node indicating a source track that has a derivation relationship with multiple destination tracks is selected, the display control unit changes the display manner of components related to each of the multiple destination tracks in accordance with the melody of each corresponding destination track.

5. An information processing device as described in claim 1 or 2, wherein the track indicates audio data produced by a user, and the acquisition unit associates the acquired track with track information regarding the track and stores it in a memory unit as track data.

6. The information processing device according to claim 5, wherein the display control unit causes the track information of the track to be displayed near the corresponding node.

7. The information processing device according to claim 1 or 2, wherein, when a new track is posted to a previously generated node, the generation unit generates a node for the new track and updates the tree diagram by adding the branch connecting the node for the new track to the previously generated node.

8. An information processing method in which a computer executes the following steps: an acquisition step of acquiring a plurality of tracks; a generation step of generating a tree diagram including at least components including nodes indicating the tracks and branches indicating the derivation relationships of the plurality of tracks by connecting the plurality of nodes; and a display control step of changing a display manner of the components of the tree diagram, wherein in the display control step, when a node indicating a derived track is selected in the tree diagram, the display manner of the components related to a derived track in a derived relationship with the derived track is changed in accordance with the melody of the derived track, in tune with the melody of the derived track.

9. A program for causing a computer to execute the steps of: an acquisition step of acquiring a plurality of tracks; a generation step of generating a tree diagram including at least components including nodes indicating the tracks and branches indicating the derivation relationships of the plurality of tracks by connecting the plurality of nodes; and a display control step of changing the display manner of the components of the tree diagram, wherein in the display control step, when a node indicating a derived track is selected in the tree diagram, the display manner of the components related to a derived track in a derived relationship with the derived track is changed in accordance with the melody of the derived track, in accordance with the melody of the derived track.

Images