Information processing device, information processing method and program

Abstract

To provide an information processing device that can efficiently check a destination track of derivation in a system for creating music using tracks that are in derivation relationship.SOLUTION: An information processing device 1 of this disclosure includes: an acquisition section 11 for acquiring multiple tracks; a generation section 12 for generating a tree diagram that includes at least a node indicating a track and a branch indicating a derivation relationship between multiple tracks by connecting multiple nodes as components; and a display control section 13 for changing a display style of the components of the tree diagram. When a node indicating the source track of derivation is selected in the tree diagram, the display control section 13 changes the display style of the components related to the destination track of derivation that is related to the source track of derivation in accordance with the melody of the source track of derivation.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] There is known a music production system for layering multiple tracks to create one piece of music. For example, in such a music production system, a user posts a track that he or she has created to a specified website via the Internet or the like. For example, when user A posts a track, other users can listen to this track. In addition, other users consider creating a track to be layered on user A's track. For example, user B creates and posts a track to be layered on user A's track. Furthermore, user C, who has listened to user A's track and user B's track layered together, creates and posts a track to be layered on the two tracks. Then, user D mixes these tracks to complete it as a single piece of music, and releases the completed song.

[0003] As described above, in such a music production system, one track is used as a starting point to generate other tracks one after another. For example, the music production system generates a tree diagram in which each track is a node and the nodes are connected by branches, and displays the generated tree diagram on a browser. This allows the music production system to display multiple submitted tracks in a linked manner. In this way, users of the music production system can enjoy the process of music production by submitting tracks and viewing the progress until a song is completed.

[0004] As a related technique, Patent Document 1 discloses a digital content information series generation device that receives input data including a plurality of music information series or a plurality of music information sets and generates a music information series. The digital content information series generation device disclosed in Patent Document 1 regards each piece of music information as a node, and constructs a music information graph in which nodes corresponding to pieces of music information are connected by edges based on the relevance between the pieces of music information. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2016-110402 A Summary of the Invention [Problem to be solved by the invention]

[0006] Assume that a user creates a track to be overlaid on a derived track using the music production system described above. For example, when three derived tracks are derived from one derived track, the user considers which of the three derived tracks to create to overlay. In this case, the user needs to play the three derived tracks one by one and check the contents of each track. Therefore, if the number of derived tracks increases, the user will spend a lot of time listening to the derived tracks. The technology disclosed in Patent Document 1 does not sufficiently consider such problems.

[0007] In consideration of the above-mentioned problems, the object of the present disclosure is to provide an information processing device, an information processing method, and a program that enable efficient checking of derived tracks in a system in which music is produced using tracks that are in a derivative relationship. [Means for solving the problem]

[0008] The information processing device according to the present disclosure includes: an acquisition unit that acquires a plurality of tracks; a generation unit that generates a tree diagram including at least a node indicating the track and a branch indicating a derivation relationship between the plurality of tracks by connecting the plurality of nodes as components; a display control unit that changes a display mode of the components of the tree diagram; Equipped with When a node indicating a derived track is selected in the tree diagram, the display control unit changes the display manner of components related to a derived track that is in a derived relationship with the derived track in accordance with the melody of the derived track, in accordance with the melody of the derived track.

[0009] The information processing method according to the present disclosure includes: The computer An acquisition step of acquiring a plurality of tracks; a generating step of generating a tree diagram including at least a node indicating the track and a branch indicating a derivation relationship between the plurality of tracks by connecting the plurality of nodes as components; a display control step of changing a display manner of the components of the tree diagram; Run In the display control step, when a node indicating a derived track is selected in the tree diagram, the display manner of components related to a derived track that is in a derived relationship with the derived track is changed in accordance with the melody of the derived track, in accordance with the melody of the derived track.

[0010] The program according to the present disclosure is An acquisition step of acquiring a plurality of tracks; a generating step of generating a tree diagram including at least a node indicating the track and a branch indicating a derivation relationship between the plurality of tracks by connecting the plurality of nodes as components; a display control step of changing a display manner of the components of the tree diagram; Run the following on your computer: In the display control step, when a node indicating a derived track is selected in the tree diagram, the display manner of components related to a derived track that is in a derived relationship with the derived track is changed in accordance with the melody of the derived track, in accordance with the melody of the derived track. Effect of the Invention

[0011] An information processing device, an information processing method, and a program according to the present disclosure enable efficient confirmation of derivative tracks in a system in which music is produced using tracks in a derivative relationship. [Brief description of the drawings]

[0012] [Figure 1] 1 is a diagram showing an overall configuration of a music production system according to an embodiment. [Diagram 2] 1 is a block diagram showing a functional configuration of an information processing device according to an embodiment; [Diagram 3] FIG. 2 is a block diagram illustrating a functional configuration of a terminal device according to an embodiment. [Figure 4] 1 is a flowchart showing a process for generating a tree diagram by the information processing device according to the embodiment. [Diagram 5] FIG. 4 is a diagram showing an example of track data according to the embodiment; [Figure 6] FIG. 2 is a diagram illustrating an example of a tree diagram according to an embodiment. [Figure 7] 11 is a flowchart showing a process performed by the information processing device when a node is selected in the tree diagram according to the embodiment. [Figure 8] 11A to 11C are diagrams illustrating an example of a change in the display mode of components of a tree diagram according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are denoted by the same reference numerals. For clarity of explanation, duplicate explanations will be omitted as necessary.

[0014] (Configuration and Overview of Music Production System 100) A music production system 100 according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing the overall configuration of the music production system 100. The music production system 100 includes an information processing device 1 and multiple terminal devices 2. Although one information processing device 1 and three terminal devices 2 are shown in Fig. 1, the number of information processing devices 1 and the number of terminal devices 2 are not limited to those shown in the figure. In other words, the number of information processing devices 1 may be any number greater than or equal to one, and the number of terminal devices 2 may be any number greater than or equal to one.

[0015] The information processing device 1 and the multiple terminal devices 2 are connected via a network N. The network N is a wireless or wired communication line. As the network N, for example, an Internet line, a mobile phone line, a wireless LAN (Local Area Network), a wired LAN, or the like may be used, and the type of communication is not limited.

[0016] The information processing device 1 is, for example, a PC (Personal Computer), etc. The terminal device 2 is a terminal device used by a user, etc. The terminal device 2 is, for example, a smartphone, a mobile phone terminal, a tablet terminal, a PC, etc.

[0017] The music production system 100 is a system that allows a user to create a music piece by layering tracks created by the user. For example, the terminal device 2 transmits a track created by the user to the information processing device 1 via a predetermined website open to the user. For example, the terminal device 2 transmits the track to the information processing device 1 by posting the track on the website.

[0018] The information processing device 1 acquires tracks transmitted from multiple terminal devices 2. The information processing device 1 performs processing according to the present disclosure using the acquired tracks. For example, the information processing device 1 generates a tree diagram that visually shows the process of creating a piece of music using the acquired tracks. The information processing device 1 displays the generated tree diagram on a display unit (not shown in FIG. 1) of the terminal device 2. The tree diagram includes at least nodes and branches as components. The nodes represent tracks created by the user. The branches represent line segments connecting nodes. As a result, the branches represent derivation relationships between the tracks.

[0019] In the following, two tracks in a derivative relationship may be referred to as a derivative track and a derivative track. The derivative track is a track posted before the derivative track in the derivative relationship. Similarly, the derivative track is a track posted after the derivative track in the derivative relationship. The derivative track can also be said to be a track selected by the user who posted the derivative track as a track to be overlaid.

[0020] A source track may have a derived relationship with multiple destination tracks. A destination track may have a further derived track. In this case, the destination track becomes a source track from the viewpoint of the further derived track.

[0021] When a track is posted, the information processing device 1 generates a node indicating the posted track. When a new track is posted to be overlaid on the track, the information processing device 1 generates a node corresponding to the new track. The information processing device 1 connects the newly generated node and a node that was generated beforehand with a branch. In this way, the tree diagram expresses that the track that was posted beforehand (derived track) and the newly generated track (derived track) are in a derived relationship.

[0022] The information processing device 1 repeats the above process each time a track is posted, increasing the number of nodes and branches. When a predetermined stage is reached, the information processing device 1 completes a piece of music using multiple tracks and releases the completed piece of music. In this way, the tree diagram can represent the process by which a piece of music is produced by multiple users.

[0023] Furthermore, the information processing device 1 changes the display mode of the components in the tree diagram. For example, assume that a node indicating a derivation source track is selected by a user in the tree diagram. In this case, the information processing device 1 changes the display mode of the components related to the derivation destination track in a derivation relationship with the derivation source track according to the melody of the derivation destination track, in accordance with the melody of the derivation destination track. An example of the components related to the derivation destination track is a node indicating the derivation destination track.

[0024] In the following description, a node indicating a source track may be referred to as a "source node" and a node indicating a destination track may be referred to as a "destination node." The source node may not be limited to the node immediately above the destination node, but may include a node even higher than the node immediately above. Similarly, the destination node may not be limited to the node immediately below the source node, but may include a node even lower than the node immediately below.

[0025] For example, the information processing device 1 changes the size, color, position, or movement of the derivation destination node. For example, the information processing device 1 changes the size of the derivation destination node so that the node becomes larger as the sound of the derivation destination track becomes louder and the node becomes smaller as the sound becomes quieter. In this way, the information processing device 1 can visually express the melody of the derivation destination track in the tree diagram. The information processing device 1 controls the display and audio output in the terminal device 2 so as to realize the above-mentioned change in the display mode while playing the derivation source track and without playing the derivation destination track.

[0026] In this way, the information processing device 1 visually expresses the melody of the derived track in accordance with the playback of the derived track. Even if there are multiple derived tracks, the information processing device 1 controls the terminal device 2 so that the above-mentioned change in display mode is realized in all of the multiple derived track nodes indicating the multiple derived tracks. In this way, the user can check the contents of the multiple derived tracks without playing the derived tracks one by one. This reduces the burden on the user when selecting a derived track. In this way, the information processing device 1 can provide a user interface that can support the user in creating tracks.

[0027] (Configuration of information processing device 1) Next, the configuration of the information processing device 1 will be described in detail with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the information processing device 1. The information processing device 1 includes an acquisition unit 11, a generation unit 12, a display control unit 13, a playback control unit 14, a music management unit 15, a communication unit 17, and a storage unit 19.

[0028] The information processing device 1 includes a processor and a memory as components not shown. A computer program in which the processing according to this embodiment is implemented is stored in a storage unit 19 configured as a storage device. The processor can load the computer program from the storage device into the memory and execute the computer program. In this way, the processor realizes the functions of an acquisition unit 11, a generation unit 12, a display control unit 13, a playback control unit 14, and a music management unit 15. Alternatively, the acquisition unit 11, the generation unit 12, the display control unit 13, the playback control unit 14, and the music management unit 15 may each be realized by dedicated hardware.

[0029] In addition, some or all of the components of each device may be realized by general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and programs. In addition, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (field-programmable gate array), a quantum processor (quantum computer control chip), etc. can be used as the processor.

[0030] Furthermore, when some or all of the components of the information processing device 1 are realized by a plurality of information processing devices, circuits, etc., the plurality of information processing devices, circuits, etc. may be centrally arranged or distributed. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, etc., in a form in which each is connected via a communication network. Furthermore, the functions of the information processing device 1 may be provided in a SaaS (Software as a Service) format.

[0031] The acquisition unit 11 acquires a plurality of tracks. For example, the acquisition unit 11 acquires tracks from each of a plurality of terminal devices 2 via a network N. The acquisition unit 11 may acquire a plurality of tracks from one terminal device 2. The acquisition unit 11 acquires tracks via a predetermined website, for example.

[0032] Here, a "track" refers to audio data created by a user. The track may be an audio data track such as data recorded from a musical instrument or data recorded from a human singing voice. The track may also be audio data generated by a computer. For example, the track may be a MIDI track including MIDI (Musical Instrument Digital Interface) data and information on a MIDI sound source, or a VOCALOID track generated by VOCALOID (registered trademark) technology. The track constitutes a part of a completed musical piece. The track may be composed of one section or multiple sections. When composed of multiple sections, the track may include sections such as an A melody, a B melody, and a chorus. The track may be less than the length of one section.

[0033] The acquiring unit 11 stores the acquired data including the track in the storage unit 19 as track data 191. The track data 191 may include user information and track information in addition to audio data indicating the track.

[0034] The user information is information about the user who produced the track. The user information may be, for example, a user name or a user nickname. The track information is information about the produced track. The track information may include, for example, information about the musical instrument used in the performance. Without being limited to this, the track information may include various information such as the posting date and time of the track, the taste of the track, or the role of the track in the completed song. Specific examples of the track data 191 will be described later.

[0035] The generating unit 12 generates display information to be displayed on the display unit of the terminal device 2. For example, the generating unit 12 generates a tree diagram including at least components of nodes indicating tracks and branches indicating derivative relationships of multiple tracks by connecting multiple nodes. For example, the generating unit 12 generates a tree diagram such that multiple nodes in a derivative relationship are linked together. The generating unit 12 transmits the generated tree diagram to the terminal device 2 via the communication unit 17. A specific example of the tree diagram will be described later.

[0036] The components of a tree diagram are not limited to nodes and branches. For example, the components may include an area related to a node or a branch. An area related to a node or a branch is, for example, a peripheral area of ​​the node or branch. The peripheral area of ​​a node or a branch indicates an area within a predetermined distance from the node or branch. The predetermined distance may be expressed, for example, using the number of pixels.

[0037] The components may be characters, figures, or images related to the track indicated by the node. For example, the components may be characters or figures indicating the user name of the user who created the track or the name of the instrument used to play the track. For example, the generation unit 12 generates display information for displaying user information and track information related to each track and completed music piece by referring to the track data 191. For example, by displaying the user name and the instrument name near the node, a user who visually checks the tree diagram can easily grasp information related to the track and the music piece. Furthermore, by displaying icons instead of characters, a user can more intuitively grasp information related to the track and the music piece.

[0038] In addition, the components may include characters, figures, images, etc. related to the derivation relationship indicated by the branch. The components may also include a background region of the tree diagram. The background region of the tree diagram may be the background region of the entire tree diagram, or may be a background region corresponding to a peripheral region of a node or a branch. Without being limited to these, the components may include various regions that can be visually recognized by the user.

[0039] The generating unit 12 may generate various kinds of display information, not limited to the above-mentioned display information. For example, the generating unit 12 may generate various buttons for playing or downloading a track. The generating unit 12 transmits the generated display information to the terminal device 2.

[0040] The display control unit 13 controls the display of display information on the terminal device 2. For example, the display control unit 13 changes the display mode of the components of the tree diagram in response to a user selecting a node in the tree diagram. The display control unit 13 may also change the components in response to a button or icon provided near the tree diagram being clicked.

[0041] For example, when a node indicating a derived track is selected in the tree diagram, the display control unit 13 changes the display mode of components related to a derived track that is in a derived relationship with the derived track in accordance with the melody of the derived track, in accordance with the melody of the derived track.

[0042] There are a number of examples of display modes of components related to a derived track, as described later. Here, as an example, a case will be described in which the components related to the derived track are derived nodes, and the display mode is the size of the derived node. Here, it is assumed that the display mode is set so that the larger the sound of the derived track is, the larger the derived node becomes, and the smaller the sound is, the smaller the derived node becomes. Furthermore, it is assumed here that the derived track is played back in the playback control unit 14 by selecting the derived node in the tree diagram. Note that, as described later, playback of the derived track is not essential.

[0043] When a derivation source node is selected in the tree diagram, the display control unit 13 synchronizes the derivation source track with the derivation destination track. This allows the display control unit 13 to change the size of the derivation destination node using a time axis corresponding to the playback time of the derivation source track. The display control unit 13 changes the size of the derivation destination node according to the volume of the derivation destination track while the derivation source track is being played. In this way, the display control unit 13 can visually represent the melody of the derivation destination track to be overlaid on the derivation source track in accordance with the playback of the derivation source track.

[0044] The components related to the derived track include, for example, the derived node, the peripheral area of ​​the derived node, the branch connecting the derived track and the derived track, or the peripheral area of ​​the branch, etc. Examples of the display mode of the components changed by the display control unit 13 include the following examples.

[0045] (Appearance of components) For example, the display control unit 13 changes the appearance of the component. For example, the display control unit 13 changes the shape, size, color, etc. of the derivation destination node. The shape of the derivation destination node may be, for example, a circle, an ellipse, a polygon, a star, etc. For example, the display control unit 13 changes the derivation destination node from a circle to an ellipse according to the volume of the derivation destination track.

[0046] Also, for example, the display control unit 13 changes the size of the derivation destination node using the size of the derivation destination node before the derivation source node is selected as a reference value. The reference value may be set for each track, for example. The reference value may be set using a statistical value of the loudness of the tracks, for example. The statistical value is, for example, an average value, a mode value, or a median value. The reference value may be set uniformly for all tracks, and may be set to use a statistical value of all posted tracks as the reference value, instead of for each track. Note that reference values ​​may be set similarly for other display modes (for example, color, etc.) described later.

[0047] For example, the display control unit 13 changes the size of the derivation destination node so that the louder the sound of the derivation destination track, the larger the derivation destination node becomes, and the quieter the sound, the smaller the derivation destination node becomes. Without being limited to this, the display control unit 13 may change the derivation destination node to a predetermined size according to the melody of the derivation destination track. For example, the display control unit 13 may change the derivation destination node to a predetermined size when the sound volume of the derivation destination track becomes equal to or greater than a threshold value.

[0048] The color of the derivation destination node is, for example, a color set according to the tempo of the derivation destination track. For example, the display control unit 13 changes the color of the derivation destination node so that it is red when the tempo of the derivation destination track is equal to or greater than a predetermined value, and blue when it is less than the predetermined value. In this way, the display control unit 13 displays the derivation destination node in red when the tempo of the derivation destination node is fast, and in blue when it is slow.

[0049] The display control unit 13 may also change the display mode of the derivation destination node so as to highlight the derivation destination node. For example, the display control unit 13 may display the outline of the derivation destination node in a thicker manner when the tempo of the derivation destination track is equal to or greater than a predetermined value, and may blink the derivation destination node when the tempo is less than the predetermined value. The display control unit 13 may change the shape, length, thickness, color, etc. of the branch connecting the derivation destination track and the derivation source track in the same manner as the derivation destination node.

[0050] (Location of components) The display control unit 13 may change the position of a component. For example, the display control unit 13 changes the position of a derivation destination node. Accordingly, the display control unit 13 may change the position of a branch connecting the derivation destination node and the derivation source node. For example, the display control unit 13 changes the position of the derivation destination node so as to swing the derivation destination node left and right on the tree diagram. For example, the display control unit 13 changes the position of the derivation destination node so that the swing width becomes larger as the sound of the derivation destination track becomes louder and the swing width becomes smaller as the sound becomes quieter. The display control unit 13 may change the position of the derivation destination node so that the position of the derivation destination node jumps up and down.

[0051] (Movement of components) The display control unit 13 may change the movement of the component. For example, the display control unit 13 rotates the derivation destination node. For example, the display control unit 13 rotates the derivation destination node faster as the tempo of the derivation destination track becomes faster, and rotates the derivation destination node slower as the tempo becomes slower. The display control unit 13 may vibrate the derivation destination node.

[0052] The display control unit 13 may change the display mode of the component by using one of the above-mentioned examples, or may change the display mode by using a plurality of the above-mentioned examples. Furthermore, the display control unit 13 may change the display mode of the component by using a method other than the above-mentioned examples.

[0053] The display control unit 13 also controls various displays related to each track and song. For example, the display control unit 13 may display various buttons for playing or downloading a track near the corresponding track. When a song is completed, the display control unit 13 may also display a display indicating the type of the completed song.

[0054] The display control unit 13 may also display track information near the corresponding node. This allows the user to intuitively grasp information about the creator of the track, the instrument, and the like. The display control unit 13 may also display ratings and comments for the track near the corresponding node. The display control unit 13 may also display a gauge or icon indicating the level of rating. This allows the user to check the ratings and comments for the track, which can be used as one of the factors for making decisions about track production. The display control unit 13 may display various display information by superimposing it on the tree diagram, or may display it on a separate screen.

[0055] The playback control unit 14 plays the posted track. For example, the playback control unit 14 plays the track indicated by the node selected by the user.

[0056] For example, when a node indicating a derived track is selected, the playback control unit 14 plays the derived track and the derived track in an overlapping manner. This allows the user to listen to the melody of the derived track and the derived track overlapping. When there are multiple derived tracks, the user can listen to the melody of each system and use the melody of each system as a basis for considering the creation of a new track.

[0057] The playback control unit 14 may overlap a track indicating a selected derivation destination node with a track of a derivation source node adjacent to the derivation destination node, or may further overlap a track of a derivation source node higher than the derivation source node. Alternatively, the playback control unit 14 may specify tracks to be overlapped in response to a user's selection. The playback control unit 14 may also play only the derivation destination track in response to a user's selection.

[0058] The playback control unit 14 detects that a derivation destination node has been selected by, for example, clicking the derivation destination node on the tree diagram. Alternatively, the playback control unit 14 may detect that a derivation destination node has been selected by clicking a "play" button or the like provided near the derivation destination track.

[0059] Furthermore, when a node indicating a derivation source track is selected, the playback control unit 14 plays the derivation source track and does not play the derivation destination track. In other words, when a derivation source node is selected, the playback control unit 14 plays only the derivation source track and does not play the derivation destination track.

[0060] As described above, during playback of the derivation source track, the display control unit 13 changes the display mode of the components related to the derivation destination track. For example, when the display control unit 13 changes the size of the derivation destination node, the user can visually confirm how the size of the derivation destination node changes in accordance with the melody of the derivation source track. Since the size of the derivation destination node changes according to the melody of the derivation destination track, even if there are multiple derivation destination nodes, the user can check the contents of all the derivation destination tracks by checking the change in size of each of the derivation destination tracks. Therefore, the user does not need to play each of the multiple derivation destination nodes one by one to check the contents.

[0061] The music management unit 15 manages music, tracks, and users. For example, the music management unit 15 manages posted tracks in association with the users who created them. Furthermore, when a music piece is completed, the music management unit 15 manages the tracks included in the music piece. For example, the music management unit 15 manages the above information by appropriately updating the track data 191.

[0062] The communication unit 17 communicates with the terminal device 2. The communication unit 17 may communicate with a device other than the terminal device 2. The communication unit 17 may be configured with a communication interface for performing wired or wireless communication.

[0063] The storage unit 19 is composed of a semiconductor memory or the like, and stores various data and programs. At least a part of the storage unit 19 is composed of a non-volatile memory so that data is retained even when the power of the information processing device 1 is turned off. The storage unit 19 stores the track data 191 described above.

[0064] (Configuration of Terminal Device 2) Next, the configuration of the terminal device 2 will be described in detail with reference to Fig. 3. Fig. 3 is a block diagram showing the functional configuration of the terminal device 2. The terminal device 2 includes an input unit 21, a display unit 22, an audio output unit 23, a communication unit 27, and a storage unit 29.

[0065] The input unit 21 accepts user input in response to an operation by the user of the terminal device 2. For example, the input unit 21 posts a track created by the user to a predetermined website via the communication unit 27. The input unit 21 also selects a component of the tree diagram displayed on the display unit 22. For example, the input unit 21 selects a derivation source node, a derivation destination node, various buttons, or the like.

[0066] The input unit 21 may include, for example, a keyboard, a mouse, a trackball, or a stylus pen. The input unit 21 may include a microphone and a camera. That is, the input unit 21 may include an audio input function and an image input function. However, the input unit 21 is not limited to this, and other input devices may be used as the input unit 21.

[0067] The display unit 22 displays information related to music production. The display unit 22 is, for example, a display device such as a display. The display unit 22 may be a touch panel or the like having the functions of the input unit 21. That is, the input unit 21 and the display unit 22 may be integrally configured. The display unit 22 displays display information generated by the information processing device 1. The display unit 22 displays, for example, a tree diagram. The tree diagram includes components whose display form changes.

[0068] The audio output unit 23 outputs information related to music production by audio. The audio output unit 23 is, for example, a speaker. When a derivation source node is selected in the tree diagram, the audio output unit 23 outputs the derivation source track by audio. When a derivation destination node is selected in the tree diagram, the audio output unit 23 outputs the derivation destination track and the derivation source track by superimposing them.

[0069] The communication unit 27 communicates with the information processing device 1. The communication unit 27 receives display information transmitted from the information processing device 1. The communication unit 27 may communicate with devices other than the information processing device 1. The communication unit 27 may be configured with a communication interface for performing wired or wireless communication.

[0070] The storage unit 29 is composed of a semiconductor memory or the like, and stores various data and programs. At least a part of the storage unit 29 is composed of a non-volatile memory so that data is retained even when the power of the terminal device 2 is turned off. The storage unit 29 may store produced tracks. The storage unit 29 may also store downloaded music.

[0071] The components of the music production system 100 according to this embodiment have been described above. The above-described components of the music production system 100 are merely examples and may be modified as appropriate. For example, in the above description, an example has been described in which the information processing device 1 generates display information and transmits the generated display information to the terminal device 2, causing the terminal device 2 to display the display information, but the present invention is not limited to this.

[0072] For example, the music production system 100 may perform the process according to this embodiment via a Web application. In this case, the information processing device 1 implements the Web application that executes the process according to this embodiment. Furthermore, the terminal device 2 stores (installs) a Web browser for displaying a page of a predetermined website in the storage unit 29. The terminal device 2 performs a part of the process according to this embodiment via the Web browser displayed on the display unit 22. For example, the terminal device 2 performs a part of the process of the above-mentioned generation unit 12, display control unit 13, and playback control unit 14 via the Web browser. For example, the terminal device 2 displays a tree diagram and plays music on the Web browser using the Web application stored in the storage unit 19 of the information processing device 1.

[0073] (Processing of information processing device 1) Next, the processing of the information processing device 1 will be described with reference to Fig. 4 to Fig. 8. Fig. 4 to Fig. 6 are diagrams for explaining the processing of the information processing device 1 generating a tree diagram. Fig. 7 and Fig. 8 are diagrams for explaining the processing performed by the information processing device 1 when a node is selected in the generated tree diagram.

[0074] The process up to when the information processing device 1 generates a tree diagram will be described with reference to Fig. 4. Fig. 4 is a flowchart showing the process of generating a tree diagram by the information processing device 1. Here, an example will be described in which users A to G who use the music production system 100 post tracks that they have created on a predetermined website.

[0075] First, user A posts a guitar track TR1 to a website using the terminal device 2. The track TR1 is audio data of a track created by user A. The acquisition unit 11 acquires the track TR1 transmitted from the terminal device 2 (S11). The acquisition unit 11 also associates the acquired track TR1 with the track information of the track TR1 and stores it in the storage unit 19 as track data 191 (S12).

[0076] 5 is a diagram showing an example of track data 191. Here, other tracks that will be added later are also shown. As shown in the diagram, the track data 191 includes a node number, a track number, a user name, an instrument name, and audio data. The user name is an example of the above-mentioned user information. Also, the instrument name is an example of the above-mentioned track information.

[0077] The node number is a number for identifying a node. When a track is added, the node number may be automatically assigned to the node indicating the track. The track number is a number for identifying a track. When a track is added, the track number may be automatically assigned to the track.

[0078] The user name is information indicating the name of the user. The user name may be an account name or a nickname used by the user. The user name may also be an automatically assigned identification number, etc. The instrument name is information indicating the name of the instrument used in the performance. The instrument name may be registered by the user from the terminal device 2, for example, or may be determined by the information processing device 1 based on the melody of the track. The audio data is data indicating the contents of the track. The audio data may be data that records the tone of an instrument, or data that records a person's singing voice, etc.

[0079] These are merely examples, and the track data 191 may not include some of these pieces of information. The track data 191 may also include other information. For example, the track data 191 may include the posting date and time of the track.

[0080] Returning to FIG. 4, the generation unit 12 generates a tree diagram T1 (S13). Here, only the track TR1 of user A has been posted. Therefore, the generation unit 12 generates the tree diagram T1 whose only component is the node N1 indicating the track TR1. The generation unit 12 may generate the tree diagram T1 after two or more tracks have been posted. The display control unit 13 causes the tree diagram T1 to be displayed on the website (S14). As a result, the display unit 22 of the user's terminal device 2 displays the tree diagram T1.

[0081] FIG. 6 is a diagram showing an example of a tree diagram T1. Here, nodes showing other tracks to be added later are also shown. As shown in the diagram, at the start of music production, node N1 is displayed. Here, for example, it is assumed that node N1 is selected by a user by clicking or the like. In response to the selection of node N1, the playback control unit 14 plays track TR1. This allows users other than user A who posted track TR1 to listen to track TR1. In addition, users can create tracks to be overlaid on track TR1.

[0082] Returning to FIG. 4, the generation unit 12 determines whether or not a new post has been made (S15). When it is determined that there is no new post (NO in S15), the generation unit 12 waits until there is a new post. When it is determined that there is a new post (YES in S15), the information processing device 1 returns to step S11 and repeats the subsequent processes.

[0083] For example, in the example shown in FIG. 5 and FIG. 6, when user B posts piano track TR2 in response to track TR1 posted by user A, the acquisition unit 11 acquires track TR2 (S11 described above). The acquisition unit 11 associates the acquired track TR2 with the track information of track TR2 and stores it in the track data 191 (S12 described above). The generation unit 12 generates a tree diagram T1 (S13 described above). Specifically, the generation unit 12 adds a node N2 to the tree diagram T1. The generation unit 12 also adds a branch connecting node N1 and node N2. As a result, the generation unit 12 updates the tree diagram T1. The display control unit 13 displays the updated tree diagram T1 on the website (S14 described above).

[0084] Similarly, user C posts a drum track TR3 in response to track TR1 of user A. The generation unit 12 adds a node N3 indicating track TR3. The generation unit 12 also adds a branch connecting nodes N1 and N3. The display control unit 13 displays the updated tree diagram T1.

[0085] In addition, for track TR3 of user C, user D submits bass track TR4, user E submits saxophone track TR5, and user F submits piano track TR6. The generation unit 12 adds nodes N4, N5, and N6 indicating tracks TR4, TR5, and TR6, respectively. The generation unit 12 also adds branches connecting each of nodes N4, N5, and N6 to node N3. The display control unit 13 displays the updated tree diagram T1.

[0086] Furthermore, user G posts a piano track TR7 in response to track TR4 of user D. The generation unit 12 adds a node N7 indicating track TR7. The generation unit 12 also adds a branch connecting nodes N4 and N7. The display control unit 13 displays the updated tree diagram T1.

[0087] In this way, the information processing device 1 updates the tree diagram T1 by repeating the processes of steps S11 to S14 shown in Fig. 4 in response to the posting of a track. This increases the number of nodes and branches on the tree diagram T1. Since the generation unit 12 generates the tree diagram T1 such that tracks in a derivative relationship are linked together, the user can easily check the progress of the music production by visually checking the display unit 22.

[0088] In the examples shown in FIG. 5 and FIG. 6, it is assumed that the song in which the tracks TR1, TR3, TR4, and TR7, which respectively indicate the nodes N1, N3, N4, and N7, are layered reaches a predetermined level when the user G posts the track TR7. In this case, the song management unit 15 releases the song in which the tracks TR1, TR3, TR4, and TR7 are layered as a completed song. The predetermined level can be said to be a level sufficient for a song in which multiple tracks are layered to be released as a completed song. In FIG. 6, the family M shown by the dashed line indicates the family of the completed song. The generation unit 12 may generate display information indicating the family M as shown by the dashed line in FIG. 6. For example, the generation unit 12 may generate display information for changing the background color around the nodes belonging to the family M.

[0089] The music management unit 15 may use a predetermined condition to determine whether or not a music piece has reached a predetermined level. The predetermined condition may be, for example, that the number of types of musical instruments is equal to or greater than a predetermined number, that a vocal voice has been posted, or that a mix has been performed by a user. The music management unit 15 may determine that a music piece has reached a predetermined level by receiving an input from a user who performs a mix operation.

[0090] When the completed song is released in the song management section 15, the display control section 13 may cause the display section 22 to display a “download” button for downloading the completed song. This allows the user to save the completed song in the terminal device 2.

[0091] 7 is a flowchart showing a process performed by the information processing device 1 when a node is selected in the tree diagram T1. The display control unit 13 determines whether or not any node is selected in the tree diagram T1 (S21). If no node is selected (NO in S21), the display control unit 13 waits until any node is selected. If any node is selected (YES in S21), the display control unit 13 determines whether or not the selected node is a derivation source node (S22).

[0092] If the selected node is a derivation source node (YES in S22), the display control unit 13 changes the display mode of the components related to the derivation destination track in the tree diagram T1 (S23). Furthermore, the playback control unit 14 plays only the derivation source track (S24). At this time, the playback control unit 14 does not play the derivation destination track. Steps S23 and S24 may be performed in parallel.

[0093] Fig. 8 is a diagram showing an example of a change in the display mode of the components of tree diagram T1. Tree diagram T1 shown in Fig. 8 is similar to tree diagram T1 shown in Fig. 6, but for the sake of explanation, node N7 is omitted. In addition, a mark P for playing track TR3 indicated by node N3 is added to node N3.

[0094] It is assumed that node N3 is selected by the user of the terminal device 2. The playback control unit 14 plays back the track TR3 indicated by node N3, causing the audio output unit 23 of the terminal device 2 to output the track TR3 as audio.

[0095] Node N3 is connected to nodes N4, N5, and N6 via branches. That is, track TR3 is in a derivative relationship with tracks TR4, TR5, and TR6. While track TR3 is being played back by the playback control unit 14, the display control unit 13 changes the display manner of nodes N4, N5, and N6 indicating tracks TR4, TR5, and TR6, respectively. In addition, the display control unit 13 may change the display manner of components related to nodes N4, N5, and N6, respectively.

[0096] For example, the display control unit 13 changes the size of the derived node according to the melody of the derived track. In the example of FIG. 8, the display control unit 13 changes the size of the node N4 according to the volume of the track TR4. In the figure, the node N4 when the node N3 is not selected is shown by a solid line, and the node N4 when the node N3 is selected is shown by a dashed line. The display control unit 13 changes the size of the node N4 so that the node N4 becomes larger as the volume of the track TR4 becomes louder, and the node N4 becomes smaller as the volume of the track TR4 becomes quieter. This allows the user to grasp the change in the volume of the track TR4 in accordance with the melody of the track TR3 without playing the track TR4.

[0097] Also, for example, the display control unit 13 may change the length of the branch connecting the derived track and the derived track according to the melody of the derived track. In the example of FIG. 8, the display control unit 13 changes the length of the branch B1 connecting the node N3 and the node N5 according to the pitch of the track TR5. The display control unit 13 also changes the position of the node N5 by changing the length of the branch B1. In the figure, the node N5 when the node N3 is not selected is shown by a solid line, and the node N5 when the node N3 is selected is shown by a dashed line. The display control unit 13 changes the length of the branch B1 so that the higher the pitch of the track TR5, the longer the branch B1 becomes, and the lower the pitch, the shorter the branch B1 becomes. This allows the user to grasp the change in the pitch of the track TR5 in accordance with the melody of the track TR3 without playing the track TR5.

[0098] Furthermore, for example, the display control unit 13 may change the color of the derivation destination node according to the melody of the derivation destination track. In the example of Fig. 8, the display control unit 13 changes the color of the node N6 according to the tempo of the track TR6. If the tempo of the track TR6 is equal to or greater than a predetermined value, the display control unit 13 changes the color of the node N6 to red, and if the tempo is less than the predetermined value, the display control unit 13 changes the color of the node N6 to blue. The display control unit 13 may change the color of the track TR6 according to the melody of the track TR3. This allows the user to understand the change in tempo of the track TR6 in accordance with the melody of the track TR3 without playing the track TR6. The colors are not limited to red and blue, and the display control unit 13 may use other colors. The display control unit 13 may change the shade of the color according to the tempo.

[0099] While track TR3 is being played, the display control unit 13 changes the display modes of nodes N4, N5, and N6. At this time, the playback control unit 14 does not play tracks TR4, TR5, and TR6. Therefore, the user can visually check the melodies of these three tracks while listening to track TR3, without playing any of tracks TR4, TR5, and TR6.

[0100] The display control unit 13 may change the display manner of all of the nodes N4, N5, and N6, or may detect the node hovered over with the mouse and change the display manner of only the detected node. In this case, the playback control unit 14 may play the track indicated by the node hovered over with the mouse over the track TR3.

[0101] Furthermore, the playback control unit 14 may overlap and play back the track TR1 indicating the node N1 above the node N3 while playing back the track TR3. Furthermore, the playback control unit 14 stops the playback of the track TR3 in response to, for example, clicking on the node N3 while playing back the track TR3. In this case, the display control unit 13 stops the change in the display mode of the nodes N4, N5, N6, and the branch B1.

[0102] Here, the display control unit 13 changes the display manner of the nodes N4, N5, N6, and the branch B1 in accordance with the playback of the track TR3, but is not limited to this. The display control unit 13 may perform the same process even if the track TR3 is not being played. For example, the display control unit 13 displays a seek bar for playing tracks and music near the tree diagram T1. The seek bar indicates the playback position of the track or music. The seek bar has, for example, a slider indicating the playback position. The slider is configured to correspond to the time axis of the track TR3. By operating the slider, the user can visually confirm the change in the melody of the tracks TR4, TR5, and TR6 in accordance with the time axis of the track TR3.

[0103] Returning to Fig. 7, if the selected node is not a derivation source node, i.e., if the selected node is a derivation destination node (NO in S22), the playback control unit 14 plays the derivation destination track and the derivation source track in an overlapping manner (S25). For example, suppose that the user selects node N4 after checking the change in the display mode shown in Fig. 8. In this case, the playback control unit 14 plays the tracks TR4 and TR3 in an overlapping manner. In addition to tracks TR4 and TR3, the playback control unit 14 may also play track TR1, which is the derivation source of track TR3, in an overlapping manner.

[0104] In addition to the above-mentioned processes, the display control unit 13 and the playback control unit 14 may perform processes according to a user's selection. Alternatively, if a process to be preferentially performed is set in advance, the display control unit 13 and the playback control unit 14 may perform processes according to the setting.

[0105] In addition, although an example in which users A to G each post one track has been shown here, this is not limiting. Users A to G may post multiple tracks. Therefore, the tree diagram T1 may include nodes corresponding to the multiple tracks posted by user A, for example.

[0106] In addition, although an example in which three tracks TR4, TR5, and TR6 are derived from track TR3 has been shown here, this is not limiting. The number of derived tracks for one derived track is arbitrary. Also, one derived track may be derived from multiple derived tracks. In this case, by overlapping multiple derived tracks, the multiple derived tracks can be treated as one derived track.

[0107] The derivative track may be a combination of multiple tracks. In this case, the multiple derivative tracks can be overlapped and treated as one derivative track. In this case, the display control unit 13 changes the display mode of the components related to each of the multiple derivative tracks according to the melody of each derivative track.

[0108] As described above, in the music production system 100 according to the present embodiment, in the information processing device 1, the acquisition unit 11 acquires tracks from multiple terminal devices 2. The generation unit 12 generates a tree diagram including at least nodes indicating tracks and branches indicating the derivation relationships of multiple tracks by connecting multiple nodes as components. The display control unit 13 changes the display manner of the components in the tree diagram. For example, when a derivation source node is selected in the tree diagram, the display control unit 13 changes the display manner of the components related to the derivation destination track in accordance with the melody of the derivation destination track, in accordance with the melody of the derivation source track.

[0109] This allows the terminal device 2 to play back the derivation source track and display a tree diagram in which the display mode of the derivation destination track changes. In this way, even if there are multiple derivation destination tracks, the user can simultaneously and visually check the melodies of multiple derivation destination tracks in accordance with the melody of the derivation source track. Therefore, even if there are a large number of derivation destination tracks, the user can efficiently check the derivation destination tracks without playing them one by one, and can easily check the image of each track. This allows the user to find the music piece he or she is looking for in a short time.

[0110] Each functional component of the information processing device 1 and the terminal device 2 described above may be realized by hardware that realizes each functional component (e.g., a hardwired electronic circuit, etc.), or may be realized by a combination of hardware and software (e.g., a combination of an electronic circuit and a program that controls it, etc.). For example, any process in the present disclosure can be realized by having a CPU execute a computer program.

[0111] The program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on various types of non-transitory computer readable medium or tangible storage medium. By way of example and not limitation, non-transitory computer readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray® disk or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may also be transmitted on various types of transitory computer readable medium or communication medium. By way of example and not limitation, transitory computer readable medium or communication medium includes electrical, optical, acoustic, or other form of propagated signal.

[0112] The present disclosure is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit and scope of the present disclosure. [Explanation of symbols]

[0113] 1. Information processing device 2 Terminal Equipment 11 Acquisition Department 12 Generation part 13 Display control section 14 Playback control section 15 Music Management Section 17 Communications Department 19 Memory section 21 Input section 22 Display section 23 Audio output section 27 Communications Department 29 Memory section 100 Music Production System 191 Track Data A~G Users B1 Branch M system N Network N1~N7 nodes T1 Tree Diagram TR1~TR7 Tracks

Claims

1. an acquisition unit that acquires a plurality of tracks; a generation unit that generates a tree diagram including at least a node indicating the track and a branch indicating a derivation relationship between the plurality of tracks by connecting the plurality of nodes; a display control unit that changes a display mode of the components of the tree diagram; Equipped with When a node indicating a derivation source track is selected in the tree diagram, the display control unit changes a display mode of a component related to a derivation destination track having a derivation relationship with the derivation source track in accordance with the melody of the derivation destination track in accordance with the melody of the derivation source track. Information processing device.

2. a playback control unit for playing back the track; When a node indicating the derived track is selected, the playback control unit plays the derived track and does not play the derived track. The information processing device according to claim 1 .

3. When a node indicating the derived track is selected, the playback control unit plays back the derived track and the derived track in an overlapping manner. The information processing device according to claim 2 .

4. The computer An acquisition step of acquiring a plurality of tracks; a generating step of generating a tree diagram including at least a node indicating the track and a branch indicating a derivation relationship between the plurality of tracks by connecting the plurality of nodes as components; a display control step of changing a display manner of the components of the tree diagram; Run In the display control step, when a node indicating a derivation source track is selected in the tree diagram, a display mode of a component related to a derivation destination track having a derivation relationship with the derivation source track is changed in accordance with the melody of the derivation destination track in accordance with the melody of the derivation source track. Information processing methods.

5. An acquisition step of acquiring a plurality of tracks; a generating step of generating a tree diagram including at least a node indicating the track and a branch indicating a derivation relationship between the plurality of tracks by connecting the plurality of nodes as components; a display control step of changing a display manner of the components of the tree diagram; Run the following on your computer: In the display control step, when a node indicating a derivation source track is selected in the tree diagram, a display mode of a component related to a derivation destination track having a derivation relationship with the derivation source track is changed in accordance with the melody of the derivation destination track in accordance with the melody of the derivation source track. program.

Images