Information processing device, program, and information processing method

Abstract

We provide musical scale color images to give people the experience of being "surrounded by music on a daily basis." [Solution] The information processing device includes means for converting each musical scale of music data into musical scale color information, and means for generating musical scale color image information corresponding to each musical scale color information, wherein the musical scale color image information is information in which each musical scale color image is arranged according to the melody of the music data.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a program, and an information processing method.

Background Art

[0002] Generally, methods for visually expressing music are known.

[0003] For example, Patent Document 1 describes the following matters. A system and method for generating a color set based on the musical concepts of pitch and harmony of Patent Document 1 are disclosed. The color set is obtained by a music-hue process that analyzes musical pitch data related to musical input that determines the pitch included in the music. The pitch angle associated with the pitch is applied to an adjusted hue index to identify hue notes ordered within a separated index by a hue interval angle similar to the pitch angle associated with the analyzed pitch data. This system and method generate a color set similar to a chord in terms of including a plurality of hue notes selected based on the hue interval angle obtained from the musical interval angle associated with the received musical input.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] People who like music have a desire to be "surrounded by music in daily life" in addition to performance scenes. In order to be surrounded by music in daily life, a method of visually expressing music in products that people wear daily is effective.

[0006] Patent Document 1 discloses a technique for generating a color set in order to visually represent music. However, while this color set represents the musical concepts of pitch and harmony, it does not represent the melody of a piece of music. In other words, Patent Document 1 does not visually represent the melody of music. Therefore, it is not possible to provide the experience of being "surrounded by music on a daily basis."

[0007] The objective of this invention is to provide musical scale color images that give people the experience of being "surrounded by music on a daily basis." [Means for solving the problem]

[0008] One aspect of the present invention is, It includes a means for converting each musical note in music data into musical note color information, The system includes means for generating tone color image information corresponding to each tone color information, The aforementioned musical scale color image information is information in which each musical scale color image is arranged according to the melody of the music data. It is an information processing device. [Brief explanation of the drawing]

[0009] [Figure 1] This is a block diagram showing the configuration of the information processing system in this embodiment. [Figure 2] Figure 1 is a functional block diagram of the information processing system. [Figure 3] This is an explanatory diagram illustrating the overview of this embodiment. [Figure 4] This is a sequence diagram of the information processing in this embodiment. [Figure 5] This figure shows an example of a screen displayed during the information processing shown in Figure 4. [Modes for carrying out the invention]

[0010] Hereinafter, an embodiment of the present invention will be described in detail based on the drawings. In the drawings for explaining the embodiment, the same components are generally denoted by the same reference numerals, and repeated explanations thereof are omitted.

[0011] (0) Definition of Terms The definitions of the terms in this embodiment are as follows. · "Melody" is a linear sequence of sounds that sounds like a single entity when a listener listens to music, and is composed of a plurality of musical scales arranged along the linear sequence.

[0012] (1) Configuration of the Information Processing System The configuration of the information processing system will be described. FIG. 1 is a block diagram showing the configuration of the information processing system of this embodiment. FIG. 2 is a functional block diagram of the information processing system of FIG. 1.

[0013] As shown in FIG. 1, the information processing system 1 includes a client device 10 and a server 30. The client device 10 and the server 30 are connected via a network (for example, the Internet or an intranet) NW.

[0014] The client device 10 is a computer (an example of an "information processing device") that transmits and receives information to and from the server 30. The client device 10 is, for example, a smartphone, a tablet terminal, or a personal computer.

[0015] The server 30 is a computer (an example of an "information processing device") that transmits and receives information to and from the client device 10. The server 30 is, for example, a web server.

[0016] (1-1) Configuration of the Client Device The configuration of the client device 10 will be described.

[0017] As shown in FIG. 2, the client device 10 includes a storage device 11, a processor 12, an input / output interface 13, and a communication interface 14.

[0018] The storage device 11 is configured to store programs and data. The storage device 11 is, for example, a combination of a ROM (Read Only Memory), a RAM (Random Access Memory), and a storage (e.g., flash memory or hard disk).

[0019] The program includes, for example, the following programs. · Program of an OS (Operating System) · Parameters, functions, and models used in information processing · Program of an application (e.g., web browser) that executes information processing

[0020] The data includes, for example, the following data. · Database referred to in information processing · Data obtained by executing information processing (i.e., execution result of information processing)

[0021] The processor 12 is configured to realize the functions of the client device 10 by starting the programs stored in the storage device 11. The processor 12 is, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination thereof.

[0022] The input / output interface 13 is configured to obtain a user's instruction from an input device connected to the client device 10 and output information to an output device connected to the client device 10. Input devices include, for example, keyboards, pointing devices, touch panels, or combinations thereof. An output device is, for example, a display.

[0023] The communication interface 14 is configured to control communication between the client device 10 and the server 30.

[0024] (1-2) Server configuration The configuration of server 30 will be explained.

[0025] As shown in Figure 2, the server 30 includes a storage device 31, a processor 32, an input / output interface 33, and a communication interface 34.

[0026] The storage device 31 is configured to store programs and data. The storage device 31 is, for example, a combination of ROM, RAM, and storage (e.g., flash memory or hard disk).

[0027] The program includes, for example, the following: • OS programs Parameters, functions, and models used in information processing. • Programs for applications that perform information processing.

[0028] The data includes, for example, the following: • Databases referenced in information processing • Results of information processing

[0029] The processor 32 is configured to realize the functions of the server 30 by launching programs stored in the storage device 31. The processor 32 may be, for example, a CPU, GPU, ASIC, FPGA, or a combination thereof.

[0030] The input / output interface 33 is configured to receive user instructions from an input device connected to the server 30 and to output information to an output device connected to the server 30. Input devices include, for example, keyboards, pointing devices, touch panels, or combinations thereof. An output device is, for example, a display.

[0031] The communication interface 34 is configured to control communication between the server 30 and the client device 10.

[0032] (2) Outline of the Embodiment This embodiment will now be outlined. Figure 3 is an explanatory diagram of this embodiment.

[0033] As shown in Figure 3, the client device 10 sends music data to the server 30 in response to user instructions.

[0034] Server 30 converts the musical scale of the music data into musical scale color information. Server 30 generates musical scale color image information based on musical scale color information. The musical scale color image information is information in which each musical scale color image is arranged according to the melody of the music data.

[0035] (3) Information processing The information processing of this embodiment will now be described. Figure 4 is a sequence diagram of the information processing of this embodiment. Figure 5 is a diagram showing an example of the screen displayed in the information processing of Figure 4.

[0036] The trigger for the process shown in Figure 4 is when the user gives an instruction to access a predetermined website using the client device 10.

[0037] [Generation Request (S1110)] As shown in Figure 4, the client device 10 executes the generation request (S1110). Specifically, the processor 12 displays screen P1110 (Figure 5) on the display. Screen P1110 includes the operation object B1110 and the field object F1110.

[0038] Operation object B1110 is an object that receives user instructions to confirm user instructions to field object F1110.

[0039] Field object F1110 is an object that accepts user instructions for inputting music data. Music data is, for example, MIDI (Musical Instruments Digital Interface) data.

[0040] When a user inputs arbitrary music data into field object F1110 and operates operation object B1110, processor 12 sends generation request data to server 30. The generated request data includes, for example, the music data entered into the field object F1110.

[0041] [Determination of target melody (S1130)] After step S1110, the server 30 performs the determination of the target melody (S1130). Specifically, the processor 32 determines the target melody from the music data included in the generation request data. The target melody is the melody that will be used to generate the musical scale color image information.

[0042] In the first example of step S1130, the processor 32 determines the melody included in the music data for the entire duration as the target melody.

[0043] In the second example of step S1130, the processor 32 determines the target melody based on the target melody rule. The target melody rule is, for example, at least one of the following: (Rule 1) Of the melody in the music data, the melody from the beginning for a certain period of time. (Rule 2) Of the melody in the music data, the melody from the end for a certain period of time. (Rule 3) Among the melodies in the music data, a melody that meets the specified conditions (for example, the melody of the chorus part where the music is most exciting).

[0044] In the third example of step S1130, the processor 32 determines the melody of the music data that corresponds to the time specified by the user as the target melody.

[0045] [Extraction of the main melody scale (S1131)] After step S1130, the server 30 performs extraction of the main melody scale (S1131). Specifically, the processor 32 extracts the main melody scale from the scales that make up the target melody obtained in step S1130. The main melody scale is the scale played by the instrument that plays the main melody.

[0046] [Converting musical scale text (S1132)] After step S1131, the server 30 performs musical scale text conversion (S1132). Specifically, the memory device 31 stores a musical scale text conversion model. The musical scale text conversion model describes the correlation between musical scales and musical scale text information. The musical scale text information is information in which characters representing each musical note that makes up the target melody are arranged according to the target melody. A musical scale text conversion model is, for example, a matching table.

[0047] The processor 32 inputs the main melody scale obtained in step S1131 into a scale text conversion model, thereby converting the main melody scale into scale text information.

[0048] [Tone Color Conversion (S1133)] After step S1132, the server 30 performs a color conversion (S1133). Specifically, the memory device 31 stores the color rules. The color rules describe the correlation between musical scale text information and musical scale color information. A color rule is, for example, a matching table. The musical scale color information is information in which the musical scale color corresponding to each note is arranged according to the target melody. For example, the musical scale color information is represented by RGB values.

[0049] As an example, the color rules describe the correlation between 17 musical scales and 12 musical scale color information, as shown below. ·D:Red ·D#:Wisteria · D♭: Wisteria • Re: Electric Violet ·Re#:Regent St Blue · E♭: Regent St Blue ·Mi: Gold • Fa: Hot Pink • Fa#: Emerald G♭: Emerald ·So:Cerulean • So#: Gray A♭: Gray • La: Yellow ·Ra#:Web Orange · B♭: Web Orange • C: Kenyan Copper

[0050] The processor 32 converts the musical scale text information obtained in step S1132 into musical scale color information by inputting the musical scale text information into a color rule.

[0051] [Generation of musical scale color images (S1134)] After step S1133, the server 30 performs the generation of a musical scale color image (S1135). Specifically, the memory device 31 stores a musical scale color image generation model. The musical scale color image generation model converts musical scale color information into musical scale color image information and arranges the musical scale color image information corresponding to each musical scale that makes up the target melody, in accordance with the target melody. Multiple musical scale color images have the same shape as each other. The shape of each musical scale color image is, for example, at least one of the following: • Bar image • Dot image • Rectangular image • Symbolic image (for example, a heart image) • Stripe image

[0052] Each musical scale color image corresponds to one musical scale. The colors in the musical scale color image are those indicated by the musical scale color information obtained in step S1133. The size of the musical scale color image (for example, the width of the bar image) corresponds to the length of the musical scale. The musical scale color image information is information in which bar images are arranged in one direction according to the order of the musical notes that make up the target melody.

[0053] The processor 32 generates a tone color image information corresponding to the tone color information by inputting the tone color information obtained in step S1133 into a tone color image generation model.

[0054] [Generating design data (S1135)] After step S1134, the server 30 performs the generation of design data (S1135). Specifically, the processor 32 generates design data by combining the musical scale color image information obtained in step S1134 with product image information pre-stored in the storage device 31. Product image information includes, for example, image information for at least one of the following products: • Clothing (for example, a knit sweater or a T-shirt) ·shoes ·bag Accessories ·watch • Smartphone case

[0055] [Generation response (S1136)] After step S1135, the server 30 executes a generated response (S1136). Specifically, the processor 32 transmits the generated response data to the client device 10. The generated response data includes the design data generated in step S1133.

[0056] [Presentation of design data (S1111)] After step S1136, the client device 10 performs the presentation of design data (S1111). Specifically, the processor 12 displays screen P1111 (Figure 5) on the display. Screen P1111 contains image objects IMG11110~IMG11111.

[0057] The image object IMG11110 is the product image of the design data included in the generated response data.

[0058] The image object IMG11111 is a musical scale color image of the design data included in the generated response data.

[0059] (4) Summary of this embodiment According to this embodiment, the musical scale of the music data is converted into musical scale color information, and musical scale color image information is generated based on the musical scale color information. In the musical scale color image information, the musical scale color images are arranged according to the melody of the music data. This allows us to provide users with musical scale color images that give them the experience of being "surrounded by music on a daily basis."

[0060] According to this embodiment, among melodies, the target melody for which the generation of musical scale color image information is to be performed may be determined, and the musical scale of the target melody may be converted into musical scale color information. This allows users to visually enjoy some of the melodies within the music data.

[0061] According to this embodiment, a melody that meets a predetermined condition may be selected as the target melody. This allows users to visually enjoy a portion of the music data's melodies without having to select the target melody themselves.

[0062] According to this embodiment, the predetermined condition may be a melody of a certain duration from the beginning or end. This allows users to visually enjoy a certain period of melody from the beginning or end of a music file without having to select the melody themselves.

[0063] According to this embodiment, the predetermined condition may be the chorus part of the melody. This allows users to visually enjoy the melody of the chorus part of a music data without having to decide on the target melody themselves.

[0064] According to this embodiment, a melody specified by the user may be selected as the target melody from among the melodies. This allows users to visually enjoy their desired melody.

[0065] According to this embodiment, the main melody scale may be extracted from the music data, and the main melody scale may be converted into scale color information. This allows users to visually enjoy the melody of the main theme's scale.

[0066] According to this embodiment, the musical scale color image may also be a bar image. This allows users to enjoy melodies like a music box, through visually recognizable bar images.

[0067] According to this embodiment, the bar image may have a width corresponding to the length of the musical scale. This allows users to enjoy melodies like a music box, through visually recognizable bar images.

[0068] According to this embodiment, design data may be output. The design data includes musical scale color image information and product image information of the product on which the musical scale color image information is placed. This allows users to visually enjoy the melodies expressed in the product. Furthermore, product manufacturers can easily produce products that represent musical scale color image information.

[0069] (5) Other variations Other variations will be explained.

[0070] The storage device 11 may be connected to the client device 10 via a network NW. The storage device 31 may be connected to the server 30 via a network NW.

[0071] Each of the above information processing steps can be executed on either the client device 10 or the server 30. For example, if the client device 10 is capable of performing all the steps of the above information processing, the client device 10 functions as a standalone information processing device without sending a request to the server 30.

[0072] The color rules in this embodiment can be changed according to user instructions. In this case, the user can be presented with a musical scale color image corresponding to the desired color pattern.

[0073] In this embodiment, an example was shown where the design data is a combination of musical scale color images and product images, but the scope of this embodiment is not limited to this. This embodiment is also applicable to cases where the design data is data that can be read by a manufacturing device that produces a product on which musical scale color images are placed (for example, a sewing machine configured to perform embroidery based on the design data). This makes it easy to manufacture products with musical scale color images.

[0074] Although embodiments of the present invention have been described in detail above, the scope of the present invention is not limited to the embodiments described above. Furthermore, the embodiments described above can be improved or modified in various ways without departing from the spirit of the present invention. In addition, the embodiments and modifications described above can be combined. [Explanation of Symbols]

[0075] 1: Information Processing System 10: Client device 11:Storage device 12: Processor 13: Input / Output Interface 14: Communication Interface 30: Server 31:Storage device 32: Processor 33: Input / Output Interface 34: Communication Interface

Claims

1. It includes a means for converting each musical note in music data into musical note color information, The system includes means for generating tone color image information corresponding to each tone color information, The aforementioned musical scale color image information is information in which each musical scale color image is arranged according to the melody of the music data. Information processing device.

2. The system includes means for determining a target melody from among the aforementioned melodies that is the subject of the generation of the musical scale color image information, The conversion means converts the musical scale of the target melody into the musical scale color information. The information processing apparatus according to claim 1.

3. The means for making the determination includes selecting a melody from among the melodies that meets a predetermined condition as the target melody. The information processing apparatus according to claim 2.

4. The aforementioned predetermined condition is a melody of a certain duration from the beginning or end. The information processing apparatus according to claim 3.

5. The aforementioned predetermined condition is the chorus part of the melody, The information processing apparatus according to claim 3.

6. The means for making the determination includes determining the melody specified by the user from among the melodies as the target melody. The information processing apparatus according to claim 2.

7. The system includes means for extracting the main melody scale from the aforementioned music data, The means for performing the conversion converts the main melody scale into the scale color information. An information processing apparatus according to any one of claims 1 to 6.

8. Multiple musical scale color images are images that have the same shape as each other. An information processing apparatus according to any one of claims 1 to 6.

9. The aforementioned musical scale color image is a bar image. The information processing apparatus according to claim 8.

10. The aforementioned musical scale color image has a size corresponding to the length of the musical scale. The information processing apparatus according to claim 8.

11. The system includes means for outputting design data including the aforementioned musical scale color image information, An information processing apparatus according to any one of claims 1 to 6.

12. The design data includes the musical scale color image information and the product image information of the product on which the musical scale color image information is placed. The information processing apparatus according to claim 11.

13. The aforementioned design data is data that can be read by a manufacturing apparatus that produces a product on which the musical scale color image information is arranged. The information processing apparatus according to claim 11.

14. On the computer, The means of converting each musical note in the music data into musical note color information is executed. The means for generating musical scale color image information corresponding to each musical scale color information is executed. The aforementioned musical scale color image information is information in which each musical scale color image is arranged according to the melody of the music data. A program for that purpose.

15. Computers The process involves converting each note in the music data into note color information. The step of generating tone color image information corresponding to each tone color information is performed. The aforementioned musical scale color image information is information in which each musical scale color image is arranged according to the melody of the music data. Information processing methods.

Images