Generation device and generation method

Abstract

To produce music suitable for a user and to provide the user with the music.SOLUTION: The RAG system 20 includes a reception section 21 that receives user information including at least biological information of a user and information relating to preference of music of the user, a determination section 22 that determines a concept relating to music production based on the user information, a generation section 23 that generates a prompt for instructing production of music based on the concept, and an inputting section 24 that controls a generative AI model 31 that produces music based on the prompt generated by the generation section 23.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] One aspect of the present disclosure relates to a generating device and a generating method. [Background technology]

[0002] Patent Document 1 discloses a technology for selecting and playing suitable music based on biometric information of a user. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-192127 A Summary of the Invention [Problem to be solved by the invention]

[0004] Providing music that is suitable for the user (suitable for the user's condition and preferences) is important because it can lift the user's spirits and, for example, increase their awareness of exercising while listening to music.

[0005] One aspect of the present disclosure has been made in consideration of the above-mentioned circumstances, and aims to provide a generation device and a generation method that can create music that is suitable for a user and provide that music to the user. [Means for solving the problem]

[0006] A generation device according to one aspect of the present disclosure includes a reception unit that receives user information including at least biometric information of a user and information regarding the user's musical preferences; a determination unit that determines a concept for music production based on the user information; a generation unit that generates prompts to instruct music production based on the concept; and a control unit that controls a generative AI model that produces music based on the prompts generated by the generation unit.

[0007] In a generation device according to one aspect of the present disclosure, a concept for music production is determined based on user information, including information about the user's biometric information and musical preferences. With this configuration, a concept for producing music suitable for a user can be appropriately determined based on the user's condition, such as the user's heart rate, and information about the user's preferred music. A generative AI model for producing music is then controlled by prompts generated based on the concept, thereby producing music suitable for the user based on the above-described concept. As described above, the generation device according to one aspect of the present disclosure can produce music suitable for a user and provide the music to the user. [Effects of the Invention]

[0008] According to one aspect of the present disclosure, music suitable for a user can be produced and provided to the user. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing the device configuration of a music production system according to this embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of a prompt generated by the RAG system. [Figure 3] FIG. 3 is a flowchart showing the processing executed by the RAG system. [Figure 4] FIG. 4 is a diagram illustrating an example of a hardware configuration of the RAG system. DETAILED DESCRIPTION OF THE INVENTION

[0010] The present disclosure will be described with reference to the accompanying drawings. Whenever possible, the same parts are designated by the same reference numerals and redundant description will be omitted.

[0011] Fig. 1 shows the device configuration of a music production system according to this embodiment. The music production system shown in Fig. 1 is a system that produces music suitable for a user and provides that music to the user.

[0012] 1, the music production system includes a terminal 10, a RAG (Retrieval-Augmented Generation) system 20, and a server device 30, which are configured to be able to communicate with each other via a network including a wireless communication network and a fixed communication network. The RAG system 20 constitutes a generation device that generates prompts based on information received from the terminal 10. A prompt is information indicating an instruction or question input to an AI model in an interactive system such as a dialogue with an AI model or a command line interface (CLI).

[0013] The terminals 10 are devices used by users who receive music. The terminals 10 are, for example, personal computers, smartphones, tablet terminals, feature phones, server devices, game consoles, etc. Although only two terminals 10 are shown in FIG. 1, the music production system may include any number of terminals 10 greater than or equal to two.

[0014] The server device 30 stores a generative AI model 31 and enables the provision of music to users using the generative AI model 31. The generative AI model is a model that can generate content in response to a prompt containing input information, based on any one or a combination of the instructions, context, question, and output format indicated by the prompt, and return the content as response information. The prompt can also include input information, in which case the generative AI model 31 generates response information targeted at the input information. The generative AI model 31 may be a music generation AI such as SUNOAI. The generative AI model 31 may be an interactive AI that includes a large-scale language model (LLM) and a user interface (UI) for interacting with the user, enabling text or voice chat with the user. Examples of such generative AI models include ChatGPT, GPT (registered trademark)-3.5, GPT-4V, and PaLM2. In this embodiment, an example is described in which music is provided by server device 30 using one generative AI model 31, but server device 30 may also provide music using multiple generative AI models. Also, while FIG. 1 shows only one server device 30, a music production system may include multiple server devices 30. The generative AI model 31 creates music based on prompts.

[0015] The RAG system 20 is configured to include, as functional components, a reception unit 21, a determination unit 22, a generation unit 23, an input unit 24 (control unit), and a storage unit 25. The RAG system 20 inputs a prompt corresponding to input information from the terminal 10 to the server device 30, and relays response information from the server device 30 to the prompt to the terminal 10. The RAG system 20 also has a function to generate a prompt based on the input information from the terminal 10. The function of each functional unit of the RAG system 20 will be described in detail below.

[0016] The receiving unit 21 receives user information including at least biometric information of the user and information about the user's music preferences. The user's biometric information may be, for example, information indicating the user's heart rate (BPM). The information about the user's music preferences may be, for example, information specifying a favorite genre such as jazz, J-pop, hip-hop, R&B, house, or techno.

[0017] The receiving unit 21 may receive user information that further includes user attribute information, such as the user's age and gender.

[0018] The accepting unit 21 may accept user information that further includes history information of the user's music playback app. The history information of the user's music playback app may be, for example, at least one of information specifying a song, information specifying a genre of the song, information indicating a time period when the song was played, information indicating a volume when the song was played, and information indicating the BPM of the music.

[0019] The receiving unit 21 may accept user information further including information indicating the purpose for which the user listens to music. The listening purpose may be, for example, relaxation, blocking out ambient noise, etc., and may be one or more. The receiving unit 21 may accept the listening purpose for each time period for listening to music as a survey result previously acquired from the user. That is, the receiving unit 21 may accept user information further including a survey result previously acquired from the user indicating the listening purpose for each time period for listening. The receiving unit 21 may accept the listening purpose for each music listening situation as a survey result previously acquired from the user. That is, the receiving unit 21 may accept user information further including a survey result previously acquired from the user indicating the listening purpose for each listening situation.

[0020] The receiving unit 21 may receive user information that further includes information regarding the user's walking speed or running speed.

[0021] The reception unit 21 may receive user information further including information about a usage scene. The information about the usage scene may be, for example, information indicating commuting, running, returning home, etc. The reception unit 21 may receive information indicating the usage scene as the information about the usage scene, or may receive "information from which the usage scene can be estimated" such as time of day, BPM, walking speed, etc. For example, if the BPM is stable (with little fluctuation) in the range of 50 to 90, it is possible to estimate that the user has just woken up.

[0022] The reception unit 21 may receive the user information including the above-described various information from the terminal 10 operated by the user, or may acquire the information via an app, etc. The reception unit 21 outputs the received information to the determination unit 22.

[0023] The determination unit 22 determines a concept for music production based on the user information received by the reception unit 21. The determination unit 22 may determine, as the concept for music production, information including at least any of information about the listener, information about the time period for listening, information about the place for listening, and the purpose of listening.

[0024] The determination unit 22 may estimate a parameter indicating the tones to be used in music production based on the user's biological information, and determine a concept based on the parameter. Specifically, the determination unit 22 may estimate a parameter indicating the ratio of high tones and low tones in music based on the user's BPM, and use the parameter to determine a concept.

[0025] The determination unit 22 may estimate parameters indicating the melody to be used in music production based on information about the user's musical preferences, and determine a concept based on the parameters. Specifically, the determination unit 22 may estimate parameters indicating the proportion of each genre based on information specifying the user's favorite genres, such as jazz, J-pop, hip-hop, R&B, house, and techno, and use the parameters to determine a concept.

[0026] The determination unit 22 may determine information about the listener based on information about the user's music preference and user attribute information. For example, based on information that the user is a male in his twenties who likes techno and house, the determination unit 22 may determine information about the listener such as "a male in his twenties whose favorite genres are techno and house."

[0027] The determination unit 22 may determine information about the listener based on history information of the user's music playback app. For example, assume that the history information of the user's music playback app is as follows: "February 20th, time period '8:30 to 9:00', song title 'A', genre 'Techno', volume '12', BPM '131'", "February 20th, time period '8:00 to 20:30', song title 'B', genre 'House', volume '12', BPM '121'", "February 21st, time period '8:30 to 9:00', song title 'C', genre 'Techno', volume '08', BPM '128'", "February 22nd, time period '8:30 to 9:00', song title 'D', genre 'Ambient', volume '12', BPM '101'". In this case, the determination unit 22 may determine that, of the total two-hour playback time, one hour is "techno," 30 minutes is "house," and the remaining 30 minutes is "ambient," and may estimate that the user's favorite genres are techno, house, and ambient, or may estimate them as 50% techno, 25% house, and 25% ambient, depending on the proportion of playback time. Based on the above information, the determination unit 22 may determine that the listener has relatively complex preferences. Furthermore, information about the listener may be determined by further taking into account information about the volume and BPM.

[0028] The determination unit 22 may determine the time period for listening based on information about the usage scene. For example, when the information about the usage scene indicates "during commuting," the determination unit 22 may determine the time period for listening to be "morning."

[0029] The determination unit 22 may determine the listening time period based on history information of the user's music playback app. For example, when the music playback time period is "8:30 to 9:00" or "20:00 to 20:30," the determination unit 22 may determine the listening time period to be "morning" or "night," or may determine it to be "morning and night." Note that, when multiple listening time periods are determined, such as "morning and night," multiple pieces of music may be produced.

[0030] The determination unit 22 may determine the listening location based on information about the usage scene. For example, when the information about the usage scene indicates "during commuting," the determination unit 22 may determine the listening location to be "on the train."

[0031] The determination unit 22 may determine the place to listen based on history information of the user's music playback app. For example, if the time period for music playback is "8:30 to 9:00," the determination unit 22 may determine that the place to listen is "on the train" because the time period is "morning."

[0032] The determining unit 22 may determine the listening purpose based on the information received by the receiving unit 21 indicating the purpose for which the user is listening to music.

[0033] The determination unit 22 may determine the purpose of listening based on the history information of the user's music playback app and the results of a questionnaire. The questionnaire results here may be, for example, questionnaire results indicating the purpose of listening for each listening time period, or questionnaire results indicating the purpose of listening for each listening situation. For example, suppose that the questionnaire results show that the purpose of listening to music during commuting is "to relax 43% and to block out ambient noise 21%." In this case, when the determination unit 22 estimates that the time period of music playback is "morning" and "during commuting" based on the history information of the user's music playback app, it may determine that the purpose of listening to music is "to relax 43% and to block out ambient noise 21%" based on the questionnaire results.

[0034] The determination unit 22 may determine the purpose of listening based on the BPM. For example, when the BPM is calm, the determination unit 22 may determine that the purpose of listening is to relax because the store sounds fast.

[0035] The determination unit 22 may further determine a "summary" from the determined concept based on information in which at least one of "information about the listener, the time period when listening, the information about the place where listening, and the purpose of listening" is previously associated with a "summary." A summary is information that summarizes a concept, such as "techno music that blocks out noise and lifts your spirits during your commute." The associated information may be stored in advance in the storage unit 25, for example.

[0036] The generation unit 23 generates a prompt for instructing music production based on the concept determined by the determination unit 22. The prompt expresses, in text, for example, the command to be executed by the generative AI model 31 (interactive AI model), the task to be executed by the generative AI model 31, the background and context (e.g., role, condition) to be considered by the generative AI model 31, the question to be answered by the generative AI model 31, and the output format of the response information from the generative AI model 31. The prompt may also include input information to be used as the target of the command and task to be executed by the generative AI model 31. Examples of such input information include data files with file names including a predetermined extension, such as text data, image data, application-related data, audio data, video data, and still image data. Application-related data is data such as document data, table data, and graph data that can be processed by a default application program.

[0037] FIG. 2 is a diagram showing an example of a prompt generated by the RAG system 20. The prompt shown in FIG. 2 specifies a role, a task, and a condition. The role is information that specifies the role that the generative AI model 31 will play in outputting, and in this case, it is specified as a "music producer" involved in music production. The task is information that outlines the instructions to the generative AI model 31, and in this case, it is specified as "Please create a piece of music."

[0038] The conditions are information indicating detailed conditions for the task. The conditions may specify the concept described above or various parameters related to the concept. In the example shown in FIG. 2, the conditions are specified as follows: "Create a song that matches the following concept. Compose a techno piece that includes elements of house and ambient music. The ratio is as follows: 50% techno, 25% ambient. Create a song that blocks out ambient noise and lifts your spirits during your morning commute. Please refer to songs the user likes (examples include A, B, C, and D). 30% high tones, 20% low tones." This information is information determined by the determination unit 22, such as information about the concept itself, parameters indicating the melody related to the concept determination, information summarizing the concept, and parameters indicating the melody related to the concept determination.

[0039] The generation unit 23 may generate prompt information included in the prompt based on the concept, present the prompt information to the user, and accept a change request from the user. That is, the generation unit 23 may present the prompt information as shown in Fig. 2 to the user and accept a change request. The generation unit 23 may present, for example, parameter parts (techno 50%, ambient 25%, etc.) to the user and accept a change request.

[0040] The generation unit 23 may add highly correlated additional information to the prompt information, present the prompt information and the additional information to the user, and accept a change request from the user. For example, the generation unit 23 may add highly correlated additional information, "Jazz 9%," to prompt information, "Techno 50%, Ambient 25%, and present the information to the user. When additional information is added in this way, information indicating which parameters are the additional information may be presented. The generation unit 23 may modify the prompt based on a change request accepted from the user.

[0041] The generation unit 23 may modify parameters when generating prompts for the next music production, depending on the amount of time the user has listened to music produced by the generation AI model 31. For example, if music is produced using multiple parameter combinations, the parameter combination for the music that the user has listened to the longest may be used preferentially when producing the next music. Information such as the parameter combinations related to the past music productions described above may be stored in the storage unit 25, for example.

[0042] The input unit 24 controls the generative AI model 31 based on the prompt generated by the generation unit 23. The input unit 24 inputs the prompt to the generative AI model 31. The generative AI model 31 creates and outputs music in response to the input prompt.

[0043] Next, the processing executed by the RAG system 20 will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the processing executed by the RAG system.

[0044] As shown in FIG. 3, first, in the RAG system 20, user information including at least the user's biometric information and information about the user's music preferences is received from the user via the terminal 10 (step S1).

[0045] Next, in the RAG system 20, a concept for music production is determined based on the user information (step S2).

[0046] Next, the RAG system 20 generates prompts for instructing the production of music based on the concept (step S3).

[0047] Finally, in the RAG system 20, the generated prompt is input to the generative AI model 31 (step S4).

[0048] Next, the effects of the RAG system 20 according to this embodiment will be described.

[0049] The RAG system 20 of this embodiment includes a reception unit 21 that receives user information including at least the user's biometric information and information regarding the user's music preferences, a determination unit 22 that determines a concept for music production based on the user information, a generation unit 23 that generates prompts to instruct music production based on the concept, and an input unit 24 that controls a generative AI model 31 that produces music based on the prompts generated by the generation unit 23.

[0050] In the RAG system 20 according to this embodiment, a concept for music creation is determined based on user information, including biometric information and information about the user's musical preferences. This configuration allows for an appropriate concept for creating music suited to the user to be determined based on the user's condition, such as the user's heart rate, and the user's preferred music. The AI ​​model for creating music is then controlled by prompts generated based on the concept, allowing for music tailored to the user to be created based on the concept. As described above, the RAG system 20 according to this embodiment can create music suited to the user and provide it to the user. For example, matching the walking tempo with the music tempo can elevate the user's mood. This can also improve the user's awareness of walking (running), thereby promoting the associated health benefits. It is also possible to synchronize music with breathing or typing tempo.

[0051] The determination unit 22 may estimate parameters indicating the tones to be used in music production based on the user's biometric information and determine a concept based on the parameters. This allows the tones corresponding to the biometric information to be reflected in the concept for music production, making it possible to appropriately produce music that matches the user's biometric information.

[0052] The determination unit 22 may estimate parameters indicating the melody to be used in music production based on information about the user's music preferences, and determine a concept based on the parameters. This allows the melody according to the user's music preferences to be reflected in the concept for music production, making it possible to appropriately produce music that suits the user's music preferences.

[0053] The determining unit 22 may determine, as a concept, information including at least any of information about the listener, information about the time period when the listener listens, information about the place where the listener listens, and the purpose of listening. By including such information in the concept, it is possible to appropriately create music that is suitable for the user.

[0054] The receiving unit 21 may receive user information further including user attribute information, and the determining unit 22 may determine information about the listener based on information about the user's music preferences and the user attribute information. In this way, by taking into consideration the user attribute information in addition to information about the user's music preferences, the information about the listener can be appropriately determined.

[0055] The accepting unit 21 may accept user information further including history information of the user's music playback app, and the determining unit 22 may determine information about the listener based on the history information of the user's music playback app. In this way, by using the history information of the music playback app, it is possible to appropriately determine information about the listener.

[0056] The receiving unit 21 may receive user information further including history information of the user's music playback app and questionnaire results indicating the listening purpose for each listening time period obtained in advance from the user, and the determining unit 22 may determine the listening purpose based on the history information of the user's music playback app and the questionnaire results. By using the questionnaire results in this way, the listening purpose can be appropriately determined.

[0057] The generation unit 23 may generate prompt information to be included in the prompt based on the concept, present the prompt information to the user, and accept a change request from the user. By accepting a change request from the user in this way, the prompt can be generated while appropriately reflecting the user's intentions.

[0058] The generation unit 23 may add highly correlated additional information to the prompt information, present the prompt information and the additional information to the user, and accept a change request from the user. By adding highly correlated additional information to the prompt information in this way, it is possible to increase the variety of information included in the prompt, while accepting a change request from the user if it is not necessary.

[0059] The generating device and generating method of the present disclosure have the following configuration.

[0060] [1] a receiving unit that receives user information including at least biometric information of a user and information regarding the user's music preferences; a determination unit that determines a concept for music production based on the user information; a generating unit that generates prompts for instructing music production based on the concept; A generating device comprising: a control unit that controls a generative AI model that creates music based on the prompt generated by the generating unit.

[0061] [2] The generating device according to [1], wherein the determination unit estimates parameters indicating the tones to be used in music production based on the biometric information of the user, and determines the concept based on the parameters.

[0062] [3] The generation device according to [1] or [2], wherein the determination unit estimates parameters indicating the melody to be used in music production based on information regarding the user's musical preferences, and determines the concept based on the parameters.

[0063] [4] The generating device according to any one of [1] to [3], wherein the determination unit determines information including at least information about the listener, the time of day when the listener is listening, the place where the listener is listening, and the purpose of listening, as the concept.

[0064] [5] the receiving unit receives the user information further including attribute information of the user; The generating device according to [4], wherein the determining unit determines the information about the listener based on information about the user's musical preference and attribute information about the user.

[0065] [6] the receiving unit receives the user information further including history information of a music playback app of the user; The generating device according to [4] or [5], wherein the determining unit determines information about the listener based on history information of a music playback app of the user.

[0066] [7] the receiving unit receives the user information further including history information of a music playback app of the user and a questionnaire result indicating a listening purpose for each listening time period obtained in advance from the user; The generating device according to any one of [4] to [6], wherein the determining unit determines the listening purpose based on history information of a music playback app of the user and the survey results.

[0067] [8] The generation device described in any one of [1] to [7], wherein the generation unit generates prompt information included in the prompt based on the concept, presents the prompt information to the user, and accepts change requests from the user.

[0068] [9] The generation device according to [8], wherein the generation unit adds additional information that is highly correlated to the prompt information, presents the prompt information and the additional information to the user, and accepts change requests from the user.

[0069]

[10] A generation method performed by a generation device, receiving user information including at least biometric information of a user and information regarding the user's music preferences; determining a concept for music production based on the user information; generating prompts for directing music production based on said concepts; and controlling a generative AI model that produces music based on the generated prompts.

[0070] The block diagrams used to explain the above embodiments show functional blocks. These functional blocks (components) are realized by any combination of hardware and / or software. Furthermore, the method for realizing each functional block is not particularly limited. That is, each functional block may be realized using a single device that is physically or logically coupled, or may be realized using two or more physically or logically separated devices that are connected directly or indirectly (for example, by wire, wirelessly, etc.) and these multiple devices. The functional block may also be realized by combining the single device or multiple devices with software.

[0071] Functions include, but are not limited to, judgment, determination, judgment, calculation, computation, processing, derivation, investigation, search, confirmation, reception, transmission, output, access, resolution, selection, election, establishment, comparison, assumption, expectation, consideration, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocation, mapping, and assignment. For example, a functional block (component) that performs transmission is called a transmitting unit or transmitter. As mentioned above, there are no particular limitations on how these functions are implemented.

[0072] For example, the RAG system 20 constituting the music production system according to an embodiment of the present disclosure may function as a computer that performs processing of the control method of the present disclosure. FIG. 4 is a diagram illustrating an example of the hardware configuration of the RAG system 20 according to this embodiment. The RAG system 20 described above may be physically configured as a computer device including a processor 1001, a memory 1002, a storage device 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, and the like. Note that the RAG system 20 may be configured as a computer device including at least one processor such as a CPU or a GPU, or may be configured as a computer device including multiple processors, or may be configured to include multiple computer devices. The terminal 10 and the server device 30 may also have a similar hardware configuration.

[0073] In the following description, the term "apparatus" can be interpreted as a circuit, a device, a unit, etc. The hardware configuration of the RAG system 20 may be configured to include one or more of the apparatuses shown in the figure, or may be configured to exclude some of the apparatuses.

[0074] Each function in the RAG system 20 is realized by loading specified software (programs) onto hardware such as the processor 1001 and memory 1002, causing the processor 1001 to perform calculations, control communication via the communication device 1004, and control at least one of reading and writing data in the memory 1002 and storage 1003.

[0075] The processor 1001 controls the entire computer by running, for example, an operating system. The processor 1001 may be configured by a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic unit, a register, etc. For example, the above-mentioned reception unit 21, determination unit 22, generation unit 23, input unit 24, etc. may be realized by the processor 1001.

[0076] The processor 1001 also loads programs (program codes), software modules, data, etc. from at least one of the storage 1003 and the communication device 1004 into the memory 1002 and executes various processes in accordance with the programs. The programs used are those that cause a computer to execute at least some of the operations described in the above-described embodiments. For example, the reception unit 21, the determination unit 22, the generation unit 23, and the input unit 24 may be implemented by a control program stored in the memory 1002 and running on the processor 1001, and similar implementations may be made for other functional blocks. While the above-described various processes have been described as being executed by one processor 1001, they may also be executed simultaneously or sequentially by two or more processors 1001. The processor 1001 may be implemented by one or more chips. The programs may also be transmitted from a network via a telecommunications line.

[0077] The memory 1002 is a computer-readable recording medium and may be configured, for example, by at least one of a read-only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a random access memory (RAM), etc. The memory 1002 may also be called a register, a cache, a main memory (primary storage device), etc. The memory 1002 can store executable programs (program codes), software modules, etc. for implementing a control method according to an embodiment of the present disclosure.

[0078] Storage 1003 is a computer-readable recording medium, and may be, for example, at least one of an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray disc), a smart card, a flash memory (e.g., a card, a stick, a key drive), a floppy disk, a magnetic strip, etc. Storage 1003 may also be referred to as an auxiliary storage device. The above-mentioned storage medium may be, for example, a database, a server, or other appropriate medium including at least one of memory 1002 and storage 1003.

[0079] The communication device 1004 is hardware (transmission / reception device) for communicating between computers via at least one of a wired network and a wireless network, and is also referred to as, for example, a network device, a network controller, a network card, or a communication module. The communication device 1004 may be configured to include a high-frequency switch, a duplexer, a filter, a frequency synthesizer, etc. to realize at least one of frequency division duplex (FDD) and time division duplex (TDD). For example, the above-mentioned reception unit 21, input unit 24, etc. may be realized by the communication device 1004.

[0080] The input device 1005 is an input device (for example, a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that receives input from the outside. The output device 1006 is an output device (for example, a display, a speaker, an LED lamp, etc.) that outputs to the outside. The input device 1005 and the output device 1006 may be integrated into one device (for example, a touch panel).

[0081] Furthermore, each device, such as the processor 1001 and the memory 1002, is connected by a bus 1007 for communicating information. The bus 1007 may be configured using a single bus, or may be configured using different buses between each device.

[0082] Furthermore, RAG system 20 may be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA), and some or all of the functional blocks may be realized by the hardware. For example, processor 1001 may be implemented using at least one of these pieces of hardware.

[0083] The notification of information is not limited to the aspects / embodiments described in the present disclosure and may be performed using other methods. For example, the notification of information may be performed by physical layer signaling (e.g., Downlink Control Information (DCI), Uplink Control Information (UCI)), higher layer signaling (e.g., Radio Resource Control (RRC) signaling, Medium Access Control (MAC) signaling, broadcast information (Master Information Block (MIB), System Information Block (SIB))), other signals, or a combination thereof. Furthermore, the RRC signaling may be referred to as an RRC message, and may be, for example, an RRC Connection Setup message, an RRC Connection Reconfiguration message, or the like.

[0084] The order of the procedures, sequences, flowcharts, etc. of each aspect / embodiment described in this disclosure may be changed unless it is consistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0085] Input and output information may be stored in a specific location (for example, memory) or may be managed using a management table. Input and output information may be overwritten, updated, or added to. Output information may be deleted. Input information may be sent to another device.

[0086] The determination may be made based on a value represented by one bit (0 or 1), a Boolean value (true or false), or a numerical comparison (e.g., comparison with a predetermined value).

[0087] Each aspect / embodiment described in this disclosure may be used alone, in combination, or switched depending on the implementation. Furthermore, notification of predetermined information (e.g., notification that "X is true") is not limited to being done explicitly, but may be done implicitly (e.g., by not notifying the predetermined information).

[0088] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure.

[0089] Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.

[0090] Software, instructions, information, etc. may also be transmitted or received over a transmission medium. For example, if software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave), these wired and / or wireless technologies are included within the definition of transmission media.

[0091] The information, signals, etc. described in this disclosure may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0092] Note that terms explained in this disclosure and terms necessary for understanding this disclosure may be replaced with terms having the same or similar meanings. For example, at least one of a channel and a symbol may be a signal (signaling). Furthermore, a signal may be a message. Furthermore, a component carrier (CC) may be called a carrier frequency, a cell, a frequency carrier, etc.

[0093] Furthermore, the information, parameters, etc. described in the present disclosure may be expressed using absolute values, may be expressed using relative values ​​from a predetermined value, or may be expressed using other corresponding information. For example, a radio resource may be indicated by an index.

[0094] The names used for the above-described parameters are not intended to be limiting in any way. Furthermore, the mathematical expressions using these parameters may differ from those explicitly disclosed in this disclosure. The various channels (e.g., PUCCH, PDCCH, etc.) and information elements may be identified by any suitable names, and therefore the various names assigned to these various channels and information elements are not intended to be limiting in any way.

[0095] In this disclosure, the terms "Mobile Station (MS)," "user terminal," "User Equipment (UE)," "terminal," etc. may be used interchangeably.

[0096] A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other suitable terminology.

[0097] As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (e.g., searching in a table, database, or other data structure), ascertaining, and the like. "Determining" and "determining" may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), and the like. Furthermore, "judgment" and "decision" can include regarding resolving, selecting, choosing, establishing, comparing, etc. as having been "judged" or "decided." In other words, "judgment" and "decision" can include regarding some action as having been "judged" or "decided." Furthermore, "judgment (decision)" can be interpreted as "assuming," "expecting," "considering," etc.

[0098] The terms "connected," "coupled," or any variation thereof, refer to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using one or more wires, cables, and / or printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0099] As used in this disclosure, the phrase "based on" does not mean "based only on," unless expressly stated otherwise. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0100] Any reference to an element using a designation such as "first," "second," etc., used in this disclosure does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient way to distinguish between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed or that the first element must in some way precede the second element.

[0101] When used in this disclosure, the terms "include," "including," and variations thereof are intended to be inclusive, similar to the term "comprising." Furthermore, when used in this disclosure, the term "or" is not intended to be an exclusive or.

[0102] In this disclosure, where articles are added by translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are in the plural form.

[0103] In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "coupled" may also be interpreted in the same way as "different." [Explanation of symbols]

[0104] 20...RAG system (generation device), 21...reception unit, 22...decision unit, 23...generation unit, 24...input unit (control unit), 31...generative AI model.

Claims

1. a receiving unit that receives user information including at least biometric information of a user and information regarding the user's music preferences; a determination unit that determines a concept for music production based on the user information; a generating unit that generates prompts for instructing music production based on the concept; A generation device comprising: a control unit that controls a generative AI model that creates music based on the prompts generated by the generation unit.

2. The generating device according to claim 1 , wherein the determining unit estimates parameters indicating tones to be used in music production based on biometric information of the user, and determines the concept based on the parameters.

3. The generating device according to claim 1 , wherein the determining unit estimates parameters indicating a melody to be used in music production based on information about the user's musical preferences, and determines the concept based on the parameters.

4. The generating device according to any one of claims 1 to 3, wherein the determining unit determines information including at least information about the listener, the time of day when the listener listens, the place where the listener listens, and the purpose of listening as the concept.

5. the receiving unit receives the user information further including attribute information of the user; The generating device according to claim 4 , wherein the determining unit determines the information about the listener based on information about the user's musical preference and attribute information about the user.

6. the receiving unit receives the user information further including history information of a music playback app of the user; The generating device according to claim 4 , wherein the determining unit determines the information about the listener based on history information of a music playback application of the user.

7. the receiving unit receives the user information further including history information of a music playback app of the user and a questionnaire result indicating a listening purpose for each listening time period obtained in advance from the user; The generating device according to claim 4 , wherein the determining unit determines the listening purpose based on history information of a music playback app of the user and the survey results.

8. A generation device according to any one of claims 1 to 3, wherein the generation unit generates prompt information to be included in the prompt based on the concept, presents the prompt information to the user, and accepts change requests from the user.

9. The generating device according to claim 8 , wherein the generating unit adds additional information that is highly correlated with the prompting information, presents the prompting information and the additional information to the user, and accepts a change request from the user.

10. A generation method performed by a generation device, receiving user information including at least biometric information of a user and information regarding the user's music preferences; determining a concept for music production based on the user information; generating prompts for directing music production based on said concepts; and controlling a generative AI model to produce music based on the generated prompts.

Images