Information processing device, information processing method, and program

Abstract

A smart phone (corresponding to an example of "information processing apparatus") includes: an application execution unit provided to be able to execute a recording and editing application (corresponding to an example of "an application having a recording function and an editing function of sound source data"); and a display control unit that causes a display unit to variably display a menu for sound quality improvement in conjunction with a type of sound source data selected as a target of sound quality improvement by a user via the record editing application.

Description

Technical Field

[0001] The present disclosure relates to an information processing device, an information processing method, and a program. Background Art

[0002] In recent years, the popularity of portable information processing devices such as smart phones and tablet terminals has been remarkable. In addition, in these portable information processing devices, the performance of processing power has been rapidly improved, and by using such information processing devices, users can easily create various media contents such as music and videos by themselves.

[0003] Application software (application) for recording and editing operated in an information processing device is known for production of music contents. A user can use such an application to edit sound source data recorded by the information processing device or purchased from outside with a high degree of freedom.

[0004] In addition, some applications for recording and editing are capable of editing sound source data recorded by a plurality of information processing devices via a network, thereby supporting a plurality of users to collaboratively produce music content (for example, see Patent Document 1).

[0005] Citation List

[0006] Patent Literature

[0007] Patent Document 1: WO 2019 / 102730 A Summary of the invention Technical issues

[0008] However, in order to further improve the convenience for users when producing music contents, the above conventional technology still has room for further improvement.

[0009] Therefore, the present disclosure proposes an information processing device, an information processing method, and a program that can improve the convenience of a user when creating music content. Solution to the problem

[0010] In order to solve the above-mentioned problem, according to one aspect of the information processing device disclosed herein, it includes an application execution unit, which is configured to be able to execute an application having a recording function and an editing function of sound source data; and a display control unit, which enables the display unit to variably display a menu for sound quality improvement in combination with the type of the sound source data, and the sound source data is selected by the user via the application as the target of the sound quality improvement. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 It is a schematic diagram for explaining an information processing method according to an embodiment of the present disclosure.

[0012] Figure 2is a block diagram illustrating a configuration example of a smartphone according to an embodiment of the present disclosure.

[0013] Figure 3 is a block diagram illustrating a configuration example of a server device according to an embodiment of the present disclosure.

[0014] Figure 4 This is a diagram illustrating a UI example when adding a track.

[0015] Figure 5 It is a diagram illustrating a UI example when selecting a track (part 1).

[0016] Figure 6 It is a diagram illustrating a UI example when selecting a track (part 2).

[0017] Figure 7 It is a diagram illustrating a UI example when selecting a track (part 3).

[0018] Figure 8 is a diagram illustrating a UI example when changing the track type.

[0019] Fig. 9 is a diagram illustrating a UI example when the sound quality improvement process is performed (part 1).

[0020] Fig.10 is a diagram illustrating the content of the sound quality improvement processing.

[0021] Fig.11 is a diagram illustrating a UI example when the sound quality improvement process is performed (part 2).

[0022] Fig.12 is a diagram illustrating a UI example when the sound quality improvement process is performed (part 3).

[0023] Fig.13 is a diagram illustrating a UI example when the sound quality improvement process is performed (part 4).

[0024] Fig.14 is a diagram illustrating a UI example when the sound quality improvement process is performed (part 5).

[0025] Fig.15 2 is a diagram illustrating the notification content of the sound quality improvement process.

[0026] Fig.16 is a diagram illustrating a state in which the sound quality improvement process is being executed.

[0027] Fig.17 is a diagram illustrating a UI example when the sound quality improvement process is performed (part 6).

[0028] Fig.18 is a diagram illustrating a UI example when the sound quality improvement process is performed (part 7).

[0029] Fig.19 This is a diagram for explaining the naming convention of audio track names (part 1).

[0030] Fig. 20 This is a diagram for explaining the naming convention of track names (part 2).

[0031] Fig.21 is a diagram illustrating a UI example when the sound quality improvement process is performed (part 8).

[0032] Fig. 22 This is a view illustrating an example of a UI when switching between hiding and showing.

[0033] Fig.23 is a diagram illustrating a UI example related to a count-in function (part 1).

[0034] Fig.24 is a diagram illustrating a UI example related to the ready-to-shoot function (part 2).

[0035] Fig.25 is a diagram illustrating a UI example related to the ready-to-shoot function (part 3).

[0036] Fig.26 is a diagram illustrating a processing sequence in the case where the information processing system performs sound quality improvement processing.

[0037] Fig. 27 This is a diagram illustrating the hardware configuration of an example of a computer that realizes the functions of a smartphone. DETAILED DESCRIPTION

[0038] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In each of the following embodiments, the same parts are denoted by the same reference numerals, and redundant descriptions will be omitted.

[0039] Furthermore, as a main example, the case where the information processing apparatus according to the embodiment of the present disclosure is the smartphone 10 used by the user will be described below. Hereinafter, the recording and editing application operating on the smartphone 10 is referred to as a "recording editing application".

[0040] In addition, hereinafter, sound source data recorded by the smartphone 10 or purchased from the outside and stored in the storage device of the smartphone 10 is appropriately referred to as a “track”.

[0041] In addition, in the following description, the function of improving the sound quality of each audio track in the recording editing application according to the embodiment of the present disclosure is referred to as a sound quality improvement function. In the drawings described later, the sound quality improvement function may be illustrated as "studio tuning" or "studio tuning". In addition, the processing performed by the sound quality improvement function is referred to as "sound quality improvement processing".

[0042] Furthermore, the description of the present disclosure will be made in the following order of items.

[0043] 1. Overview

[0044] 2. Example of smartphone configuration

[0045] 3. Example of server equipment configuration

[0046] 4. UI example in record editing application

[0047] 4-1. When adding a track

[0048] 4-2. When selecting a track

[0049] 4-3. Changing the track type

[0050] 4-4. When executing sound quality improvement processing

[0051] 4-5. When switching between non-display and display

[0052] 4-6. Ready-to-shoot function

[0053] 5. Processing Sequence

[0054] 6. Modifications

[0055] 7. Hardware composition

[0056] 8. Conclusion

[0057] <<1.Overview>>

[0058] Figure 1 1 is a schematic diagram of an information processing method according to an embodiment of the present disclosure. The information processing method according to an embodiment of the present disclosure is executed by an information processing system 1. Figure 1 As shown in the diagram, the information processing system 1 includes a smartphone 10 and a server device 100 .

[0059] The smartphone 10 is a portable information processing device used by a user. The smartphone 10 has a platform capable of executing a record editing application according to an embodiment of the present disclosure.

[0060] like Figure 1As shown in the diagram, the smartphone 10 includes a microphone 11, a speaker 12, and a display unit 15. The microphone 11 is provided at one end close to a mouthpiece in the longitudinal direction of the smartphone 10. The speaker 12 is provided at the other end close to an earphone relative to the one end.

[0061] The display unit 15 is implemented as an operation unit 14 described later (see Figure 2 ) integrated touch screen, and has a rectangular shape. The touch screen detects a touch operation of a user. As a detection method of the touch screen, known methods such as a capacitance method, a resistance film method, a surface acoustic wave method (or an ultrasonic method), an infrared method, an electromagnetic induction method, and a load detection method are used.

[0062] When the note editing application is executed on the smartphone 10 , the touch screen displays various user interfaces (user interface; UI) related to the note editing application to detect a touch operation of the UI by the user.

[0063] In addition, when the operation of starting recording is performed in the recording editing application, the microphone 11 collects the sound emitted from the sound source (for example, a musical instrument) and records the sound as the sound source data of the track type specified in advance when recording. In addition, when the operation of reproducing the sound source data is performed in the recording editing application, the speaker 12 outputs the sound source data selected when reproducing.

[0064] On the other hand, in order to further improve the convenience for users when producing music content, there is still room for further improvement in conventional recording and editing applications.

[0065] As described above, in recent years, the processing power of portable information processing devices such as smartphones 10 has been rapidly improved, and users can easily create music content by themselves by using recording editing applications. In addition, at the same time, users have more opportunities to disclose the created music content to, for example, social network services (SNS), video distribution services, etc.

[0066] Therefore, in recent years, there has been an increasing demand for improvement in the sound quality of music content produced by users. Note that examples of the “sound quality improvement” mentioned here may include, for example, “audio separation” for separating a plurality of different sound sources included in a track recorded using one microphone 11, “denoising” for removing noise, “reverberation removal” for eliminating unnecessary reverberation, and the like. In addition, “microphone simulation” for reproducing the microphone characteristics of a high-performance microphone, “studio simulation” for adding unique reverberation of a recording studio, and the like may be exemplified.

[0067] The reality is that conventional recording and editing applications do not fully expand the sound quality improvement function. For example, a track can be recorded with a single sound source or with multiple sound sources, and the types of tracks are different. A track including multiple sound sources can be the processing target of the above-mentioned "audio separation", but a track with a single sound source cannot be the processing target. In the case of using conventional recording and editing applications, users need to grasp this difference according to the type of tracks and specify the setting content about sound quality improvement one by one.

[0068] Thus, in the information processing method according to the embodiment of the present disclosure, the smartphone 10 variably displays a menu for sound quality improvement in conjunction with the type of sound source data selected as a target of sound quality improvement.

[0069] Specifically, Figure 1 As shown in the diagram, the smartphone 10 first executes the recording editing application (step S1). Then, the smartphone 10 variably displays a menu for sound quality improvement in accordance with the type of sound source data selected as a target of sound quality improvement in the recording editing application (step S2).

[0070] As described above, by automating the menu according to the type of sound source data, the user does not need to grasp the difference corresponding to the type of track, nor does he need to specify the setting contents related to the sound quality improvement one by one. In addition, it is possible to prevent the user from making an erroneous specification. That is, it is possible to further improve the convenience of the user when creating music content. Note that reference will be made later on. Figure 4 2 and subsequent figures describe specific examples of various UIs of the record editing application according to an embodiment of the present disclosure, including the case of step S2.

[0071] Then, regarding sound quality improvement, the smartphone 10 transmits the sound source data to the server device 100 together with the content designated via the variably displayed menu (step S3 ).

[0072] The server device 100 is a device configured to be able to communicate with the smartphone 10 via a network N such as a mobile phone network or the Internet. The server device 100 is implemented as a cloud server, for example.

[0073] The server device 100 has a sound quality improvement processing model 102a (see Figure 3 ), and is configured to be able to perform sound quality improvement processing using the sound quality improvement processing model 102a. The sound quality improvement processing model 102a is, for example, a deep neural network (DNN) model learned using a deep learning algorithm.

[0074] The server device 100 performs sound quality improvement processing on the sound source data acquired from the smartphone 10 by artificial intelligence (AI) processing using the sound quality improvement processing model 102a (step S4). Then, the server device 100 transmits the sound quality improved data to the smartphone 10, and the smartphone 10 receives the data (step S5).

[0075] Note that since the server device 100 comprehensively performs sound quality improvement processing with a high processing load through the cloud server model, the smart phone 10 can continue to use the recording editing application or execute other applications even during the sound quality improvement processing without affecting the sound quality improvement processing.

[0076] <<2. Example of Smartphone Configuration>>

[0077] Next, a configuration example of the smartphone 10 will be described. Figure 2 1 is a block diagram illustrating a configuration example of a smartphone 10 according to an embodiment of the present disclosure. Figure 2 and later shown Figure 3 , only components required to describe the features of an embodiment of the present disclosure are shown, and description of general components is omitted.

[0078] in other words, Figure 2 and Figure 3 The components shown in the diagram are functionally conceptual and do not necessarily need to be physically constructed as shown. For example, the specific forms of distribution and integration of each block are not limited to those shown in the diagram, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc.

[0079] In use Figure 2 and Figure 3 In the description of the present invention, descriptions of components that have already been described may be simplified or omitted.

[0080] like Figure 2 As shown in the diagram, the smartphone 10 includes a microphone 11 , a speaker 12 , a communication unit 13 , an operation unit 14 , a display unit 15 , a storage unit 16 , and a control unit 17 .

[0081] Since the microphone 11 and the speaker 12 have been described, their description is omitted here. The communication unit 13 is implemented by a communication module, etc. The communication unit 13 is wirelessly connected to the above-mentioned network N, and implements communication with the server device 100 via the network N.

[0082] The operation unit 14 is an operation component mounted on the smartphone 10 and is realized by, for example, a touch panel. The display unit 15 is a display component mounted on the smartphone 10 and is realized by, for example, a display.

[0083] Note that the operation unit 14 and the display unit 15 are integrated to constitute the above-mentioned touch screen, for example. Then, the operation unit 14 may be a software component displayed on the display unit 15, and is, for example, a graphical user interface (GUI) that can allow a record editing application to be displayed on the display unit 15 in an operable manner.

[0084] The storage unit 16 is implemented by, for example, a semiconductor storage element such as a random access memory (RAM), a read only memory (ROM), or a flash memory. Figure 2 In the example illustrated in FIG. 1 , the storage unit 16 stores application information 16a. The application information 16a is information including a program of a record editing application, various parameters used during operation of the record editing application, and the like.

[0085] The control unit 17 is a controller and is implemented by, for example, a central processing unit (CPU), a microprocessing unit (MPU), etc. using a RAM as a work area, executing a program according to an embodiment of the present disclosure stored in the storage unit 16. In addition, for example, the control unit 17 may be implemented by an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

[0086] The control unit 17 includes an application execution unit 17 a , a display control unit 17 b , and a communication control unit 17 c , and implements or executes functions and actions of information processing described below.

[0087] The application execution unit 17a reads the application information 16a stored in the storage unit 16 and executes the recording editing application. For example, the application execution unit 17a adds a track according to the operation content of adding a track in the recording editing application input from the operation unit 14.

[0088] In addition, for example, the application execution unit 17a selects a track according to the operation content when selecting a track in the recording editing application input from the operation unit 14. In addition, for example, the application execution unit 17a changes the track type of the sound source data according to the operation content when changing the track type in the recording editing application input from the operation unit 14.

[0089] Furthermore, for example, the application execution unit 17a executes the sound quality improvement process according to the operation content when executing the sound quality improvement process in the recording editing application input from the operation unit 14. Furthermore, for example, the application execution unit 17a switches the non-display / display of the audio track according to the operation content regarding the non-display / display switching of the audio track in the recording editing application input from the operation unit 14. Furthermore, for example, the application execution unit 17a executes the count-in function according to the operation content regarding the count-in function in the recording editing application input from the operation unit 14.

[0090] In addition, the application execution unit 17a causes the display control unit 17b to perform display control of visual information including various UIs according to various operation contents when the record editing application is executed. Figure 4 to Figure 25 Describe specific examples of various UIs.

[0091] The display control unit 17b performs display control of visual information on the display unit 15 when the record editing application is executed based on an instruction from the application execution unit 17a. The communication control unit 17c performs communication control with the server device 100 when the record editing application is executed.

[0092] The communication control unit 17c uploads, for example, sound source data that is a target of sound quality improvement processing to the server device 100 via the communication unit 13. Furthermore, the communication control unit 17c downloads, for example, data on which sound quality improvement processing has been performed in the server device 100 from the server device 100 via the communication unit 13.

[0093] <<3. Example of server equipment configuration>>

[0094] Next, a configuration example of the server device 100 will be described. Figure 3 is a block diagram illustrating a configuration example of the server device 100 according to an embodiment of the present disclosure.

[0095] like Figure 3 As shown in the diagram, the server device 100 includes a communication unit 101 , a storage unit 102 , and a control unit 103 .

[0096] Similar to the above-described communication unit 13 , the communication unit 101 is implemented by a communication module, etc. The communication unit 101 is connected to the network N in a wired or wireless manner to implement communication with the smartphone 10 via the network N.

[0097] Similar to the above-mentioned storage unit 16, the storage unit 102 is implemented by, for example, a semiconductor storage element such as a RAM, a ROM, or a flash memory. In addition, the storage unit 102 is implemented by a disk device such as a hard disk device or an optical disk device. Figure 3 In the example shown in the diagram, the storage unit 102 stores a sound quality improvement processing model 102a.

[0098] As described above, the sound quality improvement processing model 102a is, for example, a deep neural network (DNN) model learned using a deep learning algorithm. Note that the learning algorithm of the sound quality improvement processing model 102a is not limited to deep learning. The sound quality improvement processing model 102a is read by the sound quality improvement processing unit 103b described later, and when the sound source data to be processed is input, the sound quality improvement processing module performs sound quality improvement processing on the sound source data using the specified setting content (options), and outputs the data subjected to the sound quality improvement processing.

[0099] The control unit 103 is a controller similar to the above-described control unit 17, and is implemented, for example, by a CPU, MPU, etc. executing various programs (not shown) stored in the storage unit 102 using the RAM as a work area. In addition, for example, the control unit 103 may be implemented by an integrated circuit such as an ASIC or an FPGA.

[0100] The control unit 103 includes an acquisition unit 103a, a sound quality improvement processing unit 103b, and a transmission unit 103c, and implements or executes functions and actions of information processing described below.

[0101] The acquisition unit 103a acquires the options of the sound quality improvement processing and the sound source data to be processed designated in the smartphone 10 via the communication unit 101. In addition, the acquisition unit 103a outputs the acquired data to the sound quality improvement processing unit 103b.

[0102] The sound quality improvement processing unit 103b reads the sound quality improvement processing model 102a from the storage unit 102, and inputs each data received from the acquisition unit 103a to the sound quality improvement processing model 102a. In addition, the sound quality improvement processing unit 103b acquires the sound quality improvement processed data output from the sound quality improvement processing model 102a, and outputs the data to the sending unit 103c.

[0103] The transmission unit 103 c transmits the data subjected to the sound quality improvement processing and received from the sound quality improvement processing unit 103 b to the smartphone 10 via the communication unit 101 .

[0104] <<4. UI Example in Record Editing Application>>

[0105] Next, we will refer to Figure 4 to Figure 25 Various UI examples in the record editing application according to the embodiment of the present disclosure are sequentially described.

[0106] <4-1. When adding a track>

[0107] First, a UI example when a track is added on the recording screen of the recording editing application will be described. Figure 4 This is a diagram illustrating a UI example when adding a track.

[0108] When the record editing application is activated, the display control unit 17b displays a record screen selection button RB and an edit screen selection button EB, as shown in FIG. Figure 4 Then, when the user performs a touch operation on the recording screen selection button RB, the display control unit 17b displays a track adding screen including a track adding button A1, as shown in FIG. Figure 4 As shown in the diagram on the left.

[0109] Then, when the user performs a touch operation on the track adding button A1, the display control unit 17b displays the track type selection screen A2, as shown in FIG. Figure 4 In the recording editing application according to the embodiment of the present disclosure, for example, the options that can be specified in the sound quality improvement processing are different for each musical instrument serving as a sound source, so when adding a track, the user is allowed to select the track type on the track type selection screen A2.

[0110] Here, as in Figure 4 As shown in the diagram in the center of FIG, it is assumed that the user selects the track type T3. The track type T3 corresponds to the type of sound source data of multiple sound sources including vocals and guitars (see "Vocal & Guitar" in the figure) as the sound sources. That is, when the recording mode for simultaneously recording multiple musical instruments is selected, the track type T3 is specified.

[0111] By executing the above-described “audio separation” as one of the options of the sound quality improvement processing, the sound source data recorded in this recording mode can be separated into the sound source data of the sound of each musical instrument after recording.

[0112] Then, when the track type T3 is selected, the display control unit 17b erases the track type selection screen A2 and displays the icon I3 corresponding to the track type T3, as shown in FIG. Figure 4 Then, as shown in the diagram on the right of Figure 4 As shown in the diagram on the right of FIG. , when the user touches the record button SB, the application execution unit 17a starts a record operation, and the display control unit 17b performs real-time display of an input waveform corresponding to the record operation.

[0113] <4-2. When selecting a track>

[0114] Next, a UI example at the time of track selection on the editing screen of the recording editing application will be described. Figure 5 to Figure 7 1 to 3 are diagrams illustrating an example of a UI when selecting a track. When the user touches the edit screen selection button EB, the display control unit 17b displays an edit screen such as Figure 5 As shown in the diagram.

[0115] On the edit screen, Figure 5 As shown in the diagram in FIG. 1 , the sound source data that are candidates for the editing target are displayed in a list form. Here, when the user performs a touch operation on the sound source data to be edited, the corresponding sound source data is selected, and the selected sound source data is highlighted, as shown in the diagram in the M1 portion in the figure. That is, the display control unit 17 b clearly indicates the selected sound source data by highlighting it.

[0116] Note that Figure 5 As shown in the diagram, a label R is added to each sound source data and displayed. The display control unit 17b can clearly indicate the selected sound source data by changing the display of the label R. For example, Figure 5 As shown in the diagram, it is assumed that the sound source data "Track_1" is selected.

[0117] Then, if Figure 6 As shown in the diagram, for example, the display control unit 17b enlarges and displays the label R1 of "Track_1" so as to extend in the row direction of the row displaying "Track_1". The display control unit 17b can clearly indicate the selected sound source data by the enlarged display of the label R1.

[0118] In addition, if Figure 7 As shown in the diagram, the display control unit 17b can also perform an expanded display such as expanding the entire width of the row of "Track_1" in which the label R1 including "Track_1" is displayed. The display control unit 17b can also clearly indicate the selected sound source data by expanding the entire width of the expanded display. Note that in the case of releasing the selection of the sound source data, the display control unit 17b cancels the Figure 6 and Figure 7 , and returns the display to the state before the selection.

[0119] <4-3. Changing the track type>

[0120] Next, a UI example when changing the track type on the editing screen will be described. Figure 8 1 is a diagram illustrating an example of a UI when changing a track type. When the user performs a predetermined touch operation on the sound source data selected on the editing screen, the display control unit 17b displays a track menu TM on which a predetermined operation can be performed on the corresponding sound source data, such as Figure 8 As shown in the diagram.

[0121] In the Track Menu TM, "Change Track Type", "Change Track Name", "Copy" and "Delete" are available.

[0122] exist Figure 8In the example of FIG. 1 , it is assumed that the user selects the sound source data “Track_1” of the track type T3 corresponding to the icon I3, and further selects “Change track type”, as illustrated in the M2 portion of the figure.

[0123] Then, the display control unit 17b displays a change track type screen CT, as in Figure 8 Here, it is assumed that the user selects the track type T1 as illustrated in the figure. The track type T1 corresponds to the sound source data of vocal music (see "Vocal Music" in the figure) as a single sound source.

[0124] Then, as in Figure 8 As shown in the following figure, the display control unit 17b displays an icon I1 corresponding to the track type T1 of the corresponding "Track_1". Note that when the track type of a single sound source is changed to the track type T1, the above-mentioned "audio separation" cannot be selected as an option for sound quality improvement processing. That is, the user can change Figure 8 You can change the options that can be selected in the sound quality improvement process by adjusting the track type as shown in the figure.

[0125] <4-4. When executing sound quality improvement processing>

[0126] Next, a UI example when the sound quality improvement process is performed on the editing screen will be described. Fig. 9 1 is a diagram illustrating an example of a UI when performing sound quality improvement processing (part 1). Fig.10 is a diagram illustrating the content of the sound quality improvement processing. Figure 11 to Figure 14 The following are diagrams (Part 2) to (Part 5) illustrating examples of UI when performing sound quality improvement processing. Fig.15 : is a diagram illustrating the notification content of the sound quality improvement process. Fig.16 is a diagram illustrating a state in which the sound quality improvement process is being executed.

[0127] Fig.17 and Fig.18 are diagrams (part 6) and (part 7) illustrating a UI example when the sound quality improvement process is performed. Fig.19 and Fig. 20 The following are diagrams (Part 1) and (Part 2) showing the naming convention for track names. Fig.21 is a diagram illustrating a UI example when the sound quality improvement process is performed (part 8).

[0128] As in Fig. 9As shown in the diagram of the above figure, when the user taps the sound quality improvement (studio tuning) button TB on the editing screen in a state where the user selects a piece of sound source data (in this example, "Track_1"), the display control unit 17b displays the sound quality improvement processing execution screen, as shown in Fig. 9 As shown in the diagram below.

[0129] On the sound quality improvement processing execution screen, in addition to the data capacity of the selected sound source data as illustrated in the D1 portion of the figure, the remaining available data capacity is also displayed as illustrated in the D2 portion. In addition, on the sound quality improvement processing execution screen, a menu M3 for sound quality improvement indicating options selectable in the sound quality improvement processing is displayed.

[0130] like Fig.10 As shown in the diagram, in an embodiment of the present disclosure, sound quality improvement processing such as the above-mentioned "audio separation", "denoising", "deviation of reverberation", "microphone simulation" and "recording studio simulation" can be performed.

[0131] As reference Figure 1 As described above, in the information processing method according to the embodiment of the present disclosure, by using the AI ​​processing of the sound quality improvement processing model 102a, sound quality improvement processing is performed on the sound source data acquired from the smartphone 10. As a result, the sound source data can be up-converted to the sound quality of professional recording studio quality.

[0132] Regarding “audio separation”, if anything other than the points already described is supplemented, the smartphone 10 side can listen to the separated sounds alone, or mix them at an arbitrary volume balance of the user.

[0133] Furthermore, as a complement to “denoising”, for example, by using the “audio separation” technique, any other sound can be separated and removed as noise from the sound of vocals or guitar included in the sound source data of the track type T3.

[0134] In addition, as a supplement to "reverberation removal", the reverberation in a general house (room reverberation) can be suppressed and removed through AI processing, and the sound quality can be changed to that of studio recording material.

[0135] In addition, as a supplement to "Microphone Simulation", the frequency characteristics of high-performance vacuum tube condenser microphones can be reproduced.

[0136] In addition, with "Studio Simulation", you can add the unique reverb of a recording studio, etc., without adding reverb as an effect.

[0137] Then, the display control unit 17b variably displays a menu M3 for sound quality improvement in conjunction with the type of the selected sound source data. For example, in the case where sound source data of the track type T3 is selected, the display control unit 17b displays a menu M3 from which "audio separation & denoising", "reverberation removal", "microphone simulation" and "studio simulation" can be selected, such as Fig.11 As shown in the diagram.

[0138] Note that in "Audio Separation", the sound source data is separated into the selected track type and others. Thus, in the case of track type T3, the sound source data is separated into vocal sounds, guitar sounds, and other sounds. In the embodiment of the present disclosure, vocals and guitars are exemplified as multiple sound sources, but by setting other musical instruments such as piano and drums as learning targets of the sound quality improvement processing model 102a, other musical instruments such as piano and drums can also be set as separation targets.

[0139] Then, the server device 100 transmits only the data of the sound indicated by the selected track type among the separated sounds to the smartphone 10. Since the noise is contained in the other sounds, the noise is also removed by performing the "audio separation". Fig.11 As shown in the diagram, the display control unit 17b displays "Audio Separation & Denoising" as the name of the option selectable in the menu M3.

[0140] Similarly, for example, in the case where the sound source data of "Vocal" as the track type T1 described above is selected, the display control unit 17b displays a menu M3 from which "Denoising", "Dereverberation", "Microphone Simulation" and "Studio Simulation" can be selected, such as Fig.12 As shown in the diagram.

[0141] Even when the audio track type is a single sound source, the server device 100 performs "denoising" using the "audio separation" technology as described above. However, the server device 100 only transmits the data of the sound of the single sound source to the smartphone 10, and does not perform the transmission in multiple parts. Therefore, the option name is not "audio separation & denoising", but "denoising".

[0142] Similarly, for example, in the case where the sound source data of the track type "guitar" is selected, the display control unit 17b displays a menu M3 from which "denoising" and "studio simulation" can be selected, such as Fig.13 For example, in the case where the sound source data of the track type "guitar" is not data recorded via the microphone 11, but is sound source information purchased by the user, etc., "deviating reverberation" and "microphone simulation" may not be displayed because they are not required to be selected, such as Fig.13 As shown in the diagram.

[0143] Then, if Fig.14 As shown in the diagram, when the user specifies an option by the selection switch SW on the sound quality improvement processing execution screen and touches the execution (EXECUTE) button EXB, the sound quality improvement processing is executed. During the execution of the sound quality improvement processing, the display control unit 17b notifies the progress status of the sound quality improvement processing, as shown in the portion M4 in the figure.

[0144] like Fig.15 As shown in the diagram, the display control unit 17b displays "Uploading", "Tuning", "Downloading" and an indicator indicating the progress as notification content. In addition, although not shown in the diagram, a completion notification is displayed after completion.

[0145] "Uploading", "Tuning" and "Downloading" correspond to Fig.16 Note that since the sound quality improvement process takes time, in the smart phone 10, Fig.16 As shown in the diagram, the recording editing application can be used continuously despite the functional limitations. In addition, other applications can be used. For example, in the case where the user uses other applications to wait for the completion of the sound quality improvement process, such as Fig.15 and Fig.16 As shown in the diagram, the progress status of the sound quality improvement process is displayed on the notification panel 15 a of the display unit 15 .

[0146] Furthermore, in the case where the user continuously uses the recording and editing application to wait for the completion of the sound quality improvement process, the user can record and edit the audio tracks other than the audio tracks undergoing the sound quality improvement process. In addition, only operations related to reproduction can be performed on the audio tracks undergoing the sound quality improvement process. Operations related to reproduction include reproduction, muting, volume adjustment, etc. Thus, editing such as trimming or compounding cannot be performed on the audio tracks undergoing the sound quality improvement process. As a result, the consistency of the audio tracks that are the targets of the sound quality improvement process can be ensured.

[0147] Then, when the sound quality improvement process is completed, such as Fig.18 As shown in the diagram, each audio track that has been processed for sound quality improvement is displayed in a list form on the editing screen of the recording editing application. At this time, the display control unit 17b displays each audio track that has been processed for sound quality improvement at a position above the audio track before the sound quality improvement process. The display control unit 17b also displays an icon DI indicating that the sound quality improvement process has been performed.

[0148] In addition, for example, the display control unit 17b grays out the display of the track before the sound quality improvement process. In addition, the track before the sound quality improvement process is muted.

[0149] Since the track before the sound quality improvement process is basically unnecessary, the track is automatically muted after the sound quality improvement process. Note that the user can switch the muted state between the track after the sound quality improvement process and the track before the sound quality improvement process to compare the listening. In addition, in the case where the user does not like the track after the sound quality improvement process, the user can edit the track after the sound quality improvement process after muting the track before the sound quality improvement process, or perform the sound quality improvement process again. When performing the sound quality improvement process again, the user can change the option to be specified from the previous option.

[0150] In addition, the application execution unit 17a names the audio track after the sound quality improvement processing different from the audio track name before the sound quality improvement processing. Fig.19 As shown in the diagram, the basic naming convention is obtained by adding (Tuned) to the original track name before the sound quality improvement process.

[0151] Then, in the case of performing "audio separation", the track name is named in the form in which the above (tuned) is in the form of (tuned_sound source name). For example, in the case where the sound source data of the track type T3 is subjected to audio separation, as Fig. 20 As shown in the diagram, the track name of the track of the vocal sound subjected to the sound quality improvement process is "Original track name (Tuned_Vo)". In addition, the track name of the track of the guitar subjected to the sound quality improvement process is "Original track name (Tuned_Gt)".

[0152] In this way, by changing the track name before and after the sound quality improvement processing, for example, when each track is output as a file, the file name is set to the format of track name + extension, so that even after the file is output, it is possible to immediately identify whether the sound quality improvement processing has been performed by the file name alone.

[0153] In addition, if Fig.18 As shown in the diagram, the display control unit 17b superimposes and displays the named track name on the track that has undergone the sound quality improvement process, and displays an icon corresponding to the type of the track that has undergone the sound quality improvement process.

[0154] exist Fig. 20 In the example of , the icon I3 displayed for the track before the sound quality improvement process is changed to icons I1 and I2 in each corresponding track after the sound quality improvement process. In this way, the display control unit 17b clearly indicates that the sound quality improvement process has been performed, especially the audio separation has been performed, through the icon indicating the track type and the track name.

[0155] In addition, if Fig.21As shown in the diagram, when the user touches the icon DI indicating that the sound quality improvement process has been performed, the display control unit 17b displays a pop-up window P1 indicating the content of the sound quality improvement process performed. As a result, the user can immediately grasp the content of the sound quality improvement process performed on the corresponding track by a simple operation of touching the icon DI.

[0156] <4-5. When switching between non-display and display>

[0157] Note that in a portable information processing device such as a smartphone 10, the display area of ​​the display unit 15 is limited, so there is a case where the user wants to temporarily hide unnecessary tracks even though the tracks have not been deleted. In this case, the recording editing application can display a track hide / display switching screen.

[0158] Fig. 22 2 is a diagram illustrating an example of a UI when switching between non-display and display. Fig. 22 As shown in the diagram, on the non-display / display switching screen, audio tracks that can be edited by the recording editing application are displayed in list form.

[0159] A check box CB is provided in each list. On the non-display / display switching screen, the user selects the track to be displayed only by the check box CB and performs a touch operation on the next (NEXT) button NB. Then, thereafter, the display control unit 17b sets only the track selected in the check box CB as the display target and makes the unselected track non-display. The non-displayed track is automatically muted and is outside the reproduction target.

[0160] As a result, the user can arbitrarily and easily change the track list display on the display unit 15 so that it is easy to view and easy to edit.

[0161] <4-6. Ready-to-shoot function>

[0162] In addition, the recording editing application according to the embodiment of the present disclosure has a pre-beat function. The pre-beat function is a function of performing counts on the recording screen in synchronization with the start of recording. The recording editing application implements this pre-beat function by performing count display on the display unit 15 and count output from the speaker 12.

[0163] Figure 23 to Figure 25 1 and 2 are diagrams (part 1) to (part 3) illustrating examples of UI related to the ready-take function. When the user specifies the use of the ready-take function from the recording screen of the recording editing application through a predetermined operation, the display control unit 17b displays a setting screen for the ready-take function, such as Fig.23 As shown in the diagram.

[0164] The setting screen is provided with a rhythm (see "rhythm" in the figure) setting section, a count sound setting section, a beat setting section TS and a count-in length setting section CI. The rhythm can be set by specifying an arbitrary value. As the count sound, the count sound of a metronome (see "metronome" in the figure), the count sound of a drumstick, etc. can be selected.

[0165] Furthermore, the user can select and set 4 / 4 beat, 3 / 4 beat, 6 / 8 beat, etc. from the setting part TS. Furthermore, the user can select and set the number of measures indicating the length of the preparatory beat from more than 1 measure, such as 1 measure, 2 measures, 4 measures, or 8 measures, from the setting part CI1 expanded by touching the setting part CI.

[0166] Here, it is assumed that the user selects 4 / 4 as the tempo and selects 4 bars as the number of measures, as in Fig.23 As shown in the diagram of parts M5 and M6. Then, Fig.24 As shown in the diagram, it is assumed that the user positions the music position cursor In at the time stamp "25" on the recording screen and performs a touch operation on the recording button SB with this position as the recording start position.

[0167] Then, if Fig.25 As shown in the diagram, the display control unit 17b automatically causes the music position cursor In to jump to the corresponding position 4 bars before the time stamp "25", and starts the count-in from the corresponding position.

[0168] That is, the display control unit 17b moves the music position cursor In according to the set rhythm, and performs count display in the count display area CR. The display control unit 17b performs upward count display starting from negative values ​​such as "-2", "-1", ... in the count display area CR until the music position cursor In reaches 1 bar immediately before the recording start position. Fig.25 As shown in the diagram, "-2" corresponds to the previous 3 bars and "-1" corresponds to the previous 2 bars.

[0169] In addition, the display control unit 17b performs a count-up display starting from "1" in the count display area CR one bar before the recording start position. Fig.23 In the case of the 4 / 4 beat setting shown in the diagram, the display control unit 17b counts up from 1 to 4 according to the rhythm, such as "1", "2", "3" and "4". Fig.25 As shown in the diagram.

[0170] Note that for each one-bar count-up display by the display control unit 17b, the application execution unit 17a causes the speaker 12 to output a count-up sound in synchronization with the count-up. Then, recording starts from the point in time when the music position cursor In reaches the recording start position.

[0171] According to such a count-in function, the user can freely set the count-in function by, for example, selecting a length of the count-in exceeding 2 bars in accordance with the method of obtaining the user's rhythm. In addition, the user can obtain the timing of starting recording at a desired timing while using the count-in function corresponding to the setting.

[0172] <<5. Processing sequence>>

[0173] Next, we will refer to Fig.26 A processing sequence in the case where the information processing system 1 according to the embodiment of the present disclosure performs sound quality improvement processing is described. Fig.26 1 is a diagram illustrating a processing sequence in a case where the information processing system 1 performs sound quality improvement processing.

[0174] like Fig.26 As shown in the diagram, the smartphone 10 first activates the record editing application (step S101). Then, the smartphone 10 detects a touch operation on the sound quality improvement button TB on the editing screen of the record editing application (step S102).

[0175] Then, the smartphone 10 variably displays the menu M3 for sound quality improvement in accordance with the type of sound source data selected when the sound quality improvement button TB is touched (step S103 ).

[0176] Subsequently, the smartphone 10 detects a selection operation of an option of the sound quality improvement process via the variably displayed menu M3 (step S104 ) Then, the smartphone 10 transmits the selected option and the sound source data to the server device 100 (step S105 ).

[0177] The server device 100 acquires the data transmitted from the smartphone 10 in step S105 , and performs sound quality improvement processing by AI processing based on the data (step S106 ).

[0178] Then, when the sound quality improvement process is completed, the server device 100 transmits the sound quality improvement processed data to the smartphone 10 (step S107). Note that, in the case where the sound quality improvement process performed includes the audio separation process, the server device 100 transmits the sound quality improvement processed data of the separated sound source to the smartphone 10. At this time, the data separated as other sounds other than the sound source is not transmitted.

[0179] Then, the smartphone 10 receives the data subjected to the sound quality improvement processing transmitted from the server device 100 (step S108). The user checks the data subjected to the sound quality improvement processing and performs editing and the like as necessary.

[0180] Furthermore, if the user desires to perform the sound quality improvement process again, if the user selects the sound source data to be processed on the editing screen and touches the sound quality improvement button TB, the smartphone 10 repeats the process starting from step S102 .

[0181] <<6. Modifications>>

[0182] Meanwhile, the embodiments of the present disclosure described above may include several modifications.

[0183] In the embodiment of the present disclosure described above, the recording editing application records the sound collected by the microphone 11 included in the smartphone 10, but the microphone used in the recording function may be an external microphone connected to the smartphone 10. Similarly, the speaker used by the recording editing application may be an external speaker connected to the smartphone 10, rather than the speaker 12 included in the smartphone 10.

[0184] Furthermore, in the above-described embodiment, the server device 100 performs the sound quality improvement process using the sound quality improvement process model 102 a , but the smartphone 10 may perform such a sound quality improvement process.

[0185] In this case, the server device 100 functions as a learning device that learns the sound quality improvement processing model 102a. In addition, the smartphone 10 receives distribution of the learned sound quality improvement processing model 102a from the server device 100 and holds the sound quality improvement processing model 102a in the smartphone 10.

[0186] Then, when the user performs an operation to execute the sound quality improvement process, the smartphone 10 executes the sound quality improvement process using the retained sound quality improvement process model 102a. In this case, there is an advantage that the response of the sound quality improvement process can be improved. On the other hand, the smartphone 10 needs to have a processing capability capable of executing the sound quality improvement process.

[0187] Furthermore, in the above-described embodiments, as the sound quality improvement processing, “audio separation”, “denoising”, “deviating erverberation”, “microphone simulation”, and “studio simulation” are exemplified, but the sound quality improvement processing is naturally not limited thereto.

[0188] For example, "microphone simulation" may be a process in which a user selects a microphone from a plurality of high-performance microphones and reproduces the microphone characteristics of the selected microphone. Similarly, "recording studio simulation" may be a process in which a user selects a recording studio from a plurality of well-known recording studios and adds a unique reverb of the selected recording studio. Furthermore, instead of a recording studio, a user may select a concert venue from a plurality of well-known concert venues, and sound quality improvement processing such as "concert simulation" that adds a unique reverb of the selected concert venue may be performed.

[0189] Among the processes described in the embodiments of the present disclosure above, all or part of the processes described as being performed automatically may be performed manually, or all or part of the processes described as being performed manually may be performed automatically by known methods. In addition, unless otherwise specified, the processes, specific names, and information containing various data and parameters shown in this document and the accompanying drawings may be arbitrarily changed. For example, the various types of information illustrated in each figure are not limited to the information illustrated.

[0190] In addition, each component of each device illustrated in the drawings is conceptual in function and does not necessarily have to be physically constructed as illustrated in the drawings. That is, the specific form of distribution and integration of each device is not limited to the form illustrated, and all or part of it can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc.

[0191] In addition, the above-mentioned embodiments can be appropriately combined in areas where the processing contents do not contradict each other. In addition, the order of each step illustrated in the sequence diagram or flowchart of this embodiment can be appropriately changed.

[0192] <<7. Hardware Configuration>>

[0193] Furthermore, for example, the smartphone 10 and the server device 100 according to the embodiment of the present disclosure described above are composed of a server having Fig. 27 The present invention is realized by a computer 1000 having the configuration illustrated in FIG. A smartphone 10 will be described as an example. Fig. 27 10 is a hardware configuration diagram illustrating an example of a computer 1000 that realizes the functions of the smartphone 10. The computer 1000 includes a CPU 1100, a RAM 1200, a ROM 1300, an auxiliary storage device 1400, a communication interface 1500, and an input / output interface 1600. The respective units of the computer 1000 are connected via a bus 1050.

[0194] The CPU 1100 operates based on the programs stored in the ROM 1300 or the auxiliary storage device 1400 and controls the respective units. For example, the CPU 1100 expands the programs stored in the ROM 1300 or the auxiliary storage device 1400 in the RAM 1200 and executes processing corresponding to the various programs.

[0195] The ROM 1300 stores a boot program such as a basic input output system (BIOS) executed by the CPU 1100 when the computer 1000 is activated, a program depending on the hardware of the computer 1000 , and the like.

[0196] The auxiliary storage device 1400 is a computer-readable recording medium that non-temporarily records a program executed by the CPU 1100, data used by the program, etc. Specifically, the auxiliary storage device 1400 is a recording medium that records a program according to an embodiment of the present disclosure corresponding to the application information 16a as an example of program data 1450.

[0197] The communication interface 1500 is an interface for connecting the computer 1000 to the external network 1550. For example, the CPU 1100 receives data from other devices via the communication interface 1500 or transmits data generated by the CPU 1100 to other devices.

[0198] The input / output interface 1600 is an interface for connecting the input / output device 1650 and the computer 1000. For example, the CPU 1100 receives data from an input device such as a microphone or a touch panel via the input / output interface 1600. In addition, the CPU 1100 sends data to an output device such as a display or a speaker via the input / output interface 1600. In addition, the input / output interface 1600 can function as a media interface for reading a program recorded in a predetermined recording medium (medium), etc. The medium is, for example, an optical recording medium such as a digital versatile disc (DVD) or a phase-change rewritable optical disc (PD), a magneto-optical recording medium such as a magneto-optical disc (MO), a magnetic tape medium, a magnetic recording medium, a semiconductor memory, etc.

[0199] For example, in the case where the computer 1000 functions as the smartphone 10 according to the embodiment of the present disclosure, the CPU 1100 of the computer 1000 realizes the function of the control unit 17 by executing the program loaded on the RAM 1200. In addition, the auxiliary storage device 1400 stores the program and data according to the present disclosure in the storage unit 16. Note that the CPU 1100 reads the program data 1450 from the auxiliary storage device 1400 and executes the program data, but as another example, these programs may be acquired from other devices via the external network 1550.

[0200] <<8. Conclusion>>

[0201] As described above, according to an embodiment of the present disclosure, the smart phone 10 (corresponding to an example of an "information processing device") includes: an application execution unit 17a configured to be able to execute a recording editing application (corresponding to an example of an "application having a recording function and an editing function of sound source data"); and a display control unit 17b that causes the display unit 15 to variably display a menu M3 for sound quality improvement in conjunction with the type of sound source data, in a case where the user selects sound source data to be subjected to sound quality improvement via the recording editing application, the sound source data being selected by the user as a target of sound quality improvement. As a result, the convenience of the user when making music content can be improved.

[0202] Although the embodiments of the present disclosure are described above, the technical scope of the present disclosure is not limited to the above embodiments as it is, and various modifications can be made without departing from the gist of the present disclosure. In addition, components of different embodiments and modified examples can be appropriately combined.

[0203] Furthermore, the effects of each embodiment described in this specification are merely examples and are not limited thereto, and other effects may be provided.

[0204] Note that the present technology may also have the following configurations.

[0205] (1) An information processing device comprising:

[0206] an application execution unit configured to be capable of executing an application having a recording function and an editing function of sound source data; and

[0207] The display control unit causes a display unit to variably display a menu for improving sound quality in conjunction with a type of the selected sound source data when the sound source data is selected as a target of improving sound quality by the user via the application.

[0208] (2) The information processing device according to (1), wherein

[0209] When the sound source data is selected via the application, the display control unit clearly indicates the selected sound source data on the display unit.

[0210] (3) The information processing device according to (2), wherein

[0211] The display control unit displays the sound source data together with the tags added to the sound source data in a list form on the display unit, and when the sound source data is selected via the application, enlarges and displays the tags added to the selected sound source data in a manner extending in a row direction of a row displaying the sound source data.

[0212] (4) The information processing device according to (2) or (3), wherein

[0213] The display control unit displays the sound source data in a list form on the display unit, and when the sound source data is selected via the application, enlarges and displays a row in which the selected sound source data is displayed so as to extend the entire width of the row.

[0214] (5) The information processing device according to any one of (1) to (4), wherein

[0215] The application execution unit can set, for the sound source data, a first type indicating a sound including a plurality of different sound sources based on a user's selection, and

[0216] When the first type is set for the sound source data, the display control unit displays the sound source data in a list form on the display unit together with an icon indicating that the first type is set.

[0217] (6) The information processing device according to (5), wherein

[0218] The sound quality improvement processing for improving the sound quality includes, when the sound source data includes a plurality of different sound sources, an audio separation processing for separating an arbitrary sound source part from the sound source data, and

[0219] The display control unit causes the display unit to display a menu for sound quality improvement so that the audio separation process can be selected only when the first type is set for the sound source data.

[0220] (7) The information processing device according to (6), wherein

[0221] The sound quality improvement process includes a denoising process of removing a portion other than the arbitrary sound source portion as noise using the audio separation process, and

[0222] The display control unit causes the display unit to display a menu for sound quality improvement so that the audio separation process and the noise removal process can be selected simultaneously when the first type is set for the sound source data.

[0223] (8) The information processing device according to (7), wherein

[0224] The display control unit causes the display unit to display a menu for sound quality improvement so that the noise removal process can be individually selected when a type other than the first type is set for the sound source data.

[0225] (9) The information processing device according to (7) or (8), wherein

[0226] When the data subjected to the sound quality improvement process is acquired, the display control unit displays the data subjected to the sound quality improvement process in the form of a list on the display unit together with an icon indicating that the sound quality improvement process has been performed.

[0227] (10) An information processing method comprising:

[0228] executing an application having a recording function and an editing function of sound source data; and

[0229] When the sound source data is selected as a target of the sound quality improvement by the user via the application, a menu for sound quality improvement is variably displayed on a display unit in conjunction with the type of the selected sound source data.

[0230] (11) A program that causes a computer to:

[0231] executing an application having a recording function and an editing function of sound source data; and

[0232] When the sound source data is selected as a target of the sound quality improvement by the user via the application, a menu for sound quality improvement is variably displayed on a display unit in conjunction with the type of the selected sound source data. Reference numerals list

[0233] 1 Information Processing System

[0234] 10 Smartphone

[0235] 11 Microphone

[0236] 12 Speakers

[0237] 13 Communication unit

[0238] 14 Operating units

[0239] 15 Display unit

[0240] 15a Notification Panel

[0241] 16 Storage Units

[0242] 16a Application Information

[0243] 17 Control Unit

[0244] 17a Application execution unit

[0245] 17b Display control unit

[0246] 17c Communication control unit

[0247] 100 server devices

[0248] 101 Communication Unit

[0249] 102 Storage Unit

[0250] 102a Sound Quality Improvement Processing Model

[0251] 103 Control Unit

[0252] 103a Acquisition Unit

[0253] 103b Sound Quality Improvement Processing Unit

[0254] 103c Sending unit

Claims

1. An information processing device, comprising: an application execution unit configured to execute an application having a recording function and an editing function of sound source data; and The display control unit causes a display unit to variably display a menu for improving sound quality in conjunction with a type of the selected sound source data when the sound source data is selected as a target of improving sound quality by the user via the application.

2. The information processing device according to claim 1, wherein When the sound source data is selected via the application, the display control unit clearly indicates the selected sound source data on the display unit.

3. The information processing device according to claim 2, wherein The display control unit displays the sound source data together with the tags added to the sound source data in a list form on the display unit, and when the sound source data is selected via the application, enlarges and displays the tags added to the selected sound source data in a manner extending in a row direction of a row displaying the sound source data.

4. The information processing device according to claim 2, wherein The display control unit displays the sound source data in a list form on the display unit, and when the sound source data is selected via the application, enlarges and displays a row in which the selected sound source data is displayed so as to extend the entire width of the row.

5. The information processing device according to claim 1, wherein The application execution unit can set, for the sound source data, a first type indicating a sound including a plurality of different sound sources based on a user's selection, and When the first type is set for the sound source data, the display control unit displays the sound source data in a list form on the display unit together with an icon indicating that the first type is set.

6. The information processing device according to claim 5, wherein The sound quality improvement processing for improving the sound quality includes, when the sound source data includes a plurality of different sound sources, an audio separation processing for separating an arbitrary sound source part from the sound source data, and The display control unit causes the display unit to display a menu for sound quality improvement so that the audio separation process can be selected only when the first type is set for the sound source data.

7. The information processing device according to claim 6, wherein The sound quality improvement process includes a denoising process of removing a portion other than the arbitrary sound source portion as noise using the audio separation process, and The display control unit causes the display unit to display a menu for sound quality improvement so that the audio separation process and the noise removal process can be selected simultaneously when the first type is set for the sound source data.

8. The information processing device according to claim 7, wherein The display control unit causes the display unit to display a menu for sound quality improvement so that the noise removal process can be individually selected when a type other than the first type is set for the sound source data.

9. The information processing device according to claim 7, wherein When the data subjected to the sound quality improvement process is acquired, the display control unit displays the data subjected to the sound quality improvement process in the form of a list on the display unit together with an icon indicating that the sound quality improvement process has been performed.

10. An information processing method, comprising: executing an application having a recording function and an editing function of sound source data; as well as When the sound source data is selected as a target of the sound quality improvement by the user via the application, a menu for sound quality improvement is variably displayed on a display unit in conjunction with the type of the selected sound source data.

11. A program for causing a computer to: executing an application having a recording function and an editing function of sound source data; and When the sound source data is selected as a target of the sound quality improvement by the user via the application, a menu for sound quality improvement is variably displayed on a display unit in conjunction with the type of the selected sound source data.

Images