User interface device, method and computer program for writing audio output file

Abstract

Embodiments of the present invention relate to a user interface device, a method and a computer program for writing an audio output file, the user interface device comprising: an arrangement of interactively operable visual elements displayed on a display means, each visual element representing a piece of musical instrument content, and each musical instrument content block comprises a musical content sub-block from a musical instrument and has a plurality of audio parameters, in which the musical instrument content block is activated by a user clicking a corresponding visual element using a pointing member, and whereby, when the user activates the musical instrument content block, one or more of a plurality of interactive authoring tools are provided, to enable the user to adjust audio parameters of the activated musical instrument content chunks, and to apply the audio parameters adjusted by the user to the musical instrument content chunks; and means for combining the musical instrument content chunks to generate the audio output file.

Description

Technical Field

[0001] The present disclosure relates to a user interface device, method, and computer program for writing an audio output file. The present disclosure also relates to a user interface device, method, and computer program for creating a multimedia file including an audio output file written by the user interface device. Background Art

[0002] Digital audio workstations (DAWs) have been developed to provide users with a production environment in which audio content can be composed, recorded, edited, mixed, and optionally synchronized with target image or video content.

[0003] Such DAWs are typically configured with a series of tools and a library of pre-recorded audio content that users can select, edit and combine to create audio output files, and if desired, synchronize the created audio output files with multimedia content such as images and / or video files.

[0004] However, such production environments are often difficult to use, and selecting a harmonically compatible pre-recorded audio content file for an audio output file is very time-consuming, even for the most skilled audio editor. Furthermore, such environments are limited in the extent to which users can efficiently and easily edit or alter the created audio output files due to their complexity and often unfriendly user interface.

[0005] It is therefore an object of the present disclosure to provide a user interface device, method, and computer program for authoring audio output files that overcome, at least to some extent, the above-mentioned problems and / or provide a useful alternative to the public or industry.

[0006] Further aspects of the present invention will become apparent from the following description which is given by way of example only. Summary of the Invention

[0007] According to an embodiment of the present invention, a user interface device for writing an audio output file is provided, the user interface device comprising:

[0008] a. an arrangement of interactively operable visual elements displayed on a display member, each visual element representing an instrument content block, and each instrument content block including a sub-block of music content from an instrument and having a plurality of audio parameters,

[0009] b. wherein the user activates the instrument content block by clicking the corresponding visual element using a pointing member, and

[0010] c. whereby, when a user activates an instrument content block, one or more of a plurality of interactive authoring tools are provided to enable the user to adjust audio parameters of the activated instrument content block, and the audio parameters adjusted by the user are applied to the instrument content block,

[0011] d. means for composing said audio output file by combining said instrument content blocks.

[0012] An embodiment provides a user interface device for managing the technical tasks of creating, editing, and writing audio output files that can be played so that they can be listened to on an audio output component of a device, such as a speaker or headphones. The user interface device displays interactive visual elements, each of which represents an instrument content block (i.e., an individual instrument component) of a generated audio output file. By clicking on a visual element using a pointing component, a user can activate the instrument content block, and when the instrument content block is activated, an interactive creation tool is provided to the user that is configured to enable the user to adjust various audio parameters of the instrument content block and the music content sub-blocks that make up the instrument content block. Through the user interface, the user can edit and adjust the way the instrument content block sounds, thereby changing the way the audio output file sounds when it is generated and played.

[0013] Embodiments of the present invention enable users to visualize music by providing visual elements that represent individual instrument components and interactive composition tools that are compatible with the visual elements, thereby providing an intuitive and simpler interface for creating, composing, and editing audio output files.

[0014] Embodiments of the present invention initially provide the user with an option via the user interface to request generation of an audio output file that includes a random selection of harmonically compatible instrument content blocks. Alternatively, the initial selection of harmonically compatible instrument content blocks can be based on a style selection (such as pop, synth, reggae, etc.) made by the user via the user interface component. Thus, when the user begins the writing or creation process in the application, they are given the option to receive an audio output file based on a completely random selection of harmonically compatible instrument content blocks, or to initially select a style on which to base the selection of harmonically compatible instrument content blocks.

[0015] Once an initial selection of harmonically compatible instrument content blocks is provided, the user may apply the editing and composition tools of embodiments of the present invention to change, alter, adjust, switch and / or remove the selected instrument content blocks and sound audio output files according to their preferences.

[0016] The user interface device is communicatively coupled to means configured to author instrument content blocks from a library of pre-recorded musical content sub-blocks, wherein each musical content sub-block is from an instrument, and the instrument content blocks selected for the audio output file are harmonically compatible.

[0017] The user interface device can be displayed by a digital display of a user electronic device (such as a mobile smartphone or tablet computer). A software application can be downloaded and installed on the electronic device to display the user interface. However, in some embodiments, the electronic device can execute a web browser application that browses to a website served by a web server, where the user interface is displayed embedded therein.

[0018] In an embodiment, the interactive authoring tool includes a component for an instrument content block switching component, which is configured such that when a user slides a visual element for an instrument content block using a pointing component, the instrument content block is replaced with an alternative instrument content block.

[0019] In an embodiment, the instrument content block switching means further comprises means for replacing the instrument content block with an alternative selection of the instrument content block.

[0020] In an embodiment, the interactive composition tool includes means for muting, locking, deleting, changing the musical style, resuming a previously replaced, and / or playing an instrument content block.

[0021] In an embodiment, the interactive authoring tools provided to the user depend on how long the user clicks on a visual element, whereby relatively shorter clicks provide a first subset of the interactive authoring tools and relatively longer clicks provide a second subset of the interactive authoring tools.

[0022] In an embodiment, the interactive composition tool includes means for enabling a user to search a database based on existing artist names and / or song titles to provide an audio output file having a desired sound and timbre similar to the existing artist and / or song titles.

[0023] In an embodiment, the interactive composition tool comprises means for enabling a user to individually change the volume of each instrument content block.

[0024] In an embodiment, the interactive composition tool comprises means for displaying the audio output file divided into a plurality of segments, wherein each segment displayed is populated by a music content sub-block for each instrument content block, and whereby the user interface comprises means for enabling a user to disable and enable one or more music content sub-blocks of an instrument content block in a segment of the audio output file.

[0025] In an embodiment, the interactive authoring tool comprises means for enabling a user to reorder segments of an audio output file.

[0026] In an embodiment, the interactive authoring tool includes a component for displaying selectable alternative fragment layout templates so that the user can select a desired fragment layout from a plurality of selectable fragment layouts. Such fragment layouts can be displayed as a scrollable list, icons, etc. The user can be provided with three, four, or more fragment layout template options.

[0027] In an embodiment, a segment layout template includes five to eight segments.

[0028] In an embodiment, the interactive composition tool includes means for enabling a user to add an instrument content block for a selected instrument and genre to an instrument content block in an audio output file.

[0029] In an embodiment, the interactive composition tool includes means for enabling a user to change the pitch and tempo of an audio output file.

[0030] In an embodiment, the interactive authoring tool comprises means for enabling a user to configure an audio output file for use in a short message that can be transmitted to a device via a network using a messaging service.

[0031] Such a short message including an audio output file may have a duration or length of up to approximately thirty seconds, although an optimal duration may be between three and twenty seconds, three and fifteen seconds, or three and nine seconds.

[0032] A short message including an audio output file may also contain or be synchronized with one or more multimedia files, such as one or more images and / or video files, such that when the short message is played on the device, the audio output file is combined with the one or more multimedia files.

[0033] In an embodiment, the arrangement of interactive visual elements also includes a visual element representing an empty vocal content block, wherein the empty vocal content block is activated by the user clicking the corresponding visual element using a pointing component, and when the empty vocal content block is activated, the user interface provides a component for enabling the user to use an input component such as a microphone to record a vocal melody or other audio input and store the recorded vocal melody or other audio input for use in the vocal content block.

[0034] In an embodiment, the interactive composition tool comprises means for enabling a user to individually change the volume of each instrumental content block and / or the volume of each vocal content block.

[0035] In an embodiment, the interactive composition tool comprises means for recording a vocal melody or other audio input using input means such as a microphone as a vocal recording of a selected predefined segment for said audio output file.

[0036] In an embodiment, the interactive composition tool includes means for displaying lyrics for a recorded piece of vocal content.

[0037] In an embodiment, the arrangement of interactable visual elements further comprises a plurality of visual elements, each visual element representing an empty block of vocal content.

[0038] In an embodiment, the arrangement of interactively operable visual elements further includes a visual element representing at least one vocal content block, wherein each vocal content block is activated by a user clicking on the corresponding visual element using a pointing member, and when each vocal content block is activated, a plurality of interactive authoring tools are provided for enabling the user to adjust audio parameters of the activated vocal content block.

[0039] In an embodiment, the interactive composition tool includes a component for automatically tuning a vocal melody or other audio input of a vocal content block. Such automatic tuning functionality can be provided via a value slider to adjust the level of automatic tuning.

[0040] In an embodiment, the interactive authoring tool includes means for displaying a piece of recorded vocal content as a waveform of a line that moves according to the vocals as the vocals are recorded on the display means.

[0041] In an embodiment, the interactive composition tool includes a component for trimming a recorded vocal melody or other audio input to a block of recorded vocal content.

[0042] In an embodiment, the user interface includes a component for displaying a user's vocal recording as a visual element, wherein the vocal recording is activated by the user clicking on the corresponding visual element using a pointing component, thereby providing a plurality of interactive creation tools for enabling the user to adjust audio parameters of the vocal recording when the vocal recording is activated.

[0043] In an embodiment, the interactive composition tool further provides means for muting, locking, deleting, changing the musical style of, applying filters, adjusting volume, adjusting auto-tune levels, trimming, copying, naming and renaming, playing and / or restoring the vocal recording.

[0044] In an embodiment, the display member is a touch screen and the pointing member is provided by a user's finger or a stylus. Alternatively, the pointing member is a mouse and the instrument content block is activated or removed by the user positioning and pressing the mouse pointer on the corresponding visual element or dragging the mouse pointer to the corresponding visual element.

[0045] In an embodiment, each visual element includes a visual indication of an instrument corresponding to the musical content in the instrument content block.

[0046] In an embodiment, the visual indication is the name of the instrument written within or adjacent to the visual element.

[0047] In an embodiment, the visual indication is a depiction of the name of the instrument shown within or near the visual element.

[0048] In an embodiment, each visual element is an image of a shape.

[0049] In an embodiment, each visual element is an image of a ring.

[0050] According to an embodiment of the present invention, a method for writing an audio output file using a user interface device is provided, the method comprising:

[0051] a. providing an arrangement of interactively operable visual elements displayed on a display member, each visual element representing an instrument content block, and each instrument content block including a sub-block of music content from an instrument and having a plurality of audio parameters,

[0052] b. wherein the user activates the instrument content block by clicking the corresponding visual element using a pointing member, and

[0053] c. whereby, when a user activates an instrument content block, one or more of a plurality of interactive authoring tools are provided to enable the user to adjust audio parameters of the activated instrument content block, and the audio parameters adjusted by the user are applied to the instrument content block,

[0054] d. Combining the instrument content blocks to write the audio output file.

[0055] In an embodiment, the method comprises the step of providing an interactive composition tool comprising an instrument content block switching member configured such that when a visual element for an instrument content block is slid by a user using a pointing member, the instrument content block is replaced with an alternative instrument content block.

[0056] In an embodiment, the instrument content block switching means further comprises means for replacing the instrument content block with an alternative selection of the instrument content block.

[0057] In an embodiment, the method comprises the step of providing an interactive composition tool comprising means for muting, locking, deleting, changing musical style, resuming a previously replaced and / or playing an instrument content block.

[0058] In an embodiment, the method includes the step of providing an interactive composition tool including means for enabling a user to search a database based on existing artist names and / or song titles to provide an audio output file having a desired sound and timbre similar to the existing artist and / or song titles.

[0059] In an embodiment, the method comprises the step of providing an interactive composition tool comprising means for enabling a user to individually change the volume of each piece of instrument content.

[0060] In an embodiment, the method comprises the step of providing an interactive composition tool comprising means for displaying said audio output file divided into a plurality of segments, wherein each segment displayed is populated by a music content sub-block for each instrument content block, and whereby said user interface comprises means for enabling a user to disable and enable one or more music content sub-blocks of an instrument content block in a segment of said audio output file.

[0061] In an embodiment, the method comprises the step of providing an interactive authoring tool comprising means for reordering segments of an audio output file.

[0062] In an embodiment, the method includes the steps of providing an interactive authoring tool including means for displaying selectable alternative fragment layout templates so that a user can select a desired fragment layout from a plurality of selectable fragment layouts. Such fragment layouts can be displayed as a scrollable list, icons, etc. The user can be provided with three, four, or more fragment layout template options.

[0063] In an embodiment, a segment layout template includes five to eight segments.

[0064] In an embodiment, the method comprises the step of providing an interactive authoring tool comprising means for adding an instrument content block for a selected instrument and genre to an instrument content block in an audio output file.

[0065] In an embodiment, the method comprises the step of providing an interactive composition tool comprising means for changing the pitch and tempo of an audio output file.

[0066] In an embodiment, the method comprises the step of providing an interactive authoring tool comprising means for enabling a user to configure an audio output file for use in a short message that can be transmitted to a device via a network using a messaging service.

[0067] In an embodiment, the method includes the step of providing an arrangement of interactive visual elements, the arrangement of interactive visual elements also including a visual element representing an empty vocal content block, wherein the empty vocal content block is activated by a user clicking on the corresponding visual element using a pointing member, and when the empty vocal content block is activated, the user interface provides a member for enabling the user to use an input member such as a microphone to record a vocal melody or other audio input and store the recorded vocal melody or other audio input for use in the vocal content block.

[0068] In an embodiment, the method comprises the step of providing an interactive composition tool comprising means for recording a vocal melody or other audio input as a vocal recording of a selected predefined segment for said audio output file using input means such as a microphone.

[0069] In an embodiment, the method comprises the step of providing an interactive composition tool comprising means for displaying lyrics for a recorded piece of vocal content.

[0070] In an embodiment, the arrangement of interactable visual elements further comprises a plurality of visual elements, each visual element representing an empty block of vocal content.

[0071] In an embodiment, the method includes the step of providing an arrangement of interactive visual elements, the arrangement of interactive visual elements further comprising a visual element representing at least one vocal content block, wherein each vocal content block is activated by a user clicking on a corresponding visual element using a pointing member, and when each vocal content block is activated, a plurality of interactive authoring tools are provided for enabling the user to adjust audio parameters of the activated vocal content block.

[0072] In an embodiment, the method comprises the step of providing an interactive composition tool having means for enabling a user to individually change the volume of each instrumental content block and / or the volume of each vocal content block.

[0073] In an embodiment, the method includes the step of providing an interactive composition tool including means for automatically tuning a vocal melody or other audio input to a piece of vocal content. Such automatic tuning functionality may be provided via a value slider to adjust the level of automatic tuning.

[0074] In an embodiment, the method comprises the step of providing an interactive composition tool comprising means for displaying the recorded vocal content block as a waveform on a display means.Such auto-tune functionality may be provided via a value slider to adjust the level of auto-tune.

[0075] In an embodiment, the method includes the step of providing an interactive composition tool including means for trimming a recorded vocal melody or other audio input of a recorded block of vocal content.

[0076] In an embodiment, the method includes the step of providing an interactive creation tool, which includes a component for displaying a user's vocal recording as a visual element, wherein the vocal recording is activated by the user clicking on the corresponding visual element using a pointing component, thereby providing a plurality of interactive creation tools for enabling the user to adjust audio parameters of the vocal recording when the vocal recording is activated.

[0077] In an embodiment, the method includes the step of providing an interactive authoring tool comprising components for muting, locking, deleting, changing the musical style, applying filters, adjusting volume, adjusting auto-tune levels, trimming, copying, naming and renaming, playing and / or restoring a vocal recording.

[0078] According to an embodiment of the present invention, a computer program is provided, which performs the steps of the method described when the computer program is run on a computer. BRIEF DESCRIPTION OF THE DRAWINGS

[0079] Embodiments of the invention will be more clearly understood from the following description of some embodiments given by way of example only and with reference to the accompanying drawings, in which:

[0080] Figure 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an instrument content block and a vocal content block for an audio output file.

[0081] Figures 2 to 10 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive composition tool through which a user edits and adjusts one or more instrument content blocks for an audio output file, and

[0082] Figures 11 to 22 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool through which a user creates, edits, and adjusts one or more vocal content blocks for an audio output file. DETAILED DESCRIPTION

[0083] The embodiments of the present invention are implemented by one or more computer processors and a memory containing computer software program instructions executable by the one or more processors.The computer processors may be provided by a computer server or a network of connected and / or distributed computers.

[0084] An audio file of an embodiment of the present invention will be understood as a file containing audio or MIDI data or content that is received, stored, or recorded and that, when processed by an audio or MIDI player, produces a sound output. The audio output file can be recorded in a known audio file format, including but not limited to an audio WAV format, an MP3 format, an Advanced Audio Coding (AAC) format, an Ogg format, or any other format, analog, digital, or other, as desired. The user can optionally specify the desired audio or MIDI format.

[0085] Figures 1 to 18 A user interface apparatus for authoring audio output files is shown, generally indicated by reference numeral 1 .

[0086] The user interface device 1 is communicatively coupled to a backend software application operable to select a suitable instrument content block 4 for an audio output file from a library of pre-recorded instrument content sub-blocks or stems 6, wherein the selected instrument content blocks 4 are harmonically compatible.

[0087] Each instrument content sub-block 6 includes music content from a specific instrument, such as piano, drums, synthesizer, guitar, bass, etc., and originates from a musical performance created by a human composer or musician. Associated with the instrument content block 4 and the music content sub-block 6 are a number of audio parameters, such as pitch, tempo, volume, style, genre, etc. Thus, the instrument content sub-block 6 of an embodiment of the present invention originates from a specific instrument, and a plurality of such music content sub-blocks provide the instrument content block 4 for an audio output file.

[0088] The backend software application may automatically select the instrument content block 4 based on user provided input parameters such as instrument type, style and / or genre.

[0089] When a user begins the composition process, they may be provided with the option to request generation of an audio output file comprising a random selection of harmonically compatible instrumental content blocks. Alternatively, the initial selection of harmonically compatible instrumental content blocks may be based on a genre selection (such as pop, synth, reggae, etc.) made by the user via a user interface component.

[0090] like Figure 1 As shown, the figure shows by way of example only that the back-end software application has selected instrument content blocks 4 corresponding to four instruments including "drums", "piano", "bass" and "guitar", but it can be understood that other instruments, such as synthesizers, violins, brass instruments, accordions, etc., can be selected by the user, or selected based on audio parameters provided by the user, or automatically selected by the back-end software application for the audio output file.

[0091] Figure 1Also shown is a vocal content block 5, which is an audio recording of a user-provided vocal melody or other audio input, or a stored pre-recording of an audio input. When a user provides a vocal recording as an input file or imports a stored pre-recording of an audio input, an embodiment of the present invention analyzes the musical parameters of the audio input file, such as chord progression and tempo, and selects harmonically compatible instrumental content blocks to combine with the vocal content block to provide an audio output file.

[0092] It will be appreciated that the audio output file is generated by combining and playing the instrument content block 4 represented by the instrument content block 4 and, if applicable, one or more vocal content blocks 5. Including one or more vocal content blocks 5 in the audio output file is optional. Therefore, any changes to the individual instrument content blocks 4 and the inclusion of vocal content blocks 5 will have an impact on the final sound when the audio output file is played.

[0093] like Figure 1 As shown, a user interface apparatus 1 displays an arrangement of interactive visual elements 2 on a display member 3 of a user electronic device, such as a mobile smartphone, tablet computer, laptop computer, PC, etc. The display member 3 may be a touch screen, a non-touch-sensitive visual display monitor, a head-mounted display, or other visual display coupled to or integrated with the user electronic device. The display member 3 shown is a touch screen, and in such an embodiment, the pointing member is provided by the user's finger. Alternatively, in embodiments where the display member 3 is not a touch-sensitive screen, the pointing member may be provided by a mouse or other suitable pointing device.

[0094] Each visual element 2 represents an instrument content block 4 or a vocal content block 5, and in the example shown, is provided in the shape of a ring 2. However, it will be appreciated that each visual element 2 may be provided in alternative shapes, such as a square, diamond, oval, or other desired shape, or in an image depicting the instrument from which the instrument content block 4 originates. Therefore, reference to visual elements 2 being shown as rings 2 in embodiments of the present invention should not be considered limiting.

[0095] The user activates each instrument content block 4 by clicking the corresponding ring 2 using a pointing member. When an instrument content block 4 is activated, one or more of a plurality of interactive composition tools are provided, offering the user various ways to adjust the audio parameters of the activated instrument content block 4. The user also activates a vocal content block 5 by clicking the corresponding visual element 2 using a pointing member. When the vocal content block is activated, a plurality of interactive composition tools are provided, allowing the user to adjust the audio parameters of the vocal melody or other audio input of the activated vocal content block 5. Although a single such vocal content block 5 is shown, it will be appreciated that the audio output file may include multiple such vocal content blocks 5.

[0096] The user interface device 1 includes an interactive creation tool, which is provided as an instrument content block switching component, which is configured so that when the user uses the pointing component to slide the visual element 2 for the instrument content block 4, the slid instrument content block 4 is replaced by a substitute instrument content block 4 of the same instrument, and the substitute instrument content block 4 is harmonically compatible with the remaining instrument content blocks 4.

[0097] The instrument content block 4 switching means further comprises means 24 for replacing all instrument content blocks 4 with alternative selections of instrument content blocks 4 .

[0098] The user interface device 1 further comprises an interactive composition tool which provides means 7 for enabling the user to add further instrument content blocks 4 to the instrument content blocks 4 in the audio output file for a selected instrument and genre. The interactive composition tool further provides means 8 for enabling the user to change the pitch and tempo of the audio output file and means 9 for enabling the user to change the musical style of the audio output file.

[0099] Also shown is a timeline 11 showing the progression of the audio output file as it is played via the user interface device 1 , and means 18 for pausing the audio output file while it is playing. The playback volume can be adjusted by means of a volume control 12 .

[0100] Figure 2 A number of interactive composition tools are shown that are provided when a user long-presses the ring 2 for an instrument content piece 4, which in the example shown include functionality that provides for muting 13, locking 14 (i.e., preventing changes / editing and removal from selection), and deleting 15 components of the individual instrument content piece 4. It will be appreciated that long-pressing the ring 2 involves the user clicking on the ring 2 and holding it for a few seconds to access the interactive composition tools provided.

[0101] Figure 3 A number of further interactive composition tools are shown which are provided when the user quickly clicks on the ring 2, including the aforementioned means for muting 13, locking 14 and deleting 15 an activated instrument content piece 4, as well as means for playing / soloing 16, changing style 17 and pausing playback 18 of an individual instrument content piece 4. Also shown is a timeline 11 showing the progression of an activated instrument content piece 4 as it plays.

[0102] Figure 4 An interactive composition tool is shown which provides a widget 17 by which a user can select a musical style for the activated instrument content piece 4. Thus, in the example shown, the activated instrument content piece 4 is for a guitar having the current style of J-Pop, and if the user chooses to change the guitar style, they can select from among the provided alternative styles by using the pointing widget.

[0103] Figure 5 An interactive composition tool is shown that provides means 20 for enabling a user to search a database based on an existing artist name and / or song title to provide a selection of instrument content pieces 4 having a desired sound and timbre similar to the existing artist and / or song title. A database query function 19 is shown for a user to input an existing artist name and / or song title to locate an instrument content piece 4 matching the query for an audio output file.

[0104] Figure 6 An interactive authoring tool is shown which provides means 21 for enabling a user to individually change the volume of each instrumental content block 4 in the audio output file, as well as the playback timeline 11. In embodiments including vocal content blocks, the volume of the vocals can be adjusted in the same manner.

[0105] Figure 7 An interactive composition tool is shown that provides a component 22 for displaying the instrument content blocks 4 and vocal content blocks 5 for the vocal part of an audio output file in a plurality of segments 23. The segments 23 are shown by way of example as "Intro," "Verse A," and "Chorus." Each segment 23 is populated with the instrument content sub-blocks 6 that make up the instrument content block 4, and the vocal content block 5 is also divided into sections for each segment. The component 22 enables the user to disable and enable individual musical content sub-blocks 6, individual instrument content blocks 4, and / or vocal content blocks 5 in the segments 23. The component 22 further enables the user to reorder the segments 23 and reorder the musical content sub-blocks 6 and vocal content block sections 5 in the segments 23.

[0106] Figure 8 An interactive composition tool is shown which provides a widget 7 that allows the user to add an instrumental content block 4 ("add stem") or a vocal content block 5 to the audio output file. Figure 1 When the "add stem" icon shown is selected, component 7 is activated and, when selected, the user can select from instrument types, including, for example, guitar, brass, drums, etc., for the instrument content block 4.

[0107] like Figure 9 As shown, when adding an instrument content block 4, the user can also specify a genre and / or style for the selected instrument type, in the example shown, a genre and / or style for "guitar." The backend software application also provides suggested genres based on existing instrument content blocks 4 in the audio output file.

[0108] Figure 10 An interactive authoring tool is shown which provides means 8 for enabling a user to change the pitch and tempo of an audio output file.

[0109] Figure 11 Shown with Figure 1 A similar screen, where the vocal content block 5 is not currently included in the audio output file, and therefore the user interface device 1 includes an "add vocal" ring 2 which, when clicked by the user operating the pointing device, activates the interactive authoring tool which provides Figure 12 The component 30 enables a user to record a vocal melody or other audio input and store the recorded vocal melody or other audio input as a recorded vocal content block 5 for an audio output file.

[0110] according to Figure 12 The vocal recording component 30 enables the user to record a vocal melody from a predefined segment 31, such as "Intro," "Verse A," "Chorus A," etc., by activating the corresponding ring 2 with a "+" symbol therein. A timeline 11 is also displayed, showing the playback progress of the recorded vocal content as it plays. A component 33 is also provided for displaying the lyrics of the recorded vocal content 5. Lyrics can optionally be automatically generated by a lyrics generator.

[0111] Figure 13 An interactive authoring tool is shown that provides means 50 for enabling a user to set recording parameters and begin recording content for a predefined segment portion 31 of a vocal recording, which in the example shown is "Verse A" of a vocal content block 5. Sound check 51 for audio input means such as a microphone, filters 52 and auto-tune levels 53 for vocal recording, and a start recording icon 54 are shown.

[0112] Figure 14 An interactive authoring tool is shown providing means 55 for displaying vocal content recorded as waveforms 56 for the predefined segment portion 31. The interactive authoring tool provides means 57 to stop and means 58 to restart the recording.

[0113] Figure 15 An interactive authoring tool is shown that is provided once the user has completed the vocal recording for the segment portion 31 of the vocal content block 5. A component 53 is shown that enables the user to automatically tune the vocal melody or other audio input of the vocal recording. Such automatic tuning functionality can be provided through a value slider to adjust the level of automatic tuning. Also provided are a component 52 for setting filters for the vocal recording, a component 60 for displaying the vocal recording as a waveform or "moving" line on the display component 3, and a component 61 for adjusting the volume of the vocal recording on the timeline. The vocal recording can be trimmed by cutting / marking the waveform or "moving" line appropriately.

[0114] Figure 16An interactive authoring tool is shown that provides a component 70 that enables a user to store and display vocal recordings 27 made for each predefined segment 31. A new vocal recording 27 for a vocal content block 5 can be recorded for a predefined segment 31 by clicking on the vocal ring 2 in which a "+" symbol is displayed using a pointing component. Each vocal recording 27 can be stored with an identifying name, such as "Rec one," "Rec two," and so on in the example shown. Component 70 also provides a playback timeline 11 and a component 33 for displaying the lyrics of the recorded vocal content block 5.

[0115] Figure 17 An interactive authoring tool is shown that provides widgets 37 , including widget 71 for muting a vocal recording 27 (shown as vocal recording “Rec One”), and widget 72 that enables a user to delete a vocal recording 27 .

[0116] Figure 18 An interactive authoring tool is shown that provides a means 80 for trimming a vocal recording 27 , a means 81 for duplicating a vocal recording 27 , a means 82 for renaming a vocal recording 27 , and a means 83 for deleting a vocal recording 27 .

[0117] Figure 19 An interactive composition tool is shown that includes a component 85 for displaying selectable alternative segment layout templates 86, so that a user can select a desired segment layout from a plurality of selectable segment layout templates 86. Such segment layouts can be displayed as a scrollable list, icons, etc. The user can be provided with three, four, or more segment layout template options from which to select one. In the example shown, the "Afro Pop Original" layout includes five segments, arranged in the order of "Verse A," "Verse B," "Chorus," and "Outro."

[0118] Each segment is typically eight bars long, but some segments may be less than eight bars, such as the "end" segment shown, which is two bars long. A segment layout template may include five to eight segments, depending on various factors, including the desired duration of the audio output file. Rearranging the segments of the template provides alternative layouts.

[0119] Figure 22 Shown is a table 100 showing three sample segment layouts for a music style set to 70-75 bpm. Layout 1 includes eight segments in the following order:

[0120] a. Verse A, Verse B, Chorus A, Verse B, Chorus A, Chorus B, Chorus B, Ending. Layout 2 also includes eight segments in the following order:

[0121] b. Chorus A, Verse B, Chorus A, Chorus B, Verse B, Chorus A, Chorus B, Ending Layout 3 includes nine segments in the following order:

[0122] c. Chorus A, Verse A, Chorus A, Post-Chorus, Verse B, Chorus B, Post-Chorus, Chorus B, End

[0123] As shown, each segment of the layout comprises a number of measures of music (typically eight), and by rearranging these segments, a new template layout is provided.

[0124] Such template layouts may be provided at different music tempos, such as 80-85bpm, 92-100bpm, 107-116bpm, 120bpm and / or 130pm.

[0125] An interactive authoring tool is also provided that has a component that enables a user to select portions of adjacent fragments and combine these selected fragment portions to form new fragments that can be dynamically included in new or existing layout templates. Figure 22 For example, in Layout 1, the user might select measures 4 through 8 of Verse A and measures 9 through 13 of Verse B and combine them into a new segment to include in Layout 1, such as by removing an existing segment or by adding a new segment somewhere along the layout. Such a new segment can also be included in an alternate layout as desired.

[0126] Figure 20 and Figure 21 An interactive composition tool is shown, wherein a member 84 enables a user to individually change the volume of each instrumental content block 4 and / or the volume of each vocal content block 5. The member 84 can be provided as a button or icon that can be slid to switch between adjusting the volume of the instrumental content block 4 and the vocal content block 5. The user can drag their finger or other pointing member up and down the instrument or vocal bar 87 shown to increase or decrease the volume level as desired. As shown, the volume level of each instrumental content block 4 and vocal content block 5 in the composition can be adjusted independently and individually.

[0127] The interactive authoring tool also includes a component that enables a user to configure an audio output file for use in a short message that can be transmitted to a device via a network using a messaging service. Such a short message including an audio output file can have a duration or length of up to approximately thirty seconds, although an optimal duration may be between three and twenty seconds, three and fifteen seconds, or three and nine seconds. The short message including the audio output file can also contain or be synchronized with one or more multimedia files, such as one or more images and / or video files, such that when the short message is played on the device, the audio output file is combined with the one or more multimedia files.

[0128] Embodiments of the present invention also provide an interactive authoring tool, including a component for storing the authored audio output files in a library and sharing the audio output files on alternative media platforms (such as social media platforms). The audio output files authored for the user can also be presented as a playlist, and the user can create such a playlist. The user interface also provides a component for searching for audio output files authored and published by other users and searching for other users.

[0129] The user interface also provides components for synchronizing video with audio output files, including components for recording and editing such video, and components for adding artwork, including images and image effects, to the audio output files.

[0130] It will be understood that the embodiments of the present invention are not limited to the specific details described herein, which are given by way of example only, and that various modifications and alterations are possible without departing from the scope of the present invention.

Claims

1. A user interface device for writing an audio output file, the user interface device comprising: an arrangement of a plurality of interactively operable visual elements displayed on the display member, each visual element representing an instrument content block, and each instrument content block including musical content from an instrument and having a plurality of audio parameters, wherein the user activates the instrument content block by clicking the corresponding visual element using a pointing member, and Thus, when a user activates an instrument content block, one or more of a plurality of interactive authoring tools are provided to enable the user to adjust audio parameters of the activated instrument content block, and the audio parameters adjusted by the user are applied to the instrument content block, Means for composing the audio output file by combining the instrument content blocks.

2. A user interface device according to claim 1, wherein the interactive creation tool includes a component for an instrument content block switching component, and the instrument content block switching component is configured so that when a user slides a visual element for an instrument content block using a pointing component, the instrument content block is replaced with an alternative instrument content block.

3. The user interface device of claim 2, wherein the instrument content block switching component further comprises a component for replacing the instrument content block with an alternative selection of an instrument content block.

4. A user interface device according to claim 1, wherein the interactive authoring tools provided to the user depend on the length of time the user clicks on a visual element, whereby a relatively shorter click provides a first subset of the interactive authoring tools and a relatively longer click provides a second subset of the interactive authoring tools.

5. A user interface device according to claim 1, wherein the interactive composition tool includes a component for displaying the instrument content blocks of the audio output file in multiple segments, wherein each segment displayed is populated by the instrument content sub-blocks for each instrument content block, and whereby the user interface includes a component for enabling a user to disable and enable one or more music content sub-blocks of the instrument content blocks in the segments of the audio output file, and wherein the interactive composition tool includes a component for enabling a user to reorder the segments of the audio output file.

6. A user interface device according to claim 1, wherein the interactive composition tool includes means for enabling a user to add an instrument content block for a selected instrument and genre to the instrument content block in the audio output file.

7. A user interface device according to claim 1, wherein each visual element includes a visual indication of an instrument corresponding to the musical content of the instrument content block, such visual indication being the name of the instrument written within or near the visual element and / or an image depicting the instrument shown within or near the visual element.

8. The user interface device according to claim 1 comprises one or more visual elements, each visual element representing a vocal content block, wherein the vocal content block is activated by a user clicking on a corresponding visual element using a pointing component, and when the vocal content block is activated, one or more of a plurality of interactive creation tools are provided to enable the user to adjust audio parameters of the activated vocal content block, and the user interface device comprises a component for combining the instrument content block and the one or more vocal content blocks to generate the audio output file.

9. The user interface device according to claim 1 comprises a visual element representing an empty vocal content block, wherein the empty vocal content block is activated by a user clicking on the corresponding visual element using a pointing member, and when the empty vocal content block is activated, a member is provided for enabling the user to record a vocal melody as a vocal recording and store the vocal recording as a vocal content block or part of a vocal content block.

10. A user interface device according to claim 9, wherein the interactive composition tool includes means for recording a vocal melody or other audio input as a vocal recording of a selected predefined segment for the audio output file using an input means such as a microphone.

11. The user interface device of claim 9, wherein the interactive composition tool includes means for displaying lyrics for the vocal content block or the portion of the vocal content block.

12. The user interface device of claim 9, wherein the interactive authoring tool includes means for automatically tuning the vocal content block or the portion of the vocal content block.

13. The user interface device according to claim 9 includes a component for displaying the vocal recording as a visual element, wherein the vocal recording is activated by the user clicking on the corresponding visual element using a pointing component, thereby providing a plurality of interactive creation tools for enabling the user to adjust the audio parameters of the vocal recording when the vocal recording is activated.

14. A user interface device according to claim 9, wherein the interactive authoring tool also provides components for muting, locking, deleting, changing the musical style, applying filters, adjusting the volume, adjusting the auto-tune level, trimming, copying, naming and renaming, playing and / or restoring the vocal recording.

15. The user interface device of claim 1, wherein each visual element is an image of a ring.

16. A method for composing an audio output file using a user interface device, the method comprising: providing an arrangement of a plurality of interactively operable visual elements displayed on a display member, each visual element representing an instrument content block, and each instrument content block including musical content from an instrument and having a plurality of audio parameters, wherein the user activates the instrument content block by clicking the corresponding visual element using a pointing member, and Thus, when a user activates an instrument content block, one or more of a plurality of interactive authoring tools are provided to enable the user to adjust audio parameters of the activated instrument content block, and the audio parameters adjusted by the user are applied to the instrument content block, The instrument content blocks are combined to compose the audio output file.

17. The method according to claim 16, comprising the steps of: providing a visual element representing a block of vocal content, wherein the block of vocal content is activated by a user clicking on the corresponding visual element using a pointing member, and when the block of vocal content is activated, providing one or more of a plurality of interactive authoring tools to enable the user to adjust audio parameters of the activated block of vocal content; and combining the instrument content block and the vocal content block to generate the audio output file.

18. The method according to claim 16, comprising the step of providing a visual element representing an empty vocal content block, wherein the empty vocal content block is activated by a user clicking on the corresponding visual element using a pointing member, and when the empty vocal content block is activated, a member is provided for enabling the user to record a vocal melody as a vocal recording and store the vocal recording as a vocal content block or part of a vocal content block.

19. The method according to claim 18 includes the step of displaying the vocal recording as a visual element, wherein the vocal recording is activated by the user clicking on the corresponding visual element using a pointing member, thereby providing a plurality of interactive creation tools for enabling the user to adjust the audio parameters of the vocal recording when the vocal recording is activated.

20. A computer program which, when executed by one or more processors, causes the one or more processors to perform the steps of the method according to claim 1.

Images