User interface device, method and computer program for configuring an audio output file

Abstract

Embodiments of the present invention relate to a user interface device, method, and computer program for composing an audio output file, the user interface device including: an arrangement of interactively operable visual elements displayed on a display means, each visual element representing a musical instrument content block, each musical instrument content block including musical content sub-blocks from an instrument and having a plurality of audio parameters, wherein the musical instrument content blocks are activated by a user tapping a corresponding visual element with a pointing means, whereby, upon activation of an musical instrument content block by the user, one or more of a plurality of interactive authoring tools are provided to enable the user to adjust the audio parameters of the activated musical instrument content block, and the audio parameters adjusted by the user are applied to the musical instrument content block; and means for combining the musical instrument content blocks to generate the audio output file.

Description

[Technical Field]

[0001] The present disclosure relates to a user interface device, a method, and a computer program for composing an audio output file. The present disclosure further relates to a user interface device, a method, and a computer program for creating a multimedia file that includes an audio output file composed by a user interface device. [Background technology]

[0002] Digital Audio Workstations (DAWs) have been developed to provide users with a production environment in which audio content can be composed, recorded, edited, mixed, and optionally synchronized with target image or video content.

[0003] Such DAWs typically consist of a set of tools and a library of pre-recorded audio content that a user can select, edit, and combine to create audio output files that can be synchronized, if desired, with multimedia content such as image and / or video files.

[0004] However, such production environments are often very difficult to use, and it is very time-consuming for even the most skilled audio editor to select from pre-recorded audio content files that musically match the audio output file. Furthermore, how efficiently and easily such environments allow a user to edit or modify the created audio output file is limited by their complexity and often difficult-to-use user interface.

[0005] It is therefore an object of the present disclosure to provide a user interface apparatus, method and computer program for composing audio output files that overcomes in at least some way the above-mentioned problems and / or provides a useful alternative for the public or industry.

[0006] Further aspects of the present invention will become apparent from the following description, which is given by way of example only. Summary of the Invention

[0007] According to an embodiment of the present invention, there is provided a user interface device for composing an audio output file, the user interface device comprising: a. an arrangement of interactively operable visual elements displayed on a display means, each visual element representing a musical instrument content block, each musical instrument content block including musical content sub-blocks from a musical instrument and having a plurality of audio parameters; b. in said arrangement, musical instrument content blocks are activated by a user tapping on a corresponding visual element with a pointing means; c. the arrangement whereby, when a musical instrument content block is activated by a user, one or more of a plurality of interactive authoring tools are provided to enable the user to adjust audio parameters of the activated musical instrument content block, and the audio parameters adjusted by the user are applied to the musical instrument content block; d. means for constructing an audio output file by combining the instrument content blocks.

[0008] Embodiments provide a user interface apparatus for managing the technical task of creating, editing, and composing audio output files that can be audibly played back on audio output means of a device, such as speakers or headphones. The user interface apparatus displays interactively operable visual elements representing instrument content blocks (i.e., individual instrument components) of the generated audio output file. By tapping on the visual elements with a pointing means, a user can activate the instrument content block, and upon activation, the user is provided with an interactive authoring tool configured to allow the user to adapt various audio parameters of the instrument content block and the music content sub-blocks that make up the instrument content block. The user interface allows the user to edit and adjust the sound of the instrument content blocks, which can change the sound of the audio output file when generated and played back.

[0009] Embodiments of the present invention enable users to visualize music by providing visual elements representing individual instrument components and an interactive authoring tool compatible with the visual elements, thereby providing an intuitive and simple interface for creating, composing, and editing audio output files.

[0010] User interface embodiments of the present invention initially provide a user with the option of requesting the generation of an audio output file that includes a random selection of musically harmonic instrumental content blocks. Alternatively, the initial selection of musically harmonic instrumental content blocks may be based on a style selection (e.g., pop, synth, reggae) made by the user via the user interface means. Thus, when a user begins a composition or creation process in an application, they are given the option of receiving an audio output file based on a completely random selection of musically harmonic instrumental content blocks, or of initially selecting a style based on a musically harmonic instrument selection that is based on the content blocks.

[0011] Once provided with an initial selection of musically congruent instrumental content blocks, the user can then apply the editing and authoring tools of embodiments of the present invention to change, alter, adjust, shuffle, and / or remove the selection and the instrumental content blocks within the acoustic audio according to their preferences.

[0012] The user interface device is communicatively coupled to means configured to compose instrumental content blocks from a library of pre-recorded musical content sub-blocks, each musical content sub-block being from a musical instrument, and the instrumental content blocks for the audio output file being musically consistent.

[0013] The user interface device may be displayed by a digital display of a user electronic device, such as a mobile smartphone or tablet. A software application may be downloaded and installed on the electronic device for display of the user interface. However, in some embodiments, the electronic device may run a web browser application that browses a website provided by a web server, where the embedded user interface is displayed.

[0014] In one embodiment, the interactive authoring tool includes means for instrument content block shuffling means configured such that when a visual element of an instrument content block is swiped by a user with a pointing means, the instrument content block is replaced with an alternative instrument content block.

[0015] In one embodiment, the instrument content block shuffling means further comprises means for replacing an instrument content block with an alternative selection of instrument content blocks.

[0016] In one embodiment, the interactive authoring tool includes means for muting, locking, deleting, changing the musical style of, restoring a previously replaced, and / or playing back an instrumental content block.

[0017] In one embodiment, the interactive authoring tools provided to a user depend on the length of time the user taps on a visual element, whereby a relatively short tap provides a first subset of interactive authoring tools and a relatively long tap provides a second subset of interactive authoring tools.

[0018] In one embodiment, the interactive authoring tool includes means for enabling a user to search a database according to existing artist and / or song names and provide an audio output file with a desired sound and timbre similar to the existing artist and / or song name.

[0019] In one embodiment, the interactive authoring tool includes means for allowing a user to change the volume of each instrument content block individually.

[0020] In one embodiment, the interactive authoring tool includes means for displaying an audio output file divided into a plurality of sections, with musical content sub-blocks for each instrumental content block arranged in each displayed section, whereby the user interface includes means for a user to disable and enable one or more musical content sub-blocks of an instrumental content block within a section of the audio output file.

[0021] In one embodiment, the interactive authoring tool includes means for allowing a user to reorder sections of the audio output file.

[0022] In one embodiment, the interactive authoring tool includes means for displaying alternative section layout templates for selection, thereby allowing a user to select a desired section layout from a plurality of optional section layouts. Such section layouts may be displayed as a scrollable list, icons, etc. A user may be provided with three, four, or more section layout template options.

[0023] In one embodiment, the section layout template includes 5-8 sections.

[0024] In one embodiment, the interactive authoring tool includes means for allowing a user to add instrument content blocks for a selected instrument and genre to the instrument content blocks in the audio output file.

[0025] In one embodiment, the interactive authoring tool includes means for allowing a user to change the pitch and tempo of the audio output file.

[0026] In one embodiment, the interactive authoring tool includes means for allowing a user to configure an audio output file for use in a short message that can be sent to a device over a network using a messaging service.

[0027] Such short messages, including audio output files, may have a duration or length of up to about 30 seconds, but may optimally have a duration of 3-20 seconds, 3-15 seconds, or 3-9 seconds.

[0028] A short message including an audio output file may further include or be synchronized with one or more multimedia files, such as one or more image and / or video files, so that the audio output file is combined with the one or more multimedia files when the short message is played on a device.

[0029] In one embodiment, the arrangement of interactively operable visual elements further includes a visual element representing an empty vocal content block, which is activated by a user tapping on a corresponding visual element with a pointing means, and upon activation, the user interface provides means for enabling a user to record a recording of a vocal melody or other audio input using an input means such as a microphone, and to save the recorded vocal melody or other audio input for use within the vocal content block.

[0030] In one embodiment, the interactive authoring tool includes means for allowing a user to individually change the volume of each instrumental content block and / or the volume of each vocal content block.

[0031] In one embodiment, the interactive authoring tool includes means for recording vocal melodies or other audio input using an input means such as a microphone as a vocal recording of selected predetermined sections of the audio output file.

[0032] In one embodiment, the interactive authoring tool includes means for displaying lyrics for a recorded vocal content block.

[0033] In one embodiment, the arrangement of interactive visual elements further includes a plurality of visual elements, each representing an empty vocal content block.

[0034] In one embodiment, the arrangement of interactively operable visual elements further includes a visual element representing at least one vocal content block, each vocal content block being activated by a user tapping on a corresponding visual element with a pointing means, and upon activation, a plurality of interactive authoring tools are provided to enable a user to adjust audio parameters of the activated vocal content block.

[0035] In one embodiment, the interactive authoring tool includes means for auto-tuning the vocal melody or other audio input of the vocal content block. Such auto-tune functionality may be provided by a value slider for adjusting the level of auto-tune.

[0036] In one embodiment, the interactive authoring tool includes means for displaying the recorded vocal content blocks as a line representation waveform that moves with the vocals as they are recorded on a display means.

[0037] In one embodiment, the interactive authoring tool includes means for cutting out recorded vocal lines or other audio input for recorded vocal content blocks.

[0038] In one embodiment, the user interface includes means for displaying the vocal recording to the user as a visual element, the vocal recording being activated by the user tapping on a corresponding visual element with a pointing means, and once activated, a number of interactive authoring tools are provided for enabling the user to adjust audio parameters of the vocal recording.

[0039] In one embodiment, the interactive authoring tool further provides means to mute, lock, delete, change musical style, apply filters, adjust volume, adjust autotune levels, cut, duplicate, name and rename, play and / or restore vocal recordings.

[0040] In one embodiment, the display means is a touch screen and the pointing means is provided by a user's finger or stylus. Alternatively, the pointing means is a mouse and instrument content blocks are activated or deleted by the user positioning and pressing or dragging the mouse pointer over the corresponding visual element.

[0041] In one embodiment, each visual element includes a visual representation of an instrument that corresponds to the musical content in the instrument content block.

[0042] In one embodiment, the visual indication is the name of the instrument written within or adjacent to the visual element.

[0043] In one embodiment, the visual representation is an image representing a musical instrument shown within or adjacent to the visual element.

[0044] In one embodiment, each visual element is an image of a shape.

[0045] In one embodiment, each visual element is an image of a ring.

[0046] According to an embodiment of the present invention, there is provided a method for configuring an audio output file using a user interface device, said method comprising: a. providing an arrangement of interactively operable visual elements displayed on a display means, each visual element representing a musical instrument content block, each musical instrument content block including musical content sub-blocks from a musical instrument and having a plurality of audio parameters; b. in said providing, the musical instrument content blocks are activated by the user tapping on the corresponding visual element with a pointing means; c. whereby, when a musical instrument content block is activated by a user, one or more of a plurality of interactive authoring tools are provided to enable the user to adjust audio parameters of the activated musical instrument content block, and the audio parameters adjusted by the user are applied to the musical instrument content block; d. Combining the instrument content blocks to compose an audio output file.

[0047] In one embodiment, the method includes providing an interactive authoring tool that includes instrument content block shuffling means configured to replace an instrument content block with an alternative instrument content block when a visual element of the instrument content block is swiped by a user with a pointing means.

[0048] In one embodiment, the instrument content block shuffling means further comprises means for replacing an instrument content block with an alternative selection of instrument content blocks.

[0049] In one embodiment, the method includes providing an interactive authoring tool that includes means for muting, locking, deleting, changing musical style, restoring previously replaced, and / or playing instrument content blocks.

[0050] In one embodiment, the method includes providing an interactive authoring tool that includes means for enabling a user to search a database according to existing artist and / or song names and provide an audio output file with a desired sound and timbre similar to the existing artist and / or song name.

[0051] In one embodiment, the method includes providing an interactive authoring tool that includes means for allowing a user to individually change the volume of each instrument content block.

[0052] In one embodiment, the method includes providing an interactive authoring tool comprising means for displaying an audio output file divided into a plurality of sections, with musical content sub-blocks of each instrumental content block arranged in each displayed section, whereby the user interface comprises means for allowing a user to disable and enable one or more musical content sub-blocks of the instrumental content block within a section of the audio output file.

[0053] In one embodiment, the method includes providing an interactive authoring tool that includes means for reordering sections of an audio output file.

[0054] In one embodiment, the method includes providing an interactive authoring tool with means for displaying alternative section layout templates that can be selected, thereby allowing a user to select a desired section layout from a plurality of optional section layouts. Such section layouts may be displayed as a scrollable list, icons, etc. The user may be provided with three, four, or more section layout template options.

[0055] In one embodiment, the section layout template includes 5-8 sections.

[0056] In one embodiment, the method includes providing an interactive authoring tool that includes means for adding instrument content blocks for a selected instrument and genre to instrument content blocks in the audio output file.

[0057] In one embodiment, the method includes providing an interactive authoring tool that includes means for modifying the pitch and tempo of an audio output file.

[0058] In one embodiment, the method includes providing an interactive authoring tool that includes means for enabling a user to configure an audio output file for use in a short message that can be sent to a device over a network using a messaging service.

[0059] In one embodiment, the method includes providing an arrangement of interactively operable visual elements, further including a visual element representing an empty vocal content block, which is activated by a user tapping on a corresponding visual element with a pointing means, and upon activation, the user interface provides means for a user to use an input means, such as a microphone, to record a recording of a vocal melody or other audio input and save the recorded vocal melody or other audio input for use within the vocal content block.

[0060] In one embodiment, the method includes providing an interactive authoring tool that includes means for recording a vocal melody or other audio input as a vocal recording of a selected predetermined section of an audio output file using input means such as a microphone.

[0061] In one embodiment, the method includes providing an interactive authoring tool that includes means for displaying lyrics for a recorded vocal content block.

[0062] In one embodiment, the arrangement of interactive visual elements further includes a plurality of visual elements, each representing an empty vocal content block.

[0063] In one embodiment, the method includes providing an arrangement of interactively operable visual elements, further including a visual element representing at least one vocal content block, each vocal content block being activated by a user tapping on a corresponding visual element with a pointing means, and upon activation, a plurality of interactive authoring tools are provided to enable the user to adjust audio parameters of the activated vocal content block.

[0064] In one embodiment, the method includes providing an interactive authoring tool that includes means for enabling a user to change the volume of each instrument content block and / or the volume of each volume content block individually.

[0065] In one embodiment, the method includes providing an interactive authoring tool that includes means for auto-tuning a vocal melody or other audio input of a vocal content block, such auto-tune functionality may be provided by a value slider for adjusting the level of the auto-tune.

[0066] In one embodiment, the method includes providing an interactive authoring tool including means for displaying the recorded vocal content blocks as a waveform on a display means, wherein such autotune functionality may be provided by a value slider for adjusting the level of the autotune.

[0067] In one embodiment, the method includes providing an interactive authoring tool that includes means for cutting out recorded vocal lines or other audio input of vocal content blocks.

[0068] In one embodiment, the method includes providing an interactive authoring tool including means for displaying a user's vocal recording as a visual element, the vocal recording being activated by the user tapping on a corresponding visual element with a pointing means, and upon activation, a plurality of interactive authoring tools are provided for enabling the user to adjust audio parameters of the vocal recording.

[0069] In one embodiment, the method includes providing an interactive authoring tool that includes means for muting, locking, deleting, changing musical style, applying filters, adjusting volume, adjusting autotune levels, cutting, duplicating, naming and renaming, playing and / or restoring vocal recordings.

[0070] According to an embodiment of the present invention, there is provided a computer program which, when executed on a computer, performs steps according to the described methods.

[0071] The invention will be more clearly understood from the following description of some embodiments thereof, given by way of example only, with reference to the accompanying drawings, in which: [Brief explanation of the drawings]

[0072] [Figure 1] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, illustrating instrumental and vocal content blocks of an audio output file; [Figure 2] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool for a user to edit and adjust one or more instrument content blocks of an audio output file. [Figure 3] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool for a user to edit and adjust one or more instrument content blocks of an audio output file. [Figure 4] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool for a user to edit and adjust one or more instrument content blocks of an audio output file. [Figure 5]1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool for a user to edit and adjust one or more instrument content blocks of an audio output file. [Figure 6] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool for a user to edit and adjust one or more instrument content blocks of an audio output file. [Figure 7] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool for a user to edit and adjust one or more instrument content blocks of an audio output file. [Figure 8] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool for a user to edit and adjust one or more instrument content blocks of an audio output file. [Figure 9] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool for a user to edit and adjust one or more instrument content blocks of an audio output file. [Figure 10] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool for a user to edit and adjust one or more instrument content blocks of an audio output file. [Figure 11] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool through which a user creates, edits, and adjusts one or more vocal content blocks of an audio output file. [Figure 12]1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool through which a user creates, edits, and adjusts one or more vocal content blocks of an audio output file. [Figure 13] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool through which a user creates, edits, and adjusts one or more vocal content blocks of an audio output file. [Figure 14] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool through which a user creates, edits, and adjusts one or more vocal content blocks of an audio output file. [Figure 15] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool through which a user creates, edits, and adjusts one or more vocal content blocks of an audio output file. [Figure 16] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool through which a user creates, edits, and adjusts one or more vocal content blocks of an audio output file. [Figure 17] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool through which a user creates, edits, and adjusts one or more vocal content blocks of an audio output file. [Figure 18] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool through which a user creates, edits, and adjusts one or more vocal content blocks of an audio output file. [Figure 19]1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool through which a user creates, edits, and adjusts one or more vocal content blocks of an audio output file. [Figure 20] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool through which a user creates, edits, and adjusts one or more vocal content blocks of an audio output file. [Figure 21] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool through which a user creates, edits, and adjusts one or more vocal content blocks of an audio output file. [Figure 22] 1 is an exemplary user interface screen of a user interface device according to an embodiment of the present invention, showing an interactive authoring tool through which a user creates, edits, and adjusts one or more vocal content blocks of an audio output file. DETAILED DESCRIPTION OF THE INVENTION

[0073] Embodiments of the present invention are implemented by one or more computer processors and memory containing computer software program instructions executable by the one or more processors, which may be provided by a computer server or a network of connected and / or distributed computers.

[0074] It will be understood that an audio file in accordance with embodiments of the present invention is a received, saved, or recorded file containing audio or MIDI data or content that, when processed by an audio or MIDI player, produces an audio output. The audio output file may be recorded in any known audio file format, including, but not limited to, audio WAV format, MP3 format, Advanced Audio Coding (AAC) format, Ogg format, or any other format, as appropriate, analog, digital, or any other format. The desired audio or MIDI format may optionally be specified by the user.

[0075] 1 to 18 show a user interface device, generally designated by the reference numeral 1, for composing an audio output file.

[0076] The user interface device 1 is communicatively coupled to a back-end software application operable to select appropriate instrument content blocks 4 for audio output from a library of pre-recorded instrument content sub-blocks or stems 6, the selected instrument content blocks 4 being harmonically compatible.

[0077] Each instrument content sub-block 6 contains musical content from a particular instrument, such as piano, drums, synthesizer, guitar, bass, etc., and is derived from a musical performance created by a human composer or musician. Associated with the instrument content block 4 and the musical content sub-block 6 are a number of audio parameters, such as pitch, tempo, volume, style, genre, etc. Thus, an instrument content sub-block 6 in an embodiment of the present invention is derived from a particular instrument, and a number of such musical content sub-blocks provide the instrument content block 4 in the audio output file.

[0078] The selection of instrument content blocks 4 may be done automatically by a back-end software application based on input parameters provided by the user, such as instrument type, style and / or genre.

[0079] When a user initiates the composition process, they are provided with a choice requesting the generation of an audio output file containing a random selection of musically congruent instrumental content blocks. Alternatively, the initial selection of musically congruent instrumental content blocks may be based on a style choice (pop, synth, reggae, etc.) made by the user via a user interface means.

[0080] As shown in FIG. 1, which is by way of example only, the backend software application has selected instrument content blocks 4 corresponding to four instruments including "drums," "piano," "bass," and "guitar," however, it should be understood that other instruments such as synthesizers, violins, brass instruments, accordions, etc. may be selected for the audio output file by the user or according to audio parameters provided by the user, or may be automatically selected by the backend software application.

[0081] 1 shows a vocal content block 5, which is an audio recording of a vocal melody or other audio input provided by a user or by a saved pre-recording of audio input. When a user provides a vocal recording as an input file or imports a saved pre-recording of audio input, embodiments of the present invention analyze musical parameters of the audio input file, such as chord progression and tempo, and select musically congruent instrumental content blocks to combine with the vocal content block and provide an audio output file.

[0082] It will be appreciated that the audio output file is generated by playing back the instrumental content blocks 4 represented by the instrumental content blocks 4 in combination with, if applicable, the vocal content block or blocks 5. The inclusion of one or more vocal content blocks 5 within the audio output file is optional. Thus, any changes to the individual instrumental content blocks 4 and the inclusion of the vocal content block(s) 5 will affect the final sound of the audio output file when played back.

[0083] As shown in FIG. 1 , a user interface apparatus 1 displays an arrangement of interactively operable visual elements 2 on a display means 3 of a user electronic device, such as a mobile smartphone, tablet, laptop, or PC. The display means 3 may be a touchscreen, a non-touch-sensitive visual display monitor, a headset display, or other visual display coupled to or integrated with the user electronic device. The illustrated display means 3 is a touchscreen, and in such embodiments, the pointing means is provided by a user's finger. Alternatively, in embodiments in which the display means 3 is not a touch-sensitive screen, the pointing means may be provided by a mouse or other suitable pointing device.

[0084] Each visual element 2 represents an instrumental content block 4 or a vocal content block 5 and, in the illustrated example, is provided in the shape of a ring 2. However, it will be appreciated that each visual element 2 may be provided in an alternative shape, such as a square, diamond, oval, or other desired shape, or with an image depicting the instrument from which the instrumental content block 4 is derived. Accordingly, reference to visual elements 2 of embodiments of the present invention being shown as rings 2 should not be considered limiting.

[0085] Each instrumental content block 4 is activated by the user tapping the corresponding ring 2 with a pointing means. Activation of an instrumental content block 4 provides one or more of a plurality of interactive authoring tools that provide the user with various means for adjusting audio parameters of the activated instrumental content block 4. A vocal content block 5 is also activated by the user tapping the corresponding visual element 2 with a pointing means, and upon activation, a plurality of interactive authoring tools are provided to allow the user to adjust audio parameters of the vocal melody or other audio input of the activated vocal content block 5. While one such vocal content block 5 is shown, it will be understood that the audio output file may include multiple such vocal content blocks 5.

[0086] The user interface device 1 includes an interactive authoring tool configured to replace a swiped instrument content block 4 with an alternative instrument content block 4 of the same instrument that is in musical harmony with the remaining instrument content blocks 4 when the visual element 2 of the instrument content block 4 is swiped by a user using a pointing means, and provided as an instrument content block shuffling means.

[0087] The instrument content block 4 shuffling means further comprises means 24 for replacing all of the instrument content blocks 4 with an alternative selection of instrument content blocks 4 .

[0088] The user interface device 1 further comprises an interactive authoring tool providing means 7 for allowing a user to add another instrument content block 4 for a selected instrument and genre to the instrument content block 4 in the audio output file. The interactive authoring tool also provides means 8 for allowing a user to change the pitch and tempo of the audio output file, and means 9 for allowing a user to change the musical style of the audio output file.

[0089] Also shown is a timeline 11 showing the progression of the audio output file as it is played through the user interface device 1, as well as means 18 for pausing the audio output file while it is being played. The playback volume can be adjusted by a volume control 12.

[0090] 2 illustrates several interactive authoring tools that are provided when a user long-tap on ring 2 of an instrument content block 4, which in the illustrated example includes functionality that provides means to mute 13, lock 14 (i.e., prevent modification / editing and removal from selection), and delete 15 an individual instrument content block 4. It will be appreciated that long-tapping on ring 2 involves the user tapping and holding ring 2 for several seconds to access the interactive authoring tools that are provided.

[0091] 3 shows several further interactive authoring tools that are provided when the user quick-tap on the ring 2, including the above-mentioned means for muting 13, locking 14 and deleting 15 the activated instrument content block 4, as well as means for playing / soloing 16, changing the style 17 and stopping playback 18 individual instrument content blocks 4. Also shown is a timeline 11 that shows the progression of the activated instrument content blocks 4 as they are played.

[0092] 4 shows an interactive authoring tool providing means 17 by which a user may select the musical style of the activated instrument content block 4. Thus, in the illustrated example, the activated instrument content block 4 is for guitar in the current style J-Pop, and if the user chooses to change the guitar style, the user can select from the alternative styles offered by using the pointing means.

[0093] 5 shows an interactive authoring tool providing means 20 that allows a user to search a database according to an existing artist and / or song title and provide a selection of instrument content blocks 4 that have a desired sound and timbre similar to the existing artist and / or song title. A database query function 19 is shown for a user to input an existing artist and / or song title to identify instrument content blocks 4 that match the query for the audio output file.

[0094] 6 shows an interactive authoring tool providing means 21 that allows a user to individually change the volume of each instrument content block 4 in an audio output file, along with a playback timeline 11. In embodiments where vocal content blocks are included, the volume may be similarly adjusted for the vocals.

[0095] 7 illustrates an interactive authoring tool providing means 22 for displaying instrumental content blocks 4 and vocal content blocks 5 of a vocal portion of an audio output file in multiple sections 23. The sections 23 are illustratively shown as "Intro," "Verse A," and "Chorus." Within each section 23, instrumental content sub-blocks 6 are arranged to create the instrumental content blocks 4, and the vocal content blocks 5 are also divided for each section. The means 22 allows a user to disable and enable individual musical content sub-blocks 6, individual instrumental content blocks 4, and / or vocal content blocks 5 within a section 23. The means 22 further allows a user to reorder the sections 23 and reorder the musical content sub-blocks 6 and vocal content block portions 5 within a section 23.

[0096] 8 illustrates an interactive authoring tool providing means 7 that allows a user to add an instrument content block 4 (“add stem”) or a vocal content block 5 to an audio output file. The means 7 is activated upon user selection by tapping the “add stem” icon shown in FIG. 1, and upon selection, the user may choose from instrument types including, for example, guitar, brass, drum kit, etc. for the instrument content block 4.

[0097] 9, when adding an instrument content block 4, the user may also specify a genre and / or style for the selected instrument type, with the genre and / or style of "guitar" shown in the example. A suggested genre may also be provided by the back-end software application based on the existing instrument content blocks 4 in the audio output file.

[0098] FIG. 10 shows an interactive authoring tool providing means 8 for allowing a user to change the pitch and tempo of an audio output file.

[0099] FIG. 11 shows a similar screen to FIG. 1, where a vocal content block 5 is not currently included in the audio output file, and therefore the user interface device 1 includes an “add vocal” ring 2 which, when tapped by a user by manipulating the pointing means, activates the interactive author tool providing means 30 of FIG. 12, which enables the user to record a vocal melody or other audio input and save the recorded vocal melody or other audio input as a recorded vocal content block 5 in the audio output file.

[0100] 12, vocal recording means 30 allow a user to record vocal melodies in predefined sections 31 such as "Intro", "Verse A", "Chorus A", etc. by using the "+" symbol to activate the corresponding ring 2. Also shown is a timeline 11 showing the playback progression as the recorded vocal content is played back. Also provided is a means 33 for displaying lyrics of the recorded vocal content block 5. The lyrics can optionally be generated automatically by a lyrics generator.

[0101] 13 shows an interactive authoring tool providing means 50 that allows a user to set up recording parameters and start recording content for a predefined section part 31 of vocal recording, shown in the example shown as "Version A" of the vocal content block 5. Shown are an audio check 51 for an audio input means such as a microphone, filter 52 and autotune levels 53 for vocal recording, and a start recording icon 54.

[0102] 14 shows an interactive authoring tool providing means 55 for displaying recorded vocal content as a waveform 56 of a predefined section portion 31. Interactive authoring tool providing means 57 stops recording and means 58 resumes recording.

[0103] 15 illustrates an interactive authoring tool provided once a user has completed vocal recording of a section portion 31 of a vocal content block 5. Means 53 are shown that allow a user to autotune the vocal melody or other audio input of the vocal recording. Such autotune functionality may be provided by a value slider for adjusting the autotune level. Also provided are means 52 for setting a filter on the vocal recording, means 60 for displaying the vocal recording as a waveform or "moving" line display on the display means 3, and means 61 for adjusting the volume of the vocal recording on the timeline. The vocal recording may be cropped by appropriately cutting / marking the "moving" wave or line display.

[0104] 16 illustrates an interactive authoring tool providing means 70 that allows a user to save and display vocal recordings 27 created for each predefined section 31. A new vocal recording 27 for use in a vocal content block 5 can be recorded in a predefined section 31 by tapping on the vocal ring 2 displaying a "+" symbol with a pointing means. Each vocal recording 27 may be saved with an identifying name, shown in the illustrated example as "Recording 1," "Recording 2," etc. The means 70 also provides a playback timeline 11 and means 33 for displaying lyrics for the recorded vocal content block 5.

[0105] FIG. 17 shows an interactive authoring tool providing means 37 including means 71 for muting the vocal recording 27, indicated as the vocal recording “Recording 1”, and means 72 for allowing a user to delete the vocal recording 27.

[0106] FIG. 18 shows an interactive authoring tool that provides means 80 for cutting vocal recording 27, means 81 for duplicating vocal recording 27, means 82 for renaming vocal recording 27, and means 83 for deleting vocal recording 27.

[0107] 19 illustrates an interactive authoring tool that includes means 85 for displaying alternative selectable section layout templates 86, allowing a user to select a desired section layout from a plurality of optional section layout templates 86. Such section layouts may be displayed as a scrollable list, icons, or the like. A user may be provided with three, four, or more section layout template options from which to select one. In the illustrated example, the "Afropop Original" layout includes five sections arranged in the following order: "Verse A," "Verse B," "Chorus," and "End."

[0108] Each section is typically eight bars long, although some sections may be less than eight bars, such as the "End" section, which is two bars long as shown. A section layout template may contain five to eight sections, depending on various factors, including the desired duration of the audio output file. Rearranging the sections in the template provides alternative layouts.

[0109] Shown in Figure 22 is a table 100 showing three sample section layouts for a music style set to 70-75 bpm. Layout 1 includes eight sections in the following order: a. Verse A, verse B, chorus A, verse B, chorus A, chorus B, chorus B, end. Layout 2 contains eight sections in the following order: b. Chorus A, Verse B, Chorus A, Chorus B, Verse B, Chorus A, Chorus B, end. Layout 3 includes nine sections in the following order: c. Chorus A, Verse A, Chorus A, Post-Chorus, Verse B, Chorus B, Post-Chorus, Chorus B, End.

[0110] As shown, each section of the layout contains multiple bars of music (typically eight), and rearranging the sections provides a new template layout.

[0111] Such template layouts may be provided in different musical speeds such as 80-85 bpm, 92-100 bpm, 107-116 bpm, 120 bpm and / or 130 bpm.

[0112] Also provided is an interactive authoring tool having means for allowing a user to select portions of adjacent sections and combine these selected section portions to form new sections that can be dynamically included in new or existing layout templates. For example, with reference to Layout 1 in Figure 22, a user can select measures 4-8 of Verse A and measures 9-13 of Verse B and combine them into a new section for inclusion in Layout 1, such as by deleting the existing sections or adding the new sections at a position along the layout. Such new sections may also be included in alternative layouts as desired.

[0113] 20 and 21 illustrate an interactive authoring tool having a means 84 that allows a user to individually change the volume of each instrumental content block 4 and / or each vocal content block 5. The tool 84 may be provided as a button or icon that can be swiped to toggle the volume adjustment between the instrumental content block 4 and the vocal content block 5. The user can drag a finger or other pointing means to move the volume level up or down on the indicated instrument or vocal bar 87 to increase or decrease the volume level as desired. As shown, the volume level of each instrumental content block 4 and vocal content block 5 in the composition may be adjusted singly and individually.

[0114] The interactive authoring tool further includes means for enabling a user to configure an audio output file for use in a short message that can be sent to a device over a network using a messaging service. Such a short message that includes an audio output file may have a duration or length of up to approximately 30 seconds, but optimally may have a duration of 3-20 seconds, 3-15 seconds, or 3-9 seconds. A short message that includes an audio output file may further include or be synchronized with one or more multimedia files, such as one or more image and / or video files, so that the audio output file is combined with the one or more multimedia files when the short message is played on a device.

[0115]

[0010] Embodiments of the present invention further provide an interactive authoring tool that includes means for saving the configured audio output files to a library and means for sharing the audio output files on alternative media platforms, such as social media platforms. The audio output files configured for a user may also be presented as a playlist, and the user may create such a playlist. The user interface also provides means for searching for audio output files configured and released by other users, as well as means for searching for other users.

[0116] The user interface also provides means for synchronizing video with audio output files, including means for recording and editing such video, and means for adding artwork, including images and effects, to the images in the audio output files.

[0117] It will be understood that embodiments of the invention are not limited to the specific details set forth herein, which are given by way of example only, and that various modifications and alterations are possible without departing from the scope of the invention.

Claims

1. 1. A user interface device for composing an audio output file, the user interface device comprising: an arrangement of a plurality of interactively operable visual elements displayed on a display means, each visual element representing a musical instrument content block, each musical instrument content block including musical content from a musical instrument and having a plurality of audio parameters; an instrument content block is activated by a user tapping on the corresponding visual element with a pointing means; wherein, when a musical instrument content block is activated by a user, one or more of a plurality of interactive authoring tools are provided to enable the user to adjust audio parameters of the activated musical instrument content block, and the audio parameters adjusted by the user are applied to the musical instrument content block; and means for constructing the audio output file by combining the musical instrument content blocks.

2. 2. The user interface device of claim 1, wherein the interactive authoring tool includes means for shuffling instrument content blocks configured such that when a visual element for a musical instrument content block is swiped by a user with a pointing means, the musical instrument content block is replaced with an alternative musical instrument content block.

3. The user interface device of claim 2 , wherein the instrument content block shuffling means further comprises means for replacing the instrument content block with an alternative selection of instrument content blocks.

4. 2. The user interface device of claim 1, wherein the interactive authoring tools provided to a user depend on the length of time the user taps on a visual element, whereby a relatively short tap provides a first subset of the interactive authoring tools and a relatively long tap provides a second subset of the interactive authoring tools.

5. 2. The user interface device of claim 1, wherein the interactive authoring tool includes means for displaying the musical instrument content blocks of the audio output file in a plurality of sections, with musical instrument content sub-blocks for each musical instrument content block arranged in each displayed section, whereby the user interface includes means for enabling a user to disable and enable one or more musical content sub-blocks for a musical instrument content block within a section of the audio output file, and the interactive authoring tool includes means for enabling a user to reorder the sections of the audio output file.

6. 2. The user interface device of claim 1, wherein the interactive authoring tool includes means for enabling a user to add instrument content blocks corresponding to a user-selected instrument and genre to the instrument content blocks in the audio output file.

7. 2. The user interface device of claim 1, wherein each visual element includes a visual representation of an instrument corresponding to the musical content of the instrument content block, such visual representation being the name of the instrument written within or adjacent to the visual element and / or an image depicting the instrument shown within or adjacent to the visual element.

8. 2. The user interface device of claim 1, further comprising: one or more visual elements each representing a vocal content block; a vocal content block being activated by a user tapping the corresponding visual element with a pointing means; and, upon activation, one or more of a plurality of interactive authoring tools being provided to enable the user to adjust audio parameters of the activated vocal content block; and means for combining the instrumental content block with one or more of the vocal content blocks to generate the audio output file.

9. 10. The user interface device of claim 1, further comprising: a visual element representing an empty vocal content block, the empty vocal content block being activated by a user tapping the corresponding visual element with a pointing means, and, upon activation, providing means for enabling a user to record a vocal melody as a vocal recording and save the vocal recording as a vocal content block or as part of a vocal content block.

10. 10. The user interface device of claim 9, wherein the interactive authoring tool includes means for recording vocal melodies or other audio input using input means such as a microphone as a vocal recording for a selected predetermined section of the audio output file.

11. The user interface device of claim 9 , wherein the interactive authoring tool includes means for displaying lyrics for a vocal content block or a portion of a vocal content block.

12. The user interface device of claim 9 , wherein the interactive authoring tool includes means for auto-tuning the vocal content block or a portion of the vocal content block.

13. 10. The user interface device of claim 9, further comprising means for displaying the vocal recording as a visual element, the vocal recording being activated by a user tapping the corresponding visual element with a pointing means, whereby, upon activation, a plurality of interactive authoring tools are provided for enabling the user to adjust audio parameters of the vocal recording.

14. 10. The user interface device of claim 9, wherein the interactive authoring tool further provides means for muting, locking, deleting, changing musical style, applying filters, adjusting volume, adjusting autotune levels, cutting, duplicating, naming and renaming, playing and / or restoring vocal recordings.

15. The user interface device of claim 1 , wherein each visual element is an image of a ring.

16. 1. A method for configuring an audio output file using a user interface device, the method comprising: providing an arrangement of a plurality of interactively operable visual elements displayed on a display means, each visual element representing a musical instrument content block, each musical instrument content block including musical content from an instrument and having a plurality of audio parameters; an instrument content block is activated by a user tapping on the corresponding visual element with a pointing means; whereby, when a musical instrument content block is activated by a user, providing one or more of a plurality of interactive authoring tools to allow the user to adjust audio parameters of the activated musical instrument content block, and the audio parameters adjusted by the user are applied to the musical instrument content block; combining the instrument content blocks to compose the audio output file.

17. 17. The method of claim 16, comprising: providing visual elements representing vocal content blocks, the vocal content blocks being activated by a user tapping the corresponding visual element with a pointing means, and upon activation, one or more of a plurality of interactive authoring tools being provided to enable the user to adjust audio parameters of the activated vocal content blocks; and combining the instrumental content blocks and vocal content blocks to generate the audio output file.

18. 17. The method of claim 16, further comprising providing a visual element representing an empty vocal content block, the empty vocal content block being activated by a user tapping on the corresponding visual element with a pointing means, and providing means, upon activation, for enabling a user to record a vocal melody as a vocal recording and save the vocal recording as a vocal content block or as part of a vocal content block.

19. 20. The method of claim 18, comprising displaying a vocal recording as a visual element, the vocal recording being activated by a user tapping on the corresponding visual element with a pointing means, whereby, upon activation, a plurality of interactive authoring tools are provided to enable the user to adjust audio parameters of the vocal recording.

20. A computer program product which, when executed by one or more processors, causes said one or more processors to perform the steps according to the method of claim 1.

Images