Method, digital jukebox system and recording medium
The digital jukebox system integrates karaoke features with seamless transitions and central server access, addressing storage limitations and setup issues, enhancing user engagement and revenue through comprehensive entertainment and compliance with copyright laws.
Patent Information
- Application Number
- JP2023221023
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2012-01-09
- Filing Date
- 2023-12-27
- Publication Date
- 2025-01-14
- Estimated Expiration
- 2032-09-18
AI Technical Summary
Traditional jukeboxes and karaoke systems are limited by storage capacity, require separate equipment setup, and lack seamless integration for karaoke experiences, leading to reduced revenue and user engagement.
A digital jukebox system with integrated karaoke functionality that allows access to a central server for song downloads, seamless transitions between jukebox and karaoke modes, and features like video recording, social sharing, and performance scoring, while managing licensing and royalties.
Enhances user engagement, increases revenue by providing a comprehensive entertainment experience, and ensures compliance with copyright laws through integrated licensing and royalty management.
Smart Images

Figure 0007612243000001 
Figure 0007612243000002 
Figure 0007612243000003
Abstract
Description
Detailed Description of the Invention
[0001] [Cross-references to related literature] This application claims priority to U.S. Patent Application No. 61 / 584,750, filed January 9, 2012, and U.S. Patent Application No. 61 / 536,015, filed September 18, 2011, the entire contents of which are incorporated herein by reference. This application incorporates by reference the entire contents of U.S. patent application Ser. Nos. 12 / 929,466 (filed Jan. 26, 2011), 12 / 737,395 (filed Jan. 7, 2011), 61 / 202,617 (filed Mar. 18, 2009), 12 / 318,864 (filed Jan. 9, 2009), 12 / 222,785 (filed Aug. 15, 2008), 12 / 076,761 (filed Mar. 21, 2008), 11 / 902,790 (filed Sep. 25, 2007), and 11 / 902,658 (filed Sep. 24, 2007).
[0002] [Technical field] Certain exemplary embodiments relate to entertainment systems, and more particularly to jukebox systems incorporating karaoke jukebox and / or digital download jukebox functionality with photo booth functionality.
[0003] [Background and Summary] Jukeboxes have been around for about several decades, allowing users to select desired music to play in a convenient and convenient manner. Jukeboxes have traditionally been installed in commercial establishments, such as restaurants and bars, to provide customers with music of their choice for a fee. In recent years, a new generation of jukebox devices has become available. The new generation of jukebox devices offers significant operational improvements for all participants. More specifically, traditional stand-alone vinyl and CD jukeboxes have been replaced with digital download jukeboxes that communicate with and are controlled by a central server. An example of this new generation of jukebox system is shown in U.S. Patent No. 6,308,204, the entire disclosure of which is incorporated herein by reference. A leading provider of this new generation of jukebox systems is TouchTunes Music Corporation.
[0004] FIG. 1 illustrates an overview of an exemplary embodiment of a digital download jukebox system 10. As shown in FIG. 1, the jukebox system 10 includes a central server 12. The central server 12 includes a master library of audio content (illustratively "music") and / or audiovisual content (illustratively "music and associated video or graphics") that is available for download from the central server 12. The jukebox system further includes a series of remote jukebox devices 16, 16a-16f. Each of these jukebox devices is typically installed in a bar, restaurant, club, or other desired establishment. Each jukebox device is operative to receive payment from a user, such as coins, bills, credit / debit cards, etc., and to play music (e.g., from an appropriate storage location, such as a local server, a central server, a remote server, or a local recording medium) in response to the user selecting one or more songs to play. In another embodiment, the music service is paid for by the establishment on a subscription basis, and the selected music is provided free of charge to the end user. The remote jukebox device 16 illustratively includes a screen 18 and an audio system 20. The screen 18 presents information to a user and allows the user to select music. The audio system 20 plays the selected music. The screen 18 may also be used to display video or graphics related to the music. The screen 18 may also be used to display advertisements for the jukebox itself, other types of advertisements, and / or other desired information to attract customers.
[0005] The jukebox devices 16 (sometimes simply referred to herein as "jukeboxes") are operable to communicate with a central server 12 over a communications network 14, such as the Internet. The jukebox devices 16 communicate periodically with the server 12 to provide the server 12 with information regarding the particular songs played on the jukeboxes. The central server uses this information to determine the appropriate royalties and / or other fees to be paid for the songs played on each jukebox. In this manner, this new generation of jukeboxes has the advantage that music playback and / or other applicable music rights are protected in a more accurate and reliable manner, thereby ensuring that appropriate royalties are paid to artists and song owners. The central server 12 also provides new songs to the jukeboxes so that the appropriate or most popular songs for the particular customers in the store are maintained in the jukebox. In this manner, the songs available on each jukebox can be customized through communication with the central server to provide songs and / or a variety of music commonly requested by customers in each jukebox store. As described in the aforementioned U.S. Patent No. 6,308,204, the central server may also be used to preferably update the software running on the jukebox in order to modify the operation of the jukebox, for example to provide new or improved features. Thus, this new generation of jukeboxes has the added advantage that the songs (or other audio and / or visual content) and the operation of the jukebox itself can be remotely modified as desired, without requiring a dealer or other person to personally service the jukebox. Instead, such updates can be made using the central server 12.
[0006] As mentioned above, each jukebox device 16 includes a mass storage device, such as a hard drive, on which music pieces and associated video / graphic data (if any) as well as any desired graphical information to be played by the jukebox are stored. The jukebox's mass storage device typically has a limited storage capacity compared to the storage device of the central server 12. As such, the jukebox's mass storage device typically contains only a portion of the music pieces stored on the central server 12 at any one time. Moreover, there may be other reasons for limiting the storage capacity of the jukebox and / or limiting the number of music pieces stored on the jukebox, such as data security or limited space availability on the jukebox itself. For example, a wall-mounted jukebox, which is designed to be smaller in size than a freestanding model, may have limited physical space. As explained above, the music on the jukebox can be changed through communication with the central server, but typically, any jukebox stores only a relatively small subset of the complete library of music held on the central server at any one time.
[0007] In order to increase the revenue generated by a jukebox, it is important to keep the most desired and popular songs available on the jukebox for a long period of time. If customers cannot find their favorite songs on the jukebox, the utilization rate of the jukebox (and the profits generated thereby) will drop significantly. On the other hand, it is not always possible to accurately predict in advance what songs customers will want to play on the jukebox in any particular store. In fact, there appear to be many instances where a customer selects a song that is not currently on the jukebox but is on the central server. Thus, the jukebox may not be enjoyed and used to its fullest extent. To address this problem and increase the revenue generated by the jukebox, conventional jukebox systems have provided a feature that allows a user to search for songs on the central server from the jukebox and to request an immediate download of the desired song from the central server to the jukebox for an additional fee. This feature allows a user to use the jukebox to play any song that is included in the master library of songs held on the central server, regardless of whether the particular song is currently stored in the mass storage of the jukebox itself. Thus, a user may first locate a desired song in the jukebox's local storage and then, if desired, further locate the desired song in the central server (e.g., potentially accessible by selecting a search function button on the central server's screen in association with a search function). Typically, jukebox devices charge an additional fee (such as 5 credits instead of 1 credit) for instant download and playback of a song from the central server as opposed to standard playback directly from the jukebox's local storage.
[0008] There is a need for an integrated karaoke experience with all the features of the exemplary jukebox. For that matter, current jukeboxes are illustratively turned off or inactive during karaoke nights, and karaoke providers either bring their own separate equipment and set it up at the venue, or the venue itself simply sets up a separate karaoke system that is spent separately. The deactivation of the jukebox equipment represents a loss of potential revenue, even if only temporarily, at such karaoke establishments. The setup and teardown of a separate karaoke system is inconvenient and cumbersome in venues that are understaffed or have little space. Furthermore, the exemplary jukebox is barred from "karaoke only" establishments. Because jukeboxes and karaoke equipment belong to different classes in the real world, an entire market remains untapped.
[0009] As is known, the karaoke environment requires an organized process when selecting songs from a dedicated karaoke catalog containing legally licensed music. Unfortunately, it is challenging to develop a solution rich enough in features to enable a true karaoke experience in a bar or public venue. Today, commercially available karaoke systems use exemplary current music collected by a "KJ" or "Karaoke Jockey" (as opposed to a DJ). The KJ strives to utilize legally licensed versions of the music. A true effort to license music from a provider of proper karaoke music is fraught with risk, as the provider does not have the possibility of a consistent and valid license. A true effort to license music is not to provide the KJ with a vast catalog of music available in a jukebox device.
[0010] Thus, new catalog management and royalty payment strategies beyond those in place for exemplary licensed music are needed to accommodate mechanical reproduction and performance, e.g., karaoke environments. For example, certain exemplary embodiments provide methods for upholding obligations to respect copyright in more complex karaoke environments involving different configurations of rights, e.g., vocalist departures and replacements, new content generation, etc.
[0011] In this storyline, the karaoke experience creates new compositions, i.e., the combination of an original musical composition and performance. Performers often desire to retain audio and video copies of the audio or performance. However, fulfilling this desire involves potentially periodic usage of the original musical track, proper tracking and management of the production work, e.g., to comply with current copyright laws. Thus, other challenges facing the development of karaoke applications include providing the ability to create these new performance compositions, while managing to respect the licensing requirements of the original rights holders. However, media management is hindered with the spread of digital media and ubiquitous player technology.
[0012] An aspect of certain exemplary embodiments relates to providing the ability to seamlessly transition between exemplary jukebox usage or jukebox plus broadcast TV (such as when using the jukebox audio system to play audio for a football game being displayed on the venue's television) and / or new karaoke audio and video configurations in a venue or location that accommodates a jukebox and karaoke environment. At such times, it may be desirable to adjust the settings of the integrated karaoke jukebox system.
[0013] For example, the volume settings of all zones can be changed to present a fair stage environment and provide proper audio monitoring capabilities for the performers. Also, the video screens may be repurposed to provide information about the scheduled performers and lyrics for the current song. As alluded to above, it is desirable for this transformation to occur in a seamless manner by requiring very little skill from the venue staff, the karaoke master of ceremonies or the de facto strict "KJ".
[0014] Thus, it can be seen that there is a need in the art for improving jukeboxes by incorporating karaoke functionality that provides karaoke that performs a "take away" while allowing a seamless transition between jukebox and karaoke modes, while complying with licensing, reporting and / or other requirements.
[0015] The inventors of the present application recognize that karaoke can be an active, social, fun, and sometimes competitive experience. Performance is part of the karaoke experience for both performers and audience members. The more people involved in the experience, the more fun it tends to be. Smart technology can provide new KJ capabilities. Smart technology can leverage opportunities to create a connected karaoke experience for a connected world.
[0016] In this manner, aspects of certain exemplary embodiments encourage more people to perform and / or connect more people to a performance before, during and / or after the performance.
[0017] An aspect of certain exemplary embodiments relates to providing a karaoke jukebox connected to a system having communal touchpoints (e.g., user devices such as mobile phones, tablets, etc.; karaoke jukeboxes, games or other fixed or mobile terminals, etc.) that define unique times.
[0018] The method according to certain embodiments involves treating a performance as a moment of karaoke experience that connects with and stems from other moments.
[0019] Methods according to certain embodiments relate to defining moments in an experience by providing unique or distinctive interactions that make the experience immersive and distinctive for customers, whether they are performing or watching at the venue or away from the venue.
[0020] Certain exemplary embodiments, as shown and described herein, relate to a jukebox device that can be used in a jukebox mode, (a) a karaoke mode, and / or (b) a photo booth mode.
[0021] Certain exemplary embodiments relate to methods for operating a jukebox device usable in a jukebox mode, (a) a karaoke mode, and / or (b) a photo booth mode as shown and described herein.
[0022] Certain exemplary embodiments relate to a system including a jukebox device operable in a jukebox mode, (a) a karaoke mode, and / or (b) a photo booth mode as shown and described herein.
[0023] In certain exemplary embodiments, a method is provided for recording a karaoke performance in which a karaoke performer playing a karaoke performance song sings the song through a first microphone connected to a jukebox. A user may check into a site where the jukebox is located through an application on a portable electronic device operated by the user. The application has access to a karaoke queue maintained by the jukebox. The karaoke queue indicates the song being sung. Time is synchronized between the jukebox and the electronic device based on the check-in. The electronic device causes at least a video of the karaoke performance mediated by the jukebox to be captured. The captured video is received from the electronic device at a network location. With reference to the synchronized time, the captured video is combined at the network location with the high quality audio captured by the first microphone connected to the jukebox and the high quality song audio corresponding to the song associated with the karaoke performance to generate a combined recording of the karaoke performance.
[0024] In certain exemplary embodiments, a method is provided for generating a file corresponding to a performance of a performer singing a musical piece with musical accompaniment. Audiovisual data captured from a user device is received along with audiovisual data including first audio data and first video data. Audio-only data of higher quality than the first audio data is received. The first audio data and the audio-only data are combined such that the first audio data is at least partially replaced by the audio-only data to generate a new audiovisual data file having user-generated video content synchronized with the high quality audio content based on a common time reference value.
[0025] According to certain exemplary embodiments, a non-transitory computer-readable storage medium stores a program that implements these and / or other methods.
[0026] Similarly, according to certain exemplary embodiments, a system is configured to implement these and / or other methods. For example, in certain exemplary embodiments, a digital jukebox system is provided. In the system, a digital jukebox is provided that includes a processing resource including at least one processor and a memory configured. The processing resource causes the digital jukebox to operate in a standard jukebox and a karaoke jukebox mode. The standard jukebox mode is programmed to cause the digital jukebox device to play an instance of media when a corresponding payment is made. The karaoke jukebox mode is programmed to enable the digital jukebox device to participate in a karaoke performance where a performer sings a song via a first microphone connected to the digital jukebox device that plays the karaoke song. The check-in module is configured to enable a user to check in to a site where the digital jukebox device is located via an application operating on a portable electronic device operated by the user. The application has access to songs maintained by the digital jukebox device, and the karaoke queue indicates the song being sung. The synchronization module is configured such that a successful check-in operation synchronizes time between the digital jukebox device and the electronic device upon a successful check-in operation performed in association with the check-in module. The non-transitory computer readable medium is configured to receive, via the application, at least a video of the karaoke performance mediated by the jukebox captured by the electronic device, and a mixer is configured to combine, with a synchronized time reference, the captured video with the high quality audio captured by a first microphone coupled to the jukebox and high quality song audio corresponding to a song associated with the karaoke performance to create a combined recording of the karaoke performance.
[0027] The exemplary embodiments, aspects, and advantages disclosed herein may be provided in any suitable combination or subcombination to achieve further exemplary embodiments.
[0028] [Brief explanation of the figure] The above and other features, aspects and advantages of the present invention will be further understood by reference to the following Detailed Description of Exemplary Embodiments, when read in conjunction with the accompanying drawings.
[0029] FIG. 1 is a block diagram of an exemplary download digital jukebox system.
[0030] FIG. 2 is a block diagram of an improved jukebox system 10' in an exemplary embodiment.
[0031] FIG. 3 is a schematic diagram of a combination jukebox karaoke system for use within a venue or location in accordance with a particular exemplary embodiment.
[0032] FIG. 4 is a schematic diagram of an example karaoke jukebox remote control usage in accordance with certain exemplary embodiments.
[0033] FIG. 5 illustrates example performance data associated with a karaoke performance on a karaoke jukebox in accordance with certain exemplary embodiments.
[0034] FIG. 6 is a flow chart illustrating an example process for logging into a karaoke jukebox, selecting songs to be played, and uploading data to a social networking site in accordance with certain exemplary embodiments.
[0035] FIG. 7a is a flow chart illustrating an example process for combining captured audio, image and / or video content in accordance with certain exemplary embodiments.
[0036] FIG. 7b is a flow chart illustrating an example "use case" for performers competing in karaoke performances at a venue in accordance with certain exemplary embodiments.
[0037] FIG. 8 is an audio-video sequencing system in a particular exemplary embodiment.
[0038] FIG. 9 is a flow chart illustrating an example process for scoring a karaoke performance in accordance with certain exemplary embodiments.
[0039] FIG. 10 is a flow diagram illustrating an example process for adjusting aspects of a karaoke performance in accordance with certain exemplary embodiments.
[0040] FIG. 11 is a flow chart illustrating an example process for using a rehearsal package in accordance with certain exemplary embodiments.
[0041] 12a-12f illustrate a first use case for queuing songs for the first time in accordance with a particular exemplary embodiment.
[0042] 13a-13f illustrate a second use case for smart song suggestions in accordance with certain exemplary embodiments.
[0043] 14a-14f illustrate a third use case relating to playing a song in accordance with certain exemplary embodiments.
[0044] 15a-15d illustrate requests for actions to be taken during a presented performance in accordance with certain exemplary embodiments.
[0045] 16a-16f illustrate a fourth use case in accordance with certain exemplary embodiments.
[0046] 17a-17f illustrate a fifth use case for socializing the karaoke experience in accordance with certain exemplary embodiments.
[0047] 18a-18f illustrate a sixth use case relating to player engagement in accordance with certain exemplary embodiments.
[0048] 19a-19f illustrate a seventh use case relating to player engagement in accordance with certain exemplary embodiments.
[0049] FIG. 20 illustrates a screenshot of a countdown in accordance with a particular exemplary embodiment.
[0050] FIG. 21 shows a screenshot of an example photoburst in a particular exemplary embodiment.
[0051] FIG. 22 shows an example screenshot displaying an electronic or digital "proof sheet" in accordance with certain exemplary embodiments.
[0052] FIG. 23 illustrates an example screenshot that allows adding an image to a frame in a particular example embodiment.
[0053] FIG. 24 is a flow diagram illustrating processing when recording a performance or other event in accordance with certain exemplary embodiments.
[0054] FIG. 25 is a block diagram of an example configuration of an upload system in accordance with certain exemplary embodiments.
[0055] FIG. 26 is a partial schematic diagram of a performance archive in accordance with certain exemplary embodiments.
[0056] FIG. 27 is a partial schematic diagram illustrating a mobile phone user using an application on the mobile phone to record a portion of a performance in accordance with a particular exemplary embodiment.
[0057] FIG. 28 is a partial schematic diagram of a performance archive for user-based recording in accordance with certain exemplary embodiments.
[0058] FIG. 29 is a schematic diagram illustrating a cell phone audio clip matching and remixing technique in accordance with a particular exemplary embodiment.
[0059] FIG. 30 is a diagram illustrating a cell phone video file being viewed from a cloud or other network in accordance with a particular exemplary embodiment.
[0060] DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS Referring now to the figures, FIG. 2 is a block diagram of an exemplary embodiment of an improved jukebox system 10'. The jukebox system 10' includes components similar to those shown in FIG. 1. The jukebox system 10' includes a central server 12 and remote jukebox devices 16, 16a-16f connected to a communications network 14 as described above, but also includes local servers 22, 22a-22f connected to each of the jukebox devices 16, 16a-16f. The central server 12 includes a master library of songs (and / or other content). Each jukebox device includes a portion of the master library in a local storage device of the jukebox device. The central server may be used to individually manage the content of the jukebox devices by monitoring the usage of songs on each jukebox device and updating the portion of songs to maximize song usage. The central server 12 periodically receives data from each jukebox device for calculation and payment of royalties for played songs. The jukebox devices may be connected to the network in any suitable manner, such as by dial-up modem or broadband modem (e.g., DSL, cable, wireless broadband, or satellite). The communications network 14 may be any suitable network capable of delivering data (e.g., audiovisual data) from the central server 12 to the jukeboxes 16, and capable of uploading data from the jukeboxes 16 to the central server 12.
[0061] The songs (and / or other data) are digitized, compressed, and encrypted using known techniques by the central server 12 for security and bandwidth reasons before being sent to the jukebox. The songs are then decompressed and decrypted for storage and playback at the jukebox. In this manner, each jukebox maintains a library of digitized songs in a database for playback on the jukebox, which may be changed or updated through communications from the central server. The jukebox may receive and store data constituting images (e.g., still and / or moving and / or graphic images) that may be displayed on the display 18 of the jukebox device 16. A jukebox device according to an exemplary embodiment of the present invention has a structure and operates similar to that described in the above-referenced U.S. Patent No. 6,308,204. Thus, each jukebox device 16 may include one or more microprocessors, such as a main CPU and / or audio DSP, storage for storing music and / or other content, such as a hard disk, a display for displaying visual items, an audio device 20 for providing sound, a communications system that allows the jukebox to communicate with the central server 12 over the communications network 14, and operating software that controls the operation of the jukebox, including a multitasking operating system. The operating software may be updatable through communications with the central server 12, for example, as described in the above-referenced U.S. Patent No. 6,308,204. Additionally, the jukebox 16 may include one or more payment devices, such as, for example, coin, bill, and / or credit card deposit devices, that allow customers to conveniently pay for use of the jukebox. The screen 18 may be a touch screen that allows a user to select inputs by touching them.
[0062] In one embodiment, each jukebox may include a local server 22 accessible to the jukebox device. Each local server is connected to the jukebox device using an Ethernet or other type of local connection. In another embodiment, the local server may simply be a logical extension (e.g., a partition, directory, or area) of the jukebox hard drive rather than a separate hardware device. Each local server 22 includes a mirror copy of the master library of music records held by the central server 12. Before the local server and jukebox device are shipped to a jukebox distributor or operator, the local server 22 may be loaded with the master library by an entity that owns and / or controls the network of jukeboxes. Of course, due to the fact that the central server is continually updated with additional or new songs, over time the local server will no longer be perfectly consistent with the central server. Thus, the local servers 22 may also be periodically updated to continually match the library with the central server 12. For example, the central server 12 may perform the updates through communication with the jukebox devices connected to the local server 22, for example, using a dial-up or broadband modem. Alternatively, the updates may be performed directly using an update tool that a vendor or other person can connect directly to the jukebox or local server for the purpose of updating the content of the local server. The portable tool may include a removable storage medium, such as a hard drive, that can be returned to and reused by the owner of the jukebox system for future updates. The tool itself may be managed by an operator or other person responsible for maintaining the particular jukebox being used upon receiving the updated removable storage medium from the jukebox system owner.
[0063] For security reasons, the local server 22 does not contain all the digital data that constitutes any song stored on the local server 22. Furthermore, some of the songs on the local server are encrypted. The jukebox device 16 is provided with the missing portions of each song on the local server, which allows the jukebox to complete the song based on the contents of the local server and the contents of the storage device of the jukebox device. The missing data on the jukebox is necessary to decrypt the song. For example, a single block (or other small portion) of data for each song may not be present on the local server but is present on the jukebox device, and the encryption may proceed block by block based on the missing blocks. Thus, no block can be decrypted without obtaining and / or decrypting the previous block. This feature provides a great deal of security and prevents and deters theft and other types of unauthorized use or copying of songs on the local server. Thus, in this embodiment, each local server must be dedicated to a particular jukebox device so that the decryption described above can be performed properly.
[0064] According to an exemplary embodiment, each local server may be individually checked in and identified to the central server 12 so that the central server can manage and monitor each local server individually. The same applies to the jukebox devices themselves; that is, they may be checked in to the central server so that the central server can manage and monitor each jukebox individually. As can be seen from the above, the local server is an important and useful part of the jukebox system by allowing the jukebox to access the content of the local server to provide further services not available on the jukebox itself (such as providing additional songs). As will be explained below, the song library and / or storage capacity of the central server itself can be advantageously used to provide services to other jukeboxes, such as pay-per-use home jukeboxes and commercial jukeboxes, and / or other pay-per-use devices. One use of the local server may be to provide an instant song download feature.
[0065] FIG. 3 is a schematic diagram of a combination jukebox karaoke system for use within a venue or location in a particular exemplary embodiment. In FIG. 3, the components shown below the dotted line are provided in one venue or location, while the components shown above the dotted line are provided outside of one venue or location. For example, multiple venues or locations may be connected to an AV network, although the karaoke jukebox system and / or related components are omitted from FIG. 3 for clarity purposes. Also, one or more karaoke jukebox systems, displays, speakers, zones, mobile devices, remote devices, social networks, and / or the like may be provided in different locations, and the multiple components shown in FIG. 3 are provided for illustrative purposes. That is, the mobile devices, displays, remote devices, social networks may be coupled or interconnected in different embodiments.
[0066] As shown in FIG. 3, karaoke jukebox system 302 is connected to an audiovisual (AV) network 304. Karaoke jukebox system 302 includes processing resources 308 (e.g., including at least one processor, memory, non-transitory computer readable media, etc.) that facilitate execution modules used in karaoke, jukebox, photo booth, and / or other modes of operation. AV network 304 includes processing resources 308 (e.g., including at least one processor, memory, non-transitory computer readable media, etc.). Karaoke jukebox system 302 includes a song database 310, a song queue, processes or modules for managing the database or queue. In certain exemplary embodiments, song database 310 is provided on local server 302. Similarly, karaoke jukebox system 302 includes a lyrics database 314, a karaoke queue 316 to facilitate management of operation when karaoke jukebox system 302 operates in karaoke mode. In certain exemplary embodiments, lyrics database 314 may be located remotely and accessible via a network connection.
[0067] In certain exemplary embodiments, songs used for karaoke are stored in song database 310, although in different exemplary embodiments, such songs are stored in a database separate from song database 310. That separate database may be part of karaoke jukebox system 302 or may at least be accessible (remotely) by karaoke jukebox system 302. In other embodiments, songs from song database 310 may be used for karaoke, for example, if a vocal eliminator or other modification is applied to appropriately modify some or all of the vocal tracks in the song. Of course, the vocal eliminator may be ignored when the jukebox is operating in normal jukebox mode. In certain exemplary embodiments, these features may be combined in various ways. For example, two or more databases of karaoke songs may be provided separate from song database 310, such as having a database of karaoke songs available in karaoke jukebox system 302 and a database of karaoke songs located (accessible and managed) away from the processes of karaoke jukebox system 302. A premium or multiple fee may be charged for accessing songs from a separate database of karaoke songs. For example, a premium is charged when the mode is changed and a selection is made in each mode, as specified in a fee schedule, as read by the system 302. In certain exemplary embodiments, a premium is charged for selecting a song from the "regular" song database 310 and applying a vocal eliminator or other modification, as specified in the fee schedule. In certain exemplary embodiments, the second premium may be higher than the first premium.
[0068] Metadata is associated with songs in a karaoke database or karaoke catalog. Metadata information may include, for example, song lyrics, difficulty, key, range, snippets (e.g., available for playback on a mobile device), an indication of when the song was last played at a given location or venue, popularity, frequency of play, etc. This and / or other information may be used to help develop recommendations for customers, determining whether a jukebox or karaoke user is a regular or frequent user when a recommendation feature of the jukebox is activated by the customer, when the customer logs into the jukebox, etc.
[0069] In certain exemplary embodiments, a single karaoke and / or song queue may be stored, while in other exemplary embodiments, priority queues may be stored, for example, based on credit payments. Additionally or alternatively, smart queues may help group similar or dissimilar songs or good songs, separate duplicates, remove duplicates, and separate or move songs that are known to generate a good crowd response. A program or program module corresponding to this smart queue function may perform dynamic re-ordering based, for example, on popularity scores associated with songs, beat counts, known tempo data stored in a database, or pre-known artist / album / song title data.
[0070] To accommodate network connections, the karaoke jukebox system 302 includes a network interface 318 to connect the karaoke jukebox system 302 to the AV network 304 and / or other external resources. The network interface 318 of the karaoke jukebox system 302 may also accommodate connections to customer mobile devices 320. Such connections may be direct connections to the karaoke jukebox system 302 or indirect connections mediated by the AV network 304, a local server, etc.
[0071] Audio is output from the karaoke jukebox system 302 using one or more audio output ports and / or circuitry 322. The audio output 322 may support regional output to multiple speakers and / or speaker systems 324. The jukebox operating system may store separate songs and / or karaoke cues for various regions in certain exemplary embodiments. For example, separate cues may be stored so that songs are played in one region even though other regions play different songs and / or participate in karaoke. An auxiliary and / or microphone input port 326 facilitates the connection of one or more microphones, for example, for karaoke, general announcements, and / or other purposes. A camera 328 integrated into or connected to the karaoke system 302 is configured to capture images and / or video in photo booth and / or other modes (where they are temporarily stored in a storage location on the jukebox device). For example, the camera may be used to attract repeat patrons (e.g., images and / or video from the location are captured and incorporated into the attracting video / images) or for security purposes. Video output circuitry 330 is connected to a number of displays 332, for example via switching device 342 as described below.
[0072] The storage of the AV network 304 includes a master catalog 336 of media available for playback on the karaoke jukebox system 302, including, for example, songs, advertising, promotional media clips, etc. The AV network 304 includes a social network interface 338, allowing connection to one or more social networks 340 (e.g., TouchTune, Facebook, Twitter, LinkedIn, etc.). One or more remote devices 342 can connect to the AV network 304, the social networks 340, and / or the karaoke jukebox system 302 (e.g., directly or using the AV network 304 as an intermediary) in certain exemplary embodiments.
[0073] In different scenarios, the KJ may be a member of the venue staff, an enthusiastic audience member, an operator, or an automatic (machine) control. A human user may, for example, activate a simple remote control or a smart device equipped to be remotely controlled to manage the sequence of later performers, easily adjust the audio, provide spontaneous events, segment initiation associated with commentary or supplementary audio and video clips. For example, the control system may be used to bring nervous performers back into the queue, turn the volume up or down for a particular performer, play pre-stored applause or cheers, show encouraging or entertaining comments on a video display, skip performers who are no longer there (have left the venue, are unavailable, a decision has been made to skip the performer, etc.). The human KJ may be located at the venue or remote from the venue.
[0074] FIG. 4 illustrates a karaoke jukebox remote control that can be used in connection with certain exemplary embodiments. The exemplary karaoke jukebox remote control illustrated in FIG. 4 includes a number of buttons or switches. Volume controls 402, 404 are used to raise and lower the volume of each microphone. Other buttons (not shown) are used to adjust background music, etc. The KJ uses dedicated buttons, menus, etc. to cause encouraging messages to be displayed on a display for viewing by the performer and / or the audience. For example, the KJ may cause a "good" message, i.e., encouraging message, or a "bad" message, i.e., provocative message, to be randomly displayed by pressing a good message button 406 or a bad message button 408, respectively. In certain exemplary embodiments, the KJ may have dedicated buttons for the dedicated messages. Alternatively or additionally, in certain exemplary embodiments, the karaoke jukebox remote control may have a keypad or other input device for the KJ to enter a guest message or select from a catalog of predefined guest messages. The KJ may cause a performance to be recorded by pressing a record button 410 or may cause the music and / or recording to be paused by pressing a pause button 412. The KJ may cause a performer to be skipped by pressing a no performer or skip button 414. The KJ may cause a pre-arranged cheer or other effect by pressing a cheer button 416, etc. The karaoke jukebox remote control may have a remote transmitter operating under infrared, RF, Bluetooth, or other frequencies to communicate with the karaoke jukebox. In certain exemplary embodiments, the karaoke jukebox remote control may include a microphone connected to a speaker in the karaoke jukebox system and / or venue to allow the KJ to make announcements, words of encouragement, and call the next performer.An exemplary remote control may have these and / or other buttons or switches for controlling the jukebox in jukebox and / or karaoke modes. In certain exemplary embodiments, the KJ remote control may be a virtual remote control device accessible via an electronic device such as, for example, a laptop computer, a smart phone, a tablet, etc.
[0075] In certain exemplary embodiments, a karaoke box operating in karaoke mode may be configured to occupy one or more peripheral displays connected to the jukebox by sending karaoke alert signals and overriding the video source.
[0076] Knowing that the display systems in venues are hardwired and that staff do not want to be involved with the hassle of managing displays (which in some examples may be televisions), it is desirable to provide a technique for karaoke and having displays that the owner selects to automatically switch from a broadcast video feed to a karaoke feed. Certain exemplary embodiments incorporate a small computing device, referred to as a switching device (switching device 334 in FIG. 3) between existing video or audio video from satellite, cable, internal broadcast sources or other video feeds and display devices. In "normal" broadcast mode, the television signal passes through the switching device, but when the jukebox is switched to karaoke mode, a control signal is sent to the switching device which overrides the received broadcast source and substitutes video and / or images to support the karaoke experience. One or more TVs are connected to the signal switching device, allowing cascading of displays to many televisions and rendering the same karaoke signal. In certain exemplary embodiments, the control signal has information embedded therein indicating whether the display has been switched to karaoke mode or not. The switching device reads and decodes this signal and the correct video signal is sent to the appropriate display.
[0077] Lyric, performance and / or other data streams may be generated for display on an associated display device. This information may be generated by the jukebox, a switching device, a video server or other device. The generated data may include, for example, information about the current performer, comments about the previous performer (lyrics, performer identifier, song identifier, etc.), the experience at the venue in general, etc. In certain exemplary embodiments, the data streams of lyric data and performance data may be displayed solely at or via the karaoke jukebox, on one or more displays connected to the karaoke system, on portable devices at or away from the venue and logged into the jukebox system, etc.
[0078] Certain exemplary embodiments allow a customer to search the lyrics to find a song to sing. This allows a customer to find music that they are comfortable singing. Unfortunately, it can be difficult to spontaneously think of a song that is enjoyable to sing and / or that they can sing well. However, the more "hints" or "triggers" that are provided for a customer to find a song, the more likely the customer will eventually find the song and perform it spontaneously. Thus, certain exemplary embodiments allow a customer to search the karaoke catalog in one or more ways, including by original artist, song title, genre, key, beats per minute, type of performance (solo, duet, group, etc.), decade or period during which the song is popular, etc. Additionally or alternatively, a performer may want to sing a song about a particular theme that is appropriate for a particular time (e.g., songs related to the Fourth of July, Christmas, the November Hanukkah festival, a friend's birthday, etc.). A collection of songs may be collected into a song book that can be categorized and provides similar characteristics that aid the performer in finding songs. Often, a performer may only remember a portion of the lyrics of a song. In such a situation, the customer can use the search feature to search the lyrics database for a phrase or word selection to find the song.
[0079] Performers may identify themselves. Performer identification may, for example, facilitate memorization of performance data. Indeed, performance names may be provided as individual first names, spontaneous names, playful names, titles, or simple names. Providing a performance name may, for example, inform the performer when it is their turn if a cue is displayed on a suitable display device. The performance name may be used in the actual performance presentation to help identify the "artist" who is singing. For example, a catchphrase may be provided with appropriate text such as "Next is 'My Way' by Dave."
[0080] A performer may wish to store or access data about a performance, such as what song was sung, when it was sung, and where it was sung. This information may be stored in a database on the jukebox or in an audiovisual distribution record, such as a personal karaoke record for the customer. To maintain such a personal karaoke record, the customer may log into the jukebox system with a user ID / password, or may create a new profile and submit it to an authorized station server from a social network in which the performer participates, such as Facebook, Twitter, TouchTunes, etc. The karaoke jukebox system may associate the performer with the audio-video and performance data by using the profile information. Appropriate follow-up actions may be for the performer to send elements of the performance, under the performance authentication information, to a social network web service, which may copy the media or metadata to a remote storage location for later playback. Submissions to social networking sites "advertise" and "celebrate" the experience with expected or actual performance times. It may be as simple as a "tweet" that says "Dave sings 'My Way' at Michael's Bar." Alternatively or additionally, content-rich data may be transmitted, such as audio and / or audiovisual clips of some or all of the performance.
[0081] FIG. 5 illustrates exemplary performance data associated with karaoke performances on a karaoke jukebox in a particular exemplary embodiment. Each performance is labeled with a performance ID 502, which is a particular alphanumeric or other identifier generated by a computer. A performance date and / or performance time 504 is defined as indicative of the location or venue 506 where the performance took place. A performer name or other identifier 508 is included in the performance data illustrated in FIG. 5. A score or ranking 512, and songs performed 510 are stored. The location or venue 506, performer name 508, and / or songs performed 510 are accessible via a mobile application on a mobile device or searchable via an appropriate network interface on a remote computer for purposes of connecting to and searching the karaoke jukebox. For example, a particular customer may want to review all songs performed by the customer (his / her friends). A venue or location can view all performances from a particular night, rank them by score or other factor, and award prizes. Virtual head-to-head competitions are conducted and prizes are awarded based on multiple performers singing the same song. In certain exemplary embodiments, the example performance data shown in FIG. 5 and / or other information is stored in a database on the karaoke jukebox system and / or on a central server.
[0082] FIG. 6 is a flow chart illustrating an example process of logging into a karaoke jukebox, selecting songs to be played, and uploading data to a social networking site in a particular exemplary embodiment. In step S602, a performer searches for a song. The search may be based on, for example, song name, artist, album, popularity, recommended karaoke songs (updated for the venue, updated for all karaoke jukebox enabled venues, based on a predefined list, etc.). Recommended songs may be songs that the performer has sung before, or songs that are recommended for a particular performer (previous performances in performance history, previous scores, known vocal range, etc.). In step S604, a song is selected using the karaoke jukebox system or a mobile device connected to the karaoke jukebox system (a bartop terminal or a wall mounted terminal, the performer's mobile device communicating with the jukebox). If the performer is not identified to the jukebox system (e.g., logging into the karaoke jukebox by using their mobile device), in step S606 the performer may be prompted to enter certain personal information (e.g., name, phone number, email address, etc.) to be communicated at an appropriate time and in a preferred manner. The performer may have the option to join TouchTunes at this time. In step S608, the queue may be updated as various patrons make their karaoke selections. In step S610, when appropriate, the performer is notified that it is time to perform. In certain exemplary embodiments, an SMS, email, or other message is sent to the performer based on known or other criteria. In certain exemplary embodiments, some or all of the karaoke performer's cues are displayed for these and / or other purposes. In step S612, the performer sings the song.Singers may be ranked or scored based on, for example, synchronicity with the beat, deviation from expected notes or pitches, and / or quantitative measures such as audience reaction, measured applause, KJ, objective evaluations from other authorized persons, guest judgments, or other quantitative measures determined via suitable measurement devices. In step S614, some or all of the performance may be recorded for sharing. For example, audio and / or video of the performance may be stored and / or shared on a social networking service for later viewing.
[0083] In certain exemplary embodiments, the karaoke player may be linked with a smartphone, tablet or other suitable device. This has the advantage of allowing the customer to view the karaoke queue or at least a portion of it. In some cases, the customer may want to check their position in the queue to manage their time at the venue. In other cases, the customer may want to view the queue to make a decision. Integration with a mobile device may allow the customer to view the queue or a portion of it, browse through the karaoke catalog from a "safe" location without the imposition of an immediate selection, review lyrics for potential songs, submit authentication information and / or performance name along with a song selection to enter the queue, and view the performance on the mobile device as lyrics for the current song are performed. The smartphone, tablet or other computing device may, in different embodiments, connect with the jukebox device or connect through an audiovisual communications network to look up queue information, check in performances, and browse through the catalog. Thus, a remote interface may be provided to the jukebox and / or audiovisual network, allowing the user of the mobile device to log in and access the lyric database, karaoke queue, etc., through a dedicated or simple user interface.
[0084] In certain exemplary embodiments, the time of one or more mobile devices at a venue may be synchronized with the time of the karaoke jukebox. For example, the mobile devices may determine the real time or an offset between the time in the device and the time in the karaoke jukebox or system. This synchronization allows two or more devices in a venue to present and capture media in a manner that is synchronized with that presented and captured via the karaoke jukebox. This media may be augmentative; i.e., actual lyrics of the song, a timed visual progression through the lyrics, games related to the karaoke or performer's performance, time-based quiz or poll interaction, etc. The synchronization of time between devices facilitates public workgroup contests, quizzes, or surveys, etc., in a fair and visually sensible manner.
[0085] Certain exemplary embodiments allow for the creation of a "mixed performance" that receives audio from the karaoke jukebox's microphone input as well as backing audio tracks of the music. Thus, in certain exemplary embodiments, the karaoke jukebox provides a real-time music mixing and manipulation device to render the song music media while overlaying the inbound performance audio. These two audio streams are mixed by a mixing arrangement to generate a mixed audio file that includes the original music and the audio captured at the venue. This mixed file is considered a new work for which royalties and rightsholder properties are tracked. However, the mixed file is transferred or played again under the control of the karaoke jukebox to facilitate rightsholder tracking and royalty provisioning. Additional audio may be pre-attached or attached to the mixed file to include sponsor advertisements, venue and / or performance information, and rights information.
[0086] In a similar vein, configuration arrangements for the karaoke jukebox system may be used to configure the jukebox to alternatively or additionally generate a mixed performance of microphone input and backing vocal music along with one or more images in a video file for later access. Doing so helps to create the illusion of a professional performance for the karaoke performer, adding an overall sense of enjoyment on the performer's part. The performer may take one or more pictures from a connected mobile device, from images stored in the performer's social network environment, and / or from other resources to the karaoke jukebox. For retained recordings, the pictures may be used as graphics along with the audio of the stored performance. Multiple pictures may be used in the form of a slide show. In certain exemplary embodiments, the karaoke jukebox system may automatically insert pictures at predetermined locations. Such locations include, for example, the beginning, middle, and / or end of a song. Other locations include, for example, automatic and / or predetermined "turnaround points" in a song (such as when the beat is dropped in Rush's "Free Will" or well-known portions of Queen's "Bohemian Rhapsody").
[0087] Instead of or in addition to using images, certain exemplary embodiments may instead or additionally incorporate a recording of the video in a video file for later access. For example, as a performer approaches to sing for the karaoke jukebox camera, the video can be recorded and combined with audio from a microphone and background music to generate a generic audio-video file of the performance. This audio-video file is subject to the rights holder's musical restrictions and is limited by the proprietary rights assigned to the video file by the performer and / or the owner of the background music. Karaoke jukebox systems, including networked systems, may maintain control over some or all aspects of the media to ensure respect for all rights of the custodian.
[0088] Video files may be generated to include automated lead-in and / or lead-out audio and / or video for later access. The lead-in / lead-out audio / video may be stored in or accessible by the karaoke jukebox system. The performer may or may not select such clips in different implementations. These clips are effectively provided as a "wrap" for the karaoke jukebox performance with associated video. This helps to create a professional looking memento of the fun performance event, which can be purchased according to price (download from the karaoke jukebox system, social networking sites like TouchTunes, collected via mail), automatically delivered to checked-in karaoke jukebox users, and uploaded in whole or in part to the social networking site.
[0089] FIG. 7a is a flow chart illustrating an example process of combining captured audio, image and / or video content in a particular exemplary embodiment. In step S702, an audiovisual signal is captured as a song is being sung. For example, audio data is captured by using a microphone where the performer is singing, thereby capturing this portion of the performance in high quality. The performer's audio is overlaid or combined with background music as available via the karaoke jukebox. Images and / or video are captured by a camera mounted on the karaoke jukebox system. The camera is set up at the location or venue and / or a customer's mobile device is set up at the location or venue. Images and / or video clips are selected to be included with the audio. Pre-prepared or pre-stored video clips may be included during musical "silences", at the beginning of the clip, and / or at the end of the clip. If there is only one video source, the selection is made automatically. If there are multiple possible video sources, the performer, KJ or other editor may select the appropriate clip and / or image and indicate where it is to be placed in the overall stream. In other cases, clips and / or images are selected randomly or non-randomly automatically by determining where the performer is standing, facing, and selecting the appropriate image or video clip. In step S706, the audio, images and video are synchronized based on an absolute or common time reference. Further, in step S708, the images and / or video are pre-attached or attached. The combined images and / or audio are uploaded in whole or in part to a common server at a remote site, a social media site, and made available to the performer via a link sent to the performer, or the like.
[0090] FIG. 7b is a flow chart illustrating an example "use case" for performers to compete in karaoke performances at a venue in accordance with a particular exemplary embodiment. In step S720, the user's electronic device checks into the venue via a social network and / or an application running on the electronic device (e.g., a smartphone, tablet, or other device). In this scenario, the user is a friend of the performer. Because the user is checked into the venue, the application knows who is performing, what song, and when the performance is. For example, the application may access a karaoke song queue at a karaoke jukebox device. In step S722, the performer selects a song. The performer's friend may activate a "record" button on the electronic device, and in step S724, the electronic device captures audio and / or video of the performance. The audio recording may be highly directional or potentially low quality due to the particular user's device hardware, the user's location, and the likelihood of ambient or background noise. The video may be limited to where the user points the camera. In certain exemplary embodiments, the audio and / or video data is stored on the device and later transmitted to a network archival location (eg, the cloud) for subsequent processing as described below.
[0091] As the performer performs the song, audio is captured from the performer's microphone. This microphone is a high quality input source, controlled to capture a small amount of background noise, especially compared to the amount of background noise of the electronics. The audio from the performer's microphone is digitally "processed" and mixed with the underlying high quality music from the karaoke jukebox, e.g., in conjunction with appropriate modules of the jukebox, server, or other computer resource. Digital and / or other effects may be added, e.g., adding reverberation, vocals, harmony lines, auto-tuning features, etc. These effects may be automatically activated at predefined points in the song where the original recording originally had such characteristics. A database of metadata may be referenced by the computer system to modify such information or to trigger such effects. Digital and / or other effects are added by applying known filters, algorithms, transformations, and / or other predefined, user-specified times. In certain exemplary embodiments, digital and / or other effects may be added directly to the karaoke jukebox via an appropriately configured audio manipulation module.
[0092] Referring again to FIG. 7b, in step S728, the audio and / or video from the electronic device is mixed with the modified audio from the microphone that is overlaid on the audio of the underlying musical piece. The electronic device is checked into the location and synchronized with the local karaoke jukebox system, allowing the combination of different audio streams from different sources, thereby providing a common timestamp so that the different audio streams are overlaid in a consistent fashion even though the recordings start and stop over an hour, and the recordings from the microphone and the recordings from the electronic device start and / or stop at different times. The audio and / or video selection devices are triggered locally or remotely to determine the mixing conditions for each stream at the selected predetermined audio level. Selectively mixing different audio streams in this manner helps to produce high quality audio, while at the same time providing a sense of personal ownership in the music-making process and connection to the venue or particular musical event, in a manner that simulates a small or intimate "rock star"-like performance, at least in some ambient audio, mixing personalized or unique user-generated content (UGC). In certain exemplary embodiments, the audio streams may be mixed in equal or other portions. The majority from the electronic devices is considered to be an "amateur" or "unprofessional" quality recording, while the majority from the karaoke jukebox device is considered to be a more professional or higher quality recording. Some or all of the audio data from a given source may be replaced with some or all of one or more other data. Replacing 80% of the audio from the electronic devices has been found to preserve the appropriate ambient sound from the venue while producing a very high quality overall song. However, certain exemplary embodiments replace more or less of the 80% as described above. The swapping or mixing may occur at a server in the cloud (where the audio from the electronic devices is stored after it has been transmitted and accessed), at the karaoke jukebox, or elsewhere.
[0093] In certain exemplary embodiments, audio from multiple electronic devices is combined with high quality data from a karaoke jukebox system. This is advantageous when highly directional audio is captured to represent left and right channel audio data. In certain exemplary embodiments, left and right channel audio data are mixed in equal parts using appropriate interface devices. In other cases, source recordings are converted to mono data and duplicated over the left and right channels. Similarly, v data is mixed from various sources. This is advantageous when computer algorithms detect a lot of darkness, a lot of light, and fast motion that can cause dizziness when played back. In certain exemplary embodiments, all audio and / or video streams are stored for mixing and matching by performers, recorders, venues, etc.
[0094] With reference to FIG. 7b, in step S730, once a new production is generated, links enabling download are sent to some or all of the involved parties. For example, the link may be provided to the owner of the electronic device that captured the audio and / or video, with corresponding contact information known by an application running on the electronic device, or to the performer of the song, with contact information known by the performer providing login or other identifying authentication information to the karaoke jukebox system, KJ, venue, and / or other involved parties. In some implementations, all of this information is stored at least temporarily in an appropriate memory location until the link is transmitted or accessed. In certain exemplary embodiments, the link may be associated with streaming media. In certain exemplary embodiments, the audio and / or video files may be delivered rather than the link.
[0095] In certain exemplary embodiments, a performer may use links and access information from a jukebox or other designated terminal or device to enable previewing of media before it is distributed to others. For example, a performer may use corresponding devices and user interfaces to designate generated audio / video packages as available to people recording the performance, friends, venues, lists or sub-lists of friends organized in groups. Thus, a performer may have control over at least user-generated contacts that use the likeness of a particular performer. Similarly, in some embodiments, an owner or operator of an electronic device may designate created audio / video packages to be selectively made available. These features promote privacy and help performers retain rights to their likeness, provide for overall music copyright royalties, etc.
[0096] 8 is an audio-video sequencing system implementing the selection made in an audio and / or video selection device in a particular exemplary embodiment. A source audio stream 802 (or multiple source audio streams) is received from a microphone (and / or electronic device such as a smartphone, tablet, etc.) and sent to an audio mixer 804 to be mixed with background music and / or live sounds from the crowd (e.g., from an electronic device). The audio mixer 804 assigns different weights to different audio streams such that a small amount of ambient noise is added while the vocal level is provided at a level appropriate for the underlying musical piece to be played. This mixing produces a complete, mixed audio stream. Similarly, one or more source images and / or one or more source video streams 808 are fed to an image / video selector 810. After such selection, a complete, mixed video stream 812 is produced. The complete, composited audio stream 806 and the complete, composited video stream 812 are provided to a sequencer 814, which are mapped to each other in a fixed format and, when composited, result in a logical video file with synchronous times associated with the audio and video / images. The sequence data is passed to a video packager 816, which composites them. Additional content may be added via the packager 816. Such additional content may include pre-attached or attached audio and / or video (advertising, sponsorship, copyright, downloads and / or other information). A target audio and / or video file 818 is finally generated and uploaded, in whole or in part, to a server, a social networking site, etc.
[0097] In one exemplary embodiment, the acoustic settings of the venue are adjusted to transition appropriately from traditional audio to karaoke audio. If the usage is not 100% karaoke, a karaoke jukebox system is illustratively installed in the venue, and the audio system in the venue is configured through appropriate interfaces to support various zones, each with its own assigned relative volume. Since the focal point for a karaoke performance is the stage or area where the patrons perform, the relative volume of each zone may not correspond to the acoustic logic settings for karaoke. Thus, certain exemplary embodiments dynamically adjust the volumes for the zones to optimize the acoustics for the karaoke performance. For example, multiple audio program settings are provided to accommodate live jukebox, background music, karaoke, live, DJ and / or other events. These settings may be pre-specified (by an operator, manager, venue staff or other authorized person) and / or dynamically adjusted (by an operator, manager, venue staff or other authorized person). The relative balance is set, and the multiple settings are recorded (in communication with the karaoke jukebox) on a non-transitory computer readable recording medium for future reference. Transition settings between the various modes are recorded to facilitate easy switching between the various modes.
[0098] A microphone configuration utility module is provided to assist in establishing improved acoustic balance in a venue. A display screen is displayed after invoking the configuration utility, and instructs or commands the technician to position the microphones in certain instances (e.g., the layout of the setup or general layout). After the technician instructs the configuration utility that the microphones are properly positioned, the configuration utility triggers the output of a series of tones from various possible zones that are received by the inputs of the microphones (connected to the speakers) and provides for improved balance and volume limits to be applied to the control circuits of the speakers. This technique helps to ease the installation of the karaoke jukebox system and reduce the possibility of feedback. In certain exemplary embodiments, the user may be asked to leave the microphone in a central area (the performance area). In other exemplary embodiments, the installer may be asked to reposition the microphones in front of various speakers installed in the venue, listen to test signals emitted from the speakers, adjust the system to the appropriate volume, and identify potential for feedback or poor sound quality. In certain exemplary embodiments, adjustments to the configuration utility may include selections to display or selectively undertake per-zone and / or per-speaker tests to be performed in certain exemplary situations. The resulting profiles are stored and used to make adjustments in volume, balance levels, etc. when the jukebox switches between modes. These sound equalization techniques are similar to those offered by Yamaha's YPAO system.
[0099] The modules of the karaoke jukebox system of certain exemplary embodiments may be configured to detect dominant melody lines in songs, make them scalable by a processor of the jukebox, and compare performers as they are measured against the melody lines. Such comparisons may be visually displayed for the performers and / or audience members so that the karaoke performances can be compared against the performances popularized by the original artists. This may be accomplished, for example, by comparing the observed audio against standards recorded on the jukebox, a network recording location (either on a central server or from an external provider database) or elsewhere. In some cases, it may be possible to obtain metadata, including song performance rating data, from external sources, such as databases maintained by separate providers, recording devices of pre-computed metadata managed by the jukebox provider, etc. In other cases, however, the karaoke jukebox system may implement an algorithm for detecting melody lines against which performances should be rated.
[0100] This karaoke jukebox implementation of dynamic melody creation, interpolation, and extraction can be compared to the inbound audio to generate an informative and entertaining rendering on a display connected to the karaoke jukebox system. Scores can be associated with the performance by comparing the performance against an actual or inferred melody line, and / or by comparing detected timing or synchronicity (resulting from comparing the karaoke performance against a performance popularized by the original artist, a performance recorded in memory for later use and / or reference) with the original material to score for note accuracy, timing accuracy, etc. These accuracy assessments can, in some instances, be regular sampling, resulting in a score for each sample, allowing the system to generate an aggregate score depending on policies in place, such as favoring strong beginnings and endings, favoring the entire song, discarding deviations beyond a threshold, weighting deviations, etc.
[0101] In certain exemplary embodiments, the assistive instruments may be modified based on the calculated quality of the performance, e.g., compared to the derivative melody line. For example, if the karaoke jukebox system's scoring system determines that the performer is performing above a threshold, the karaoke jukebox system may generate additional audio signals that are layered onto the performance audio (applause) and / or display new videos (e.g., crowd cheering, crowd waving lights) and / or cues in the karaoke jukebox video system.
[0102] Similarly, additionally or alternatively, the volume of a performer's microphone may be (dynamically) altered based on the calculated quality of the performance compared to the derived melody line. A scoring system may determine that one performer out of a group of performers singing at the same or different times rates highly and is "better" than the others. For that singer, the dynamic melody generation, interpolation, extraction from the jukebox may be configured or programmed to have increased audio volume relative to the other performers. Similarly, poorer performers may have the volume reduced. Additionally or alternatively, within a song, microphone volumes may be increased for better performers relative to the underlying song and decreased for poorer performers, and / or supporting vocals may be added.
[0103] As alluded to above, in certain exemplary embodiments, a singer's performance may be based on a calculated quality of the performance compared to the derived melody line. For example, by using the performer's different scores stored in memory, the scoring system may evaluate the performer's performance as an overall score that can be compared to other performers and to the performance of the particular performer or other performers. Similarly, the score may be based in part on detection of the rhythm of the lyrics of the song and comparison corresponding to the beat of the song. A karaoke jukebox may use algorithms associated with detection of the beat to change the lighting as well as comparison of rhythms associated with the detected consonants to the beat of the song. Improved alignment and timing will result in a higher score. Scores in absolute terms and / or trends to reflect performance based on comparison over time for a particular performer are provided in certain exemplary embodiments.
[0104] Depending on the resulting beat detection and performance comparison provided by the algorithms, supporting sounds are preferably added to the performance. For example, a beat or rhythm is preferably added to the performance. If the performer seems off-beat, the volume of the performer's microphone is preferably reduced, the song is slowed down or sped up, and / or other remedial actions are taken to make the song sound better or at least "not as bad". Thus, certain exemplary embodiments support changes in supporting instruments based on the calculated quality of the performance compared to consonant timing for beats, etc., and microphone volume based on the calculated quality of the performance compared to consonant timing for beats, etc. The singer's performance is evaluated based on various factors as described above.
[0105] FIG. 9 is a flow chart illustrating an example process for scoring a karaoke performance in accordance with certain exemplary embodiments. In step S902, scoring metrics and / or baseline data are defined or calculated. For example, the baseline data corresponds to the rhythm of the song or segments, pauses, notes, etc. of the song. In step S904, the song is performed. In step S906, the performance is compared to the baseline during and / or after the performance. In step S908, feedback is provided during and / or after the performance. The feedback may be encouragement, suggestive comments, instructions, other visual cues to sing higher or lower (e.g., using a pitch meter), applause, etc. Feedback may be generated automatically (e.g., in the case of pitch meters, cheers, etc.), based on customer-specific messages (sent via text, email, via a mobile application running on the customer's mobile device), KJ-provided messages. In step S910, a score may be calculated in part based on the score metrics. For example, the score metric may determine how many points are awarded for singing notes within a particular range of expected pitches, singing a word, a series of words or beatboxing at the correct or expected time, manipulating a microphone or other implement in an expected manner, etc. In step S912, this score may be archived. Information about the performance (as shown and described in connection with FIG. 5) is stored. Optionally, in step S914, the performance of the musical piece is stored and / or shared. In certain exemplary embodiments, the performer's score is tracked over time and / or used as a baseline "handicap" for future scores.
[0106] The key in which a performer is suitable is largely unknown to the average individual. Performers have been known to inadvertently sing songs that present a challenge, either necessary or desirable, due to their vocal range. In certain exemplary embodiments, a key-changing algorithm changes the key of a song by dynamically transposing, raising or lowering musical frequencies, or automatically adjusting the input audio from the performer's microphone. However, for certain exemplary embodiments, it is possible to recommend the best key to use and / or the best key to use in a particular song based on past performances and scores, historical or expected vocal ranges, etc.
[0107] It is advantageous for the performer to be able to determine the natural key. This allows the performer to sing a short scale or an arpeggio that accompanies the spoken audio. Additionally or alternatively, "corrections" for the performer can be made in substantially real-time by having the person sing a short scale or ratio or the lyrics of a piece of music and displaying a graphic indicating the high, low or just pitch. This can be done as part of the singer's calibration phase for each performance or during the karaoke mode in some instances.
[0108] The key determination algorithm can guide the performer to the most natural key and presents a difficulty rating for each piece of music for the performer based on how far a given piece is from the natural key. For example, pieces within a full step of the natural key are rated as easy, pieces within a major third are rated as medium difficulty, pieces between a major third and a major fifth away from the natural key are rated as difficult, and pieces beyond that are rated as "very difficult" or "expert." Such ratings are stored in memory and compared to the performer's natural key to generate a display list in which the difficulty is indicated. The number of notes in the determined melody line that are outside the performer's range or expected range can be examined. The more notes in the derived melody that are within the performer's range, the higher the level of indication that the piece is appropriate for the customer. Pieces with many notes outside the performer's cognitive range are more difficult pieces to play.
[0109] An auto-tuning or auto-tune-like feature may be presented to or accessible via the karaoke system and selectively activated within predetermined thresholds to correct deviations within certain amounts and / or to produce interesting effects at appropriate times during the performance of a given piece of music.
[0110] FIG. 10 is a flow chart illustrating an exemplary process for adjusting aspects of a karaoke performance in certain exemplary embodiments. Similar to the description of FIG. 9, in step S1002, baseline data is defined or calculated. Optionally, in step S1004, performer-specific settings are retrieved (from a central server). The performer-specific settings may indicate that the user requires a certain average Auto-Tune adjustment when singing a given song, that the volume is increased or decreased in a certain way, that distortion is added, etc. In certain exemplary embodiments, the performer-specific settings may be customized for a particular song, venue, etc. In step S1006, the song is performed. Similar to step S906 of FIG. 9, in step S1008, a comparison is made with the baseline data. The settings are adjusted based on deviations (within the Schoech threshold) from the baseline data. For example, the Auto-Tune settings are adjusted, the song may be transposed or pitch changed, the tempo may be increased or decreased. In step S1012, the performer-based settings are stored and / or modified based on this performance. Similar to step S914 of FIG. 9, in step S1014, the song is stored and / or shared.
[0111] Once a performer is identified to the system and the system determines the most comfortable key, the system may be configured to suggest a key in which the song may be performed and / or that is best suited and recognizable to the performer. This may be accomplished, for example, by comparing the songs and comparing metadata that identifies when the song is sung, a perceived or derived melody. In certain exemplary embodiments, suggestions of songs are generated and / or specific songs are ranked based on this data.
[0112] Rather than a performer selecting a particular song, in one example, a game is provided in which the system allows other performers to issue a challenge by selecting a song to be sung by a performer who has already agreed to participate in the game and from whom the message is sent, and displaying the message on a shared or centralized display. In one example scenario, the game program may provide the possibility to define one or several teams with the names of singers or other indicia. For example, there may be multiple teams (e.g., two or more) consisting of one or more (e.g., three) singers. The game program may allow each team to take turns selecting one or more songs of the singers of the other teams. The challenging singer may be asked to perform the song selected by the opponent. The audience may evaluate the performance of the song by a scoring system, by simple applause detected by a microphone, or by sending texts, emails or other messages. The game program may generate a ranking using such information. The ranking may additionally or alternatively be based on more objective techniques, as described above. Different weights may be assigned to objective (system determined) and subjective (audience provided) feedback to determine the overall score. Furthermore, an objectively "bad" performance is often enjoyable by the audience, and good "stage presence" can make up for some objective deficiencies in a performance. The table can then be turned on and the challenge singer can select a song for his or her opponent in the karaoke jukebox mode of operation.
[0113] In another example variation, the system may be set to randomly select songs, or may be set to select from one or more particular categories, genres (e.g., Country Classics), etc. In this mode, a customer may be requested to sign up to participate in a "Country Classics Challenge" and asked to play a song selected by the system based on criteria established at the beginning of the contest.
[0114] In yet another example variation, possible songs can be presented to the audience for next performance. One of the possible next songs may be selected based on votes from mobile phones (applause judged by the performer or the system, etc.). "Karaoke Roulette" allows for tournament oriented, evening or evening segments can take place. Scores may be the same or different as above.
[0115] It will be appreciated that these and / or other "variants" may be provided in various combinations and subcombinations in alternative exemplary embodiments to provide an enjoyable karaoke experience, and thus, it will be appreciated that these and / or other "variants" may be available on a single karaoke jukebox device in different operating modes selectable by KJs, venue staff, or others.
[0116] The karaoke jukebox system includes a connectivity configuration that can support connection to a smart phone or portable device that enters the karaoke jukebox environment and continues to respect and manage the licensed content present on the karaoke jukebox. Connection from the smart phone or portable device can be via a Bluetooth® connection, a wide area network that connects the smart phone to the karaoke jukebox system server infrastructure, or otherwise directly from the portable device to a short range communication system or short range wireless system within the venue.
[0117] Thanks to the exchange of commands and messages, the server infrastructure can communicate karaoke jukebox system commands to modify operation. These commands include, for example: · Requesting music or karaoke catalogues; Request lyrics for songs in the catalogue; · Submission of user credentials to log into the Karaoke Jukebox system; · Commands to check in or start a session for a particular venue; · Submitting requests to perform songs; · Withdrawal of request to perform a piece of music; · A request to postpone or expedite a performance request; · Comment, vote or request information about current performance; · Request a pending queue of plays; · Submission of photos taken by performers to karaoke jukeboxes from mobile devices; · Submitting images or video of a performer's performance to Karaoke Jukebox from your mobile device; · A request from the mobile device to the karaoke jukebox and server infrastructure to establish venue time to enable synchronization of the karaoke jukebox with the device and display of lyrics; · Submitting input regarding performance information and other polls, survey responses and responses; Other features as required.
[0118] In certain exemplary embodiments, the mobile device can interact with a karaoke jukebox system to search for content using suitable criteria such as, for example, song title, artist, album, genre, theme, recommendations, collections, and the like.
[0119] In certain exemplary embodiments, the mobile device can interact with the karaoke jukebox device and / or karaoke jukebox system following synchronized lyrics presented on the second display directly on the mobile device.
[0120] In certain exemplary embodiments, a mobile device can interact with a karaoke jukebox system to select a song from a catalog and submit the song title and performance name for addition to a play queue.
[0121] In certain exemplary embodiments, the karaoke jukebox system includes configurations that allow mobile devices to interact with the jukebox system by delivering comment messages from a mobile application to comment on a performance. For example, sending comments to enthusiastically support a performer, remaining neutral, commenting on how good or bad the performance was, etc. In certain exemplary embodiments, messages sent by the mobile device can be used to vote, like or dislike a performance, by allocating a period during which messages are considered ratings or by inserting a flag that identifies the message as a vote. Multiple numeric votes and scores are also possible. The voting and / or scoring features can be tabulated and displayed via a display of the karaoke jukebox system.
[0122] In certain exemplary embodiments, a mobile device can interact with a karaoke jukebox system to record a performance using a video camera on the mobile device, and this video stream is transmitted to the karaoke jukebox system and / or server for combination with processed high quality audio via a microphone connected to the karaoke jukebox system, etc., to create a video file of the performance for later access.
[0123] It is therefore also possible to use a mobile application on a mobile device to record a video of the performer's performance of the piece of music. The jukebox system, server or mobile device may include a device to synchronize that video with the audio captured by the karaoke jukebox system as appropriate. Additionally, it may be desirable to add some or all of the crowd and ambient noise of the venue to the composite performance audio. Thus, the audio and video files captured by the mobile device may be transmitted to the karaoke jukebox system via a local wireless in the venue, a wide area network, a karaoke jukebox server infrastructure or some other means. At that time, either within the karaoke box system or the karaoke jukebox server infrastructure, for example, the music of the original piece of music, the recorded audio from the performer, any real-time modifications such as reverb, the video from the mobile prosecution, and any viewer audio from the mobile device may be integrated into a complete video performance package. This video performance package may be a video file of its own, a set of files that allows the creation of a video file based on composition input rules that govern the relative volumes of all the audio data and the resulting quality metrics of the output audio-video file. Synchronization may enable this combination. As described above, audio and / or video content may be pre-added or pre-appended.
[0124] In certain exemplary embodiments, a mobile device can interact with a karaoke jukebox system to purchase a rehearsal package for use at home or other locations other than a venue, with the package optionally including a fixed number of recordings. A song is preferably selected on the mobile device, and the rights to use the song and lyric data, if desired, to rehearse for a future performance are preferably purchased. The rehearsal package may allow for purchase or temporary access to a version of the song's lyric data that can be played one or more times (e.g., up to a limit identified in the package) within the karaoke mobile device. The rehearsal package (either free or paid) may allow a finite number of performances, or an unlimited number of hours or days, to be sung and practiced on the mobile device. The rehearsal package (either free or paid) may allow a user to sing and practice on the mobile device for an unlimited number of hours or days, a finite number of performances, or an unlimited number of days. In certain exemplary implementations, the implementation may not make the music and lyrics available as part of the rehearsal package after the time has elapsed once the number of performances has been reached. It is also possible to purchase special rehearsal packages that have quotas in different implementations, limits on rehearsals approaching the number of rehearsal attempts, or much larger limits. In certain exemplary embodiments, the rehearsal application may be available for free or for a one-time cost, while certain rehearsal packages with certain songs may be offered for free or for a part amount.
[0125] FIG. 11 is a flow chart illustrating an exemplary process for using a rehearsal package in certain exemplary embodiments. In step S1102, a rehearsal package is downloaded (e.g., to a device on which the package is executed). The rehearsal package may include one or more songs for practice purposes. In certain exemplary embodiments, the rehearsal package may be matched with one or more songs, for example, so that a user may download a rehearsal package / song combination. In other exemplary embodiments, a comprehensive rehearsal package may be provided with songs optionally downloaded separately. In step S1104, a performer may sing to the rehearsal package as a practice. As above, in step S1106, a comparison may be made with baseline data during and / or after a practice performance. The baseline data may be calculated substantially in real time, pre-programmed as part of the package, such as a rehearsal. In step S1108, feedback may be provided as needed. In step S1110, a rehearsal score may be calculated. In step S1112, the rehearsal data may be archived as needed (e.g., to a networked location, such as a central server, the device on which the package is running, etc.). This optional archiving allows the performer to track his / her performance and improvements over time. It may also be used to allow adjustments to be made within a live karaoke jukebox environment, such as, for example, anticipated auto-tuning, volume, tempo, pitch adjustments, and / or other settings may be altered to account for anticipated deviations from baseline data. If the rehearsal package and / or songs have limited usage, the same may be selectively disabled in step S1114 (e.g., after a predetermined number of uses, after a certain amount of time has passed). In certain exemplary embodiments, the rehearsal package may include commercial songs, scales, simple compositions, public domain songs, etc.
[0126] Such performance and / or grading techniques are possible via a rehearsal module operating on a mobile device equipped with a suitable mobile karaoke jukebox application. For example, in certain exemplary embodiments, it may be possible to use the rehearsal package via a mobile device to detect a dominant melody line in a song and allow the performer to be measured against this melody line. For example, when using the rehearsal package on a karaoke mobile device, it may be possible to provide the ability for the performer to be measured against this melody line and observe visual and / or audio feedback meters, gauges, or indicators. This may include a mobile application that detects the dominant melody line, utilizes a metadata file containing the melody line, and compares the input audio to the expected melody.
[0127] In certain exemplary embodiments, it is possible to use the rehearsal package via the mobile device to modify the supporting instrumentation based on the calculated quality of the performance compared to the derived melody line. For example, additional beat back chorus instruments may be added as encouragement, or additional vocal support may be added for "poor" performances.
[0128] In certain exemplary embodiments, it may be possible to use the rehearsal package via the mobile device to alter the volume of the performer's microphone based on the calculated quality of the performance compared to the derived melody line.
[0129] In certain exemplary embodiments, it may be possible to use the rehearsal package via the mobile device to evaluate a performer's performance based on the calculated quality of the performance compared to the derived melody line.
[0130] In certain exemplary embodiments, it may be possible to use the rehearsal package via the mobile device to detect rhythm and beats within a piece of music and allow the performer to make measurements by comparing consonant timing to the beat. Preferably, it is within the karaoke system, such as a karaoke jukebox system, that the music obtained from the karaoke jukebox can be analyzed for beat detection. This beat detection may be used to detect the rhythm and intonation of consonants within the performance and provide a comparison to the music being rehearsed. Alternatively, or in addition, metadata may be provided to assist or reduce the need for advanced detection techniques.
[0131] In some embodiments, it may be possible to use the rehearsal package via the mobile device to modify the supporting instruments based on the calculated quality of the performance compared to the consonant timing on the beat. Depending on the score of this comparison, the metadata may include additional backing instrumentation that may be added or removed.
[0132] In certain exemplary embodiments, it may be possible to use the rehearsal package via the mobile device to vary the volume of the performers' microphones based on the calculated quality of their performance compared to consonant timing on the beat.
[0133] In certain exemplary embodiments, it may be possible to use the rehearsal package via the mobile device to evaluate a performer's performance based on the calculated quality of the performance compared to consonant timing on the beat.
[0134] Performers may use the mobile device to identify themselves and view personal competitive, historical and / or other performance data. For example, previous performance data of poor performers who have identified themselves may be maintained on the Karaoke Jukebox server infrastructure. This content is available through a controlled player system to respect the work of the original rights holders. The Karaoke Jukebox mobile application may connect to the Karaoke Jukebox server infrastructure for the purpose of obtaining previous performance and performance data for individuals who have submitted the appropriate credentials. That is, to view videos, the mobile device user must access the content from a secure site or portal where royalties and / or other accounting standards are maintained. This approach allows the Karaoke mobile device to play content from the Karaoke Jukebox server infrastructure on the Karaoke mobile device in a controlled manner that respects appropriate copyright laws and / or other related agreements. For Karaoke Jukebox customers, it is also possible to rent or provide temporary access to media related to their performance, which may be stored on the Karaoke Jukebox server infrastructure. The media may be viewed, for example, using a controlled Karaoke Jukebox player system that continues to respect the rights of the original musical composition rights holders and the rights of the performers.
[0135] Identified performers can view previous performances via the mobile device. For example, on a karaoke mobile device, once an individual submits the appropriate credentials, the individual can view their own content (achievements and performance data), as well as content for performers to which they are provided temporary or permanent access.
[0136] Identified performers can share their performances with others through submissions to social media services via mobile devices. For example, after submitting credentials for a social media service, performers can submit performances, snippets of performances, and / or performance data to the social media site. In some implementations, such submissions can be automated (e.g., for certain registered users who configure the application appropriately for the venue's social network presence). For this media to play on the social media site, the social media site needs to support the karaoke jukebox system's media player, which is configured to respect all of the parties' rights (by providing limited access, royalty accounting features).
[0137] Traditional jukebox and karaoke environments are different in the sense that for a karaoke environment there is a concept of a sound stage of the performance. The karaoke experience can be improved by having stronger sounds around the performance and weaker sounds away from the performance.
[0138] Additionally or alternatively, the performer may benefit from a monitor or the like so that the performer can easily hear the music, voice, and make appropriate adjustments. The monitor may be mounted on the floor in front of the performer, angled upwards. However, this arrangement may be problematic in some normal bars and restaurants, since the performance stage often serves "double duty" as a dance floor during the juke period. It is therefore more convenient in some exemplary scenarios to have a portable, wireless performer monitor that can be connected to the karaoke jukebox when needed. In certain exemplary embodiments, the performer may use wireless headphones connected to the karaoke jukebox as a monitor. In other exemplary embodiments, a mobile application running on the performer's mobile device may be used to play background and / or vocal audio, thereby acting as a monitor.
[0139] The karaoke monitors may make this connection wirelessly and without any perceived latency to the karaoke jukebox in certain implementations. This may be accomplished by conventional wireless data technology, through analog RF and / or other suitable technology that is less susceptible to interference from other equipment in the venue. This type of configuration may help to avoid the need for wires running through potentially high traffic areas. It is also desirable for this monitor speaker to be battery powered, thereby helping to reduce the need for power cords. This monitor system may be moved to a safe location to be recharged during the day and placed in a temporary position during the karaoke performance. The karaoke jukebox system may treat this as an additional zone and let the performer or KJ adjust the volume for the performance.
[0140] Certain exemplary embodiments relate to karaoke video and lighting accessories. Like a conventional jukebox, the karaoke jukebox may have the ability to control outgoing lighting via a DMX output stream, a series of streams of data indicating light control, or some other means. The karaoke jukebox may also be capable of controlling performer spotlights located in the venue. These venue spotlights are directed at the performance area and may change color and intensity based on a data stream sent from the jukebox in response to the time of the music and / or metadata associated with the piece being played, the scoring, audience reactions, KJs, cues. Additionally or alternatively, under the control of the karaoke jukebox system, the spotlights may be moved in response to predefined animations such as searchlights and audience highlights as well as a variety of other video effects that accompany the lighting movement. The lighting may return to the stage based on a command from the karaoke jukebox after the predefined animation has been performed by the KJ cues.
[0141] In certain exemplary embodiments, the pan-tilt-zoom (PTZ) capabilities of these spotlights can also be applied to the video cameras in certain exemplary embodiments. The video cameras respond to pan, tilt and zoom controls from an operator, for example, using either a remote control, a karaoke mobile device with a special remote control, or an automated device that tracks the performer. Tracking of the performer occurs from the performer positioning him or herself within a target that appears on a second screen, karaoke jukebox, audio monitor or other location. Once positioned inside the screen and the song begins, the karaoke box system can send pan-tilt-zoom commands to the camera appropriately based on separate tracking of the face, movement and / or performer.
[0142] This PTZ camera and spotlight feature may also be controlled by the camera and pointed at the performer or elsewhere, but in certain exemplary embodiments may respond to infrared or other signals emitted by the performer's microphone, for example, for tracking purposes. Periodic checking of the position of the performer's face holding the microphone may, in some exemplary cases, enable the camera to self-correct throughout the performance.
[0143] In certain exemplary embodiments, the performance monitor may include both audio speakers and a video screen to prompt the performer, which may provide face tracking alignment and show the singer's performance overlaid with lyrics, or, in addition or instead, simply the lyrics or performance.
[0144] The karaoke jukebox microphone system may include mechanisms to animate with visible light such as infrared or spatial (e.g., geo) positioning signals, and potentially illuminate with cameras and / or spotlights within the venue, and record video of the performance. The karaoke jukebox microphone system may have the functionality to restart a song from the karaoke system in some embodiments, either via gesture or button. The karaoke jukebox microphone system may also have the functionality to allow the performer to improve their vocal performance via gesture or button (via an auto-tune function). Gestures allow a second screen or monitor screen to display options for the performance, such as, for example, change keys, reverb, auto-tune, etc.
[0145] The karaoke jukebox system may include a server infrastructure that allows patrons to access and interact (e.g., via a browser) with the karaoke jukebox environment via their mobile devices, home computers, or other devices. This interaction may be done in a manner that ensures that the presented media is secure and respects the rights of song rights holders.
[0146] In this manner, the karaoke jukebox infrastructure can identify performers to enable credential access to the system, or at least to access protected media content, performance data, etc. Identified performers with appropriate authorization can view previous performances, recordings of previous performances, etc., via the karaoke jukebox infrastructure.
[0147] The identified user may share the performance data or achievements with other identified users, subject to fees and / or restrictions imposed by the rights holder. Additionally or alternatively, the identified user may use social media credentials to record access to the performance data, achievements, or portions thereof, on a corresponding social media site. If the site supports a karaoke jukebox infrastructure media player, for example, controlled access to other users may be considered as authorized access by the identified user. In certain exemplary embodiments, the generated content may be made available in a proprietary format accessible only via the jukebox infrastructure media player. For example, the proprietary format may facilitate rights tracking and royalty accounting, since digital rights management (DRM) features may include watermarks, etc.
[0148] For performances where unlimited rights have been acquired or where no permissions are required, performance data and results may also be posted to a fully public site, and it is an advantage for rights holders and performers to be able to post snippets of performance data and results to media sites or sites that are used to promote the karaoke experience at venues or on behalf of Karaoke Network or Karaoke Network's partners.
[0149] These snippets do not necessarily contain the entire performance, but can provide an opportunity to share part of the experience and encourage further research - for example, snippets can effectively serve as a "teaser" to encourage someone to purchase the performance, for example, as a keepsake of a fun outing.
[0150] Identified users may purchase and request use of a rehearsal package for use outside of the venue, which, as described above, may include a length of time during which the user may have access to the music and lyric data for purposes of performing a finite number of performances for which the user has access to the music and lyric data.
[0151] It may be useful for the performer to view the quality of his or her performance as established by comparing the derived melody line or melody metadata to the audio. This may be presented to the performer graphically or acoustically to encourage and adjust his or her performance. Based on the performer's rehearsal score, the supportive devices may be altered to provide encouragement. Similarly, by using the rehearsal package, the volume of the performer's microphone may be altered based on the quality of the performance calculated in comparison to the derived melody line. The performance is finally evaluated based on the quality of the performance calculated in comparison to the derived melody line, musical composition, and lyric metadata to provide feedback regarding the timing of the rehearsal. For example, based on the performer's rehearsal score of the musical composition timing and rhythm, the supportive devices may be altered to encourage the rehearsal. Additionally or alternatively, the rehearsal package may include audio snippets of the rehearsal performance or encouragement from a musical expert.
[0152] The performance packages described herein may be provided as stand-alone elements, modules or configurations executable on a computing device including at least one processor and memory. Such elements, modules or configurations may be configured to perform process steps corresponding to, for example, the flowcharts shown and described herein. Information obtained via the rehearsal package may be stored and uploaded to the karaoke jukebox server for future reference, such as when a singer attempts to perform a previous song. Based on the performance data from the rehearsal package, values such as auto-tune, microphone volume, background music volume level, etc., are retrieved and set for the venue.
[0153] The following are example use cases for the improved karaoke jukebox system in certain exemplary embodiments.
[0154] 12a-12f illustrate a first use case relating to queuing songs for the first time in certain exemplary embodiments. A customer browses for songs on a display, perhaps using karaoke, specific browsing criteria (FIG. 12a). Browsing may be done via a karaoke jukebox device, a mobile device, within the venue. Lyric previews may be provided and songs selected on the display may be added to the queue (FIG. 12b). A customer's photo may be taken, for example, for the queue and / or performance display (FIG. 12c). A customer may opt-in via SNS or other notification (the user may need to enter a phone number if the user is not already a recognized user of the karaoke jukebox system or such data has not been provided through a trusted social media service the customer is logged into) (FIG. 12d). The customer may be asked to sign up for TouchTunes. A song may be paid for and a "how it works" video may be displayed (FIG. 12e). Some or all of the queue may be displayed for the user, along with a photo or other indicator of the soon-to-be performing customer, if desired (FIG. 12f).
[0155] 13a-13f illustrate a second use case for smart song suggestions in certain exemplary embodiments. The user views a TouchTunes mobile application suggestion screen and is asked to take a range or other test (FIG. 13a). The user then takes the test to determine the "best" or at least recommended song (FIG. 13b). The user views the results of the range test and the results of the song suggestions (FIG. 13c). These suggestions may be viewed based on the customer's interests, and the customer is asked to review the karaoke library (FIG. 13d). Songs resulting from the library review may be viewed and songs may be added to a queue (FIG. 13e). Some or all of the queue may be displayed for the user, optionally along with photos or other indicators of customers who will soon be performing (FIG. 13f).
[0156] 14a-14f illustrate a third use case related to performing a musical piece in a particular exemplary embodiment. A customer may receive a notification (e.g., SNS, email, or other notification) that the customer is about to be replaced (FIG. 14a). The customer may proceed to a staging area and obtain a microphone (e.g., from a microphone stand) (FIG. 14b). Pitch help may be selected (via a button on the microphone) (FIG. 14c). When the customer is ready to perform, they may be instructed to press a play button (on the microphone) (FIG. 14d). Once the play button is pressed, the microphone may be activated and music may be played (FIG. 14e). Lyrics and / or melody may be displayed for the performer to complete the performance aspect of the karaoke experience (FIG. 14f). Settings are downloaded and placed in place if the user is an authenticated user, has previously set such settings (e.g., with respect to pitch help, transposition, volume), has completed one or more rehearsal modules, and has a karaoke history that can be read and summarized.
[0157] The patrons can view feedback from the crowd by looking at the lyric screen. Prompts for actions to be taken during the performance can be provided, for example, as shown in Figs. 15a-15d. Instructions for motion control are provided, for example, at a 16 bar break. The instructions may be intended to correspond to the beat, and the patron may cause the movement and / or feedback to be displayed on the screen. Once the song is over, the reaction of the crowd may be displayed on a feedback screen. In certain exemplary embodiments, the microphone may be equipped with one or more gyroscopes, accelerometers (linear or non-linear) to determine or determine its position, movement and / or orientation, etc. A comparison of the movements communicated to the display (signals communicated or acquired via the jukebox or server) and those corresponding to the actual movements is calculated, and in certain exemplary embodiments, the performer's score may be based in part on this tracking. These and / or other motion sensors and / or locators help determine or infer the location of the microphones and therefore the performers, and enable a tracking system for the camera and / or lighting devices in association with the karaoke jukebox system to direct the cameras and / or lights towards the performers at all or selected times. Gyroscopes, accelerometers, and the like on the microphones may be used to track or infer movement in certain exemplary embodiments. In certain exemplary embodiments, the cameras and / or lights may be integral or separate from (but operatively associated with) the karaoke jukebox.
[0158] 16a-16f illustrate a fourth use case of a particular exemplary embodiment. For example, miscellaneous information may be displayed on the display (FIG. 16a). The user may submit answers to multiple choice or other questions, such as via SMS, email, or a dedicated application accessible on the mobile device (FIG. 16b). The customer may receive feedback and be asked to download the TouchTunes application (FIG. 16c) if they win a prize (e.g., credits). The user may then download TouchTunes (FIG. 16d), log an account (FIG. 16e), and use the prize money won from the trivia contest (FIG. 16f). Of course, it will be understood that other audience engagement features and the like may be provided, including, for example, rating a singer's performance, voting for the next song or patron to perform.
[0159] 17a-17f illustrate a fifth use case for making the karaoke experience social, in accordance with certain exemplary embodiments. When queuing a song, the customer may choose to video record the performance. The customer may be asked to sign up for a TouchTunes account if they are not already a recognized user of TouchTunes. A video of the performance may be captured and saved to TouchTunes. The customer may later receive an email containing a link to the video of the performance. After following the link, the customer may log into TouchTunes to view the video of the performance. Some and / or all of the videos of the performance may be shared via Twitter, Facebook, and / or other social networks.
[0160] In certain exemplary embodiments, the captured video may incorporate video content captured by cameras integrated into the karaoke jukebox system, external cameras installed in the venue, and / or video captured by one or more portable devices (e.g., smart, etc.). Because the devices connected to the karaoke jukebox system may have a synchronized time base, different sources may be spliced together as the performance is taking place or at a later time. For example, the KJ may direct one or more displays in the venue to receive video signals from a particular device. Like many directors, the KJ may be able to switch between available input video sources. For example, customers may be able to do this at a later time to create a custom movie of the performance. For example, footage from multiple devices may be submitted (automatically or at the user's request) to a central audiovisual network server and associated with the date / time and / or performer of a particular performance. A catalog of user-created content for performers and others to create their own footage may be searched. High quality audio recorded by the karaoke jukebox microphone may be added to the video as an audio track. As noted above, this may be facilitated thanks to the time synchronization features of certain exemplary embodiments. In certain exemplary embodiments, the composite video may be generated automatically. For example, the video may randomly select different video segments or may combine user content with the karaoke jukebox video content on a random, pseudo-random, or non-random basis. Other customer cameras may provide different angles of the performance. Thus, in some implementations, whether the video content is user-generated or automatically generated, other views may be selectively incorporated based on the movements of the performers. The movements of the performers may be tracked by position-indicating or inferring devices (e.g., trackers, accelerometers, gyros, etc.) incorporated into the karaoke jukebox, microphones, etc.Based on this data (such as tracking data associated with the device, facial and image recognition performed on the video, etc.), specific videos can be selected for compositing into a common video file, along with high-quality captured audio.
[0161] 18a-18f illustrate a sixth use case of performer engagement in a particular exemplary embodiment. A customer searches for a song to be played by a friend. The song may be selected because it is expected to sound fun, interesting, particularly good or bad, etc. The customer may also select a friend who already uses TouchTunes. Alternatively, the user may enter an email address to invite the friend to join TouchTunes and / or participate in the karaoke experience. The friend may receive a notification that they have received a "challenge" to perform the song and may decide whether to accept the challenge. The friend may play the song to bring rewards (unlock a "challenge badge") and bring "coins" or credits, tokens for each person at the checked-in location, and the progress of the content may be reflected on the display. The challenge may be marked as completed and the sender may be notified that the challenge is completed. Of course, it will be understood that there are other ways to encourage performer engagement, such as between multiple individuals or teams of individuals, and that this is one example of how a challenge may be issued and how completion of a challenge may be rewarded. If the challenge is accepted, the song may be added to the karaoke queue along with instructions from the challenger (the person to perform the song) and / or the person who initiated the challenge.
[0162] 19a-19f illustrate a seventh use case relating to performer engagement in certain exemplary embodiments. A venue manager may use the karaoke jukebox to configure venues. The venues may be displayed on the karaoke venue map on TouchTunes along with information such as name, address, theme, etc. Karaoke music preferences may also be configured to give priority to certain genres and determine whether karaoke performances are pay-per-play performances, cost of each performance. The karaoke jukebox may prioritize certain genres in user interface elements that are displayed to customers who interact with the karaoke jukebox or mobile devices that are checked into the venue. Details of karaoke availability and listings of special events taking place at the venue may be specified by authorized persons. Similarly, karaoke nights and events from some or all associated venues may be displayed on the TouchTunes calendar. In some cases, only venues to which a customer has subscribed or otherwise expressed an interest may be displayed on the calendar. In this regard, in certain exemplary embodiments, a module operating on the jukebox and / or having control over the jukebox may enable such configuration to be provided by authorized users.
[0163] Purikura is known in the art. However, the inventors of the present application realize to build on the familiar fun of traditional purikura with modern technology to create a next generation experience. For example, rather than providing a monotonous environment where pictures can only be taken at regular intervals, certain exemplary embodiments relate to incorporating purikura like activities into a jukebox and / or karaoke jukebox. In such exemplary embodiments, a series of digital pictures can be taken continuously (e.g., 12 pictures per second). In such exemplary embodiments, the color of the flash may be optimized or improved for the environment by using LEDs or other lights that the jukebox has (having the camera determine the lighting at the time of shooting, calculating an offset amount to match the lighting characteristics, and adjusting the flash). Digital filters can enhance the quality of the image and / or allow the user to express creativity. For example, music-themed filters, backgrounds, etc. may be added to the photo rather than a frame that is music, venue, or theme. Drawing tools allow the user to make further modifications to the captured image. The digital "proof sheet" gives the user potentially greater control over their photos and allows them to select their favorites. Because the photos are taken digitally, they can be distributed to the user or users via digital channels, such as by posting to an email server or social media site. The captured images, and subsequently modified as necessary, can be incorporated into a music video, karaoke performance, attraction loop, uploaded to a social media site for the venue and / or user for which the photo was taken, etc.
[0164] The following description provides an example use case for a Purikura Jukebox in accordance with certain exemplary embodiments. The attraction loop for a Purikura may include previously taken and / or prepared photos. From the "Home Screen", the user can choose to switch between Jukebox mode (e.g., to access jukebox-related functions), Purikura mode, or Video mode. If the user selects Purikura mode, the user may have the option to take a test image. The test image is used to help the user orient themselves in front of the camera, demonstrate how the image will be cropped, etc. Before taking a live shot, the user may be asked to pay in advance and / or agree to terms of use.
[0165] When the photo booth is ready to take a picture, a countdown may be displayed on the jukebox or associated display so that the person being photographed can properly compose themselves / herself / themselves. Figure 20 shows a screenshot of the countdown in a particular exemplary embodiment. The area to be cropped from the image may be shown as greyed out, for example, compared to the main image area.
[0166] One or more photos can be taken. Photos can be taken in rapid photo burst fashion, each time the user activates a button or the like (optionally following a countdown). For example, FIG. 21 shows an example photo burst screenshot in a particular example embodiment. The current photo is displayed on the jukebox in the main display area. A timeline (displayed above the main area in this example) may indicate how many photos can be taken, showing how many photos are to be taken while providing a small representation of each. The images being displayed may be highlighted. A secondary display, such as an LED array on the main screen, may similarly display the progress of the photo burst.
[0167] An electronic or digital "proof sheet" may be displayed, such as the example shown in FIG. 22. Twelve photographs are shown in this example as this is how many images were captured during the photoburst. However, it will be understood that more or less images may be taken in different example scenarios. When more images are displayed than can be printed, stored or manipulated, the user may select some suitable subset of the images (such as, for example, four images out of the twelve).
[0168] Various filters may be applied and / or various elements may be added to some or all of the selected image. For example, a "rock star filter" may add multiple spotlights of different colors while adding lens flare and / or a foggy look to create a "rock star-like" atmosphere for the image. Images may be converted to black and white or sepia tones, softened, have their corners faded out or otherwise distorted to give the appearance of vintage or technicolor images, etc. Blurring, shading, sharpening, etc., red-eye reduction, lens flare may be added. The image may have its color levels, brightness, contrast, etc. Frames may include, for example, vintage or round frames, themed frames (e.g., as shown in FIG. 23); frames for a particular sponsor (e.g., advertiser) or venue. In certain exemplary embodiments, the raw image data may be uploaded to a remote location and subsequently manipulated in these and / or other ways, for example, via a web-based interface accessible via a mobile application, a remote computing device running a browser, etc.
[0169] The user may select a target output device or location for the images. For example, the user may choose to print the photo(s) on a printer integrated or connected to the Purikura Jukebox, send a digital copy via email or MMS message, post the photo to a particular social networking site, etc. The Purikura Jukebox may have appropriate network and / or telephony connections (potentially through optional servers or gateways) to accomplish digital transmission of the image(s). The user may purchase additional copies for printing or digital transmission. Digitally transmitted images may have copy-protected, digital watermarks to help protect against unauthorized copying. In some scenarios, the user may pay a premium for unprotected images. If images are uploaded to a social media site on behalf of the user, the registered user's profile may be queried to obtain associated usernames, passwords or other authentication information to enable logging into the site and posting. If such information is not provided or if the user is not a checked-in user, the Purikura Jukebox may prompt the user to enter such information.
[0170] Once printing and / or digital transmission is complete, the user may be prompted to return to the proof sheet, start a new photo session, return to jukebox mode, etc. The invitation loop may be updated in some embodiments to include the most recently captured image (e.g., in the event that the user does not "opt out" of such inclusion).
[0171] As can be seen from the above, this technology can be utilized to improve the traditional purikura experience while tying it to the jukebox and venue environment. For example, a purikura jukebox can instruct the user to become a "photo director" and "strike a pose." Participants can respond with suggestions on what to look like ("Look scared"), iconic poses ("Vogue now!"), etc. Such photos can be printed, transmitted digitally, uploaded to social networking sites, etc.
[0172] In another example mode, a user may sign up for a "Deployment Night," "Scavenger Hunt," or "Challenge" mode. Throughout a predefined time, a mobile application running on the user's mobile device may prompt the user to take photos with specific expressions / poses / items, etc., with different people, at different times. These photos may be turned into slideshows, videos, etc. that can be transmitted digitally. Prizes may be awarded for successful completion of the challenge. Contests may be run for costume parties, if user-based voting is allowed.
[0173] Time limits may be imposed in certain cases to ensure that the jukebox is not used for excessive purikura operations. For example, a user may complete the purikura experience within 1-10 minutes. Exemplary minimum times are approximately one minute or one and a half, with a maximum time of 7 minutes. If the jukebox is busy or unused, or if the queue is exhausted, it may trigger the cessation of some or all of the purikura functions. A timer may be displayed when a predefined time of use, etc. is nearing the end (e.g., 30 seconds before the 7 minute time has elapsed). In some cases, if the user chooses to take a test shot, the photo may remain on the screen for a short time (e.g., 10 seconds) or until a start or play button is pressed. Test shots may likewise be deactivated after a short time (e.g., 2 minutes) after use. A live preview feature may be provided in certain exemplary embodiments. The live preview feature may display raw image data and may be maintained for later use. Face detection for focus and metering may be activated using known algorithms. After the photo is taken, optimization filters can be run, potentially including smoothing skin features and creating enhancement effects to separate foreground elements from background elements. The user may have predefined times to complete different sub-operations within the photo booth experience. For example, the user may have 1 minute to complete selections from the proof sheet, 3 minutes to modify the photo, and 2 minutes to submit / print the selections. These timers may restart if the user returns to the proof sheet or starts a new photo booth session. Of course, these time frames are provided as examples, and longer or shorter time limits could be imposed in some situations. Note that some situations may not include any time limits at all.
[0174] The user may be charged for various functions in different embodiments. For example, a base purchase price of say $5 allows the user to take a burst of photos, select four photos, and print them. This price may be reduced if a printer is not attached, network connectivity is not possible, etc. Texting, emailing, uploading, additional prints, more operations, etc. may require a premium fee in certain scenarios. In some scenarios, digital transmission and / or uploading may be provided free of charge, possibly at cost, if the user chooses to allow venues to use the images for public viewing and / or other purposes.
[0175] With the advent of real-time broadband connections, customers are able to utilize music lists that they or their friends maintain on external data services (e.g., social networking sites). These data services allow customers to post their current activities and observations. The digital jukebox system of certain exemplary embodiments allows customers to identify themselves to the jukebox by submitting authentication information to the jukebox, individual account, or social networking account. Once identified, activities such as music selections, music comments, social plans, and music collections can be shared via the social network.
[0176] To create a credential on the jukebox network, the customer would preferably submit an image to be associated with the account. Such an image would be referred to as the customer's avatar. The avatar would preferably be created by the customer through an independent process performed from a computer or mobile smart phone. The photo would be submitted via the jukebox network or directly on the jukebox itself.
[0177] This may be accomplished under certain exemplary circumstances by configuring a jukebox with a photo feature and allowing the customer to associate this photo with their personal account. These images may show a single person, a group account showing all the staff at a particular location, a tight-knit group of friends sharing an evening, or a larger group. Alternatively or in addition to still frame avatars, certain exemplary embodiments allow customers to take short videos of themselves and use these videos as avatars to be used as mementos of their time spent at the venue. Indeed, these images and / or videos of activities, sharing music, etc. may provide a visual memento of the time spent together at the venue. This provides a more enjoyable experience for individuals to enjoy the music and have a photo or video record of their evening.
[0178] As jukeboxes become more sophisticated and move towards media centers and incorporate more media center functionality, it is desirable to provide supplemental audio and microphone capabilities. Doing so in certain circumstances allows individuals at the jukebox to interact with the system or with distant individuals and hear audio that is just for them and not broadcast to the entire venue. Additionally or alternatively, individuals can respond to or transmit audio that is picked up by a microphone configured to prioritize local audio over ambient audio.
[0179] These microphones may be provided internally to the jukebox, as wireless peripherals to the jukebox, and in certain exemplary cases, allow customers to add audio clips to avatars (e.g., still image and video avatars) that they experience through social media distribution services. Individuals may view avatars of their friends and hear associated audio clips.
[0180] A venue may also have its most popular or featured customer owning avatars or avatars whose audio is presented on a jukebox controlled by the audio and video system in certain exemplary embodiments, as well as individual introductions of playlists and music sets.
[0181] The camera used to capture the avatar in the jukebox may have additional functionality and / or may be utilized in a number of different ways, for example, as described herein. For example, the jukebox of certain exemplary embodiments may be configured to take pictures while music is playing, thereby allowing a customer to immerse themselves in the jukebox without interrupting the music playback. Multitasking operating systems and / or capabilities may be provided for these and / or other purposes.
[0182] Alternative photographs not intended for the creation of avatars may be offered as a service. Customers may pay for such images by providing music credits to Jukebox. Photos taken by Jukebox may be redeemed for a number of credits, cash paid via virtual wallets, credit cards or bills or coins associated with personal social media accounts, altered, printed and / or delivered to mobile applications via email, internet, social networks.
[0183] In-venue printing capabilities may be provided. For example, in certain exemplary embodiments, the jukebox may include within its form a printing means for customers to obtain their own photo prints from the jukebox device at a later time. Alternatively, a remote printing station controlled by the jukebox and used to print photos and other materials (coupons, promotional vouchers, etc.) may be at least under communication control with the jukebox such that these images are printed on behalf of individuals, venues, advertisers and / or other persons. Any suitable wired or wireless connection may be provided. For example, a network printer may be configured via a LAN, WAN connection, Bluetooth, etc.
[0184] Video may be paid for with music credits, cash, credits or virtual wallet accounts, etc., to take video of the moment and to enable sharing of this video via social media websites, email and internet links. Audio is optionally captured along with the video through a microphone provided to the jukebox and / or synchronized from a remote source (e.g., the customer's mobile device). Synchronization can be facilitated by providing a common or shared time stamp service as between the various devices involved in the video and / or audio capture.
[0185] This video session can occur with or without music being played, thereby providing a second revenue opportunity for the jukebox device: for example, a jukebox can multitask to make money for the operator by playing music and selling photo services, video services and audio-video services, all substantially simultaneously.
[0186] A camera can be operated within the jukebox at any time, and motion in front of the jukebox can be detected by employing an algorithm that compares the most recent captured image with the current image. This motion is used to trigger a specific attraction loop in certain exemplary embodiments by encouraging passersby to engage in music or other activities on the jukebox. This motion sensing tracking can trigger a face detection service such that a portion of the observed image is presented on the jukebox or, in certain circumstances, on a TV screen connected to the jukebox. Additionally or alternatively, filters and frames can be applied to the observed image that provide an example of what the photo or video might look like. The captured and / or printed images are incorporated into a standard attraction loop that advertises the jukebox, karaoke and / or photo booth features of the smart jukebox in certain exemplary embodiments.
[0187] Many jukeboxes are typically located in subdued lighting locations. It may be desirable to supplement the available light when filming with light from the jukebox. For example, in certain exemplary embodiments, based on the light intensity detected from the camera, the jukebox may supplement its LED and / or other lighting systems and, if necessary or desirable, may use light emitted from the LCD display to supplement the light intensity of both the photograph or video being taken, thereby improving the effective white balance of the photograph or video being taken. Of course, other image and / or video characteristics aside from or in addition to white balance may be adjusted, altered and / or improved by altering the light, including, for example, color saturation, overall brightness, hue, exposure, etc. Also, it is possible to correct for asymmetries and / or inadequacies in ambient light in certain exemplary implementations by using the camera to detect or infer the presence of such problems and instruct the jukebox lighting system on how to correct them.
[0188] Celebrating events with a group of people using social media is very popular. However, jukeboxes provide additional opportunities for non-sequential interactions related to one event. For example, a baseball team may have won an important game that they would like to commemorate with music and photos. An individual can create an event by first identifying themselves using their credentials and creating an event name. The event may have a theme assigned to it from a set of templates that the jukebox provides. In this example, the customer would choose a sports victory theme and give it a name like "We Finally Beat the Panthers". Throughout the evening, others can go to the jukebox and add their music selections, photos or comments to the event, using credit or cash or a virtual wallet, etc.
[0189] In certain exemplary embodiments, each event entry can be made as part of a payment event. For example, a customer can pay to take one or more photos and submit a video or commentary to the event. Additionally or alternatively, the creation of the event itself can require payment. This payment can cover all, part, or any of the possible follow-on activities associated with the event over the course of an evening or event or period.
[0190] This ability of certain exemplary embodiments to use the jukebox to create a media log of an event allows digital souvenirs to be created by the jukebox for a variety of experiences, including events that take place at the venue prior to the event, such as a singing contest, trivia contest or other group activity.
[0191] A repository of event media and the ability for a jukebox to then post this media to social networks or specific individual email addresses helps create a record of the experience on behalf of a group, rather than shared by individuals.
[0192] In certain exemplary embodiments, a user may identify themselves by a username, password combination, an image presented to a camera, or an electronic message from a proximity device for purposes of creating a virtual event and / or adding elements.
[0193] In some cases, jukeboxes equipped with photo and / or video capabilities can be provided to individuals at the venue to participate and share their experience. Social media contributions need not be limited to simply what is captured on the jukebox. For example, a jukebox photo booth application allows users to log in or check into the jukebox from a mobile device and participate in the exchange of entertainment media directly from their mobile device. This includes, in certain exemplary embodiments, the ability to submit media photos, video, text, audio, etc. to the juke repository or the ability to consume audio video text and images projected from the jukebox in real time or retroactively.
[0194] All of the social media sharing functionality may be possible from a mobile device that checks into a fully photo booth-equipped jukebox. Thus, capturing, sharing, etc. (via the internet, email, social networking sites, and / or the like) is possible in certain exemplary embodiments both through the jukebox and multiple mobile devices within or away from the venue.
[0195] Challenges exist when providing jukebox-delivered media to devices within a venue such that video images and / or audio are synchronized. Audio, video, quiz, game data, etc. may be disjointed or unfair if time synchronization is not effectively managed. In certain exemplary embodiments, the jukebox may include a mechanism to synchronize its time with the time of remote devices using a network server or direct communication between devices. Also, due to unpredictable latencies of wireless networks, it is preferable for the jukebox to discover when latency occurs and resynchronize timing to allow all devices to present media again within a well-synchronized time frame, so that the media experience is not compromised. Thus, certain exemplary embodiments may be operated such that video, images, and / or audio are delivered, displayed, captured, and / or allowed and synchronized at the appropriate time.
[0196] Once checked in (e.g., identified as being present at the venue based on the social networking service sending a signal indicating the venue and the user's login credentials), the mobile device, in certain exemplary embodiments, can participate in and begin creating a virtual event. This allows others to submit song selections, audio, video, and commentary submissions for a digital recording of the event. From the mobile device, this can be done for free or funded by a virtual wallet associated with an account, such as the mobile device owner.
[0197] It will therefore be appreciated that, using certain exemplary techniques disclosed herein, many people can participate in an event from a variety of different computing devices, thereby forming a collection of different sub-events or activities.
[0198] Certain exemplary embodiments described herein may be used in conjunction with the user interfaces disclosed, for example, in U.S. Patent Application Serial No. 12 / 929,466, filed January 26, 2011, which is incorporated herein in its entirety. Additionally, certain exemplary embodiments may be used in conjunction with the designs shown and described in U.S. Patents D475,029, issued May 27, 2003, D616,414, issued May 25, 2010, D629,382, issued December 21, 2010, D642,553, issued August 2, 2011, 29 / 371,255, filed December 14, 2010, and 29 / 401,854, filed September 16, 2011, the entire contents of each of which are incorporated herein.
[0199] Although certain exemplary embodiments are referred to as karaoke and photo booth applications in conjunction with jukeboxes, it will be understood that the techniques disclosed herein may be used in any combination or subcombination. For example, the karaoke, photo booth and / or jukebox techniques disclosed herein may be applied to any type of on-demand pay media kiosk.
[0200] As noted above, certain exemplary embodiments may feature tie-ins to social networking sites. For example, a karaoke contest may be viewed locally, nationally, internationally (e.g., worldwide) via social networking sites, etc. People from around the world may use social networking and other sites to vote for their favorite performances, and people may advance through the competition. Such technology may be used as a reality TV style contestable entry to be broadcasted via television and / or the Internet. The ultimate competition may be karaoke, live music or other.
[0201] In certain exemplary embodiments, customers may develop a list of karaoke and photo booth friends. This list may be generated automatically, in certain exemplary embodiments, by scanning connections in social networks. In certain exemplary embodiments, the karaoke jukebox system allows customers to communicate with friends via SMS, email, social networking, jukebox specific and / or other messages. In certain exemplary embodiments, a "buddy list" may be built and used for instant communication. Customers issue karaoke challenges and meet up requests / messages / details, photos, songs, comments on karaoke song suggestions. Messages may be automatically sent to customers any time friends check into the venue, sign up for a performance, complete and / or share a performance.
[0202] In addition to being able to purchase mementos of the evening (such as an audio and / or video rendition of karaoke; photos, videos, slideshows; event packages that include songs and photos and / or videos), messages can be sent to inform users when songs are made available for later download (for a fee) and edited by an editor.
[0203] Certain exemplary embodiments relate to an entertainment center including a computer capable of communicating with a network, said computer further connected to at least one display via a standard analog, digital or network addressable display. The computer is operable to interact with a remote device connected to the network capable of communicating with said computer, said remote device operable to receive a code and transmit said code to said computer, said computer being capable of validating said code against a database or algorithm, and when valid, said computer being configured to assign a monetary or credit value to said remote device. The remote device is operable to browse content contained on said computer, said remote device is operable to select and pay for said content using said monetary or credit value, and said computer is operable to deduct said monetary or credit value based on a selection by said remote device. Alternatively or additionally, a code can be transmitted to a remote device and entered on a computer.
[0204] Certain exemplary embodiments relate to an out-of-home entertainment center coupled with at least one Internet-based messaging system and / or social networking site. The remote devices are connected to the out-of-home entertainment center via a wired or wireless local area network or the Internet. Use of a portion of the entertainment center services by the remote devices causes the entertainment center to send messages to the at least one Internet-based messaging system. Connection of the systems via the Internet may require a user to enter a code into the remote device that identifies the entertainment center.
[0205] Some of the handheld devices herein may be, for example, those disclosed in application Ser. No. 11 / 902,790, the entire contents of which are incorporated herein by reference.
[0206] This disclosure uses specific terminology so as not to be construed as limiting the invention to any particular embodiment, hardware configuration, components, or software configuration. For example, many of the features and examples are described in relation to their presence in a bar, pub, or other environment. However, it will be understood that in exemplary embodiments of the invention, the features are adaptable for use in any location where a jukebox (or multiple jukeboxes) may be located. Similarly, while certain features and functions are described in relation to use by a "user," "owner," "operator," or "customer," it will be understood that these terms are general and will in most cases be used interchangeably depending on the embodiment and features used that are selected. For example, while it may be advantageous to limit the initial song selection to the owner and / or operator, in certain exemplary embodiments, the customer may play a role in the initial song selection. It is understood that a "display" includes, for example, a monitor connected to a computer, directly or remotely, or embedded in an IC, such as IPTV technology. The display may be network addressable. Also, standard digital signs (LED-based) may be provided as contemplated displays and / or network addressable displays.
[0207] Although certain exemplary embodiments have been described in relation to out-of-home locations, it will be appreciated that the techniques described herein may be adapted to in-home or personal jukebox devices having appropriate connections to a jukebox network or configured for stand-alone operation.
[0208] Also, although certain exemplary embodiments have been described in connection with in-home and some exemplary out-of-home scenarios, the exemplary techniques described herein can be used in connection with different locations and / or events. In general, the exemplary techniques for mixing ambient audio and / or user-generated video with high quality audio described herein can be used in connection with any type of live event that is desirable to record, such as a concert; a play or musical; a speech, rally or protest; a retail or other shopping event; a newsworthy event or an event reported as news; etc.
[0209] In the context of public or concert performances, for example, certain exemplary embodiments provide a means for performers, record labels, schools, production companies, and other appropriately qualified parties to enable recording of the concert and, if necessary, assume responsibility for those recordings. Currently, it is common for people attending a concert to use the video recording capabilities of their mobile devices to record portions of the concert. Although the quality of the audio and video is often relatively low, the recording is nevertheless seen as an important memento of the event. Even if the quality of the audio and video is often relatively low, the person recording the performance may not have the legal bundle of rights necessary to do so. Thus, it will be appreciated that it is desirable to enable recording of performances and events in a manner that respects the rights of these rights holders and also promotes user-created content, while potentially providing financial compensation for the licenses that allow them. New works created via recording and / or mixed approaches.
[0210] In certain exemplary embodiments, an artist, booking agent, venue staff, school teacher or other authority may contact a recording service operated by the assignee of the present invention to request that recording and mixing services be made available at a particular event. An identified event is identified and an entry for the event is made available to a recording reservation that is used on a mobile phone or other device equipped with a custom recording application. The custom recording application is downloaded or otherwise installed for a fee in some scenarios and can then be used for an unlimited or some limited number of events. In certain exemplary embodiments, the application may be available free or for a nominal fee, but users may be charged for recording by song, number of songs or length of time. Different fee tiers may be established for artists, labels, song lengths, event types, durations. For example, a school event may be less expensive than an indie rock event, which may be less expensive than a recording of part or all of a Rolling Stones concert. In some cases, specially labeled versions of the recording application may be created by allowing branding and messaging to assist in marketing the artist or other artists on the same label or representation.
[0211] In one exemplary use case, a user purchases a custom summer application for a predefined amount (). The application allows the user to record three songs from one or more shows. Once the tour or show is completed, or the three videos have been captured, a link to the videos is provided, along with the video containing the actual audio from the performances, complete with some ambient crowd noise.
[0212] Certain exemplary embodiments may include one or more upload systems. Similarly, the recording system may receive a high quality (e.g., digital) audio feed of the performance, background acoustics of ambient noise within the venue such as applause and cheers. A mixer or mixing board may be provided on-site to receive such input. The mixer or mixing board may be as simple as a mixed balance line fed into the recording service's upload device (e.g., a computer, laptop or other combination of appropriately configured hardware and / or software). The upload device may forward live audio feeds, mixed musical compositions (post-processed after the performance, or processed in real-time or substantially real-time), or digital versions of multiple unmixed or partially mixed audio streams for later assembly in a final mix. The upload device may be configured to identify the performance (e.g., using name, date, time, and / or special identifiers) and characterize the method and upload material (e.g., file format, whether the audio stream is raw or fully or partially mixed, source device for the audio stream). Video may be collected and uploaded via the same device in certain exemplary embodiments, and this type and / or other related information may be provided. The uploaded data may be stored in a cloud storage location. The cloud service may be configured to archive the uploaded material for subsequent processing.
[0213] A performance archiving system located in or having access to the cloud processes the inbound or uploaded audio stream and adds associated metadata, if necessary or desirable, to organize the received audio. For example, depending on the upload stream, the audio may be identified as a lead-in or an actual musical performance. The matching system may be configured to identify a continuous audio stream, and individual identification of the musical piece may not necessarily be required.
[0214] Similar to that described in the karaoke jukebox related embodiment above, audio and / or video can be collected from the audience using an application on a smart phone, tablet or other computing device. A mobile user equipped with a device loaded with a recording application or an application specifically designed for this particular artist could, for example, purchase or receive the right to record a performance. As mentioned above, the recording may be limited in some manner to a particular number of songs, total duration.
[0215] An application running or accessible via the device can interface with an embedded or attached video camera to create a digital recording of the time / moment during the performance. If the mobile user is satisfied with the recording (after reviewing it on the mobile device or from his / her evaluation of the captured video, etc.), the mobile user can choose to save the recording. This allows the recording to be copied to the cloud for archiving or matching against the performance audio. Note that there may be many users for a given performance, with one submitting his / her own clips for matching.
[0216] The recording system's cloud service captures inbound mobile user mobile clips and metadata about the user and purchased rights. This material is archived (e.g., stored in a database) as mobile video and audio recordings of the performance and associated metadata (as appropriate and available).
[0217] A matching process begins based on timestamps and metadata received from the upload feed, as well as timestamps of metadata received within the mobile user video feed. The audio data files of the mobile video and the upload video can be compared to each other using pattern matching or algorithms with time sequencing capabilities. Once a "best" match is found, the audio segment time delimiters can be used to create a new video with a modified audio mix. That is, transitions between songs, sets, and speech acknowledgments can be detected or otherwise marked and used as delimiters for the different portions. Additionally, if it is determined that a particular user has "missed" a beginning, end, or other continuous clip (because the user did not realize a song was playing, the user's mobile device ran out of battery, the user hit the record button too late, etc.), the "missing" audio and / or video may be provided in the segment. This missing data may be provided by another person who managed to record the portion from "home" or an "official" source, etc. The timestamps can facilitate detection of the missing portion and the location of the portion to be added.
[0218] As above, in the audio mix, the audio from the device can replace up to 100% of the uploaded audio from the performer's mixing board, indicating very high quality audio. In some cases, it is desirable to have some audio from the mobile device recording customer reactions, comments or performances. The amount of mobile background audio may be configurable on the mobile device in certain exemplary embodiments.
[0219] Once the remix process is performed, the new mixed song combined with the mobile video may be used to generate a digital video file that is archived on a cloud server. The address of this video segment may be indexed for distribution to qualified mobile patrons and / or others for download. Once the customer's mobile video is processed, a display may be sent to the originating mobile device alerting the user that the video footage has been processed. This link to the new processed footage may be available online for streaming or may be downloaded, depending on the permissions granted by the artist or the artist's representative. A link to the video may be emailed to other devices, depending on the permissions granted by the artist. Other individuals (e.g., fan club members, school boosters, parents, etc.) may receive the email or other link. In certain exemplary embodiments, the file, a portion of it, or a link may be posted or disseminated to a public service such as a social networking site (posted on the performer's page, tweeted from an approved account, etc.).
[0220] It will therefore be appreciated that the exemplary techniques applied for karaoke may be used for non-jukebox and non-karaoke events, such as, for example, certain live performances and shows. Certain exemplary embodiments thus relate to the creation and optional distribution (perhaps for sale) of new content including high quality audio synchronized with video captured on a mobile device, with new productions selectively paid for via a mobile application.
[0221] Further details of examples of how this can be accomplished are described in connection with FIGS. 24-30. However, the various hardware combinations and configurations, and process flows disclosed are indicative of only how the embodiment may be constructed and other combinations, configurations, process flows, etc. may be used in different embodiments. FIG. 24 is a flow chart illustrating a procedure for recording a performance or other event according to a particular exemplary embodiment. An artist's performance date is scheduled in step S2402. If recording is not permitted, as determined, for example, at decision point 2402, the process waits for the next performance S2406. On the other hand, if recording is permitted, several steps prepare for recording. For example, in step S2408, a sub-process is performed to enable recording in the application. This includes adding the event to a list of events, including information about the event (e.g., artist name, location, start / end times, cost data, etc.). Some or all of this and / or other related data may be stored in a database. In step S2410, it is determined whether a custom application should be provided for the particular event. If so, the custom application may be incorporated in step S2412. The custom application may include branding and / or the look and feel of the artist, customized advertising aimed at a specific target audience, etc. If no special application exists or if a custom application is constructed, the process waits for the performance in step S2416. For example, at the venue, an upload system is prepared in step S2414. This may include, for example, connecting a computer system (including appropriate hardware and / or software) to a mixing board and ensuring that a potentially secure connection to a remote storage location is made available (via an Internet connection).
[0222] FIG. 25 is a block diagram of an example configuration of an upload system in accordance with certain exemplary embodiments. As shown, audio lines from a band performing 2502 are fed into a mixing board 2504. This may include, for example, microphones, outputs from guitars and guitar amps, from keyboards, etc. The output from the mixing board is fed into a digital or other upload device 2506 that stores the audio data in a remote storage location (e.g., in the cloud). For example, a live audio feed 2514 may be fed into a first network storage location 2518 as part of a live feed 2516. Mixed audio data 2508 (e.g., including audio for multiple instruments, microphones, and / or other sources) may be stored as a mixed song 2510 uploaded to a second network storage location 2512. Similarly, an unmixed or partial mixed song 2520 may be slit into multiple song tracks 2522 and uploaded to a third network storage location 2524. The digital upload device may provide separately identifiable songs, a continuous live feed stream, or individual tracks to be mixed in the cloud. Once received in network storage in the cloud, the performance is archived, potentially allowing for future matching with submitted video recordings.
[0223] FIG. 26 is a partial schematic diagram of a performance archive in a particular exemplary embodiment. As shown in the figure, a network storage location 2602 includes a segment identification and song analysis module 2604. The segment identification and song analysis module 2604 operates on performance audio and data records stored in a database that includes a plurality of performance audio and data records. The exemplary performance audio and data record 2606 shown in FIG. 26 includes a plurality of songs 2608a-n. Lead-in audio 2608a-n is provided for some or all of these songs 2608a-n. Lead-out audio 2612 is also provided. As mentioned above, lead-in audio 2608 and lead-out audio 2612 may be provided for any of some of the songs 2608. This, or lead-in and / or lead-out audio, may be provided for an event, in whole or in part, including a set, a group of songs (a medley, a particular group of consecutive or non-consecutive separate songs, an artist, a label, a particular item selected for recording by a user of a mobile device), or an individual group. Although not explicitly shown in FIG. 26, metadata is associated with each of the segments 2608, 2610, 2612 indicating timestamps (for start and end times), length, date, source of data (e.g., from mixer, raw input stream, from user, etc.). An upload system located within the venue or at the event can transmit the data to be stored as a continuous data stream. If metadata or detectable audio cues are available, the data set can be identified by segment ID and may be parsed with an identification of song audio type. Possible audio types include lead-in, actual song, lead-out. The audio record may be time stamped based on information provided by the performance venue and time of receipt at the cloud server.
[0224] FIG. 27 is a partial schematic diagram illustrating a cell phone user using a cell phone application to record a portion of a performance in certain exemplary embodiments. A venue 2702 shown in FIG. 27 shows a band performing in front of an audience using multiple speakers provided at the venue. A mobile user using a mobile device 2704 can record video of the band performing. A time or other counter indicates how much of the event has been recorded after the user presses a record or other similar button. The user can press a save or other similar button to cause the mobile device to transmit an audio / video clip 2706 to a network storage location 2708. In certain exemplary embodiments, the audio / video data can be streamed to the network storage location 2708.
[0225] Thus, using a specialized recording application on the mobile device, the customer may select the recording feature, and if the user is authorized to record, either through the purchase of recording rights or because the performance is available for free from the performer, the mobile device may begin recording all video and audio subject to potential time constraints. The user may be instructed to begin recording X seconds or less before the song and to end recording (which may be an automatic cut-off in some instances) Y seconds or less before the song. Alternatively or additionally, some performances may allow recording without song break restrictions, but rather allow continuous segments of the performance.
[0226] FIG. 28 is a partial schematic diagram of a performance archive for user-based recordings in certain exemplary embodiments. As shown, a network storage location 2802 can include mobile clips and / or associated metadata 2804 for one or more performances. The storage format (e.g., database) and / or metadata stored therein can be similar to, for example, that described above in connection with FIG. 26 for the performance audio data and data records 2806. Additionally or alternatively, unique clip and / or customer identifiers can be provided. As shown in FIG. 28, for example, multiple clips 2808, 2810 are provided for multiple customers an. The database, in certain exemplary embodiments, can be organized such that clips for a common event are stored in close relative proximity to one another (e.g., in a common table or common directory) or otherwise linked together. Similarly, in certain exemplary embodiments, clips for a single user can be stored in close relative proximity to one another (e.g., in a common table or common directory) or otherwise linked together.
[0227] For each mobile device equipped with a dedicated application and appropriate permissions to record, each recorded segment may have video and audio transmitted to a cloud service for network storage. The transmitted video resolution and audio quality may vary due to the capabilities and bandwidth of the mobile device required to transfer this data. In certain exemplary embodiments, transmissions may be archived by performance and time sequence or other order as they are received. Indexing and archiving may be sufficient to convey an indication as to the general time the recording was made to facilitate matching. These archives may be treated as individual clips and may be matched against the received and stored uploaded audio data of the performance.
[0228] FIG. 29 is a schematic diagram illustrating a mobile phone audio clip matching and remixing technique in a particular exemplary embodiment. As shown in FIG. 29, a first clip for a first customer 2902 executes a matching process executed via a matching module 2904 of a computer system (e.g., including at least one processor and memory for executing instructions stored on a tangible computer-readable storage medium). The matching module 2904 attempts to find a song 2904 and associated lead-in or lead-out data 2908, 2910. As shown in FIG. 29, data for a particular performance (Performance X) is obtained and searched. This may be facilitated by metadata associated with the clip, including some or all of the performance name / identifier, date, time, and / or other information aspects. In the example of FIG. 29, the matching module 2904 determines that the first clip for the first customer 2902 corresponds to song 1 (2906a) and a portion of the lead-in audio 2908b for a second song 2906b. That information passed to the audio remix module 2912 can obtain high quality audio for the first song 2906a and reserve pre-appropriate audio 2908a if necessary. Lead-in audio 2908b is removed for the second song 2906b. Mixing may take 0-100% of the ambient background recording from a clip and / or other source and mix it with the appropriate amount (0-100%) of the high quality source. The newly remixed audio may be combined with video from the customer and used to generate a mixed song along with the mobile video 2914. This new work may be made available for download or to other users and / or others. Note that some or all of this and / or other processing may be performed in the cloud.
[0229] Once a new video is created via a remix of audio from an upload source and a mobile submission, the new video can be stored on a cloud server along with a unique address (e.g., a GUID). In some cases, the video may be controlled by the performer and only accessible via subsequent processing. For example, a customer who purchases the rights to record one or more segments of a performance has authorization via authentication and access to stream this clip to any device that supports audio / video playback.
[0230] In some circumstances, performers may be willing to give up control over new video creations, and the actual files may be made available for download from the stream upon payment of an additional fee. For example, a user recorder may be encouraged to sell his / her recordings by being rewarded with some monetary credit based on the downloads of his / her recordings. In other cases, the user recorder may not receive credits, but rather, license fees charged to the community downloader may be forwarded to the rights holders and / or facilitators of the upload / download / matching system. These and / or other revenue sharing schemes may also be made available for the karaoke jukebox embodiments described above.
[0231] Figure 30 is a schematic diagram showing a cell phone video file viewed from a cloud or other network in certain exemplary embodiments. Unlike Figure 27, the mobile device 2704 generates a coherent audio and / or video clip that is shown in a playback or "media ready" mode after the audio and / or video clips are aligned and mixed. At that point, a user can access the mixed music piece with the mobile video 3002 from the network storage location 3004 by accessing a link to the video stream or file 3006. In certain exemplary embodiments, the mixed video may not generate a combined image until requested by the user.
[0232] This may not require a temporary burst of processing power, but may conserve space as all clips need to be combined immediately. In certain exemplary embodiments, a user may be able to select whether one or more audio clips should be combined to specify the level of portable audio versus high quality audio. The process of matching submitted mobile video clips with uploaded renditions may be time consuming. In some instances, the uploaded rendition may be available for the next hour or days.
[0233] The particular hardware combinations and configurations are disclosed to represent only the manner in which the embodiments may be constructed and other combinations and configurations may be used in different exemplary embodiments. For example, a central server may be comprised of one or more servers acting together or separately to provide the full range of services necessary to enable jukebox functionality in some exemplary embodiments. For example, a cluster of servers may include a virtual central server along with media provisioning servers, separate tracking membership, and further processing licenses.
[0234] Similarly, the local servers described herein may be incorporated into a jukebox. For example, a local server may exist within the jukebox as part of an integrated mass storage device (e.g., a partition) yet appear to function independently. In fact, as hard disks become larger and cheaper, they may preferably perform the functions of a local server.
[0235] Additionally, although the term "music" is used at times in the above description, this term is not intended to limit the scope of the present invention, and any example of media (e.g., music, video, music / video combinations, data, information, etc.) may fall within the intended scope of any embodiment used herein and the present invention.
[0236] It will be understood that the screenshots and software configurations presented herein are only exemplary ways to organize and display the features disclosed herein. Other configurations are possible and thus contemplated herein. In this vein, the techniques disclosed herein may be implemented by any suitable combination of hardware, software, firmware, etc. The various modules, configurations, programs, etc. may be implemented in these and / or other ways.
[0237] While preferred embodiments of the present invention have been illustrated and described, it will be apparent to those skilled in the art that various changes and / or modifications can be made. Accordingly, the specific descriptions herein are intended to be illustrative only and are not intended to limit the invention beyond the scope of the appended claims.
[0238] Alternative Expressions of the Invention The present invention can also be expressed as follows.
[0239] That is, a method according to the present invention is a method for generating a file corresponding to a performance of a performer singing a musical piece with musical accompaniment, comprising the steps of receiving audiovisual data captured by a user device, the audiovisual data including first audio data and first video data; receiving high quality audio-only data having a higher quality than the first audio data; and digitally combining the first audio data and the high quality audio-only data such that a predetermined percentage of the first audio data is replaced by the high quality audio-only data to generate a new audiovisual data file synchronized with high quality audio content from the received high quality audio-only data based on a common time reference value, the new audiovisual data file having user generated video content from the received audiovisual data, the predetermined percentage being determined to increase if a user selected level of quality for the new audiovisual data file to be generated increases and to decrease if the user selected level of quality for the new audiovisual data file to be generated decreases.
[0240] Also in the method of the present invention, the first audio data is digitally combined with the high quality audio-only data such that at least a portion of the ambient noise from the first audio data is present in the new audiovisual data file that is generated.
[0241] In a method according to the present invention, the high quality audio-only data includes musical accompaniment from a jukebox and vocals from a microphone connected to the jukebox.
[0242] Additionally, in a method according to the present invention, the digitally combining step may further include images and / or video captured by one or more cameras on the jukebox.
[0243] Also in a method according to the present invention, the high quality audio-only data includes music from a live music concert in attendance of a user of the user device.
[0244] The method according to the present invention also includes the further step of uploading said new audiovisual data file to a server.
[0245] The method of the present invention also includes the step of making the new audiovisual data file available via a social media site.
[0246] A system according to the present invention is configured to implement any of the above methods.
[0247] The present invention also provides a method, executed by a program of a digital processing device, for generating a file corresponding to a performance of a musical piece by a performer singing with musical accompaniment, comprising the steps of: synchronizing time between a user device and a second device prior to the performance; receiving audiovisual data captured from the user device, the audiovisual data including first audio data and first video data; receiving high quality audio-only data from the second device, the high quality audio-only data being of higher quality than the first audio data; and digitally combining the first audio data and the high quality audio-only data such that the first audio data is at least partially replaced by the high quality audio-only data to generate a new audiovisual data file having user generated video content from the received audiovisual data, synchronized with high quality audio content from the received high quality audio-only data based on a common time reference value between the user device and the second device after the synchronization.
[0248] The method of the present invention also includes, in conjunction with the digital combining step, a step of reducing the sound level of at least a portion of the first audio data such that ambient noise is present in the new audiovisual data file that is generated.
[0249] Also in the method of the present invention, musical accompaniment from a jukebox and voice from a microphone connected to said jukebox are mixed with the high quality audio-only data.
[0250] Additionally, in a method according to the present invention, the digitally combining step may further include images and / or video captured by one or more cameras on the jukebox.
[0251] Also in a method according to the present invention, the high quality audio-only data includes music from a live music concert being attended by a user of the user device.
[0252] The method according to the present invention also includes the further step of uploading said new audiovisual data file to a server.
[0253] The method of the present invention also includes the step of interfacing with a module of a social media site to make the new uploaded audiovisual data file available for access via and / or download from the social media site.
[0254] A system according to the present invention is configured to implement any of the above methods.
[0255] Furthermore, the present invention can be further expressed as follows.
[0256] That is, a method according to the present invention is a method for recording a karaoke performance in which a karaoke performer sings a song via a first microphone connected to a jukebox playing a song, comprising the steps of: synchronizing time between the jukebox and a portable electronic device; causing the electronic device to capture at least a video of the karaoke performance mediated by the jukebox; receiving the captured video from the electronic device at a network location; combining, at the network location with the high quality audio captured by the first microphone connected to the jukebox and a high quality song audio corresponding to the song associated with the karaoke performance, with reference to the synchronized time, to generate a combined recording of the karaoke performance; determining how well the karaoke performer is performing; and adjusting a volume of the first microphone in response to the determination of how well the karaoke performer is performing.
[0257] The method according to the present invention also includes the step of applying a digital effect to the high quality audio captured by the first microphone.
[0258] In addition, in the method of the present invention, the electronic device further captures low quality audio data corresponding to the karaoke performance via a second microphone, the second microphone being attached to or integrated into the electronic device.
[0259] The method also includes mixing the lower quality audio data with the higher quality audio captured by the first microphone and the higher quality music audio at a predetermined non-zero level.
[0260] Also in the method of the present invention, the step of determining how well the karaoke performer performs is performed by comparing high quality audio captured by the first microphone against a dominant melody line and / or rhythm of the song being performed.
[0261] The digital jukebox system of the present invention also includes a digital jukebox device including a processing resource including at least one processor and a memory, the processing resource configured to operate the digital jukebox device in a standard jukebox mode and a karaoke jukebox mode, the standard jukebox mode being programmed to cause the digital jukebox device to play an instance of media when a corresponding payment has been made, the karaoke jukebox mode being programmed to enable the digital jukebox device to allow a karaoke performer to participate in a karaoke performance in which the karaoke performer sings a song via a first microphone connected to the digital jukebox device that plays the song, and synchronizing time between the digital jukebox device and a portable electronic device. a synchronization module configured to synchronize a karaoke performance with a first microphone connected to the jukebox and a second microphone configured to synchronize a karaoke performance with the first microphone, and a non-transitory computer readable recording medium configured to receive at least a video of the karaoke performance captured by the electronic device via an application executed on the electronic device; a mixer configured to combine high quality audio captured by the first microphone connected to the jukebox and audio of a high quality song corresponding to the song associated with the karaoke performance with the captured video, with reference to the synchronized time, to generate a combined recording of the karaoke performance; and a performance evaluation module configured to determine how well the karaoke performer performs, wherein a volume of the first microphone is adjustable in response to a determination of how well the karaoke performer performs.
[0262] The system of the present invention also includes a digital effects filter configured to apply a digital effect to the high quality audio captured by the first microphone.
[0263] In addition, in the system of the present invention, the application is configured to cause the electronic device to capture low quality audio data corresponding to the karaoke performance via a second microphone, the second microphone being attached to or integrated with the electronic device.
[0264] Also in the system according to the present invention, the mixer mixes the lower quality audio with the higher quality audio captured by the first microphone and with the higher quality music audio at a predetermined non-zero level.
[0265] In addition, in the system of the present invention, the performance evaluation module determines how well the karaoke performer performs by comparing high quality audio captured by the first microphone against the dominant melody line and / or rhythm of the song being performed.
[0266] A recording medium according to the present invention is a non-transitory computer-readable recording medium that stores a program for implementing the above-mentioned method.
[0267] In another embodiment, a method for generating a file corresponding to a performance of a performer singing a musical piece with musical accompaniment includes the steps of receiving audiovisual data captured from a user device, the audiovisual data including first audio data and first video data; receiving high quality audio-only data having a higher quality than the first audio data; and digitally combining the first audio data and the audio-only data such that the first audio data is at least partially replaced by the high quality audio-only data to generate a new audiovisual data file having user generated video content from the received audiovisual data synchronized with the high quality audio content based on a common time reference value, wherein a predetermined percentage of the first audio data is replaced by the high quality audio-only data such that a desired amount of ambient noise from the first audio data is present in the new audiovisual data file generated.
[0268] In some embodiments above and below, approximately 80% of the first audio data is replaced with the higher quality audio-only data.
[0269] In some embodiments above and below, the high quality audio-only data includes musical accompaniment from a jukebox and vocals from a microphone connected to the jukebox.
[0270] In some embodiments above and below, the digitally combining step further includes images and / or video captured by one or more cameras on the jukebox.
[0271] In some embodiments above and below, the high quality audio-only data includes music from a live music concert in attendance of a user of the user device.
[0272] In some embodiments above and below, the method further comprises uploading said new audiovisual data file to a server.
[0273] In some embodiments above and below, the method further comprises making the new audiovisual data file available via a social media site.
[0274] In some embodiments above and below, a method and system for providing a digital jukebox device includes: a processing resource including at least one processor and a memory, the processing resource configured to operate the digital jukebox device in a standard jukebox mode and a karaoke jukebox mode, the standard jukebox mode being programmed to cause the digital jukebox device to play instances of media when a corresponding payment has been made, and the karaoke jukebox mode being programmed to enable the digital jukebox device to allow karaoke performers to participate in a karaoke performance in which the karaoke performer sings a song via a first microphone connected to the digital jukebox device that plays the song; (i) operating the jukebox in the karaoke jukebox mode via an application executing on a portable user device; and (ii) A digital jukebox system is provided that includes a non-transitory computer readable recording medium configured to receive audiovisual data mediated by the jukebox via the application, the audiovisual data including at least first audio data and first video data of the karaoke performance captured by the user device; and a mixer configured to combine, with reference to a common time reference, high quality audio captured by the first microphone connected to the jukebox and high quality song audio corresponding to the song associated with the karaoke performance with the audiovisual data captured by the portable user device to generate a combined recording of the karaoke performance, wherein a predetermined percentage of the first audio data is replaced with the high quality audio such that a desired amount of ambient noise from the first audio data is present in the generated recording.
[0275] In some embodiments above and below, the system further includes a digital effects filter configured to apply a digital effect to the high quality audio captured by the first microphone.
[0276] In some embodiments above and below, the application is configured to cause the user device to capture lower quality audio data corresponding to the karaoke performance via a second microphone attached to or integrated with the user device.
[0277] In some embodiments above and below, the mixer combines the lower quality audio data with the higher quality audio captured by the first microphone and the higher quality music audio at a predetermined non-zero level.
[0278] In some embodiments above and below, the method further includes a performance evaluation module configured to calculate how well the karaoke performer performs by comparing an aspect of the high quality audio captured by the first microphone against a dominant melody line and / or rhythm of the song being performed.
[0279] In some embodiments above and below, the volume of the first microphone is adjustable depending on the result of the calculation.
[0280] In some embodiments above and below, a system configured to perform a method according to any one of claims 1-7 is provided.
[0281] In some embodiments above and below, a non-transitory computer readable recording medium is provided that stores a program that, when executed, performs the method according to any one of claims 1 to 7.
[0282] Furthermore, the present invention can be expressed as follows.
[0283] A method according to one aspect of the present invention is a method for recording a karaoke performance in which a karaoke performer sings a song into a first microphone connected to a jukebox playing songs, the method comprising the steps of: synchronizing time between the jukebox and a portable electronic device; causing the portable electronic device to capture audiovisual data of the karaoke performance, the audiovisual data including first audio data and first video data; receiving the captured audiovisual data from the portable electronic device in a digital processing device; executing in the digital processing device a program for combining the captured audiovisual data with high quality audio captured by the first microphone connected to the jukebox with reference to the synchronized time, such that the first audio data of the audiovisual data is at least partially replaced by the high quality audio captured by the first microphone to generate a new audiovisual data file from the first video data of the received audiovisual data synchronized with the high quality audio; and applying one or more digital effects to the high quality audio captured by the first microphone.
[0284] In a method according to one aspect of the present invention, a predetermined percentage of the first audio data may be replaced with the high quality audio data captured by the first microphone.
[0285] In one aspect of the method of the present invention, the step of combining the captured audiovisual data with the high quality audio may include a step of retaining at least a portion of the first audio data such that ambient noise is present in the generated new audiovisual data file.
[0286] In a method according to one aspect of the present invention, the step of applying one or more digital effects to the high quality audio captured by the first microphone may include the steps of selecting one or more digital effects to be applied to a data file recording the high quality audio captured by the first microphone, each digital effect having an associated algorithm to achieve the digital effect, and modifying the data file recording the high quality audio captured by the first microphone by applying the algorithm for the selected digital effect to the data file.
[0287] In a method according to one aspect of the invention, the applying step may include synthesizing, mixing together and / or layering the additional audio data.
[0288] The method according to one aspect of the present invention may further include determining how well the karaoke performer performs by comparing high quality audio captured by the first microphone against a predetermined dominant melody line and / or rhythm for the song being performed.
[0289] In a method according to one aspect of the present invention, the predetermined dominant melody line and / or the predetermined rhythm may be derived from the musical piece being performed or may be obtained from a data store containing pre-derived data.
[0290] The method according to one aspect of the present invention may further include a step of adjusting a volume of the first microphone in response to the determination.
[0291] A digital jukebox system according to one aspect of the present invention includes a digital jukebox device including a processing resource including at least one processor and a memory, the processing resource configured to operate the digital jukebox device in a standard jukebox mode and a karaoke jukebox mode, the standard jukebox mode being programmed to cause the digital jukebox device to play an instance of media when a corresponding payment is made, and the karaoke jukebox mode being programmed to enable the digital jukebox device to allow a karaoke performer to participate in a karaoke performance in which the karaoke performer sings the song into a first microphone connected to the digital jukebox device that plays the song, and a synchronization module configured to synchronize time between the digital jukebox device and a portable electronic device, and a synchronization module configured to synchronize time between the digital jukebox device and a portable electronic device, the ... a non-transitory computer readable recording medium configured to receive audiovisual data of the karaoke performance captured by the electronic device, the audiovisual data including first audio data and first video data; a mixer configured to combine the captured audiovisual data and the high quality audio captured by the first microphone connected to the jukebox with reference to the synchronized time such that the first audio data of the audiovisual data is at least partially replaced by the high quality audio captured by the first microphone to generate a new audiovisual data file from the first video data of the received audiovisual data synchronized with the high quality audio; and a digital effects filter configured to apply digital effects to the high quality audio captured by the first microphone.
[0292] In a digital jukebox system according to one embodiment of the present invention, a predetermined percentage of the first audio data may be replaced with the high quality audio data captured by the first microphone.
[0293] In a digital jukebox system according to one aspect of the present invention, the generated new audiovisual data file may include at least a portion of the first audio data such that ambient noise is present in the generated new audiovisual data file.
[0294] A digital jukebox system according to one embodiment of the present invention may further include a performance evaluation module configured to determine how well a karaoke performer performs by comparing the high quality audio captured by the first microphone against a dominant melody line and / or rhythm of the song being performed.
[0295] In a digital jukebox system according to one aspect of the present invention, the volume of the first microphone may be adjustable in response to the determination by the performance evaluation module.
[0296] A non-transitory computer-readable recording medium according to an aspect of the present invention may store a program for implementing a method according to an aspect of the present invention.
[0297] Furthermore, the present invention can be expressed as follows.
[0298] A method according to one aspect of the present invention is a method for recording a karaoke performance in which a karaoke performer sings a song into a first microphone connected to a jukebox playing the song, the method comprising the steps of: causing a portable electronic device to capture audiovisual data of the karaoke performance, the audiovisual data including first audio data and first video data; receiving the captured audiovisual data from the portable electronic device; applying one or more digital effects to the high quality audio captured by the first microphone connected to the jukebox to generate a converted high quality audio; and combining the captured audiovisual data with the converted high quality audio to generate a new audiovisual data file, using the first video data of the received audiovisual data synchronized with the converted high quality audio, such that the first audio data of the audiovisual data is at least partially replaced by the converted high quality audio.
[0299] In the method according to one aspect of the present invention, a predetermined percentage of the first audio data may be replaced with the high quality audio data captured by the first microphone.
[0300] In a method according to one aspect of the present invention, the step of combining the captured audiovisual data with the converted high quality audio may include a step of retaining at least a portion of the first audio data such that ambient noise is present in the generated new audiovisual data file.
[0301] In a method according to one aspect of the present invention, the step of applying one or more digital effects to the high quality audio captured by the first microphone may include the steps of selecting one or more digital effects to be applied to a data file recording the high quality audio captured by the first microphone, each digital effect having an associated algorithm to achieve the digital effect, and modifying the data file recording the high quality audio captured by the first microphone by applying the algorithm for the selected digital effect to the data file.
[0302] In a method according to one aspect of the present invention, the applying step may include synthesizing, mixing together and / or layering the additional audio data.
[0303] A method according to one aspect of the present invention may further include determining how well the karaoke performer performs by comparing aspects of the high quality audio captured by the first microphone against a predetermined dominant melody line and / or rhythm for the song being performed.
[0304] In a method according to one aspect of the present invention, the predetermined dominant melody line and / or the predetermined rhythm may be derived from the musical piece being performed or may be obtained from a data store containing pre-derived data.
[0305] The method according to one aspect of the present invention may further include a step of adjusting a volume of the first microphone in response to the determination.
[0306] A digital jukebox system according to one aspect of the present invention includes a digital jukebox device including processing resources including at least one processor and memory, the processing resources configured to operate the digital jukebox device in a standard jukebox mode and a karaoke jukebox mode, the standard jukebox mode being programmed to cause the digital jukebox device to play an instance of media when a corresponding payment is made, and the karaoke jukebox mode being programmed to enable the digital jukebox device to enable a karaoke performer to participate in a karaoke performance in which the karaoke performer sings the song into a first microphone connected to the digital jukebox device that plays the song, the karaoke performer singing the song into a first microphone connected to the digital jukebox device that plays the song, and the karaoke performer singing ... a non-transitory computer readable recording medium configured to receive audiovisual data of the karaoke performance including first audio data and first video data; a digital effects filter configured to apply digital effects to the high quality audio captured by the first microphone to generate a converted high quality audio; and a mixer configured to combine the captured audiovisual data with the converted high quality audio such that the first audio data of the audiovisual data is at least partially replaced by the converted high quality audio to generate a new audiovisual data file using the first video data of the received audiovisual data synchronized with the high quality audio.
[0307] In a digital jukebox system according to one aspect of the present invention, a predetermined percentage of the first audio data may be replaced with the high quality audio data captured by the first microphone.
[0308] In a digital jukebox system according to one aspect of the present invention, the generated new audiovisual data file may include at least a portion of the first audio data such that ambient noise is present in the generated new audiovisual data file.
[0309] A digital jukebox system according to one embodiment of the present invention may further include a performance evaluation module configured to determine how well the karaoke performer performs by comparing aspects of the high quality audio captured by the first microphone against a dominant melody line and / or rhythm of the song being performed.
[0310] In a digital jukebox system according to one aspect of the present invention, the volume of the first microphone may be adjustable in response to the determination by the performance evaluation module.
[0311] A non-transitory computer-readable recording medium according to an aspect of the present invention may store a program for implementing a method according to an aspect of the present invention. [Brief description of the drawings]
[0312] The above and other features, aspects and advantages of the present invention will be further understood by reference to the following Detailed Description of Exemplary Embodiments, when read in conjunction with the accompanying drawings. [Figure 1] FIG. 1 is a block diagram of an exemplary download digital jukebox system. [Diagram 2] FIG. 1 is a block diagram of an improved jukebox system 10' in an exemplary embodiment. [Diagram 3] FIG. 1 is a schematic diagram of a combination jukebox karaoke system for use within a venue or location in accordance with certain exemplary embodiments. [Figure 4]1 is a schematic diagram of an example karaoke jukebox remote control usage in accordance with certain exemplary embodiments; [Diagram 5] 1 illustrates example performance data associated with a karaoke performance on a karaoke jukebox in accordance with certain exemplary embodiments. [Figure 6] 4 is a flow chart illustrating an example process for logging into a karaoke jukebox, selecting songs to be played, and uploading data to a social networking site in accordance with certain exemplary embodiments. [Figure 7a] 5 is a flowchart illustrating an example process for combining captured audio, image and / or video content in accordance with certain exemplary embodiments. [Figure 7b] 1 is a flow chart illustrating an example "use case" for performers competing in karaoke performances at a venue in accordance with certain exemplary embodiments. [Figure 8] 1 is an audio-video sequencing system according to certain exemplary embodiments. [Figure 9] 4 is a flowchart illustrating an example process for scoring a karaoke performance in accordance with certain exemplary embodiments. [Figure 10] 5 is a flowchart illustrating an example process for adjusting aspects of a karaoke performance in accordance with certain exemplary embodiments. [Figure 11] 11 is a flowchart illustrating an example process for using a rehearsal package in accordance with certain exemplary embodiments. [Figure 12a] 1 illustrates a first use case for song queuing in a particular exemplary embodiment. [Figure 12b] 1 illustrates a first use case for song queuing in a particular exemplary embodiment. [Figure 12c] 1 illustrates a first use case for song queuing in a particular exemplary embodiment. [Figure 12d]1 illustrates a first use case for song queuing in a particular exemplary embodiment. [Figure 12e] 1 illustrates a first use case for song queuing in a particular exemplary embodiment. [Figure 12f] 1 illustrates a first use case for song queuing in a particular exemplary embodiment. [Figure 13a] 13 illustrates a second use case for smart song suggestions in accordance with certain exemplary embodiments. [Figure 13b] 13 illustrates a second use case for smart song suggestions in accordance with certain exemplary embodiments. [Figure 13c] 13 illustrates a second use case for smart song suggestions in accordance with certain exemplary embodiments. [Figure 13d] 13 illustrates a second use case for smart song suggestions in accordance with certain exemplary embodiments. [Figure 13e] 13 illustrates a second use case for smart song suggestions in accordance with certain exemplary embodiments. [Figure 13f] 13 illustrates a second use case for smart song suggestions in accordance with certain exemplary embodiments. [Figure 14a] 13 illustrates a third use case relating to playing a song in accordance with certain exemplary embodiments. [Figure 14b] 13 illustrates a third use case relating to playing a song in accordance with certain exemplary embodiments. [Figure 14c] 13 illustrates a third use case relating to playing a song in accordance with certain exemplary embodiments. [Figure 14d] 13 illustrates a third use case relating to playing a song in accordance with certain exemplary embodiments. [Figure 14e] 13 illustrates a third use case relating to playing a song in accordance with certain exemplary embodiments. [Figure 14f] 13 illustrates a third use case relating to playing a song in accordance with certain exemplary embodiments. [Figure 15a]1 illustrates a request for an action to be taken during a provided performance in accordance with certain exemplary embodiments. [Figure 15b] 1 illustrates a request for an action to be taken during a provided performance in accordance with certain exemplary embodiments. [Figure 15c] 1 illustrates a request for an action to be taken during a provided performance in accordance with certain exemplary embodiments. [Figure 15d] 1 illustrates a request for an action to be taken during a provided performance in accordance with certain exemplary embodiments. [Figure 16a] 13 illustrates a fourth use case in accordance with certain exemplary embodiments. [Figure 16b] 13 illustrates a fourth use case in accordance with certain exemplary embodiments. [Figure 16c] 13 illustrates a fourth use case in accordance with certain exemplary embodiments. [Figure 16d] 13 illustrates a fourth use case in accordance with certain exemplary embodiments. [Figure 16e] 13 illustrates a fourth use case in accordance with certain exemplary embodiments. [Figure 16f] 13 illustrates a fourth use case in accordance with certain exemplary embodiments. [Figure 17a] 13 illustrates a fifth use case for making the karaoke experience social in accordance with certain exemplary embodiments. [Figure 17b] 13 illustrates a fifth use case for making the karaoke experience social in accordance with certain exemplary embodiments. [Figure 17c] 13 illustrates a fifth use case for making the karaoke experience social in accordance with certain exemplary embodiments. [Figure 17d] 13 illustrates a fifth use case for making the karaoke experience social in accordance with certain exemplary embodiments. [Figure 17e] 13 illustrates a fifth use case for making the karaoke experience social in accordance with certain exemplary embodiments. [Fig. 17f]13 illustrates a fifth use case for making the karaoke experience social in accordance with certain exemplary embodiments. [Figure 18a] 13 illustrates a sixth use case relating to performer engagement in accordance with certain exemplary embodiments. [Figure 18b] 13 illustrates a sixth use case relating to performer engagement in accordance with certain exemplary embodiments. [Figure 18c] 13 illustrates a sixth use case relating to performer engagement in accordance with certain exemplary embodiments. [Figure 18d] 13 illustrates a sixth use case relating to performer engagement in accordance with certain exemplary embodiments. [Figure 18e] 13 illustrates a sixth use case relating to performer engagement in accordance with certain exemplary embodiments. [Fig. 18f] 13 illustrates a sixth use case relating to performer engagement in accordance with certain exemplary embodiments. [Figure 19a] 13 illustrates a seventh use case relating to performer engagement in accordance with certain exemplary embodiments. [Figure 19b] 13 illustrates a seventh use case relating to performer engagement in accordance with certain exemplary embodiments. [Figure 19c] 13 illustrates a seventh use case relating to performer engagement in accordance with certain exemplary embodiments. [Figure 19d] 13 illustrates a seventh use case relating to performer engagement in accordance with certain exemplary embodiments. [Figure 19e] 13 illustrates a seventh use case relating to performer engagement in accordance with certain exemplary embodiments. [Figure 19f] 13 illustrates a seventh use case relating to performer engagement in accordance with certain exemplary embodiments. [Figure 20] 13 illustrates a screenshot of a countdown in accordance with certain exemplary embodiments. [Figure 21] 13 shows a screenshot of an example photoburst in accordance with certain exemplary embodiments. [Figure 22]13 shows example screenshots displaying an electronic or digital "proof sheet" in accordance with certain exemplary embodiments. [Figure 23] 13 illustrates example screenshots that allow adding images to a frame in accordance with certain exemplary embodiments; [Figure 24] 4 is a flowchart illustrating a process for recording a performance or other event in accordance with certain exemplary embodiments. [Diagram 25] FIG. 2 is a block diagram of an example configuration of an upload system in accordance with certain exemplary embodiments. [Figure 26] 1 is a partial schematic diagram of a performance archive in accordance with certain exemplary embodiments; [Figure 27] 1 is a partial schematic diagram illustrating a mobile phone user using an application on the mobile phone to record a portion of a performance in accordance with a particular exemplary embodiment; [Figure 28] FIG. 13 is a partial schematic diagram of a performance archive for user-based recording in accordance with certain exemplary embodiments; [Figure 29] FIG. 2 is a schematic diagram illustrating a mobile phone audio clip matching and remixing technique in accordance with certain exemplary embodiments. [Diagram 30] FIG. 2 is a schematic diagram illustrating a mobile phone video file viewed from a cloud or other network in accordance with certain exemplary embodiments.
Claims
1. 1. A method for recording a karaoke performance, comprising: a karaoke performer singing a song into a first microphone connected to a jukebox that plays the song, the method comprising: causing a portable electronic device to capture audiovisual data of the karaoke performance, the audiovisual data including first audio data and first video data; receiving the captured audiovisual data from the portable electronic device; combining the captured audiovisual data with the high quality audio to generate a new audiovisual data file using the first video data of the received audiovisual data synchronized with the high quality audio, such that the first audio data of the audiovisual data is at least partially replaced by the high quality audio; A method, wherein a predetermined percentage of the first audio data is replaced with the higher quality audio data captured by the first microphone.
2. 10. The method of claim 1, further comprising applying one or more digital effects to the high quality audio captured by the first microphone connected to the jukebox, said applying step including synthesizing, mixing together and / or layering additional audio data.
3. 2. The method of claim 1, wherein combining the captured audiovisual data with the high quality audio includes retaining at least a portion of the first audio data such that ambient noise is present in the generated new audiovisual data file.
4. applying one or more digital effects to the high quality audio captured by the first microphone, selecting one or more of the digital effects to be applied to a data file recording the high quality audio captured by the first microphone, each digital effect having an associated algorithm for achieving the digital effect; and modifying the data file recording the high quality audio captured by the first microphone by applying the algorithm for the selected digital effect to the data file.
5. 10. The method of claim 1, further comprising the step of determining how well the karaoke performer performs by comparing aspects of the high quality audio captured by the first microphone against a predetermined dominant melody line and / or rhythm for the song being performed.
6. The method of claim 5 , wherein the predetermined dominant melody line and / or the predetermined rhythm are derived from the piece of music being performed or are obtained from a data store containing pre-derived data.
7. The method of claim 5 , further comprising adjusting a volume of the first microphone in response to the determination.
8. 1. A digital jukebox system comprising: a digital jukebox device including processing resources including at least one processor and a memory, the processing resources configured to operate the digital jukebox device in a standard jukebox mode and a karaoke jukebox mode; the standard jukebox mode being programmed to cause the digital jukebox device to play an instance of media when a corresponding payment is made; the karaoke jukebox mode is programmed to enable the digital jukebox device to allow a karaoke performer to participate in a karaoke performance in which the karaoke performer sings the song into a first microphone connected to the digital jukebox device that plays the song; a non-transitory computer readable recording medium configured to receive audiovisual data of the karaoke performance captured by a portable electronic device, the audiovisual data including first audio data and first video data; a mixer configured to combine the captured audiovisual data with the high quality audio such that the first audio data of the audiovisual data is at least partially replaced by the high quality audio to generate a new audiovisual data file using the first video data of the received audiovisual data synchronized with the high quality audio; A digital jukebox system, wherein a predetermined percentage of the first audio data is replaced with the higher quality audio data captured by the first microphone.
9. 10. The digital jukebox system of claim 8, further comprising a digital effects filter configured to apply digital effects to the high quality audio captured by the first microphone connected to the jukebox, said applying synthesizing, mixing together, and / or layering additional audio data.
10. 9. The digital jukebox system of claim 8, wherein the new audiovisual data file generated includes at least a portion of the first audio data such that ambient noise is present in the new audiovisual data file generated.
11. 10. The system of claim 8, further comprising a performance evaluation module configured to determine how well the karaoke performer performs by comparing aspects of the high quality audio captured by the first microphone against a dominant melody line and / or rhythm of the song being performed.
12. The system of claim 11 , wherein the volume of the first microphone is adjustable in response to the determination by the performance evaluation module.
13. A non-transitory computer-readable recording medium storing a program for implementing the method according to any one of claims 1 to 7.
Citation Information
Patent Citations
Program, device, and method for voice and image recording
JP2002328689A
Karaoke providing method, device therefor, and program
JP2010112982A
Video and audio capture equipment for karaoke
JP3156336U