Event source content and remote content synchronization
By using audio/acoustic tagging and fingerprint search technology, low-quality audio content on user devices is matched and replaced, solving the problem of low-quality remote recording by viewers, achieving synchronization of high-quality audio and video content, and improving the sharing experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- VAUDIO LTD
- Filing Date
- 2018-02-07
- Publication Date
- 2026-04-10
AI Technical Summary
The media content of the event performance recorded remotely by the audience is of low quality and distorted, and cannot be synchronized with the high-quality source content, resulting in the inability to effectively share and watch it.
By using audio/acoustic tagging and fingerprint search technology, low-quality audio content recorded on user devices can be matched, replaced, or enhanced, while high-quality audio content recorded on source devices can be synchronized.
It achieves synchronization between high-quality audio content and user-recorded video content, improving the quality of media content shared by viewers and providing a clear audio experience.
Smart Images

Figure CN116320528B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present invention relates generally to a method and system for event source content and remote content synchronization, and more particularly to synchronizing high quality recorded media content of a performance event from a source device that directly records the performance with low quality recorded media content of a remote device that is recorded by a spectator member of the same event. BACKGROUND
[0002] Spectators can live record or capture broadcasted event performances on smart phones and other handheld recording devices. These recordings provide a personalized memento of the event performance experience for the spectator members. Spectator members often stream, upload and post the remotely recorded video and photo content to share their experience with others on social networks and video clip capturing and sharing applications. However, the remotely recorded media content of the event performance, particularly the sound quality of the audio content, is often of low quality and frequently distorted and fragmented, making the posted content unlistenable and unwatchable. Some event organizers can provide "official" recordings of the live performance, but these recordings do not record the personal perspective of the fans and spectators, i.e. the video and photo accounts of the live performance remotely taken by the spectators.
[0003] There is a need for a method and system for event source content and spectator remote content synchronization of an event performance that addresses or at least mitigates some of the problems and / or limitations discussed above. SUMMARY
[0004] One aspect of the present invention is a method of synchronizing event media content, the event media content comprising remote content having at least a first type of media and a second type of media recorded by a user on a user device, and source content comprising the first type of media, the method comprising the steps of: receiving the media content recorded by the first device; performing an audio / acoustic tag and / or fingerprint search of audio content recorded by a second device based on tag data and / or fingerprint data associated with the audio content of the media content recorded by the first device to match the audio content of the media content recorded by the first device with a portion of the audio content recorded or provided by the second device; and replacing or augmenting the audio content of the media content recorded by the first device with the matched portion of the audio content recorded or provided by the second device by compiling the matched portion of the audio content with the video content of the media content recorded by the first device; wherein the audio content recorded by the second device comprises only audio content.
[0005] In an embodiment, wherein said first device records images, and said method comprises compiling said images with said associated matching portions of audio content recorded or provided by said second device and said video image content recorded by said first device. In an embodiment, said method comprises recording time and location data of said audio content of media content recorded by said first device. In an embodiment, said method comprises manually associating tags with said audio content of media content recorded by said first device to allow synchronization of said associated matching portions of audio content recorded or provided by said second device with said video image content recorded by said first device.
[0006] In an embodiment, said method comprises a plurality of users, each user having a separate first device for recording respective synchronized audio content and video image content, wherein said method comprises repeating said steps of one aspect of the invention for each second device's respective recorded synchronized audio content and video image content.
[0007] In an embodiment, said audio content recorded by said second device comprises a studio quality recording, and said audio content recorded by said first device comprises a recording of lower quality audio content.
[0008] In an embodiment, said audio / acoustic tag and / or fingerprint search of said audio content recorded by said second device is performed by an audio / acoustic fingerprint database storing audio content recorded by said second device. In an embodiment, said compiled associated matching portions of audio content recorded by said second device and said video image content recorded by said first device are compiled with any one or more of photographs, content from content providers or branding material from sponsors.
[0009] In an embodiment, said photographs, content from content providers or branding material from sponsors are used to fill gaps in said video image content of said media content recorded by said first device.
[0010] In an embodiment, said photographs, content from content providers or branding material from sponsors are used to fill any gaps in said video image content occurring during the length of said matching portions of audio content recorded by said second device.
[0011] In an embodiment, said compiled associated matching portions of audio content recorded by said second device and said video image content recorded by said first device are overlaid with audio content recorded by other first devices.
[0012] One aspect of the invention is a system for synchronizing event media content, said event media content comprising remote content having at least a first type of media and a second type of media recorded by a user, and source content comprising said first type of media, said method comprising: a matching content module for performing an audio / acoustic tag and / or fingerprint search of audio content recorded by a second device based on tag data and / or fingerprint data associated with said audio content of media content recorded by said first device to match said audio content of media content recorded by said first device with a portion of audio content recorded or provided by said second device; a mixing content module for replacing or enhancing said audio content of media content recorded by said first device with said matched portion of said audio content recorded or provided by said second device; a compiler for compiling said matched portion of said audio content with said video content of media content recorded by said first device; and an output device for making available said compiled matched portion of said audio content with said video content of said media content recorded by said first device; said device being configured to search only audio content recorded by a second device.
[0013] One aspect of the invention is a system for synchronizing event media content, said event media content comprising remote content having at least a first type of media and a second type of media recorded by a user, and source content comprising said first type of media: a server having a memory for storing machine readable instructions and a processor configured to execute said machine readable instructions; a first user electronic device having a memory for storing machine readable instructions and a processor configured to execute said machine readable instructions; said server and said first user electronic device being configured to communicate with each other over a network; wherein said server and said first user electronic device interoperate to perform a method according to an embodiment of the invention.
[0014] One aspect of the invention is a computer readable medium storing machine readable instructions executable by a processor of a user electronic device to implement steps of a method according to an embodiment of the invention.
[0015] A computer readable medium storing machine readable instructions executable by a processor of a server to implement steps of a method according to an embodiment of the invention. BRIEF DESCRIPTION OF DRAWINGS
[0016] The accompanying drawings, which are incorporated herein and form a part of the specification, illustrate several aspects of the present application and, together with the description, serve to explain the principles of the application. Although the application will be described in conjunction with certain embodiments, it is not intended that the application be limited to those embodiments. On the contrary, the intent is to cover all alternatives, modifications, and equivalents included within the scope of the application as defined by the appended claims. In the drawings:
[0017] Figure 1 shows a schematic block diagram of a system according to an embodiment of the present application;
[0018] Figure 2 shows a schematic block diagram of a server as shown in Figure 1 more detail according to an embodiment of the present application;
[0019] Figure 3 shows a schematic block diagram of a source recording device as shown in Figure 1 more detail according to an embodiment of the present application;
[0020] Figure 4 shows a schematic block diagram of a user device recording device as shown in Figure 1 more detail according to an embodiment of the present application;
[0021] Figures 5-7 shows a schematic diagram of a data structure of remote media content compiled with source media content; and
[0022] Figure 8 is a flowchart of a method according to an embodiment of the present application. DETAILED DESCRIPTION
[0023] An embodiment of the present invention is a method and apparatus for synchronizing event media content including remote audio and video content recorded by spectator or fan users from a speaker at the time of an event performance, and source audio content recorded directly from a performance recorded by an originator, club, music provider, band, etc. The source audio content has better sound quality than the remote audio content recorded by the spectators. Typically, the remote recorded media content of an event performance recorded by users on user devices (e.g., smart phones, etc.) has very low quality (especially sound quality of the audio content) and is often distorted and fragmented, making the recorded remote content inaudible and unwatchable. The sound recording apparatus of the user devices used to record the remote content is typically far lower quality than the sound recording equipment used to record the source content. The higher quality audio source content replaces the lower quality audio remote content recorded by the user spectators, and is synchronized and layered with the video remote content recorded by the users. The resulting event source audio / remote video media content provides a pure recording clear sound quality audio for the user's personalized account or event memento.
[0024] Reference is made to Figure 1 FIG. 10 shows a schematic block diagram of a system 10 in accordance with an embodiment of the present invention. Event source content and remote content synchronization system 10 shows a server 12 and database 14 in communication with source content 20 and at least one user 22, 24 or plurality of users 28 over a network 16 (e.g., the Internet, a local area network, etc.). User 22 records an event performance 26. The event performance can be a live event or a broadcasted live event. The event performance can be a broadcast of a previously recorded event. In an embodiment, source content 20 can be live broadcasted or recorded live in an event. The source content can be a recorded music track recorded in a studio and played or broadcasted in an event, on the radio, etc. The user can record the video on a user device while capturing the broadcast of the music song in the background. Content providers 30 can provide source content of higher sound quality than the remote content recorded by the user. The content providers can provide other material that can be related to the performance, such as other media content such as text, audio content, images, photos, videos, video clips, etc. External social media / communication sources 32 are shown as communicating over the network to upload and share content.
[0025] Figure 2 FIG. 11 shows a schematic block diagram of a system 40 in accordance with an embodiment of the present invention, shown in more detail as Figure 1A schematic block diagram 50 of the server 12 is shown. The server 12 includes a processor 52 and a memory 54 for storing and executing a plurality of applications and different modules of the applications of the processing system. The server can include input devices 56 and output devices 58, and interface modules 60 for communicating with different modules and devices of the system. The plurality of modules of the server can include a user configuration module 62 for maintaining user profile accounts of a plurality of users, a content module 64 for managing content of a plurality of performances, a sharing module 66 for sharing source content with a plurality of users, a recognition module 68 including an identifying content module 70 for identifying remote content and a matching content module 72 for matching remote content with source content, and a mixing module 74 for replacing, overlaying, etc. unclear audio remote content with clearer audio source content together with other media video remote content.
[0026] Figure 3 An embodiment of the application is shown in more detail as Figure 1A schematic block diagram 100 of the recording device for source content 20 is shown. The recording device for source content 20 includes a processor 102 and a memory 104, various modules for storing and executing the source content of the performance, and processing the source content of the recording device 20. The recording device for source content may include an input device 106 and an output device 108, a recording source content module 110 for recording source content, a source content mixing module 112 for mixing source content when needed, a sharing module 114 for sharing source content with users, and a tagging content module 116 for tagging content to allow content synchronization. It will be understood that the source content may be stored in a storage device located on the source content recording device itself, or in a storage device located away from the source content recording device (e.g., server 12, database 14, content provider storage device 30, external social media / communication source 32, cloud storage device (not shown), other remote storage devices, etc.). The source content storage device records the performance content directly from the event performance, or in other words, records the performance content in a more direct manner compared to remote user devices. For example, source content recording devices may include digital outputs directly linked to the audio outputs of performers' electronic sequencers, synthesizers, instruments, etc., or sensitive, high-specification analog / digital microphones positioned close to the performers and / or instruments to provide substantially higher sensitivity and higher quality recordings than achievable with remote user recording devices. The source content of an event performance can be recorded live and broadcast in real time, either live or at a later time after the event. Source content can be stored on stage, in recording studios, etc. Source content can be broadcast through various means such as concert venues, radio stations, nightclubs, cinemas, concert halls, theaters, and recitals. The source content of a performance event can be broadcast from anywhere on a speaker system, and users can record or capture remote content from the speaker outputs using user equipment. Source content recording can be adjusted using filters, sound engineering equipment, etc., to improve the quality of the recorded content. Conversely, remote user recording devices are typically located far from the performers between the speakers of the performance event, resulting in interference from ambient sounds, distortion, feedback, etc. Therefore, the recorded source content achieves a much higher quality level than the low quality achievable using user equipment.
[0027] Figure 4 A more detailed illustration is shown of an embodiment of the invention. Figure 1A schematic block diagram 150 of the user device recording device 22 is shown. The user device 22 includes a processor 152 and memory 154 for storing and executing a plurality of applications and processing different modules and systems of the user device and a plurality of applications for communicating with different modules and devices of the system and user. The user device 22 can include input devices 156 and output devices 158 for user input and retrieval of commands and information of the system and for communicating with different modules and devices of the system. The input devices 156 can include a microphone, a camera, etc. The output devices can include a display 159, a speaker, etc., and the user device modules can include an application 162 module for running the method and system according to an embodiment of the present application, a play content module 164 for playing media content on the user device, a write content module 166 for a user to write and share media content originating from the user device, a manage content and tagging module 168 for storing and maintaining media content residing on the user device in a content repository or storage 169, etc. It will be understood that storage of remote content and / or source content can be stored in the content repository 169 in storage means located on the user device itself, can be stored in storage means located somewhere remote from the user device (e.g. server 12, database 14, content provider storage 30, external social media / communication sources 32, cloud storage means (not shown), other remote storage means, etc.). Reference is made to Figures 5 to 8 The interaction of the different modules 60, 62, 64, 66 of the server 12, the modules 110, 112, 114, 116 of the source content recording device 20, and the modules 160, 162, 164, 166, 168 of the user device 22 are described in more detail.
[0028] Figures 5 to 7 A schematic diagram of the data structure 170, 180, 190 of the remote content and source content is shown. More specifically, Figure 5 A schematic diagram 170 of the data structure of the remote media content recorded by a user at an event performance is shown. The data structure of the remote media content 170 includes layered or dual media content, i.e. remote content B 172 layer and remote content A 174 layer. The remote content B 172 can be the video portion of the remote media content, while the remote content A 174 can be the audio portion of the remote media content. Each portion includes tags 176, 178, metadata, etc., including identification means, identification data, etc., to allow synchronization of the remote data and source data. For example, the embedded identification data tags or metadata containers can include ID3 metadata, geographical data or geo-location data with latitude and longitude coordinates, time identification data, artist name, song or track name, genre, album title, album track number, release date, etc., to identify the multimedia audio and / or video content.
[0029] Reference is made to Figure 6 , the data structure 180 shows high quality source content A 182 and associated tags 184 of source media content recorded and captured by the performer source recording device.
[0030] Reference is made to Figure 7 , the produced matched data structure 190 is shown with Figure 5 remote media content B 172 layer (with compilation, embedding and layering of the high quality source content A 182 layer of Figure 6 associated tags 184) of Figure 5 low quality remote content A 174 is stripped from the data structure 170 of remote media content recorded by the user and replaced by Figure 6 high quality source content A with associated tags 184. This results in data structure 190 having a dual data structure with some remote content captured by the user and some source content captured by the performer source recording device. In the present embodiment, remote content B 172 can be video content and remote content A 174 and source content A 182 can be audio. It will be appreciated that the content can be other forms of media content such as photographs, videos, audio etc.
[0031] The tags 176, 178, 184 provide various means of identification to enable synchronization of the content. For example, in the present embodiment, the various tags identify time and geographical location which identifies the event performance and the part of the performance that is recorded. This information is vital to accurately identify and match and synchronize the high quality source content with the remote content. For example, at some performance locations, such as multi-stage music festivals or electronic music club venues, several performances can occur simultaneously at different stages or spaces. Therefore, in such scenarios, the accuracy of the geographical location is sufficient to distinguish between the venue stages or spaces. It will be appreciated that other forms of means of identification can be used instead of, or in addition to, time identification and / or geographical location.
[0032] When the application 162 of the user device 22 communicates the identification details of the tags 178 of the low quality remote content A 174 to the server, the higher quality source content A 182 is identified and sent to the user device. The higher quality source content A 182 is synchronized with the remote content B 172.
[0033] In one embodiment, when clean audio (i.e., source content) from a club / promoter, music or track producer, track in a broadcast, etc. is received, a number of associated metadata or tags can be automatically and manually generated. The associated metadata or tags can include other information such as start and end times, geographic location, venue name, promoter, event, location, DJ(s), performer(s), theme, music type, occasion, etc. Since the source content is typically recorded by the music or track producer, event organizer, etc., the quality of the source content is of a high studio-like quality. The user recorded remote content is typically recorded from a speaker that is far away or remote from the broadcast recorded or live content. Thus, all external and internal background ambient noise at the time of the live event performance is also recorded in the remote content by the user.
[0034] When the user uploads the remote content (i.e., video, audio and / or fingerprint data associated with the audio) to the server, there can also be a number of associated metadata in the remote content recorded by the user that is generated and embedded by the application running on the recording device of the user device. Some of the associated metadata and tags associated with the user remote content can be automatically generated, such as start time, end time, clip length to obtain the end time, geographic location, time zone, etc. In addition, some of the associated metadata or tags associated with the user remote content can include tags that are manually generated by the user, such as event name, music type, etc. The associated metadata can be computed or obtained from existing automatically generated associated metadata, such as when the geographic location is known from existing geo, then the event and venue can be obtained if known or match known data. In one embodiment, the user manually generated metadata (e.g., DJ, type, etc. content) can play to enrich our clean audio data.
[0035] In one embodiment, an audio or sound fingerprint search of the remote content can be used to search a fingerprint database to match the source content. Multiple content databases or stores can be searched, such as the event content database 14, the content provider 30 databases, content repositories on the user device 150 that store existing content (that the user can have stored), etc., to find the correct portion of the source content audio to match the remote content audio. It will be understood that the source content can be searched on any number of stores, such as content stored in the content repository 169 on the user device itself, content stored in a storage device somewhere remote from the user device (such as the server 12, the database 14, the content provider storage 30, external social media / communication sources 32, cloud storage (not shown), other remote storage, etc.). Any number of databases and stored content in stores can be searched to determine if there is a match to a live or known event in the event content database 14, or if there is a known track from the content providers 30. For example, remote content recorded by a user can capture music played in the background (such as in a car while driving, in a restaurant, etc.) from a radio, jukebox, etc. The track can be identified and matched. Associated metadata from the user can be used to filter the list of potential audio segments so that the correct segment can be found more quickly, rather than searching through all existing segments that can not be relevant.
[0036] Figure 8 is a flowchart of a method 200 according to one embodiment of the present application. The method of the user device installs 202 an application on the user device, and the user records 204 remote media content of a performance. The user requests and downloads 206 the recorded source media content, and the application synchronizes 208 the user remote content with the source content. The remote content and the source content are compiled 210.
[0037] In one embodiment, the remote media content is identified in the recognition module 68 and matched to stored music tracks. The remote media content or unclean audio content can be identified and matched to source content or clean audio with a fingerprint type match. Sound fingerprinting is used in the industry and can be applied here with embodiments of the present application. Stored music tracks (such as live event performances, provided by the content providers 30 such as recorded audio tracks, etc.) can be stored in the event database 14. The remote content is identified and matched to event performances in the event database and tracks in the content provider database. For example, the media content can be classified as a live event with live event indicia and can match an event performance source content stored in the event database 14. If no match is found in the event database, the match can be made by a content provider or music application program interface (API) provider.
[0038] In an embodiment, once the clean source audio is compiled and embedded with the user's video, the user can post the user's personal remote content B 172 (capture of the user personal memento taken from the user's perspective) along with the higher quality source content A 182 to external social media, video clip capture and sharing systems, etc. Figure 1 Other users in the plurality of users 28 shown can perform several actions within the network and server, such as viewing posts, commenting on posts, tracking users who post, being prompted for similar events to occur in the future, etc.
[0039] In an embodiment, the user event content remote video and remote audio with source audio of the event is replaced with the user event content remote video and source audio. The source audio is sent to the user device and an application on the user device synchronizes the event content remote video with the source audio. It will be understood that the synchronization can occur at other devices of the plurality of systems, such as the server, the user device, etc. In an embodiment, the resulting data structure can include an mp4 format file, etc., with only the user video and source audio on the user device. It will be understood that any playback file or format can be used to playback on any number of multimedia playback applications to playback the synchronized source audio content and fan's remote video / photo content together.
[0040] In an embodiment, in addition to just video, other multimedia event related content of the user such as photos, etc. that reside on the user device (or other storage associated with the user device) along with the video, can be synchronized with the source audio. It will be understood that even some of the low quality audio taken by the fans can be overlaid on top of the source audio. This will provide an enhanced personal experience of the audio playback of the source audio with the fan's audio portion. For example, a fan can want to hear the fan's singing or reciting portion along with the playback of the source audio. In an embodiment, the resulting data structure can include an mp4 format file, etc., with the user video on the user device with the source audio and other user multimedia content. It will be understood that any playback file or format can be used to playback on any number of multimedia playback applications to playback the synchronized source audio content and fan's remote video / photo content together.
[0041] In an embodiment, the user video (e.g. photos taken during the course of the performance event) can be compiled with the source audio and source multimedia content. Typically, the photos can be taken on the same user device that is recording the video and audio portion of the event, and the photos can be taken in between the video. The photos or other multimedia content can also have the same timestamp as the video, and can be synchronized with the video. In an embodiment, the resulting data structure can include an mp4 format file, etc., with the user video on the user device with the source audio and other user multimedia content. It will be understood that any playback file or format can be used to playback on any number of multimedia playback applications to playback the synchronized source audio content and fan's remote video / photo content together. Figures 5 to 7The multiple data structures of the indicia shown (with geographic location, time stamp, etc.) are such that during playback of the source audio content and the synchronized fan's remote video / photo and other multimedia content that was taken during the performance at the specific time of the photo, the photo will be displayed for a period of time (e.g., about 1-5 seconds, etc.). In an embodiment, the resulting data structure can include an mp4 format file, etc., with the user's video (and other user multimedia content) on the user's device together with the source audio and source multimedia content provided by the source server. It will be understood that any playback file or format can be used to playback on any number of multimedia playback applications to playback the synchronized source audio content with the fan's remote video / photo.
[0042] In an embodiment, the multiple user videos in a group of users can be compiled together into a single video with the source audio. This can result in an advanced audio coding (AAC), mp4 video format file, etc., with the video and other content, such as audio from multiple user devices together with the source audio, photos, etc. The selection of the user's video / photo segments can be randomly selected, or selected from within a group of users that have some link between them, i.e., the fans have indicated their consent to share content with each other within an organized group in the user's system network. It will be understood that any playback file or format can be used to playback on any number of multimedia playback applications to playback the synchronized source audio content with the fan's remote video / photo content. It will be understood that the remote content can be recorded by the users, and the users can be members of the audience, performers, speakers holding a performance, etc.
[0043] In an embodiment, other content from content providers (e.g., sponsors, brand material from sponsors, etc.) can be compiled with the user's content and the source content audio into a single video. This can be useful if there are some gaps in the fan's video / photo during the entire length of the source audio track of the entire event performance, if it is necessary or convenient to fill in any gaps between the fan's time stamped video / photo sequence in the video portion that is synchronized with the source audio portion.
[0044] Embodiments of the application have been described herein, including the best mode known to the inventors for practicing the application. Variations of these preferred embodiments will become apparent to those of ordinary skill in the art upon reading the foregoing description. The inventors expect skilled artisans to employ such variations as appropriate, and the inventors intend for the application to embrace all such modifications and equivalents. Accordingly, the application includes all modifications and equivalents of the subject matter recited in the claims appended hereto, as permitted by applicable law. Moreover, any combination of the above-described elements in all possible variations thereof is encompassed by the application unless otherwise indicated herein or otherwise apparent to one of ordinary skill in the art in light thereof.
Claims
1. A method of replacing or augmenting audio content recorded by a first device with audio content recorded by a second device in media content recorded by the first device, the media content recorded by the first device comprising the audio content recorded by the first device synchronized with video image content recorded by the first device, the method comprising the steps of: receiving the media content recorded by the first device; performing a search of audio / acoustic tags and / or fingerprints of only the audio content recorded by the second device based on tag data and / or fingerprint data associated only with the audio content recorded by the first device to match at least a portion of the audio content recorded by the second device using only the tag data and / or fingerprint data associated only with the audio content recorded by the first device; and replacing or augmenting the audio content recorded by the first device with the matched portion of the audio content recorded by the second device by compiling the matched portion of the audio content recorded by the second device with video content of the media content recorded by the first device; wherein the compiling is performed using only the tag data and / or fingerprint data associated only with the audio content recorded by the first device, wherein the audio content recorded by the second device comprises only audio content.
2. The method of claim 1, wherein the first device records images and the method comprises compiling the images with the associated matched portion of the audio content recorded by the second device and the video image content recorded by the first device.
3. The method of claim 1, wherein the method comprises recording time and location data of the audio content of the media content recorded by the first device.
4. The method of claim 1, wherein the method comprises manually associating tags with the audio content recorded by the first device to allow synchronization of the matched portion of the audio content recorded by the second device with the video image content recorded by the first device.
5. The method of claim 1, wherein the method comprises a plurality of users each having a separate first device for recording respective synchronized audio content and video image content, wherein the method comprises repeating the steps of claim 1 for each first device's respective recorded synchronized audio content and video image content.
6. The method of claim 1, wherein the audio content recorded by the second device comprises a studio quality recording and the audio content recorded by the first device comprises a recording of lower quality audio content.
7. The method of claim 1, wherein the search of the audio / acoustic tags and / or fingerprints of the audio content recorded by the second device is performed by an audio / acoustic fingerprint database storing the audio content recorded by the second device.
8. The method of claim 1, wherein the compiled matching portion of the audio content recorded by the second device is compiled with any one or more of photos, content from content providers, or branding material from sponsors of the video image content recorded by the first device.
9. The method of claim 8, wherein the photos, content from content providers, or branding material from sponsors are used to fill gaps in the video image content of the media content recorded by the first device.
10. The method of claim 9, wherein the photos, content from content providers, or branding material from sponsors are used to fill any gaps in the video image content that occur during the length of the matching portion of the audio content recorded by the second device.
11. The method of claim 1, wherein the compiled matching portion of the audio content recorded by the second device is overlaid with other audio content recorded by the first device of the video image content recorded by the first device.
12. A device for replacing or augmenting audio content recorded by a first device with audio content recorded by a second device in media content recorded by the first device, the media content recorded by the first device including the audio content recorded by the first device synchronized with video image content recorded by the first device, the device comprising: a matching content module for performing a search of only audio / acoustic tags and / or fingerprints of the audio content recorded by the second device based on tag data and / or fingerprint data associated with the audio content recorded by the first device to match at least a portion of the audio content recorded by the second device using only the tag data and / or fingerprint data associated with the audio content recorded by the first device; a mixing content module for replacing or augmenting the audio content recorded by the first device with the matching portion of the audio content recorded by the second device; a compiler for compiling the matching portion of the audio content recorded by the second device with video content of the media content recorded by the first device; and an output device for making the compiled matching portion of the audio content available with the video content of the media content recorded by the first device; the device configured to search only audio content recorded by the second device.
13. A system for synchronizing event media content, the event media content including remote content having at least a first type of media and a second type of media recorded by a user, and source content including the first type of media, the system comprising: a server having a memory for storing machine readable instructions and a processor configured to execute the machine readable instructions; a first user electronic device having a memory for storing machine readable instructions and a processor configured to execute the machine readable instructions; The server and the first user electronic device are configured to communicate with each other over a network; wherein the server and the first user electronic device interact to perform the method according to any one of claims 1 to 11.
14. A computer readable medium storing machine readable instructions executable by a processor of a user electronic device to implement steps of the method according to any one of claims 1 to 11.
15. A computer readable medium storing machine readable instructions executable by a processor of a server to implement steps of the method according to any one of claims 1 to 11.
Citation Information
Patent Citations
Media streams synchronization
US20140192200A1